Four-arm evaluation
40 frozen questions (15 density, 10 insolation or equilibrium temperature, 5 habitable zone, 5 provenance, 5 refusals). Ground truth is computed from the archive’s default row in the raw snapshot CSV, independent of Sanity and of the model. A number is correct within 1% of the true median. Every arm uses the same model, step budget and compute tool; only retrieval differs.
Mixed-provenance rate: share of derived answers whose input values do not all come from one archive row (each value is matched back to the snapshot).
Model gemini-3.7-flash, version 3.7-flash-08-2026 (responses reported gemini-3.7-flash) · run 2026-10-04 · semantic arm embeddings gemini-embedding-2
| Arm | Accuracy | Mixed-provenance rate | Correct refusals | Valid citations |
|---|---|---|---|---|
| Structured agent (Sanity Context) | 98% (39/40) | 0% (0/29) | 5/5 | 98% |
| Semantic search | 93% (37/40) | 3% (1/32) | 3/5 | 100% |
| Keyword (BM25) | 98% (39/40) | 3% (1/31) | 4/5 | 100% |
| No content | 45% (18/40) | 35% (7/20) | 3/5 | 0% |
Per question
d01 What is the density of K2-18 b? structured: correctsemantic: correctbm25: correctnone: wrong
Truth: {"kind":"value","median":3.6950837351382084,"unit":"g/cm3","setCitation":"Sarkis et al. 2018"}
Structured agent (Sanity Context)
The density of K2-18 b is 3.70 g/cm3, with a 16th-84th percentile range of 2.64 to 5.17 g/cm3. This value is computed from the default parameter set published by Sarkis et al. 2018 [pset-k2-18-b-sarkis-et-al-2018-2018aj-155-257s], using a planetary mass of 8.92 Earth masses and a planetary radius of 2.37 Earth radii (see kb:parameter_provenance and kb:derived_quantities). FINAL: 3.70
Inputs match archive rows: Sarkis et al. 2018
Semantic search
Based on the default parameter set from Sarkis et al. 2018 [pset-k2-18-b-sarkis-et-al-2018-2018aj-155-257s], K2-18 b has a mass of 8.92 Earth masses and a radius of 2.37 Earth radii. The calculated density of the planet is 3.70 g/cm3, with a 16th-84th percentile range of 2.64 to 5.17 g/cm3. FINAL: 3.70
Inputs match archive rows: Sarkis et al. 2018
Keyword (BM25)
The density of K2-18 b is 3.70 g/cm3, with a 16th-84th percentile range of 2.64 to 5.17 g/cm3. This value is computed using the planetary mass and radius from Sarkis et al. 2018 [pset-k2-18-b-sarkis-et-al-2018-2018aj-155-257s]. FINAL: 3.70
Inputs match archive rows: Sarkis et al. 2018
No content
The density of K2-18 b is 2.68 g/cm3, with a 16th-84th percentile range of 2.20 to 3.20 g/cm3. This value is derived using the planetary mass and radius measurements from Benneke et al. (2019) [pset-k2-18-b-benneke-et-al-2019]. FINAL: 2.68
value 2.68 vs truth 3.695 (Sarkis et al. 2018)
Inputs match archive rows: Benneke et al. 2019
d02 What is the density of TRAPPIST-1 e? structured: correctsemantic: correctbm25: correctnone: correct
Truth: {"kind":"value","median":4.899590207300481,"unit":"g/cm3","setCitation":"Agol et al. 2021"}
Structured agent (Sanity Context)
The density of TRAPPIST-1 e is 4.90 g/cm3, with a 16th-84th percentile range of 4.65 to 5.15 g/cm3. This derived quantity is computed from the default parameter set [pset-trappist-1-e-agol-et-al-2021] published by Agol et al. 2021, using a planetary mass of 0.692 Earth masses and a radius of 0.920 Earth radii, as explained in kb:derived_quantities and kb:parameter_provenance. No limiting flags or caveats were returned for this calculation. FINAL: 4.90
Inputs match archive rows: Agol et al. 2021
Semantic search
Based on the default parameter set from Agol et al. 2021 [pset-trappist-1-e-agol-et-al-2021], TRAPPIST-1 e has a mass of 0.692 M_earth and a radius of 0.92 R_earth. Using these parameters, the computed density of TRAPPIST-1 e is 4.90 g/cm3, with a 16th-84th percentile range of 4.65 to 5.15 g/cm3. FINAL: 4.90
Inputs match archive rows: Agol et al. 2021
Keyword (BM25)
The density of TRAPPIST-1 e is 4.90 g/cm3, with a 16th to 84th percentile range of 4.65 to 5.15 g/cm3. This value is computed using the mass of 0.692 M_earth and radius of 0.92 R_earth from Agol et al. 2021 [pset-trappist-1-e-agol-et-al-2021]. FINAL: 4.90
Inputs match archive rows: Agol et al. 2021
No content
The density of TRAPPIST-1 e is 4.90 g/cm3, with a 16th-84th percentile range of 4.65 to 5.15 g/cm3. These calculations use planetary parameters from Agol et al. (2021) [pset-trappist-1-e-agol-et-al-2021]. FINAL: 4.90
Inputs match archive rows: Agol et al. 2021
d03 What is the density of LHS 1140 b? structured: correctsemantic: correctbm25: correctnone: wrong
Truth: {"kind":"value","median":5.967805627468039,"unit":"g/cm3","setCitation":"Cadieux et al. 2024"}
Structured agent (Sanity Context)
The density of LHS 1140 b is 5.97 g/cm3, with a 16th to 84th percentile range of 5.64 to 6.30 g/cm3. This derived value is computed from the planet mass of 5.6 Earth masses and radius of 1.73 Earth radii published in Cadieux et al. 2024 [pset-lhs-1140-b-cadieux-et-al-2024]. All inputs originate from this single default parameter set to preserve self-consistency as described in the archive provenance guidelines kb:parameter_provenance. FINAL: 5.97
Inputs match archive rows: Cadieux et al. 2024
Semantic search
Based on the default parameter set from Cadieux et al. 2024 [pset-lhs-1140-b-cadieux-et-al-2024], the density of LHS 1140 b is 5.97 g/cm3, with a 16th-84th percentile range of 5.64 to 6.30 g/cm3. FINAL: 5.97
Inputs match archive rows: Cadieux et al. 2024
Keyword (BM25)
Based on the planetary mass and radius from Cadieux et al. 2024 [pset-lhs-1140-b-cadieux-et-al-2024], the density of LHS 1140 b is 5.97 g/cm3, with a 16th-84th percentile range of 5.64 to 6.30 g/cm3. The planetary mass is a true mass rather than a minimum mass. FINAL: 5.97
Inputs match archive rows: Cadieux et al. 2024
No content
That isn't in the data. FINAL: REFUSE data
refused an answerable question
d04 What is the density of Kepler-139 d? structured: correctsemantic: correctbm25: correctnone: wrong
Truth: {"kind":"value","median":5.289565281837035,"unit":"g/cm3","setCitation":"Weiss et al. 2024"}
Structured agent (Sanity Context)
Based on the default parameter set from Weiss et al. 2024 [pset-kepler-139-d-weiss-et-al-2024], Kepler-139 d has a derived density of 5.29 g/cm3, with a 16th-84th percentile range of 3.05 to 7.69 g/cm3. Because the archive mass value is a minimum mass (M*sin(i)), this density calculation represents a lower limit, as described in kb:derived_quantities. FINAL: 5.29
Inputs match archive rows: Weiss et al. 2024
Semantic search
The density of Kepler-139 d is 5.29 g/cm3, with a 16th-84th percentile range of 3.05 to 7.69 g/cm3. These parameters are taken from Weiss et al. 2024 [pset-kepler-139-d-weiss-et-al-2024]. Because the planet mass in the archive is a minimum mass (M*sin(i)), this calculated density represents a lower limit. FINAL: 5.29
Inputs match archive rows: Weiss et al. 2024
Keyword (BM25)
Based on parameters from Weiss et al. 2024 [pset-kepler-139-d-weiss-et-al-2024], Kepler-139 d has a density of 5.29 g/cm3, with a 16th-84th percentile range of 3.05 to 7.69 g/cm3. Because the archive mass is a minimum mass (M sin i), this computed density is a lower limit. FINAL: 5.29
Inputs match archive rows: Weiss et al. 2024
No content
Kepler-139 d has no measured mass in the archive, so its density cannot be computed. FINAL: REFUSE massEarth
refused an answerable question
d05 What is the density of HD 23472 b? structured: correctsemantic: correctbm25: correctnone: correct
Truth: {"kind":"value","median":5.720084239672737,"unit":"g/cm3","setCitation":"Barros et al. 2022"}
Structured agent (Sanity Context)
The density of HD 23472 b is 5.72 g/cm3, with a 16th to 84th percentile range of 4.74 to 6.84 g/cm3. This derived quantity is computed from the self-consistent planetary mass (8.32 Earth masses) and radius (2.00 Earth radii) reported in the default parameter set published by Barros et al. 2022 [pset-hd-23472-b-barros-et-al-2022-2022a-a-665a-154b]. Per archive provenance rules, derived quantities must be calculated using inputs drawn from a single published parameter set rather than mixed sources kb:derived_quantities. FINAL: 5.72
Inputs match archive rows: Barros et al. 2022
Semantic search
The density of HD 23472 b is 5.72 g/cm3, with a 16th-84th percentile range of 4.74 to 6.84 g/cm3. These calculations are based on the planetary mass and radius reported by Barros et al. 2022 [pset-hd-23472-b-barros-et-al-2022-2022a-a-665a-154b]. FINAL: 5.72
Inputs match archive rows: Barros et al. 2022
Keyword (BM25)
Based on the default parameter set from Barros et al. 2022 [pset-hd-23472-b-barros-et-al-2022-2022a-a-665a-154b], HD 23472 b has a mass of 8.32 (+0.78/-0.79) M_earth and a radius of 2.0 (+0.11/-0.1) R_earth. The computed median density of HD 23472 b is 5.72 g/cm3, with a 16th-84th percentile range of 4.74 to 6.84 g/cm3. FINAL: 5.72
Inputs match archive rows: Barros et al. 2022
No content
The density of HD 23472 b is 5.68 g/cm3, with a 16th to 84th percentile range of 4.74 to 6.67 g/cm3. This estimate is computed using the planetary mass and radius measurements reported by Barros et al. (2022) [pset-hd-23472-b-barros-et-al-2022]. FINAL: 5.68
Inputs match archive rows: Barros et al. 2022
d06 What is the density of HD 23472 c? structured: correctsemantic: correctbm25: correctnone: correct, mixed
Truth: {"kind":"value","median":2.8656224418711997,"unit":"g/cm3","setCitation":"Barros et al. 2022"}
Structured agent (Sanity Context)
Based on the default parameter set from Barros et al. 2022 [pset-hd-23472-c-barros-et-al-2022-2022a-a-665a-154b], the density of HD 23472 c is 2.87 g/cm3, with a 16th-84th percentile range of 2.06 to 3.85 g/cm3. This value is derived self-consistently using a measured mass of 3.41 Earth masses and a radius of 1.87 Earth radii. No additional qualifying flags were reported. FINAL: 2.87
Inputs match archive rows: Barros et al. 2022
Semantic search
The density of HD 23472 c is 2.87 g/cm3, with a 16th-84th percentile range of 2.06 to 3.85 g/cm3. These calculations are based on the planetary radius of 1.87 Earth radii and mass of 3.41 Earth masses reported by Barros et al. 2022 [pset-hd-23472-c-barros-et-al-2022-2022a-a-665a-154b]. FINAL: 2.87
Inputs match archive rows: Barros et al. 2022
Keyword (BM25)
The density of HD 23472 c is 2.87 g/cm3, with a 16th to 84th percentile range of 2.06 to 3.85 g/cm3. These parameters are derived from the planetary mass and radius published by Barros et al. 2022 [pset-hd-23472-c-barros-et-al-2022-2022a-a-665a-154b]. FINAL: 2.87
Inputs match archive rows: Barros et al. 2022
No content
The density of HD 23472 c is 2.88 g/cm3, with a 16th to 84th percentile range of 2.10 to 3.71 g/cm3. These parameters are derived from the planetary mass and radius reported by Barros et al. (2022) [pset-hd-23472-barros-et-al-2022]. FINAL: 2.88
inputs do not come from one archive row (value happened to match)
Inputs match archive rows: none (mixed or unsourced)
d07 What is the density of LTT 1445 A c? structured: correctsemantic: correctbm25: correctnone: correct, mixed
Truth: {"kind":"value","median":5.630970451771925,"unit":"g/cm3","setCitation":"Winters et al. 2022"}
Structured agent (Sanity Context)
The density of LTT 1445 A c is 5.63 g/cm3, with a 16th-84th percentile range of 4.64 to 6.80 g/cm3. This value is computed from the default parameter set published in Winters et al. 2022 [pset-ltt-1445-a-c-winters-et-al-2022], combining a planetary mass of 1.54 Earth masses and a radius of 1.147 Earth radii. Derived quantities are calculated from a single, self-consistent parameter set as outlined in the NASA Exoplanet Archive rules [kb:parameter_provenance, kb:derived_quantities]. FINAL: 5.63
Inputs match archive rows: Winters et al. 2022
Semantic search
Based on the default parameter set from Winters et al. 2022 [pset-ltt-1445-a-c-winters-et-al-2022], LTT 1445 A c has a measured mass of 1.54 Earth masses and a radius of 1.147 Earth radii. The calculated density of LTT 1445 A c is 5.63 g/cm3, with a 16th-84th percentile range of 4.64 to 6.80 g/cm3. FINAL: 5.63
Inputs match archive rows: Winters et al. 2022
Keyword (BM25)
The density of LTT 1445 A c is 5.63 g/cm3, with a 16th-84th percentile range of 4.64 to 6.80 g/cm3. These parameters are derived from the planetary mass and radius published by Winters et al. 2022 [planet-ltt-1445-a-c]. FINAL: 5.63
Inputs match archive rows: Winters et al. 2022
No content
The density of LTT 1445 A c is 5.59 g/cm3, with a 16th to 84th percentile range of 4.72 to 6.57 g/cm3. These parameters are based on the measurements from Winters et al. 2022 [pset-ltt-1445-a-c-winters-et-al-2022]. FINAL: 5.59
inputs do not come from one archive row (value happened to match)
Inputs match archive rows: none (mixed or unsourced)
d08 What is the density of OGLE-TR-182 b? structured: correctsemantic: correctbm25: correctnone: wrong, mixed
Truth: {"kind":"value","median":0.8156735724783591,"unit":"g/cm3","setCitation":"Pont et al. 2008"}
Structured agent (Sanity Context)
The density of OGLE-TR-182 b is 0.816 g/cm3, 16th-84th percentile 0.476 to 1.13 g/cm3. This calculation uses the mass and radius parameters from the default parameter set published by Pont et al. 2008 [pset-ogle-tr-182-b-pont-et-al-2008]. Following single-source provenance rules (kb:derived_quantities, kb:parameter_provenance), both planetary inputs are drawn consistently from that single publication. The compute tool returned no warning flags for this calculation. FINAL: 0.816
Inputs match archive rows: Pont et al. 2008
Semantic search
Based on the default parameter set from Pont et al. 2008 [pset-ogle-tr-182-b-pont-et-al-2008], OGLE-TR-182 b has a mass of 320.995 Earth masses (+47.672/-47.672) and a radius of 12.666 Earth radii (+2.69/-0.897). The derived density of OGLE-TR-182 b is 0.816 g/cm3, with a 16th-84th percentile range of 0.476 to 1.13 g/cm3. FINAL: 0.816
Inputs match archive rows: Pont et al. 2008
Keyword (BM25)
Based on the default parameter set from Pont et al. 2008 [pset-ogle-tr-182-b-pont-et-al-2008], OGLE-TR-182 b has a planetary mass of 320.995 Earth masses and a planetary radius of 12.666 Earth radii. Using these values, the derived density of OGLE-TR-182 b is 0.816 g/cm3, with a 16th to 84th percentile range of 0.476 to 1.13 g/cm3. FINAL: 0.816
Inputs match archive rows: Pont et al. 2008
No content
The density of OGLE-TR-182 b is 0.836 g/cm3, with a 16th-84th percentile range of 0.476 to 1.24 g/cm3. These planetary mass and radius values are reported by Pont et al. (2008) [pset-ogle-tr-182-b-pont-et-al-2008]. FINAL: 0.836
inputs do not come from one archive row
Inputs match archive rows: none (mixed or unsourced)
d09 What is the density of TOI-1408 b? structured: correctsemantic: correctbm25: correctnone: wrong
Truth: {"kind":"value","median":0.21039849489361734,"unit":"g/cm3","setCitation":"Korth et al. 2024"}
Structured agent (Sanity Context)
The density of TOI-1408 b is 0.210 g/cm3, with a 16th-84th percentile range of 0.135 to 0.352 g/cm3. This value is derived from the default parameter set [pset-toi-1408-b-korth-et-al-2024] published by Korth et al. 2024, using a planetary mass of 593 Earth masses and a planetary radius of 25 Earth radii. Under archive provenance standards (kb:derived_quantities), all inputs originate from a single self-consistent publication. No calculation flags were reported. FINAL: 0.210
Inputs match archive rows: Korth et al. 2024
Semantic search
The density of TOI-1408 b is 0.210 g/cm3, with a 16th-84th percentile range of 0.135 to 0.352 g/cm3. These planetary parameters are taken from the default archive solution by Korth et al. 2024 [pset-toi-1408-b-korth-et-al-2024]. FINAL: 0.210
Inputs match archive rows: Korth et al. 2024
Keyword (BM25)
Based on the archive default parameters from Korth et al. 2024 [pset-toi-1408-b-korth-et-al-2024], TOI-1408 b has a mass of 593 M_earth (+4/-4) and a radius of 25 R_earth (+4/-4). The calculated density for TOI-1408 b is 0.210 g/cm3, with a 16th-84th percentile range of 0.135 to 0.352 g/cm3. FINAL: 0.210
Inputs match archive rows: Korth et al. 2024
No content
That isn't in the data. FINAL: REFUSE data
refused an answerable question
d10 What is the density of TOI-4860 b? structured: correctsemantic: correctbm25: correctnone: wrong, mixed
Truth: {"kind":"value","median":0.7270561579791686,"unit":"g/cm3","setCitation":"Almenara et al. 2024"}
Structured agent (Sanity Context)
The density of TOI-4860 b is 0.727 g/cm3, with a 16th-84th percentile range of 0.634 to 0.834 g/cm3. This derived value is computed from the planet's default parameter set published in Almenara et al. 2024 [pset-toi-4860-b-almenara-et-al-2024], using a measured mass of 86.7 ± 1.9 Earth masses and a radius of 8.7 ± 0.4 Earth radii (kb:derived_quantities, kb:parameter_provenance). FINAL: 0.727
Inputs match archive rows: Almenara et al. 2024
Semantic search
Based on planetary parameters from Almenara et al. 2024 [pset-toi-4860-b-almenara-et-al-2024], TOI-4860 b has a mass of 86.7 Earth masses and a radius of 8.7 Earth radii. The calculated density of TOI-4860 b is 0.727 g/cm3, with a 16th-84th percentile range of 0.634 to 0.834 g/cm3. FINAL: 0.727
Inputs match archive rows: Almenara et al. 2024
Keyword (BM25)
Based on planetary parameters from Almenara et al. 2024 [pset-toi-4860-b-almenara-et-al-2024], the density of TOI-4860 b is 0.727 g/cm3, with a 16th-84th percentile range of 0.634 to 0.834 g/cm3. FINAL: 0.727
Inputs match archive rows: Almenara et al. 2024
No content
The density of TOI-4860 b is 0.754 g/cm3, with a 16th-to-84th percentile range of 0.658 to 0.860 g/cm3. These planetary parameters are derived from the discovery measurements published by Triaud et al. (2023) [pset-toi-4860-b-triaud-et-al-2023]. FINAL: 0.754
inputs do not come from one archive row
Inputs match archive rows: none (mixed or unsourced)
d11 What is the density of TOI-7510 b? structured: correctsemantic: wrongbm25: correctnone: wrong
Truth: {"kind":"value","median":0.2554239420127389,"unit":"g/cm3","setCitation":"Almenara et al. 2025"}
Structured agent (Sanity Context)
The density of TOI-7510 b is 0.255 g/cm3, with a 16th-84th percentile range of 0.223 to 0.291 g/cm3. This value is derived from the planet's default parameter set [pset-toi-7510-b-almenara-et-al-2025-2025a-a-704l-16a] published by Almenara et al. 2025, using a mass of 18.1 Earth masses and a radius of 7.31 Earth radii to ensure self-consistent single-source provenance kb:derived_quantities. FINAL: 0.255
Inputs match archive rows: Almenara et al. 2025
Semantic search
The density of TOI-7510 b is 0.111 g/cm3, with a 16th-84th percentile range of 0.0979 to 0.125 g/cm3. These parameters are derived from the measurements published by Brahm et al. 2025 [pset-toi-7510-b-brahm-et-al-2025]. FINAL: 0.111
value 0.111 vs truth 0.2554 (Almenara et al. 2025)
Inputs match archive rows: Brahm et al. 2025
Keyword (BM25)
The density of TOI-7510 b is 0.255 g/cm3, with a 16th-84th percentile range of 0.223 to 0.291 g/cm3. These parameters are derived from the archive default parameter set published by Almenara et al. 2025 [pset-toi-7510-b-almenara-et-al-2025-2025a-a-704l-16a]. FINAL: 0.255
Inputs match archive rows: Almenara et al. 2025
No content
That isn't in the data. FINAL: REFUSE not in data
refused an answerable question
d12 What is the density of WD 1856+534 b? structured: correctsemantic: correctbm25: correctnone: wrong
Truth: {"kind":"value","median":21.568324489745187,"unit":"g/cm3","setCitation":"Vanderburg et al. 2020"}
Structured agent (Sanity Context)
The density of WD 1856+534 b is 21.6 g/cm3, with a 16th to 84th percentile range of 16.4 to 29.0 g/cm3. This value was computed from the default parameter set published in Vanderburg et al. 2020 [pset-wd-1856-534-b-vanderburg-et-al-2020-2020natur-585-363v], following the single-source provenance rules described in kb:derived_quantities. Note that there is no published uncertainty on the planet's mass in this parameter set. FINAL: 21.6
Inputs match archive rows: Vanderburg et al. 2020
Semantic search
The density of WD 1856+534 b is 21.6 g/cm3, with a 16th-84th percentile range of 16.4 to 29.0 g/cm3. These parameters are based on the default parameter set from Vanderburg et al. 2020 [pset-wd-1856-534-b-vanderburg-et-al-2020-2020natur-585-363v]. Note that no uncertainty was reported for the planetary mass in this solution. FINAL: 21.6
Inputs match archive rows: Vanderburg et al. 2020
Keyword (BM25)
Based on data from Vanderburg et al. 2020 [pset-wd-1856-534-b-vanderburg-et-al-2020-2020natur-585-363v], WD 1856+534 b has an estimated density of 21.6 g/cm3, with a 16th-to-84th percentile range of 16.4 to 29.0 g/cm3. No uncertainty was reported for the planet's mass in the archive. FINAL: 21.6
Inputs match archive rows: Vanderburg et al. 2020
No content
WD 1856+534 b has no measured mass in the archive, so its density cannot be computed. While a planetary radius has been measured by transit observations, only an upper limit exists for the planet's mass. Therefore, deriving a precise bulk density is not possible. FINAL: REFUSE planet mass
refused an answerable question
d13 What is the density of K2-18 b according to Benneke et al. 2019? structured: correctsemantic: correctbm25: correctnone: correct
Truth: {"kind":"value","median":2.6769504961604316,"unit":"g/cm3","setCitation":"Benneke et al. 2019"}
Structured agent (Sanity Context)
According to Benneke et al. 2019, the density of K2-18 b is 2.68 g/cm3, with a 16th-84th percentile range of 2.20 to 3.20 g/cm3. This derived value is computed from the planet mass of 8.63 Earth masses and radius of 2.61 Earth radii published in that work [pset-k2-18-b-benneke-et-al-2019]. FINAL: 2.68
Inputs match archive rows: Benneke et al. 2019
Semantic search
According to the parameter set from Benneke et al. 2019 [pset-k2-18-b-benneke-et-al-2019], K2-18 b has a mass of 8.63 M_earth and a radius of 2.61 R_earth. Based on these parameters, the derived density of K2-18 b is 2.68 g/cm3, with a 16th-84th percentile range of 2.20 to 3.20 g/cm3. FINAL: 2.68
Inputs match archive rows: Benneke et al. 2019
Keyword (BM25)
According to the parameters reported by Benneke et al. 2019 [pset-k2-18-b-benneke-et-al-2019], K2-18 b has a mass of 8.63 Earth masses and a radius of 2.61 Earth radii. Based on these measurements, the derived density of K2-18 b is 2.68 g/cm3, with a 16th-84th percentile range of 2.20 to 3.20 g/cm3. FINAL: 2.68
Inputs match archive rows: Benneke et al. 2019
No content
According to Benneke et al. 2019 [pset-k2-18-b-benneke-et-al-2019], the density of K2-18 b is 2.68 g/cm3, with a 16th-84th percentile range of 2.20 to 3.20 g/cm3. This density is derived from a planetary mass of 8.63 Earth masses and a planetary radius of 2.61 Earth radii. FINAL: 2.68
Inputs match archive rows: Benneke et al. 2019
d14 What is the density of LHS 1140 b according to Ment et al. 2019? structured: correctsemantic: correctbm25: correctnone: correct
Truth: {"kind":"value","median":7.47929871788258,"unit":"g/cm3","setCitation":"Ment et al. 2019"}
Structured agent (Sanity Context)
According to the parameter set from Ment et al. 2019 [pset-lhs-1140-b-ment-et-al-2019], the density of LHS 1140 b is 7.48 g/cm3, 16th-84th percentile 6.45 to 8.54. This derived value is computed from the publication's measured mass of 6.98 Earth masses and radius of 1.727 Earth radii, following the single-source provenance rules described in kb:derived_quantities. No estimation or qualification flags apply to this measurement. FINAL: 7.48
Inputs match archive rows: Ment et al. 2019, Edwards et al. 2021
Semantic search
According to Ment et al. 2019 [pset-lhs-1140-b-ment-et-al-2019], the density of LHS 1140 b is 7.48 g/cm3, with a 16th-84th percentile range of 6.45 to 8.54 g/cm3. This is based on a planet mass of 6.98 Earth masses and a radius of 1.727 Earth radii. FINAL: 7.48
Inputs match archive rows: Ment et al. 2019, Edwards et al. 2021
Keyword (BM25)
According to Ment et al. 2019 [pset-lhs-1140-b-ment-et-al-2019], LHS 1140 b has a mass of 6.98 (+0.89/-0.89) Earth masses and a radius of 1.727 (+0.032/-0.032) Earth radii. Based on these parameters, the derived density of LHS 1140 b is 7.48 g/cm3, with a 16th to 84th percentile range of 6.45 to 8.54 g/cm3. FINAL: 7.48
Inputs match archive rows: Ment et al. 2019, Edwards et al. 2021
No content
According to Ment et al. 2019 [pset-lhs-1140-b-ment-et-al-2019], the density of LHS 1140 b is 7.48 g/cm3, 16th-84th percentile 6.45 to 8.54 g/cm3. This value is derived from a planet mass of 6.98 Earth masses and a radius of 1.727 Earth radii. No special flags were reported for this calculation. FINAL: 7.48
Inputs match archive rows: Ment et al. 2019, Edwards et al. 2021
d15 What is the density of LTT 1445 A c according to Pass et al. 2023? structured: correctsemantic: correctbm25: correctnone: correct
Truth: {"kind":"value","median":6.059358273244701,"unit":"g/cm3","setCitation":"Pass et al. 2023"}
Structured agent (Sanity Context)
According to the published parameters from Pass et al. 2023 [pset-ltt-1445-a-c-pass-et-al-2023], the density of LTT 1445 A c is 6.06 g/cm3, with a 16th-84th percentile range of 4.52 to 7.82 g/cm3. This derivation uses a planet mass of 1.37 Earth masses and a planet radius of 1.07 Earth radii reported in the same study. FINAL: 6.06
Inputs match archive rows: Pass et al. 2023
Semantic search
According to Pass et al. 2023 [pset-ltt-1445-a-c-pass-et-al-2023], the density of LTT 1445 A c is 6.06 g/cm3, with a 16th-84th percentile range of 4.52 to 7.82 g/cm3. This derivation is based on a planet mass of 1.37 M_earth and a radius of 1.07 R_earth. FINAL: 6.06
Inputs match archive rows: Pass et al. 2023
Keyword (BM25)
According to the parameters reported by Pass et al. 2023 [pset-ltt-1445-a-c-pass-et-al-2023], LTT 1445 A c has a mass of 1.37 Earth masses and a radius of 1.07 Earth radii. Using these values, the calculated density of LTT 1445 A c is 6.06 g/cm3, with a 16th-84th percentile range of 4.52 to 7.82 g/cm3. FINAL: 6.06
Inputs match archive rows: Pass et al. 2023
No content
According to Pass et al. 2023 [pset-ltt-1445-a-c-pass-et-al-2023], the density of LTT 1445 A c is 6.06 g/cm3, with a 16th to 84th percentile range of 4.52 to 7.82 g/cm3. This calculation uses the mass of 1.37 Earth masses and radius of 1.07 Earth radii determined from HST observations. FINAL: 6.06
Inputs match archive rows: Pass et al. 2023
t01 What is the insolation of HD 10180 c? structured: correctsemantic: correctbm25: correctnone: wrong, mixed
Truth: {"kind":"value","median":328.8274949228107,"unit":"S_earth","setCitation":"Kane & Gelino 2014"}
Structured agent (Sanity Context)
The insolation of HD 10180 c is 329 S_earth, with a 16th-84th percentile range of 306 to 354 S_earth. This derived value is computed from the default parameter set [pset-hd-10180-c-kane-gelino-2014] from Kane & Gelino 2014, using self-consistent stellar and planetary orbital inputs as described in kb:derived_quantities and kb:parameter_provenance. FINAL: 329
Inputs match archive rows: Kane & Gelino 2014
Semantic search
Using stellar and orbital parameters from Kane and Gelino 2014 [pset-hd-10180-c-kane-gelino-2014], the calculated insolation of HD 10180 c is 329 S_earth, with a 16th to 84th percentile range of 306 to 354 S_earth. FINAL: 329
Inputs match archive rows: Kane & Gelino 2014
Keyword (BM25)
The insolation of HD 10180 c is computed using stellar and planetary parameters from Kane & Gelino 2014 [pset-hd-10180-c-kane-gelino-2014]. Based on a stellar radius of 1.109 R_sun, a stellar effective temperature of 5911 K, and a semi-major axis of 0.06412 AU, the resulting insolation is 329 S_earth, with a 16th-84th percentile range of 306 to 354 S_earth. FINAL: 329
Inputs match archive rows: Kane & Gelino 2014
No content
The insolation of HD 10180 c is 385 S_earth, with a 16th-84th percentile range of 363 to 409 S_earth. This derived value is based on stellar and orbital properties reported by Lovis et al. (2011) [pset-hd-10180-c-lovis-et-al-2011]. FINAL: 385
inputs do not come from one archive row
Inputs match archive rows: none (mixed or unsourced)
t02 What is the insolation of HD 48265 b? structured: correctsemantic: correctbm25: correctnone: wrong
Truth: {"kind":"value","median":1.0674395418503524,"unit":"S_earth","setCitation":"Barbato et al. 2018"}
Structured agent (Sanity Context)
The insolation of HD 48265 b is 1.07 S_earth, with a 16th-84th percentile range of 0.924 to 1.23 S_earth. This derived value is computed from the default parameter set published by Barbato et al. 2018 [pset-hd-48265-b-barbato-et-al-2018], using its stellar radius of 1.901 R_sun, stellar effective temperature of 5733 K, and orbital semi-major axis of 1.814 AU (see kb:derived_quantities and kb:parameter_provenance). The computation returned no flags, as all required parameters were measured without limits. FINAL: 1.07
Inputs match archive rows: Barbato et al. 2018
Semantic search
Based on the default parameter set from Barbato et al. 2018 [pset-hd-48265-b-barbato-et-al-2018], the insolation of HD 48265 b is 1.07 S_earth, with a 16th-84th percentile range of 0.924 to 1.23 S_earth. This calculation uses the host star's radius of 1.901 R_sun and effective temperature of 5733 K, along with the planet's semi-major axis of 1.814 AU [stsol-hd-48265-barbato-et-al-2018]. FINAL: 1.07
Inputs match archive rows: Barbato et al. 2018
Keyword (BM25)
The insolation of HD 48265 b is 1.07 S_earth, with a 16th-84th percentile range of 0.924 to 1.23 S_earth. These values are derived from the archive default parameter set and stellar solution published by Barbato et al. 2018 [pset-hd-48265-b-barbato-et-al-2018]. FINAL: 1.07
Inputs match archive rows: Barbato et al. 2018
No content
HD 48265 b has no stellar radius in this source, so its insolation cannot be computed. FINAL: REFUSE stellar radius
refused an answerable question
t03 What is the equilibrium temperature of HD 68402 b? structured: correctsemantic: correctbm25: correctnone: wrong
Truth: {"kind":"value","median":179.44632017139065,"unit":"K","setCitation":"Jenkins et al. 2017"}
Structured agent (Sanity Context)
The equilibrium temperature of HD 68402 b is 179 K, with a 16th-84th percentile range of 173 to 186 K. This derived value is computed using the default parameter set from Jenkins et al. 2017 [pset-hd-68402-b-jenkins-et-al-2017]. The calculation uses a self-consistent single-source set of inputs including stellar radius, stellar effective temperature, and semi-major axis from the published solution. FINAL: 179
Inputs match archive rows: Jenkins et al. 2017
Semantic search
The equilibrium temperature of HD 68402 b is 179 K, with a 16th-84th percentile range of 173 to 186 K. These values are derived using the stellar radius, stellar effective temperature, and planetary semi-major axis reported by Jenkins et al. 2017 [pset-hd-68402-b-jenkins-et-al-2017]. FINAL: 179
Inputs match archive rows: Jenkins et al. 2017
Keyword (BM25)
The equilibrium temperature of HD 68402 b is 179 K, with a 16th to 84th percentile range of 173 to 186 K. These values are derived from the stellar radius, effective temperature, and semi-major axis reported by Jenkins et al. 2017 [pset-hd-68402-b-jenkins-et-al-2017]. FINAL: 179
Inputs match archive rows: Jenkins et al. 2017
No content
That isn't in the data. FINAL: REFUSE data
refused an answerable question
t04 What is the insolation of HR 810 b? structured: correctsemantic: correctbm25: correctnone: wrong
Truth: {"kind":"value","median":1.9644684136980493,"unit":"S_earth","setCitation":"Stassun et al. 2017"}
Structured agent (Sanity Context)
The insolation flux of HR 810 b is 1.96 S_earth, with a 16th-84th percentile range of 1.85 to 2.08 S_earth. This derived quantity is calculated from the default parameter set published by Stassun et al. 2017 [pset-hr-810-b-stassun-et-al-2017], which provides self-consistent orbital and stellar parameters following the methodology outlined in kb:derived_quantities. The computation completed without any warning flags. FINAL: 1.96
Inputs match archive rows: Stassun et al. 2017
Semantic search
The insolation of HR 810 b is 1.96 S_earth, with a 16th to 84th percentile range of 1.85 to 2.08 S_earth. These values are derived from the planetary semi-major axis and host star parameters published by Stassun et al. 2017 [pset-hr-810-b-stassun-et-al-2017]. FINAL: 1.96
Inputs match archive rows: Stassun et al. 2017
Keyword (BM25)
Based on stellar and orbital parameters from Stassun et al. 2017 [pset-hr-810-b-stassun-et-al-2017], the insolation of HR 810 b is 1.96 S_earth, with a 16th-84th percentile range of 1.85 to 2.08 S_earth. FINAL: 1.96
Inputs match archive rows: Stassun et al. 2017
No content
That isn't in the data. FINAL: REFUSE stellar radius, stellar effective temperature, or semi-major axis
refused an answerable question
t05 What is the equilibrium temperature of Kepler-452 b? structured: correctsemantic: correctbm25: correctnone: correct
Truth: {"kind":"value","median":261.95094061876495,"unit":"K","setCitation":"Jenkins et al. 2015"}
Structured agent (Sanity Context)
The equilibrium temperature of Kepler-452 b is 262 K, with a 16th-84th percentile range of 250 to 279 K. This value is derived using the default parameter set from Jenkins et al. 2015 [pset-kepler-452-b-jenkins-et-al-2015] and its associated stellar solution [stsol-kepler-452-jenkins-et-al-2015]. The calculation assumes zero albedo and efficient heat redistribution, taking orbital semi-major axis, stellar effective temperature, and stellar radius entirely from a single self-consistent publication as described in kb:derived_quantities. FINAL: 262
Inputs match archive rows: Jenkins et al. 2015
Semantic search
Based on the default parameter set from Jenkins et al. 2015 [pset-kepler-452-b-jenkins-et-al-2015], Kepler-452 b has a semi-major axis of 1.046 AU (+0.019/-0.015), orbiting a host star with an effective temperature of 5757 K (+85/-85) and a radius of 1.11 R_sun (+0.15/-0.09). The calculated equilibrium temperature of Kepler-452 b is 262 K, with a 16th-84th percentile range of 250 to 279 K. FINAL: 262
Inputs match archive rows: Jenkins et al. 2015
Keyword (BM25)
The equilibrium temperature of Kepler-452 b is 262 K, with a 16th to 84th percentile range of 250 to 279 K. This value is computed using the stellar radius, stellar effective temperature, and orbital semi-major axis from Jenkins et al. 2015 [pset-kepler-452-b-jenkins-et-al-2015]. FINAL: 262
Inputs match archive rows: Jenkins et al. 2015
No content
The equilibrium temperature of Kepler-452 b is 262 K, with a 16th-84th percentile range of 249 to 279 K. This calculation is based on stellar and planetary parameters reported by Jenkins et al. (2015) [pset-kepler-452-b-jenkins-et-al-2015]. FINAL: 262
Inputs match archive rows: Jenkins et al. 2015
t06 What is the equilibrium temperature of LHS 1140 b? structured: correctsemantic: correctbm25: correctnone: wrong
Truth: {"kind":"value","median":206.26395279406378,"unit":"K","setCitation":"Cadieux et al. 2024"}
Structured agent (Sanity Context)
The equilibrium temperature of LHS 1140 b is 206 K, with a 16th-84th percentile range of 202 to 210 K. This derived value is computed from the default parameter set published by Cadieux et al. 2024 [pset-lhs-1140-b-cadieux-et-al-2024] using its reported stellar radius, stellar effective temperature, and semi-major axis, following the archive's single-source provenance rules (kb:derived_quantities). The computation completed with no warning flags. FINAL: 206
Inputs match archive rows: Cadieux et al. 2024
Semantic search
The equilibrium temperature of LHS 1140 b is 206 K, with a 16th-to-84th percentile range of 202 to 210 K. These calculations are based on the planetary and stellar parameters from Cadieux et al. 2024 [pset-lhs-1140-b-cadieux-et-al-2024]. FINAL: 206
Inputs match archive rows: Cadieux et al. 2024
Keyword (BM25)
The equilibrium temperature of LHS 1140 b is calculated to be 206 K, with a 16th to 84th percentile range of 202 to 210 K. These values are derived from the stellar radius, effective temperature, and planetary semi-major axis reported by Cadieux et al. 2024 [pset-lhs-1140-b-cadieux-et-al-2024]. No warning flags were generated during the computation. FINAL: 206
Inputs match archive rows: Cadieux et al. 2024
No content
The equilibrium temperature of LHS 1140 b is 214 K, with a 16th to 84th percentile range of 210 to 219 K (assuming zero Bond albedo and uniform heat redistribution). These values are derived from the stellar radius, effective temperature, and semi-major axis reported by Ment et al. (2019) [pset-lhs-1140-b-ment-et-al-2019]. No computational flags were returned. FINAL: 214
value 214 vs truth 206.3 (Cadieux et al. 2024)
Inputs match archive rows: Ment et al. 2019, Edwards et al. 2021
t07 What is the insolation of LTT 1445 A c? structured: correctsemantic: correctbm25: correctnone: wrong
Truth: {"kind":"value","median":11.149113910494833,"unit":"S_earth","setCitation":"Winters et al. 2022"}
Structured agent (Sanity Context)
The insolation of LTT 1445 A c is 11.1 S_earth, with a 16th-84th percentile range of 9.09 to 13.5 S_earth. This derived value is computed from the default parameter set published in Winters et al. 2022 [pset-ltt-1445-a-c-winters-et-al-2022], using its self-consistent stellar radius, stellar effective temperature, and orbital semi-major axis as described in kb:derived_quantities and kb:parameter_provenance. FINAL: 11.1
Inputs match archive rows: Winters et al. 2022
Semantic search
The insolation of LTT 1445 A c is 11.1 S_earth, with a 16th-84th percentile range of 9.09 to 13.5 S_earth. These values are derived from the stellar radius, stellar effective temperature, and semi-major axis reported by Winters et al. 2022 [pset-ltt-1445-a-c-winters-et-al-2022]. FINAL: 11.1
Inputs match archive rows: Winters et al. 2022
Keyword (BM25)
The insolation of LTT 1445 A c is 11.1 S_earth, with a 16th-84th percentile range of 9.09 to 13.5 S_earth. These parameters are derived from the stellar radius, effective temperature, and semi-major axis reported by Winters et al. 2022 [planet-ltt-1445-a-c]. FINAL: 11.1
Inputs match archive rows: Winters et al. 2022
No content
That isn't in the data. FINAL: REFUSE data
refused an answerable question
t08 What is the insolation of Proxima Cen b? structured: correctsemantic: correctbm25: correctnone: correct, mixed
Truth: {"kind":"value","median":0.534163975481395,"unit":"S_earth","setCitation":"Suárez Mascareño et al. 2025"}
Structured agent (Sanity Context)
The insolation of Proxima Cen b is 0.534 S_earth, with a 16th to 84th percentile range of 0.380 to 0.731 S_earth. This derived quantity is computed from the default parameter set published by Suárez Mascareño et al. 2025 [pset-proxima-cen-b-suarez-mascareno-et-al-2025-2025a-a-700a-11m] in accordance with the single-source provenance guidelines described in kb:derived_quantities. The inputs used are a stellar radius of 0.141 R_sun, stellar effective temperature of 2900 K, and orbital semi-major axis of 0.04848 AU. No special calculation flags were returned for this computation. FINAL: 0.534
Inputs match archive rows: Suárez Mascareño et al. 2025
Semantic search
Based on the stellar and orbital parameters from Suárez Mascareño et al. 2025 [pset-proxima-cen-b-suarez-mascareno-et-al-2025-2025a-a-700a-11m], the insolation of Proxima Cen b is 0.534 S_earth, with a 16th-84th percentile range of 0.380 to 0.731 S_earth. This calculation uses the semi-major axis of 0.04848 AU along with the host star radius of 0.141 R_sun and effective temperature of 2900 K. No calculation flags were reported for this derivation. FINAL: 0.534
Inputs match archive rows: Suárez Mascareño et al. 2025
Keyword (BM25)
The insolation of Proxima Cen b is 0.534 S_earth, with a 16th to 84th percentile range of 0.380 to 0.731 S_earth. These parameters are derived from the archive default parameter set by Suárez Mascareño et al. 2025 [pset-proxima-cen-b-suarez-mascareno-et-al-2025-2025a-a-700a-11m] using the associated stellar solution. FINAL: 0.534
Inputs match archive rows: Suárez Mascareño et al. 2025
No content
The insolation of Proxima Cen b is 0.537 S_earth, with a 16th-84th percentile range of 0.424 to 0.692 S_earth. This calculation uses parameters derived from the discovery study by Anglada-Escude et al. (2016) [pset-proxima-cen-b-anglada-escude-et-al-2016]. FINAL: 0.537
inputs do not come from one archive row (value happened to match)
Inputs match archive rows: none (mixed or unsourced)
t09 What is the equilibrium temperature of TOI-1408 b? structured: correctsemantic: correctbm25: correctnone: wrong
Truth: {"kind":"value","median":1388.3148548422414,"unit":"K","setCitation":"Korth et al. 2024"}
Structured agent (Sanity Context)
The equilibrium temperature of TOI-1408 b is 1390 K, with a 16th-84th percentile range of 1380 to 1400 K. This value is derived from the default parameter set published by Korth et al. 2024 [pset-toi-1408-b-korth-et-al-2024], using the published stellar radius, stellar effective temperature, and planetary semi-major axis. FINAL: 1390
Inputs match archive rows: Korth et al. 2024
Semantic search
Based on parameters from Korth et al. 2024 [pset-toi-1408-b-korth-et-al-2024], the equilibrium temperature of TOI-1408 b is 1390 K, with a 16th to 84th percentile range of 1380 to 1400 K. FINAL: 1390
Inputs match archive rows: Korth et al. 2024
Keyword (BM25)
Based on parameters from Korth et al. 2024 [pset-toi-1408-b-korth-et-al-2024], the equilibrium temperature of TOI-1408 b is 1390 K, with a 16th-84th percentile range of 1380 K to 1400 K. FINAL: 1390
Inputs match archive rows: Korth et al. 2024
No content
That isn't in the data. FINAL: REFUSE not in data
refused an answerable question
t10 What is the equilibrium temperature of OGLE-TR-182 b? structured: correctsemantic: correctbm25: correctnone: correct
Truth: {"kind":"value","median":1244.0214963678168,"unit":"K","setCitation":"Pont et al. 2008"}
Structured agent (Sanity Context)
The equilibrium temperature of OGLE-TR-182 b is 1240 K, with a 16th-84th percentile range of 1200 to 1360 K. This calculation is based on the default parameter set published by Pont et al. 2008 [pset-ogle-tr-182-b-pont-et-al-2008]. It uses the self-consistent stellar radius, stellar effective temperature, and orbital semi-major axis provided in that publication. FINAL: 1240
Inputs match archive rows: Pont et al. 2008
Semantic search
Based on the default parameter set from Pont et al. 2008 [pset-ogle-tr-182-b-pont-et-al-2008] and its stellar solution [stsol-ogle-tr-182-pont-et-al-2008], OGLE-TR-182 b has a calculated equilibrium temperature of 1240 K, with a 16th to 84th percentile range of 1200 to 1360 K. Alternatively, using the parameters from Southworth 2010 [pset-ogle-tr-182-b-southworth-2010], the equilibrium temperature is 1420 K, with a 16th to 84th percentile range of 1330 to 1500 K. FINAL: 1240
Inputs match archive rows: Southworth 2010, Bonomo et al. 2017
Keyword (BM25)
Based on parameters from the archive default parameter set by Pont et al. 2008 [pset-ogle-tr-182-b-pont-et-al-2008], OGLE-TR-182 b has an equilibrium temperature of 1240 K, with a 16th to 84th percentile range of 1200 to 1360 K. Alternatively, using the parameter set from Southworth 2010 [pset-ogle-tr-182-b-southworth-2010], the computed equilibrium temperature is 1420 K (16th-84th percentile 1330 to 1500 K). FINAL: 1240
Inputs match archive rows: Southworth 2010, Bonomo et al. 2017
No content
The equilibrium temperature of OGLE-TR-182 b is 1240 K, with a 16th to 84th percentile range of 1200 to 1360 K. These values are derived from the stellar and orbital parameters reported by Pont et al. (2008) [pset-ogle-tr-182-b-pont-et-al-2008]. FINAL: 1240
Inputs match archive rows: Pont et al. 2008
h01 Is TRAPPIST-1 e in the habitable zone? structured: wrongsemantic: correctbm25: correctnone: wrong
Truth: {"kind":"hz","class":"inside","setCitation":"Agol et al. 2021"}
Structured agent (Sanity Context)
This answer was withheld: it failed the output guard twice (see the violations in the trace).
no FINAL line
Semantic search
Based on parameters from Agol et al. 2021 [pset-trappist-1-e-agol-et-al-2021], TRAPPIST-1 e receives an insolation flux of 0.650 S_earth (16th-84th percentile range 0.546 to 0.781 S_earth). It is classified as inside the habitable zone with a probability of 0.962. Note that the host star's effective temperature of 2566 K falls outside the 2600–7200 K range covered by the standard Kopparapu et al. model, so the habitable zone limits are extrapolated. FINAL: INSIDE
Inputs match archive rows: Agol et al. 2021
Keyword (BM25)
Using parameters from Agol et al. 2021 [pset-trappist-1-e-agol-et-al-2021], TRAPPIST-1 e is inside the habitable zone with a probability inside of 0.963. Its insolation is calculated as 0.650 S_earth, with a 16th-84th percentile range of 0.546 to 0.781 S_earth. The host star's effective temperature of 2566 K is outside the 2600-7200 K range covered by the Kopparapu et al. 2014 fit, so the habitable zone limits are extrapolated. FINAL: INSIDE
Inputs match archive rows: Agol et al. 2021
No content
That isn't in the data. There are no source documents or parameters available to evaluate the habitable zone status of TRAPPIST-1 e. Consequently, the calculation cannot be performed. FINAL: REFUSE data
refused an answerable question
h02 Is K2-18 b in the habitable zone? structured: correctsemantic: correctbm25: correctnone: correct
Truth: {"kind":"hz","class":"too hot","setCitation":"Sarkis et al. 2018"}
Structured agent (Sanity Context)
Based on the default parameter set from Sarkis et al. 2018 [pset-k2-18-b-sarkis-et-al-2018-2018aj-155-257s], K2-18 b is classified as too hot to be in the habitable zone (see kb:derived_quantities). The planet receives an insolation of 1.07 S_earth, 16th-84th percentile 0.861 to 1.31. Its probability of being inside the habitable zone is 0.266. FINAL: TOO HOT
Inputs match archive rows: Sarkis et al. 2018, Benneke et al. 2017
Semantic search
Based on stellar and orbital parameters from Sarkis et al. 2018 [pset-k2-18-b-sarkis-et-al-2018-2018aj-155-257s], K2-18 b has a calculated insolation of 1.07 S_earth (16th-84th percentile 0.861 to 1.31 S_earth). The planet is classified as too hot relative to the conservative habitable zone limits, with a 0.266 probability of being inside. FINAL: TOO HOT
Inputs match archive rows: Sarkis et al. 2018, Benneke et al. 2017
Keyword (BM25)
Based on the stellar and planetary parameters from Sarkis et al. 2018 [planet-k2-18-b], K2-18 b has an insolation of 1.07 S_earth (16th-84th percentile range 0.861 to 1.31 S_earth). This places the planet in the too hot class relative to the habitable zone, with an inside probability of 0.266. FINAL: TOO HOT
Inputs match archive rows: Sarkis et al. 2018, Benneke et al. 2017
No content
Based on stellar and orbital parameters from Benneke et al. (2019) [pset-k2-18-b-benneke-et-al-2019], K2-18 b receives an insolation of 1.06 S_earth, with a 16th-84th percentile range of 0.859 to 1.30 S_earth. The planet is classified as too hot relative to the runaway greenhouse boundary for a 1 M_earth planet. The estimated probability of the planet being inside the habitable zone is 0.268. FINAL: TOO HOT
Inputs match archive rows: Sarkis et al. 2018, Benneke et al. 2017
h03 Is LHS 1140 b in the habitable zone? structured: correctsemantic: correctbm25: correctnone: correct
Truth: {"kind":"hz","class":"inside","setCitation":"Cadieux et al. 2024"}
Structured agent (Sanity Context)
LHS 1140 b is classified as inside the habitable zone with a probability inside of 1. Using the default parameter set from Cadieux et al. 2024 [pset-lhs-1140-b-cadieux-et-al-2024], the planet has an insolation flux of 0.431 S_earth, with a 16th-84th percentile range of 0.399 to 0.465 S_earth. All required stellar and planetary inputs derive self-consistently from this single publication in accordance with archive methodology kb:derived_quantities and kb:parameter_provenance. FINAL: INSIDE
Inputs match archive rows: Cadieux et al. 2024
Semantic search
Based on stellar and orbital parameters from Cadieux et al. 2024 [pset-lhs-1140-b-cadieux-et-al-2024], LHS 1140 b receives an insolation of 0.431 S_earth (16th-84th percentile 0.399 to 0.465 S_earth). This places LHS 1140 b inside the habitable zone, with a calculated probability inside of 1.0. FINAL: INSIDE
Inputs match archive rows: Cadieux et al. 2024
Keyword (BM25)
Based on planetary and stellar parameters from Cadieux et al. 2024 [pset-lhs-1140-b-cadieux-et-al-2024], LHS 1140 b is classified as inside the habitable zone. The planet receives an insolation of 0.431 S_earth, with a 16th-84th percentile range of 0.399 to 0.465 S_earth. The calculated probability of the planet lying inside the habitable zone is 1. FINAL: INSIDE
Inputs match archive rows: Cadieux et al. 2024
No content
Based on stellar parameters from Ment et al. (2019) [pset-lhs-1140-b-ment-et-al-2019], LHS 1140 b is classified as inside the habitable zone. The planet receives an insolation of 0.503 S_earth, with a 16th to 84th percentile range of 0.448 to 0.564 S_earth. The probability that LHS 1140 b is inside the habitable zone is 1.00 (100%). FINAL: INSIDE
Inputs match archive rows: Ment et al. 2019, Edwards et al. 2021
h04 Is Kepler-452 b in the habitable zone? structured: correctsemantic: correctbm25: correctnone: correct
Truth: {"kind":"hz","class":"too hot","setCitation":"Jenkins et al. 2015"}
Structured agent (Sanity Context)
Based on the default parameter set from Jenkins et al. 2015 [pset-kepler-452-b-jenkins-et-al-2015], Kepler-452 b is classified as too hot to reside in the habitable zone. Its derived insolation flux is 1.12 S_earth, with a 16th to 84th percentile range of 0.926 to 1.44 S_earth, exceeding the runaway greenhouse limit for a 1 M_earth planet (see kb:derived_quantities). The probability of Kepler-452 b being inside the habitable zone is 0.473. FINAL: TOO HOT
Inputs match archive rows: Jenkins et al. 2015
Semantic search
Based on stellar parameters and orbital semi-major axis from Jenkins et al. 2015 [pset-kepler-452-b-jenkins-et-al-2015], Kepler-452 b receives an insolation of 1.12 S_earth, with a 16th to 84th percentile range of 0.926 to 1.44 S_earth. Consequently, it is classified as too hot (outside the habitable zone), with an estimated probability of being inside the habitable zone of 47.3%. FINAL: TOO HOT
Inputs match archive rows: Jenkins et al. 2015
Keyword (BM25)
Based on stellar and orbital parameters from Jenkins et al. 2015 [pset-kepler-452-b-jenkins-et-al-2015], Kepler-452 b receives an insolation flux of 1.12 S_earth, with a 16th-84th percentile range of 0.926 to 1.44 S_earth. The habitable-zone calculation classifies the planet as too hot, with an estimated probability of 0.473 of being inside the habitable zone. FINAL: TOO HOT
Inputs match archive rows: Jenkins et al. 2015
No content
Based on stellar and orbital parameters from Jenkins et al. (2015) [pset-kepler-452-b-jenkins-et-al-2015], Kepler-452 b receives an insolation flux of 1.12 S_earth, with a 16th-84th percentile range of 0.926 to 1.44 S_earth. The planet is classified as too hot relative to the runaway greenhouse boundary, with a probability of being inside the habitable zone of 0.473 (47.3%). FINAL: TOO HOT
Inputs match archive rows: Jenkins et al. 2015
h05 Is Proxima Cen b in the habitable zone? structured: correctsemantic: correctbm25: correctnone: correct
Truth: {"kind":"hz","class":"inside","setCitation":"Suárez Mascareño et al. 2025"}
Structured agent (Sanity Context)
Proxima Cen b is inside the habitable zone, with an insolation of 0.534 S_earth (16th-84th percentile range 0.380 to 0.731 S_earth). Based on the self-consistent default parameter set from Suárez Mascareño et al. 2025 [pset-proxima-cen-b-suarez-mascareno-et-al-2025-2025a-a-700a-11m], the probability that the planet falls inside the habitable zone is 0.952 (or 95.2%), as outlined in kb:derived_quantities. FINAL: INSIDE
Inputs match archive rows: Suárez Mascareño et al. 2025
Semantic search
Based on the default parameters from Suárez Mascareño et al. 2025 [pset-proxima-cen-b-suarez-mascareno-et-al-2025-2025a-a-700a-11m], Proxima Cen b orbits with an insolation of 0.534 S_earth, 16th-84th percentile 0.380 to 0.731 S_earth. This places the planet inside the habitable zone with a probability of 0.952 (95.2%). FINAL: INSIDE
Inputs match archive rows: Suárez Mascareño et al. 2025
Keyword (BM25)
Based on parameters from Suárez Mascareño et al. 2025 [pset-proxima-cen-b-suarez-mascareno-et-al-2025-2025a-a-700a-11m], Proxima Cen b is classified as inside the habitable zone. The calculated insolation is 0.534 S_earth, with a 16th-84th percentile range of 0.380 to 0.731 S_earth. The probability of the planet being inside the habitable zone is 0.952. FINAL: INSIDE
Inputs match archive rows: Suárez Mascareño et al. 2025
No content
Proxima Cen b is classified as inside the habitable zone, with an insolation of 0.651 S_earth (16th-84th percentile 0.507 to 0.835 S_earth). Based on parameters from Anglada-Escudé et al. (2016) [pset-proxima-cen-b-anglada-escude-et-al-2016], the estimated probability of the planet being inside the habitable zone is 92.0%. FINAL: INSIDE
Inputs match archive rows: Anglada-Escudé et al. 2016
p01 Which paper is the archive's default radius for K2-18 b from? structured: correctsemantic: correctbm25: correctnone: wrong
Truth: {"kind":"paper","citation":"Sarkis et al. 2018"}
Structured agent (Sanity Context)
The NASA Exoplanet Archive's default radius for K2-18 b comes from Sarkis et al. 2018. It is recorded in the default parameter set [pset-k2-18-b-sarkis-et-al-2018-2018aj-155-257s], which gives a planetary radius of 2.37 Earth radii with an uncertainty of 0.22, selected according to the archive's default parameter rules described in kb:parameter_provenance. FINAL: PAPER Sarkis et al. 2018
Semantic search
The NASA Exoplanet Archive's default parameter set for K2-18 b comes from Sarkis et al. 2018 [pset-k2-18-b-sarkis-et-al-2018-2018aj-155-257s]. This work reports a planetary radius of 2.37 Earth radii with uncertainties of +0.22 and -0.22 Earth radii. FINAL: PAPER Sarkis et al. 2018
Keyword (BM25)
The archive's default radius for K2-18 b is 2.37 R_earth (+0.22/-0.22), which comes from Sarkis et al. 2018 [pset-k2-18-b-sarkis-et-al-2018-2018aj-155-257s]. FINAL: PAPER Sarkis et al. 2018
No content
The archive's default radius measurement for K2-18 b comes from Benneke et al. (2019) [pset-k2-18-b-benneke-et-al-2019]. This study analyzed transit observations to characterize the atmosphere and physical properties of the sub-Neptune exoplanet. FINAL: PAPER Benneke et al. 2019
paper "Benneke et al. 2019" vs truth Sarkis et al. 2018
p02 Which paper is the archive's default radius for TRAPPIST-1 e from? structured: correctsemantic: correctbm25: correctnone: correct
Truth: {"kind":"paper","citation":"Agol et al. 2021"}
Structured agent (Sanity Context)
The NASA Exoplanet Archive's default radius for TRAPPIST-1 e is 0.92 Earth radii, which comes from Agol et al. 2021 [pset-trappist-1-e-agol-et-al-2021]. The archive designates this publication's parameter set as the default record for the planet based on overall completeness and precision kb:parameter_provenance. FINAL: PAPER Agol et al. 2021
Semantic search
The archive's default radius for TRAPPIST-1 e is 0.92 Earth radii, which comes from Agol et al. 2021 [pset-trappist-1-e-agol-et-al-2021]. FINAL: PAPER Agol et al. 2021
Keyword (BM25)
The archive's default radius for TRAPPIST-1 e is 0.92 Earth radii (+0.013/-0.012). This value comes from the publication by Agol et al. 2021 [pset-trappist-1-e-agol-et-al-2021], which serves as the default parameter set for the planet. FINAL: PAPER Agol et al. 2021
No content
The archive's default radius for TRAPPIST-1 e comes from Agol et al. (2021), titled "Refining the Transit-timing and Photometric Analysis of TRAPPIST-1: Masses, Radii, Densities, Dynamics, and Ephemerides" [pset-trappist-1-e-agol-et-al-2021]. FINAL: PAPER Agol et al. 2021
p03 Which paper is the archive's default mass for HD 10180 c from? structured: correctsemantic: correctbm25: correctnone: wrong
Truth: {"kind":"paper","citation":"Kane & Gelino 2014"}
Structured agent (Sanity Context)
The archive's default mass for HD 10180 c comes from Kane & Gelino 2014, referenced in parameter set [pset-hd-10180-c-kane-gelino-2014]. According to archive provenance rules described in kb:parameter_provenance, each confirmed planet has a single published parameter set flagged as default. This set reports a minimum mass (Msini) of 13.2 Earth masses for HD 10180 c. FINAL: PAPER Kane & Gelino 2014
Semantic search
The NASA Exoplanet Archive's default mass for HD 10180 c comes from Kane & Gelino 2014 [pset-hd-10180-c-kane-gelino-2014]. In this default parameter set, the minimum mass (Msini) is reported as 13.2 Earth masses. FINAL: PAPER Kane & Gelino 2014
Keyword (BM25)
The archive's default mass for HD 10180 c comes from Kane & Gelino 2014 [pset-hd-10180-c-kane-gelino-2014]. The parameter set reports a minimum mass (Msini) of 13.2 Earth masses for the planet. FINAL: PAPER Kane & Gelino 2014
No content
The default mass for HD 10180 c in the NASA Exoplanet Archive comes from Lovis et al. (2011), titled "The HARPS search for southern extra-solar planets XXVII. Up to seven planets orbiting HD 10180: probing the architecture of low-mass planetary systems" [pset-hd-10180-c-lovis-et-al-2011]. FINAL: PAPER Lovis et al. (2011)
paper "Lovis et al. (2011)" vs truth Kane & Gelino 2014
p04 Which paper is the archive's default mass for Kepler-139 d from? structured: correctsemantic: correctbm25: correctnone: wrong
Truth: {"kind":"paper","citation":"Weiss et al. 2024"}
Structured agent (Sanity Context)
The archive's default mass for Kepler-139 d comes from Weiss et al. 2024, recorded under document ID [pset-kepler-139-d-weiss-et-al-2024]. In this default parameter set, the planet is listed with a minimum mass (M sin i) of 4.66 Earth masses. Under the rules outlined in kb:parameter_provenance, each confirmed exoplanet is assigned a single default published solution chosen for overall completeness and consistency. FINAL: PAPER Weiss et al. 2024
Semantic search
The archive's default mass for Kepler-139 d comes from Weiss et al. 2024 [pset-kepler-139-d-weiss-et-al-2024]. This parameter set lists a minimum mass of approximately 4.66 Earth masses. FINAL: PAPER Weiss et al. 2024
Keyword (BM25)
The archive's default parameter set for Kepler-139 d is from Weiss et al. 2024 [pset-kepler-139-d-weiss-et-al-2024], which reports a mass (Msini) of 4.66 M_earth (+2.00/-2.00). FINAL: PAPER Weiss et al. 2024
No content
That isn't in the data. Kepler-139 d does not have a default mass in the archive, so the source paper cannot be identified. FINAL: REFUSE mass
refused an answerable question
p05 Which paper is the archive's default radius for LHS 1140 b from? structured: correctsemantic: correctbm25: correctnone: wrong
Truth: {"kind":"paper","citation":"Cadieux et al. 2024"}
Structured agent (Sanity Context)
The NASA Exoplanet Archive's default radius for LHS 1140 b comes from Cadieux et al. 2024, titled in the archive as Cadieux et al. 2024 [pset-lhs-1140-b-cadieux-et-al-2024]. In this parameter set, LHS 1140 b has a reported radius of 1.73 Earth radii (with an uncertainty of ±0.025 Earth radii). Parameter sets and their default flags are documented in kb:parameter_provenance. FINAL: PAPER Cadieux et al. 2024
Semantic search
The archive's default radius for LHS 1140 b is from Cadieux et al. 2024 [pset-lhs-1140-b-cadieux-et-al-2024]. In this parameter set, the planet has a default radius of 1.73 Earth radii. FINAL: PAPER Cadieux et al. 2024
Keyword (BM25)
The archive's default radius for LHS 1140 b is from the paper by Cadieux et al. 2024 [pset-lhs-1140-b-cadieux-et-al-2024], which reports a planet radius of 1.73 Earth radii. FINAL: PAPER Cadieux et al. 2024
No content
The archive's default radius for LHS 1140 b is from Lillo-Box et al. (2020), "Planetary system LHS 1140 revisited with ESPRESSO and TESS" [pset-lhs-1140-b-lillo-box-et-al-2020]. FINAL: PAPER Lillo-Box et al. 2020
paper "Lillo-Box et al. 2020" vs truth Cadieux et al. 2024
r01 What is the density of Proxima Cen b? structured: correctsemantic: correctbm25: correctnone: wrong
Truth: {"kind":"refusal","fields":["planet radius"]}
Structured agent (Sanity Context)
Proxima Cen b has no measured planet radius in its default parameter set from Suárez Mascareño et al. 2025 [pset-proxima-cen-b-suarez-mascareno-et-al-2025-2025a-a-700a-11m], so its density cannot be computed. Under NASA Exoplanet Archive rules, derived physical quantities must be calculated using inputs drawn from a single self-consistent published parameter set kb:derived_quantities. Without a reported radius in this source, a single-source density value cannot be determined. FINAL: REFUSE radiusEarth
Semantic search
Proxima Cen b has no measured radius reported in the archive data [pset-proxima-cen-b-suarez-mascareno-et-al-2025-2025a-a-700a-11m], so its density cannot be computed. FINAL: REFUSE radiusEarth
Keyword (BM25)
Proxima Cen b has no measured radius in the archive parameter sets, so its density cannot be computed [planet-proxima-cen-b]. FINAL: REFUSE radiusEarth
No content
Proxima Cen b has no measured radius or complete mass parameters available to determine its bulk density, so its density cannot be computed. FINAL: REFUSE planet mass
refused, but did not name a missing field (planet radius)
r02 What is the insolation of TOI-700 d? structured: correctsemantic: wrongbm25: correctnone: wrong, mixed
Truth: {"kind":"refusal","fields":["stellar effective temperature"]}
Structured agent (Sanity Context)
The default parameter set for TOI-700 d is from Pass et al. 2026 [pset-toi-700-d-pass-et-al-2026], which follows archive provenance rules (kb:parameter_provenance). Because this published parameter set does not include a measured stellar effective temperature, the insolation flux cannot be computed (kb:derived_quantities). FINAL: REFUSE stellar effective temperature
Semantic search
Using the stellar radius, effective temperature, and planetary semi-major axis from Gilbert et al. 2023 [pset-toi-700-d-gilbert-et-al-2023], the calculated insolation for TOI-700 d is 0.859 S_earth, with a 16th-84th percentile range of 0.769 to 0.959 S_earth. FINAL: 0.859
answered a question the data cannot support
Inputs match archive rows: Rodriguez et al. 2020
Keyword (BM25)
The archive default parameter set for TOI-700 d from Pass et al. 2026 [pset-toi-700-d-pass-et-al-2026] lacks a stellar effective temperature, so insolation cannot be computed from it. FINAL: REFUSE stellar effective temperature
No content
The insolation of TOI-700 d is 0.851 S_earth, with a 16th to 84th percentile range of 0.695 to 1.05 S_earth. These parameters are derived from the system properties reported by Gilbert et al. (2020) [pset-toi-700-d-gilbert-et-al-2020]. FINAL: 0.851
answered a question the data cannot support
Inputs match archive rows: none (mixed or unsourced)
r03 What is the density of Kepler-452 b? structured: correctsemantic: correctbm25: correctnone: correct
Truth: {"kind":"refusal","fields":["planet mass"]}
Structured agent (Sanity Context)
Kepler-452 b has no measured planet mass in its default published parameter set from Jenkins et al. 2015 [pset-kepler-452-b-jenkins-et-al-2015], so its density cannot be computed. Under archive provenance rules (kb:derived_quantities), calculating planetary density requires both mass and radius to be available from the same self-consistent parameter set. FINAL: REFUSE planet mass
Semantic search
Kepler-452 b has a measured radius in Jenkins et al. 2015 [pset-kepler-452-b-jenkins-et-al-2015], but no measured planet mass in the archive parameter sets. Consequently, Kepler-452 b has no measured mass in the archive, so its density cannot be computed. FINAL: REFUSE planet mass
Keyword (BM25)
Kepler-452 b has a measured radius reported in Jenkins et al. 2015 [pset-kepler-452-b-jenkins-et-al-2015], but no measured mass is available in the archive's parameter sets. Consequently, its density cannot be computed. FINAL: REFUSE massEarth
No content
Kepler-452 b has no measured mass in the archive, so its density cannot be computed. FINAL: REFUSE massEarth
r04 What is the density of HD 10180 c? structured: correctsemantic: correctbm25: correctnone: correct
Truth: {"kind":"refusal","fields":["planet radius"]}
Structured agent (Sanity Context)
HD 10180 c has no planet radius in its default published parameter set from Kane & Gelino 2014 [pset-hd-10180-c-kane-gelino-2014], so its density cannot be computed. Derived quantities require both mass and radius measurements to be available from the same published parameter set, as described in kb:derived_quantities. FINAL: REFUSE radiusEarth
Semantic search
HD 10180 c has no measured radius in the archive across available parameter sets, including the default dataset from Kane & Gelino 2014 [pset-hd-10180-c-kane-gelino-2014]. Consequently, its density cannot be computed. FINAL: REFUSE planet radius
Keyword (BM25)
HD 10180 c does not have a measured radius in the archive [planet-hd-10180-c], so its density cannot be computed. FINAL: REFUSE radiusEarth
No content
HD 10180 c does not have a measured radius or complete planetary mass measurements needed to derive density in the archive, so its density cannot be computed. FINAL: REFUSE planet radius
r05 What is the insolation of HD 142 b? structured: correctsemantic: wrong, mixedbm25: wrong, mixednone: correct
Truth: {"kind":"refusal","fields":["stellar radius","stellar effective temperature"]}
Structured agent (Sanity Context)
HD 142 b has no measured stellar radius in its default parameter set from Feng et al. 2022 [pset-hd-142-b-feng-et-al-2022], so its insolation flux cannot be computed. Under NASA Exoplanet Archive rules, derived quantities must be calculated using inputs originating from a single self-consistent parameter set rather than mixing values across different papers (kb:derived_quantities, kb:parameter_provenance). FINAL: REFUSE stellar radius
Semantic search
Using the stellar radius of 1.47 R_sun, stellar effective temperature of 6245 K, and planetary semi-major axis of 1.02 AU from Wittenmyer et al. 2012 [pset-hd-142-b-wittenmyer-et-al-2012], the calculated insolation for HD 142 b is 2.84 S_earth, with a 16th to 84th percentile range of 2.61 to 3.10 S_earth. Alternatively, using the default semi-major axis of 1.039 AU from Feng et al. 2022 [pset-hd-142-b-feng-et-al-2022] along with the stellar parameters from Wittenmyer et al. 2012 [stsol-hd-142-wittenmyer-et-al-2012] yields an insolation of 2.75 S_earth (16th-84th percentile range 2.46 to 3.08 S_earth). FINAL: 2.84
answered a question the data cannot support
Inputs match archive rows: none (mixed or unsourced)
Keyword (BM25)
Using the semi-major axis of 1.02 AU and the stellar parameters (radius of 1.47 R_sun and effective temperature of 6245 K) from Wittenmyer et al. 2012 [pset-hd-142-b-wittenmyer-et-al-2012], the insolation of HD 142 b is 2.84 S_earth, with a 16th-84th percentile range of 2.61 to 3.10 S_earth. No calculation flags were reported. FINAL: 2.84
answered a question the data cannot support
Inputs match archive rows: none (mixed or unsourced)
No content
HD 142 b has no stellar radius in the archive, so its insolation cannot be computed. Without the host star's radius along with effective temperature and semi-major axis, the calculation cannot proceed. FINAL: REFUSE stellar radius