Scientific Engine

Methodology & Data Provenance

How Earth Force detects planetary anomalies across 500 cities with more than 1 million inhabitants, publishes a dated chart for every city, reserves NASA GIBS imagery for flagged events, experimentally groups regional changes, and translates telemetry into conversational language. Unusual ≠ unsafe.

Cadence

04:00 UTC

Consolidated 24h Pass

Multiple testing

BH q (diagnostic)

Not a 5% FDR claim

Protocol

“Unusual” ≠ “Unsafe”

Non-Alarmist Stance

01Guiding Philosophy

Built by Data Scientists, for Everyday Citizens

Environmental monitoring tools frequently fail the general public: they either present opaque engineering parameters (μg/m³, W/m², Pa) without context, or use sensationalist red banners that trigger unwarranted panic over routine diurnal shifts. Earth Force solves this with two foundational pillars:

The Cardinal Principle: “Unusual” ≠ “Unsafe”

In mathematical statistics, an anomaly is merely an observation that diverges from recent historical patterns against that city’s own 30-day baseline. Display flags now require a rare jump (for example PM2.5 ≥ 85 µg/m³ and +50% / 2.8σ, ozone 1/p ≥ 20 in the ~30-day daily GEV, rain ≥ 60 mm, or fire FRP ≥ 500 MW), not a mild ±15% wiggle. An anomaly does not mean an acute life-safety emergency. The reverse is also true: a statistically typical PM2.5 reading can still exceed the WHO 24-hour guideline of 15 µg/m³. Earth Force therefore labels EPA/WHO health bands separately from radar flags.

Verified Non-Alarmist Protocol

Empathetic Conversational Translation

Raw sensor streams are synthesized into 8 conversational questions that directly answer what people care about: “How clean is the air?”, “What’s unusual right now?”, and “How hot does it feel?”. Every reading is coupled with a plain-English explanation generated via Gemini AI declaring whether daily outdoor activities require modification.

8 Human-Centered Telemetry Cards

02Data Sources & Provenance

Open scientific feeds, labeled by kind

Every metric originates from public scientific feeds. Weather and air-quality fields from Open-Meteo are modeled analyses (ECMWF IFS / GFS and Copernicus CAMS), not raw station observations. NASA FIRMS fire detections are satellite-observed hotspots. Ground ozone is the CAMS surface mass concentration in µg/m³ — a different product from the 0–500 US AQI or Singapore PSI ozone sub-index on station dashboards. A CAMS reading near 150 µg/m³ is not an AQI of 150, and it will not match a station O₃ index near 12. Gemini and SerpApi never invent the numbers; they only translate or corroborate them after filtering.

Weather & Thermal

Open-Meteo ERA5 Reanalysis

ECMWF Integrated Forecasting System (IFS)

2m Air Temp, Apparent (Feels-Like) Temp, 24h Precipitation, 10m Wind Speed, Relative Humidity, Soil Moisture (0–7cm), Solar UV Index, Visibility

0.1° (~9 km) Grid · Daily Consolidated Batch

Air Quality Chemistry

Copernicus CAMS Global

European Space Agency (ESA) & ECMWF

Fine Particulate Matter (PM2.5), Coarse Particles (PM10), Ground-Level Ozone (O₃ as µg/m³ mass concentration — not AQI), Nitrogen Dioxide (NO₂)

Sentinel-5P TROPOMI Calibrated · Hourly & Daily Max

Wildfire Radiometry

NASA FIRMS (EOSDIS)

NOAA-20 / VIIRS 375m & Suomi-NPP

Active Fire Radiative Power (FRP in Megawatts), Thermal Brightness Temperature, Detection Confidence Buffer (50 km Great-Circle)

375m Spatial Pixel · 24h Polar Orbit Extract

Ground News Corroboration

SerpApi News Engine

Google News Verified Press Index

Third-party journalistic corroboration: Local newspapers, meteorology departments, official advisories, ground photography

Triggered on Anomaly · Top 3 Verified Articles

Satellite Context (GIBS)

NASA GIBS / WVS GetSnapshot

NOAA-20 / Suomi-NPP VIIRS · MODIS Terra · IMERG

True-color reflectance, land-surface temperature, precipitation rate, and optional aerosol or hotspot overlays. Tiles are requested only for cities that already carry a statistical or physical flag. Baseline cities keep the engine idle.

Five frames: Current · T−1 · T−7 · T−14 · T−30 · ~1-day GIBS lag · no 90-day tile walk

Citizen Plain-English

Google Gemini 3.5 Flash-Lite

Google DeepMind · fallback gemini-3.8-flash

Empathetic translation: Converts numerical departure, physical drivers (inversions, monsoon surges, heat domes), and press facts into reassuring prose

Deterministic Temp 0.2 · Strict 2–3 Sentences

Urban Demographics

Cities with over 1 million inhabitants

Wikipedia list of million-plus cities · GeoNames census coordinates

The monitored set is the 500 cities with more than 1 million inhabitants — large urban hubs, not a sample of every town. Coordinates and census population come from GeoNames.

Wikipedia: List of cities with over 1 million inhabitants

500 cities · >1 million people each

03Temporal Cadence

Why Daily at Exactly 04:00 UTC?

Earth Force operates on a synchronized once-per-day batch composite rather than continuous erratic polling. This architectural design is dictated by orbital physics and meteorological assimilation schedules:

1.

Polar Orbit Consolidation

Sun-synchronous polar satellites (NOAA-20 and Suomi-NPP) require ~14 daily orbits to sweep every terrestrial longitude. NASA FIRMS publishes its quality-checked global 24-hour composite extract at approximately 03:00–04:00 UTC.

2.

ECMWF Midnight Assimilation

European atmospheric reanalysis models ingest global midnight ground weather balloon (radiosonde) soundings at 00:00 UTC. By 04:00 UTC, the assimilation run is verified, eliminating transient modeling artifacts.

3.

30-Day Rolling Baseline

At 04:00 UTC, each city's rolling 30-day baseline window (720 hourly points for diurnal variables; 30 daily sums for precipitation and soil saturation) advances 24 hours, adjusting local statistical norms dynamically.

04Mathematical & Statistical Detection Engine

Closed-form parametric distributions from first principles

Rather than arbitrary risk heuristics, Earth Force computes rigorous, closed-form parametric distributions from first mathematical principles:

Extreme Heat & Photochemical Smog

Generalized Extreme Value (GEV) Distribution via L-Moments

Hosking (1990) Formulation

Atmospheric temperature and ground ozone spikes exhibit heavy, asymmetric tails. Earth Force computes unbiased sample L-moments (λ₁, λ₂, λ₃) to fit GEV location (μ), scale (σ), and shape (ξ) parameters without iterative convergence failures:

F(x) = exp( - [ 1 + ξ · (x - μ) / σ ]^(-1 / ξ) )

// Inverse exceedance on the sample-day basis of the ~30-day daily fit:
T(x) = 1 / (1 - F(x))
time basis = one calendar day in the 30-day window, not a year

Heat and ozone use T = 1 / (1 − F(x)) as a rarity score inside that short daily sample. A gate of T ≥ 20 means p ≤ 0.05 in the 30-day daily GEV — not a 20-year climatological return period. We do not publish year-based return periods until a longer historical model justifies that time basis. Magnitude gaps still apply: ozone +50% and ≥ 2.5σ, or temperature at least +8°C above the 30-day mean.

Precipitation Deluges & Flash Flooding

Standardized Precipitation Index (SPI) via 2-Parameter Gamma

Thom (1958) Maximum Likelihood

Precipitation is zero-bounded and positively skewed. Earth Force fits a 2-parameter Gamma distribution with shape α and scale β using Thom’s maximum likelihood estimate:

A = ln(x̄) - (1/n) ∑ ln(x_i),   α = [1 + √(1 + 4A/3)] / (4A),   β = x̄ / α
Cumulative Probability: H(x) = q + (1 - q) · Γ(α, x / β)
SPI = Φ⁻¹(H(x))   (Abramowitz & Stegun Rational Approximation)

Precipitation anomalies are flagged when SPI ≥ +2.5 with at least 40 mm in 24h, or when 24h accumulation exceeds 60 mm.

Multiple Hypothesis Elimination

Benjamini-Hochberg q-values (diagnostic, not a 5% FDR)

Benjamini & Hochberg (1995)

Testing 500 cities at once needs a multiple-testing diagnostic. Earth Force computes BH q-values across the full city family, then displays them. Magnitude gates decide the radar flag. Because those gates are functions of the same series as the p-value, selecting first and then promising FDR would not be valid. We therefore do not claim a 5% FDR on the flagged set.

1. Sort all city p-values: p_(1) ≤ p_(2) ≤ ... ≤ p_(m)
2. q_(i) = min_(j ≥ i) [ min(1.0, (m / j) · p_(j)) ]
3. q is shown on the city page. Flags do not require q ≤ 0.05.

Fire FRP ≥ 500 MW and rain ≥ 60 mm remain physical detections. Isolation Forest is a separate unsupervised layer and is labeled as such — not an FDR discovery.

Silent Multivariate Compound Traps

Isolation Forest (Unsupervised ML)

Liu, Ting & Zhou (2008) · 100 trees · contamination 0.03 · hard cap 10–15

Single-metric gates miss weather traps where every reading looks ordinary but the joint combination is rare — for example stagnant wind plus high humidity holding ground emissions in place. Earth Force standardizes a 6-feature vector (temperature, humidity, wind, PM2.5, ozone, soil moisture), fits an Isolation Forest across the 500-city matrix, and ranks cities by isolation score.

s(x, n) = 2 ^ ( - E[h(x)] / c(n) )
c(n) = 2 H(n - 1) - 2(n - 1)/n
Flag only the top 10–15 eligible cities (never more than 20)

Cities already flagged by the univariate magnitude gates are excluded so Isolation Forest only surfaces silent compound traps. The two largest |z| features become the public driver line.

05The 8 Conversational Telemetry Indicators

Measurements mapped into human-centric questions

Every monitored city — flagged or holding steady — has a deep-dive page. Measurements are mapped into 8 human-centric questions:

“How clean is the air?”

PM2.5

Fine particles (≤ 2.5μm) capable of entering lung tissue. Evaluated against WHO 15 μg/m³ daily guideline.

“What’s unusual right now?”

Ozone (O₃)

Photochemical ground ozone created when solar radiation catalyses vehicle emissions during still air inversions.

“How hot does it feel?”

Feels-Like

Steadman apparent temperature combining dry-bulb air temperature with humidity and wind to express human comfort.

“Are we getting enough rain?”

Precip 24h

Accumulated precipitation over 24 hours compared against 30-day baseline. Clarifies that dry days do not equal drought.

“How humid & breezy is it?”

Wind & RH

Surface wind dispersion dynamics and relative moisture saturation that influence pollutant ventilation.

“What is solar UV exposure?”

UV Index

WHO erythemal solar ultraviolet radiation index indicating when sun protection is prudent during midday hours.

“How clear is the horizon?”

Visibility

Atmospheric optical extinction distance in kilometers, detecting regional haze, fog, and suspended dust layers.

“Is soil moisture balanced?”

Soil 0–7cm

Volumetric water content in the root zone measuring urban green cover stress and hydrological runoff readiness.

Provenance: Open-Meteo/CAMS supply modeled weather and air chemistry; NASA FIRMS supplies observed fire. The city set is the 500 urban areas with more than 1 million inhabitants (Wikipedia list); GeoNames supplies census population. Gemini may only restate verified telemetry already on the page and is blocked from calling hazardous air “safe.” SerpApi stories must mention the city, match the event, and be ≤ 14 days old. Unusual still does not mean unsafe — and statistically typical air can still exceed WHO guidelines.

06City Directory & Dated Charts

A chart for every city, not only the flagged ones

The Cities directory lists all 500 monitored places. Opening any row goes to that city’s page. Holding-steady cities still receive dated air, heat, rain, and humidity trends. Missing a statistical flag is not a reason to hide the series.

Directory, not a second radar

Search and All / Unusual / Steady filters sit on top of the same daily catalog the planetary radar uses. Population is never double-counted when summarizing flagged cities.

Onset, peak, and latest from the series

Expanding a card opens 30 / 60 / 90-day windows. Annotations (onset, peak, duration, latest versus baseline) are computed from the dated Open-Meteo / CAMS series. The last chart point is pinned to the card reading so the two cannot disagree. Hypotheses under the chart are labeled and are not verified causes.

07Satellite Investigation

GIBS imagery only after a city is already flagged

NASA GIBS is a context layer, not a detector. The pipeline never walks tiles for all 500 cities. Differencing and the on-page explorer run only when is_anomaly is true. Unflagged pages show a short idle note and fetch no snapshots.

Five-frame lookback

Current, T−1, T−7, T−14, and T−30. The 90-day daily scrub was removed because it requested far too many GIBS tiles. VIIRS true-color is typically ~1 day behind UTC “today,” so Current is clamped to the latest published date — never a 90-day chart peak.

Before / after and mask

Optional compare and “what changed” views difference two already-chosen dates with a fixed 15% RGB threshold and a brightness cloud heuristic. That fraction is a visual comparison aid. It is not treated as environmental detection until it is validated against a labeled change product.

What we will not claim

Pixel change is not causation, exposure, or a mapped hazard zone. Investigation records store evidence completeness (series length, onset, measurement, layer, usable cloud state) — not a hardcoded 0.94 confidence. FIRMS FRP is a 24-hour hotspot composite inside a 50 km buffer, not a 90-day fire curve.

08Regional Clustering · Experimental

When changes across cities may be one story

Connected Changes is linked from the header as New. It does not change production detection. It asks whether already-flagged cities form a plausible regional group instead of treating every pin as an isolated incident.

Explainable graph clustering

An edge requires the same pillar and direction, Haversine distance inside a category radius (Air 280 km, Heat 550 km, Rain 350 km, Fire 220 km), and either onset proximity, Pearson similarity of the stored primary series, or coincident FIRMS detections for fire. Geography alone is not enough. Long-range CAMS correlation is ignored on purpose.

Three honest labels

  • Potential Cluster — statistical grouping with supporting extras such as stagnant 10 m wind or nearby FIRMS FRP.
  • Corroborated Regional Event — stored local news, mixed observed + modeled sources, or FIRMS detections more than 100 km apart.
  • Shared Cause Unverified — members likely share a coarse CAMS / Open-Meteo cell or the same 50 km FIRMS buffer.

Wind direction is not stored, so transport is never inferred. Translucent map outlines are grouping aids, not a confirmed affected footprint. Cluster formation history is not reconstructed from a single daily snapshot. Observed facts, statistical associations, and hypotheses are labeled separately.