george bonev

Seeing snow every day

A broken satellite sensor, a decade-old fix, and the fusion problem it points to.

01

Here's a snow map

This is a crop from MODIS — the imaging spectrometer flying on NASA's Terra and Aqua satellites. Snow is bright where visible light hits it and dark in the shortwave infrared. That gap between two bands, band 4 (visible) and band 6 (1.6 µm), is what separates snow from cloud and bare ground.

The ratio is called NDSI, the normalized difference snow index, and NASA has run a version of it operationally since 2000. Drag the threshold below off the standard cutoff of 0.4 and watch the mask move — turning a continuous quantity into a binary map is never as clean as one number implies.

[ live NDSI threshold — waiting on the real MODIS crop, see data-pipeline/ ]

02

Here's why you can't have one every day

A single satellite crosses any given point roughly once a day at best. Cloud cover blocks the optical view outright — across most regions, a large share of days at a given location are cloud-obstructed. A snow map that can't refresh daily isn't much use for hazard response, hydrology, or reservoir operations, all of which run on daily-to-weekly decisions.

[ revisit / cloud-occlusion illustration ]

03

Here's the broken sensor in the way

MODIS on Aqua has 20 physical detectors dedicated to band 6, one per scan line. Most failed shortly after launch — only 5 of the 20 are still fully functional. Toggle detectors off below and watch the striping return. This is the real damage pattern on Aqua, not a simulation.

NASA's operational fallback swaps in band 7 (2.1 µm) instead. It's spectrally close, but not close enough — snow/cloud contrast is measurably weaker there, and the standard Aqua snow product eats an accuracy hit as a result.

[ detector toggle — waiting on the real MODIS crop, see data-pipeline/ ]

04

Here's how we fixed it

Instead of falling back to a worse band, predict the missing band 6 value directly from a small neighborhood of pixels in the bands that still work — a linear regression fit against the detectors that survived, applied to the ones that didn't. This was work I did my part of at CCNY, and a version of it now runs in NASA's operational Collection 6 Aqua snow product.

It's cheap enough that the wipe below is running an actual regression in your browser right now — not a precomputed image. (Simplified from the published method: two predictor bands instead of four, one global fit instead of overlapping tiles. Close enough to be honest, light enough to ship.)

[ restoration wipe — waiting on real regression coefficients, see data-pipeline/ ]

05

Here's the map you could build on top

Optical still can't see through clouds, restored or not. Passive microwave can — far coarser, tens of kilometers instead of hundreds of meters, but indifferent to cloud cover entirely. Put the two together, colocated in space and reconciled in time, and there's a plausible path to an actual daily snow/sea-ice product: microwave fills the cloudy days, optical sharpens the clear ones.

I specified this. I did not build it. That's worth saying plainly rather than around: a fusion pipeline across two instruments with wildly different resolution, latency, and failure modes is a harder systems problem than the restoration above — and the more interesting one.

[ fusion concept sketch ]

06

Here's what stopped me, and how I'd attack it in 2026

[ George: what actually stopped this — time, data access, scope, something else? Say it plainly. ]

[ George: the concrete 2026 attack plan — what's different now (compute, data availability, tooling) that makes this newly tractable? ]

Fusing heterogeneous sources with different resolutions, latencies, and reliabilities into one answer you can defend is the same problem in remote sensing and in document retrieval.

Coarse-but-always-available microwave plus sharp-but-cloud-blocked optical is structurally the same problem as BM25 plus late interaction plus a doc-rank pass. Everything added to this site after v1 hangs off that thread.