01
Here's a snow map
This is a crop from MODIS — the imaging spectrometer flying on NASA's Terra and Aqua satellites. Snow is bright where visible light hits it and dark in the shortwave infrared. That gap between two bands, band 4 (visible) and band 6 (1.6 µm), is what separates snow from cloud and bare ground.
The ratio is called NDSI, the normalized difference snow index, and NASA has run a version of it operationally since 2000. Drag the threshold below off the standard cutoff of 0.4 and watch the mask move — turning a continuous quantity into a binary map is never as clean as one number implies.
[ live NDSI threshold — waiting on the real MODIS crop, see data-pipeline/ ]
02
Here's why you can't have one every day
A single satellite crosses any given point roughly once a day at best. Cloud cover blocks the optical view outright — across most regions, a large share of days at a given location are cloud-obstructed. A snow map that can't refresh daily isn't much use for hazard response, hydrology, or reservoir operations, all of which run on daily-to-weekly decisions.
[ revisit / cloud-occlusion illustration ]
03
Here's the broken sensor in the way
MODIS on Aqua has 20 physical detectors dedicated to band 6, one per scan line. Most failed shortly after launch — only 5 of the 20 are still fully functional. Toggle detectors off below and watch the striping return. This is the real damage pattern on Aqua, not a simulation.
NASA's operational fallback swaps in band 7 (2.1 µm) instead. It's spectrally close, but not close enough — snow/cloud contrast is measurably weaker there, and the standard Aqua snow product eats an accuracy hit as a result.
[ detector toggle — waiting on the real MODIS crop, see data-pipeline/ ]
04
Here's how we fixed it
Instead of falling back to a worse band, predict the missing band 6 value directly from a small neighborhood of pixels in the bands that still work — a linear regression fit against the detectors that survived, applied to the ones that didn't. This was work I did my part of at CCNY, and a version of it now runs in NASA's operational Collection 6 Aqua snow product.
It's cheap enough that the wipe below is running an actual regression in your browser right now — not a precomputed image. (Simplified from the published method: two predictor bands instead of four, one global fit instead of overlapping tiles. Close enough to be honest, light enough to ship.)
[ restoration wipe — waiting on real regression coefficients, see data-pipeline/ ]
05
Here's the map you could build on top
Optical still can't see through clouds, restored or not. Passive microwave can — far coarser, tens of kilometers instead of hundreds of meters, but indifferent to cloud cover entirely. Put the two together, colocated in space and reconciled in time, and there's a plausible path to an actual daily snow/sea-ice product: microwave fills the cloudy days, optical sharpens the clear ones.
I specified this. I did not build it. That's worth saying plainly rather than around: a fusion pipeline across two instruments with wildly different resolution, latency, and failure modes is a harder systems problem than the restoration above — and the more interesting one.
[ fusion concept sketch ]
06
Here's what stopped me, and how I'd attack it in 2026
[ George: what actually stopped this — time, data access, scope, something else? Say it plainly. ]
[ George: the concrete 2026 attack plan — what's different now (compute, data availability, tooling) that makes this newly tractable? ]
Fusing heterogeneous sources with different resolutions, latencies, and reliabilities into one answer you can defend is the same problem in remote sensing and in document retrieval.
Coarse-but-always-available microwave plus sharp-but-cloud-blocked optical is structurally the same problem as BM25 plus late interaction plus a doc-rank pass. Everything added to this site after v1 hangs off that thread.