Skip to article frontmatterSkip to article content
Site not loading correctly?

This may be due to an incorrect BASE_URL configuration. See the MyST Documentation for reference.

Deciding whether one label per image chip is enough

1. Motivation

Choosing the wrong task formulation wastes real effort, exactly the warning from L01’s core tasks page. Image recognition is attractive because it is quick to set up and train, but it only answers questions of a specific shape. Recognizing that shape early saves you from labeling pixel masks you did not need, or discovering three weeks in that your question actually required object locations.


2. Core idea

Image recognition assigns a single categorical label to an entire image tile. It answers “what is the dominant thing in this tile,” not “where exactly is it” or “which pixels belong to it.”


3. Workflow

A. Recognize a good fit

Image recognition fits well when a tile has one dominant, describable content type, and you do not need to know where within the tile that content sits. If you can look at a tile and confidently assign one label without needing to point at a specific pixel or object, this task probably fits.

B. Look at realistic examples

Regional and national land-use mapping often works this way: classify millions of tiles extracted from a mosaic into categories like forest, cropland, or urban. Crop-type screening across a growing season is another common case. Post-disaster triage can use scene-level labels (undamaged, minor damage, major damage) to prioritize which areas need closer inspection first. Scene screening, filtering out cloudy or irrelevant tiles before running a more expensive model, is a fourth pattern.

C. Recognize when it is not enough

If your question needs where something is, individual buildings, vehicles, or field boundaries, you need object detection (covered in L06) rather than a single tile-level label. If it needs a full pixel-level map, every pixel classified as building, road, or vegetation, you need semantic segmentation (covered in L07). Image recognition on a mixed-content tile can still run, but the single predicted label will hide most of what is actually happening in that tile.

D. Use it as a first, cheap pass

Even when your real question needs a heavier task, image recognition can still help as a pre-filtering step: quickly screening out tiles that clearly do not contain what you care about, before spending compute on detection or segmentation for the tiles that remain.

E. Define the chip carefully

The chip size affects the meaning of the label. A 64 × 64 Sentinel-2 chip may represent a broad land-use pattern. A high-resolution aerial chip of the same pixel size may show only a few buildings or trees.

F. Think about mixed scenes

Many geospatial image chips contain more than one land-cover type. A “residential” chip may include roads, gardens, trees and rooftops. A “river” chip may include water, vegetation and bridges.

This is not automatically a problem, but the class definition must be clear. In many classification datasets, the label refers to the dominant or most representative scene type rather than a pure land-cover class.


4. Common pitfalls


5. Mini task

For each rough project prompt below, decide whether image recognition fits, and if not, name the task that would fit better.

  1. “I want to flag which satellite tiles in my study area show visible flooding.”

  2. “I want to count individual solar panels on rooftops across a city.”

  3. “I want a map showing exactly which pixels are impervious surface versus vegetation.”


6. Key takeaways

7. Further reading