Measuring urban problems: a brief report on rating grass coverage.

The authors asked city residents to look at neighborhood lawns and rate grass coverage on a 0-to-10 scale.

They wanted to know if regular people, without special training, could give reliable scores.

Neighbors agreed with each other more than 90 percent of the time.

A simple ten-point scale was enough to track how much grass was growing.

Matson et al. (2009) and Busch et al. (2010) also built short 0-to-10 or 4-code scales that reached high reliability, showing the trick works for kids' home activity and therapy homework too.

Wolfe et al. (2016) found the opposite: experts barely agreed when eyeballing complex graphs, while these untrained residents easily agreed on grass. The difference is task length: a single number for a lawn is simpler than judging whole graphs.

Jones et al. (1977) later warned that just saying "above 90 percent agreement" hides important details, yet this 1975 paper did exactly that, making it a clear example of what not to do when reporting IOA.

You can borrow the 0-to-10 idea any time you need a quick, low-effort measure. Ask parents to rate evening routine smoothness from 0 to 10, or have staff score hallway noise levels. One number, no long checklist, still gives trustworthy data you can graph and share.