  This paper explores a lightweight, quantitative audit methodology for
transparency disclosures called scrappy audits. It amounts to little more than
treating redundant and repeated disclosures as opportunities for validating
quantities. The paper applies two concrete audits to social media disclosures
about content moderation. The first compares legally mandated reports about the
sexual exploitation of minors as disclosed by social media and the national
clearinghouse receiving them. The second compares historical quantities
included in platforms' CSV files across two subsequent disclosures of the data.
Despite their simplicity, these scrappy audits are nonetheless effective. Out
of 16 surveyed social media platforms, 11 make transparency disclosures about
content moderation and 8 meet the prerequisites of one audit. Yet only
4~platforms pass their audits. The paper continues probing the limits of
transparency data by presenting a data-driven overview of the online sexual
exploitation of minors. Accordingly, the analysis is particularly careful to
identify threats to validity as well as potentially helpful, but unavailable
statistics. Likewise, it identifies major shortcomings of widely used
technologies for the automated detection of images and videos depicting sexual
abuse of minors. Overall, the data shows an alarming growth in such material
over the last decade. However, there also are strong indicators that current
statistics, which treat all such material the same, are large and unhelpful
overcounts. Notably, many technical violations of the law, e.g., teenagers
sexting, are not necessarily grounded in actual harm to minors but still
reported as such.
