But like many standardized tests, the reports miss a lot. They are poor tools for understanding how well this technology works, and how each company’s progress compares to their competitors’. Some in the space gripe that the reports risk encouraging engineers to baby their cars in a bid to keep disengagements low, to juke the stats.
Still, in a new industry built on complex software and hardware, in which secrecy is paramount, any public information can be revealing. And there is knowledge to be gleaned from these thousands upon thousands of pages.