When AI Passes This Test, Look Out

SAN FRANCISCO — If you’re looking for a new reason to be nervous about artificial intelligence, try this: Some of the smartest humans in the world are struggling to create tests that AI systems can’t pass. For years, AI systems were measured by giving new models a variety of standardized benchmark tests. Many of these tests consisted of challenging, SAT-caliber problems in areas like math, science and logic.

Comparing the models’ scores over time served as a rough measure of AI progress..