Intelligence Observatory

The Intelligence Observatory (IO) is a human behavioral testing and benchmarking platform designed to work at scale. Human and non-human primate data captured from a variety of internal and external collaborators fuels a natural intelligence benchmarking platform, and in turn informs and guides the Missions. 

The IO is building experimental infrastructure for scalable psychometric testing in humans and models. A central focus is the development of formal data abstractions that describe cognitive tasks, agent interfaces, and behavioral measurements. These abstractions are designed to support interoperable use across artificial and natural agents. 

In parallel, the IO is advancing internal infrastructure for high-throughput online experimentation in human participants, including a scalable orchestration engine now undergoing live pilot testing in collaboration with the Perception Mission. The IO also supports exploratory work in virtual-reality based task environments, piloting a limited set of VR-based protocols. 

Taken together, these efforts position the IO to enable rigorous, scalable comparisons of computational models against human behavioral data. A research scientist and a member of the Quest Engineering Team support this work.