Our long-term vision is Efficient Intelligence : AI that learns using fewer resources, generalizes from less data, and reasons through structure rather than scale. To reach that, we are first building the Foundational Data Systems that make structured AI possible.

The Mission

AI today is limited not only by model design but by the inefficiency of the data that feeds it. At scale, each redundant byte, each poorly organized dataset, and each inefficient data path slows progress and compounds into enormous cost, latency, and energy waste.

company’s mission is to remove that inefficiency. We combine new research in information theory , probabilistic modeling , and distributed systems to design self-optimizing data infrastructure: systems that continuously improve how information is represented and used by AI.

This engineering team partners closely with the company's Research group led by Prof. Andrea Montanari (Stanford), bridging advances in information theory and learning efficiency with large-scale distributed systems. Together, we share a conviction that the next leap in AI will come from breakthroughs in efficient systems, not just larger models.

What You’ll Build

• Global Metadata Substrate. Help design and implement the metadata substrate that supports time-travel, schema evolution, and atomic consistency across massive tabular datasets.
• Adaptive Engines. Build components that reorganize data autonomously, learning from access patterns and workloads to maintain efficiency with minimal manual tuning.
• Intelligent Data Layouts. Develop and refine bit-level encodings, compression, and layout strategies to extract maximum signal per byte read.
• Autonomous Compute Pipelines. Contribute to distributed compute systems that scale predictively and adapt to dynamic load.
• Research to Production. Translate new algorithms in compression and representation from research into production-grade implementations.
• Latency as Intelligence. Design and optimize data paths to minimize time between question and insight, enabling faster learning for both models and humans.

What You Bring

• Foundational understanding of distributed systems: partitioning, replication, and fault tolerance.
• Experience or curiosity with columnar formats such as Parquet or ORC and low-level data encoding.
• Familiarity with metadata-driven architectures or data query planning.
• Exposure to or hands-on use of Spark , Flink , or similar distributed engines on cloud storage.
• Proficiency in Java, Rust, Go, or C++ and commitment to clean, reliable code.
• Curiosity about how compression, entropy, and representation shape system efficiency and learning.
• A builder’s mindset—eager to learn, improve, and deliver features end-to-end with growing autonomy.

Bonus

• Familiarity with Iceberg , Delta Lake , or Hudi .
• Contributions to open-source projects or research in compression, indexing, or distributed systems.
• Interest in how data representation influences AI training dynamics and reasoning efficiency.

Why

• Fundamental Research Meets Enterprise Impact. Work at the intersection of science and engineering, turning foundational research into deployed systems serving enterprise workloads at exabyte scale.
• AI by Design. Build the infrastructure that defines how efficiently the world can create and apply intelligence.
• Real Ownership. Design primitives that will underpin the next decade of AI infrastructure.
• High-Trust Environment. Deep technical work, minimal bureaucracy, shared mission.
• Enduring Horizon. Backed by NEA, Bain Capital, and various luminaries from tech and business. We are building a generational company for decades, not quarters or a product cycle.

Compensation & Benefits

• Competitive salary, meaningful equity, and substantial bonus for top performers
• Flexible time off plus comprehensive health coverage for you and your family
• Support for research, publication, and deep technical exploration

Join us to build the foundational data systems that power the future of enterprise AI.

Here you will shape the fundamental infrastructure that makes intelligence itself efficient, structured, and enduring.