OpenAI has unveiled Habitat, the online storage platform behind ChatGPT: processing over 70 million requests per second, storing over 500PB of data, serving over 1 billion users weekly, and covering nearly 40 geographical regions. The system was initially developed as a Python client library for GPTs during the 2023 Developer Day, connecting to a single database, with Python still supporting over 20 million requests per second during peak times.

The company acknowledged early on that Python could not sustain the ultimate scale and knew a rewrite was necessary, but chose to expand the product first. The rewrite was delayed by about a year to focus engineering efforts on more urgent issues during a hyper-growth period. Habitat later became the second-largest internal service by core count. In Q2 2026, two engineers, along with Codex and GPT-5.5, rewrote the entire service in Rust. The new version now handles 95% of production traffic, with CPU efficiency improved by about 6 times, memory efficiency increased by about 15 times, and both average and tail latency reduced, while the Python implementation is set to be deprecated in a few weeks.

The underlying system still connects to Azure Cosmos DB; complex queries are synchronized to the analytics layer via change data capture. The official documentation will continue to address storage layer expansion, multi-tenant reliability, and read performance. Boundary conditions are written as: monitoring, testing, and service boundaries must be clear enough to entrust migration to the model. Without these, a rewrite could turn into an accident. Codex also revealed a defect where local logs wrote approximately 640TB annually to SSDs, which has been fixed, indicating that writing code and writing logs are two sides of the same coin.

The creditors of this technical debt have shifted from "future overtime engineers" to "stronger next-generation models." Choosing the wrong language no longer automatically equates to expensive manual migration, provided that traffic paths, testing, and rollbacks are still designed by humans. OpenAI has written this bet into production storage rather than demonstration repositories.

In market mechanisms, this is an internal efficiency event that spills over into coding agent pricing. The buyers are platform teams looking to migrate existing Python services; the sellers are OpenAI, which has embedded the rewrite costs into Codex subscriptions. Beneficiaries are large-scale systems with clear interfaces and observability; those under pressure are startup codebases that want models to migrate architectures without a test network, as well as outsourcing firms selling migration projects by person-month. Funding has shifted from hiring rewrite teams to tokens and two engineers capable of writing constraints. The public blog itself serves as a living advertisement for Codex enterprise orders.

Source: Public Information