Stellar is introducing BucketListDB, a new unified storage mechanism that replaces its dual database system. The upgrade cuts disk usage by 45%, increases read speeds 400%, and halves validator startup time, preparing the network for Soroban's mainnet launch and continued growth.
Stellar's ledger has grown from 2.6 million entries in 2018 to 43.4 million last year, with projections exceeding 300 million by end of 2023. The current dual-database system using a Bucket List for hashing and SQL key-value store for lookups creates inefficiencies: redundant disk storage, excessive write operations, and unnecessary ACID compliance overhead. BucketListDB consolidates these into a single searchable structure using bloom filters and bucket indexes for efficient lookups. The result: 45% reduction in disk usage, 400% faster reads, and 50% faster validator startup. Already enabled for Horizon instances with captive-core, it will roll out network-wide soon.
