The Stellar Development Foundation introduced Galexie, the first component of the Composable Data Platform, a lightweight application that extracts and stores Stellar ledger data in cloud-based data lakes. Galexie decouples data extraction from transformation, enabling tools like Horizon and Hubble to access precomputed transaction metadata more efficiently than relying on Captive Core.
Galexie is a new lightweight extractor application designed to address the tight coupling between data extraction and transformation in Stellar network development. It efficiently exports complete Stellar network data and stores it in cloud-based data lakes, supporting tools like Hubble and Horizon in building derived data. The application features data extraction, compression, flexible storage options (starting with Google Cloud Storage), and both batch and continuous streaming modes. Built on principles of simplicity, portability, decentralization, extensibility, and resiliency, Galexie significantly improves operational efficiency by enabling direct access to precomputed transaction metadata, reducing reliance on resource-intensive Captive Core instances. Performance benchmarks show that backfilling 10 years of Stellar Pubnet data with 40+ parallel instances costs approximately $600 and takes under 5 days, with ongoing operational costs around $160 per month.
