From Stars to Storage Engines: Migrating Big Science Workloads Beyond Greenplum
Wednesday, October 22 at 11:15–12:05
Room: Omega 2
Level: Intermediate
We archive massive datasets to map the stars in ESA’s Gaia mission and unlock the secrets of dark matter and dark energy with Euclid. Today, these are living on Greenplum — but shifting away from Open Source Software demands have us exploring new directions: migrating to Citus or adopting EDB’s next-generation Greenplum-based warehouse.
In this talk, we’ll share how we’re rethinking architecture, tools, and operations to handle petabyte-scale astronomy workloads. We’ll cover the practical pros and cons of each option, the administrative shifts required, and the hurdles we face moving such critical operations between engines. Attendees will leave with real-world lessons and key questions to ask before starting a migration of their own.
