In this video, Laura Thomson from Mozilla describes a major project involving Big Data Migration.
In January 2011 we moved the Mozilla crash reporting system from old creaky hardware in San Jose to a new shiny datacenter in Phoenix. This system contains more than 40TB of data in HBase, the Hadoop database, and PostgreSQL. The data collecting app has a requirement for close to 100% uptime. On top of that we have data processing, an API, and a webapp. After many months of work, the migration went seamlessly.
Recorded at the linux.conf.au on January 17, 2012.
Leave your own comment