'Restoring database delta between two dumps
We're currently struggling with moving our Aurora Database to an RDS Postgres DB. Our database is quite huge with 80GB and some tables having up to 85 million entries.
The problem is currently our dump and restore time.
Dumping the database takes around 1 hour but the restore time is beyond 24h, due to some indexes taking up to 12 hours to create. Even with changing those indexes its quite the time for a production downtime.
My question would be is there any way to dump the DB an initial first time which we can take anytime during the day. Then during go-live we take a second dump, and we restore it again, with it only restoring/adding the delta from the first dump and this dump.
I've looked into AWS DMS, but here is the problem that it dies after 2 days due to memory issues and additionally it doesn't add views, indexes etc.
Any feedback is welcome.
amazon-rdsSolution 1:[1]
We ended up removing some index creations and ran our RDS on the recommended settings from AWS.
https://docs.aws.amazon.com/AmazonRDS/latest/UserGuide/PostgreSQL.Procedural.Importing.html
Sources
This article follows the attribution requirements of Stack Overflow and is licensed under CC BY-SA 3.0.
Source: Stack Overflow
| Solution | Source |
|---|---|
| Solution 1 | M. Schmidt |