最新消息:雨落星辰是一个专注网站SEO优化、网站SEO诊断、搜索引擎研究、网络营销推广、网站策划运营及站长类的自媒体原创博客

postgresql - CDC between OLAP (amazon redshift) and OLTP (possibly amazon aurora) - Stack Overflow

programmeradmin4浏览0评论

This is the situation:

My startup has a transactional platform that uses Redshift as its main database (before you say this was an error, it was not—we have multiple products in our suite that are primarily analytical, so we need an OLAP database). Now we are facing scaling challenges, mostly due to some Redshift characteristics that are optimal for OLAP but not ideal for OLTP.

We need to establish a Change Data Capture (CDC) between a primary database (likely Aurora) and a secondary database (Redshift). We've previously attempted this using AWS Database Migration Service (DMS) but encountered difficulties.

I'm seeking recommendations on how to implement this CDC, particularly focusing on preventing blocking. Should I continue trying with DMS? Would Kafka be a better solution? Additionally, what realistic replication latency can I expect? Is a 5-second or less replication time a little too optimistic?

发布评论

评论列表(0)

  1. 暂无评论