Use your Elasticsearch deployment to complete the fields. Select Add Elastic Search Sink from the database CDC console to enforce the default settings. DataStax recommends using the default Astra Streaming settings. The data- topic can be used to consume CDC data in Astra Streaming.Īfter creating your CDC connector, connect an Elasticsearch sink to it. The log- topic is for CDC functionality and should not be used. The log- topic consumes schema changes, processes them, and then writes clean data to the data- topic. Once created, your CDC connector will appear:Įnabling CDC creates a new astracdc namespace with two new topics, data- and log. Select the CDC tab in your database dashboard.Use the default persistent and non-partitioned topic settings. In, select Create Streaming.Įnter the name for your new streaming tenant and select a provider.This doc will show you how to create a CDC connector for your Astra DB deployment and send change data to an Elasticsearch sink. By design, the Change Data Capture (CDC) component is simple, with a 1:1 correspondence between the table and a single Pulsar topic. □ Apache Pulsar Documentation CDC for Astra DB ¶ĬDC for Astra DB automatically captures changes in real time, de-duplicates the changes, and streams the clean set of changed data into Astra Streaming where it can be processed by client applications or sent to downstream systems.Īstra Streaming processes data changes via a Pulsar topic.□ Pulsar Documentation - Getting Started.□ Youtube Video - Astra Streaming demo.□ Astra Docs - Reference documentation.
0 Comments
Leave a Reply. |
AuthorWrite something about yourself. No need to be fancy, just an overview. ArchivesCategories |