CData adds pipeline orchestration & broader CDC support

CData has added pipeline orchestration, expanded change data capture support, and open table format support to CData Sync, targeting data pipeline management across hybrid and cloud environments.

The update adds several functions, including a new Pipelines feature for orchestrating multi-step workflows inside Sync. Data engineers can sequence replication jobs, transformations, and events within the platform instead of relying on separate orchestration tools.

A redesigned API 2.0 is also part of the release, aimed at helping organisations configure pipelines, trigger executions, and monitor operations programmatically across distributed deployments, including through external systems.

The release also extends change data capture support to IBM DB2, including LUW and iSeries/AS400, and SAP HANA. This enables near-real-time replication of incremental changes from those systems into cloud analytics and AI environments.

CData has also introduced support for Delta Lake, including Microsoft Fabric through Open Mirroring, and Apache Iceberg. This allows teams to write data into open table formats used in analytics and AI workloads.

Workflow focus

The additions come as companies try to keep analytical systems supplied with current data while managing a growing number of dependencies across legacy systems and newer cloud platforms. In response, data integration vendors have increasingly combined replication, governance, and workflow management in a single product as customers look to reduce the number of tools they use.

A new Workspaces function provides central management of connections, jobs, and transformations across teams and environments. It is designed to help organisations maintain policy controls and operational visibility as data pipelines scale.

Manish Patel outlined the company's view of the shift away from older data pipeline practices.

"The era of batch-and-hope data pipelines is over," said Manish Patel, GM of Data Integration at CData.

He added: "Enterprises need data flowing continuously from core systems to AI platforms, and they need to coordinate those flows without duct-taping together multiple tools. CData Sync gives teams the control and flexibility to operate data infrastructure the way modern businesses actually work."

Customer view

Finthrive also commented on the direction of the product update.

"Organisations everywhere are focused on ensuring data moves seamlessly and reliably between foundational systems and advanced analytics environments," said Andrew Chabot, Senior Data Engineering Manager at Finthrive.

He added: "The direction CData Sync is taking with pipeline orchestration and expanded CDC support reflects where data platforms need to go next. It has the potential to simplify how complex data workflows are coordinated and to consistently deliver trusted, timely data to the teams and models that depend on it."

CData describes itself as a provider of data access and replication software, serving more than 10,000 customers worldwide and offering connectivity across more than 350 data sources.