Incremental loads, full resyncs, and AI-assisted SQL — now standard across all database connectors.
TL;DR
- Unified table replication across all databases
- Incremental updates + full data resync
- In-pipe SQL transformations with AI assistance
- Zero reconfiguration needed for existing flows
What Happened
We’ve rolled out a major upgrade to our entire suite of database connectors. This update brings consistency, intelligence, and flexibility to how you can set up and manage data replication pipelines.
Whether you're working with a database like Azure or the underlying databases of Oracle, NetSuite, Salesforce etc, you now get a unified experience with smarter defaults and more powerful capabilities built in.
Why This Matters
Before this update, working with database connectors often meant:
- Navigating database-specific quirks and setup hurdles
- Dealing with manual or complex configurations for incremental loading
- No built-in support for log-based replication
- Limited on-the-fly transformations
- Relying on SQL expertise just to filter or shape your data
These friction points made scaling and maintaining pipelines across multiple databases unnecessarily time-consuming — especially for teams working across multiple clouds and tech stacks.
What’s New
Each feature now works the same across all database connectors:
- Unified Setup Across All DBs
Set up and replicate tables with one consistent, intuitive flow — no need to learn the quirks of each database.
- Incremental Updates & Change Tracking
Easily configure CDC (Change Data Capture) and update logic — just a few clicks to set it up.
- Log Replication
Maintain data consistency across systems and locations. Ideal for compliance, recovery, or real-time sync.
- Full Resync Support
Need to reload historical data or perform a clean sync? You can now do this reliably and with minimal effort.
- In-Pipe SQL Transformations
Filter, join, aggregate, and clean your data directly in the pipeline — without having to wait for a separate transformation step on your side.
- AI-Powered SQL Assistant
Don’t remember the syntax differences for SuiteQL, SOQL, PGSQL (etc)? The built-in AI assistant helps you generate, edit, and troubleshoot SQL on the fly.
What’s in Scope
This upgrade applies to all database connectors, including:
- PgSQL, MSSQL, Vertica...
- Azure, GCP, AWS...
- Salesforce, NetSuite, Oracle...
- ...and every other of the ±40 connectors in our DB portfolio
You now get the same setup experience and capabilities across the board.
What You Need to Do
No action is required for existing flows — they’ll keep working exactly as before.
However, we encourage you to:
- Review and enable incremental sync settings on your most critical tables
- Explore AI-assisted SQL transformations
- Take advantage of log replication and full resync support where relevant
What’s Coming Next
We’re expanding this unified pipeline experience to non-database sources, giving you the same transformation power and consistency across APIs, files, and cloud apps.
Let Us Know What You Think
We’d love to hear how you’re using the new features.
Share feedback, ideas, or success stories with us — right from the platform or through our budding community.
Comments