Real-time sync
Changes in Apache Kylin or MotherDuck instantly reflect in both systems. No stale data, no manual imports.
Keep Apache Kylin and MotherDuck in sync without custom scripts. Cut weeks of integration work, eliminate silent data drift, and give your team a single, reliable source of truth.
Apache Kylin is a read-only source: Stacksync reads its data in real time and delivers it into MotherDuck, so MotherDuck always reflects the current state of Apache Kylin — without exports, scripts, or schedulers.
Companies end up with two warehouses for practical reasons: a migration in progress, teams that standardized on different platforms, an acquisition, or tools that only connect to one of them. The result is the same dataset maintained twice, with duplicated pipelines and numbers that almost match.
Bring the acquired company's warehouse data across continuously instead of through one-off dumps.
When one platform is replacing the other, keep tables mirrored while workloads move over gradually, and cut over with nothing to backfill.
Mirror the datasets a BI tool, notebook, or application needs onto the platform it can actually reach.
Representative objects on each side — any object or custom field can map to any target. Schemas are auto-detected; types are converted between the two systems.
| Apache Kylin objects | MotherDuck objects | How this pairing syncs | |
|---|---|---|---|
| Source Tables Hive or other upstream tables that builds read from. | Schemas Namespaces within a database used to organize synced tables. | Source Tables is specific to Apache Kylin and Schemas to MotherDuck — each maps to any object or custom field on the other side. | |
| Segments Time-ranged build units that partition pre-computed data. | Tables The main landing target for synced records and source for analysis. | Segments is specific to Apache Kylin and Tables to MotherDuck — each maps to any object or custom field on the other side. | |
| Build Jobs Batch jobs that compute or refresh segments, monitored via the REST API. | Views Modeled projections used as outbound sync sources. | Build Jobs is specific to Apache Kylin and Views to MotherDuck — each maps to any object or custom field on the other side. | |
| Projects Top-level workspaces that group models, tables, and jobs. | Database Shares Read-only copies of a database shared with other users or teams. | Projects is specific to Apache Kylin and Database Shares to MotherDuck — each maps to any object or custom field on the other side. | |
| Models Star-schema definitions over source tables that determine what can be queried. | Attached Local DuckDB Databases Local files attached alongside cloud databases for hybrid queries. | Models is specific to Apache Kylin and Attached Local DuckDB Databases to MotherDuck — each maps to any object or custom field on the other side. | |
| Cubes / Indexes Pre-computed aggregate structures that answer queries at low latency. | Databases Cloud-hosted DuckDB databases that scope a sync's reads and writes. | Cubes / Indexes is specific to Apache Kylin and Databases to MotherDuck — each maps to any object or custom field on the other side. |
Each direction of the sync is driven by what the source system can signal and what the destination accepts — detection, delivery, and expected latency below.
DetectionStacksync polls Apache Kylin for changes on an incremental schedule, reading only records changed since the previous pass. Data freshness follows segment build and refresh jobs, so integrations poll query results.
DeliveryEach detected change is applied to MotherDuck as a row-level write, with types converted between the two schemas.
DetectionStacksync polls MotherDuck for changes on an incremental schedule, reading only records changed since the previous pass. Polling.
DeliveryApache Kylin does not accept inbound record writes, so this direction carries requests rather than records: Apache Kylin's output flows back as field updates on the originating MotherDuck records.
Real-time sync, workflow automation, event queues, EDI, and monitoring, for every Apache Kylin–MotherDuck connection.
Changes in Apache Kylin or MotherDuck instantly reflect in both systems. No stale data, no manual imports.
Trigger automated workflows whenever Apache Kylin or MotherDuck data changes, update records, fire webhooks, or kick off sequences without brittle API scripts.
Handle millions of events per minute without losing a single Apache Kylin or MotherDuck record.
Track your Apache Kylin ⇄ MotherDuck sync health, view errors, and replay failed events in one click.
Transform legacy EDI complexity into simple database interactions between Apache Kylin and MotherDuck.
Configure and sync within minutes, no code. Whether you sync 50k or 100M+ records, Stacksync handles the queues, infra, and plumbing. Integrations are non-invasive and need zero setup on your systems.
Authenticate Apache Kylin and MotherDuck with each platform's native method — OAuth, API keys, or service accounts — plus secure options like SSH tunneling, IP whitelisting, and VPC peering.
Pick the Apache Kylin and MotherDuck objects to sync — Stacksync auto-detects both schemas, including custom fields where the platform exposes them. Sync to existing tables, or let Stacksync create new ones with ideal data types.
Fields map automatically even when names and types differ. Stacksync handles transformation and type casting for you, zero configuration required.
Yes. Stacksync provides a managed, real-time integration between Apache Kylin and MotherDuck — Apache Kylin is a read-only source, so data flows from it into the other system: authenticate both systems, choose the objects to sync, map fields visually, and changes propagate in milliseconds — no code required.
On the Apache Kylin side: Projects, Models, Cubes / Indexes, Source Tables, plus custom fields where Apache Kylin exposes them. On the MotherDuck side: Views, Database Shares, Attached Local DuckDB Databases, Databases. Stacksync auto-detects both schemas and converts types between the two systems.
Apache Kylin is a read-only source, so this integration runs one-way: Stacksync reads from Apache Kylin in real time and delivers into MotherDuck. Field mapping and monitoring work the same as for two-way pairs.
Common patterns for Apache Kylin and MotherDuck: Consolidation after M&A; Migration without a big bang; Serve tools that only connect to one platform. Bring the acquired company's warehouse data across continuously instead of through one-off dumps.
Apache Kylin: SQL over JDBC/ODBC plus a REST API for queries and administration. Authentication: Username/password (HTTP basic authentication on the REST API). MotherDuck: SQL through DuckDB clients and drivers using a MotherDuck (md:) connection. Authentication: Access token created in MotherDuck (Settings > General > Create Token), pasted into Stacksync; database name and schema configurable if not using defaults. Stacksync manages authentication, retries, and rate limits on both sides.
Apache Kylin: Kylin answers queries from pre-computed aggregate indexes (cubes) built over star-schema models, so query-time data reflects the last completed build rather than live source rows. MotherDuck: MotherDuck is built on DuckDB, so integrations use DuckDB SQL and connect through standard DuckDB client libraries with an md: connection string. Stacksync's field mapping accounts for these differences between Apache Kylin and MotherDuck without custom code.
As a data company, we understand the importance of keeping your data secure. Stacksync is built with security best practices to keep your data safe at every layer, and is DPF-certified for US, EU, UK and CH data transfers.
Let your users access Stacksync from your centralized user management systems. Works with Okta, Azure, Google SSO and more.
Immediately get alerted about record syncing issues over email, Slack, PagerDuty and WhatsApp. Resolve issues from a centralized dashboard with retry and revert options.
Securely connects to your systems with:
Every pair below is a real-time, two-way sync. Search all 337 integrations available for Apache Kylin and MotherDuck.