Open-Sourced Ingestion Jobs

MySQL streaming job

Replicates MySQL tables to the IOMETE Lakehouse with a full load or an incremental sync.

Kafka streaming job

Copies data from Kafka to Iceberg using Spark Structured Streaming.

File streaming job

Transfers files from object storage to Iceberg continuously.

Kinesis streaming job

Reads data from a Kinesis stream and writes it to an Iceberg table.

Debezium CDC streaming job

Replicates CDC events from MySQL and PostgreSQL to Iceberg tables using Debezium Server.

Oracle streaming job

Replicates Oracle tables to the IOMETE Lakehouse with a full load or an incremental sync.