Open-Sourced Ingestion Jobs

Kinesis streaming job

This project contains a spark streaming job that reads data from a kinesis stream and writes it to a Iceberg Table.

MySQL streaming job

This library provides easily replicate tables from MySQL databases to IOMETE

Kafka streaming job

This is a collection of data movement capabilities. This streaming job copies data from Kafka to Iceberg.

PostgreSQL streaming job

This library provides easily replicate tables from PostgreSQL to IOMETE

MongoDB streaming job

This library provides easily replicate tables from MongoDB databases to IOMETE

File streaming job

This library provides easily transfer files to IOMETE continuously