IOMETE Spark Jobs Marketplace

IOMETE offers access to its Spark Jobs Marketplace, an innovative platform featuring a variety of pre-built ingestion jobs ready for deployment. Explore this open-sourced marketplace to find ingestion solutions tailored to your specific data processing needs.

---

Spark Jobs Marketplace

To view and utilize all built-in jobs in IOMETE, navigate to the Job Templates page and scroll down to Marketplace section.

Available jobs

There is a list of all available built-in jobs.

MySQL Database Replication Job

Seamlessly transfer your MySQL tables to IOMETE Lakehouse with our easy-to-configure Spark Job.

Query Scheduler Job

Effortlessly schedule your SQL query to be run in your data warehouse using IOMETE's Query Scheduler Job.

Data Compaction Job

Over time, iceberg tables can slow down and may need data compaction to tidy them up. IOMETE offers a built-in job to execute data compactions for each table.

Catalog Sync Job

Efficiently synchronize your data with the Data Catalog using IOMETE's Catalog Sync Job.

TPC-DS Generator Job

The TPC-DS generator is a tool designed for benchmarking and evaluating the performance.

Kafka to IOMETE Lakehouse Data Replication Job

A configuration-based, ready-to-use Spark Streaming job for replicating data from Kafka to the IOMETE Lakehouse.

File Streaming

A configuration-based, ready-to-use Spark Streaming job for replicating data from File sources (a directory, S3 location, etc.) to the IOMETE Lakehouse.