IOMETE offers a feature for configuring Spark Catalogs interface.
To view Spark Catalogs, navigate to the
Settings menu item and switch to the
Spark Catalogs tab.
In the list below, you'll find the Spark catalog. The default catalog created by the system is called
To add new catalog item, click
Add catalog button. You'll see following inputs:
- Lakehouse directory
- Type - Currently, only 'iceberg' type is supported.
For custom credentials, click on the
Configure credentials radio button. Then, you'll see additional input fields for your credentials.
- Endpoint - If using AWS S3 you can omit the endpoint, for Minio and Dell ECS storage providers the endpoint is mandatory.
- Access key
- Secret key
After filling all inputs click
Editing and deleting the
default catalog is not permitted; you can only make changes to other catalogs.
Catalog in SQL Editor.
Go to the SQL Editor to view the Spark catalog that has been created.
Check out the
Database Explorer section in the left panel. If you don't see the created catalog, please refresh by using the button.
In the given image, we have already created some databases and tables inside the catalog.