Platform Tour

The IOMETE Platform interface is composed of the following sections:

1. User Menu: - Use this menu to switch themes, access the settings menu, and log out.

2. Navigation Menu: - Navigate through different Platform areas including Lakehouses, SQL Editor, Spark jobs, Data catalog and more.

3. Help Menu: - Access this menu to redirect to Community & Support and Documentation for assistance.

4. Content: - When a Platform menu item is selected, the associated content is displayed in the content pane.

Lakehouses page

A virtual lakehouse is a cluster of compute resources that provide the required resources, such as CPU, memory to perform the querying processing. Before using the SQL Editor, you should create a lakehouse.

For more details, see Virtual Lakehouses

SQL Editor page

The main components of the SQL Editor are highlighted below:

• Worksheets offer a simple method for you to write SQL queries, execute the queries, and see the results.
• Database explorer is used to explore your database objects, which includes namespaces, tables, views, and their columns (even complex columns), and partitions.
• Lakehouse and Namespace selection are required to execute SQL queries.
• SQL Editor is used to write SQL queries using autocomplete feature. IOMETE tracks database objects and suggests them as autocomplete options
• Query result view provide executed queries results. You can filter each column in the results and toggle on Charts to visualize the results as graphs.

For more details, see SQL Editor

Spark Jobs page

IOMETE offers PySpark quickstart template for AWS or PySpark quickstart template for GCP helping you kickstart your first Spark Job. Follow the README instructions to use the template, which includes a sample job reading a CSV file from an S3 bucket, applying transformations, and writing the output to an Iceberg Table. Use it as a starting point for your custom jobs.

For more details, see Spark job

Data security page

Data security at IOMETE is maintained through access control using a user interface for consistent administration. Security admins set policies for databases, tables, and columns, managing permissions for groups or users. IOMETE offers the following types of data security.

• Access Policy policy comprises rules and permissions that specify who can access specific resources and the actions they can take after gaining access.
• Data masking is a method to hide sensitive information by changing it into fake data while keeping its appearance intact. It safeguards private details during testing or sharing.
• Row-level filtering limits who can see certain rows in a database.

For more details, see Data security overview

Data catalog page

The data catalog interface offers metadata for all tables. You can easily filter by Schemas, Table type, Provider and Tags, and use the search function to find what you need. Additionally, you have the option to bookmark tables for quick access.

In the detailed view of a table, you can view comprehensive information such as Created time, Updated time, Last sync time, Table type, Table owner, Tags, Description, and Columns. For more convenience, you can edit table tags, owner, and description. Similarly, you can edit column tags and descriptions. This user-friendly interface allows you to manage and customize the information according to your needs.

Notebook

Jupyter Notebook is a powerful tool for interactive data exploration and prototyping. By connecting to IOMETE's Jupyter Gateway you will be able to explore and analyze data stored in IOMETE's data lake directly from your local environment.

For more details, see Starting with Notebook