IOMETE University
A growing library of practical lessons for data engineers, platform teams, and anyone building a sovereign data lakehouse with IOMETE.
Understand and operate Spark compute.
Learn how IOMETE compute clusters work, scale, and stay isolated across production, staging, analytics, and ETL workloads.
What is a compute cluster? Apache Spark on Kubernetes explained
See how stateless, isolated, multi-protocol Spark clusters process workloads while data stays in object storage.
How a Spark cluster starts, scales and gets sized
Follow cluster startup, autoscaling behavior, and practical sizing patterns for different workload shapes.
Cluster topology: production, staging, analytics and ETL
Organize clusters by workload type with clear ownership, access controls, and cost allocation.
Connect tools and diagnose workloads.
Choose the right connection protocol for each workflow, then use IOMETE cluster tabs and Spark UI to find issues quickly.
JDBC vs SparkConnect vs Arrow Flight: which one to use
Compare the three connection protocols and choose the right option for BI, Python, dbt, Spark, and large result sets.
Spark UI and cluster tabs: where to look when a query fails
Learn where to investigate failed queries, slow jobs, startup problems, configuration changes, and resource pressure.
Recover, version, and govern your data.
Use Apache Iceberg snapshots, time travel, rollback, branches, and tags to operate production tables safely.
I Deleted Production Data on Purpose — Apache Iceberg Time Travel Explained
See how immutable snapshots preserve every table state and make point-in-time queries possible after a bad delete.
How to Recover Deleted Data in Apache Iceberg (Time Travel + Rollback)
Compare snapshot IDs, timestamps, and named references, then restore data with rollback or set current snapshot.
Apache Iceberg Branches & Tags: Git for Your Data
Create durable snapshot bookmarks and isolated writable branches for testing changes without touching production.
Apache Iceberg Time Travel in the Real World: Compliance, GDPR, A/B Testing & More
Apply snapshots and time travel to compliance, reproducibility, debugging, recovery, experimentation, and deletion workflows.