Spark SQL without the notebook.
Spark 4.1 HiveServer2 binary and HTTP connections with TLS, Kerberos, and SSH, catalog navigation, Iceberg CRUD, and partition advice - in a real desktop workbench.
Spark 4.1 · HiveServer2 · TLS/Kerberos/SSH · Iceberg
The physical plan Mongrel would show for your query.
Click any operator below to see what it does and what Mongrel would suggest. Same plan view you get inside the workbench.
// FileScan parquet · analytics.events
Iceberg scan with a filter on event_date that does not match the partition spec (bucket(16, user_id)), so nothing is pruned and the whole table is read. Mongrel's partition advisor flags scans like this.
-- catalog.analytics · spark-thrift-prod SELECT user_id, COUNT(*) AS pv FROM catalog.analytics.events WHERE event_date >= DATE '2026-06-01' GROUP BY user_id ORDER BY pv DESC NULLS LAST LIMIT 20; -- full-table scan: the filter on event_date -- can't prune; the partition spec is -- bucket(16, user_id) -- ✓ Proposal: add a days(event_ts) partition field ALTER TABLE catalog.analytics.events ADD PARTITION FIELD days(event_ts);
What Mongrel ships for Spark SQL.
HiveServer2 connections
Binary and HTTP transport modes against Spark Thrift Server. TLS, Kerberos, and SSH tunnels are first-class profile options.
Physical plan viewer
Run EXPLAIN and walk the physical plan: scans, exchanges, aggregates, and joins in simple, cost, codegen, or formatted output.
Catalog navigation
Browse catalogs, databases, tables, and views across your Spark session. Hive Metastore and Iceberg catalogs side by side.
Iceberg CRUD
Create, insert, update, and delete on Iceberg tables. Single and bulk edits, schema migrations, and copy/sync run with snapshot-pinned reads.
Partition advice
Mongrel flags full-table scans caused by partition-spec mismatches and proposes the partition transform that fixes them.
Stage & shuffle metrics
With the optional Spark status API, review per-stage shuffle read and write bytes, memory and disk spill, and task counts for your application.
Kerberos ticket-cache auth
Authenticate with the OS ticket cache (kinit) and the HiveServer2 service principal, with SASL QOP selection and authorized proxy users. Works alongside TLS and SSH tunnels.
Encrypted backups
Create encrypted logical archives of Spark namespace tables and views, and restore them with dependency-aware view recreation.
Session & job insight
Add the optional Spark status API URL to see application, executor, job, stage, and SQL execution metrics alongside your session.