KnowBite KnowBite

Data Engineering · · 1 min read

Accelerating Spark queries with Iceberg materialized views

Accelerate slow, repetitive Apache Spark analytical queries on Apache Iceberg tables without rewriting any SQL. This post shows how automatic query rewrite in Amazon EMR and AWS Glue uses Iceberg materialized views in the AWS Glue Data Catalog to transparently substitute matching query plans, and how to design materialized views for the best speedup.

Read original on AWS Big Data Blog