Data Engineering AWS Big Data Blog · 2026-09-23T18:28:32Z · 1 min read

Announcing Spark Connect on Amazon EMR on EC2: Interactive PySpark anywhere

Amazon EMR on EC2 now supports Spark Connect, so you can develop and debug PySpark interactively from Amazon SageMaker Unified Studio Data Notebooks or your own IDE while Spark runs on your cluster. This post shows you how to get started from both a Data Notebook and a local IDE.

Read original on AWS Big Data Blog