You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
{{ message }}
This repository was archived by the owner on Aug 7, 2025. It is now read-only.
Copy file name to clipboardExpand all lines: content/en/user-guide/aws/glue/index.md
+18Lines changed: 18 additions & 0 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -4,13 +4,31 @@ linkTitle: Glue
4
4
description: Get started with Glue on LocalStack
5
5
tags: ["Pro image"]
6
6
---
7
+
7
8
## Introduction
8
9
9
10
The Glue API in LocalStack Pro allows you to run ETL (Extract-Transform-Load) jobs locally, maintaining table metadata in the local Glue data catalog, and using the Spark ecosystem (PySpark/Scala) to run data processing workflows.
10
11
11
12
LocalStack allows you to use the Glue APIs in your local environment.
12
13
The supported APIs are available on our [API coverage page](/references/coverage/coverage_glue/), which provides information on the extent of Glue's integration with LocalStack.
13
14
15
+
{{< callout >}}
16
+
LocalStack now includes a container-based Glue Job executor, enabling Glue jobs to run within a Docker environment.
17
+
Previously, LocalStack relied on a pre-packaged binary that included Spark and other required components.
18
+
The new executor leverages the `aws-glue-libs` Docker image, provides better production parity, faster startup times, and more reliable execution.
19
+
20
+
Key enhancements include:
21
+
22
+
- Running Glue jobs inside Docker containers
23
+
- Providing isolated execution environments per job
24
+
- Executing multiple jobs in parallel
25
+
- Ensuring correct versioning of Spark, Hadoop, Python, Java, and related libraries
26
+
- Improving startup times and offline execution support
27
+
28
+
To use it, set `GLUE_JOB_EXECUTOR=docker` and `GLUE_JOB_EXECUTOR_PROVIDER=v2` in your LocalStack configuration.
29
+
The new executor additionally deprecates older versions of Glue (`0.9`, `1.0`, `2.0`).
30
+
{{< /callout >}}
31
+
14
32
## Getting started
15
33
16
34
This guide is designed for users new to Glue and assumes basic knowledge of the AWS CLI and our [`awslocal`](https://github.com/localstack/awscli-local) wrapper script.
0 commit comments