Skip to content
This repository was archived by the owner on Aug 7, 2025. It is now read-only.

Commit bc07cd9

Browse files
add a callout for new glue executor (#1751)
Co-authored-by: Quetzalli <alejandra.olvera.novack@gmail.com>
1 parent 8a19853 commit bc07cd9

File tree

1 file changed

+18
-0
lines changed

1 file changed

+18
-0
lines changed

content/en/user-guide/aws/glue/index.md

Lines changed: 18 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -4,13 +4,31 @@ linkTitle: Glue
44
description: Get started with Glue on LocalStack
55
tags: ["Pro image"]
66
---
7+
78
## Introduction
89

910
The Glue API in LocalStack Pro allows you to run ETL (Extract-Transform-Load) jobs locally, maintaining table metadata in the local Glue data catalog, and using the Spark ecosystem (PySpark/Scala) to run data processing workflows.
1011

1112
LocalStack allows you to use the Glue APIs in your local environment.
1213
The supported APIs are available on our [API coverage page](/references/coverage/coverage_glue/), which provides information on the extent of Glue's integration with LocalStack.
1314

15+
{{< callout >}}
16+
LocalStack now includes a container-based Glue Job executor, enabling Glue jobs to run within a Docker environment.
17+
Previously, LocalStack relied on a pre-packaged binary that included Spark and other required components.
18+
The new executor leverages the `aws-glue-libs` Docker image, provides better production parity, faster startup times, and more reliable execution.
19+
20+
Key enhancements include:
21+
22+
- Running Glue jobs inside Docker containers
23+
- Providing isolated execution environments per job
24+
- Executing multiple jobs in parallel
25+
- Ensuring correct versioning of Spark, Hadoop, Python, Java, and related libraries
26+
- Improving startup times and offline execution support
27+
28+
To use it, set `GLUE_JOB_EXECUTOR=docker` and `GLUE_JOB_EXECUTOR_PROVIDER=v2` in your LocalStack configuration.
29+
The new executor additionally deprecates older versions of Glue (`0.9`, `1.0`, `2.0`).
30+
{{< /callout >}}
31+
1432
## Getting started
1533

1634
This guide is designed for users new to Glue and assumes basic knowledge of the AWS CLI and our [`awslocal`](https://github.com/localstack/awscli-local) wrapper script.

0 commit comments

Comments
 (0)