-
Notifications
You must be signed in to change notification settings - Fork 54
Open
Labels
Description
Product
Amazon Linux 2023
What is your question?
building archive for EMR serverless takes a lot of time when using al2023
Dockerfile
FROM amazonlinux:2023 AS base
RUN yum install -y gcc python3 python3-devel
ENV VIRTUAL_ENV=/opt/venv
RUN python3 -m venv $VIRTUAL_ENV
ENV PATH="$VIRTUAL_ENV/bin:$PATH"
RUN python3 -m pip install --upgrade pip && \
python3 -m pip install great_expectations venv-pack
RUN mkdir /output && venv-pack -o /output/pyspark_ge.tar.gz
FROM scratch AS export
COPY --from=base /output/pyspark_ge.tar.gz /
command
docker buildx build --no-cache --platform linux/arm64 --output . .building time
Building 2317.3s (11/11) FINISHED
When I use amazonlinux:2 instead of amazonlinux:2023 the build runs much faster
building time
Building 493.2s (11/11) FINISHED
onikroo and nmburgan