Skip to content

[Question]: al2023 so slow while installing pip requirements #117

@kostiantyn-lab

Description

@kostiantyn-lab

Product

Amazon Linux 2023

What is your question?

building archive for EMR serverless takes a lot of time when using al2023

Dockerfile

FROM amazonlinux:2023 AS base

RUN yum install -y gcc python3 python3-devel

ENV VIRTUAL_ENV=/opt/venv
RUN python3 -m venv $VIRTUAL_ENV
ENV PATH="$VIRTUAL_ENV/bin:$PATH"

RUN python3 -m pip install --upgrade pip && \
    python3 -m pip install great_expectations venv-pack

RUN mkdir /output && venv-pack -o /output/pyspark_ge.tar.gz

FROM scratch AS export
COPY --from=base /output/pyspark_ge.tar.gz /

command

docker buildx build --no-cache --platform linux/arm64 --output . .

image

building time

Building 2317.3s (11/11) FINISHED

When I use amazonlinux:2 instead of amazonlinux:2023 the build runs much faster

image

building time

Building 493.2s (11/11) FINISHED

Metadata

Metadata

Assignees

No one assigned

    Labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions