Lambda container - Pyarrow and numpy

If you read your build log, you can see that it is attempting to build pyarrow from source, and failing because it has no C compiler installed.

But why is trying to build from source, rather than installing a pre-built wheel? The Lambda image you are using uses glibc 2.26. In order to install a pre-built wheel for pyarrow 21.0.0, you'd need glibc >= 2.28.

This gives you a few ways you could solve this.

Solution #1: Use older pyarrow

This works, because this version of pyarrow includes a build for very old glibc.

FROM public.ecr.aws/lambda/python:3.11
Install
RUN pip install 'numpy