Certificate error when using docker buildx

Question

I am having a very weird issue when building an armv7 docker image using docker buildx, but not when building it natively on armv7 hardware.

Here is a very simple docker