ci: also pass `-L` for the gfortran libraries

For some reason, the arm64 linker doesn't use `LC_RPATH` commands when
linking libraries transitively. Just shove the link path in the search
path so that `libgcc_s.dylib` ends up getting found.