So we ran into a problem when using releases (mix release/mix phx.gen.release) with the PhoenixGon.Pipeline plug, on it's source it's using Mix.env() and for some reason that is not being resolved when you create a release.
I have no solution for it yet, but I thought of creating an issue for those who run into the same problem as us.