How can an API key be specified?

[mags0ft]

Hello there,

I was wondering whether it's possible to make llama-swap require an API key to accept any incoming requests to the OpenAI API compatible endpoint. Is there an easy way to do this somehow, preferably in the config.yaml file?

Thanks in advance!

[olegshulyakov]

Have you tried to add marcos api-key with value and then use it in model command with --api-key ${api-key}?

[mags0ft]

That is a really good idea! Thanks for pointing it out.