[Question] Why is the default discount factor 0.999 for PPO and 0.99 for DQN?

[roger-creus]

❓ Question

I would think 0.99 is the most widely used default value, so I suggest using that for PPO as well.

Checklist

• I have checked that there is no similar issue in the repo
• I have read the documentation
• If code there is, it is minimal and working
• If code there is, it is formatted using the markdown code blocks for both code and stack traces.

[myismyname]

0.999 is used for the Procgen games.