Improve ThetaData caching and open fix

[grzesir]

Summary

• cache processed ThetaData frames and append incremental rows instead of reprocessing whole datasets
• reuse cached 09:30 minute bars for the EOD open correction and add downloader smoke scripts/tests
• add targeted regression coverage plus bump Lumibot to 4.3.7

Testing

• source "/Users/robertgrzesik/Documents/Development/Strategy Library/Demos/.env" && ~/bin/safe-timeout 1800s pytest tests/test_thetadata_helper.py
• set -a && source "/Users/robertgrzesik/Documents/Development/Strategy Library/Demos/.env" && set +a && export PYTHONPATH=$(pwd):$PYTHONPATH && ~/bin/safe-timeout 600s python3 scripts/check_eod_chunking.py --symbol GOOGL --start 2023-01-03 --end 2024-12-31
• (Demos) set -a && source .env && set +a && ~/bin/safe-timeout 3600s python3 profile_google_momentum.py
• (Demos) set -a && source .env && set +a && ~/bin/safe-timeout 3600s python3 "PLTR Weekly Call Roller.py"

[korbit-ai]

I was unable to write a description for this pull request. This could be because I only found files I can't scan.

[korbit-ai]

I've completed my review and didn't find any issues.

Files scanned

​

File Path	Reviewed
setup.py	✅
lumibot/backtesting/thetadata_backtesting_pandas.py	✅
lumibot/tools/thetadata_helper.py	✅

Explore our documentation to understand the languages and file types we support and the files we ignore.

Check out our docs on how you can make Korbit work best for you and your team.

Loving Korbit!? Share us on LinkedIn Reddit and X