Implement real dependency caching

[zamyers]

This makes testing and debugging a lot faster since we don't have to crawl through so many files.

[zamyers]

Maybe this can be done through a checksum associated with the tracked folders and files?