ABR-Arena is a Python-based global testing infrastructure for the efficient evaluation and comparison of ABR algorithm performance across diverse real-world environments. By containerizing streaming servers and deploying them to cloud instances worldwide, we design ABR-Arena to be easy to use and to extend to new locations. We mitigate the impact of survivorship bias by not relying on returning users, but rather stream to random users sourced via Amazon Mechanical Turk (MTurk), a popular crowdsourcing marketplace. Parts of our streaming infrastructure are based on the Puffer project, which can be found here https://github.com/StanfordSNR/puffer.
Coming soon! We're currently cleaning up all of our code and documenting every step to make it as easy to replicate and build as possible.