Pinned Loading

1. OpenMOSS/Thus-Spake-Long-Context-LLM OpenMOSS/Thus-Spake-Long-Context-LLM Public

   a survey of long-context LLMs from four perspectives, architecture, infrastructure, training, and evaluation

   61 1

2. OpenMOSS/LongLLaDA OpenMOSS/LongLLaDA Public

   [AAAI26] LongLLaDA: Unlocking Long Context Capabilities in Diffusion LLMs

   Python 55 5

3. OpenLMLab/LongWanjuan OpenLMLab/LongWanjuan Public

   Towards Systematic Measurement for Long Text Quality

   Python 38 2

4. OpenMOSS/ReAttention OpenMOSS/ReAttention Public

   [ICLR2025] ReAttention, a training-free approach to break the maximum context length in length extrapolation

   Python 14

5. OpenMOSS/rope_pp OpenMOSS/rope_pp Public

   Beyond Real: Imaginary Extension of Rotary Position Embeddings for Long-Context LLMs

   Python 33 4

6. OpenMOSS/CoLLiE OpenMOSS/CoLLiE Public

   Collaborative Training of Large Language Models in an Efficient Way

   Python 420 58