Topic: small language models

A new benchmark called SRRM has been introduced to evaluate the long-context memory capabilities of small language models, addressing the need for better understanding and assessment of these models' abilities to retain information over extended text sequences. This is crucial as SLMs are increasingly used on consumer-grade hardware where handling longer contexts poses significant challenges.

arxiv.org↗