What it does
The creator reports requests taking about 68 milliseconds on a consumer graphics card, but the small model has limited reasoning. Results are near chance on natural-language inference tasks such as ANLI, and complex 77-way classifications are a struggle compared with larger models.