tashfeenahmed/freellmapi
- Stars
- 50,253
- Language
- TypeScript
- License
- MIT
- Monthly
- rank 14 · +17,544 stars gained
Repository metrics were observed on this edition date and may have changed.
Key Details FreeLLMAPI is a model router that connects free quotas from multiple providers and custom endpoints through a single API. It provides per-key usage tracking, fallback routing when requests are rate-limited, and encrypted key storage, and can connect clients using OpenAI, Anthropic, Gemini, and Ollama formats. Use Cases Register provider keys and configure existing compatible clients to point to the local router. Manage fallback model chains and usage through the dashboard, or add custom local model endpoints. Costs and Limitations A free installation option is available, and the real-time model catalog is specified as an optional paid feature costing $19 per year. The free catalog adds new models with a 30-day delay, and external providers' free limits and account terms apply. Charges for paid endpoints, self-hosting, and hardware for local models are separate. Adoption Considerations Node 20 or later, or the supplied deployment setup, is required, and each provider's keys, terms, and quotas need to be checked. The metadata limits the scope to personal experimentation. Total token counts and automatic compliance with limits are developer descriptions, not verified results guaranteeing available capacity or the absence of charges. Why It Stands Out It was observed at No. 14 on monthly Trending, with an increase of 17,544 stars. Version v0.16.24, posted on 2026-11-11, describes fixes to PowerTokens fallback routing and key rotation for custom endpoints, and also explicitly notes frequent rate limiting by PowerTokens.
View on GitHub