Debian launches an Inference Portal to give contributors free access to LLM inferencing

What happened

Debian has launched the Debian Inference Portal, a hosted service that gives Debian contributors self-service access to AI/LLM inferencing. The portal is reachable at inference.debian.net and exposes an API so developers can integrate inferencing into editors and other development tooling.

Why it exists

Debian recently voted to allow the responsible use of generative AI for development, maintenance, and documentation. The Inference Portal is an effort to make those AI capabilities easier to use for contributors without each person having to provision their own inference infrastructure.

What's available now

Who can use it and how access is controlled

Maintainers. Scaleway is sponsoring the service by providing a fixed monthly pool of credits for the portal. That pool is divided into per-user weekly budgets, so contributors get a limited weekly allotment of inferencing credits.

Intended uses

The announcement indicates the portal is intended to help practical project tasks: packaging work, bug triage, creating or improving fixes, developer tooling, and documentation writing. The emphasis is on enabling contributor workflows rather than general public or commercial use.

Practical implications for contributors

• Contributors already on Salsa and holding a Developer or Maintainer account can apply for an API key and begin integrating inferencing into their workflows.
• Because use is credit-limited by the sponsored pool and weekly budgets, contributors should plan how to allocate inferencing calls (for example, periodic batch runs or editor integrations that avoid excessive calls).
• The API-based approach supports automation: scripting triage steps, generating documentation drafts, or using model output as a starting point for patches that human developers review and edit.

Relationship to Debian policy

This portal follows Debian's vote permitting responsible use of generative AI. The service aims to provide a sanctioned, permissioned way for contributors to use models while keeping access within the project's contributor ecosystem.

Where to go next

Visit inference.debian.net to learn about the API and sign-up process. Contributors should ensure they have the correct Salsa account type before requesting access and plan usage within the weekly budget allocated by the Scaleway-sponsored credit pool.