You are building an IDE coding assistant with two modes: inline completion (ghost text as the developer types) and a chat panel that can answer questions about the codebase and propose multi-file edits.
Inline completion is a latency problem above all else. If a suggestion takes longer than roughly 300ms it arrives after the developer has already typed past it, and acceptance collapses. Developers type continuously, so requests are fired and cancelled constantly.
You have read the opening. The rest is free with a Bezen account, and no card is needed.
Behind the sign-in