Running a Coaching LLM in the Browser: What WebGPU Really Costs

We built a real-time writing coach that scores tone and clarity as you type — think "this sentence reads as passive-aggressive" nudges inside a feedback composer. The pitch from day one was privacy: never send a user's draft performance review to a server. So we tried to run the whole thing client-side with WebGPU. It mostly worked. Here's the... Weiterlesen: Running a Coaching LLM in the Browser: What WebGPU Really Costs