println!("Hello World!");
This is my first post here. Ocasionally, I’d share what I work on in my spare time.
Currently, I’m working on my own local coding harness. Main goal: have a way to test small local models for coding.
Focusing mostly on the model led me design the system like this:
MLX- local models on a Mac- served via
vLLMormlx_lm.server
- served via
MCP- set of tools provided by a running JetBrains IDEACP- to let my ide/editor act as a frontend
Moving the focus away from implementing (yet another) TUI and (yet another) set of same tools (bash+read+write) lets me iterate faster on the model experiments. Also, I like the JetBrains IDEs a lot and since I use the tooling it provides I thought “why not check how the LLMs work with similar tools?” (via MCP). And I have my IDE/editor already open so why not use its interface to steer the agent (via ACP).
This blog is made with Zine.