R126 · Agent architecture › Self-improvement and learning loops

Harness adapters: RL-tuning an open model for one coding agent

Read the original

open-weightsreinforcement-learningcoding-agentsagent-harnessbenchmarks

Source: harness-hub/Qwen3.8-27B-pi-adapted model card (Apache-2.0 LoRA on Qwen3.8-27B), part of a Hugging Face collection of 11 harness-specific adapters; announced by Hugging Face CEO Clem Delangue on LinkedIn, 2026-11-17. The card says the full training recipe will follow in a release blog post.

What it is

A single LoRA adapter trained with reinforcement learning (async GRPO via TRL) so that Qwen3.8-27B works well as the model behind one specific coding agent, the open-source pi harness. Training data comes from two harness-hub task sets for software-engineering and terminal work. The point is not a better general model but a model fitted to one harness's tools, prompts and API shape.

Results (as reported on the card)

All runs use the pi harness, one attempt per task at temperature 0.8 with thinking off, paired against the base model under pi on the same tasks; intervals are 95% and p-values come from an exact sign test on tasks whose outcome changed.

The card is careful in ways launch posts often aren't: paired comparisons, a sign test, a held-out split, and tool calls measured on tasks both models solved, so efficiency gains aren't just an artifact of failing faster.

How it is meant to be run

Load the adapter on the exact base model (it does not transfer to other bases), merge it into the base weights with PEFT for a standalone checkpoint, or serve the base plus LoRA through llama.cpp-style local apps or transformers serve. The card warns that pi must use the chat-completions API: by default pi uses a different API shape, which the adapter was neither trained nor evaluated with.

Why it matters

Tradeoffs and failure modes

Review checklist

Connections

See R126 on the knowledge map

Part of the Research notes on nowucca.com. Figures and claims are the source's own unless the summary says otherwise.