magus v0.4.3 is out. See what's new
¶ View markdown source · ✎ Suggest an edit
2 min read

instruction-position

A rule that is off by default: it reports a full skill form of 1500 words or more whose first "must" or "never" sits past the middle of its body once a decisions table turns it on.

What it catches

A full skill form of 1500 words or more whose first "must" or "never" sits past the middle of its body.

Dimension

structure: the reader has to reconstruct the order or the purpose. A finding is counted on the dimension of its rule, the cost it names to the reader.

Why

"Lost in the Middle" (Liu et al., TACL 2023) measured models using what sits at the start and the end of a long context better than the middle, from its shortest setting of about 2000 tokens up. IFScale (Jaroslawicz et al., arXiv 2507.11538) found frontier models favor early instructions only at very high instruction counts, so the rule judges the full form alone, the copy written for less capable models. Long is that 2000 tokens, about 1500 words at 1.3 tokens a word, near the median length of the full forms magus ships.

Default decision

The code is PRF7021. The decision depends on the kind of text judged:

Kind Default
skill-template off

Changing it

A decisions table sets this rule to deny, advise or off, for everything judged or for the files a glob matches. Proofread reads the table from the file its -decisions flag names:

{
  "rules": {"instruction-position": "deny"},
  "paths": {"blog/**": {"instruction-position": "off"}}
}

rules applies to every file. A glob in paths applies to the files it matches, and the last match wins. A rule set to off never reports.

Seeing it

A finding names the rule, its code and the decision that applies, and links here:

{"rule": "instruction-position", "code": "PRF7021", "decision": "off", "url": "https://eli.gladman.cc/magus/reference/proofread/instruction-position/"}

proofread rules prints this entry with every other rule's.

See also

proofreadrulesinstruction-positionoff
Last updated (29d8b3de)
Glossary

Op

A single tool-native command a target composes (long form: operation); the middle of the work hierarchy (Spell to Op to Target). Op in full.

CI

An ordinary target you compose yourself with ctx.needs; magus does not hardcode its stages. It is the anchor magus affected ci keys off, and ci strips the rw charm. CI in full.

Skill

A packaged set of instructions an agent host loads when a task matches its description: a directory holding a SKILL.md. magus ships its magus-* skills in the binary and writes them with magus agent install. Skill in full.

Conventions

This page uses none of the site's convention markers. The full set is on the conventions page.