aadha
“Narratives have musical arcs. Music has narrative arcs.”
I wrote those two sentences in 2023, on a Museum of Vestigial Desire page called Music, and aadha marks them story or the good noise, depending on which of its two readers I ask.
aadha is a model I released today, as version 0.8.1. It reads one sentence at a time and gives it one of four marks.
Story is plain meaning. The good noise is more abstraction, layered meaning or analogy than usual, saying something a reader could argue with. Common coin is a phrase already in circulation. Unwanted noise is decoration, nonsense, or a figure of speech that fits anything.
Its name is from the Hindi idiom aadha teetar aadha bater, half partridge, half quail: something that is neither one thing nor the other.
It is an NSMnum (Narrow Small Model [numerating], said en-ess-em-num). It gives a mark and nothing else, and code decides what the marks mean for a whole piece.
The plain reader marks 78 of the 80 sentences in Music as story. The second reader, a version trained further on argued and reflective writing, marks 20 of them the good noise, the two above among them. aadha does not choose between the two; whoever uses it does.
I measured an earlier version on 603 sentences I had marked before any model saw them. It marked 576 of them as I had; Claude Haiku matched me on 441 and Claude Sonnet on 456.
On the good noise alone, both of those did as well as aadha or better. Its lead over them comes from sentences of abstract nonsense, which they marked the good noise and aadha did not.
The released version marks 176 of 182 as I did on the sentences I marked after the four marks took their present form. It was trained on Claude’s reading of the training sentences, which I agreed to use; my own marks are in the tests only.
It still misses a stock phrase put into new words, 0 of 6 in every version, and it can take a misspelt sentence of plain story for unwanted noise.
The release:
https://github.com/syntax-context/aadha/releases/tag/v0.8.1
The weights:
https://huggingface.co/prayasabhinav/aadha
aadha in the ungli builder:
https://ungli.syntax.prayasabhinav.net/#aadha
Music, on the Museum:
https://museumofvestigialdesire.net/functions/journal/missed-opportunities/2023/music