An OEIS editor asked what my "certificates" proved, and I changed how I label evidence
When you hand someone results made with AI agents, they need to know what they can check from what you gave them and what they have to take on trust. An editor of a public math database asked me exactly that about a count I had added. The honest answer was "at least this many", not "exactly this many".
I had called the files behind one of my OEIS counts "certificates". The editor's question showed they supported only a lower bound, so I renamed them, and this post walks through that case and the checklist I now run before I publish anything.
I do mathematics with Claude agents working under my direction: they write code, run it and write up the results, and I direct the work and check it. In September one of those results was a new term for the OEIS (the Online Encyclopedia of Integer Sequences), a large public database of number sequences that mathematicians use.
The count
The sequence was A307185. It counts the basic shapes from which phylogenetic networks are built. A phylogenetic network is a family tree of species in which lineages can merge, as in hybridization, as well as split. Level 6 means shapes with exactly six merge points; specialists call these shapes generators. Every network of level 6 or less can be built from these shapes and simpler ones, with ordinary branches hung off them. Programs that reconstruct species histories from data start from this list of shapes, so a missing shape could mean a missed answer. The published entry stopped at level 5. The agents, working under my direction, computed level 6 and found ▲ shapes. (The ▲ links to a note about that number at the bottom of the page.)
The word
New terms go into the OEIS as a public draft that the database's editors review, with a link to your evidence. My evidence was a public archive of the code and its output, and I labeled the link "enumeration code, certificates and the generator files."
"Certificates" came from software. To tell the shapes apart, the agents used nauty, a standard program that gives each graph (here, each shape) an ID string: two drawings of the same shape always get the same string, and different shapes get different strings. nauty's documentation calls that string a certificate. The agents used nauty's word in their run notes and file names, and I carried it into the archive's title and the link. To a mathematician, a certificate is a proof you can check without redoing the work.
On , Andrew Howroyd, an OEIS editor, asked on the draft: "What does certificates mean here? This is some kind of self-certification - perhaps would be better called log file?" A few minutes later he asked: "How do these certificates allow someone to check the correctness of the terms without rerunning the code?"
What the files proved: at least this many, not exactly this many
Anyone with the files can check that every listed shape is a valid level-6 shape. They can also confirm that no shape appears twice, by computing each listed shape's ID string with nauty or another program that gives one string per shape, and sorting the strings. That shows the count is at least 5,539,121.
The files cannot show the count is exactly that. A shape the code never produced would simply be absent, and nothing in the files would reveal the gap. Showing that nothing is missing means rerunning the computation, which starts from the published list of level-5 shapes and applies published rules for building the next level. Two separately written programs, both written by Claude agents, had done that and produced identical lists. That is strong evidence for the exact count, though two programs from the same AI model family can share a mistake, and a reader cannot check it from the files alone. The exact count also rests on a published result: Gambette, Berry and Paul proved in 2009 that their two rules build every shape of the next level, and that proof is taken from their paper, not redone here.
That evening, I posted a reply under my name on the draft saying exactly this, and added
the same statement to the archive's README. I replaced "certificates" with "canonical-form
lists" (that is, lists of the ID strings) in the archive's title and README and in the link.
The archive's description still uses the old word, and its files still have names ending in
.cert, as first published; a note in the README
explains the old word. The term was approved on
with the count unchanged.
The checklist I use now
My checks on this work were all aimed at the number. None of them read the wording, which had been copied from tool output. For every result I publish with files, I now write down three things:
- What a reader can confirm from the files alone. Here: each shape is valid, and none repeats.
- What still requires rerunning the code, or trusting that it was run. Here: that nothing is missing.
- Whether any word claims more than that. Before a word that means proof to the reader (certificate, certified, verified, proven) goes into a title, a metadata field or a database entry, I read it in that reader's sense, and spell out a narrower meaning or pick another word.
For specialists
The level-6 set was produced by applying the two rules of Gambette, Berry and Paul (2009) to the published level-5 generators and deduplicating with two independently written canonical forms: nauty, and a nauty-free rooted traversal. The two routes produced byte-identical generator sets. Before the level-6 run, both reproduced a(1) to a(5) and matched the published level-4 and level-5 generator sets exactly.
From the files, a reader can validate each listed graph as a level-6 generator by a local check (vertex types by indegree and outdegree, exactly six indegree-2 vertices, acyclic, biconnected) and confirm pairwise distinctness by sorting the canonical forms. That establishes a lower bound on a(6). Completeness rests on rerunning the expansion, and on the source paper's result that the two rules generate every level-6 generator, which is taken from that paper and not re-proved here.
Notes on the numbers marked ▲
- Level-6 generators of phylogenetic networks (A307185 at n = 6; the published entry ends at level 5): 5,539,121. Published in the OEIS on September 25, 2026, with the term credited to me. That the construction rules produce every generator rests on the paper that introduced them; I did not prove it again.
These notes appear in every version of this page.
Revision history
- 2026-10-29 · corrected
The post said the old word was replaced in the archive. It was replaced in the archive's title and README and in the OEIS link; the archive's description still uses it, as its file names do, and the post now says so.
How to cite this
Tyler Satchel Orden (2026). An OEIS editor asked what my "certificates" proved, and I changed how I label evidence. Cyborg Mathematics. https://cyborgmathematics.com/writing/certificate-meant-something-else (updated October 29, 2026)
This page has no DOI of its own. Cite the URL and the date; the revision history above keeps a dated citation meaningful.
BibTeX
@misc{orden2026certificatemeantsomethingelse,
author = {Tyler Satchel Orden},
title = {An OEIS editor asked what my "certificates" proved, and I changed how I label evidence},
year = {2026},
howpublished = {Cyborg Mathematics},
url = {https://cyborgmathematics.com/writing/certificate-meant-something-else}
}See also
- A case study of my own AI agent team: what the lead agent's check before accepting work caught, and what got past it.Verify Before You Accept
- An entrance test for an AI-built search program caught a rule that would have thrown away the very solid it was looking for. Then a reviewer's pointer showed the "new" solid had been printed, unnamed, in a 2016 survey.Before my AI pipeline could hunt for new shapes, it had to rebuild a known one
- A network puzzle: pick as few points as possible so that every point is picked or linked to a picked one. A search I ran with Claude found a smaller set than any published.A new best-known dominating set for the twelfth Fibonacci cube, and a month-long run with no answer
- I keep a record of every error a check caught in my math work with AI agents: who made it and what caught it. Two of them changed how I check everything.The record I keep of errors my checks caught, and two that changed how I work