Skip to content
Writing

An OEIS editor asked what my "certificates" proved, and I changed how I label evidence

When you hand someone results made with AI agents, they need to know what they can check from what you gave them and what they have to take on trust. An editor of a public math database asked me exactly that about a count I had added. The honest answer was "at least this many", not "exactly this many".

I had called the files behind one of my OEIS counts "certificates". The editor's question showed they supported only a lower bound, so I renamed them, and this post walks through that case and the checklist I now run before I publish anything.

September 26, 2026· updated Oct 29, 2026

I do mathematics with Claude agents working under my direction: they write code, run it and write up the results, and I direct the work and check it. In September one of those results was a new term for the OEIS (the Online Encyclopedia of Integer Sequences), a large public database of number sequences that mathematicians use.

The count

The sequence was A307185. It counts the basic shapes from which phylogenetic networks are built. A phylogenetic network is a family tree of species in which lineages can merge, as in hybridization, as well as split. Level 6 means shapes with exactly six merge points; specialists call these shapes generators. Every network of level 6 or less can be built from these shapes and simpler ones, with ordinary branches hung off them. Programs that reconstruct species histories from data start from this list of shapes, so a missing shape could mean a missed answer. The published entry stopped at level 5. The agents, working under my direction, computed level 6 and found ▲ shapes. (The ▲ links to a note about that number at the bottom of the page.)

The word

New terms go into the OEIS as a public draft that the database's editors review, with a link to your evidence. My evidence was a public archive of the code and its output, and I labeled the link "enumeration code, certificates and the generator files."

"Certificates" came from software. To tell the shapes apart, the agents used nauty, a standard program that gives each graph (here, each shape) an ID string: two drawings of the same shape always get the same string, and different shapes get different strings. nauty's documentation calls that string a certificate. The agents used nauty's word in their run notes and file names, and I carried it into the archive's title and the link. To a mathematician, a certificate is a proof you can check without redoing the work.

On , Andrew Howroyd, an OEIS editor, asked on the draft: "What does certificates mean here? This is some kind of self-certification - perhaps would be better called log file?" A few minutes later he asked: "How do these certificates allow someone to check the correctness of the terms without rerunning the code?"

What the files proved: at least this many, not exactly this many

Anyone with the files can check that every listed shape is a valid level-6 shape. They can also confirm that no shape appears twice, by computing each listed shape's ID string with nauty or another program that gives one string per shape, and sorting the strings. That shows the count is at least 5,539,121.

The files cannot show the count is exactly that. A shape the code never produced would simply be absent, and nothing in the files would reveal the gap. Showing that nothing is missing means rerunning the computation, which starts from the published list of level-5 shapes and applies published rules for building the next level. Two separately written programs, both written by Claude agents, had done that and produced identical lists. That is strong evidence for the exact count, though two programs from the same AI model family can share a mistake, and a reader cannot check it from the files alone. The exact count also rests on a published result: Gambette, Berry and Paul proved in 2009 that their two rules build every shape of the next level, and that proof is taken from their paper, not redone here.

That evening, I posted a reply under my name on the draft saying exactly this, and added the same statement to the archive's README. I replaced "certificates" with "canonical-form lists" (that is, lists of the ID strings) in the archive's title and README and in the link. The archive's description still uses the old word, and its files still have names ending in .cert, as first published; a note in the README explains the old word. The term was approved on with the count unchanged.

The checklist I use now

My checks on this work were all aimed at the number. None of them read the wording, which had been copied from tool output. For every result I publish with files, I now write down three things:

  • What a reader can confirm from the files alone. Here: each shape is valid, and none repeats.
  • What still requires rerunning the code, or trusting that it was run. Here: that nothing is missing.
  • Whether any word claims more than that. Before a word that means proof to the reader (certificate, certified, verified, proven) goes into a title, a metadata field or a database entry, I read it in that reader's sense, and spell out a narrower meaning or pick another word.

For specialists

The level-6 set was produced by applying the two rules of Gambette, Berry and Paul (2009) to the published level-5 generators and deduplicating with two independently written canonical forms: nauty, and a nauty-free rooted traversal. The two routes produced byte-identical generator sets. Before the level-6 run, both reproduced a(1) to a(5) and matched the published level-4 and level-5 generator sets exactly.

From the files, a reader can validate each listed graph as a level-6 generator by a local check (vertex types by indegree and outdegree, exactly six indegree-2 vertices, acyclic, biconnected) and confirm pairwise distinctness by sorting the canonical forms. That establishes a lower bound on a(6). Completeness rests on rerunning the expansion, and on the source paper's result that the two rules generate every level-6 generator, which is taken from that paper and not re-proved here.

Notes on the numbers marked ▲

  • Level-6 generators of phylogenetic networks (A307185 at n = 6; the published entry ends at level 5): 5,539,121. Published in the OEIS on September 25, 2026, with the term credited to me. That the construction rules produce every generator rests on the paper that introduced them; I did not prove it again.

These notes appear in every version of this page.

Revision history

  1. 2026-10-29 · corrected

    The post said the old word was replaced in the archive. It was replaced in the archive's title and README and in the OEIS link; the archive's description still uses it, as its file names do, and the post now says so.

How to cite this

Tyler Satchel Orden (2026). An OEIS editor asked what my "certificates" proved, and I changed how I label evidence. Cyborg Mathematics. https://cyborgmathematics.com/writing/certificate-meant-something-else (updated October 29, 2026)

This page has no DOI of its own. Cite the URL and the date; the revision history above keeps a dated citation meaningful.

BibTeX
@misc{orden2026certificatemeantsomethingelse,
  author       = {Tyler Satchel Orden},
  title        = {An OEIS editor asked what my "certificates" proved, and I changed how I label evidence},
  year         = {2026},
  howpublished = {Cyborg Mathematics},
  url    = {https://cyborgmathematics.com/writing/certificate-meant-something-else}
}

See also