Every annotation programme of any size develops undocumented conventions — decisions made in a chat thread that never make it back into the guideline. Six months later, new annotators are trained on a document that no longer describes the work.
Treating the guideline as a maintained product, with a changelog and an owner, is the cheapest quality intervention available to most teams.