Verhoeff algorithm

The Verhoeff algorithm^[1] is a checksum for error detection first published by Dutch mathematician Jacobus Verhoeff in 1969.^[2][3] It was the first decimal check digit algorithm which detects all single-digit errors, and all transposition errors involving two adjacent digits,^[4] which was at the time thought impossible with such a code.

The method was independently discovered by H. Peter Gumm in 1985, this time including a formal proof and an extension to any base.^[5]

Verhoeff had the goal of finding a decimal code—one where the check digit is a single decimal digit—which detected all single-digit errors and all transpositions of adjacent digits. At the time, supposed proofs of the nonexistence^[6] of these codes made base-11 codes popular, for example in the ISBN check digit.

His goals were also practical, and he based the evaluation of different codes on live data from the Dutch postal system, using a weighted points system for different kinds of error. The analysis broke the errors down into a number of categories: first, by how many digits are in error; for those with two digits in error, there are transpositions (ab → ba), twins (aa → 'bb'), jump transpositions (abc → cba), phonetic (1a → a0), and jump twins (aba → cbc). Additionally there are omitted and added digits. Although the frequencies of some of these kinds of errors might be small, some codes might be immune to them in addition to the primary goals of detecting all singles and transpositions.

The phonetic errors in particular showed linguistic effects, because in Dutch, numbers are typically read in pairs; and also while 50 sounds similar to 15 in Dutch, 80 doesn't sound like 18.

Taking six-digit numbers as an example, Verhoeff reported the following classification of the errors:.

The general idea of the algorithm is to represent each of the digits (0 through 9) as elements of the dihedral group ${\displaystyle D_{5}}$. That is, map digits to ${\displaystyle D_{5}}$, manipulate these, then map back into digits. Let this mapping be ${\displaystyle m:[0,9]\to D_{5}}$

${\displaystyle m={\begin{pmatrix}0&1&2&3&4&5&6&7&8&9\\e&r&r^{2}&r^{3}&r^{4}&s&rs&r^{2}s&r^{3}s&r^{4}s\end{pmatrix}}}$

Let the nth digit be ${\displaystyle a_{n}}$ and let the number of digits be ${\displaystyle k}$.

For example given the code 248 then ${\displaystyle k}$ is 3 and ${\displaystyle a_{3}=m(8)=r^{3}s}$.

Now define the permutation ${\displaystyle f:D_{5}\to D_{5}}$

${\displaystyle f={\begin{pmatrix}e&r&r^{2}&r^{3}&r^{4}&s&rs&r^{2}s&r^{3}s&r^{4}s\\r&s&r^{2}s&rs&r^{2}&r^{3}s&r^{3}&e&r^{4}s&r^{4}\end{pmatrix}}}$

For example ${\displaystyle f(r^{3})=rs}$. Another example is ${\displaystyle f^{2}(r^{3})=r^{3}}$ since ${\displaystyle f(f(r^{3}))=f(rs)=r^{3}}$

Using multiplicative notation for the group operation of ${\displaystyle D_{5}}$, the check digit is then simply a value ${\displaystyle c}$ such that

${\displaystyle f(a_{1})\cdot f^{2}(a_{2})\cdot \ldots \cdot f^{k}(a_{k})\cdot f^{k+1}(c)=e}$

${\displaystyle c}$ is explicitly given by inverse permutation

${\displaystyle c=f^{-1-k}\left(\prod _{n=1}^{k}f^{n}(a_{n})^{-1}\right)}$

For example the check digit for 248 is 5. To verify this, use the mapping to ${\displaystyle D_{5}}$ and insert into the LHS of the previous equation

${\displaystyle f(r^{2})\cdot f^{2}(r^{4})\cdot f^{3}(r^{3}s)\cdot f^{4}(s)=e}$

To evaluate this permutation quickly use that

${\displaystyle f^{4}(s)=f^{3}(r^{3}s)=f^{2}(r^{4})=f(r^{2})=r^{2}s}$

to get that

${\displaystyle r^{2}s\cdot r^{2}s\cdot r^{2}s\cdot r^{2}s=e}$

This is the same reflection being iteratively multiplied. Use that reflections are their own inverse.^[7]

${\displaystyle (r^{2}s\cdot r^{2}s)\cdot (r^{2}s\cdot r^{2}s)=e^{2}=e}$

In practice the algorithm is implemented using simple lookup tables without needing to understand how to generate those tables from the underlying group and permutation theory. This is more properly considered a family of algorithms, as other permutations work too. Verhoeff's notes that the particular permutation, given above, is special as it has the property of detecting 95.3% of the phonetic errors.^[8]

The strengths of the algorithm are that it detects all transliteration and transposition errors, and additionally most twin, twin jump, jump transposition and phonetic errors.

The main weakness of the Verhoeff algorithm is its complexity. The calculations required cannot easily be expressed as a formula in say ${\displaystyle {\displaystyle \mathbb {Z} /10\mathbb {Z} }}$. Lookup tables are required for easy calculation. A similar code is the Damm algorithm, which has similar qualities.

The Verhoeff algorithm can be implemented using three tables: a multiplication table d, an inverse table inv, and a permutation table p.

⁠${\displaystyle d(j,k)}$⁠[9] k 0 1 2 3 4 5 6 7 8 9 j 0 0 1 2 3 4 5 6 7 8 9 1 1 2 3 4 0 6 7 8 9 5 2 2 3 4 0 1 7 8 9 5 6 3 3 4 0 1 2 8 9 5 6 7 4 4 0 1 2 3 9 5 6 7 8 5 5 9 8 7 6 0 4 3 2 1 6 6 5 9 8 7 1 0 4 3 2 7 7 6 5 9 8 2 1 0 4 3 8 8 7 6 5 9 3 2 1 0 4 9 9 8 7 6 5 4 3 2 1 0

j ⁠${\displaystyle inv(j)}$⁠ 0 0 1 4 2 3 3 2 4 1 5 5 6 6 7 7 8 8 9 9

⁠${\displaystyle p(pos,num)}$⁠ num 0 1 2 3 4 5 6 7 8 9 pos (mod 8) 0 0 1 2 3 4 5 6 7 8 9 1 1 5 7 6 2 8 3 0 9 4 2 5 8 0 3 7 9 6 1 4 2 3 8 9 1 6 0 4 3 5 2 7 4 9 4 5 3 1 2 6 8 7 0 5 4 2 8 6 5 7 3 9 0 1 6 2 7 9 3 8 0 6 4 1 5 7 7 0 4 6 9 1 3 2 5 8

The first table, d, is based on multiplication in the dihedral group D₅.^[7] and is simply the Cayley table of the group. Note that this group is not commutative, that is, for some values of j and k, d(j,k) ≠ d(k, j).

The inverse table inv represents the multiplicative inverse of a digit, that is, the value that satisfies d(j, inv(j)) = 0.

The permutation table p applies a permutation to each digit based on its position in the number. This is actually a single permutation (1 5 8 9 4 2 7 0)(3 6) applied iteratively; i.e. p(i+j,n) = p(i, p(j,n)).

The Verhoeff checksum calculation is performed as follows:

1. Create an array n out of the individual digits of the number, taken from right to left (rightmost digit is n₀, etc.).
2. Initialize the checksum c to zero.
3. For each index i of the array n, starting at zero, replace c with ⁠${\displaystyle d(c,p(i{\bmod {8}},n_{i}))}$⁠.

The original number is valid if and only if ⁠${\displaystyle c=0}$⁠.

To generate a check digit, append a 0, perform the calculation: the correct check digit is ⁠${\displaystyle inv(c)}$⁠.

• Luhn algorithm, earlier (1960) check digit algorithm

Wikibooks has a book on the topic of: Algorithm_Implementation/Checksums/Verhoeff_Algorithm

• Detailed description of the Verhoeff algorithm