Implementation notes: x86, kizomba, crypto_sign/mqqsig192

Computer: kizomba
Architecture: x86
CPU ID: GenuineIntel-000906e9-bfebfbff
SUPERCOP version: 20181216
Operation: crypto_sign
Primitive: mqqsig192

Time	Implementation	Compiler	Benchmark date	SUPERCOP version
115191	`ref`	`gcc -m32 -march=native -mtune=native -Os -fomit-frame-pointer`	20180828	20180818
115433	`ref`	`gcc -m32 -march=core-avx2 -Os -fomit-frame-pointer`	20180828	20180818
118526	`ref`	`gcc -m32 -march=nocona -O3 -fomit-frame-pointer`	20180828	20180818
118746	`ref`	`gcc -funroll-loops -m32 -march=pentium4 -O3 -fomit-frame-pointer`	20180828	20180818
118948	`ref`	`gcc -m32 -march=prescott -O3 -fomit-frame-pointer`	20180828	20180818
118974	`ref`	`gcc -funroll-loops -m32 -march=nocona -O3 -fomit-frame-pointer`	20180828	20180818
119502	`ref`	`gcc -funroll-loops -m32 -march=prescott -O3 -fomit-frame-pointer`	20180828	20180818
119532	`ref`	`gcc -m32 -march=pentium4 -O3 -fomit-frame-pointer`	20180828	20180818
119906	`ref`	`gcc -m32 -march=corei7-avx -Os -fomit-frame-pointer`	20180828	20180818
119994	`ref`	`gcc -m32 -march=core-avx-i -Os -fomit-frame-pointer`	20180828	20180818
120980	`ref`	`gcc -funroll-loops -m32 -march=pentium-m -O3 -fomit-frame-pointer`	20180828	20180818
121488	`ref`	`gcc -m32 -march=core2 -msse4.1 -Os -fomit-frame-pointer`	20180828	20180818
121490	`ref`	`gcc -m32 -march=core2 -Os -fomit-frame-pointer`	20180828	20180818
121828	`ref`	`gcc -m32 -march=core2 -msse4 -Os -fomit-frame-pointer`	20180828	20180818
122146	`ref`	`gcc -m32 -march=corei7 -Os -fomit-frame-pointer`	20180828	20180818
123506	`ref`	`gcc -m32 -march=pentium-m -O3 -fomit-frame-pointer`	20180828	20180818
172581	`ref`	`gcc -funroll-loops -m32 -march=pentium2 -O3 -fomit-frame-pointer`	20180828	20180818
173389	`ref`	`gcc -funroll-loops -m32 -march=pentiumpro -O3 -fomit-frame-pointer`	20180828	20180818
184171	`ref`	`gcc -m32 -march=pentium2 -O3 -fomit-frame-pointer`	20180828	20180818
184473	`ref`	`gcc -m32 -march=pentiumpro -O3 -fomit-frame-pointer`	20180828	20180818
184896	`ref`	`gcc -m32 -march=i386 -O3 -fomit-frame-pointer`	20180828	20180818
199877	`ref`	`gcc -funroll-loops -m32 -march=prescott -O2 -fomit-frame-pointer`	20180828	20180818
200264	`ref`	`gcc -funroll-loops -m32 -march=nocona -O2 -fomit-frame-pointer`	20180828	20180818
202536	`ref`	`gcc -funroll-loops -m32 -march=nocona -O -fomit-frame-pointer`	20180828	20180818
202629	`ref`	`gcc -funroll-loops -m32 -march=prescott -O -fomit-frame-pointer`	20180828	20180818
202853	`ref`	`gcc -funroll-loops -m32 -march=pentium-m -O2 -fomit-frame-pointer`	20180828	20180818
204368	`ref`	`gcc -funroll-loops -m32 -march=pentiumpro -O -fomit-frame-pointer`	20180828	20180818
204609	`ref`	`gcc -funroll-loops -m32 -march=pentiumpro -O2 -fomit-frame-pointer`	20180828	20180818
204657	`ref`	`gcc -funroll-loops -m32 -march=pentium3 -O -fomit-frame-pointer`	20180828	20180818
204677	`ref`	`gcc -funroll-loops -m32 -march=pentium2 -O -fomit-frame-pointer`	20180828	20180818
204824	`ref`	`gcc -funroll-loops -m32 -march=pentium2 -O2 -fomit-frame-pointer`	20180828	20180818
205230	`ref`	`gcc -funroll-loops -m32 -march=pentium3 -O2 -fomit-frame-pointer`	20180828	20180818
205420	`ref`	`gcc -funroll-loops -m32 -march=pentium-m -O -fomit-frame-pointer`	20180828	20180818
206027	`ref`	`gcc -funroll-loops -m32 -march=pentium3 -O3 -fomit-frame-pointer`	20180828	20180818
206603	`ref`	`gcc -funroll-loops -m32 -march=i386 -O3 -fomit-frame-pointer`	20180828	20180818
214486	`ref`	`gcc -funroll-loops -m32 -march=pentium4 -O -fomit-frame-pointer`	20180828	20180818
214530	`ref`	`gcc -funroll-loops -m32 -march=i386 -O -fomit-frame-pointer`	20180828	20180818
216121	`ref`	`gcc -m32 -march=prescott -O2 -fomit-frame-pointer`	20180828	20180818
216288	`ref`	`gcc -m32 -march=nocona -O2 -fomit-frame-pointer`	20180828	20180818
222861	`ref`	`gcc -funroll-loops -m32 -march=pentium4 -O2 -fomit-frame-pointer`	20180828	20180818
223416	`ref`	`gcc -m32 -march=nocona -O -fomit-frame-pointer`	20180828	20180818
223492	`ref`	`gcc -m32 -march=pentium-m -O -fomit-frame-pointer`	20180828	20180818
224006	`ref`	`gcc -m32 -march=pentium2 -O -fomit-frame-pointer`	20180828	20180818
224758	`ref`	`gcc -m32 -march=pentiumpro -O -fomit-frame-pointer`	20180828	20180818
224790	`ref`	`gcc -m32 -march=pentium3 -O3 -fomit-frame-pointer`	20180828	20180818
225159	`ref`	`gcc -m32 -march=pentium3 -O -fomit-frame-pointer`	20180828	20180818
226167	`ref`	`gcc -m32 -march=prescott -O -fomit-frame-pointer`	20180828	20180818
227829	`ref`	`gcc -m32 -march=pentium4 -O -fomit-frame-pointer`	20180828	20180818
227925	`ref`	`gcc -m32 -march=pentium2 -O2 -fomit-frame-pointer`	20180828	20180818
228714	`ref`	`gcc -m32 -march=pentium3 -O2 -fomit-frame-pointer`	20180828	20180818
229458	`ref`	`gcc -m32 -march=pentiumpro -O2 -fomit-frame-pointer`	20180828	20180818
232263	`ref`	`gcc -m32 -march=i386 -O -fomit-frame-pointer`	20180828	20180818
236250	`ref`	`gcc -m32 -march=pentium-m -O2 -fomit-frame-pointer`	20180828	20180818
238688	`ref`	`gcc -m32 -march=i386 -O2 -fomit-frame-pointer`	20180828	20180818
244591	`ref`	`gcc -m32 -march=pentium4 -O2 -fomit-frame-pointer`	20180828	20180818
253332	`ref`	`gcc -m32 -Os -fomit-frame-pointer`	20180828	20180818
254466	`ref`	`gcc -funroll-loops -m32 -march=pentium-m -Os -fomit-frame-pointer`	20180828	20180818
254796	`ref`	`gcc -m32 -march=athlon -Os -fomit-frame-pointer`	20180828	20180818
255631	`ref`	`gcc -m32 -march=pentium-m -Os -fomit-frame-pointer`	20180828	20180818
255875	`ref`	`gcc -m32 -march=prescott -Os -fomit-frame-pointer`	20180828	20180818
257026	`ref`	`gcc -m32 -march=pentium4 -Os -fomit-frame-pointer`	20180828	20180818
257343	`ref`	`gcc -funroll-loops -m32 -march=athlon -Os -fomit-frame-pointer`	20180828	20180818
257504	`ref`	`gcc -m32 -march=nocona -Os -fomit-frame-pointer`	20180828	20180818
258436	`ref`	`gcc -funroll-loops -m32 -march=pentium4 -Os -fomit-frame-pointer`	20180828	20180818
258592	`ref`	`gcc -funroll-loops -m32 -Os -fomit-frame-pointer`	20180828	20180818
258915	`ref`	`gcc -funroll-loops -m32 -march=i486 -Os -fomit-frame-pointer`	20180828	20180818
259167	`ref`	`gcc -m32 -march=barcelona -Os -fomit-frame-pointer`	20180828	20180818
259662	`ref`	`gcc -m32 -march=k8 -Os -fomit-frame-pointer`	20180828	20180818
259931	`ref`	`gcc -funroll-loops -m32 -march=i386 -Os -fomit-frame-pointer`	20180828	20180818
260278	`ref`	`gcc -funroll-loops -m32 -march=pentium-mmx -Os -fomit-frame-pointer`	20180828	20180818
260377	`ref`	`gcc -funroll-loops -m32 -march=k6-2 -Os -fomit-frame-pointer`	20180828	20180818
261177	`ref`	`gcc -funroll-loops -m32 -march=pentium -Os -fomit-frame-pointer`	20180828	20180818
261363	`ref`	`gcc -m32 -march=i486 -Os -fomit-frame-pointer`	20180828	20180818
261928	`ref`	`gcc -funroll-loops -m32 -march=pentium2 -Os -fomit-frame-pointer`	20180828	20180818
262008	`ref`	`gcc -m32 -march=i386 -Os -fomit-frame-pointer`	20180828	20180818
262204	`ref`	`gcc -funroll-loops -m32 -march=k6 -Os -fomit-frame-pointer`	20180828	20180818
262269	`ref`	`gcc -funroll-loops -m32 -march=k6-3 -Os -fomit-frame-pointer`	20180828	20180818
262429	`ref`	`gcc -funroll-loops -m32 -march=pentium3 -Os -fomit-frame-pointer`	20180828	20180818
262580	`ref`	`gcc -funroll-loops -m32 -march=pentiumpro -Os -fomit-frame-pointer`	20180828	20180818
265157	`ref`	`gcc -m32 -march=pentium2 -Os -fomit-frame-pointer`	20180828	20180818
265260	`ref`	`gcc -m32 -march=pentium3 -Os -fomit-frame-pointer`	20180828	20180818
265481	`ref`	`gcc -m32 -march=pentiumpro -Os -fomit-frame-pointer`	20180828	20180818
265996	`ref`	`gcc -funroll-loops -m32 -march=barcelona -Os -fomit-frame-pointer`	20180828	20180818
266294	`ref`	`gcc -funroll-loops -m32 -march=i386 -O2 -fomit-frame-pointer`	20180828	20180818
268474	`ref`	`gcc -m32 -march=pentium -Os -fomit-frame-pointer`	20180828	20180818
270490	`ref`	`gcc -m32 -march=pentium-mmx -Os -fomit-frame-pointer`	20180828	20180818
271758	`ref`	`gcc -funroll-loops -m32 -march=prescott -Os -fomit-frame-pointer`	20180828	20180818
271784	`ref`	`gcc -funroll-loops -m32 -march=k8 -Os -fomit-frame-pointer`	20180828	20180818
272218	`ref`	`gcc -funroll-loops -m32 -march=nocona -Os -fomit-frame-pointer`	20180828	20180818
290413	`ref`	`gcc -m32 -march=k6-2 -Os -fomit-frame-pointer`	20180828	20180818
291077	`ref`	`gcc -m32 -march=k6 -Os -fomit-frame-pointer`	20180828	20180818
292982	`ref`	`gcc -m32 -march=k6-3 -Os -fomit-frame-pointer`	20180828	20180818

Test failure

Implementation: crypto_sign/mqqsig192/ref
Compiler: gcc -funroll-loops -m32 -O2 -fomit-frame-pointer

error 111
crypto_sign_open does not handle c=t overlap

Number of similar (compiler,implementation) pairs: 81, namely:

Compiler	Implementations
gcc -funroll-loops -m32 -O2 -fomit-frame-pointer	ref
gcc -funroll-loops -m32 -O3 -fomit-frame-pointer	ref
gcc -funroll-loops -m32 -O -fomit-frame-pointer	ref
gcc -funroll-loops -m32 -march=athlon -O2 -fomit-frame-pointer	ref
gcc -funroll-loops -m32 -march=athlon -O3 -fomit-frame-pointer	ref
gcc -funroll-loops -m32 -march=athlon -O -fomit-frame-pointer	ref
gcc -funroll-loops -m32 -march=barcelona -O2 -fomit-frame-pointer	ref
gcc -funroll-loops -m32 -march=barcelona -O3 -fomit-frame-pointer	ref
gcc -funroll-loops -m32 -march=barcelona -O -fomit-frame-pointer	ref
gcc -funroll-loops -m32 -march=i486 -O2 -fomit-frame-pointer	ref
gcc -funroll-loops -m32 -march=i486 -O3 -fomit-frame-pointer	ref
gcc -funroll-loops -m32 -march=i486 -O -fomit-frame-pointer	ref
gcc -funroll-loops -m32 -march=k6-2 -O2 -fomit-frame-pointer	ref
gcc -funroll-loops -m32 -march=k6-2 -O3 -fomit-frame-pointer	ref
gcc -funroll-loops -m32 -march=k6-2 -O -fomit-frame-pointer	ref
gcc -funroll-loops -m32 -march=k6-3 -O2 -fomit-frame-pointer	ref
gcc -funroll-loops -m32 -march=k6-3 -O3 -fomit-frame-pointer	ref
gcc -funroll-loops -m32 -march=k6-3 -O -fomit-frame-pointer	ref
gcc -funroll-loops -m32 -march=k6 -O2 -fomit-frame-pointer	ref
gcc -funroll-loops -m32 -march=k6 -O3 -fomit-frame-pointer	ref
gcc -funroll-loops -m32 -march=k6 -O -fomit-frame-pointer	ref
gcc -funroll-loops -m32 -march=k8 -O2 -fomit-frame-pointer	ref
gcc -funroll-loops -m32 -march=k8 -O3 -fomit-frame-pointer	ref
gcc -funroll-loops -m32 -march=k8 -O -fomit-frame-pointer	ref
gcc -funroll-loops -m32 -march=pentium-mmx -O2 -fomit-frame-pointer	ref
gcc -funroll-loops -m32 -march=pentium-mmx -O3 -fomit-frame-pointer	ref
gcc -funroll-loops -m32 -march=pentium-mmx -O -fomit-frame-pointer	ref
gcc -funroll-loops -m32 -march=pentium -O2 -fomit-frame-pointer	ref
gcc -funroll-loops -m32 -march=pentium -O3 -fomit-frame-pointer	ref
gcc -funroll-loops -m32 -march=pentium -O -fomit-frame-pointer	ref
gcc -m32 -O2 -fomit-frame-pointer	ref
gcc -m32 -O3 -fomit-frame-pointer	ref
gcc -m32 -O -fomit-frame-pointer	ref
gcc -m32 -march=athlon -O2 -fomit-frame-pointer	ref
gcc -m32 -march=athlon -O3 -fomit-frame-pointer	ref
gcc -m32 -march=athlon -O -fomit-frame-pointer	ref
gcc -m32 -march=core-avx-i -O2 -fomit-frame-pointer	ref
gcc -m32 -march=core-avx-i -O3 -fomit-frame-pointer	ref
gcc -m32 -march=core-avx-i -O -fomit-frame-pointer	ref
gcc -m32 -march=core-avx2 -O2 -fomit-frame-pointer	ref
gcc -m32 -march=core-avx2 -O3 -fomit-frame-pointer	ref
gcc -m32 -march=core-avx2 -O -fomit-frame-pointer	ref
gcc -m32 -march=core2 -O2 -fomit-frame-pointer	ref
gcc -m32 -march=core2 -O3 -fomit-frame-pointer	ref
gcc -m32 -march=core2 -O -fomit-frame-pointer	ref
gcc -m32 -march=core2 -msse4.1 -O2 -fomit-frame-pointer	ref
gcc -m32 -march=core2 -msse4.1 -O3 -fomit-frame-pointer	ref
gcc -m32 -march=core2 -msse4.1 -O -fomit-frame-pointer	ref
gcc -m32 -march=core2 -msse4 -O2 -fomit-frame-pointer	ref
gcc -m32 -march=core2 -msse4 -O3 -fomit-frame-pointer	ref
gcc -m32 -march=core2 -msse4 -O -fomit-frame-pointer	ref
gcc -m32 -march=corei7-avx -O2 -fomit-frame-pointer	ref
gcc -m32 -march=corei7-avx -O3 -fomit-frame-pointer	ref
gcc -m32 -march=corei7-avx -O -fomit-frame-pointer	ref
gcc -m32 -march=corei7 -O2 -fomit-frame-pointer	ref
gcc -m32 -march=corei7 -O3 -fomit-frame-pointer	ref
gcc -m32 -march=corei7 -O -fomit-frame-pointer	ref
gcc -m32 -march=i486 -O2 -fomit-frame-pointer	ref
gcc -m32 -march=i486 -O3 -fomit-frame-pointer	ref
gcc -m32 -march=i486 -O -fomit-frame-pointer	ref
gcc -m32 -march=k6-2 -O2 -fomit-frame-pointer	ref
gcc -m32 -march=k6-2 -O3 -fomit-frame-pointer	ref
gcc -m32 -march=k6-2 -O -fomit-frame-pointer	ref
gcc -m32 -march=k6-3 -O2 -fomit-frame-pointer	ref
gcc -m32 -march=k6-3 -O3 -fomit-frame-pointer	ref
gcc -m32 -march=k6-3 -O -fomit-frame-pointer	ref
gcc -m32 -march=k6 -O2 -fomit-frame-pointer	ref
gcc -m32 -march=k6 -O3 -fomit-frame-pointer	ref
gcc -m32 -march=k6 -O -fomit-frame-pointer	ref
gcc -m32 -march=k8 -O2 -fomit-frame-pointer	ref
gcc -m32 -march=k8 -O3 -fomit-frame-pointer	ref
gcc -m32 -march=k8 -O -fomit-frame-pointer	ref
gcc -m32 -march=native -mtune=native -O2 -fomit-frame-pointer	ref
gcc -m32 -march=native -mtune=native -O3 -fomit-frame-pointer	ref
gcc -m32 -march=native -mtune=native -O -fomit-frame-pointer	ref
gcc -m32 -march=pentium-mmx -O2 -fomit-frame-pointer	ref
gcc -m32 -march=pentium-mmx -O3 -fomit-frame-pointer	ref
gcc -m32 -march=pentium-mmx -O -fomit-frame-pointer	ref
gcc -m32 -march=pentium -O2 -fomit-frame-pointer	ref
gcc -m32 -march=pentium -O3 -fomit-frame-pointer	ref
gcc -m32 -march=pentium -O -fomit-frame-pointer	ref

Test failure

Implementation: crypto_sign/mqqsig192/ref
Compiler: gcc -m32 -march=barcelona -O2 -fomit-frame-pointer

error 111
crypto_sign_open does not handle c=t overlap
error 111
crypto_sign_open does not handle c=t overlap

Number of similar (compiler,implementation) pairs: 3, namely:

Compiler	Implementations
gcc -m32 -march=barcelona -O2 -fomit-frame-pointer	ref
gcc -m32 -march=barcelona -O3 -fomit-frame-pointer	ref
gcc -m32 -march=barcelona -O -fomit-frame-pointer	ref