Implementation notes: x86, samba, crypto_sign/mqqsig224

Computer: samba
Architecture: x86
CPU ID: GenuineIntel-000506e3-bfebfbff
SUPERCOP version: 20190803
Operation: crypto_sign
Primitive: mqqsig224

Time	Implementation	Compiler	Benchmark date	SUPERCOP version
141889	`ref`	`gcc -m32 -march=core-avx2 -Os -fomit-frame-pointer`	20190806	20190803
142016	`ref`	`gcc -m32 -march=native -mtune=native -Os -fomit-frame-pointer`	20190806	20190803
147189	`ref`	`gcc -m32 -march=corei7-avx -Os -fomit-frame-pointer`	20190806	20190803
147270	`ref`	`gcc -m32 -march=core-avx-i -Os -fomit-frame-pointer`	20190806	20190803
148899	`ref`	`gcc -m32 -march=core2 -msse4 -Os -fomit-frame-pointer`	20190806	20190803
149075	`ref`	`gcc -m32 -march=core2 -Os -fomit-frame-pointer`	20190806	20190803
149163	`ref`	`gcc -m32 -march=corei7 -Os -fomit-frame-pointer`	20190806	20190803
149651	`ref`	`gcc -m32 -march=core2 -msse4.1 -Os -fomit-frame-pointer`	20190806	20190803
158978	`ref`	`gcc -m32 -march=nocona -O3 -fomit-frame-pointer`	20190806	20190803
159224	`ref`	`gcc -funroll-loops -m32 -march=nocona -O3 -fomit-frame-pointer`	20190806	20190803
159299	`ref`	`gcc -funroll-loops -m32 -march=prescott -O3 -fomit-frame-pointer`	20190806	20190803
159345	`ref`	`gcc -m32 -march=prescott -O3 -fomit-frame-pointer`	20190806	20190803
159560	`ref`	`gcc -funroll-loops -m32 -march=pentium4 -O3 -fomit-frame-pointer`	20190806	20190803
161877	`ref`	`gcc -m32 -march=pentium4 -O3 -fomit-frame-pointer`	20190806	20190803
164929	`ref`	`gcc -funroll-loops -m32 -march=pentium-m -O3 -fomit-frame-pointer`	20190806	20190803
166339	`ref`	`gcc -m32 -march=pentium-m -O3 -fomit-frame-pointer`	20190806	20190803
293593	`ref`	`gcc -funroll-loops -m32 -march=pentiumpro -O3 -fomit-frame-pointer`	20190806	20190803
294591	`ref`	`gcc -funroll-loops -m32 -march=pentium2 -O3 -fomit-frame-pointer`	20190806	20190803
306179	`ref`	`gcc -funroll-loops -m32 -march=pentium3 -O3 -fomit-frame-pointer`	20190806	20190803
306208	`ref`	`gcc -funroll-loops -m32 -march=pentium-m -O2 -fomit-frame-pointer`	20190806	20190803
306731	`ref`	`gcc -funroll-loops -m32 -march=pentium2 -O2 -fomit-frame-pointer`	20190806	20190803
307186	`ref`	`gcc -funroll-loops -m32 -march=pentiumpro -O2 -fomit-frame-pointer`	20190806	20190803
307629	`ref`	`gcc -funroll-loops -m32 -march=pentium3 -O2 -fomit-frame-pointer`	20190806	20190803
309679	`ref`	`gcc -funroll-loops -m32 -march=prescott -O -fomit-frame-pointer`	20190806	20190803
309839	`ref`	`gcc -funroll-loops -m32 -march=nocona -O -fomit-frame-pointer`	20190806	20190803
315012	`ref`	`gcc -funroll-loops -m32 -march=pentium2 -O -fomit-frame-pointer`	20190806	20190803
315817	`ref`	`gcc -funroll-loops -m32 -march=pentium3 -O -fomit-frame-pointer`	20190806	20190803
316668	`ref`	`gcc -funroll-loops -m32 -march=pentium-m -O -fomit-frame-pointer`	20190806	20190803
316685	`ref`	`gcc -funroll-loops -m32 -march=pentiumpro -O -fomit-frame-pointer`	20190806	20190803
319853	`ref`	`gcc -funroll-loops -m32 -march=nocona -O2 -fomit-frame-pointer`	20190806	20190803
320067	`ref`	`gcc -funroll-loops -m32 -march=prescott -O2 -fomit-frame-pointer`	20190806	20190803
332147	`ref`	`gcc -funroll-loops -m32 -march=i386 -O -fomit-frame-pointer`	20190806	20190803
338486	`ref`	`gcc -funroll-loops -m32 -march=pentium4 -O -fomit-frame-pointer`	20190806	20190803
341208	`ref`	`gcc -m32 -march=i386 -O3 -fomit-frame-pointer`	20190806	20190803
348832	`ref`	`gcc -m32 -march=pentium2 -O3 -fomit-frame-pointer`	20190806	20190803
350546	`ref`	`gcc -m32 -march=pentiumpro -O3 -fomit-frame-pointer`	20190806	20190803
353541	`ref`	`gcc -funroll-loops -m32 -march=pentium4 -O2 -fomit-frame-pointer`	20190806	20190803
356843	`ref`	`gcc -m32 -march=pentium4 -O2 -fomit-frame-pointer`	20190806	20190803
376441	`ref`	`gcc -m32 -march=pentium-m -O -fomit-frame-pointer`	20190806	20190803
376599	`ref`	`gcc -funroll-loops -m32 -march=i386 -O3 -fomit-frame-pointer`	20190806	20190803
376664	`ref`	`gcc -m32 -march=pentium2 -O2 -fomit-frame-pointer`	20190806	20190803
376799	`ref`	`gcc -m32 -march=pentium-m -O2 -fomit-frame-pointer`	20190806	20190803
377246	`ref`	`gcc -m32 -march=pentium3 -O2 -fomit-frame-pointer`	20190806	20190803
377431	`ref`	`gcc -m32 -march=pentiumpro -O2 -fomit-frame-pointer`	20190806	20190803
384276	`ref`	`gcc -m32 -march=pentiumpro -O -fomit-frame-pointer`	20190806	20190803
385040	`ref`	`gcc -m32 -march=pentium3 -O -fomit-frame-pointer`	20190806	20190803
385274	`ref`	`gcc -m32 -march=pentium2 -O -fomit-frame-pointer`	20190806	20190803
396776	`ref`	`gcc -m32 -march=prescott -O2 -fomit-frame-pointer`	20190806	20190803
398377	`ref`	`gcc -m32 -march=i386 -O -fomit-frame-pointer`	20190806	20190803
408573	`ref`	`gcc -m32 -march=i386 -O2 -fomit-frame-pointer`	20190806	20190803
408935	`ref`	`gcc -m32 -march=pentium4 -O -fomit-frame-pointer`	20190806	20190803
411943	`ref`	`gcc -m32 -march=nocona -O2 -fomit-frame-pointer`	20190806	20190803
421361	`ref`	`gcc -funroll-loops -m32 -march=pentium3 -Os -fomit-frame-pointer`	20190806	20190803
421970	`ref`	`gcc -funroll-loops -m32 -march=i486 -Os -fomit-frame-pointer`	20190806	20190803
422525	`ref`	`gcc -m32 -Os -fomit-frame-pointer`	20190806	20190803
422586	`ref`	`gcc -m32 -march=athlon -Os -fomit-frame-pointer`	20190806	20190803
422611	`ref`	`gcc -funroll-loops -m32 -march=k6-3 -Os -fomit-frame-pointer`	20190806	20190803
422799	`ref`	`gcc -funroll-loops -m32 -march=pentiumpro -Os -fomit-frame-pointer`	20190806	20190803
423367	`ref`	`gcc -funroll-loops -m32 -march=i386 -O2 -fomit-frame-pointer`	20190806	20190803
423490	`ref`	`gcc -funroll-loops -m32 -march=k6-2 -Os -fomit-frame-pointer`	20190806	20190803
423659	`ref`	`gcc -funroll-loops -m32 -march=k6 -Os -fomit-frame-pointer`	20190806	20190803
423754	`ref`	`gcc -funroll-loops -m32 -march=i386 -Os -fomit-frame-pointer`	20190806	20190803
424545	`ref`	`gcc -m32 -march=pentium-mmx -Os -fomit-frame-pointer`	20190806	20190803
424869	`ref`	`gcc -funroll-loops -m32 -march=pentium2 -Os -fomit-frame-pointer`	20190806	20190803
424879	`ref`	`gcc -m32 -march=pentium4 -Os -fomit-frame-pointer`	20190806	20190803
424974	`ref`	`gcc -m32 -march=i386 -Os -fomit-frame-pointer`	20190806	20190803
425074	`ref`	`gcc -funroll-loops -m32 -march=prescott -Os -fomit-frame-pointer`	20190806	20190803
425196	`ref`	`gcc -m32 -march=pentium -Os -fomit-frame-pointer`	20190806	20190803
425771	`ref`	`gcc -funroll-loops -m32 -march=pentium4 -Os -fomit-frame-pointer`	20190806	20190803
426056	`ref`	`gcc -funroll-loops -m32 -march=nocona -Os -fomit-frame-pointer`	20190806	20190803
426597	`ref`	`gcc -m32 -march=i486 -Os -fomit-frame-pointer`	20190806	20190803
428006	`ref`	`gcc -m32 -march=nocona -Os -fomit-frame-pointer`	20190806	20190803
428073	`ref`	`gcc -m32 -march=pentium-m -Os -fomit-frame-pointer`	20190806	20190803
428112	`ref`	`gcc -funroll-loops -m32 -march=barcelona -Os -fomit-frame-pointer`	20190806	20190803
428218	`ref`	`gcc -funroll-loops -m32 -march=k8 -Os -fomit-frame-pointer`	20190806	20190803
429792	`ref`	`gcc -m32 -march=prescott -Os -fomit-frame-pointer`	20190806	20190803
432756	`ref`	`gcc -m32 -march=pentium3 -O3 -fomit-frame-pointer`	20190806	20190803
433385	`ref`	`gcc -m32 -march=k6-3 -Os -fomit-frame-pointer`	20190806	20190803
433950	`ref`	`gcc -funroll-loops -m32 -march=pentium -Os -fomit-frame-pointer`	20190806	20190803
434240	`ref`	`gcc -funroll-loops -m32 -march=pentium-mmx -Os -fomit-frame-pointer`	20190806	20190803
434619	`ref`	`gcc -m32 -march=pentium2 -Os -fomit-frame-pointer`	20190806	20190803
435633	`ref`	`gcc -m32 -march=pentium3 -Os -fomit-frame-pointer`	20190806	20190803
435723	`ref`	`gcc -m32 -march=pentiumpro -Os -fomit-frame-pointer`	20190806	20190803
435907	`ref`	`gcc -m32 -march=barcelona -Os -fomit-frame-pointer`	20190806	20190803
436323	`ref`	`gcc -m32 -march=k6 -Os -fomit-frame-pointer`	20190806	20190803
436354	`ref`	`gcc -m32 -march=k6-2 -Os -fomit-frame-pointer`	20190806	20190803
436701	`ref`	`gcc -m32 -march=k8 -Os -fomit-frame-pointer`	20190806	20190803
439135	`ref`	`gcc -funroll-loops -m32 -Os -fomit-frame-pointer`	20190806	20190803
439984	`ref`	`gcc -funroll-loops -m32 -march=athlon -Os -fomit-frame-pointer`	20190806	20190803
448443	`ref`	`gcc -funroll-loops -m32 -march=pentium-m -Os -fomit-frame-pointer`	20190806	20190803
494976	`ref`	`gcc -m32 -march=nocona -O -fomit-frame-pointer`	20190806	20190803
495575	`ref`	`gcc -m32 -march=prescott -O -fomit-frame-pointer`	20190806	20190803

Test failure

Implementation: crypto_sign/mqqsig224/ref
Compiler: gcc -funroll-loops -m32 -O2 -fomit-frame-pointer

error 111
crypto_sign_open does not handle c=t overlap

Number of similar (compiler,implementation) pairs: 81, namely:

Compiler	Implementations
gcc -funroll-loops -m32 -O2 -fomit-frame-pointer	ref
gcc -funroll-loops -m32 -O3 -fomit-frame-pointer	ref
gcc -funroll-loops -m32 -O -fomit-frame-pointer	ref
gcc -funroll-loops -m32 -march=athlon -O2 -fomit-frame-pointer	ref
gcc -funroll-loops -m32 -march=athlon -O3 -fomit-frame-pointer	ref
gcc -funroll-loops -m32 -march=athlon -O -fomit-frame-pointer	ref
gcc -funroll-loops -m32 -march=barcelona -O2 -fomit-frame-pointer	ref
gcc -funroll-loops -m32 -march=barcelona -O3 -fomit-frame-pointer	ref
gcc -funroll-loops -m32 -march=barcelona -O -fomit-frame-pointer	ref
gcc -funroll-loops -m32 -march=i486 -O2 -fomit-frame-pointer	ref
gcc -funroll-loops -m32 -march=i486 -O3 -fomit-frame-pointer	ref
gcc -funroll-loops -m32 -march=i486 -O -fomit-frame-pointer	ref
gcc -funroll-loops -m32 -march=k6-2 -O2 -fomit-frame-pointer	ref
gcc -funroll-loops -m32 -march=k6-2 -O3 -fomit-frame-pointer	ref
gcc -funroll-loops -m32 -march=k6-2 -O -fomit-frame-pointer	ref
gcc -funroll-loops -m32 -march=k6-3 -O2 -fomit-frame-pointer	ref
gcc -funroll-loops -m32 -march=k6-3 -O3 -fomit-frame-pointer	ref
gcc -funroll-loops -m32 -march=k6-3 -O -fomit-frame-pointer	ref
gcc -funroll-loops -m32 -march=k6 -O2 -fomit-frame-pointer	ref
gcc -funroll-loops -m32 -march=k6 -O3 -fomit-frame-pointer	ref
gcc -funroll-loops -m32 -march=k6 -O -fomit-frame-pointer	ref
gcc -funroll-loops -m32 -march=k8 -O2 -fomit-frame-pointer	ref
gcc -funroll-loops -m32 -march=k8 -O3 -fomit-frame-pointer	ref
gcc -funroll-loops -m32 -march=k8 -O -fomit-frame-pointer	ref
gcc -funroll-loops -m32 -march=pentium-mmx -O2 -fomit-frame-pointer	ref
gcc -funroll-loops -m32 -march=pentium-mmx -O3 -fomit-frame-pointer	ref
gcc -funroll-loops -m32 -march=pentium-mmx -O -fomit-frame-pointer	ref
gcc -funroll-loops -m32 -march=pentium -O2 -fomit-frame-pointer	ref
gcc -funroll-loops -m32 -march=pentium -O3 -fomit-frame-pointer	ref
gcc -funroll-loops -m32 -march=pentium -O -fomit-frame-pointer	ref
gcc -m32 -O2 -fomit-frame-pointer	ref
gcc -m32 -O3 -fomit-frame-pointer	ref
gcc -m32 -O -fomit-frame-pointer	ref
gcc -m32 -march=athlon -O2 -fomit-frame-pointer	ref
gcc -m32 -march=athlon -O3 -fomit-frame-pointer	ref
gcc -m32 -march=athlon -O -fomit-frame-pointer	ref
gcc -m32 -march=core-avx-i -O2 -fomit-frame-pointer	ref
gcc -m32 -march=core-avx-i -O3 -fomit-frame-pointer	ref
gcc -m32 -march=core-avx-i -O -fomit-frame-pointer	ref
gcc -m32 -march=core-avx2 -O2 -fomit-frame-pointer	ref
gcc -m32 -march=core-avx2 -O3 -fomit-frame-pointer	ref
gcc -m32 -march=core-avx2 -O -fomit-frame-pointer	ref
gcc -m32 -march=core2 -O2 -fomit-frame-pointer	ref
gcc -m32 -march=core2 -O3 -fomit-frame-pointer	ref
gcc -m32 -march=core2 -O -fomit-frame-pointer	ref
gcc -m32 -march=core2 -msse4.1 -O2 -fomit-frame-pointer	ref
gcc -m32 -march=core2 -msse4.1 -O3 -fomit-frame-pointer	ref
gcc -m32 -march=core2 -msse4.1 -O -fomit-frame-pointer	ref
gcc -m32 -march=core2 -msse4 -O2 -fomit-frame-pointer	ref
gcc -m32 -march=core2 -msse4 -O3 -fomit-frame-pointer	ref
gcc -m32 -march=core2 -msse4 -O -fomit-frame-pointer	ref
gcc -m32 -march=corei7-avx -O2 -fomit-frame-pointer	ref
gcc -m32 -march=corei7-avx -O3 -fomit-frame-pointer	ref
gcc -m32 -march=corei7-avx -O -fomit-frame-pointer	ref
gcc -m32 -march=corei7 -O2 -fomit-frame-pointer	ref
gcc -m32 -march=corei7 -O3 -fomit-frame-pointer	ref
gcc -m32 -march=corei7 -O -fomit-frame-pointer	ref
gcc -m32 -march=i486 -O2 -fomit-frame-pointer	ref
gcc -m32 -march=i486 -O3 -fomit-frame-pointer	ref
gcc -m32 -march=i486 -O -fomit-frame-pointer	ref
gcc -m32 -march=k6-2 -O2 -fomit-frame-pointer	ref
gcc -m32 -march=k6-2 -O3 -fomit-frame-pointer	ref
gcc -m32 -march=k6-2 -O -fomit-frame-pointer	ref
gcc -m32 -march=k6-3 -O2 -fomit-frame-pointer	ref
gcc -m32 -march=k6-3 -O3 -fomit-frame-pointer	ref
gcc -m32 -march=k6-3 -O -fomit-frame-pointer	ref
gcc -m32 -march=k6 -O2 -fomit-frame-pointer	ref
gcc -m32 -march=k6 -O3 -fomit-frame-pointer	ref
gcc -m32 -march=k6 -O -fomit-frame-pointer	ref
gcc -m32 -march=k8 -O2 -fomit-frame-pointer	ref
gcc -m32 -march=k8 -O3 -fomit-frame-pointer	ref
gcc -m32 -march=k8 -O -fomit-frame-pointer	ref
gcc -m32 -march=native -mtune=native -O2 -fomit-frame-pointer	ref
gcc -m32 -march=native -mtune=native -O3 -fomit-frame-pointer	ref
gcc -m32 -march=native -mtune=native -O -fomit-frame-pointer	ref
gcc -m32 -march=pentium-mmx -O2 -fomit-frame-pointer	ref
gcc -m32 -march=pentium-mmx -O3 -fomit-frame-pointer	ref
gcc -m32 -march=pentium-mmx -O -fomit-frame-pointer	ref
gcc -m32 -march=pentium -O2 -fomit-frame-pointer	ref
gcc -m32 -march=pentium -O3 -fomit-frame-pointer	ref
gcc -m32 -march=pentium -O -fomit-frame-pointer	ref

Test failure

Implementation: crypto_sign/mqqsig224/ref
Compiler: gcc -m32 -march=barcelona -O2 -fomit-frame-pointer

error 111
crypto_sign_open does not handle c=t overlap
error 111
crypto_sign_open does not handle c=t overlap

Number of similar (compiler,implementation) pairs: 3, namely:

Compiler	Implementations
gcc -m32 -march=barcelona -O2 -fomit-frame-pointer	ref
gcc -m32 -march=barcelona -O3 -fomit-frame-pointer	ref
gcc -m32 -march=barcelona -O -fomit-frame-pointer	ref