Implementation notes: x86, h6sandy, crypto_sign/mqqsig224

Computer: h6sandy
Architecture: x86
CPU ID: GenuineIntel-000206a7-bfebfbff
SUPERCOP version: 20171218
Operation: crypto_sign
Primitive: mqqsig224

Time	Implementation	Compiler	Benchmark date	SUPERCOP version
214448	`ref`	`gcc -m32 -march=corei7 -Os -fomit-frame-pointer`	20171203	20171020
214620	`ref`	`gcc -m32 -march=core2 -msse4.1 -Os -fomit-frame-pointer`	20171203	20171020
214864	`ref`	`gcc -m32 -march=core2 -Os -fomit-frame-pointer`	20171203	20171020
214968	`ref`	`gcc -m32 -march=core2 -msse4 -Os -fomit-frame-pointer`	20171203	20171020
215020	`ref`	`gcc -m32 -march=corei7-avx -Os -fomit-frame-pointer`	20171203	20171020
215044	`ref`	`gcc -m32 -march=native -mtune=native -Os -fomit-frame-pointer`	20171203	20171020
215300	`ref`	`gcc -m32 -march=core-avx-i -Os -fomit-frame-pointer`	20171203	20171020
220984	`ref`	`gcc -m32 -march=nocona -O3 -fomit-frame-pointer`	20171203	20171020
221188	`ref`	`gcc -m32 -march=pentium4 -O3 -fomit-frame-pointer`	20171203	20171020
221280	`ref`	`gcc -m32 -march=prescott -O3 -fomit-frame-pointer`	20171203	20171020
225256	`ref`	`gcc -funroll-loops -m32 -march=pentium4 -O3 -fomit-frame-pointer`	20171203	20171020
233412	`ref`	`gcc -funroll-loops -m32 -march=prescott -O3 -fomit-frame-pointer`	20171203	20171020
233968	`ref`	`gcc -funroll-loops -m32 -march=nocona -O3 -fomit-frame-pointer`	20171203	20171020
234908	`ref`	`gcc -funroll-loops -m32 -march=pentium-m -O3 -fomit-frame-pointer`	20171203	20171020
248776	`ref`	`gcc -m32 -march=pentium-m -O3 -fomit-frame-pointer`	20171203	20171020
413440	`ref`	`gcc -funroll-loops -m32 -march=pentium2 -O3 -fomit-frame-pointer`	20171203	20171020
413792	`ref`	`gcc -funroll-loops -m32 -march=pentiumpro -O3 -fomit-frame-pointer`	20171203	20171020
425772	`ref`	`gcc -funroll-loops -m32 -march=nocona -O2 -fomit-frame-pointer`	20171203	20171020
427144	`ref`	`gcc -funroll-loops -m32 -march=prescott -O2 -fomit-frame-pointer`	20171203	20171020
427688	`ref`	`gcc -funroll-loops -m32 -march=nocona -O -fomit-frame-pointer`	20171203	20171020
428340	`ref`	`gcc -funroll-loops -m32 -march=prescott -O -fomit-frame-pointer`	20171203	20171020
430300	`ref`	`gcc -funroll-loops -m32 -march=pentium-m -O -fomit-frame-pointer`	20171203	20171020
430744	`ref`	`gcc -funroll-loops -m32 -march=pentium2 -O2 -fomit-frame-pointer`	20171203	20171020
430792	`ref`	`gcc -funroll-loops -m32 -march=pentium3 -O3 -fomit-frame-pointer`	20171203	20171020
431380	`ref`	`gcc -funroll-loops -m32 -march=pentiumpro -O2 -fomit-frame-pointer`	20171203	20171020
431448	`ref`	`gcc -funroll-loops -m32 -march=pentium-m -O2 -fomit-frame-pointer`	20171203	20171020
434528	`ref`	`gcc -funroll-loops -m32 -march=pentium3 -O2 -fomit-frame-pointer`	20171203	20171020
443956	`ref`	`gcc -funroll-loops -m32 -march=pentium2 -O -fomit-frame-pointer`	20171203	20171020
444224	`ref`	`gcc -funroll-loops -m32 -march=pentiumpro -O -fomit-frame-pointer`	20171203	20171020
450196	`ref`	`gcc -funroll-loops -m32 -march=pentium3 -O -fomit-frame-pointer`	20171203	20171020
467860	`ref`	`gcc -m32 -march=pentiumpro -O3 -fomit-frame-pointer`	20171203	20171020
468536	`ref`	`gcc -m32 -march=pentium2 -O3 -fomit-frame-pointer`	20171203	20171020
470228	`ref`	`gcc -m32 -march=i386 -O3 -fomit-frame-pointer`	20171203	20171020
477332	`ref`	`gcc -m32 -march=pentium-m -O2 -fomit-frame-pointer`	20171203	20171020
481768	`ref`	`gcc -m32 -march=pentium3 -O2 -fomit-frame-pointer`	20171203	20171020
483016	`ref`	`gcc -m32 -march=pentiumpro -O2 -fomit-frame-pointer`	20171203	20171020
483036	`ref`	`gcc -m32 -march=pentium4 -O -fomit-frame-pointer`	20171203	20171020
483376	`ref`	`gcc -m32 -march=pentium2 -O2 -fomit-frame-pointer`	20171203	20171020
483476	`ref`	`gcc -m32 -march=pentium3 -O3 -fomit-frame-pointer`	20171203	20171020
485532	`ref`	`gcc -m32 -march=pentium-m -O -fomit-frame-pointer`	20171203	20171020
487796	`ref`	`gcc -funroll-loops -m32 -march=i386 -O -fomit-frame-pointer`	20171203	20171020
488960	`ref`	`gcc -m32 -march=pentium3 -O -fomit-frame-pointer`	20171203	20171020
495156	`ref`	`gcc -funroll-loops -m32 -march=pentium4 -O -fomit-frame-pointer`	20171203	20171020
495628	`ref`	`gcc -m32 -march=prescott -O -fomit-frame-pointer`	20171203	20171020
495888	`ref`	`gcc -m32 -march=i386 -O2 -fomit-frame-pointer`	20171203	20171020
496544	`ref`	`gcc -m32 -march=nocona -O -fomit-frame-pointer`	20171203	20171020
516784	`ref`	`gcc -m32 -march=i386 -O -fomit-frame-pointer`	20171203	20171020
549952	`ref`	`gcc -m32 -march=k6-3 -Os -fomit-frame-pointer`	20171203	20171020
549992	`ref`	`gcc -m32 -march=k6 -Os -fomit-frame-pointer`	20171203	20171020
551904	`ref`	`gcc -m32 -march=k6-2 -Os -fomit-frame-pointer`	20171203	20171020
554604	`ref`	`gcc -m32 -march=pentium -Os -fomit-frame-pointer`	20171203	20171020
555032	`ref`	`gcc -m32 -march=pentium-mmx -Os -fomit-frame-pointer`	20171203	20171020
555048	`ref`	`gcc -funroll-loops -m32 -march=pentium4 -O2 -fomit-frame-pointer`	20171203	20171020
556008	`ref`	`gcc -funroll-loops -m32 -march=k6 -Os -fomit-frame-pointer`	20171203	20171020
556292	`ref`	`gcc -funroll-loops -m32 -march=k6-2 -Os -fomit-frame-pointer`	20171203	20171020
562700	`ref`	`gcc -funroll-loops -m32 -march=k6-3 -Os -fomit-frame-pointer`	20171203	20171020
563388	`ref`	`gcc -funroll-loops -m32 -march=i386 -Os -fomit-frame-pointer`	20171203	20171020
566648	`ref`	`gcc -funroll-loops -m32 -march=i386 -O3 -fomit-frame-pointer`	20171203	20171020
566656	`ref`	`gcc -m32 -march=i486 -Os -fomit-frame-pointer`	20171203	20171020
566976	`ref`	`gcc -m32 -march=i386 -Os -fomit-frame-pointer`	20171203	20171020
571944	`ref`	`gcc -m32 -march=pentium4 -O2 -fomit-frame-pointer`	20171203	20171020
572472	`ref`	`gcc -m32 -march=pentium-m -Os -fomit-frame-pointer`	20171203	20171020
573188	`ref`	`gcc -funroll-loops -m32 -march=i486 -Os -fomit-frame-pointer`	20171203	20171020
574644	`ref`	`gcc -m32 -march=pentium3 -Os -fomit-frame-pointer`	20171203	20171020
574936	`ref`	`gcc -funroll-loops -m32 -march=pentium -Os -fomit-frame-pointer`	20171203	20171020
574940	`ref`	`gcc -funroll-loops -m32 -march=pentium-mmx -Os -fomit-frame-pointer`	20171203	20171020
575852	`ref`	`gcc -funroll-loops -m32 -Os -fomit-frame-pointer`	20171203	20171020
580352	`ref`	`gcc -funroll-loops -m32 -march=athlon -Os -fomit-frame-pointer`	20171203	20171020
581332	`ref`	`gcc -m32 -march=prescott -O2 -fomit-frame-pointer`	20171203	20171020
581344	`ref`	`gcc -m32 -march=nocona -O2 -fomit-frame-pointer`	20171203	20171020
587004	`ref`	`gcc -m32 -march=pentium2 -Os -fomit-frame-pointer`	20171203	20171020
587608	`ref`	`gcc -m32 -march=pentiumpro -Os -fomit-frame-pointer`	20171203	20171020
589524	`ref`	`gcc -m32 -march=pentiumpro -O -fomit-frame-pointer`	20171203	20171020
590192	`ref`	`gcc -m32 -march=pentium2 -O -fomit-frame-pointer`	20171203	20171020
614380	`ref`	`gcc -funroll-loops -m32 -march=i386 -O2 -fomit-frame-pointer`	20171203	20171020
618984	`ref`	`gcc -funroll-loops -m32 -march=pentium-m -Os -fomit-frame-pointer`	20171203	20171020
621356	`ref`	`gcc -funroll-loops -m32 -march=pentium2 -Os -fomit-frame-pointer`	20171203	20171020
621636	`ref`	`gcc -funroll-loops -m32 -march=pentiumpro -Os -fomit-frame-pointer`	20171203	20171020
621896	`ref`	`gcc -funroll-loops -m32 -march=pentium3 -Os -fomit-frame-pointer`	20171203	20171020
637888	`ref`	`gcc -m32 -march=barcelona -Os -fomit-frame-pointer`	20171203	20171020
637892	`ref`	`gcc -funroll-loops -m32 -march=barcelona -Os -fomit-frame-pointer`	20171203	20171020
638192	`ref`	`gcc -funroll-loops -m32 -march=k8 -Os -fomit-frame-pointer`	20171203	20171020
639852	`ref`	`gcc -m32 -march=k8 -Os -fomit-frame-pointer`	20171203	20171020
640312	`ref`	`gcc -m32 -Os -fomit-frame-pointer`	20171203	20171020
640820	`ref`	`gcc -m32 -march=athlon -Os -fomit-frame-pointer`	20171203	20171020
641016	`ref`	`gcc -m32 -march=nocona -Os -fomit-frame-pointer`	20171203	20171020
643376	`ref`	`gcc -m32 -march=pentium4 -Os -fomit-frame-pointer`	20171203	20171020
645064	`ref`	`gcc -m32 -march=prescott -Os -fomit-frame-pointer`	20171203	20171020
673992	`ref`	`gcc -funroll-loops -m32 -march=pentium4 -Os -fomit-frame-pointer`	20171203	20171020
677440	`ref`	`gcc -funroll-loops -m32 -march=prescott -Os -fomit-frame-pointer`	20171203	20171020
679200	`ref`	`gcc -funroll-loops -m32 -march=nocona -Os -fomit-frame-pointer`	20171203	20171020

Test failure

Implementation: crypto_sign/mqqsig224/ref
Compiler: gcc -funroll-loops -m32 -O2 -fomit-frame-pointer

error 111
crypto_sign_open does not handle c=t overlap

Number of similar (compiler,implementation) pairs: 78, namely:

Compiler	Implementations
gcc -funroll-loops -m32 -O2 -fomit-frame-pointer	ref
gcc -funroll-loops -m32 -O3 -fomit-frame-pointer	ref
gcc -funroll-loops -m32 -O -fomit-frame-pointer	ref
gcc -funroll-loops -m32 -march=athlon -O2 -fomit-frame-pointer	ref
gcc -funroll-loops -m32 -march=athlon -O3 -fomit-frame-pointer	ref
gcc -funroll-loops -m32 -march=athlon -O -fomit-frame-pointer	ref
gcc -funroll-loops -m32 -march=barcelona -O2 -fomit-frame-pointer	ref
gcc -funroll-loops -m32 -march=barcelona -O3 -fomit-frame-pointer	ref
gcc -funroll-loops -m32 -march=barcelona -O -fomit-frame-pointer	ref
gcc -funroll-loops -m32 -march=i486 -O2 -fomit-frame-pointer	ref
gcc -funroll-loops -m32 -march=i486 -O3 -fomit-frame-pointer	ref
gcc -funroll-loops -m32 -march=i486 -O -fomit-frame-pointer	ref
gcc -funroll-loops -m32 -march=k6-2 -O2 -fomit-frame-pointer	ref
gcc -funroll-loops -m32 -march=k6-2 -O3 -fomit-frame-pointer	ref
gcc -funroll-loops -m32 -march=k6-2 -O -fomit-frame-pointer	ref
gcc -funroll-loops -m32 -march=k6-3 -O2 -fomit-frame-pointer	ref
gcc -funroll-loops -m32 -march=k6-3 -O3 -fomit-frame-pointer	ref
gcc -funroll-loops -m32 -march=k6-3 -O -fomit-frame-pointer	ref
gcc -funroll-loops -m32 -march=k6 -O2 -fomit-frame-pointer	ref
gcc -funroll-loops -m32 -march=k6 -O3 -fomit-frame-pointer	ref
gcc -funroll-loops -m32 -march=k6 -O -fomit-frame-pointer	ref
gcc -funroll-loops -m32 -march=k8 -O2 -fomit-frame-pointer	ref
gcc -funroll-loops -m32 -march=k8 -O3 -fomit-frame-pointer	ref
gcc -funroll-loops -m32 -march=k8 -O -fomit-frame-pointer	ref
gcc -funroll-loops -m32 -march=pentium-mmx -O2 -fomit-frame-pointer	ref
gcc -funroll-loops -m32 -march=pentium-mmx -O3 -fomit-frame-pointer	ref
gcc -funroll-loops -m32 -march=pentium-mmx -O -fomit-frame-pointer	ref
gcc -funroll-loops -m32 -march=pentium -O2 -fomit-frame-pointer	ref
gcc -funroll-loops -m32 -march=pentium -O3 -fomit-frame-pointer	ref
gcc -funroll-loops -m32 -march=pentium -O -fomit-frame-pointer	ref
gcc -m32 -O2 -fomit-frame-pointer	ref
gcc -m32 -O3 -fomit-frame-pointer	ref
gcc -m32 -O -fomit-frame-pointer	ref
gcc -m32 -march=athlon -O2 -fomit-frame-pointer	ref
gcc -m32 -march=athlon -O3 -fomit-frame-pointer	ref
gcc -m32 -march=athlon -O -fomit-frame-pointer	ref
gcc -m32 -march=core-avx-i -O2 -fomit-frame-pointer	ref
gcc -m32 -march=core-avx-i -O3 -fomit-frame-pointer	ref
gcc -m32 -march=core-avx-i -O -fomit-frame-pointer	ref
gcc -m32 -march=core2 -O2 -fomit-frame-pointer	ref
gcc -m32 -march=core2 -O3 -fomit-frame-pointer	ref
gcc -m32 -march=core2 -O -fomit-frame-pointer	ref
gcc -m32 -march=core2 -msse4.1 -O2 -fomit-frame-pointer	ref
gcc -m32 -march=core2 -msse4.1 -O3 -fomit-frame-pointer	ref
gcc -m32 -march=core2 -msse4.1 -O -fomit-frame-pointer	ref
gcc -m32 -march=core2 -msse4 -O2 -fomit-frame-pointer	ref
gcc -m32 -march=core2 -msse4 -O3 -fomit-frame-pointer	ref
gcc -m32 -march=core2 -msse4 -O -fomit-frame-pointer	ref
gcc -m32 -march=corei7-avx -O2 -fomit-frame-pointer	ref
gcc -m32 -march=corei7-avx -O3 -fomit-frame-pointer	ref
gcc -m32 -march=corei7-avx -O -fomit-frame-pointer	ref
gcc -m32 -march=corei7 -O2 -fomit-frame-pointer	ref
gcc -m32 -march=corei7 -O3 -fomit-frame-pointer	ref
gcc -m32 -march=corei7 -O -fomit-frame-pointer	ref
gcc -m32 -march=i486 -O2 -fomit-frame-pointer	ref
gcc -m32 -march=i486 -O3 -fomit-frame-pointer	ref
gcc -m32 -march=i486 -O -fomit-frame-pointer	ref
gcc -m32 -march=k6-2 -O2 -fomit-frame-pointer	ref
gcc -m32 -march=k6-2 -O3 -fomit-frame-pointer	ref
gcc -m32 -march=k6-2 -O -fomit-frame-pointer	ref
gcc -m32 -march=k6-3 -O2 -fomit-frame-pointer	ref
gcc -m32 -march=k6-3 -O3 -fomit-frame-pointer	ref
gcc -m32 -march=k6-3 -O -fomit-frame-pointer	ref
gcc -m32 -march=k6 -O2 -fomit-frame-pointer	ref
gcc -m32 -march=k6 -O3 -fomit-frame-pointer	ref
gcc -m32 -march=k6 -O -fomit-frame-pointer	ref
gcc -m32 -march=k8 -O2 -fomit-frame-pointer	ref
gcc -m32 -march=k8 -O3 -fomit-frame-pointer	ref
gcc -m32 -march=k8 -O -fomit-frame-pointer	ref
gcc -m32 -march=native -mtune=native -O2 -fomit-frame-pointer	ref
gcc -m32 -march=native -mtune=native -O3 -fomit-frame-pointer	ref
gcc -m32 -march=native -mtune=native -O -fomit-frame-pointer	ref
gcc -m32 -march=pentium-mmx -O2 -fomit-frame-pointer	ref
gcc -m32 -march=pentium-mmx -O3 -fomit-frame-pointer	ref
gcc -m32 -march=pentium-mmx -O -fomit-frame-pointer	ref
gcc -m32 -march=pentium -O2 -fomit-frame-pointer	ref
gcc -m32 -march=pentium -O3 -fomit-frame-pointer	ref
gcc -m32 -march=pentium -O -fomit-frame-pointer	ref

Test failure

Implementation: crypto_sign/mqqsig224/ref
Compiler: gcc -m32 -march=barcelona -O2 -fomit-frame-pointer

error 111
crypto_sign_open does not handle c=t overlap
error 111
crypto_sign_open does not handle c=t overlap

Number of similar (compiler,implementation) pairs: 3, namely:

Compiler	Implementations
gcc -m32 -march=barcelona -O2 -fomit-frame-pointer	ref
gcc -m32 -march=barcelona -O3 -fomit-frame-pointer	ref
gcc -m32 -march=barcelona -O -fomit-frame-pointer	ref

Test failure

Implementation: crypto_sign/mqqsig224/ref
Compiler: gcc -m32 -march=core-avx2 -O2 -fomit-frame-pointer

error 111

Number of similar (compiler,implementation) pairs: 3, namely:

Compiler	Implementations
gcc -m32 -march=core-avx2 -O2 -fomit-frame-pointer	ref
gcc -m32 -march=core-avx2 -O -fomit-frame-pointer	ref
gcc -m32 -march=core-avx2 -Os -fomit-frame-pointer	ref