Implementation notes: x86, hydra1, crypto_sign/mqqsig160

Computer: hydra1
Architecture: x86
CPU ID: AuthenticAMD-00100fa0-178bfbff
SUPERCOP version: 20161220
Operation: crypto_sign
Primitive: mqqsig160

Time	Implementation	Compiler	Benchmark date	SUPERCOP version
353092	`ref`	`gcc -funroll-loops -m32 -march=nocona -O2 -fomit-frame-pointer`	20161024	20161009
353294	`ref`	`gcc -funroll-loops -m32 -march=prescott -O2 -fomit-frame-pointer`	20161024	20161009
354333	`ref`	`gcc -funroll-loops -m32 -march=nocona -O3 -fomit-frame-pointer`	20161024	20161009
354624	`ref`	`gcc -funroll-loops -m32 -march=prescott -O3 -fomit-frame-pointer`	20161024	20161009
355509	`ref`	`gcc -funroll-loops -m32 -march=i386 -O3 -fomit-frame-pointer`	20161025	20161009
356515	`ref`	`gcc -funroll-loops -m32 -march=i386 -O2 -fomit-frame-pointer`	20161025	20161009
357434	`ref`	`gcc -funroll-loops -m32 -march=pentium3 -O3 -fomit-frame-pointer`	20161024	20161009
357490	`ref`	`gcc -funroll-loops -m32 -march=pentium3 -O2 -fomit-frame-pointer`	20161024	20161009
357787	`ref`	`gcc -funroll-loops -m32 -march=pentiumpro -O3 -fomit-frame-pointer`	20161024	20161009
358080	`ref`	`gcc -funroll-loops -m32 -march=pentium2 -O2 -fomit-frame-pointer`	20161024	20161009
358472	`ref`	`gcc -funroll-loops -m32 -march=pentium-m -O2 -fomit-frame-pointer`	20161024	20161009
359331	`ref`	`gcc -funroll-loops -m32 -march=pentium2 -O3 -fomit-frame-pointer`	20161024	20161009
359453	`ref`	`gcc -funroll-loops -m32 -march=pentiumpro -O2 -fomit-frame-pointer`	20161024	20161009
359596	`ref`	`gcc -funroll-loops -m32 -march=pentium-m -O3 -fomit-frame-pointer`	20161024	20161009
360220	`ref`	`gcc -funroll-loops -m32 -march=prescott -O -fomit-frame-pointer`	20161024	20161009
360898	`ref`	`gcc -funroll-loops -m32 -march=nocona -O -fomit-frame-pointer`	20161024	20161009
361040	`ref`	`gcc -m32 -march=pentium4 -O3 -fomit-frame-pointer`	20161024	20161009
363863	`ref`	`gcc -funroll-loops -m32 -march=pentium4 -O -fomit-frame-pointer`	20161024	20161009
365331	`ref`	`gcc -m32 -march=pentium-m -O3 -fomit-frame-pointer`	20161024	20161009
366072	`ref`	`gcc -m32 -march=pentium2 -O3 -fomit-frame-pointer`	20161024	20161009
366171	`ref`	`gcc -m32 -march=pentium3 -O3 -fomit-frame-pointer`	20161024	20161009
367330	`ref`	`gcc -m32 -march=pentiumpro -O3 -fomit-frame-pointer`	20161024	20161009
367768	`ref`	`gcc -funroll-loops -m32 -march=pentium4 -O2 -fomit-frame-pointer`	20161024	20161009
367800	`ref`	`gcc -m32 -march=i386 -O3 -fomit-frame-pointer`	20161024	20161009
368050	`ref`	`gcc -funroll-loops -m32 -march=i386 -O -fomit-frame-pointer`	20161025	20161009
368053	`ref`	`gcc -m32 -march=nocona -O3 -fomit-frame-pointer`	20161024	20161009
368094	`ref`	`gcc -funroll-loops -m32 -march=pentium2 -O -fomit-frame-pointer`	20161024	20161009
368208	`ref`	`gcc -m32 -march=prescott -O3 -fomit-frame-pointer`	20161024	20161009
369441	`ref`	`gcc -funroll-loops -m32 -march=pentiumpro -O -fomit-frame-pointer`	20161024	20161009
372004	`ref`	`gcc -funroll-loops -m32 -march=pentium3 -O -fomit-frame-pointer`	20161024	20161009
372586	`ref`	`gcc -funroll-loops -m32 -march=pentium4 -O3 -fomit-frame-pointer`	20161024	20161009
373247	`ref`	`gcc -funroll-loops -m32 -march=pentium-m -O -fomit-frame-pointer`	20161024	20161009
409464	`ref`	`gcc -m32 -march=pentium4 -O2 -fomit-frame-pointer`	20161024	20161009
409814	`ref`	`gcc -m32 -march=prescott -O2 -fomit-frame-pointer`	20161024	20161009
409856	`ref`	`gcc -m32 -march=nocona -O2 -fomit-frame-pointer`	20161024	20161009
415643	`ref`	`gcc -m32 -march=pentiumpro -O2 -fomit-frame-pointer`	20161024	20161009
415928	`ref`	`gcc -m32 -march=pentium-m -O2 -fomit-frame-pointer`	20161024	20161009
416795	`ref`	`gcc -m32 -march=pentium3 -O2 -fomit-frame-pointer`	20161024	20161009
417002	`ref`	`gcc -m32 -march=pentium2 -O2 -fomit-frame-pointer`	20161024	20161009
419254	`ref`	`gcc -m32 -march=i386 -O2 -fomit-frame-pointer`	20161024	20161009
423762	`ref`	`gcc -m32 -march=pentium4 -O -fomit-frame-pointer`	20161024	20161009
428162	`ref`	`gcc -m32 -march=prescott -O -fomit-frame-pointer`	20161024	20161009
428702	`ref`	`gcc -m32 -march=pentium2 -O -fomit-frame-pointer`	20161024	20161009
429035	`ref`	`gcc -m32 -march=pentiumpro -O -fomit-frame-pointer`	20161024	20161009
429352	`ref`	`gcc -m32 -march=nocona -O -fomit-frame-pointer`	20161024	20161009
440739	`ref`	`gcc -m32 -march=i386 -O -fomit-frame-pointer`	20161024	20161009
443942	`ref`	`gcc -funroll-loops -m32 -march=k6-3 -Os -fomit-frame-pointer`	20161024	20161009
444406	`ref`	`gcc -funroll-loops -m32 -march=k6 -Os -fomit-frame-pointer`	20161024	20161009
444434	`ref`	`gcc -funroll-loops -m32 -march=k6-2 -Os -fomit-frame-pointer`	20161024	20161009
444719	`ref`	`gcc -funroll-loops -m32 -march=pentium2 -Os -fomit-frame-pointer`	20161024	20161009
444776	`ref`	`gcc -m32 -march=pentium-m -O -fomit-frame-pointer`	20161024	20161009
445670	`ref`	`gcc -funroll-loops -m32 -march=pentiumpro -Os -fomit-frame-pointer`	20161024	20161009
450788	`ref`	`gcc -m32 -march=pentium3 -O -fomit-frame-pointer`	20161024	20161009
454114	`ref`	`gcc -m32 -march=pentiumpro -Os -fomit-frame-pointer`	20161024	20161009
454117	`ref`	`gcc -m32 -march=pentium2 -Os -fomit-frame-pointer`	20161024	20161009
456085	`ref`	`gcc -m32 -march=pentium3 -Os -fomit-frame-pointer`	20161024	20161009
456670	`ref`	`gcc -m32 -march=pentium-m -Os -fomit-frame-pointer`	20161024	20161009
461073	`ref`	`gcc -funroll-loops -m32 -march=pentium-m -Os -fomit-frame-pointer`	20161024	20161009
462306	`ref`	`gcc -funroll-loops -m32 -march=pentium3 -Os -fomit-frame-pointer`	20161024	20161009
467936	`ref`	`gcc -m32 -march=k6 -Os -fomit-frame-pointer`	20161024	20161009
468006	`ref`	`gcc -m32 -march=k6-3 -Os -fomit-frame-pointer`	20161024	20161009
468145	`ref`	`gcc -m32 -march=k6-2 -Os -fomit-frame-pointer`	20161024	20161009
468600	`ref`	`gcc -funroll-loops -m32 -march=i386 -Os -fomit-frame-pointer`	20161025	20161009
469867	`ref`	`gcc -m32 -march=i486 -Os -fomit-frame-pointer`	20161024	20161009
471208	`ref`	`gcc -m32 -march=i386 -Os -fomit-frame-pointer`	20161024	20161009
474494	`ref`	`gcc -funroll-loops -m32 -march=athlon -Os -fomit-frame-pointer`	20161024	20161009
474707	`ref`	`gcc -funroll-loops -m32 -march=i486 -Os -fomit-frame-pointer`	20161025	20161009
474912	`ref`	`gcc -funroll-loops -m32 -Os -fomit-frame-pointer`	20161024	20161009
475311	`ref`	`gcc -funroll-loops -m32 -march=pentium -Os -fomit-frame-pointer`	20161025	20161009
475327	`ref`	`gcc -funroll-loops -m32 -march=pentium-mmx -Os -fomit-frame-pointer`	20161025	20161009
477792	`ref`	`gcc -m32 -march=pentium -Os -fomit-frame-pointer`	20161024	20161009
477940	`ref`	`gcc -m32 -march=pentium-mmx -Os -fomit-frame-pointer`	20161024	20161009
484048	`ref`	`gcc -m32 -march=k8 -Os -fomit-frame-pointer`	20161024	20161009
484502	`ref`	`gcc -m32 -march=native -mtune=native -Os -fomit-frame-pointer`	20161024	20161009
485263	`ref`	`gcc -m32 -march=prescott -Os -fomit-frame-pointer`	20161024	20161009
485348	`ref`	`gcc -m32 -march=nocona -Os -fomit-frame-pointer`	20161024	20161009
485654	`ref`	`gcc -m32 -march=barcelona -Os -fomit-frame-pointer`	20161024	20161009
486014	`ref`	`gcc -m32 -march=pentium4 -Os -fomit-frame-pointer`	20161024	20161009
491652	`ref`	`gcc -m32 -Os -fomit-frame-pointer`	20161024	20161009
492107	`ref`	`gcc -m32 -march=athlon -Os -fomit-frame-pointer`	20161024	20161009
496848	`ref`	`gcc -funroll-loops -m32 -march=nocona -Os -fomit-frame-pointer`	20161024	20161009
497760	`ref`	`gcc -funroll-loops -m32 -march=prescott -Os -fomit-frame-pointer`	20161024	20161009
498249	`ref`	`gcc -funroll-loops -m32 -march=pentium4 -Os -fomit-frame-pointer`	20161024	20161009
498513	`ref`	`gcc -funroll-loops -m32 -march=barcelona -Os -fomit-frame-pointer`	20161024	20161009
498952	`ref`	`gcc -funroll-loops -m32 -march=k8 -Os -fomit-frame-pointer`	20161024	20161009

Test failure

Implementation: crypto_sign/mqqsig160/ref
Compiler: gcc -funroll-loops -m32 -O2 -fomit-frame-pointer

error 111
crypto_sign_open does not handle c=t overlap

Number of similar (compiler,implementation) pairs: 60, namely:

Compiler	Implementations
gcc -funroll-loops -m32 -O2 -fomit-frame-pointer	ref
gcc -funroll-loops -m32 -O3 -fomit-frame-pointer	ref
gcc -funroll-loops -m32 -O -fomit-frame-pointer	ref
gcc -funroll-loops -m32 -march=athlon -O2 -fomit-frame-pointer	ref
gcc -funroll-loops -m32 -march=athlon -O3 -fomit-frame-pointer	ref
gcc -funroll-loops -m32 -march=athlon -O -fomit-frame-pointer	ref
gcc -funroll-loops -m32 -march=barcelona -O2 -fomit-frame-pointer	ref
gcc -funroll-loops -m32 -march=barcelona -O3 -fomit-frame-pointer	ref
gcc -funroll-loops -m32 -march=barcelona -O -fomit-frame-pointer	ref
gcc -funroll-loops -m32 -march=i486 -O2 -fomit-frame-pointer	ref
gcc -funroll-loops -m32 -march=i486 -O3 -fomit-frame-pointer	ref
gcc -funroll-loops -m32 -march=i486 -O -fomit-frame-pointer	ref
gcc -funroll-loops -m32 -march=k6-2 -O2 -fomit-frame-pointer	ref
gcc -funroll-loops -m32 -march=k6-2 -O3 -fomit-frame-pointer	ref
gcc -funroll-loops -m32 -march=k6-2 -O -fomit-frame-pointer	ref
gcc -funroll-loops -m32 -march=k6-3 -O2 -fomit-frame-pointer	ref
gcc -funroll-loops -m32 -march=k6-3 -O3 -fomit-frame-pointer	ref
gcc -funroll-loops -m32 -march=k6-3 -O -fomit-frame-pointer	ref
gcc -funroll-loops -m32 -march=k6 -O2 -fomit-frame-pointer	ref
gcc -funroll-loops -m32 -march=k6 -O3 -fomit-frame-pointer	ref
gcc -funroll-loops -m32 -march=k6 -O -fomit-frame-pointer	ref
gcc -funroll-loops -m32 -march=k8 -O2 -fomit-frame-pointer	ref
gcc -funroll-loops -m32 -march=k8 -O3 -fomit-frame-pointer	ref
gcc -funroll-loops -m32 -march=k8 -O -fomit-frame-pointer	ref
gcc -funroll-loops -m32 -march=pentium-mmx -O2 -fomit-frame-pointer	ref
gcc -funroll-loops -m32 -march=pentium-mmx -O3 -fomit-frame-pointer	ref
gcc -funroll-loops -m32 -march=pentium-mmx -O -fomit-frame-pointer	ref
gcc -funroll-loops -m32 -march=pentium -O2 -fomit-frame-pointer	ref
gcc -funroll-loops -m32 -march=pentium -O3 -fomit-frame-pointer	ref
gcc -funroll-loops -m32 -march=pentium -O -fomit-frame-pointer	ref
gcc -m32 -O2 -fomit-frame-pointer	ref
gcc -m32 -O3 -fomit-frame-pointer	ref
gcc -m32 -O -fomit-frame-pointer	ref
gcc -m32 -march=athlon -O2 -fomit-frame-pointer	ref
gcc -m32 -march=athlon -O3 -fomit-frame-pointer	ref
gcc -m32 -march=athlon -O -fomit-frame-pointer	ref
gcc -m32 -march=i486 -O2 -fomit-frame-pointer	ref
gcc -m32 -march=i486 -O3 -fomit-frame-pointer	ref
gcc -m32 -march=i486 -O -fomit-frame-pointer	ref
gcc -m32 -march=k6-2 -O2 -fomit-frame-pointer	ref
gcc -m32 -march=k6-2 -O3 -fomit-frame-pointer	ref
gcc -m32 -march=k6-2 -O -fomit-frame-pointer	ref
gcc -m32 -march=k6-3 -O2 -fomit-frame-pointer	ref
gcc -m32 -march=k6-3 -O3 -fomit-frame-pointer	ref
gcc -m32 -march=k6-3 -O -fomit-frame-pointer	ref
gcc -m32 -march=k6 -O2 -fomit-frame-pointer	ref
gcc -m32 -march=k6 -O3 -fomit-frame-pointer	ref
gcc -m32 -march=k6 -O -fomit-frame-pointer	ref
gcc -m32 -march=k8 -O2 -fomit-frame-pointer	ref
gcc -m32 -march=k8 -O3 -fomit-frame-pointer	ref
gcc -m32 -march=k8 -O -fomit-frame-pointer	ref
gcc -m32 -march=native -mtune=native -O2 -fomit-frame-pointer	ref
gcc -m32 -march=native -mtune=native -O3 -fomit-frame-pointer	ref
gcc -m32 -march=native -mtune=native -O -fomit-frame-pointer	ref
gcc -m32 -march=pentium-mmx -O2 -fomit-frame-pointer	ref
gcc -m32 -march=pentium-mmx -O3 -fomit-frame-pointer	ref
gcc -m32 -march=pentium-mmx -O -fomit-frame-pointer	ref
gcc -m32 -march=pentium -O2 -fomit-frame-pointer	ref
gcc -m32 -march=pentium -O3 -fomit-frame-pointer	ref
gcc -m32 -march=pentium -O -fomit-frame-pointer	ref

Test failure

Implementation: crypto_sign/mqqsig160/ref
Compiler: gcc -m32 -march=barcelona -O2 -fomit-frame-pointer

error 111
crypto_sign_open does not handle c=t overlap
error 111
crypto_sign_open does not handle c=t overlap

Number of similar (compiler,implementation) pairs: 3, namely:

Compiler	Implementations
gcc -m32 -march=barcelona -O2 -fomit-frame-pointer	ref
gcc -m32 -march=barcelona -O3 -fomit-frame-pointer	ref
gcc -m32 -march=barcelona -O -fomit-frame-pointer	ref

Test failure

Implementation: crypto_sign/mqqsig160/ref
Compiler: gcc -m32 -march=core-avx-i -O2 -fomit-frame-pointer

error 111

Number of similar (compiler,implementation) pairs: 22, namely:

Compiler	Implementations
gcc -m32 -march=core-avx-i -O2 -fomit-frame-pointer	ref
gcc -m32 -march=core-avx-i -O -fomit-frame-pointer	ref
gcc -m32 -march=core-avx-i -Os -fomit-frame-pointer	ref
gcc -m32 -march=core-avx2 -O2 -fomit-frame-pointer	ref
gcc -m32 -march=core-avx2 -O -fomit-frame-pointer	ref
gcc -m32 -march=core-avx2 -Os -fomit-frame-pointer	ref
gcc -m32 -march=core2 -O2 -fomit-frame-pointer	ref
gcc -m32 -march=core2 -O3 -fomit-frame-pointer	ref
gcc -m32 -march=core2 -O -fomit-frame-pointer	ref
gcc -m32 -march=core2 -Os -fomit-frame-pointer	ref
gcc -m32 -march=core2 -msse4.1 -O2 -fomit-frame-pointer	ref
gcc -m32 -march=core2 -msse4.1 -O -fomit-frame-pointer	ref
gcc -m32 -march=core2 -msse4.1 -Os -fomit-frame-pointer	ref
gcc -m32 -march=core2 -msse4 -O2 -fomit-frame-pointer	ref
gcc -m32 -march=core2 -msse4 -O -fomit-frame-pointer	ref
gcc -m32 -march=core2 -msse4 -Os -fomit-frame-pointer	ref
gcc -m32 -march=corei7-avx -O2 -fomit-frame-pointer	ref
gcc -m32 -march=corei7-avx -O -fomit-frame-pointer	ref
gcc -m32 -march=corei7-avx -Os -fomit-frame-pointer	ref
gcc -m32 -march=corei7 -O2 -fomit-frame-pointer	ref
gcc -m32 -march=corei7 -O -fomit-frame-pointer	ref
gcc -m32 -march=corei7 -Os -fomit-frame-pointer	ref