Implementation notes: x86, cryptothinkx, crypto_sign/mqqsig256

Computer: cryptothinkx
Architecture: x86
CPU ID: GenuineIntel-00040651-bfebfbff
SUPERCOP version: 20170105
Operation: crypto_sign
Primitive: mqqsig256

Time	Object size	Test size	Implementation	Compiler	Benchmark date	SUPERCOP version
170238	? ? ?	? ? ?	`ref`	`gcc_-m32_-march=core-avx2_-Os_-fomit-frame-pointer`	20170215	20170105
170271	? ? ?	? ? ?	`ref`	`gcc_-m32_-march=native_-mtune=native_-Os_-fomit-frame-pointer`	20170215	20170105
172851	? ? ?	? ? ?	`ref`	`gcc_-m32_-march=core2_-msse4_-Os_-fomit-frame-pointer`	20170215	20170105
172872	? ? ?	? ? ?	`ref`	`gcc_-m32_-march=corei7_-Os_-fomit-frame-pointer`	20170215	20170105
173541	? ? ?	? ? ?	`ref`	`gcc_-m32_-march=core2_-msse4.1_-Os_-fomit-frame-pointer`	20170215	20170105
173745	? ? ?	? ? ?	`ref`	`gcc_-m32_-march=corei7-avx_-Os_-fomit-frame-pointer`	20170215	20170105
174132	? ? ?	? ? ?	`ref`	`gcc_-m32_-march=core2_-Os_-fomit-frame-pointer`	20170215	20170105
178797	? ? ?	? ? ?	`ref`	`gcc_-m32_-march=core-avx-i_-Os_-fomit-frame-pointer`	20170215	20170105
198690	? ? ?	? ? ?	`ref`	`gcc_-funroll-loops_-m32_-march=pentiumpro_-O3_-fomit-frame-pointer`	20170215	20170105
198732	? ? ?	? ? ?	`ref`	`gcc_-m32_-march=pentiumpro_-O3_-fomit-frame-pointer`	20170215	20170105
199017	? ? ?	? ? ?	`ref`	`gcc_-m32_-march=i386_-O3_-fomit-frame-pointer`	20170215	20170105
199230	? ? ?	? ? ?	`ref`	`gcc_-m32_-march=pentium2_-O3_-fomit-frame-pointer`	20170215	20170105
205572	? ? ?	? ? ?	`ref`	`gcc_-m32_-march=pentium-m_-O3_-fomit-frame-pointer`	20170215	20170105
207378	? ? ?	? ? ?	`ref`	`gcc_-funroll-loops_-m32_-march=prescott_-O3_-fomit-frame-pointer`	20170215	20170105
208869	? ? ?	? ? ?	`ref`	`gcc_-m32_-march=nocona_-O3_-fomit-frame-pointer`	20170215	20170105
211329	? ? ?	? ? ?	`ref`	`gcc_-m32_-march=prescott_-O3_-fomit-frame-pointer`	20170215	20170105
212583	? ? ?	? ? ?	`ref`	`gcc_-funroll-loops_-m32_-march=pentium2_-O3_-fomit-frame-pointer`	20170215	20170105
212739	? ? ?	? ? ?	`ref`	`gcc_-funroll-loops_-m32_-march=i386_-O3_-fomit-frame-pointer`	20170215	20170105
225528	? ? ?	? ? ?	`ref`	`gcc_-funroll-loops_-m32_-march=pentium-m_-O3_-fomit-frame-pointer`	20170215	20170105
227778	? ? ?	? ? ?	`ref`	`gcc_-funroll-loops_-m32_-march=nocona_-O3_-fomit-frame-pointer`	20170215	20170105
229305	? ? ?	? ? ?	`ref`	`gcc_-funroll-loops_-m32_-march=pentium4_-O3_-fomit-frame-pointer`	20170215	20170105
235977	? ? ?	? ? ?	`ref`	`gcc_-m32_-march=pentium4_-O3_-fomit-frame-pointer`	20170215	20170105
403935	? ? ?	? ? ?	`ref`	`gcc_-funroll-loops_-m32_-march=pentium3_-O_-fomit-frame-pointer`	20170215	20170105
404661	? ? ?	? ? ?	`ref`	`gcc_-funroll-loops_-m32_-march=pentium-m_-O_-fomit-frame-pointer`	20170215	20170105
408039	? ? ?	? ? ?	`ref`	`gcc_-funroll-loops_-m32_-march=nocona_-O_-fomit-frame-pointer`	20170215	20170105
416211	? ? ?	? ? ?	`ref`	`gcc_-funroll-loops_-m32_-march=pentiumpro_-O_-fomit-frame-pointer`	20170215	20170105
418335	? ? ?	? ? ?	`ref`	`gcc_-funroll-loops_-m32_-march=pentium4_-O_-fomit-frame-pointer`	20170215	20170105
429852	? ? ?	? ? ?	`ref`	`gcc_-funroll-loops_-m32_-march=pentium2_-O_-fomit-frame-pointer`	20170215	20170105
430509	? ? ?	? ? ?	`ref`	`gcc_-funroll-loops_-m32_-march=prescott_-O_-fomit-frame-pointer`	20170215	20170105
440274	? ? ?	? ? ?	`ref`	`gcc_-funroll-loops_-m32_-march=i386_-O_-fomit-frame-pointer`	20170215	20170105
491178	? ? ?	? ? ?	`ref`	`gcc_-funroll-loops_-m32_-march=pentium4_-O2_-fomit-frame-pointer`	20170215	20170105
519204	? ? ?	? ? ?	`ref`	`gcc_-m32_-march=pentium-m_-O2_-fomit-frame-pointer`	20170215	20170105
530613	? ? ?	? ? ?	`ref`	`gcc_-m32_-march=pentium3_-O3_-fomit-frame-pointer`	20170215	20170105
536124	? ? ?	? ? ?	`ref`	`gcc_-m32_-march=pentium2_-O2_-fomit-frame-pointer`	20170215	20170105
538428	? ? ?	? ? ?	`ref`	`gcc_-m32_-march=pentiumpro_-O2_-fomit-frame-pointer`	20170215	20170105
554112	? ? ?	? ? ?	`ref`	`gcc_-m32_-march=nocona_-O2_-fomit-frame-pointer`	20170215	20170105
557403	? ? ?	? ? ?	`ref`	`gcc_-m32_-march=pentium4_-O2_-fomit-frame-pointer`	20170215	20170105
571773	? ? ?	? ? ?	`ref`	`gcc_-m32_-march=pentium4_-O_-fomit-frame-pointer`	20170215	20170105
577239	? ? ?	? ? ?	`ref`	`gcc_-m32_-march=i386_-O2_-fomit-frame-pointer`	20170215	20170105
585345	? ? ?	? ? ?	`ref`	`gcc_-m32_-march=nocona_-O_-fomit-frame-pointer`	20170215	20170105
602085	? ? ?	? ? ?	`ref`	`gcc_-m32_-march=pentium3_-O2_-fomit-frame-pointer`	20170215	20170105
609111	? ? ?	? ? ?	`ref`	`gcc_-m32_-march=pentium3_-O_-fomit-frame-pointer`	20170215	20170105
611436	? ? ?	? ? ?	`ref`	`gcc_-m32_-march=i386_-O_-fomit-frame-pointer`	20170215	20170105
617085	? ? ?	? ? ?	`ref`	`gcc_-funroll-loops_-m32_-march=pentium3_-O3_-fomit-frame-pointer`	20170215	20170105
618228	? ? ?	? ? ?	`ref`	`gcc_-funroll-loops_-m32_-march=pentium4_-Os_-fomit-frame-pointer`	20170215	20170105
620382	? ? ?	? ? ?	`ref`	`gcc_-m32_-march=prescott_-O2_-fomit-frame-pointer`	20170215	20170105
622380	? ? ?	? ? ?	`ref`	`gcc_-m32_-march=prescott_-Os_-fomit-frame-pointer`	20170215	20170105
622395	? ? ?	? ? ?	`ref`	`gcc_-m32_-march=k6_-Os_-fomit-frame-pointer`	20170215	20170105
623859	? ? ?	? ? ?	`ref`	`gcc_-m32_-march=pentium-m_-O_-fomit-frame-pointer`	20170215	20170105
624309	? ? ?	? ? ?	`ref`	`gcc_-m32_-march=prescott_-O_-fomit-frame-pointer`	20170215	20170105
625302	? ? ?	? ? ?	`ref`	`gcc_-funroll-loops_-m32_-march=pentium3_-O2_-fomit-frame-pointer`	20170215	20170105
630606	? ? ?	? ? ?	`ref`	`gcc_-funroll-loops_-m32_-march=i386_-Os_-fomit-frame-pointer`	20170215	20170105
633381	? ? ?	? ? ?	`ref`	`gcc_-m32_-march=pentium-m_-Os_-fomit-frame-pointer`	20170215	20170105
635604	? ? ?	? ? ?	`ref`	`gcc_-m32_-march=pentium2_-Os_-fomit-frame-pointer`	20170215	20170105
635814	? ? ?	? ? ?	`ref`	`gcc_-funroll-loops_-m32_-march=pentium-mmx_-Os_-fomit-frame-pointer`	20170215	20170105
635874	? ? ?	? ? ?	`ref`	`gcc_-m32_-march=k8_-Os_-fomit-frame-pointer`	20170215	20170105
636063	? ? ?	? ? ?	`ref`	`gcc_-funroll-loops_-m32_-march=k8_-Os_-fomit-frame-pointer`	20170215	20170105
636714	? ? ?	? ? ?	`ref`	`gcc_-funroll-loops_-m32_-march=nocona_-Os_-fomit-frame-pointer`	20170215	20170105
636753	? ? ?	? ? ?	`ref`	`gcc_-funroll-loops_-m32_-march=pentiumpro_-Os_-fomit-frame-pointer`	20170215	20170105
638634	? ? ?	? ? ?	`ref`	`gcc_-funroll-loops_-m32_-march=athlon_-Os_-fomit-frame-pointer`	20170215	20170105
646404	? ? ?	? ? ?	`ref`	`gcc_-m32_-march=pentium_-Os_-fomit-frame-pointer`	20170215	20170105
651297	? ? ?	? ? ?	`ref`	`gcc_-funroll-loops_-m32_-march=pentium-m_-Os_-fomit-frame-pointer`	20170215	20170105
652497	? ? ?	? ? ?	`ref`	`gcc_-m32_-march=pentium2_-O_-fomit-frame-pointer`	20170215	20170105
653118	? ? ?	? ? ?	`ref`	`gcc_-funroll-loops_-m32_-march=pentium2_-Os_-fomit-frame-pointer`	20170215	20170105
653805	? ? ?	? ? ?	`ref`	`gcc_-m32_-march=pentium3_-Os_-fomit-frame-pointer`	20170215	20170105
654558	? ? ?	? ? ?	`ref`	`gcc_-m32_-march=athlon_-Os_-fomit-frame-pointer`	20170215	20170105
655548	? ? ?	? ? ?	`ref`	`gcc_-funroll-loops_-m32_-march=nocona_-O2_-fomit-frame-pointer`	20170215	20170105
657300	? ? ?	? ? ?	`ref`	`gcc_-funroll-loops_-m32_-march=prescott_-O2_-fomit-frame-pointer`	20170215	20170105
657648	? ? ?	? ? ?	`ref`	`gcc_-funroll-loops_-m32_-march=pentiumpro_-O2_-fomit-frame-pointer`	20170215	20170105
657990	? ? ?	? ? ?	`ref`	`gcc_-funroll-loops_-m32_-march=pentium-m_-O2_-fomit-frame-pointer`	20170215	20170105
658638	? ? ?	? ? ?	`ref`	`gcc_-funroll-loops_-m32_-march=pentium2_-O2_-fomit-frame-pointer`	20170215	20170105
659151	? ? ?	? ? ?	`ref`	`gcc_-funroll-loops_-m32_-march=i486_-Os_-fomit-frame-pointer`	20170215	20170105
659610	? ? ?	? ? ?	`ref`	`gcc_-funroll-loops_-m32_-march=pentium_-Os_-fomit-frame-pointer`	20170215	20170105
660246	? ? ?	? ? ?	`ref`	`gcc_-m32_-march=pentiumpro_-Os_-fomit-frame-pointer`	20170215	20170105
660699	? ? ?	? ? ?	`ref`	`gcc_-m32_-march=barcelona_-Os_-fomit-frame-pointer`	20170215	20170105
666783	? ? ?	? ? ?	`ref`	`gcc_-funroll-loops_-m32_-march=pentium3_-Os_-fomit-frame-pointer`	20170215	20170105
678363	? ? ?	? ? ?	`ref`	`gcc_-m32_-march=pentiumpro_-O_-fomit-frame-pointer`	20170215	20170105
681687	? ? ?	? ? ?	`ref`	`gcc_-funroll-loops_-m32_-march=i386_-O2_-fomit-frame-pointer`	20170215	20170105
683409	? ? ?	? ? ?	`ref`	`gcc_-m32_-march=k6-2_-Os_-fomit-frame-pointer`	20170215	20170105
683904	? ? ?	? ? ?	`ref`	`gcc_-funroll-loops_-m32_-march=k6-2_-Os_-fomit-frame-pointer`	20170215	20170105
684915	? ? ?	? ? ?	`ref`	`gcc_-funroll-loops_-m32_-march=k6-3_-Os_-fomit-frame-pointer`	20170215	20170105
687489	? ? ?	? ? ?	`ref`	`gcc_-m32_-march=nocona_-Os_-fomit-frame-pointer`	20170215	20170105
693969	? ? ?	? ? ?	`ref`	`gcc_-m32_-march=i386_-Os_-fomit-frame-pointer`	20170215	20170105
694659	? ? ?	? ? ?	`ref`	`gcc_-m32_-march=pentium4_-Os_-fomit-frame-pointer`	20170215	20170105
695007	? ? ?	? ? ?	`ref`	`gcc_-m32_-march=i486_-Os_-fomit-frame-pointer`	20170215	20170105
697944	? ? ?	? ? ?	`ref`	`gcc_-funroll-loops_-m32_-march=barcelona_-Os_-fomit-frame-pointer`	20170215	20170105
698982	? ? ?	? ? ?	`ref`	`gcc_-funroll-loops_-m32_-Os_-fomit-frame-pointer`	20170215	20170105
706746	? ? ?	? ? ?	`ref`	`gcc_-m32_-march=k6-3_-Os_-fomit-frame-pointer`	20170215	20170105
717750	? ? ?	? ? ?	`ref`	`gcc_-m32_-Os_-fomit-frame-pointer`	20170215	20170105
731550	? ? ?	? ? ?	`ref`	`gcc_-m32_-march=pentium-mmx_-Os_-fomit-frame-pointer`	20170215	20170105
743859	? ? ?	? ? ?	`ref`	`gcc_-m32_-march=barcelona_-Os_-fomit-frame-pointer`	20170215	20170105
755068	? ? ?	? ? ?	`ref`	`gcc_-funroll-loops_-m32_-march=prescott_-Os_-fomit-frame-pointer`	20170215	20170105
784168	? ? ?	? ? ?	`ref`	`gcc_-funroll-loops_-m32_-march=k6_-Os_-fomit-frame-pointer`	20170215	20170105

Test failure

Implementation: crypto_sign/mqqsig256/ref
Compiler: gcc -funroll-loops -m32 -O2 -fomit-frame-pointer

error 111
crypto_sign_open does not handle c=t overlap

Number of similar (compiler,implementation) pairs: 81, namely:

Compiler	Implementations
gcc -funroll-loops -m32 -O2 -fomit-frame-pointer	ref
gcc -funroll-loops -m32 -O3 -fomit-frame-pointer	ref
gcc -funroll-loops -m32 -O -fomit-frame-pointer	ref
gcc -funroll-loops -m32 -march=athlon -O2 -fomit-frame-pointer	ref
gcc -funroll-loops -m32 -march=athlon -O3 -fomit-frame-pointer	ref
gcc -funroll-loops -m32 -march=athlon -O -fomit-frame-pointer	ref
gcc -funroll-loops -m32 -march=barcelona -O2 -fomit-frame-pointer	ref
gcc -funroll-loops -m32 -march=barcelona -O3 -fomit-frame-pointer	ref
gcc -funroll-loops -m32 -march=barcelona -O -fomit-frame-pointer	ref
gcc -funroll-loops -m32 -march=i486 -O2 -fomit-frame-pointer	ref
gcc -funroll-loops -m32 -march=i486 -O3 -fomit-frame-pointer	ref
gcc -funroll-loops -m32 -march=i486 -O -fomit-frame-pointer	ref
gcc -funroll-loops -m32 -march=k6-2 -O2 -fomit-frame-pointer	ref
gcc -funroll-loops -m32 -march=k6-2 -O3 -fomit-frame-pointer	ref
gcc -funroll-loops -m32 -march=k6-2 -O -fomit-frame-pointer	ref
gcc -funroll-loops -m32 -march=k6-3 -O2 -fomit-frame-pointer	ref
gcc -funroll-loops -m32 -march=k6-3 -O3 -fomit-frame-pointer	ref
gcc -funroll-loops -m32 -march=k6-3 -O -fomit-frame-pointer	ref
gcc -funroll-loops -m32 -march=k6 -O2 -fomit-frame-pointer	ref
gcc -funroll-loops -m32 -march=k6 -O3 -fomit-frame-pointer	ref
gcc -funroll-loops -m32 -march=k6 -O -fomit-frame-pointer	ref
gcc -funroll-loops -m32 -march=k8 -O2 -fomit-frame-pointer	ref
gcc -funroll-loops -m32 -march=k8 -O3 -fomit-frame-pointer	ref
gcc -funroll-loops -m32 -march=k8 -O -fomit-frame-pointer	ref
gcc -funroll-loops -m32 -march=pentium-mmx -O2 -fomit-frame-pointer	ref
gcc -funroll-loops -m32 -march=pentium-mmx -O3 -fomit-frame-pointer	ref
gcc -funroll-loops -m32 -march=pentium-mmx -O -fomit-frame-pointer	ref
gcc -funroll-loops -m32 -march=pentium -O2 -fomit-frame-pointer	ref
gcc -funroll-loops -m32 -march=pentium -O3 -fomit-frame-pointer	ref
gcc -funroll-loops -m32 -march=pentium -O -fomit-frame-pointer	ref
gcc -m32 -O2 -fomit-frame-pointer	ref
gcc -m32 -O3 -fomit-frame-pointer	ref
gcc -m32 -O -fomit-frame-pointer	ref
gcc -m32 -march=athlon -O2 -fomit-frame-pointer	ref
gcc -m32 -march=athlon -O3 -fomit-frame-pointer	ref
gcc -m32 -march=athlon -O -fomit-frame-pointer	ref
gcc -m32 -march=core-avx-i -O2 -fomit-frame-pointer	ref
gcc -m32 -march=core-avx-i -O3 -fomit-frame-pointer	ref
gcc -m32 -march=core-avx-i -O -fomit-frame-pointer	ref
gcc -m32 -march=core-avx2 -O2 -fomit-frame-pointer	ref
gcc -m32 -march=core-avx2 -O3 -fomit-frame-pointer	ref
gcc -m32 -march=core-avx2 -O -fomit-frame-pointer	ref
gcc -m32 -march=core2 -O2 -fomit-frame-pointer	ref
gcc -m32 -march=core2 -O3 -fomit-frame-pointer	ref
gcc -m32 -march=core2 -O -fomit-frame-pointer	ref
gcc -m32 -march=core2 -msse4.1 -O2 -fomit-frame-pointer	ref
gcc -m32 -march=core2 -msse4.1 -O3 -fomit-frame-pointer	ref
gcc -m32 -march=core2 -msse4.1 -O -fomit-frame-pointer	ref
gcc -m32 -march=core2 -msse4 -O2 -fomit-frame-pointer	ref
gcc -m32 -march=core2 -msse4 -O3 -fomit-frame-pointer	ref
gcc -m32 -march=core2 -msse4 -O -fomit-frame-pointer	ref
gcc -m32 -march=corei7-avx -O2 -fomit-frame-pointer	ref
gcc -m32 -march=corei7-avx -O3 -fomit-frame-pointer	ref
gcc -m32 -march=corei7-avx -O -fomit-frame-pointer	ref
gcc -m32 -march=corei7 -O2 -fomit-frame-pointer	ref
gcc -m32 -march=corei7 -O3 -fomit-frame-pointer	ref
gcc -m32 -march=corei7 -O -fomit-frame-pointer	ref
gcc -m32 -march=i486 -O2 -fomit-frame-pointer	ref
gcc -m32 -march=i486 -O3 -fomit-frame-pointer	ref
gcc -m32 -march=i486 -O -fomit-frame-pointer	ref
gcc -m32 -march=k6-2 -O2 -fomit-frame-pointer	ref
gcc -m32 -march=k6-2 -O3 -fomit-frame-pointer	ref
gcc -m32 -march=k6-2 -O -fomit-frame-pointer	ref
gcc -m32 -march=k6-3 -O2 -fomit-frame-pointer	ref
gcc -m32 -march=k6-3 -O3 -fomit-frame-pointer	ref
gcc -m32 -march=k6-3 -O -fomit-frame-pointer	ref
gcc -m32 -march=k6 -O2 -fomit-frame-pointer	ref
gcc -m32 -march=k6 -O3 -fomit-frame-pointer	ref
gcc -m32 -march=k6 -O -fomit-frame-pointer	ref
gcc -m32 -march=k8 -O2 -fomit-frame-pointer	ref
gcc -m32 -march=k8 -O3 -fomit-frame-pointer	ref
gcc -m32 -march=k8 -O -fomit-frame-pointer	ref
gcc -m32 -march=native -mtune=native -O2 -fomit-frame-pointer	ref
gcc -m32 -march=native -mtune=native -O3 -fomit-frame-pointer	ref
gcc -m32 -march=native -mtune=native -O -fomit-frame-pointer	ref
gcc -m32 -march=pentium-mmx -O2 -fomit-frame-pointer	ref
gcc -m32 -march=pentium-mmx -O3 -fomit-frame-pointer	ref
gcc -m32 -march=pentium-mmx -O -fomit-frame-pointer	ref
gcc -m32 -march=pentium -O2 -fomit-frame-pointer	ref
gcc -m32 -march=pentium -O3 -fomit-frame-pointer	ref
gcc -m32 -march=pentium -O -fomit-frame-pointer	ref

Test failure

Implementation: crypto_sign/mqqsig256/ref
Compiler: gcc -m32 -march=barcelona -O2 -fomit-frame-pointer

error 111
crypto_sign_open does not handle c=t overlap
error 111
crypto_sign_open does not handle c=t overlap

Number of similar (compiler,implementation) pairs: 3, namely:

Compiler	Implementations
gcc -m32 -march=barcelona -O2 -fomit-frame-pointer	ref
gcc -m32 -march=barcelona -O3 -fomit-frame-pointer	ref
gcc -m32 -march=barcelona -O -fomit-frame-pointer	ref