Implementation notes: x86, mace, crypto_sign/mqqsig256

Computer: mace
Architecture: x86
CPU ID: AuthenticAMD-00040fb2-178bfbff
SUPERCOP version: 20170105
Operation: crypto_sign
Primitive: mqqsig256

Time	Object size	Test size	Implementation	Compiler	Benchmark date	SUPERCOP version
557790	? ? ?	? ? ?	`ref`	`gcc_-funroll-loops_-m32_-march=pentiumpro_-O3_-fomit-frame-pointer`	20161119	20161009
571464	? ? ?	? ? ?	`ref`	`gcc_-funroll-loops_-m32_-march=pentium2_-O3_-fomit-frame-pointer`	20161119	20161009
572667	? ? ?	? ? ?	`ref`	`gcc_-m32_-march=i386_-O3_-fomit-frame-pointer`	20161119	20161009
576072	? ? ?	? ? ?	`ref`	`gcc_-funroll-loops_-m32_-march=i386_-O3_-fomit-frame-pointer`	20161119	20161009
582131	? ? ?	? ? ?	`ref`	`gcc_-m32_-march=pentiumpro_-O3_-fomit-frame-pointer`	20161119	20161009
582449	? ? ?	? ? ?	`ref`	`gcc_-m32_-march=pentium2_-O3_-fomit-frame-pointer`	20161119	20161009
656270	? ? ?	? ? ?	`ref`	`gcc_-m32_-march=nocona_-O3_-fomit-frame-pointer`	20161119	20161009
659416	? ? ?	? ? ?	`ref`	`gcc_-funroll-loops_-m32_-march=pentium4_-O3_-fomit-frame-pointer`	20161119	20161009
661190	? ? ?	? ? ?	`ref`	`gcc_-funroll-loops_-m32_-march=nocona_-O3_-fomit-frame-pointer`	20161119	20161009
663011	? ? ?	? ? ?	`ref`	`gcc_-m32_-march=pentium-m_-O3_-fomit-frame-pointer`	20161119	20161009
663176	? ? ?	? ? ?	`ref`	`gcc_-m32_-march=pentium4_-O3_-fomit-frame-pointer`	20161119	20161009
669358	? ? ?	? ? ?	`ref`	`gcc_-funroll-loops_-m32_-march=prescott_-O3_-fomit-frame-pointer`	20161119	20161009
671553	? ? ?	? ? ?	`ref`	`gcc_-m32_-march=prescott_-O3_-fomit-frame-pointer`	20161119	20161009
674907	? ? ?	? ? ?	`ref`	`gcc_-funroll-loops_-m32_-march=pentium-m_-O3_-fomit-frame-pointer`	20161119	20161009
940516	? ? ?	? ? ?	`ref`	`gcc_-funroll-loops_-m32_-march=pentium-m_-O_-fomit-frame-pointer`	20161119	20161009
941956	? ? ?	? ? ?	`ref`	`gcc_-funroll-loops_-m32_-march=pentium4_-O_-fomit-frame-pointer`	20161119	20161009
948983	? ? ?	? ? ?	`ref`	`gcc_-funroll-loops_-m32_-march=prescott_-O_-fomit-frame-pointer`	20161119	20161009
951173	? ? ?	? ? ?	`ref`	`gcc_-funroll-loops_-m32_-march=nocona_-O_-fomit-frame-pointer`	20161119	20161009
955761	? ? ?	? ? ?	`ref`	`gcc_-funroll-loops_-m32_-march=i386_-O_-fomit-frame-pointer`	20161120	20161009
956863	? ? ?	? ? ?	`ref`	`gcc_-funroll-loops_-m32_-march=pentium2_-O_-fomit-frame-pointer`	20161119	20161009
957038	? ? ?	? ? ?	`ref`	`gcc_-funroll-loops_-m32_-march=pentiumpro_-O_-fomit-frame-pointer`	20161119	20161009
959692	? ? ?	? ? ?	`ref`	`gcc_-funroll-loops_-m32_-march=pentium4_-O2_-fomit-frame-pointer`	20161119	20161009
962456	? ? ?	? ? ?	`ref`	`gcc_-funroll-loops_-m32_-march=pentium3_-O_-fomit-frame-pointer`	20161119	20161009
1104113	? ? ?	? ? ?	`ref`	`gcc_-m32_-march=i386_-O2_-fomit-frame-pointer`	20161119	20161009
1107934	? ? ?	? ? ?	`ref`	`gcc_-m32_-march=pentium-m_-O2_-fomit-frame-pointer`	20161119	20161009
1109186	? ? ?	? ? ?	`ref`	`gcc_-m32_-march=pentiumpro_-O2_-fomit-frame-pointer`	20161119	20161009
1110287	? ? ?	? ? ?	`ref`	`gcc_-m32_-march=pentium3_-O2_-fomit-frame-pointer`	20161119	20161009
1110848	? ? ?	? ? ?	`ref`	`gcc_-m32_-march=pentium2_-O2_-fomit-frame-pointer`	20161119	20161009
1114553	? ? ?	? ? ?	`ref`	`gcc_-m32_-march=pentium3_-O3_-fomit-frame-pointer`	20161119	20161009
1133403	? ? ?	? ? ?	`ref`	`gcc_-m32_-march=pentium4_-O_-fomit-frame-pointer`	20161119	20161009
1133636	? ? ?	? ? ?	`ref`	`gcc_-m32_-march=prescott_-O_-fomit-frame-pointer`	20161119	20161009
1135264	? ? ?	? ? ?	`ref`	`gcc_-m32_-march=pentium2_-O_-fomit-frame-pointer`	20161119	20161009
1138645	? ? ?	? ? ?	`ref`	`gcc_-m32_-march=nocona_-O_-fomit-frame-pointer`	20161119	20161009
1147688	? ? ?	? ? ?	`ref`	`gcc_-m32_-march=pentiumpro_-O_-fomit-frame-pointer`	20161119	20161009
1149544	? ? ?	? ? ?	`ref`	`gcc_-m32_-march=pentium3_-O_-fomit-frame-pointer`	20161119	20161009
1195072	? ? ?	? ? ?	`ref`	`gcc_-m32_-march=pentium4_-O2_-fomit-frame-pointer`	20161119	20161009
1242304	? ? ?	? ? ?	`ref`	`gcc_-m32_-march=nocona_-O2_-fomit-frame-pointer`	20161119	20161009
1255940	? ? ?	? ? ?	`ref`	`gcc_-m32_-march=prescott_-O2_-fomit-frame-pointer`	20161119	20161009
1268332	? ? ?	? ? ?	`ref`	`gcc_-m32_-march=i386_-O_-fomit-frame-pointer`	20161119	20161009
1270854	? ? ?	? ? ?	`ref`	`gcc_-m32_-march=pentiumpro_-Os_-fomit-frame-pointer`	20161119	20161009
1273312	? ? ?	? ? ?	`ref`	`gcc_-m32_-march=pentium2_-Os_-fomit-frame-pointer`	20161119	20161009
1274346	? ? ?	? ? ?	`ref`	`gcc_-m32_-march=k8_-Os_-fomit-frame-pointer`	20161119	20161009
1277100	? ? ?	? ? ?	`ref`	`gcc_-funroll-loops_-m32_-march=barcelona_-Os_-fomit-frame-pointer`	20161119	20161009
1278573	? ? ?	? ? ?	`ref`	`gcc_-funroll-loops_-m32_-march=pentiumpro_-Os_-fomit-frame-pointer`	20161119	20161009
1278851	? ? ?	? ? ?	`ref`	`gcc_-funroll-loops_-m32_-Os_-fomit-frame-pointer`	20161119	20161009
1279346	? ? ?	? ? ?	`ref`	`gcc_-m32_-march=barcelona_-Os_-fomit-frame-pointer`	20161119	20161009
1279929	? ? ?	? ? ?	`ref`	`gcc_-funroll-loops_-m32_-march=athlon_-Os_-fomit-frame-pointer`	20161119	20161009
1281131	? ? ?	? ? ?	`ref`	`gcc_-m32_-march=native_-mtune=native_-Os_-fomit-frame-pointer`	20161119	20161009
1283696	? ? ?	? ? ?	`ref`	`gcc_-funroll-loops_-m32_-march=pentium-m_-Os_-fomit-frame-pointer`	20161119	20161009
1284454	? ? ?	? ? ?	`ref`	`gcc_-funroll-loops_-m32_-march=pentium-mmx_-Os_-fomit-frame-pointer`	20161119	20161009
1288388	? ? ?	? ? ?	`ref`	`gcc_-funroll-loops_-m32_-march=pentium2_-Os_-fomit-frame-pointer`	20161119	20161009
1289324	? ? ?	? ? ?	`ref`	`gcc_-funroll-loops_-m32_-march=k8_-Os_-fomit-frame-pointer`	20161119	20161009
1289982	? ? ?	? ? ?	`ref`	`gcc_-m32_-Os_-fomit-frame-pointer`	20161119	20161009
1291182	? ? ?	? ? ?	`ref`	`gcc_-m32_-march=pentium3_-Os_-fomit-frame-pointer`	20161119	20161009
1292504	? ? ?	? ? ?	`ref`	`gcc_-m32_-march=pentium-mmx_-Os_-fomit-frame-pointer`	20161119	20161009
1294748	? ? ?	? ? ?	`ref`	`gcc_-m32_-march=athlon_-Os_-fomit-frame-pointer`	20161119	20161009
1295695	? ? ?	? ? ?	`ref`	`gcc_-m32_-march=pentium_-Os_-fomit-frame-pointer`	20161119	20161009
1296442	? ? ?	? ? ?	`ref`	`gcc_-funroll-loops_-m32_-march=pentium_-Os_-fomit-frame-pointer`	20161119	20161009
1296639	? ? ?	? ? ?	`ref`	`gcc_-m32_-march=pentium-m_-O_-fomit-frame-pointer`	20161119	20161009
1300542	? ? ?	? ? ?	`ref`	`gcc_-funroll-loops_-m32_-march=pentium3_-Os_-fomit-frame-pointer`	20161119	20161009
1308268	? ? ?	? ? ?	`ref`	`gcc_-funroll-loops_-m32_-march=pentium3_-O3_-fomit-frame-pointer`	20161119	20161009
1322260	? ? ?	? ? ?	`ref`	`gcc_-m32_-march=pentium-m_-Os_-fomit-frame-pointer`	20161119	20161009
1340841	? ? ?	? ? ?	`ref`	`gcc_-funroll-loops_-m32_-march=k6_-Os_-fomit-frame-pointer`	20161119	20161009
1344454	? ? ?	? ? ?	`ref`	`gcc_-funroll-loops_-m32_-march=k6-2_-Os_-fomit-frame-pointer`	20161119	20161009
1348464	? ? ?	? ? ?	`ref`	`gcc_-funroll-loops_-m32_-march=k6-3_-Os_-fomit-frame-pointer`	20161119	20161009
1358875	? ? ?	? ? ?	`ref`	`gcc_-m32_-march=k6_-Os_-fomit-frame-pointer`	20161119	20161009
1368592	? ? ?	? ? ?	`ref`	`gcc_-m32_-march=k6-2_-Os_-fomit-frame-pointer`	20161119	20161009
1368809	? ? ?	? ? ?	`ref`	`gcc_-m32_-march=k6-3_-Os_-fomit-frame-pointer`	20161119	20161009
1453324	? ? ?	? ? ?	`ref`	`gcc_-funroll-loops_-m32_-march=pentium4_-Os_-fomit-frame-pointer`	20161119	20161009
1454534	? ? ?	? ? ?	`ref`	`gcc_-funroll-loops_-m32_-march=prescott_-Os_-fomit-frame-pointer`	20161119	20161009
1454911	? ? ?	? ? ?	`ref`	`gcc_-funroll-loops_-m32_-march=nocona_-O2_-fomit-frame-pointer`	20161119	20161009
1456973	? ? ?	? ? ?	`ref`	`gcc_-m32_-march=i386_-Os_-fomit-frame-pointer`	20161119	20161009
1459859	? ? ?	? ? ?	`ref`	`gcc_-m32_-march=i486_-Os_-fomit-frame-pointer`	20161119	20161009
1461314	? ? ?	? ? ?	`ref`	`gcc_-m32_-march=pentium4_-Os_-fomit-frame-pointer`	20161119	20161009
1463002	? ? ?	? ? ?	`ref`	`gcc_-funroll-loops_-m32_-march=i386_-O2_-fomit-frame-pointer`	20161120	20161009
1465335	? ? ?	? ? ?	`ref`	`gcc_-m32_-march=nocona_-Os_-fomit-frame-pointer`	20161119	20161009
1465433	? ? ?	? ? ?	`ref`	`gcc_-funroll-loops_-m32_-march=pentium-m_-O2_-fomit-frame-pointer`	20161119	20161009
1468012	? ? ?	? ? ?	`ref`	`gcc_-funroll-loops_-m32_-march=pentium2_-O2_-fomit-frame-pointer`	20161119	20161009
1469581	? ? ?	? ? ?	`ref`	`gcc_-funroll-loops_-m32_-march=i486_-Os_-fomit-frame-pointer`	20161119	20161009
1470426	? ? ?	? ? ?	`ref`	`gcc_-funroll-loops_-m32_-march=prescott_-O2_-fomit-frame-pointer`	20161119	20161009
1470611	? ? ?	? ? ?	`ref`	`gcc_-funroll-loops_-m32_-march=nocona_-Os_-fomit-frame-pointer`	20161119	20161009
1471332	? ? ?	? ? ?	`ref`	`gcc_-funroll-loops_-m32_-march=pentium3_-O2_-fomit-frame-pointer`	20161119	20161009
1473683	? ? ?	? ? ?	`ref`	`gcc_-funroll-loops_-m32_-march=i386_-Os_-fomit-frame-pointer`	20161119	20161009
1474831	? ? ?	? ? ?	`ref`	`gcc_-funroll-loops_-m32_-march=pentiumpro_-O2_-fomit-frame-pointer`	20161119	20161009
1479104	? ? ?	? ? ?	`ref`	`gcc_-m32_-march=prescott_-Os_-fomit-frame-pointer`	20161119	20161009

Test failure

Implementation: crypto_sign/mqqsig256/ref
Compiler: gcc -funroll-loops -m32 -O2 -fomit-frame-pointer

error 111
crypto_sign_open does not handle c=t overlap

Number of similar (compiler,implementation) pairs: 60, namely:

Compiler	Implementations
gcc -funroll-loops -m32 -O2 -fomit-frame-pointer	ref
gcc -funroll-loops -m32 -O3 -fomit-frame-pointer	ref
gcc -funroll-loops -m32 -O -fomit-frame-pointer	ref
gcc -funroll-loops -m32 -march=athlon -O2 -fomit-frame-pointer	ref
gcc -funroll-loops -m32 -march=athlon -O3 -fomit-frame-pointer	ref
gcc -funroll-loops -m32 -march=athlon -O -fomit-frame-pointer	ref
gcc -funroll-loops -m32 -march=barcelona -O2 -fomit-frame-pointer	ref
gcc -funroll-loops -m32 -march=barcelona -O3 -fomit-frame-pointer	ref
gcc -funroll-loops -m32 -march=barcelona -O -fomit-frame-pointer	ref
gcc -funroll-loops -m32 -march=i486 -O2 -fomit-frame-pointer	ref
gcc -funroll-loops -m32 -march=i486 -O3 -fomit-frame-pointer	ref
gcc -funroll-loops -m32 -march=i486 -O -fomit-frame-pointer	ref
gcc -funroll-loops -m32 -march=k6-2 -O2 -fomit-frame-pointer	ref
gcc -funroll-loops -m32 -march=k6-2 -O3 -fomit-frame-pointer	ref
gcc -funroll-loops -m32 -march=k6-2 -O -fomit-frame-pointer	ref
gcc -funroll-loops -m32 -march=k6-3 -O2 -fomit-frame-pointer	ref
gcc -funroll-loops -m32 -march=k6-3 -O3 -fomit-frame-pointer	ref
gcc -funroll-loops -m32 -march=k6-3 -O -fomit-frame-pointer	ref
gcc -funroll-loops -m32 -march=k6 -O2 -fomit-frame-pointer	ref
gcc -funroll-loops -m32 -march=k6 -O3 -fomit-frame-pointer	ref
gcc -funroll-loops -m32 -march=k6 -O -fomit-frame-pointer	ref
gcc -funroll-loops -m32 -march=k8 -O2 -fomit-frame-pointer	ref
gcc -funroll-loops -m32 -march=k8 -O3 -fomit-frame-pointer	ref
gcc -funroll-loops -m32 -march=k8 -O -fomit-frame-pointer	ref
gcc -funroll-loops -m32 -march=pentium-mmx -O2 -fomit-frame-pointer	ref
gcc -funroll-loops -m32 -march=pentium-mmx -O3 -fomit-frame-pointer	ref
gcc -funroll-loops -m32 -march=pentium-mmx -O -fomit-frame-pointer	ref
gcc -funroll-loops -m32 -march=pentium -O2 -fomit-frame-pointer	ref
gcc -funroll-loops -m32 -march=pentium -O3 -fomit-frame-pointer	ref
gcc -funroll-loops -m32 -march=pentium -O -fomit-frame-pointer	ref
gcc -m32 -O2 -fomit-frame-pointer	ref
gcc -m32 -O3 -fomit-frame-pointer	ref
gcc -m32 -O -fomit-frame-pointer	ref
gcc -m32 -march=athlon -O2 -fomit-frame-pointer	ref
gcc -m32 -march=athlon -O3 -fomit-frame-pointer	ref
gcc -m32 -march=athlon -O -fomit-frame-pointer	ref
gcc -m32 -march=i486 -O2 -fomit-frame-pointer	ref
gcc -m32 -march=i486 -O3 -fomit-frame-pointer	ref
gcc -m32 -march=i486 -O -fomit-frame-pointer	ref
gcc -m32 -march=k6-2 -O2 -fomit-frame-pointer	ref
gcc -m32 -march=k6-2 -O3 -fomit-frame-pointer	ref
gcc -m32 -march=k6-2 -O -fomit-frame-pointer	ref
gcc -m32 -march=k6-3 -O2 -fomit-frame-pointer	ref
gcc -m32 -march=k6-3 -O3 -fomit-frame-pointer	ref
gcc -m32 -march=k6-3 -O -fomit-frame-pointer	ref
gcc -m32 -march=k6 -O2 -fomit-frame-pointer	ref
gcc -m32 -march=k6 -O3 -fomit-frame-pointer	ref
gcc -m32 -march=k6 -O -fomit-frame-pointer	ref
gcc -m32 -march=k8 -O2 -fomit-frame-pointer	ref
gcc -m32 -march=k8 -O3 -fomit-frame-pointer	ref
gcc -m32 -march=k8 -O -fomit-frame-pointer	ref
gcc -m32 -march=native -mtune=native -O2 -fomit-frame-pointer	ref
gcc -m32 -march=native -mtune=native -O3 -fomit-frame-pointer	ref
gcc -m32 -march=native -mtune=native -O -fomit-frame-pointer	ref
gcc -m32 -march=pentium-mmx -O2 -fomit-frame-pointer	ref
gcc -m32 -march=pentium-mmx -O3 -fomit-frame-pointer	ref
gcc -m32 -march=pentium-mmx -O -fomit-frame-pointer	ref
gcc -m32 -march=pentium -O2 -fomit-frame-pointer	ref
gcc -m32 -march=pentium -O3 -fomit-frame-pointer	ref
gcc -m32 -march=pentium -O -fomit-frame-pointer	ref

Test failure

Implementation: crypto_sign/mqqsig256/ref
Compiler: gcc -m32 -march=barcelona -O2 -fomit-frame-pointer

error 111
crypto_sign_open does not handle c=t overlap
error 111
crypto_sign_open does not handle c=t overlap

Number of similar (compiler,implementation) pairs: 3, namely:

Compiler	Implementations
gcc -m32 -march=barcelona -O2 -fomit-frame-pointer	ref
gcc -m32 -march=barcelona -O3 -fomit-frame-pointer	ref
gcc -m32 -march=barcelona -O -fomit-frame-pointer	ref

Test failure

Implementation: crypto_sign/mqqsig256/ref
Compiler: gcc -m32 -march=core-avx-i -O2 -fomit-frame-pointer

error 111

Number of similar (compiler,implementation) pairs: 22, namely:

Compiler	Implementations
gcc -m32 -march=core-avx-i -O2 -fomit-frame-pointer	ref
gcc -m32 -march=core-avx-i -O -fomit-frame-pointer	ref
gcc -m32 -march=core-avx-i -Os -fomit-frame-pointer	ref
gcc -m32 -march=core-avx2 -O2 -fomit-frame-pointer	ref
gcc -m32 -march=core-avx2 -O -fomit-frame-pointer	ref
gcc -m32 -march=core-avx2 -Os -fomit-frame-pointer	ref
gcc -m32 -march=core2 -O2 -fomit-frame-pointer	ref
gcc -m32 -march=core2 -O3 -fomit-frame-pointer	ref
gcc -m32 -march=core2 -O -fomit-frame-pointer	ref
gcc -m32 -march=core2 -Os -fomit-frame-pointer	ref
gcc -m32 -march=core2 -msse4.1 -O2 -fomit-frame-pointer	ref
gcc -m32 -march=core2 -msse4.1 -O -fomit-frame-pointer	ref
gcc -m32 -march=core2 -msse4.1 -Os -fomit-frame-pointer	ref
gcc -m32 -march=core2 -msse4 -O2 -fomit-frame-pointer	ref
gcc -m32 -march=core2 -msse4 -O -fomit-frame-pointer	ref
gcc -m32 -march=core2 -msse4 -Os -fomit-frame-pointer	ref
gcc -m32 -march=corei7-avx -O2 -fomit-frame-pointer	ref
gcc -m32 -march=corei7-avx -O -fomit-frame-pointer	ref
gcc -m32 -march=corei7-avx -Os -fomit-frame-pointer	ref
gcc -m32 -march=corei7 -O2 -fomit-frame-pointer	ref
gcc -m32 -march=corei7 -O -fomit-frame-pointer	ref
gcc -m32 -march=corei7 -Os -fomit-frame-pointer	ref