Implementation notes: x86, samba, crypto_sign/qtesla1p

Computer: samba
Architecture: x86
CPU ID: GenuineIntel-000506e3-bfebfbff
SUPERCOP version: 20190803
Operation: crypto_sign
Primitive: qtesla1p

Time	Implementation	Compiler	Benchmark date	SUPERCOP version
4777476	`ref`	`gcc -funroll-loops -m32 -march=pentium-m -O3 -fomit-frame-pointer`	20190806	20190803
4785937	`ref`	`gcc -m32 -march=pentium-m -O3 -fomit-frame-pointer`	20190806	20190803
4932538	`ref`	`gcc -funroll-loops -m32 -march=pentium4 -O3 -fomit-frame-pointer`	20190806	20190803
4997465	`ref`	`gcc -m32 -march=nocona -O3 -fomit-frame-pointer`	20190806	20190803
5023072	`ref`	`gcc -funroll-loops -m32 -march=prescott -O3 -fomit-frame-pointer`	20190806	20190803
5061543	`ref`	`gcc -funroll-loops -m32 -march=nocona -O3 -fomit-frame-pointer`	20190806	20190803
5130736	`ref`	`gcc -m32 -march=prescott -O3 -fomit-frame-pointer`	20190806	20190803
5137145	`ref`	`gcc -m32 -march=pentium4 -O3 -fomit-frame-pointer`	20190806	20190803
5452243	`ref`	`gcc -funroll-loops -m32 -march=pentium-m -O2 -fomit-frame-pointer`	20190806	20190803
5508235	`ref`	`gcc -m32 -march=pentium-m -O2 -fomit-frame-pointer`	20190806	20190803
5681121	`ref`	`gcc -m32 -march=native -mtune=native -Os -fomit-frame-pointer`	20190806	20190803
5683903	`ref`	`gcc -m32 -march=pentium-m -Os -fomit-frame-pointer`	20190806	20190803
5692579	`ref`	`gcc -m32 -march=core-avx-i -Os -fomit-frame-pointer`	20190806	20190803
5701504	`ref`	`gcc -funroll-loops -m32 -march=pentium-m -Os -fomit-frame-pointer`	20190806	20190803
5714305	`ref`	`gcc -m32 -march=pentium4 -Os -fomit-frame-pointer`	20190806	20190803
5717474	`ref`	`gcc -m32 -march=nocona -Os -fomit-frame-pointer`	20190806	20190803
5717968	`ref`	`gcc -m32 -march=prescott -Os -fomit-frame-pointer`	20190806	20190803
5728298	`ref`	`gcc -funroll-loops -m32 -march=pentium4 -O2 -fomit-frame-pointer`	20190806	20190803
5732113	`ref`	`gcc -funroll-loops -m32 -march=pentium4 -Os -fomit-frame-pointer`	20190806	20190803
5734159	`ref`	`gcc -m32 -march=corei7-avx -Os -fomit-frame-pointer`	20190806	20190803
5747966	`ref`	`gcc -funroll-loops -m32 -march=prescott -Os -fomit-frame-pointer`	20190806	20190803
5756131	`ref`	`gcc -m32 -march=core-avx2 -Os -fomit-frame-pointer`	20190806	20190803
5757420	`ref`	`gcc -funroll-loops -m32 -march=nocona -Os -fomit-frame-pointer`	20190806	20190803
5761133	`ref`	`gcc -m32 -march=corei7 -Os -fomit-frame-pointer`	20190806	20190803
5761296	`ref`	`gcc -m32 -march=core2 -Os -fomit-frame-pointer`	20190806	20190803
5766959	`ref`	`gcc -m32 -march=core2 -msse4 -Os -fomit-frame-pointer`	20190806	20190803
5799652	`ref`	`gcc -funroll-loops -m32 -march=nocona -O2 -fomit-frame-pointer`	20190806	20190803
5841242	`ref`	`gcc -m32 -march=core2 -msse4.1 -Os -fomit-frame-pointer`	20190806	20190803
5894326	`ref`	`gcc -funroll-loops -m32 -march=prescott -O2 -fomit-frame-pointer`	20190806	20190803
5940905	`ref`	`gcc -m32 -march=prescott -O2 -fomit-frame-pointer`	20190806	20190803
6009777	`ref`	`gcc -m32 -march=nocona -O2 -fomit-frame-pointer`	20190806	20190803
6060819	`ref`	`gcc -funroll-loops -m32 -march=prescott -O -fomit-frame-pointer`	20190806	20190803
6081722	`ref`	`gcc -m32 -march=pentium-m -O -fomit-frame-pointer`	20190806	20190803
6092861	`ref`	`gcc -funroll-loops -m32 -march=pentium4 -O -fomit-frame-pointer`	20190806	20190803
6095829	`ref`	`gcc -m32 -march=pentium4 -O -fomit-frame-pointer`	20190806	20190803
6119906	`ref`	`gcc -funroll-loops -m32 -march=nocona -O -fomit-frame-pointer`	20190806	20190803
6152889	`ref`	`gcc -funroll-loops -m32 -march=pentium-m -O -fomit-frame-pointer`	20190806	20190803
6184032	`ref`	`gcc -m32 -march=pentium4 -O2 -fomit-frame-pointer`	20190806	20190803
6185012	`ref`	`gcc -m32 -march=prescott -O -fomit-frame-pointer`	20190806	20190803
6237472	`ref`	`gcc -m32 -march=nocona -O -fomit-frame-pointer`	20190806	20190803
6558837	`ref`	`gcc -funroll-loops -m32 -march=pentium3 -O3 -fomit-frame-pointer`	20190806	20190803
6598415	`ref`	`gcc -funroll-loops -m32 -march=pentium2 -O3 -fomit-frame-pointer`	20190806	20190803
6604480	`ref`	`gcc -funroll-loops -m32 -march=pentiumpro -O -fomit-frame-pointer`	20190806	20190803
6657234	`ref`	`gcc -funroll-loops -m32 -march=pentium2 -O2 -fomit-frame-pointer`	20190806	20190803
6660643	`ref`	`gcc -m32 -march=pentiumpro -O -fomit-frame-pointer`	20190806	20190803
6667764	`ref`	`gcc -m32 -march=pentium2 -O -fomit-frame-pointer`	20190806	20190803
6682524	`ref`	`gcc -funroll-loops -m32 -march=pentium2 -O -fomit-frame-pointer`	20190806	20190803
6684535	`ref`	`gcc -funroll-loops -m32 -march=pentiumpro -O3 -fomit-frame-pointer`	20190806	20190803
6708155	`ref`	`gcc -m32 -march=pentium3 -O -fomit-frame-pointer`	20190806	20190803
6726194	`ref`	`gcc -funroll-loops -m32 -march=pentium3 -O2 -fomit-frame-pointer`	20190806	20190803
6729071	`ref`	`gcc -funroll-loops -m32 -march=pentium3 -O -fomit-frame-pointer`	20190806	20190803
6732907	`ref`	`gcc -m32 -march=pentium3 -O3 -fomit-frame-pointer`	20190806	20190803
6739327	`ref`	`gcc -funroll-loops -m32 -march=pentiumpro -O2 -fomit-frame-pointer`	20190806	20190803
6773678	`ref`	`gcc -m32 -march=pentiumpro -O3 -fomit-frame-pointer`	20190806	20190803
6779145	`ref`	`gcc -funroll-loops -m32 -march=i386 -Os -fomit-frame-pointer`	20190806	20190803
6782088	`ref`	`gcc -m32 -march=pentium2 -O3 -fomit-frame-pointer`	20190806	20190803
6805330	`ref`	`gcc -m32 -march=i386 -Os -fomit-frame-pointer`	20190806	20190803
6811565	`ref`	`gcc -m32 -march=pentium-mmx -Os -fomit-frame-pointer`	20190806	20190803
6842071	`ref`	`gcc -funroll-loops -m32 -Os -fomit-frame-pointer`	20190806	20190803
6846542	`ref`	`gcc -funroll-loops -m32 -march=i486 -Os -fomit-frame-pointer`	20190806	20190803
6849095	`ref`	`gcc -m32 -march=pentium -Os -fomit-frame-pointer`	20190806	20190803
6875778	`ref`	`gcc -m32 -march=athlon -Os -fomit-frame-pointer`	20190806	20190803
6877573	`ref`	`gcc -m32 -Os -fomit-frame-pointer`	20190806	20190803
6878554	`ref`	`gcc -funroll-loops -m32 -march=athlon -Os -fomit-frame-pointer`	20190806	20190803
6879585	`ref`	`gcc -funroll-loops -m32 -march=pentium-mmx -Os -fomit-frame-pointer`	20190806	20190803
6916455	`ref`	`gcc -m32 -march=pentium3 -Os -fomit-frame-pointer`	20190806	20190803
6917042	`ref`	`gcc -m32 -march=pentiumpro -Os -fomit-frame-pointer`	20190806	20190803
6922423	`ref`	`gcc -funroll-loops -m32 -march=pentium2 -Os -fomit-frame-pointer`	20190806	20190803
6924613	`ref`	`gcc -funroll-loops -m32 -march=pentium3 -Os -fomit-frame-pointer`	20190806	20190803
6931218	`ref`	`gcc -funroll-loops -m32 -march=i386 -O -fomit-frame-pointer`	20190806	20190803
6943915	`ref`	`gcc -funroll-loops -m32 -march=pentium -Os -fomit-frame-pointer`	20190806	20190803
6952012	`ref`	`gcc -funroll-loops -m32 -march=pentiumpro -Os -fomit-frame-pointer`	20190806	20190803
6957410	`ref`	`gcc -m32 -march=pentium2 -Os -fomit-frame-pointer`	20190806	20190803
7002318	`ref`	`gcc -m32 -march=i486 -Os -fomit-frame-pointer`	20190806	20190803
7004651	`ref`	`gcc -m32 -march=pentium2 -O2 -fomit-frame-pointer`	20190806	20190803
7011351	`ref`	`gcc -m32 -march=pentium3 -O2 -fomit-frame-pointer`	20190806	20190803
7107301	`ref`	`gcc -m32 -march=pentiumpro -O2 -fomit-frame-pointer`	20190806	20190803
7121879	`ref`	`gcc -m32 -march=k6-2 -Os -fomit-frame-pointer`	20190806	20190803
7145875	`ref`	`gcc -funroll-loops -m32 -march=k6-3 -Os -fomit-frame-pointer`	20190806	20190803
7172115	`ref`	`gcc -funroll-loops -m32 -march=k6 -Os -fomit-frame-pointer`	20190806	20190803
7195845	`ref`	`gcc -funroll-loops -m32 -march=k6-2 -Os -fomit-frame-pointer`	20190806	20190803
7225345	`ref`	`gcc -m32 -march=k6 -Os -fomit-frame-pointer`	20190806	20190803
7237026	`ref`	`gcc -m32 -march=k6-3 -Os -fomit-frame-pointer`	20190806	20190803
7262881	`ref`	`gcc -m32 -march=i386 -O -fomit-frame-pointer`	20190806	20190803
7315405	`ref`	`gcc -funroll-loops -m32 -march=i386 -O3 -fomit-frame-pointer`	20190806	20190803
7327329	`ref`	`gcc -m32 -march=i386 -O3 -fomit-frame-pointer`	20190806	20190803
7390669	`ref`	`gcc -funroll-loops -m32 -march=i386 -O2 -fomit-frame-pointer`	20190806	20190803
7537784	`ref`	`gcc -m32 -march=i386 -O2 -fomit-frame-pointer`	20190806	20190803
19502758	`ref`	`gcc -funroll-loops -m32 -march=barcelona -Os -fomit-frame-pointer`	20190806	20190803
19557726	`ref`	`gcc -m32 -march=barcelona -Os -fomit-frame-pointer`	20190806	20190803
20508404	`ref`	`gcc -m32 -march=k8 -Os -fomit-frame-pointer`	20190806	20190803
20530748	`ref`	`gcc -funroll-loops -m32 -march=k8 -Os -fomit-frame-pointer`	20190806	20190803

Test failure

Implementation: crypto_sign/qtesla1p/ref
Compiler: gcc -funroll-loops -m32 -O2 -fomit-frame-pointer

error 111
crypto_sign_open does not handle c=t overlap

Number of similar (compiler,implementation) pairs: 81, namely:

Compiler	Implementations
gcc -funroll-loops -m32 -O2 -fomit-frame-pointer	ref
gcc -funroll-loops -m32 -O3 -fomit-frame-pointer	ref
gcc -funroll-loops -m32 -O -fomit-frame-pointer	ref
gcc -funroll-loops -m32 -march=athlon -O2 -fomit-frame-pointer	ref
gcc -funroll-loops -m32 -march=athlon -O3 -fomit-frame-pointer	ref
gcc -funroll-loops -m32 -march=athlon -O -fomit-frame-pointer	ref
gcc -funroll-loops -m32 -march=barcelona -O2 -fomit-frame-pointer	ref
gcc -funroll-loops -m32 -march=barcelona -O3 -fomit-frame-pointer	ref
gcc -funroll-loops -m32 -march=barcelona -O -fomit-frame-pointer	ref
gcc -funroll-loops -m32 -march=i486 -O2 -fomit-frame-pointer	ref
gcc -funroll-loops -m32 -march=i486 -O3 -fomit-frame-pointer	ref
gcc -funroll-loops -m32 -march=i486 -O -fomit-frame-pointer	ref
gcc -funroll-loops -m32 -march=k6-2 -O2 -fomit-frame-pointer	ref
gcc -funroll-loops -m32 -march=k6-2 -O3 -fomit-frame-pointer	ref
gcc -funroll-loops -m32 -march=k6-2 -O -fomit-frame-pointer	ref
gcc -funroll-loops -m32 -march=k6-3 -O2 -fomit-frame-pointer	ref
gcc -funroll-loops -m32 -march=k6-3 -O3 -fomit-frame-pointer	ref
gcc -funroll-loops -m32 -march=k6-3 -O -fomit-frame-pointer	ref
gcc -funroll-loops -m32 -march=k6 -O2 -fomit-frame-pointer	ref
gcc -funroll-loops -m32 -march=k6 -O3 -fomit-frame-pointer	ref
gcc -funroll-loops -m32 -march=k6 -O -fomit-frame-pointer	ref
gcc -funroll-loops -m32 -march=k8 -O2 -fomit-frame-pointer	ref
gcc -funroll-loops -m32 -march=k8 -O3 -fomit-frame-pointer	ref
gcc -funroll-loops -m32 -march=k8 -O -fomit-frame-pointer	ref
gcc -funroll-loops -m32 -march=pentium-mmx -O2 -fomit-frame-pointer	ref
gcc -funroll-loops -m32 -march=pentium-mmx -O3 -fomit-frame-pointer	ref
gcc -funroll-loops -m32 -march=pentium-mmx -O -fomit-frame-pointer	ref
gcc -funroll-loops -m32 -march=pentium -O2 -fomit-frame-pointer	ref
gcc -funroll-loops -m32 -march=pentium -O3 -fomit-frame-pointer	ref
gcc -funroll-loops -m32 -march=pentium -O -fomit-frame-pointer	ref
gcc -m32 -O2 -fomit-frame-pointer	ref
gcc -m32 -O3 -fomit-frame-pointer	ref
gcc -m32 -O -fomit-frame-pointer	ref
gcc -m32 -march=athlon -O2 -fomit-frame-pointer	ref
gcc -m32 -march=athlon -O3 -fomit-frame-pointer	ref
gcc -m32 -march=athlon -O -fomit-frame-pointer	ref
gcc -m32 -march=core-avx-i -O2 -fomit-frame-pointer	ref
gcc -m32 -march=core-avx-i -O3 -fomit-frame-pointer	ref
gcc -m32 -march=core-avx-i -O -fomit-frame-pointer	ref
gcc -m32 -march=core-avx2 -O2 -fomit-frame-pointer	ref
gcc -m32 -march=core-avx2 -O3 -fomit-frame-pointer	ref
gcc -m32 -march=core-avx2 -O -fomit-frame-pointer	ref
gcc -m32 -march=core2 -O2 -fomit-frame-pointer	ref
gcc -m32 -march=core2 -O3 -fomit-frame-pointer	ref
gcc -m32 -march=core2 -O -fomit-frame-pointer	ref
gcc -m32 -march=core2 -msse4.1 -O2 -fomit-frame-pointer	ref
gcc -m32 -march=core2 -msse4.1 -O3 -fomit-frame-pointer	ref
gcc -m32 -march=core2 -msse4.1 -O -fomit-frame-pointer	ref
gcc -m32 -march=core2 -msse4 -O2 -fomit-frame-pointer	ref
gcc -m32 -march=core2 -msse4 -O3 -fomit-frame-pointer	ref
gcc -m32 -march=core2 -msse4 -O -fomit-frame-pointer	ref
gcc -m32 -march=corei7-avx -O2 -fomit-frame-pointer	ref
gcc -m32 -march=corei7-avx -O3 -fomit-frame-pointer	ref
gcc -m32 -march=corei7-avx -O -fomit-frame-pointer	ref
gcc -m32 -march=corei7 -O2 -fomit-frame-pointer	ref
gcc -m32 -march=corei7 -O3 -fomit-frame-pointer	ref
gcc -m32 -march=corei7 -O -fomit-frame-pointer	ref
gcc -m32 -march=i486 -O2 -fomit-frame-pointer	ref
gcc -m32 -march=i486 -O3 -fomit-frame-pointer	ref
gcc -m32 -march=i486 -O -fomit-frame-pointer	ref
gcc -m32 -march=k6-2 -O2 -fomit-frame-pointer	ref
gcc -m32 -march=k6-2 -O3 -fomit-frame-pointer	ref
gcc -m32 -march=k6-2 -O -fomit-frame-pointer	ref
gcc -m32 -march=k6-3 -O2 -fomit-frame-pointer	ref
gcc -m32 -march=k6-3 -O3 -fomit-frame-pointer	ref
gcc -m32 -march=k6-3 -O -fomit-frame-pointer	ref
gcc -m32 -march=k6 -O2 -fomit-frame-pointer	ref
gcc -m32 -march=k6 -O3 -fomit-frame-pointer	ref
gcc -m32 -march=k6 -O -fomit-frame-pointer	ref
gcc -m32 -march=k8 -O2 -fomit-frame-pointer	ref
gcc -m32 -march=k8 -O3 -fomit-frame-pointer	ref
gcc -m32 -march=k8 -O -fomit-frame-pointer	ref
gcc -m32 -march=native -mtune=native -O2 -fomit-frame-pointer	ref
gcc -m32 -march=native -mtune=native -O3 -fomit-frame-pointer	ref
gcc -m32 -march=native -mtune=native -O -fomit-frame-pointer	ref
gcc -m32 -march=pentium-mmx -O2 -fomit-frame-pointer	ref
gcc -m32 -march=pentium-mmx -O3 -fomit-frame-pointer	ref
gcc -m32 -march=pentium-mmx -O -fomit-frame-pointer	ref
gcc -m32 -march=pentium -O2 -fomit-frame-pointer	ref
gcc -m32 -march=pentium -O3 -fomit-frame-pointer	ref
gcc -m32 -march=pentium -O -fomit-frame-pointer	ref

Test failure

Implementation: crypto_sign/qtesla1p/ref
Compiler: gcc -m32 -march=barcelona -O2 -fomit-frame-pointer

error 111
crypto_sign_open does not handle c=t overlap
error 111
crypto_sign_open does not handle c=t overlap

Number of similar (compiler,implementation) pairs: 3, namely:

Compiler	Implementations
gcc -m32 -march=barcelona -O2 -fomit-frame-pointer	ref
gcc -m32 -march=barcelona -O3 -fomit-frame-pointer	ref
gcc -m32 -march=barcelona -O -fomit-frame-pointer	ref