Implementation notes: x86, kizomba, crypto_sign/qtesla3f

Computer: kizomba
Architecture: x86
CPU ID: GenuineIntel-000906e9-bfebfbff
SUPERCOP version: 20181216
Operation: crypto_sign
Primitive: qtesla3f

Time	Implementation	Compiler	Benchmark date	SUPERCOP version
2779814	`ref`	`gcc -funroll-loops -m32 -march=pentium-m -O3 -fomit-frame-pointer`	20180829	20180818
2949363	`ref`	`gcc -m32 -march=pentium-m -O3 -fomit-frame-pointer`	20180829	20180818
2956970	`ref`	`gcc -funroll-loops -m32 -march=pentium4 -O3 -fomit-frame-pointer`	20180829	20180818
3010222	`ref`	`gcc -m32 -march=pentium4 -O3 -fomit-frame-pointer`	20180829	20180818
3163099	`ref`	`gcc -m32 -march=prescott -O3 -fomit-frame-pointer`	20180829	20180818
3181724	`ref`	`gcc -m32 -march=nocona -O3 -fomit-frame-pointer`	20180829	20180818
3184705	`ref`	`gcc -funroll-loops -m32 -march=prescott -O3 -fomit-frame-pointer`	20180829	20180818
3339566	`ref`	`gcc -funroll-loops -m32 -march=nocona -O3 -fomit-frame-pointer`	20180829	20180818
3542093	`ref`	`gcc -funroll-loops -m32 -march=pentium-m -O2 -fomit-frame-pointer`	20180829	20180818
3559000	`ref`	`gcc -m32 -march=pentium-m -O2 -fomit-frame-pointer`	20180829	20180818
3733441	`ref`	`gcc -m32 -march=core-avx2 -Os -fomit-frame-pointer`	20180829	20180818
3752404	`ref`	`gcc -m32 -march=core-avx-i -Os -fomit-frame-pointer`	20180829	20180818
3765484	`ref`	`gcc -m32 -march=core2 -msse4.1 -Os -fomit-frame-pointer`	20180829	20180818
3780692	`ref`	`gcc -m32 -march=core2 -msse4 -Os -fomit-frame-pointer`	20180829	20180818
3812863	`ref`	`gcc -funroll-loops -m32 -march=pentium4 -O2 -fomit-frame-pointer`	20180829	20180818
3821274	`ref`	`gcc -funroll-loops -m32 -march=pentium4 -Os -fomit-frame-pointer`	20180829	20180818
3824347	`ref`	`gcc -m32 -march=pentium-m -Os -fomit-frame-pointer`	20180829	20180818
3852147	`ref`	`gcc -funroll-loops -m32 -march=pentium-m -Os -fomit-frame-pointer`	20180829	20180818
3862399	`ref`	`gcc -funroll-loops -m32 -march=nocona -Os -fomit-frame-pointer`	20180829	20180818
3878139	`ref`	`gcc -m32 -march=prescott -Os -fomit-frame-pointer`	20180829	20180818
3878774	`ref`	`gcc -m32 -march=pentium4 -Os -fomit-frame-pointer`	20180829	20180818
3880149	`ref`	`gcc -m32 -march=nocona -Os -fomit-frame-pointer`	20180829	20180818
3893689	`ref`	`gcc -m32 -march=core2 -Os -fomit-frame-pointer`	20180829	20180818
3904580	`ref`	`gcc -m32 -march=corei7-avx -Os -fomit-frame-pointer`	20180829	20180818
3922242	`ref`	`gcc -m32 -march=corei7 -Os -fomit-frame-pointer`	20180829	20180818
3929508	`ref`	`gcc -funroll-loops -m32 -march=prescott -Os -fomit-frame-pointer`	20180829	20180818
3996949	`ref`	`gcc -funroll-loops -m32 -march=prescott -O2 -fomit-frame-pointer`	20180829	20180818
4006468	`ref`	`gcc -funroll-loops -m32 -march=pentium4 -O -fomit-frame-pointer`	20180829	20180818
4019302	`ref`	`gcc -m32 -march=pentium4 -O2 -fomit-frame-pointer`	20180829	20180818
4021978	`ref`	`gcc -funroll-loops -m32 -march=nocona -O2 -fomit-frame-pointer`	20180829	20180818
4073550	`ref`	`gcc -m32 -march=pentium4 -O -fomit-frame-pointer`	20180829	20180818
4084004	`ref`	`gcc -m32 -march=pentium-m -O -fomit-frame-pointer`	20180829	20180818
4169412	`ref`	`gcc -m32 -march=nocona -O2 -fomit-frame-pointer`	20180829	20180818
4270956	`ref`	`gcc -funroll-loops -m32 -march=prescott -O -fomit-frame-pointer`	20180829	20180818
4273338	`ref`	`gcc -funroll-loops -m32 -march=nocona -O -fomit-frame-pointer`	20180829	20180818
4319609	`ref`	`gcc -funroll-loops -m32 -march=pentium-m -O -fomit-frame-pointer`	20180829	20180818
4329712	`ref`	`gcc -m32 -march=prescott -O -fomit-frame-pointer`	20180829	20180818
4334931	`ref`	`gcc -funroll-loops -m32 -march=pentium2 -O2 -fomit-frame-pointer`	20180829	20180818
4352476	`ref`	`gcc -funroll-loops -m32 -march=pentium2 -O3 -fomit-frame-pointer`	20180829	20180818
4357667	`ref`	`gcc -funroll-loops -m32 -march=pentium3 -O3 -fomit-frame-pointer`	20180829	20180818
4365697	`ref`	`gcc -m32 -march=prescott -O2 -fomit-frame-pointer`	20180829	20180818
4380405	`ref`	`gcc -funroll-loops -m32 -march=pentium2 -O -fomit-frame-pointer`	20180829	20180818
4387508	`ref`	`gcc -funroll-loops -m32 -march=pentium3 -O -fomit-frame-pointer`	20180829	20180818
4387686	`ref`	`gcc -funroll-loops -m32 -march=pentiumpro -O2 -fomit-frame-pointer`	20180829	20180818
4395115	`ref`	`gcc -m32 -march=nocona -O -fomit-frame-pointer`	20180829	20180818
4443016	`ref`	`gcc -funroll-loops -m32 -march=pentiumpro -O -fomit-frame-pointer`	20180829	20180818
4448675	`ref`	`gcc -funroll-loops -m32 -march=pentium3 -O2 -fomit-frame-pointer`	20180829	20180818
4460879	`ref`	`gcc -m32 -march=pentium2 -O -fomit-frame-pointer`	20180829	20180818
4494639	`ref`	`gcc -funroll-loops -m32 -march=pentiumpro -O3 -fomit-frame-pointer`	20180829	20180818
4508455	`ref`	`gcc -m32 -march=pentiumpro -O -fomit-frame-pointer`	20180829	20180818
4511230	`ref`	`gcc -m32 -march=pentiumpro -O3 -fomit-frame-pointer`	20180829	20180818
4520071	`ref`	`gcc -m32 -march=pentium2 -O3 -fomit-frame-pointer`	20180829	20180818
4524861	`ref`	`gcc -funroll-loops -m32 -march=i386 -O3 -fomit-frame-pointer`	20180829	20180818
4568944	`ref`	`gcc -funroll-loops -m32 -march=i386 -O2 -fomit-frame-pointer`	20180829	20180818
4600087	`ref`	`gcc -m32 -march=pentium3 -O -fomit-frame-pointer`	20180829	20180818
4605670	`ref`	`gcc -m32 -march=i386 -Os -fomit-frame-pointer`	20180829	20180818
4610651	`ref`	`gcc -m32 -march=pentium3 -O3 -fomit-frame-pointer`	20180829	20180818
4618819	`ref`	`gcc -m32 -march=pentiumpro -O2 -fomit-frame-pointer`	20180829	20180818
4629470	`ref`	`gcc -m32 -march=pentium2 -O2 -fomit-frame-pointer`	20180829	20180818
4633500	`ref`	`gcc -m32 -Os -fomit-frame-pointer`	20180829	20180818
4637409	`ref`	`gcc -m32 -march=pentium -Os -fomit-frame-pointer`	20180829	20180818
4648557	`ref`	`gcc -funroll-loops -m32 -Os -fomit-frame-pointer`	20180829	20180818
4652609	`ref`	`gcc -m32 -march=athlon -Os -fomit-frame-pointer`	20180829	20180818
4659546	`ref`	`gcc -m32 -march=i386 -O -fomit-frame-pointer`	20180829	20180818
4666422	`ref`	`gcc -m32 -march=pentium3 -O2 -fomit-frame-pointer`	20180829	20180818
4685806	`ref`	`gcc -funroll-loops -m32 -march=pentium-mmx -Os -fomit-frame-pointer`	20180829	20180818
4694123	`ref`	`gcc -m32 -march=pentium3 -Os -fomit-frame-pointer`	20180829	20180818
4702385	`ref`	`gcc -m32 -march=pentiumpro -Os -fomit-frame-pointer`	20180829	20180818
4708716	`ref`	`gcc -funroll-loops -m32 -march=pentiumpro -Os -fomit-frame-pointer`	20180829	20180818
4719137	`ref`	`gcc -m32 -march=pentium2 -Os -fomit-frame-pointer`	20180829	20180818
4721175	`ref`	`gcc -m32 -march=i386 -O3 -fomit-frame-pointer`	20180829	20180818
4726222	`ref`	`gcc -funroll-loops -m32 -march=pentium -Os -fomit-frame-pointer`	20180829	20180818
4731089	`ref`	`gcc -m32 -march=k6-3 -Os -fomit-frame-pointer`	20180829	20180818
4737713	`ref`	`gcc -funroll-loops -m32 -march=pentium2 -Os -fomit-frame-pointer`	20180829	20180818
4741993	`ref`	`gcc -funroll-loops -m32 -march=pentium3 -Os -fomit-frame-pointer`	20180829	20180818
4743593	`ref`	`gcc -funroll-loops -m32 -march=k6-3 -Os -fomit-frame-pointer`	20180829	20180818
4753694	`ref`	`gcc -m32 -march=i386 -O2 -fomit-frame-pointer`	20180829	20180818
4788527	`ref`	`gcc -funroll-loops -m32 -march=i486 -Os -fomit-frame-pointer`	20180829	20180818
4789310	`ref`	`gcc -m32 -march=k6 -Os -fomit-frame-pointer`	20180829	20180818
4791355	`ref`	`gcc -funroll-loops -m32 -march=k6-2 -Os -fomit-frame-pointer`	20180829	20180818
4799315	`ref`	`gcc -funroll-loops -m32 -march=athlon -Os -fomit-frame-pointer`	20180829	20180818
4805700	`ref`	`gcc -m32 -march=k6-2 -Os -fomit-frame-pointer`	20180829	20180818
4856379	`ref`	`gcc -m32 -march=pentium-mmx -Os -fomit-frame-pointer`	20180829	20180818
4879502	`ref`	`gcc -funroll-loops -m32 -march=i386 -O -fomit-frame-pointer`	20180829	20180818
4914861	`ref`	`gcc -m32 -march=i486 -Os -fomit-frame-pointer`	20180829	20180818
4959060	`ref`	`gcc -funroll-loops -m32 -march=k6 -Os -fomit-frame-pointer`	20180829	20180818
5049476	`ref`	`gcc -funroll-loops -m32 -march=i386 -Os -fomit-frame-pointer`	20180829	20180818
14111699	`ref`	`gcc -m32 -march=native -mtune=native -Os -fomit-frame-pointer`	20180829	20180818
14292425	`ref`	`gcc -m32 -march=barcelona -Os -fomit-frame-pointer`	20180829	20180818
14665081	`ref`	`gcc -m32 -march=k8 -Os -fomit-frame-pointer`	20180829	20180818
14793553	`ref`	`gcc -funroll-loops -m32 -march=barcelona -Os -fomit-frame-pointer`	20180829	20180818
14868333	`ref`	`gcc -funroll-loops -m32 -march=k8 -Os -fomit-frame-pointer`	20180829	20180818

Test failure

Implementation: crypto_sign/qtesla3f/ref
Compiler: gcc -funroll-loops -m32 -O2 -fomit-frame-pointer

error 111
crypto_sign_open does not handle c=t overlap

Number of similar (compiler,implementation) pairs: 81, namely:

Compiler	Implementations
gcc -funroll-loops -m32 -O2 -fomit-frame-pointer	ref
gcc -funroll-loops -m32 -O3 -fomit-frame-pointer	ref
gcc -funroll-loops -m32 -O -fomit-frame-pointer	ref
gcc -funroll-loops -m32 -march=athlon -O2 -fomit-frame-pointer	ref
gcc -funroll-loops -m32 -march=athlon -O3 -fomit-frame-pointer	ref
gcc -funroll-loops -m32 -march=athlon -O -fomit-frame-pointer	ref
gcc -funroll-loops -m32 -march=barcelona -O2 -fomit-frame-pointer	ref
gcc -funroll-loops -m32 -march=barcelona -O3 -fomit-frame-pointer	ref
gcc -funroll-loops -m32 -march=barcelona -O -fomit-frame-pointer	ref
gcc -funroll-loops -m32 -march=i486 -O2 -fomit-frame-pointer	ref
gcc -funroll-loops -m32 -march=i486 -O3 -fomit-frame-pointer	ref
gcc -funroll-loops -m32 -march=i486 -O -fomit-frame-pointer	ref
gcc -funroll-loops -m32 -march=k6-2 -O2 -fomit-frame-pointer	ref
gcc -funroll-loops -m32 -march=k6-2 -O3 -fomit-frame-pointer	ref
gcc -funroll-loops -m32 -march=k6-2 -O -fomit-frame-pointer	ref
gcc -funroll-loops -m32 -march=k6-3 -O2 -fomit-frame-pointer	ref
gcc -funroll-loops -m32 -march=k6-3 -O3 -fomit-frame-pointer	ref
gcc -funroll-loops -m32 -march=k6-3 -O -fomit-frame-pointer	ref
gcc -funroll-loops -m32 -march=k6 -O2 -fomit-frame-pointer	ref
gcc -funroll-loops -m32 -march=k6 -O3 -fomit-frame-pointer	ref
gcc -funroll-loops -m32 -march=k6 -O -fomit-frame-pointer	ref
gcc -funroll-loops -m32 -march=k8 -O2 -fomit-frame-pointer	ref
gcc -funroll-loops -m32 -march=k8 -O3 -fomit-frame-pointer	ref
gcc -funroll-loops -m32 -march=k8 -O -fomit-frame-pointer	ref
gcc -funroll-loops -m32 -march=pentium-mmx -O2 -fomit-frame-pointer	ref
gcc -funroll-loops -m32 -march=pentium-mmx -O3 -fomit-frame-pointer	ref
gcc -funroll-loops -m32 -march=pentium-mmx -O -fomit-frame-pointer	ref
gcc -funroll-loops -m32 -march=pentium -O2 -fomit-frame-pointer	ref
gcc -funroll-loops -m32 -march=pentium -O3 -fomit-frame-pointer	ref
gcc -funroll-loops -m32 -march=pentium -O -fomit-frame-pointer	ref
gcc -m32 -O2 -fomit-frame-pointer	ref
gcc -m32 -O3 -fomit-frame-pointer	ref
gcc -m32 -O -fomit-frame-pointer	ref
gcc -m32 -march=athlon -O2 -fomit-frame-pointer	ref
gcc -m32 -march=athlon -O3 -fomit-frame-pointer	ref
gcc -m32 -march=athlon -O -fomit-frame-pointer	ref
gcc -m32 -march=core-avx-i -O2 -fomit-frame-pointer	ref
gcc -m32 -march=core-avx-i -O3 -fomit-frame-pointer	ref
gcc -m32 -march=core-avx-i -O -fomit-frame-pointer	ref
gcc -m32 -march=core-avx2 -O2 -fomit-frame-pointer	ref
gcc -m32 -march=core-avx2 -O3 -fomit-frame-pointer	ref
gcc -m32 -march=core-avx2 -O -fomit-frame-pointer	ref
gcc -m32 -march=core2 -O2 -fomit-frame-pointer	ref
gcc -m32 -march=core2 -O3 -fomit-frame-pointer	ref
gcc -m32 -march=core2 -O -fomit-frame-pointer	ref
gcc -m32 -march=core2 -msse4.1 -O2 -fomit-frame-pointer	ref
gcc -m32 -march=core2 -msse4.1 -O3 -fomit-frame-pointer	ref
gcc -m32 -march=core2 -msse4.1 -O -fomit-frame-pointer	ref
gcc -m32 -march=core2 -msse4 -O2 -fomit-frame-pointer	ref
gcc -m32 -march=core2 -msse4 -O3 -fomit-frame-pointer	ref
gcc -m32 -march=core2 -msse4 -O -fomit-frame-pointer	ref
gcc -m32 -march=corei7-avx -O2 -fomit-frame-pointer	ref
gcc -m32 -march=corei7-avx -O3 -fomit-frame-pointer	ref
gcc -m32 -march=corei7-avx -O -fomit-frame-pointer	ref
gcc -m32 -march=corei7 -O2 -fomit-frame-pointer	ref
gcc -m32 -march=corei7 -O3 -fomit-frame-pointer	ref
gcc -m32 -march=corei7 -O -fomit-frame-pointer	ref
gcc -m32 -march=i486 -O2 -fomit-frame-pointer	ref
gcc -m32 -march=i486 -O3 -fomit-frame-pointer	ref
gcc -m32 -march=i486 -O -fomit-frame-pointer	ref
gcc -m32 -march=k6-2 -O2 -fomit-frame-pointer	ref
gcc -m32 -march=k6-2 -O3 -fomit-frame-pointer	ref
gcc -m32 -march=k6-2 -O -fomit-frame-pointer	ref
gcc -m32 -march=k6-3 -O2 -fomit-frame-pointer	ref
gcc -m32 -march=k6-3 -O3 -fomit-frame-pointer	ref
gcc -m32 -march=k6-3 -O -fomit-frame-pointer	ref
gcc -m32 -march=k6 -O2 -fomit-frame-pointer	ref
gcc -m32 -march=k6 -O3 -fomit-frame-pointer	ref
gcc -m32 -march=k6 -O -fomit-frame-pointer	ref
gcc -m32 -march=k8 -O2 -fomit-frame-pointer	ref
gcc -m32 -march=k8 -O3 -fomit-frame-pointer	ref
gcc -m32 -march=k8 -O -fomit-frame-pointer	ref
gcc -m32 -march=native -mtune=native -O2 -fomit-frame-pointer	ref
gcc -m32 -march=native -mtune=native -O3 -fomit-frame-pointer	ref
gcc -m32 -march=native -mtune=native -O -fomit-frame-pointer	ref
gcc -m32 -march=pentium-mmx -O2 -fomit-frame-pointer	ref
gcc -m32 -march=pentium-mmx -O3 -fomit-frame-pointer	ref
gcc -m32 -march=pentium-mmx -O -fomit-frame-pointer	ref
gcc -m32 -march=pentium -O2 -fomit-frame-pointer	ref
gcc -m32 -march=pentium -O3 -fomit-frame-pointer	ref
gcc -m32 -march=pentium -O -fomit-frame-pointer	ref

Test failure

Implementation: crypto_sign/qtesla3f/ref
Compiler: gcc -m32 -march=barcelona -O2 -fomit-frame-pointer

error 111
crypto_sign_open does not handle c=t overlap
error 111
crypto_sign_open does not handle c=t overlap

Number of similar (compiler,implementation) pairs: 3, namely:

Compiler	Implementations
gcc -m32 -march=barcelona -O2 -fomit-frame-pointer	ref
gcc -m32 -march=barcelona -O3 -fomit-frame-pointer	ref
gcc -m32 -march=barcelona -O -fomit-frame-pointer	ref