Implementation notes: x86, samba, crypto_sign/mqqsig192

Computer: samba
Architecture: x86
CPU ID: GenuineIntel-000506e3-bfebfbff
SUPERCOP version: 20190803
Operation: crypto_sign
Primitive: mqqsig192

Time	Implementation	Compiler	Benchmark date	SUPERCOP version
114930	`ref`	`gcc -m32 -march=core-avx2 -Os -fomit-frame-pointer`	20190806	20190803
115975	`ref`	`gcc -m32 -march=native -mtune=native -Os -fomit-frame-pointer`	20190806	20190803
118411	`ref`	`gcc -funroll-loops -m32 -march=prescott -O3 -fomit-frame-pointer`	20190806	20190803
118645	`ref`	`gcc -funroll-loops -m32 -march=nocona -O3 -fomit-frame-pointer`	20190806	20190803
118823	`ref`	`gcc -funroll-loops -m32 -march=pentium4 -O3 -fomit-frame-pointer`	20190806	20190803
118835	`ref`	`gcc -m32 -march=nocona -O3 -fomit-frame-pointer`	20190806	20190803
119198	`ref`	`gcc -m32 -march=prescott -O3 -fomit-frame-pointer`	20190806	20190803
119510	`ref`	`gcc -m32 -march=corei7-avx -Os -fomit-frame-pointer`	20190806	20190803
119518	`ref`	`gcc -m32 -march=pentium4 -O3 -fomit-frame-pointer`	20190806	20190803
119756	`ref`	`gcc -m32 -march=core-avx-i -Os -fomit-frame-pointer`	20190806	20190803
120298	`ref`	`gcc -funroll-loops -m32 -march=pentium-m -O3 -fomit-frame-pointer`	20190806	20190803
120901	`ref`	`gcc -m32 -march=core2 -msse4.1 -Os -fomit-frame-pointer`	20190806	20190803
121659	`ref`	`gcc -m32 -march=core2 -msse4 -Os -fomit-frame-pointer`	20190806	20190803
122298	`ref`	`gcc -m32 -march=corei7 -Os -fomit-frame-pointer`	20190806	20190803
122665	`ref`	`gcc -m32 -march=pentium-m -O3 -fomit-frame-pointer`	20190806	20190803
122849	`ref`	`gcc -m32 -march=core2 -Os -fomit-frame-pointer`	20190806	20190803
172524	`ref`	`gcc -funroll-loops -m32 -march=pentium2 -O3 -fomit-frame-pointer`	20190806	20190803
172643	`ref`	`gcc -funroll-loops -m32 -march=pentiumpro -O3 -fomit-frame-pointer`	20190806	20190803
182337	`ref`	`gcc -m32 -march=pentium2 -O3 -fomit-frame-pointer`	20190806	20190803
182430	`ref`	`gcc -m32 -march=pentiumpro -O3 -fomit-frame-pointer`	20190806	20190803
184478	`ref`	`gcc -m32 -march=i386 -O3 -fomit-frame-pointer`	20190806	20190803
201476	`ref`	`gcc -funroll-loops -m32 -march=prescott -O2 -fomit-frame-pointer`	20190806	20190803
201668	`ref`	`gcc -funroll-loops -m32 -march=nocona -O -fomit-frame-pointer`	20190806	20190803
201705	`ref`	`gcc -funroll-loops -m32 -march=prescott -O -fomit-frame-pointer`	20190806	20190803
203260	`ref`	`gcc -funroll-loops -m32 -march=nocona -O2 -fomit-frame-pointer`	20190806	20190803
204167	`ref`	`gcc -funroll-loops -m32 -march=pentium3 -O3 -fomit-frame-pointer`	20190806	20190803
204448	`ref`	`gcc -funroll-loops -m32 -march=pentium-m -O2 -fomit-frame-pointer`	20190806	20190803
204539	`ref`	`gcc -funroll-loops -m32 -march=pentium2 -O -fomit-frame-pointer`	20190806	20190803
204701	`ref`	`gcc -funroll-loops -m32 -march=pentium3 -O -fomit-frame-pointer`	20190806	20190803
204972	`ref`	`gcc -funroll-loops -m32 -march=pentium-m -O -fomit-frame-pointer`	20190806	20190803
205087	`ref`	`gcc -funroll-loops -m32 -march=pentiumpro -O -fomit-frame-pointer`	20190806	20190803
205520	`ref`	`gcc -funroll-loops -m32 -march=pentiumpro -O2 -fomit-frame-pointer`	20190806	20190803
206021	`ref`	`gcc -funroll-loops -m32 -march=i386 -O3 -fomit-frame-pointer`	20190806	20190803
206730	`ref`	`gcc -funroll-loops -m32 -march=pentium2 -O2 -fomit-frame-pointer`	20190806	20190803
206796	`ref`	`gcc -funroll-loops -m32 -march=pentium3 -O2 -fomit-frame-pointer`	20190806	20190803
214165	`ref`	`gcc -funroll-loops -m32 -march=i386 -O -fomit-frame-pointer`	20190806	20190803
215324	`ref`	`gcc -m32 -march=nocona -O2 -fomit-frame-pointer`	20190806	20190803
215548	`ref`	`gcc -m32 -march=prescott -O2 -fomit-frame-pointer`	20190806	20190803
216483	`ref`	`gcc -m32 -march=pentium4 -O2 -fomit-frame-pointer`	20190806	20190803
222244	`ref`	`gcc -m32 -march=pentium-m -O -fomit-frame-pointer`	20190806	20190803
222605	`ref`	`gcc -m32 -march=pentium4 -O -fomit-frame-pointer`	20190806	20190803
222788	`ref`	`gcc -m32 -march=pentium3 -O3 -fomit-frame-pointer`	20190806	20190803
223070	`ref`	`gcc -funroll-loops -m32 -march=pentium4 -O -fomit-frame-pointer`	20190806	20190803
223089	`ref`	`gcc -m32 -march=nocona -O -fomit-frame-pointer`	20190806	20190803
223764	`ref`	`gcc -m32 -march=prescott -O -fomit-frame-pointer`	20190806	20190803
224992	`ref`	`gcc -funroll-loops -m32 -march=pentium4 -O2 -fomit-frame-pointer`	20190806	20190803
229040	`ref`	`gcc -m32 -march=pentium3 -O2 -fomit-frame-pointer`	20190806	20190803
229540	`ref`	`gcc -m32 -march=pentium-m -O2 -fomit-frame-pointer`	20190806	20190803
229565	`ref`	`gcc -m32 -march=pentium2 -O2 -fomit-frame-pointer`	20190806	20190803
229791	`ref`	`gcc -m32 -march=pentiumpro -O2 -fomit-frame-pointer`	20190806	20190803
231121	`ref`	`gcc -m32 -march=pentium3 -O -fomit-frame-pointer`	20190806	20190803
231405	`ref`	`gcc -m32 -march=pentium2 -O -fomit-frame-pointer`	20190806	20190803
232615	`ref`	`gcc -m32 -march=pentiumpro -O -fomit-frame-pointer`	20190806	20190803
234719	`ref`	`gcc -m32 -march=i386 -O -fomit-frame-pointer`	20190806	20190803
238067	`ref`	`gcc -m32 -march=i386 -O2 -fomit-frame-pointer`	20190806	20190803
251968	`ref`	`gcc -funroll-loops -m32 -march=athlon -Os -fomit-frame-pointer`	20190806	20190803
252502	`ref`	`gcc -m32 -march=i486 -Os -fomit-frame-pointer`	20190806	20190803
252585	`ref`	`gcc -m32 -march=i386 -Os -fomit-frame-pointer`	20190806	20190803
253548	`ref`	`gcc -funroll-loops -m32 -Os -fomit-frame-pointer`	20190806	20190803
254319	`ref`	`gcc -funroll-loops -m32 -march=pentium-m -Os -fomit-frame-pointer`	20190806	20190803
254498	`ref`	`gcc -m32 -march=pentium-m -Os -fomit-frame-pointer`	20190806	20190803
254623	`ref`	`gcc -funroll-loops -m32 -march=i486 -Os -fomit-frame-pointer`	20190806	20190803
255300	`ref`	`gcc -m32 -march=pentium4 -Os -fomit-frame-pointer`	20190806	20190803
255705	`ref`	`gcc -funroll-loops -m32 -march=i386 -Os -fomit-frame-pointer`	20190806	20190803
256034	`ref`	`gcc -m32 -march=athlon -Os -fomit-frame-pointer`	20190806	20190803
256186	`ref`	`gcc -m32 -march=pentium-mmx -Os -fomit-frame-pointer`	20190806	20190803
256186	`ref`	`gcc -m32 -march=pentium -Os -fomit-frame-pointer`	20190806	20190803
256194	`ref`	`gcc -m32 -Os -fomit-frame-pointer`	20190806	20190803
256285	`ref`	`gcc -m32 -march=pentium2 -Os -fomit-frame-pointer`	20190806	20190803
256517	`ref`	`gcc -funroll-loops -m32 -march=pentium2 -Os -fomit-frame-pointer`	20190806	20190803
256573	`ref`	`gcc -funroll-loops -m32 -march=pentium3 -Os -fomit-frame-pointer`	20190806	20190803
256633	`ref`	`gcc -m32 -march=pentiumpro -Os -fomit-frame-pointer`	20190806	20190803
256933	`ref`	`gcc -funroll-loops -m32 -march=k6 -Os -fomit-frame-pointer`	20190806	20190803
256970	`ref`	`gcc -funroll-loops -m32 -march=pentiumpro -Os -fomit-frame-pointer`	20190806	20190803
257072	`ref`	`gcc -m32 -march=pentium3 -Os -fomit-frame-pointer`	20190806	20190803
257193	`ref`	`gcc -funroll-loops -m32 -march=k8 -Os -fomit-frame-pointer`	20190806	20190803
257538	`ref`	`gcc -funroll-loops -m32 -march=k6-2 -Os -fomit-frame-pointer`	20190806	20190803
259509	`ref`	`gcc -funroll-loops -m32 -march=k6-3 -Os -fomit-frame-pointer`	20190806	20190803
260296	`ref`	`gcc -m32 -march=k6-3 -Os -fomit-frame-pointer`	20190806	20190803
260469	`ref`	`gcc -funroll-loops -m32 -march=barcelona -Os -fomit-frame-pointer`	20190806	20190803
260696	`ref`	`gcc -m32 -march=k8 -Os -fomit-frame-pointer`	20190806	20190803
260873	`ref`	`gcc -m32 -march=barcelona -Os -fomit-frame-pointer`	20190806	20190803
261121	`ref`	`gcc -funroll-loops -m32 -march=pentium4 -Os -fomit-frame-pointer`	20190806	20190803
261246	`ref`	`gcc -funroll-loops -m32 -march=prescott -Os -fomit-frame-pointer`	20190806	20190803
262668	`ref`	`gcc -m32 -march=k6 -Os -fomit-frame-pointer`	20190806	20190803
264299	`ref`	`gcc -funroll-loops -m32 -march=nocona -Os -fomit-frame-pointer`	20190806	20190803
265504	`ref`	`gcc -funroll-loops -m32 -march=i386 -O2 -fomit-frame-pointer`	20190806	20190803
265625	`ref`	`gcc -m32 -march=k6-2 -Os -fomit-frame-pointer`	20190806	20190803
271434	`ref`	`gcc -m32 -march=prescott -Os -fomit-frame-pointer`	20190806	20190803
272278	`ref`	`gcc -funroll-loops -m32 -march=pentium -Os -fomit-frame-pointer`	20190806	20190803
274394	`ref`	`gcc -m32 -march=nocona -Os -fomit-frame-pointer`	20190806	20190803
275936	`ref`	`gcc -funroll-loops -m32 -march=pentium-mmx -Os -fomit-frame-pointer`	20190806	20190803

Test failure

Implementation: crypto_sign/mqqsig192/ref
Compiler: gcc -funroll-loops -m32 -O2 -fomit-frame-pointer

error 111
crypto_sign_open does not handle c=t overlap

Number of similar (compiler,implementation) pairs: 81, namely:

Compiler	Implementations
gcc -funroll-loops -m32 -O2 -fomit-frame-pointer	ref
gcc -funroll-loops -m32 -O3 -fomit-frame-pointer	ref
gcc -funroll-loops -m32 -O -fomit-frame-pointer	ref
gcc -funroll-loops -m32 -march=athlon -O2 -fomit-frame-pointer	ref
gcc -funroll-loops -m32 -march=athlon -O3 -fomit-frame-pointer	ref
gcc -funroll-loops -m32 -march=athlon -O -fomit-frame-pointer	ref
gcc -funroll-loops -m32 -march=barcelona -O2 -fomit-frame-pointer	ref
gcc -funroll-loops -m32 -march=barcelona -O3 -fomit-frame-pointer	ref
gcc -funroll-loops -m32 -march=barcelona -O -fomit-frame-pointer	ref
gcc -funroll-loops -m32 -march=i486 -O2 -fomit-frame-pointer	ref
gcc -funroll-loops -m32 -march=i486 -O3 -fomit-frame-pointer	ref
gcc -funroll-loops -m32 -march=i486 -O -fomit-frame-pointer	ref
gcc -funroll-loops -m32 -march=k6-2 -O2 -fomit-frame-pointer	ref
gcc -funroll-loops -m32 -march=k6-2 -O3 -fomit-frame-pointer	ref
gcc -funroll-loops -m32 -march=k6-2 -O -fomit-frame-pointer	ref
gcc -funroll-loops -m32 -march=k6-3 -O2 -fomit-frame-pointer	ref
gcc -funroll-loops -m32 -march=k6-3 -O3 -fomit-frame-pointer	ref
gcc -funroll-loops -m32 -march=k6-3 -O -fomit-frame-pointer	ref
gcc -funroll-loops -m32 -march=k6 -O2 -fomit-frame-pointer	ref
gcc -funroll-loops -m32 -march=k6 -O3 -fomit-frame-pointer	ref
gcc -funroll-loops -m32 -march=k6 -O -fomit-frame-pointer	ref
gcc -funroll-loops -m32 -march=k8 -O2 -fomit-frame-pointer	ref
gcc -funroll-loops -m32 -march=k8 -O3 -fomit-frame-pointer	ref
gcc -funroll-loops -m32 -march=k8 -O -fomit-frame-pointer	ref
gcc -funroll-loops -m32 -march=pentium-mmx -O2 -fomit-frame-pointer	ref
gcc -funroll-loops -m32 -march=pentium-mmx -O3 -fomit-frame-pointer	ref
gcc -funroll-loops -m32 -march=pentium-mmx -O -fomit-frame-pointer	ref
gcc -funroll-loops -m32 -march=pentium -O2 -fomit-frame-pointer	ref
gcc -funroll-loops -m32 -march=pentium -O3 -fomit-frame-pointer	ref
gcc -funroll-loops -m32 -march=pentium -O -fomit-frame-pointer	ref
gcc -m32 -O2 -fomit-frame-pointer	ref
gcc -m32 -O3 -fomit-frame-pointer	ref
gcc -m32 -O -fomit-frame-pointer	ref
gcc -m32 -march=athlon -O2 -fomit-frame-pointer	ref
gcc -m32 -march=athlon -O3 -fomit-frame-pointer	ref
gcc -m32 -march=athlon -O -fomit-frame-pointer	ref
gcc -m32 -march=core-avx-i -O2 -fomit-frame-pointer	ref
gcc -m32 -march=core-avx-i -O3 -fomit-frame-pointer	ref
gcc -m32 -march=core-avx-i -O -fomit-frame-pointer	ref
gcc -m32 -march=core-avx2 -O2 -fomit-frame-pointer	ref
gcc -m32 -march=core-avx2 -O3 -fomit-frame-pointer	ref
gcc -m32 -march=core-avx2 -O -fomit-frame-pointer	ref
gcc -m32 -march=core2 -O2 -fomit-frame-pointer	ref
gcc -m32 -march=core2 -O3 -fomit-frame-pointer	ref
gcc -m32 -march=core2 -O -fomit-frame-pointer	ref
gcc -m32 -march=core2 -msse4.1 -O2 -fomit-frame-pointer	ref
gcc -m32 -march=core2 -msse4.1 -O3 -fomit-frame-pointer	ref
gcc -m32 -march=core2 -msse4.1 -O -fomit-frame-pointer	ref
gcc -m32 -march=core2 -msse4 -O2 -fomit-frame-pointer	ref
gcc -m32 -march=core2 -msse4 -O3 -fomit-frame-pointer	ref
gcc -m32 -march=core2 -msse4 -O -fomit-frame-pointer	ref
gcc -m32 -march=corei7-avx -O2 -fomit-frame-pointer	ref
gcc -m32 -march=corei7-avx -O3 -fomit-frame-pointer	ref
gcc -m32 -march=corei7-avx -O -fomit-frame-pointer	ref
gcc -m32 -march=corei7 -O2 -fomit-frame-pointer	ref
gcc -m32 -march=corei7 -O3 -fomit-frame-pointer	ref
gcc -m32 -march=corei7 -O -fomit-frame-pointer	ref
gcc -m32 -march=i486 -O2 -fomit-frame-pointer	ref
gcc -m32 -march=i486 -O3 -fomit-frame-pointer	ref
gcc -m32 -march=i486 -O -fomit-frame-pointer	ref
gcc -m32 -march=k6-2 -O2 -fomit-frame-pointer	ref
gcc -m32 -march=k6-2 -O3 -fomit-frame-pointer	ref
gcc -m32 -march=k6-2 -O -fomit-frame-pointer	ref
gcc -m32 -march=k6-3 -O2 -fomit-frame-pointer	ref
gcc -m32 -march=k6-3 -O3 -fomit-frame-pointer	ref
gcc -m32 -march=k6-3 -O -fomit-frame-pointer	ref
gcc -m32 -march=k6 -O2 -fomit-frame-pointer	ref
gcc -m32 -march=k6 -O3 -fomit-frame-pointer	ref
gcc -m32 -march=k6 -O -fomit-frame-pointer	ref
gcc -m32 -march=k8 -O2 -fomit-frame-pointer	ref
gcc -m32 -march=k8 -O3 -fomit-frame-pointer	ref
gcc -m32 -march=k8 -O -fomit-frame-pointer	ref
gcc -m32 -march=native -mtune=native -O2 -fomit-frame-pointer	ref
gcc -m32 -march=native -mtune=native -O3 -fomit-frame-pointer	ref
gcc -m32 -march=native -mtune=native -O -fomit-frame-pointer	ref
gcc -m32 -march=pentium-mmx -O2 -fomit-frame-pointer	ref
gcc -m32 -march=pentium-mmx -O3 -fomit-frame-pointer	ref
gcc -m32 -march=pentium-mmx -O -fomit-frame-pointer	ref
gcc -m32 -march=pentium -O2 -fomit-frame-pointer	ref
gcc -m32 -march=pentium -O3 -fomit-frame-pointer	ref
gcc -m32 -march=pentium -O -fomit-frame-pointer	ref

Test failure

Implementation: crypto_sign/mqqsig192/ref
Compiler: gcc -m32 -march=barcelona -O2 -fomit-frame-pointer

error 111
crypto_sign_open does not handle c=t overlap
error 111
crypto_sign_open does not handle c=t overlap

Number of similar (compiler,implementation) pairs: 3, namely:

Compiler	Implementations
gcc -m32 -march=barcelona -O2 -fomit-frame-pointer	ref
gcc -m32 -march=barcelona -O3 -fomit-frame-pointer	ref
gcc -m32 -march=barcelona -O -fomit-frame-pointer	ref