Implementation notes: x86, titan0, crypto_sign/mqqsig160

Computer: titan0
Architecture: x86
CPU ID: GenuineIntel-000306c3-bfebfbff
SUPERCOP version: 20190803
Operation: crypto_sign
Primitive: mqqsig160

Time	Implementation	Compiler	Benchmark date	SUPERCOP version
95416	`ref`	`gcc -m32 -march=core-avx2 -O2 -fomit-frame-pointer`	20190807	20190803
95548	`ref`	`gcc -m32 -march=native -mtune=native -O2 -fomit-frame-pointer`	20190807	20190803
96740	`ref`	`gcc -m32 -march=core-avx2 -O3 -fomit-frame-pointer`	20190807	20190803
99968	`ref`	`gcc -m32 -march=corei7 -O -fomit-frame-pointer`	20190807	20190803
100016	`ref`	`gcc -m32 -march=core2 -O -fomit-frame-pointer`	20190807	20190803
101592	`ref`	`gcc -m32 -march=core-avx-i -O2 -fomit-frame-pointer`	20190807	20190803
101788	`ref`	`gcc -m32 -march=corei7-avx -O3 -fomit-frame-pointer`	20190807	20190803
101804	`ref`	`gcc -m32 -march=core-avx-i -O3 -fomit-frame-pointer`	20190807	20190803
101940	`ref`	`gcc -m32 -march=core2 -O3 -fomit-frame-pointer`	20190807	20190803
102048	`ref`	`gcc -m32 -march=corei7 -O2 -fomit-frame-pointer`	20190807	20190803
102144	`ref`	`gcc -m32 -march=core2 -msse4 -O3 -fomit-frame-pointer`	20190807	20190803
102216	`ref`	`gcc -m32 -march=core2 -msse4.1 -O3 -fomit-frame-pointer`	20190807	20190803
102820	`ref`	`gcc -m32 -march=core2 -msse4 -O2 -fomit-frame-pointer`	20190807	20190803
103072	`ref`	`gcc -m32 -march=core2 -O2 -fomit-frame-pointer`	20190807	20190803
103444	`ref`	`gcc -m32 -march=corei7 -O3 -fomit-frame-pointer`	20190807	20190803
103728	`ref`	`gcc -m32 -march=corei7-avx -O2 -fomit-frame-pointer`	20190807	20190803
103736	`ref`	`gcc -m32 -march=corei7-avx -O -fomit-frame-pointer`	20190807	20190803
104948	`ref`	`gcc -m32 -march=core2 -msse4.1 -O2 -fomit-frame-pointer`	20190807	20190803
106516	`ref`	`gcc -m32 -march=core-avx-i -O -fomit-frame-pointer`	20190807	20190803
108608	`ref`	`gcc -m32 -march=core-avx2 -Os -fomit-frame-pointer`	20190807	20190803
109124	`ref`	`gcc -m32 -march=native -mtune=native -Os -fomit-frame-pointer`	20190807	20190803
111932	`ref`	`gcc -m32 -march=core-avx-i -Os -fomit-frame-pointer`	20190807	20190803
112076	`ref`	`gcc -m32 -march=core2 -Os -fomit-frame-pointer`	20190807	20190803
112140	`ref`	`gcc -m32 -march=corei7-avx -Os -fomit-frame-pointer`	20190807	20190803
115668	`ref`	`gcc -m32 -march=core2 -msse4.1 -Os -fomit-frame-pointer`	20190807	20190803
116732	`ref`	`gcc -m32 -march=corei7 -Os -fomit-frame-pointer`	20190807	20190803
118408	`ref`	`gcc -m32 -march=core2 -msse4 -Os -fomit-frame-pointer`	20190807	20190803
128720	`ref`	`gcc -m32 -march=native -mtune=native -O3 -fomit-frame-pointer`	20190807	20190803
163596	`ref`	`gcc -m32 -march=pentium4 -O3 -fomit-frame-pointer`	20190807	20190803
164432	`ref`	`gcc -m32 -march=athlon -O3 -fomit-frame-pointer`	20190807	20190803
164624	`ref`	`gcc -m32 -O3 -fomit-frame-pointer`	20190807	20190803
164672	`ref`	`gcc -m32 -march=core-avx2 -O -fomit-frame-pointer`	20190807	20190803
165016	`ref`	`gcc -m32 -march=nocona -O3 -fomit-frame-pointer`	20190807	20190803
165264	`ref`	`gcc -m32 -march=prescott -O3 -fomit-frame-pointer`	20190807	20190803
165744	`ref`	`gcc -funroll-loops -m32 -march=nocona -O2 -fomit-frame-pointer`	20190807	20190803
165760	`ref`	`gcc -funroll-loops -m32 -march=nocona -O3 -fomit-frame-pointer`	20190807	20190803
165776	`ref`	`gcc -funroll-loops -m32 -march=prescott -O3 -fomit-frame-pointer`	20190807	20190803
165944	`ref`	`gcc -funroll-loops -m32 -march=athlon -O2 -fomit-frame-pointer`	20190807	20190803
166012	`ref`	`gcc -funroll-loops -m32 -march=prescott -O2 -fomit-frame-pointer`	20190807	20190803
166028	`ref`	`gcc -funroll-loops -m32 -march=athlon -O3 -fomit-frame-pointer`	20190807	20190803
166188	`ref`	`gcc -funroll-loops -m32 -march=pentium4 -O2 -fomit-frame-pointer`	20190807	20190803
166216	`ref`	`gcc -m32 -march=native -mtune=native -O -fomit-frame-pointer`	20190807	20190803
166228	`ref`	`gcc -funroll-loops -m32 -march=pentium4 -O -fomit-frame-pointer`	20190807	20190803
166252	`ref`	`gcc -m32 -march=core2 -msse4.1 -O -fomit-frame-pointer`	20190807	20190803
166368	`ref`	`gcc -funroll-loops -m32 -march=nocona -O -fomit-frame-pointer`	20190807	20190803
166768	`ref`	`gcc -funroll-loops -m32 -O2 -fomit-frame-pointer`	20190807	20190803
166944	`ref`	`gcc -funroll-loops -m32 -O -fomit-frame-pointer`	20190807	20190803
166972	`ref`	`gcc -funroll-loops -m32 -march=prescott -O -fomit-frame-pointer`	20190807	20190803
167520	`ref`	`gcc -funroll-loops -m32 -march=athlon -O -fomit-frame-pointer`	20190807	20190803
167864	`ref`	`gcc -funroll-loops -m32 -march=pentium4 -O3 -fomit-frame-pointer`	20190807	20190803
167928	`ref`	`gcc -funroll-loops -m32 -O3 -fomit-frame-pointer`	20190807	20190803
168388	`ref`	`gcc -m32 -march=core2 -msse4 -O -fomit-frame-pointer`	20190807	20190803
169984	`ref`	`gcc -funroll-loops -m32 -march=pentiumpro -O3 -fomit-frame-pointer`	20190807	20190803
170016	`ref`	`gcc -funroll-loops -m32 -march=pentium-m -O3 -fomit-frame-pointer`	20190807	20190803
170276	`ref`	`gcc -funroll-loops -m32 -march=pentium3 -O3 -fomit-frame-pointer`	20190807	20190803
170320	`ref`	`gcc -m32 -march=pentium3 -O3 -fomit-frame-pointer`	20190807	20190803
170416	`ref`	`gcc -m32 -march=pentiumpro -O3 -fomit-frame-pointer`	20190807	20190803
170528	`ref`	`gcc -funroll-loops -m32 -march=pentium2 -O3 -fomit-frame-pointer`	20190807	20190803
170688	`ref`	`gcc -m32 -march=pentium2 -O3 -fomit-frame-pointer`	20190807	20190803
171044	`ref`	`gcc -funroll-loops -m32 -march=pentiumpro -O2 -fomit-frame-pointer`	20190807	20190803
171092	`ref`	`gcc -funroll-loops -m32 -march=pentium3 -O2 -fomit-frame-pointer`	20190807	20190803
171772	`ref`	`gcc -m32 -march=pentium-m -O3 -fomit-frame-pointer`	20190807	20190803
171788	`ref`	`gcc -funroll-loops -m32 -march=pentium2 -O2 -fomit-frame-pointer`	20190807	20190803
171892	`ref`	`gcc -funroll-loops -m32 -march=pentium-m -O -fomit-frame-pointer`	20190807	20190803
172120	`ref`	`gcc -funroll-loops -m32 -march=pentium-m -O2 -fomit-frame-pointer`	20190807	20190803
172372	`ref`	`gcc -funroll-loops -m32 -march=pentium3 -O -fomit-frame-pointer`	20190807	20190803
172372	`ref`	`gcc -funroll-loops -m32 -march=pentiumpro -O -fomit-frame-pointer`	20190807	20190803
172492	`ref`	`gcc -funroll-loops -m32 -march=pentium2 -O -fomit-frame-pointer`	20190807	20190803
185336	`ref`	`gcc -funroll-loops -m32 -march=i386 -O -fomit-frame-pointer`	20190807	20190803
193232	`ref`	`gcc -funroll-loops -m32 -march=k6 -O -fomit-frame-pointer`	20190807	20190803
193412	`ref`	`gcc -funroll-loops -m32 -march=k6-3 -O3 -fomit-frame-pointer`	20190807	20190803
193548	`ref`	`gcc -funroll-loops -m32 -march=k6 -O3 -fomit-frame-pointer`	20190807	20190803
193972	`ref`	`gcc -funroll-loops -m32 -march=k6-3 -O2 -fomit-frame-pointer`	20190807	20190803
194016	`ref`	`gcc -funroll-loops -m32 -march=k6 -O2 -fomit-frame-pointer`	20190807	20190803
194308	`ref`	`gcc -funroll-loops -m32 -march=k6-2 -O2 -fomit-frame-pointer`	20190807	20190803
194340	`ref`	`gcc -funroll-loops -m32 -march=pentium -O -fomit-frame-pointer`	20190807	20190803
194356	`ref`	`gcc -funroll-loops -m32 -march=k6-3 -O -fomit-frame-pointer`	20190807	20190803
194800	`ref`	`gcc -funroll-loops -m32 -march=pentium-mmx -O -fomit-frame-pointer`	20190807	20190803
194936	`ref`	`gcc -funroll-loops -m32 -march=k6-2 -O3 -fomit-frame-pointer`	20190807	20190803
195364	`ref`	`gcc -funroll-loops -m32 -march=k6-2 -O -fomit-frame-pointer`	20190807	20190803
196232	`ref`	`gcc -funroll-loops -m32 -march=i386 -O2 -fomit-frame-pointer`	20190807	20190803
197064	`ref`	`gcc -funroll-loops -m32 -march=i386 -O3 -fomit-frame-pointer`	20190807	20190803
211612	`ref`	`gcc -m32 -march=k6-3 -O3 -fomit-frame-pointer`	20190807	20190803
211616	`ref`	`gcc -m32 -march=k6-2 -O3 -fomit-frame-pointer`	20190807	20190803
211664	`ref`	`gcc -m32 -march=k6 -O3 -fomit-frame-pointer`	20190807	20190803
212040	`ref`	`gcc -m32 -march=i386 -O3 -fomit-frame-pointer`	20190807	20190803
214100	`ref`	`gcc -m32 -march=pentium -O3 -fomit-frame-pointer`	20190807	20190803
214136	`ref`	`gcc -m32 -march=pentium-mmx -O3 -fomit-frame-pointer`	20190807	20190803
216760	`ref`	`gcc -m32 -O2 -fomit-frame-pointer`	20190807	20190803
224188	`ref`	`gcc -m32 -march=pentium-m -O2 -fomit-frame-pointer`	20190807	20190803
226024	`ref`	`gcc -m32 -march=pentium4 -O2 -fomit-frame-pointer`	20190807	20190803
229376	`ref`	`gcc -funroll-loops -m32 -march=pentium-mmx -O3 -fomit-frame-pointer`	20190807	20190803
229692	`ref`	`gcc -funroll-loops -m32 -march=pentium-mmx -O2 -fomit-frame-pointer`	20190807	20190803
231032	`ref`	`gcc -funroll-loops -m32 -march=pentium -O2 -fomit-frame-pointer`	20190807	20190803
231424	`ref`	`gcc -funroll-loops -m32 -march=pentium -O3 -fomit-frame-pointer`	20190807	20190803
231712	`ref`	`gcc -m32 -march=athlon -O2 -fomit-frame-pointer`	20190807	20190803
235272	`ref`	`gcc -m32 -march=nocona -O2 -fomit-frame-pointer`	20190807	20190803
235300	`ref`	`gcc -m32 -march=pentiumpro -O -fomit-frame-pointer`	20190807	20190803
235852	`ref`	`gcc -m32 -march=prescott -O2 -fomit-frame-pointer`	20190807	20190803
236136	`ref`	`gcc -m32 -march=prescott -O -fomit-frame-pointer`	20190807	20190803
236492	`ref`	`gcc -m32 -march=athlon -O -fomit-frame-pointer`	20190807	20190803
236648	`ref`	`gcc -m32 -march=i386 -O2 -fomit-frame-pointer`	20190807	20190803
236728	`ref`	`gcc -m32 -march=pentium3 -O -fomit-frame-pointer`	20190807	20190803
237052	`ref`	`gcc -m32 -O -fomit-frame-pointer`	20190807	20190803
238244	`ref`	`gcc -m32 -march=pentium-m -O -fomit-frame-pointer`	20190807	20190803
239460	`ref`	`gcc -m32 -march=k6-3 -O2 -fomit-frame-pointer`	20190807	20190803
239536	`ref`	`gcc -m32 -march=pentium4 -O -fomit-frame-pointer`	20190807	20190803
240076	`ref`	`gcc -m32 -march=k6-2 -O2 -fomit-frame-pointer`	20190807	20190803
240432	`ref`	`gcc -m32 -march=pentium-mmx -O2 -fomit-frame-pointer`	20190807	20190803
242216	`ref`	`gcc -m32 -march=pentium3 -O2 -fomit-frame-pointer`	20190807	20190803
243588	`ref`	`gcc -m32 -march=k6 -O2 -fomit-frame-pointer`	20190807	20190803
244192	`ref`	`gcc -m32 -march=k6-3 -O -fomit-frame-pointer`	20190807	20190803
244196	`ref`	`gcc -m32 -march=k6 -O -fomit-frame-pointer`	20190807	20190803
244500	`ref`	`gcc -m32 -march=pentium2 -O2 -fomit-frame-pointer`	20190807	20190803
244664	`ref`	`gcc -m32 -march=pentiumpro -O2 -fomit-frame-pointer`	20190807	20190803
245160	`ref`	`gcc -m32 -march=i386 -O -fomit-frame-pointer`	20190807	20190803
245496	`ref`	`gcc -m32 -march=k6-2 -O -fomit-frame-pointer`	20190807	20190803
246492	`ref`	`gcc -m32 -march=pentium-mmx -O -fomit-frame-pointer`	20190807	20190803
263132	`ref`	`gcc -funroll-loops -m32 -march=nocona -Os -fomit-frame-pointer`	20190807	20190803
263276	`ref`	`gcc -m32 -march=barcelona -Os -fomit-frame-pointer`	20190807	20190803
263572	`ref`	`gcc -funroll-loops -m32 -march=pentium4 -Os -fomit-frame-pointer`	20190807	20190803
264260	`ref`	`gcc -funroll-loops -m32 -march=pentium-m -Os -fomit-frame-pointer`	20190807	20190803
264364	`ref`	`gcc -m32 -march=i386 -Os -fomit-frame-pointer`	20190807	20190803
264600	`ref`	`gcc -funroll-loops -m32 -march=prescott -Os -fomit-frame-pointer`	20190807	20190803
264736	`ref`	`gcc -funroll-loops -m32 -march=k8 -Os -fomit-frame-pointer`	20190807	20190803
264828	`ref`	`gcc -m32 -march=k6-2 -Os -fomit-frame-pointer`	20190807	20190803
265092	`ref`	`gcc -m32 -march=k6 -Os -fomit-frame-pointer`	20190807	20190803
265536	`ref`	`gcc -m32 -march=i486 -Os -fomit-frame-pointer`	20190807	20190803
265840	`ref`	`gcc -funroll-loops -m32 -march=pentium2 -Os -fomit-frame-pointer`	20190807	20190803
265948	`ref`	`gcc -m32 -march=k8 -Os -fomit-frame-pointer`	20190807	20190803
266344	`ref`	`gcc -funroll-loops -m32 -march=pentiumpro -Os -fomit-frame-pointer`	20190807	20190803
266588	`ref`	`gcc -funroll-loops -m32 -march=pentium-mmx -Os -fomit-frame-pointer`	20190807	20190803
266812	`ref`	`gcc -m32 -march=k6-3 -Os -fomit-frame-pointer`	20190807	20190803
266976	`ref`	`gcc -funroll-loops -m32 -march=pentium3 -Os -fomit-frame-pointer`	20190807	20190803
267008	`ref`	`gcc -funroll-loops -m32 -march=k6-3 -Os -fomit-frame-pointer`	20190807	20190803
267216	`ref`	`gcc -funroll-loops -m32 -march=pentium -Os -fomit-frame-pointer`	20190807	20190803
267612	`ref`	`gcc -funroll-loops -m32 -march=k6-2 -Os -fomit-frame-pointer`	20190807	20190803
269280	`ref`	`gcc -m32 -march=pentium2 -Os -fomit-frame-pointer`	20190807	20190803
269484	`ref`	`gcc -m32 -march=pentiumpro -Os -fomit-frame-pointer`	20190807	20190803
269820	`ref`	`gcc -m32 -march=pentium3 -Os -fomit-frame-pointer`	20190807	20190803
270160	`ref`	`gcc -m32 -march=pentium4 -Os -fomit-frame-pointer`	20190807	20190803
270268	`ref`	`gcc -funroll-loops -m32 -Os -fomit-frame-pointer`	20190807	20190803
271224	`ref`	`gcc -funroll-loops -m32 -march=k6 -Os -fomit-frame-pointer`	20190807	20190803
272168	`ref`	`gcc -funroll-loops -m32 -march=athlon -Os -fomit-frame-pointer`	20190807	20190803
272972	`ref`	`gcc -funroll-loops -m32 -march=i486 -Os -fomit-frame-pointer`	20190807	20190803
273140	`ref`	`gcc -m32 -march=athlon -Os -fomit-frame-pointer`	20190807	20190803
273184	`ref`	`gcc -funroll-loops -m32 -march=i386 -Os -fomit-frame-pointer`	20190807	20190803
274164	`ref`	`gcc -m32 -Os -fomit-frame-pointer`	20190807	20190803
274236	`ref`	`gcc -funroll-loops -m32 -march=barcelona -Os -fomit-frame-pointer`	20190807	20190803
274408	`ref`	`gcc -m32 -march=pentium-m -Os -fomit-frame-pointer`	20190807	20190803
277396	`ref`	`gcc -m32 -march=pentium -Os -fomit-frame-pointer`	20190807	20190803
285712	`ref`	`gcc -m32 -march=pentium-mmx -Os -fomit-frame-pointer`	20190807	20190803
304688	`ref`	`gcc -m32 -march=prescott -Os -fomit-frame-pointer`	20190807	20190803
306504	`ref`	`gcc -m32 -march=nocona -Os -fomit-frame-pointer`	20190807	20190803
342368	`ref`	`gcc -m32 -march=pentium -O2 -fomit-frame-pointer`	20190807	20190803
342604	`ref`	`gcc -m32 -march=nocona -O -fomit-frame-pointer`	20190807	20190803
348076	`ref`	`gcc -m32 -march=pentium2 -O -fomit-frame-pointer`	20190807	20190803
356712	`ref`	`gcc -m32 -march=pentium -O -fomit-frame-pointer`	20190807	20190803

Test failure

Implementation: crypto_sign/mqqsig160/ref
Compiler: gcc -funroll-loops -m32 -march=barcelona -O2 -fomit-frame-pointer

error 111
crypto_sign_open does not handle c=t overlap

Number of similar (compiler,implementation) pairs: 15, namely:

Compiler	Implementations
gcc -funroll-loops -m32 -march=barcelona -O2 -fomit-frame-pointer	ref
gcc -funroll-loops -m32 -march=barcelona -O3 -fomit-frame-pointer	ref
gcc -funroll-loops -m32 -march=barcelona -O -fomit-frame-pointer	ref
gcc -funroll-loops -m32 -march=i486 -O2 -fomit-frame-pointer	ref
gcc -funroll-loops -m32 -march=i486 -O3 -fomit-frame-pointer	ref
gcc -funroll-loops -m32 -march=i486 -O -fomit-frame-pointer	ref
gcc -funroll-loops -m32 -march=k8 -O2 -fomit-frame-pointer	ref
gcc -funroll-loops -m32 -march=k8 -O3 -fomit-frame-pointer	ref
gcc -funroll-loops -m32 -march=k8 -O -fomit-frame-pointer	ref
gcc -m32 -march=i486 -O2 -fomit-frame-pointer	ref
gcc -m32 -march=i486 -O3 -fomit-frame-pointer	ref
gcc -m32 -march=i486 -O -fomit-frame-pointer	ref
gcc -m32 -march=k8 -O2 -fomit-frame-pointer	ref
gcc -m32 -march=k8 -O3 -fomit-frame-pointer	ref
gcc -m32 -march=k8 -O -fomit-frame-pointer	ref

Test failure

Implementation: crypto_sign/mqqsig160/ref
Compiler: gcc -m32 -march=barcelona -O2 -fomit-frame-pointer

error 111
crypto_sign_open does not handle c=t overlap
error 111
crypto_sign_open does not handle c=t overlap

Number of similar (compiler,implementation) pairs: 3, namely:

Compiler	Implementations
gcc -m32 -march=barcelona -O2 -fomit-frame-pointer	ref
gcc -m32 -march=barcelona -O3 -fomit-frame-pointer	ref
gcc -m32 -march=barcelona -O -fomit-frame-pointer	ref