Implementation notes: x86, rumba5, crypto_sign/mqqsig160

Computer: rumba5
Architecture: x86
CPU ID: AuthenticAMD-00800f11-178bfbff
SUPERCOP version: 20181216
Operation: crypto_sign
Primitive: mqqsig160

Time	Implementation	Compiler	Benchmark date	SUPERCOP version
149120	`ref`	`gcc -m32 -march=corei7 -O3 -fomit-frame-pointer`	20180529	20171218
149440	`ref`	`gcc -m32 -march=core-avx2 -O3 -fomit-frame-pointer`	20180529	20171218
149472	`ref`	`gcc -m32 -march=core2 -msse4.1 -O3 -fomit-frame-pointer`	20180529	20171218
149600	`ref`	`gcc -m32 -march=corei7 -O -fomit-frame-pointer`	20180529	20171218
150496	`ref`	`gcc -m32 -march=core-avx2 -O2 -fomit-frame-pointer`	20180529	20171218
151040	`ref`	`gcc -m32 -march=corei7 -O2 -fomit-frame-pointer`	20180529	20171218
151072	`ref`	`gcc -m32 -march=core2 -msse4 -O3 -fomit-frame-pointer`	20180529	20171218
151136	`ref`	`gcc -m32 -march=core-avx-i -O2 -fomit-frame-pointer`	20180529	20171218
155136	`ref`	`gcc -m32 -march=core-avx2 -O -fomit-frame-pointer`	20180529	20171218
155968	`ref`	`gcc -m32 -march=core2 -O3 -fomit-frame-pointer`	20180529	20171218
155968	`ref`	`gcc -m32 -march=corei7-avx -O2 -fomit-frame-pointer`	20180529	20171218
156032	`ref`	`gcc -m32 -march=core2 -O2 -fomit-frame-pointer`	20180529	20171218
156128	`ref`	`gcc -m32 -march=core2 -O -fomit-frame-pointer`	20180529	20171218
156192	`ref`	`gcc -m32 -march=core2 -msse4.1 -O2 -fomit-frame-pointer`	20180529	20171218
156320	`ref`	`gcc -m32 -march=core2 -msse4 -O2 -fomit-frame-pointer`	20180529	20171218
157984	`ref`	`gcc -m32 -march=corei7-avx -O -fomit-frame-pointer`	20180529	20171218
158080	`ref`	`gcc -m32 -march=core-avx-i -O -fomit-frame-pointer`	20180529	20171218
158176	`ref`	`gcc -m32 -march=core-avx-i -O3 -fomit-frame-pointer`	20180529	20171218
158720	`ref`	`gcc -m32 -march=core2 -msse4.1 -O -fomit-frame-pointer`	20180529	20171218
159008	`ref`	`gcc -m32 -march=core2 -msse4 -O -fomit-frame-pointer`	20180529	20171218
163328	`ref`	`gcc -m32 -march=corei7-avx -O3 -fomit-frame-pointer`	20180529	20171218
175328	`ref`	`gcc -m32 -march=corei7 -Os -fomit-frame-pointer`	20180529	20171218
176288	`ref`	`gcc -m32 -march=core-avx2 -Os -fomit-frame-pointer`	20180529	20171218
177248	`ref`	`gcc -m32 -march=core2 -msse4.1 -Os -fomit-frame-pointer`	20180529	20171218
177280	`ref`	`gcc -m32 -march=core2 -msse4 -Os -fomit-frame-pointer`	20180529	20171218
177376	`ref`	`gcc -m32 -march=corei7-avx -Os -fomit-frame-pointer`	20180529	20171218
177440	`ref`	`gcc -m32 -march=core-avx-i -Os -fomit-frame-pointer`	20180529	20171218
177856	`ref`	`gcc -m32 -march=native -mtune=native -Os -fomit-frame-pointer`	20180529	20171218
178176	`ref`	`gcc -m32 -march=core2 -Os -fomit-frame-pointer`	20180529	20171218
203712	`ref`	`gcc -m32 -march=nocona -O3 -fomit-frame-pointer`	20180529	20171218
204384	`ref`	`gcc -m32 -march=prescott -O3 -fomit-frame-pointer`	20180529	20171218
204736	`ref`	`gcc -m32 -march=athlon -O3 -fomit-frame-pointer`	20180529	20171218
205728	`ref`	`gcc -m32 -march=pentium4 -O3 -fomit-frame-pointer`	20180529	20171218
206496	`ref`	`gcc -m32 -O3 -fomit-frame-pointer`	20180529	20171218
216352	`ref`	`gcc -m32 -march=pentiumpro -O3 -fomit-frame-pointer`	20180529	20171218
216448	`ref`	`gcc -m32 -march=pentium2 -O3 -fomit-frame-pointer`	20180529	20171218
216512	`ref`	`gcc -m32 -march=pentium-m -O3 -fomit-frame-pointer`	20180529	20171218
216736	`ref`	`gcc -m32 -march=pentium3 -O3 -fomit-frame-pointer`	20180529	20171218
218208	`ref`	`gcc -funroll-loops -m32 -march=athlon -O2 -fomit-frame-pointer`	20180529	20171218
219328	`ref`	`gcc -funroll-loops -m32 -O2 -fomit-frame-pointer`	20180529	20171218
219488	`ref`	`gcc -funroll-loops -m32 -march=athlon -O3 -fomit-frame-pointer`	20180529	20171218
219488	`ref`	`gcc -funroll-loops -m32 -march=nocona -O2 -fomit-frame-pointer`	20180529	20171218
219680	`ref`	`gcc -funroll-loops -m32 -O3 -fomit-frame-pointer`	20180529	20171218
219744	`ref`	`gcc -funroll-loops -m32 -march=prescott -O2 -fomit-frame-pointer`	20180529	20171218
219776	`ref`	`gcc -funroll-loops -m32 -march=nocona -O3 -fomit-frame-pointer`	20180529	20171218
219840	`ref`	`gcc -funroll-loops -m32 -march=prescott -O3 -fomit-frame-pointer`	20180529	20171218
220160	`ref`	`gcc -funroll-loops -m32 -O -fomit-frame-pointer`	20180529	20171218
220160	`ref`	`gcc -funroll-loops -m32 -march=athlon -O -fomit-frame-pointer`	20180529	20171218
220320	`ref`	`gcc -funroll-loops -m32 -march=nocona -O -fomit-frame-pointer`	20180529	20171218
220512	`ref`	`gcc -funroll-loops -m32 -march=prescott -O -fomit-frame-pointer`	20180529	20171218
220832	`ref`	`gcc -funroll-loops -m32 -march=pentium4 -O -fomit-frame-pointer`	20180529	20171218
220928	`ref`	`gcc -funroll-loops -m32 -march=k6-2 -O2 -fomit-frame-pointer`	20180529	20171218
220960	`ref`	`gcc -funroll-loops -m32 -march=k6-3 -O2 -fomit-frame-pointer`	20180529	20171218
221376	`ref`	`gcc -funroll-loops -m32 -march=k6-3 -O3 -fomit-frame-pointer`	20180529	20171218
221472	`ref`	`gcc -funroll-loops -m32 -march=k6-2 -O3 -fomit-frame-pointer`	20180529	20171218
221600	`ref`	`gcc -funroll-loops -m32 -march=k6 -O3 -fomit-frame-pointer`	20180529	20171218
223136	`ref`	`gcc -funroll-loops -m32 -march=k6-2 -O -fomit-frame-pointer`	20180529	20171218
223232	`ref`	`gcc -funroll-loops -m32 -march=k6-3 -O -fomit-frame-pointer`	20180529	20171218
223328	`ref`	`gcc -funroll-loops -m32 -march=pentium-m -O -fomit-frame-pointer`	20180529	20171218
223776	`ref`	`gcc -funroll-loops -m32 -march=k6 -O -fomit-frame-pointer`	20180529	20171218
223776	`ref`	`gcc -funroll-loops -m32 -march=pentiumpro -O -fomit-frame-pointer`	20180529	20171218
223840	`ref`	`gcc -funroll-loops -m32 -march=pentium2 -O -fomit-frame-pointer`	20180529	20171218
224544	`ref`	`gcc -funroll-loops -m32 -march=pentium3 -O -fomit-frame-pointer`	20180529	20171218
224640	`ref`	`gcc -funroll-loops -m32 -march=pentium4 -O2 -fomit-frame-pointer`	20180529	20171218
225184	`ref`	`gcc -funroll-loops -m32 -march=pentium4 -O3 -fomit-frame-pointer`	20180529	20171218
226400	`ref`	`gcc -funroll-loops -m32 -march=k6 -O2 -fomit-frame-pointer`	20180529	20171218
228384	`ref`	`gcc -funroll-loops -m32 -march=i386 -O -fomit-frame-pointer`	20180529	20171218
228640	`ref`	`gcc -funroll-loops -m32 -march=pentium-mmx -O -fomit-frame-pointer`	20180529	20171218
228640	`ref`	`gcc -funroll-loops -m32 -march=pentium -O -fomit-frame-pointer`	20180529	20171218
228864	`ref`	`gcc -funroll-loops -m32 -march=pentium2 -O3 -fomit-frame-pointer`	20180529	20171218
228928	`ref`	`gcc -funroll-loops -m32 -march=pentium-m -O3 -fomit-frame-pointer`	20180529	20171218
228992	`ref`	`gcc -funroll-loops -m32 -march=pentiumpro -O3 -fomit-frame-pointer`	20180529	20171218
229344	`ref`	`gcc -funroll-loops -m32 -march=pentium3 -O2 -fomit-frame-pointer`	20180529	20171218
229376	`ref`	`gcc -funroll-loops -m32 -march=pentiumpro -O2 -fomit-frame-pointer`	20180529	20171218
229568	`ref`	`gcc -funroll-loops -m32 -march=pentium3 -O3 -fomit-frame-pointer`	20180529	20171218
229600	`ref`	`gcc -funroll-loops -m32 -march=pentium2 -O2 -fomit-frame-pointer`	20180529	20171218
229856	`ref`	`gcc -funroll-loops -m32 -march=pentium-m -O2 -fomit-frame-pointer`	20180529	20171218
231840	`ref`	`gcc -m32 -march=i386 -O3 -fomit-frame-pointer`	20180529	20171218
231968	`ref`	`gcc -m32 -march=k6 -O3 -fomit-frame-pointer`	20180529	20171218
233056	`ref`	`gcc -m32 -march=k6-3 -O3 -fomit-frame-pointer`	20180529	20171218
233216	`ref`	`gcc -m32 -march=k6-2 -O3 -fomit-frame-pointer`	20180529	20171218
234112	`ref`	`gcc -funroll-loops -m32 -march=i386 -O2 -fomit-frame-pointer`	20180529	20171218
234144	`ref`	`gcc -m32 -march=pentium -O3 -fomit-frame-pointer`	20180529	20171218
234208	`ref`	`gcc -m32 -march=pentium-mmx -O3 -fomit-frame-pointer`	20180529	20171218
235296	`ref`	`gcc -funroll-loops -m32 -march=pentium-mmx -O3 -fomit-frame-pointer`	20180529	20171218
235296	`ref`	`gcc -funroll-loops -m32 -march=pentium -O3 -fomit-frame-pointer`	20180529	20171218
235616	`ref`	`gcc -funroll-loops -m32 -march=i386 -O3 -fomit-frame-pointer`	20180529	20171218
235616	`ref`	`gcc -funroll-loops -m32 -march=pentium-mmx -O2 -fomit-frame-pointer`	20180529	20171218
245504	`ref`	`gcc -funroll-loops -m32 -march=pentium -O2 -fomit-frame-pointer`	20180529	20171218
296064	`ref`	`gcc -m32 -march=pentium4 -O2 -fomit-frame-pointer`	20180529	20171218
298432	`ref`	`gcc -m32 -march=nocona -O2 -fomit-frame-pointer`	20180529	20171218
298688	`ref`	`gcc -m32 -march=prescott -O2 -fomit-frame-pointer`	20180529	20171218
299840	`ref`	`gcc -m32 -march=athlon -O2 -fomit-frame-pointer`	20180529	20171218
299968	`ref`	`gcc -m32 -O2 -fomit-frame-pointer`	20180529	20171218
302528	`ref`	`gcc -m32 -march=pentium-m -O2 -fomit-frame-pointer`	20180529	20171218
305184	`ref`	`gcc -m32 -march=pentium2 -O2 -fomit-frame-pointer`	20180529	20171218
305472	`ref`	`gcc -m32 -march=pentiumpro -O2 -fomit-frame-pointer`	20180529	20171218
305920	`ref`	`gcc -m32 -march=athlon -O -fomit-frame-pointer`	20180529	20171218
308800	`ref`	`gcc -m32 -march=pentium3 -O2 -fomit-frame-pointer`	20180529	20171218
310784	`ref`	`gcc -m32 -march=pentium-mmx -O2 -fomit-frame-pointer`	20180529	20171218
310912	`ref`	`gcc -m32 -march=pentium -O2 -fomit-frame-pointer`	20180529	20171218
311840	`ref`	`gcc -m32 -march=prescott -O -fomit-frame-pointer`	20180529	20171218
311904	`ref`	`gcc -m32 -march=pentiumpro -O -fomit-frame-pointer`	20180529	20171218
312128	`ref`	`gcc -m32 -march=nocona -O -fomit-frame-pointer`	20180529	20171218
314720	`ref`	`gcc -m32 -march=i386 -O2 -fomit-frame-pointer`	20180529	20171218
316480	`ref`	`gcc -m32 -march=pentium2 -O -fomit-frame-pointer`	20180529	20171218
323104	`ref`	`gcc -m32 -march=pentium-m -Os -fomit-frame-pointer`	20180529	20171218
324544	`ref`	`gcc -m32 -march=i386 -O -fomit-frame-pointer`	20180529	20171218
324576	`ref`	`gcc -funroll-loops -m32 -march=pentium3 -Os -fomit-frame-pointer`	20180529	20171218
326592	`ref`	`gcc -funroll-loops -m32 -march=k6-2 -Os -fomit-frame-pointer`	20180529	20171218
327104	`ref`	`gcc -funroll-loops -m32 -march=k6-3 -Os -fomit-frame-pointer`	20180529	20171218
327328	`ref`	`gcc -m32 -O -fomit-frame-pointer`	20180529	20171218
327360	`ref`	`gcc -funroll-loops -m32 -march=k6 -Os -fomit-frame-pointer`	20180529	20171218
327552	`ref`	`gcc -m32 -march=pentium-m -O -fomit-frame-pointer`	20180529	20171218
333728	`ref`	`gcc -m32 -march=k6 -O2 -fomit-frame-pointer`	20180529	20171218
334496	`ref`	`gcc -m32 -march=k6-2 -O2 -fomit-frame-pointer`	20180529	20171218
334624	`ref`	`gcc -m32 -march=k6-3 -O2 -fomit-frame-pointer`	20180529	20171218
336256	`ref`	`gcc -m32 -march=pentiumpro -Os -fomit-frame-pointer`	20180529	20171218
336288	`ref`	`gcc -m32 -march=pentium2 -Os -fomit-frame-pointer`	20180529	20171218
336896	`ref`	`gcc -m32 -march=pentium-mmx -O -fomit-frame-pointer`	20180529	20171218
337536	`ref`	`gcc -m32 -march=pentium -O -fomit-frame-pointer`	20180529	20171218
357888	`ref`	`gcc -funroll-loops -m32 -march=i486 -Os -fomit-frame-pointer`	20180529	20171218
361120	`ref`	`gcc -m32 -march=i386 -Os -fomit-frame-pointer`	20180529	20171218
361504	`ref`	`gcc -m32 -march=pentium4 -Os -fomit-frame-pointer`	20180529	20171218
363232	`ref`	`gcc -funroll-loops -m32 -march=i386 -Os -fomit-frame-pointer`	20180529	20171218
363680	`ref`	`gcc -m32 -march=barcelona -Os -fomit-frame-pointer`	20180529	20171218
364032	`ref`	`gcc -m32 -march=pentium -Os -fomit-frame-pointer`	20180529	20171218
364512	`ref`	`gcc -m32 -march=pentium-mmx -Os -fomit-frame-pointer`	20180529	20171218
364672	`ref`	`gcc -m32 -march=k8 -Os -fomit-frame-pointer`	20180529	20171218
366336	`ref`	`gcc -m32 -march=nocona -Os -fomit-frame-pointer`	20180529	20171218
366464	`ref`	`gcc -m32 -march=prescott -Os -fomit-frame-pointer`	20180529	20171218
366496	`ref`	`gcc -funroll-loops -m32 -march=prescott -Os -fomit-frame-pointer`	20180529	20171218
366688	`ref`	`gcc -funroll-loops -m32 -march=pentium4 -Os -fomit-frame-pointer`	20180529	20171218
367104	`ref`	`gcc -funroll-loops -m32 -march=nocona -Os -fomit-frame-pointer`	20180529	20171218
370176	`ref`	`gcc -m32 -Os -fomit-frame-pointer`	20180529	20171218
370496	`ref`	`gcc -m32 -march=i486 -Os -fomit-frame-pointer`	20180529	20171218
371456	`ref`	`gcc -m32 -march=athlon -Os -fomit-frame-pointer`	20180529	20171218
374016	`ref`	`gcc -m32 -march=k6 -Os -fomit-frame-pointer`	20180529	20171218
374112	`ref`	`gcc -m32 -march=k6-3 -Os -fomit-frame-pointer`	20180529	20171218
374400	`ref`	`gcc -m32 -march=k6-2 -Os -fomit-frame-pointer`	20180529	20171218
375904	`ref`	`gcc -funroll-loops -m32 -march=pentium-mmx -Os -fomit-frame-pointer`	20180529	20171218
378240	`ref`	`gcc -funroll-loops -m32 -march=pentium -Os -fomit-frame-pointer`	20180529	20171218
378304	`ref`	`gcc -m32 -march=pentium3 -O -fomit-frame-pointer`	20180529	20171218
388256	`ref`	`gcc -m32 -march=k6 -O -fomit-frame-pointer`	20180529	20171218
388448	`ref`	`gcc -m32 -march=k6-2 -O -fomit-frame-pointer`	20180529	20171218
388640	`ref`	`gcc -m32 -march=k6-3 -O -fomit-frame-pointer`	20180529	20171218
389280	`ref`	`gcc -funroll-loops -m32 -march=pentium-m -Os -fomit-frame-pointer`	20180529	20171218
394240	`ref`	`gcc -m32 -march=pentium4 -O -fomit-frame-pointer`	20180529	20171218
421184	`ref`	`gcc -funroll-loops -m32 -Os -fomit-frame-pointer`	20180529	20171218
421344	`ref`	`gcc -funroll-loops -m32 -march=athlon -Os -fomit-frame-pointer`	20180529	20171218
424832	`ref`	`gcc -m32 -march=pentium3 -Os -fomit-frame-pointer`	20180529	20171218
425824	`ref`	`gcc -funroll-loops -m32 -march=barcelona -Os -fomit-frame-pointer`	20180529	20171218
426368	`ref`	`gcc -funroll-loops -m32 -march=k8 -Os -fomit-frame-pointer`	20180529	20171218
433472	`ref`	`gcc -funroll-loops -m32 -march=pentiumpro -Os -fomit-frame-pointer`	20180529	20171218
434336	`ref`	`gcc -funroll-loops -m32 -march=pentium2 -Os -fomit-frame-pointer`	20180529	20171218

Test failure

Implementation: crypto_sign/mqqsig160/ref
Compiler: gcc -funroll-loops -m32 -march=barcelona -O2 -fomit-frame-pointer

error 111
crypto_sign_open does not handle c=t overlap

Number of similar (compiler,implementation) pairs: 18, namely:

Compiler	Implementations
gcc -funroll-loops -m32 -march=barcelona -O2 -fomit-frame-pointer	ref
gcc -funroll-loops -m32 -march=barcelona -O3 -fomit-frame-pointer	ref
gcc -funroll-loops -m32 -march=barcelona -O -fomit-frame-pointer	ref
gcc -funroll-loops -m32 -march=i486 -O2 -fomit-frame-pointer	ref
gcc -funroll-loops -m32 -march=i486 -O3 -fomit-frame-pointer	ref
gcc -funroll-loops -m32 -march=i486 -O -fomit-frame-pointer	ref
gcc -funroll-loops -m32 -march=k8 -O2 -fomit-frame-pointer	ref
gcc -funroll-loops -m32 -march=k8 -O3 -fomit-frame-pointer	ref
gcc -funroll-loops -m32 -march=k8 -O -fomit-frame-pointer	ref
gcc -m32 -march=i486 -O2 -fomit-frame-pointer	ref
gcc -m32 -march=i486 -O3 -fomit-frame-pointer	ref
gcc -m32 -march=i486 -O -fomit-frame-pointer	ref
gcc -m32 -march=k8 -O2 -fomit-frame-pointer	ref
gcc -m32 -march=k8 -O3 -fomit-frame-pointer	ref
gcc -m32 -march=k8 -O -fomit-frame-pointer	ref
gcc -m32 -march=native -mtune=native -O2 -fomit-frame-pointer	ref
gcc -m32 -march=native -mtune=native -O3 -fomit-frame-pointer	ref
gcc -m32 -march=native -mtune=native -O -fomit-frame-pointer	ref

Test failure

Implementation: crypto_sign/mqqsig160/ref
Compiler: gcc -m32 -march=barcelona -O2 -fomit-frame-pointer

error 111
crypto_sign_open does not handle c=t overlap
error 111
crypto_sign_open does not handle c=t overlap

Number of similar (compiler,implementation) pairs: 3, namely:

Compiler	Implementations
gcc -m32 -march=barcelona -O2 -fomit-frame-pointer	ref
gcc -m32 -march=barcelona -O3 -fomit-frame-pointer	ref
gcc -m32 -march=barcelona -O -fomit-frame-pointer	ref