Implementation notes: x86, bolero, crypto_sign/qtesla1p

Computer: bolero
Architecture: x86
CPU ID: GenuineIntel-000406f1-bfebfbff
SUPERCOP version: 20190110
Operation: crypto_sign
Primitive: qtesla1p

Time	Implementation	Compiler	Benchmark date	SUPERCOP version
5923508	`ref`	`gcc -m32 -march=nocona -O3 -fomit-frame-pointer`	20180831	20180818
5937368	`ref`	`gcc -m32 -march=prescott -O3 -fomit-frame-pointer`	20180831	20180818
6016348	`ref`	`gcc -m32 -march=pentium4 -O3 -fomit-frame-pointer`	20180831	20180818
6101856	`ref`	`gcc -funroll-loops -m32 -march=nocona -O3 -fomit-frame-pointer`	20180831	20180818
6107496	`ref`	`gcc -funroll-loops -m32 -march=prescott -O3 -fomit-frame-pointer`	20180831	20180818
6173452	`ref`	`gcc -funroll-loops -m32 -march=pentium4 -O3 -fomit-frame-pointer`	20180831	20180818
6293668	`ref`	`gcc -funroll-loops -m32 -march=pentium-m -O3 -fomit-frame-pointer`	20180831	20180818
6381388	`ref`	`gcc -m32 -march=pentium-m -O3 -fomit-frame-pointer`	20180831	20180818
6773188	`ref`	`gcc -funroll-loops -m32 -march=nocona -O2 -fomit-frame-pointer`	20180831	20180818
6799308	`ref`	`gcc -funroll-loops -m32 -march=pentium3 -O -fomit-frame-pointer`	20180831	20180818
6803224	`ref`	`gcc -funroll-loops -m32 -march=pentium2 -O -fomit-frame-pointer`	20180831	20180818
6876120	`ref`	`gcc -funroll-loops -m32 -march=prescott -O -fomit-frame-pointer`	20180831	20180818
6921092	`ref`	`gcc -funroll-loops -m32 -march=pentium-m -O -fomit-frame-pointer`	20180831	20180818
6945844	`ref`	`gcc -funroll-loops -m32 -march=pentiumpro -O -fomit-frame-pointer`	20180831	20180818
6949412	`ref`	`gcc -funroll-loops -m32 -march=prescott -O2 -fomit-frame-pointer`	20180831	20180818
6969988	`ref`	`gcc -funroll-loops -m32 -march=pentium4 -O -fomit-frame-pointer`	20180831	20180818
7019228	`ref`	`gcc -m32 -march=pentium3 -O -fomit-frame-pointer`	20180831	20180818
7057856	`ref`	`gcc -m32 -march=pentium2 -O -fomit-frame-pointer`	20180831	20180818
7065252	`ref`	`gcc -m32 -march=prescott -O -fomit-frame-pointer`	20180831	20180818
7069796	`ref`	`gcc -funroll-loops -m32 -march=pentium4 -O2 -fomit-frame-pointer`	20180831	20180818
7073288	`ref`	`gcc -funroll-loops -m32 -march=nocona -O -fomit-frame-pointer`	20180831	20180818
7098936	`ref`	`gcc -m32 -march=pentium2 -O3 -fomit-frame-pointer`	20180831	20180818
7113148	`ref`	`gcc -m32 -march=pentiumpro -O -fomit-frame-pointer`	20180831	20180818
7128128	`ref`	`gcc -m32 -march=native -mtune=native -Os -fomit-frame-pointer`	20180831	20180818
7128708	`ref`	`gcc -funroll-loops -m32 -march=i386 -Os -fomit-frame-pointer`	20180831	20180818
7141152	`ref`	`gcc -m32 -march=pentium4 -Os -fomit-frame-pointer`	20180831	20180818
7141720	`ref`	`gcc -m32 -march=prescott -Os -fomit-frame-pointer`	20180831	20180818
7155672	`ref`	`gcc -m32 -march=i386 -Os -fomit-frame-pointer`	20180831	20180818
7160840	`ref`	`gcc -m32 -march=pentium3 -O3 -fomit-frame-pointer`	20180831	20180818
7170728	`ref`	`gcc -m32 -march=k8 -Os -fomit-frame-pointer`	20180831	20180818
7171752	`ref`	`gcc -funroll-loops -m32 -march=prescott -Os -fomit-frame-pointer`	20180831	20180818
7172100	`ref`	`gcc -m32 -march=barcelona -Os -fomit-frame-pointer`	20180831	20180818
7182844	`ref`	`gcc -m32 -march=pentium-m -O -fomit-frame-pointer`	20180831	20180818
7188900	`ref`	`gcc -m32 -march=pentiumpro -O3 -fomit-frame-pointer`	20180831	20180818
7190060	`ref`	`gcc -funroll-loops -m32 -march=pentium3 -O3 -fomit-frame-pointer`	20180831	20180818
7191584	`ref`	`gcc -m32 -march=nocona -O -fomit-frame-pointer`	20180831	20180818
7195664	`ref`	`gcc -funroll-loops -m32 -march=pentium4 -Os -fomit-frame-pointer`	20180831	20180818
7200328	`ref`	`gcc -m32 -march=prescott -O2 -fomit-frame-pointer`	20180831	20180818
7226104	`ref`	`gcc -funroll-loops -m32 -march=barcelona -Os -fomit-frame-pointer`	20180831	20180818
7234812	`ref`	`gcc -funroll-loops -m32 -march=pentium-m -O2 -fomit-frame-pointer`	20180831	20180818
7242136	`ref`	`gcc -m32 -march=pentium4 -O -fomit-frame-pointer`	20180831	20180818
7251716	`ref`	`gcc -funroll-loops -m32 -march=pentiumpro -O2 -fomit-frame-pointer`	20180831	20180818
7257512	`ref`	`gcc -funroll-loops -m32 -march=pentium2 -O3 -fomit-frame-pointer`	20180831	20180818
7260972	`ref`	`gcc -m32 -march=pentiumpro -Os -fomit-frame-pointer`	20180831	20180818
7263148	`ref`	`gcc -m32 -march=pentium2 -Os -fomit-frame-pointer`	20180831	20180818
7275416	`ref`	`gcc -m32 -march=pentium3 -Os -fomit-frame-pointer`	20180831	20180818
7275952	`ref`	`gcc -funroll-loops -m32 -march=pentium-m -Os -fomit-frame-pointer`	20180831	20180818
7278400	`ref`	`gcc -funroll-loops -m32 -march=pentium3 -Os -fomit-frame-pointer`	20180831	20180818
7285136	`ref`	`gcc -m32 -march=pentium-m -Os -fomit-frame-pointer`	20180831	20180818
7287440	`ref`	`gcc -m32 -march=nocona -O2 -fomit-frame-pointer`	20180831	20180818
7294192	`ref`	`gcc -funroll-loops -m32 -march=pentiumpro -O3 -fomit-frame-pointer`	20180831	20180818
7294396	`ref`	`gcc -m32 -march=nocona -Os -fomit-frame-pointer`	20180831	20180818
7295776	`ref`	`gcc -m32 -march=athlon -Os -fomit-frame-pointer`	20180831	20180818
7303940	`ref`	`gcc -funroll-loops -m32 -march=i486 -Os -fomit-frame-pointer`	20180831	20180818
7304004	`ref`	`gcc -m32 -march=pentium3 -O2 -fomit-frame-pointer`	20180831	20180818
7317560	`ref`	`gcc -m32 -march=pentium-m -O2 -fomit-frame-pointer`	20180831	20180818
7327912	`ref`	`gcc -funroll-loops -m32 -march=k8 -Os -fomit-frame-pointer`	20180831	20180818
7336552	`ref`	`gcc -m32 -march=pentium-mmx -Os -fomit-frame-pointer`	20180831	20180818
7337072	`ref`	`gcc -funroll-loops -m32 -march=pentium2 -O2 -fomit-frame-pointer`	20180831	20180818
7337972	`ref`	`gcc -funroll-loops -m32 -march=pentium2 -Os -fomit-frame-pointer`	20180831	20180818
7340676	`ref`	`gcc -funroll-loops -m32 -march=pentium3 -O2 -fomit-frame-pointer`	20180831	20180818
7341348	`ref`	`gcc -funroll-loops -m32 -march=pentiumpro -Os -fomit-frame-pointer`	20180831	20180818
7342956	`ref`	`gcc -m32 -march=core-avx2 -Os -fomit-frame-pointer`	20180831	20180818
7345784	`ref`	`gcc -m32 -march=core2 -msse4.1 -Os -fomit-frame-pointer`	20180831	20180818
7346232	`ref`	`gcc -m32 -march=core2 -Os -fomit-frame-pointer`	20180831	20180818
7347196	`ref`	`gcc -funroll-loops -m32 -march=k6-3 -Os -fomit-frame-pointer`	20180831	20180818
7356860	`ref`	`gcc -m32 -march=corei7-avx -Os -fomit-frame-pointer`	20180831	20180818
7369104	`ref`	`gcc -m32 -march=pentium4 -O2 -fomit-frame-pointer`	20180831	20180818
7372876	`ref`	`gcc -funroll-loops -m32 -Os -fomit-frame-pointer`	20180831	20180818
7375696	`ref`	`gcc -funroll-loops -m32 -march=pentium -Os -fomit-frame-pointer`	20180831	20180818
7379156	`ref`	`gcc -funroll-loops -m32 -march=nocona -Os -fomit-frame-pointer`	20180831	20180818
7419356	`ref`	`gcc -m32 -march=core-avx-i -Os -fomit-frame-pointer`	20180831	20180818
7420324	`ref`	`gcc -m32 -march=corei7 -Os -fomit-frame-pointer`	20180831	20180818
7421264	`ref`	`gcc -m32 -march=core2 -msse4 -Os -fomit-frame-pointer`	20180831	20180818
7425296	`ref`	`gcc -funroll-loops -m32 -march=pentium-mmx -Os -fomit-frame-pointer`	20180831	20180818
7426560	`ref`	`gcc -m32 -Os -fomit-frame-pointer`	20180831	20180818
7433060	`ref`	`gcc -m32 -march=i486 -Os -fomit-frame-pointer`	20180831	20180818
7441340	`ref`	`gcc -m32 -march=k6-3 -Os -fomit-frame-pointer`	20180831	20180818
7457948	`ref`	`gcc -m32 -march=pentiumpro -O2 -fomit-frame-pointer`	20180831	20180818
7473768	`ref`	`gcc -m32 -march=pentium2 -O2 -fomit-frame-pointer`	20180831	20180818
7511100	`ref`	`gcc -funroll-loops -m32 -march=k6 -Os -fomit-frame-pointer`	20180831	20180818
7527620	`ref`	`gcc -m32 -march=k6 -Os -fomit-frame-pointer`	20180831	20180818
7571532	`ref`	`gcc -funroll-loops -m32 -march=athlon -Os -fomit-frame-pointer`	20180831	20180818
7598408	`ref`	`gcc -funroll-loops -m32 -march=k6-2 -Os -fomit-frame-pointer`	20180831	20180818
7637912	`ref`	`gcc -m32 -march=pentium -Os -fomit-frame-pointer`	20180831	20180818
7675584	`ref`	`gcc -m32 -march=k6-2 -Os -fomit-frame-pointer`	20180831	20180818
7778432	`ref`	`gcc -funroll-loops -m32 -march=i386 -O -fomit-frame-pointer`	20180831	20180818
7789136	`ref`	`gcc -funroll-loops -m32 -march=i386 -O3 -fomit-frame-pointer`	20180831	20180818
7811012	`ref`	`gcc -funroll-loops -m32 -march=i386 -O2 -fomit-frame-pointer`	20180831	20180818
7895128	`ref`	`gcc -m32 -march=i386 -O3 -fomit-frame-pointer`	20180831	20180818
7956932	`ref`	`gcc -m32 -march=i386 -O -fomit-frame-pointer`	20180831	20180818
8368544	`ref`	`gcc -m32 -march=i386 -O2 -fomit-frame-pointer`	20180831	20180818

Test failure

Implementation: crypto_sign/qtesla1p/ref
Compiler: gcc -funroll-loops -m32 -O2 -fomit-frame-pointer

error 111
crypto_sign_open does not handle c=t overlap

Number of similar (compiler,implementation) pairs: 81, namely:

Compiler	Implementations
gcc -funroll-loops -m32 -O2 -fomit-frame-pointer	ref
gcc -funroll-loops -m32 -O3 -fomit-frame-pointer	ref
gcc -funroll-loops -m32 -O -fomit-frame-pointer	ref
gcc -funroll-loops -m32 -march=athlon -O2 -fomit-frame-pointer	ref
gcc -funroll-loops -m32 -march=athlon -O3 -fomit-frame-pointer	ref
gcc -funroll-loops -m32 -march=athlon -O -fomit-frame-pointer	ref
gcc -funroll-loops -m32 -march=barcelona -O2 -fomit-frame-pointer	ref
gcc -funroll-loops -m32 -march=barcelona -O3 -fomit-frame-pointer	ref
gcc -funroll-loops -m32 -march=barcelona -O -fomit-frame-pointer	ref
gcc -funroll-loops -m32 -march=i486 -O2 -fomit-frame-pointer	ref
gcc -funroll-loops -m32 -march=i486 -O3 -fomit-frame-pointer	ref
gcc -funroll-loops -m32 -march=i486 -O -fomit-frame-pointer	ref
gcc -funroll-loops -m32 -march=k6-2 -O2 -fomit-frame-pointer	ref
gcc -funroll-loops -m32 -march=k6-2 -O3 -fomit-frame-pointer	ref
gcc -funroll-loops -m32 -march=k6-2 -O -fomit-frame-pointer	ref
gcc -funroll-loops -m32 -march=k6-3 -O2 -fomit-frame-pointer	ref
gcc -funroll-loops -m32 -march=k6-3 -O3 -fomit-frame-pointer	ref
gcc -funroll-loops -m32 -march=k6-3 -O -fomit-frame-pointer	ref
gcc -funroll-loops -m32 -march=k6 -O2 -fomit-frame-pointer	ref
gcc -funroll-loops -m32 -march=k6 -O3 -fomit-frame-pointer	ref
gcc -funroll-loops -m32 -march=k6 -O -fomit-frame-pointer	ref
gcc -funroll-loops -m32 -march=k8 -O2 -fomit-frame-pointer	ref
gcc -funroll-loops -m32 -march=k8 -O3 -fomit-frame-pointer	ref
gcc -funroll-loops -m32 -march=k8 -O -fomit-frame-pointer	ref
gcc -funroll-loops -m32 -march=pentium-mmx -O2 -fomit-frame-pointer	ref
gcc -funroll-loops -m32 -march=pentium-mmx -O3 -fomit-frame-pointer	ref
gcc -funroll-loops -m32 -march=pentium-mmx -O -fomit-frame-pointer	ref
gcc -funroll-loops -m32 -march=pentium -O2 -fomit-frame-pointer	ref
gcc -funroll-loops -m32 -march=pentium -O3 -fomit-frame-pointer	ref
gcc -funroll-loops -m32 -march=pentium -O -fomit-frame-pointer	ref
gcc -m32 -O2 -fomit-frame-pointer	ref
gcc -m32 -O3 -fomit-frame-pointer	ref
gcc -m32 -O -fomit-frame-pointer	ref
gcc -m32 -march=athlon -O2 -fomit-frame-pointer	ref
gcc -m32 -march=athlon -O3 -fomit-frame-pointer	ref
gcc -m32 -march=athlon -O -fomit-frame-pointer	ref
gcc -m32 -march=core-avx-i -O2 -fomit-frame-pointer	ref
gcc -m32 -march=core-avx-i -O3 -fomit-frame-pointer	ref
gcc -m32 -march=core-avx-i -O -fomit-frame-pointer	ref
gcc -m32 -march=core-avx2 -O2 -fomit-frame-pointer	ref
gcc -m32 -march=core-avx2 -O3 -fomit-frame-pointer	ref
gcc -m32 -march=core-avx2 -O -fomit-frame-pointer	ref
gcc -m32 -march=core2 -O2 -fomit-frame-pointer	ref
gcc -m32 -march=core2 -O3 -fomit-frame-pointer	ref
gcc -m32 -march=core2 -O -fomit-frame-pointer	ref
gcc -m32 -march=core2 -msse4.1 -O2 -fomit-frame-pointer	ref
gcc -m32 -march=core2 -msse4.1 -O3 -fomit-frame-pointer	ref
gcc -m32 -march=core2 -msse4.1 -O -fomit-frame-pointer	ref
gcc -m32 -march=core2 -msse4 -O2 -fomit-frame-pointer	ref
gcc -m32 -march=core2 -msse4 -O3 -fomit-frame-pointer	ref
gcc -m32 -march=core2 -msse4 -O -fomit-frame-pointer	ref
gcc -m32 -march=corei7-avx -O2 -fomit-frame-pointer	ref
gcc -m32 -march=corei7-avx -O3 -fomit-frame-pointer	ref
gcc -m32 -march=corei7-avx -O -fomit-frame-pointer	ref
gcc -m32 -march=corei7 -O2 -fomit-frame-pointer	ref
gcc -m32 -march=corei7 -O3 -fomit-frame-pointer	ref
gcc -m32 -march=corei7 -O -fomit-frame-pointer	ref
gcc -m32 -march=i486 -O2 -fomit-frame-pointer	ref
gcc -m32 -march=i486 -O3 -fomit-frame-pointer	ref
gcc -m32 -march=i486 -O -fomit-frame-pointer	ref
gcc -m32 -march=k6-2 -O2 -fomit-frame-pointer	ref
gcc -m32 -march=k6-2 -O3 -fomit-frame-pointer	ref
gcc -m32 -march=k6-2 -O -fomit-frame-pointer	ref
gcc -m32 -march=k6-3 -O2 -fomit-frame-pointer	ref
gcc -m32 -march=k6-3 -O3 -fomit-frame-pointer	ref
gcc -m32 -march=k6-3 -O -fomit-frame-pointer	ref
gcc -m32 -march=k6 -O2 -fomit-frame-pointer	ref
gcc -m32 -march=k6 -O3 -fomit-frame-pointer	ref
gcc -m32 -march=k6 -O -fomit-frame-pointer	ref
gcc -m32 -march=k8 -O2 -fomit-frame-pointer	ref
gcc -m32 -march=k8 -O3 -fomit-frame-pointer	ref
gcc -m32 -march=k8 -O -fomit-frame-pointer	ref
gcc -m32 -march=native -mtune=native -O2 -fomit-frame-pointer	ref
gcc -m32 -march=native -mtune=native -O3 -fomit-frame-pointer	ref
gcc -m32 -march=native -mtune=native -O -fomit-frame-pointer	ref
gcc -m32 -march=pentium-mmx -O2 -fomit-frame-pointer	ref
gcc -m32 -march=pentium-mmx -O3 -fomit-frame-pointer	ref
gcc -m32 -march=pentium-mmx -O -fomit-frame-pointer	ref
gcc -m32 -march=pentium -O2 -fomit-frame-pointer	ref
gcc -m32 -march=pentium -O3 -fomit-frame-pointer	ref
gcc -m32 -march=pentium -O -fomit-frame-pointer	ref

Test failure

Implementation: crypto_sign/qtesla1p/ref
Compiler: gcc -m32 -march=barcelona -O2 -fomit-frame-pointer

error 111
crypto_sign_open does not handle c=t overlap
error 111
crypto_sign_open does not handle c=t overlap

Number of similar (compiler,implementation) pairs: 3, namely:

Compiler	Implementations
gcc -m32 -march=barcelona -O2 -fomit-frame-pointer	ref
gcc -m32 -march=barcelona -O3 -fomit-frame-pointer	ref
gcc -m32 -march=barcelona -O -fomit-frame-pointer	ref