Test results for amd64, h8atom, crypto_sign/falcon512tree

[Page version: 20241027 17:23:40]

Measurements for amd64, h8atom, crypto_sign Test results for amd64, h8atom, crypto_sign Test results for crypto_sign/falcon512tree

Computer: h8atom
Microarchitecture: amd64; Bonnell (30661)
Architecture: amd64
CPU ID: GenuineIntel-00030661-bfebfbff
SUPERCOP version: 20241022
Operation: crypto_sign
Primitive: falcon512tree

Time	Object size	Test size	Implementation	Compiler	Benchmark date	SUPERCOP version
2416232	77285 0 0	94136 824 1568	`T:fpu`	`clang -march=native -Os -fwrapv -Qunused-arguments -fPIC -fPIE -gdwarf-4 -Wall`	20240702	20240625
2459436	131360 0 0	148574 832 1568	`T:fpu`	`clang -march=native -O2 -fwrapv -Qunused-arguments -fPIC -fPIE -gdwarf-4 -Wall`	20240702	20240625
2478623	92117 0 0	109614 832 1568	`T:fpu`	`clang -march=native -O -fwrapv -Qunused-arguments -fPIC -fPIE -gdwarf-4 -Wall`	20240702	20240625
2508023	142670 0 0	161086 832 1568	`T:fpu`	`clang -march=native -O3 -fwrapv -Qunused-arguments -fPIC -fPIE -gdwarf-4 -Wall`	20240702	20240625
2644488	173006 0 0	192760 792 1632	`T:fpu`	`gcc -march=native -mtune=native -O3 -fwrapv -fPIC -fPIE -gdwarf-4 -Wall`	20240702	20240625
2710449	164110 0 0	182750 840 1568	`T:fpu`	`clang -mcpu=native -O3 -fwrapv -Qunused-arguments -fPIC -fPIE -gdwarf-4 -Wall`	20240702	20240625
2780743	83607 0 0	102088 792 1632	`T:fpu`	`gcc -march=native -mtune=native -O2 -fwrapv -fPIC -fPIE -gdwarf-4 -Wall`	20240702	20240625
2921443	71350 0 0	88352 784 1600	`T:fpu`	`gcc -march=native -mtune=native -Os -fwrapv -fPIC -fPIE -gdwarf-4 -Wall`	20240702	20240625
3064117	78761 0 0	96912 792 1632	`T:fpu`	`gcc -march=native -mtune=native -O -fwrapv -fPIC -fPIE -gdwarf-4 -Wall`	20240702	20240625
17530170	138120 0 0	155350 832 1568	`T:ref`	`clang -march=native -O2 -fwrapv -Qunused-arguments -fPIC -fPIE -gdwarf-4 -Wall`	20240702	20240625
17548321	148391 0 0	166782 832 1568	`T:ref`	`clang -march=native -O3 -fwrapv -Qunused-arguments -fPIC -fPIE -gdwarf-4 -Wall`	20240702	20240625
18096141	100069 0 0	117886 832 1568	`T:ref`	`clang -march=native -O -fwrapv -Qunused-arguments -fPIC -fPIE -gdwarf-4 -Wall`	20240702	20240625
18703055	85610 0 0	102704 824 1568	`T:ref`	`clang -march=native -Os -fwrapv -Qunused-arguments -fPIC -fPIE -gdwarf-4 -Wall`	20240702	20240625
20201727	162764 0 0	182600 792 1632	`T:ref`	`gcc -march=native -mtune=native -O3 -fwrapv -fPIC -fPIE -gdwarf-4 -Wall`	20240702	20240625
20529334	89530 0 0	108080 792 1632	`T:ref`	`gcc -march=native -mtune=native -O2 -fwrapv -fPIC -fPIE -gdwarf-4 -Wall`	20240702	20240625
20596744	165555 0 0	184142 832 1568	`T:ref`	`clang -mcpu=native -O3 -fwrapv -Qunused-arguments -fPIC -fPIE -gdwarf-4 -Wall`	20240702	20240625
21415037	77935 0 0	95040 784 1600	`T:ref`	`gcc -march=native -mtune=native -Os -fwrapv -fPIC -fPIE -gdwarf-4 -Wall`	20240702	20240625
23242821	86845 0 0	104984 792 1632	`T:ref`	`gcc -march=native -mtune=native -O -fwrapv -fPIC -fPIE -gdwarf-4 -Wall`	20240702	20240625

Test failure

error 111

Number of similar (implementation,compiler) pairs: 9, namely:

Implementation	Compiler
`T:avx2`	`clang -march=native -O2 -fwrapv -Qunused-arguments -fPIC -fPIE -gdwarf-4 -Wall (Ubuntu_Clang_14.0.0)`
`T:avx2`	`clang -march=native -O3 -fwrapv -Qunused-arguments -fPIC -fPIE -gdwarf-4 -Wall (Ubuntu_Clang_14.0.0)`
`T:avx2`	`clang -march=native -O -fwrapv -Qunused-arguments -fPIC -fPIE -gdwarf-4 -Wall (Ubuntu_Clang_14.0.0)`
`T:avx2`	`clang -march=native -Os -fwrapv -Qunused-arguments -fPIC -fPIE -gdwarf-4 -Wall (Ubuntu_Clang_14.0.0)`
`T:avx2`	`clang -mcpu=native -O3 -fwrapv -Qunused-arguments -fPIC -fPIE -gdwarf-4 -Wall (Ubuntu_Clang_14.0.0)`
`T:avx2`	`gcc -march=native -mtune=native -O2 -fwrapv -fPIC -fPIE -gdwarf-4 -Wall (11.4.0)`
`T:avx2`	`gcc -march=native -mtune=native -O3 -fwrapv -fPIC -fPIE -gdwarf-4 -Wall (11.4.0)`
`T:avx2`	`gcc -march=native -mtune=native -O -fwrapv -fPIC -fPIE -gdwarf-4 -Wall (11.4.0)`
`T:avx2`	`gcc -march=native -mtune=native -Os -fwrapv -fPIC -fPIE -gdwarf-4 -Wall (11.4.0)`

Compiler output

api.c: api.c:110:25: warning: unused variable 'F' [-Wunused-variable]
api.c:         int8_t f[512], g[512], F[512], G[512];
api.c:                                ^
api.c: api.c:110:17: warning: unused variable 'g' [-Wunused-variable]
api.c:         int8_t f[512], g[512], F[512], G[512];
api.c:                        ^
api.c: api.c:110:33: warning: unused variable 'G' [-Wunused-variable]
api.c:         int8_t f[512], g[512], F[512], G[512];
api.c:                                        ^
api.c: api.c:110:9: warning: unused variable 'f' [-Wunused-variable]
api.c:         int8_t f[512], g[512], F[512], G[512];
api.c:                ^
api.c: 4 warnings generated.

Number of similar (implementation,compiler) pairs: 4, namely:

Implementation	Compiler
`T:avx2`	`clang -march=native -O2 -fwrapv -Qunused-arguments -fPIC -fPIE -gdwarf-4 -Wall (Ubuntu_Clang_14.0.0)`
`T:avx2`	`clang -march=native -O3 -fwrapv -Qunused-arguments -fPIC -fPIE -gdwarf-4 -Wall (Ubuntu_Clang_14.0.0)`
`T:avx2`	`clang -march=native -O -fwrapv -Qunused-arguments -fPIC -fPIE -gdwarf-4 -Wall (Ubuntu_Clang_14.0.0)`
`T:avx2`	`clang -mcpu=native -O3 -fwrapv -Qunused-arguments -fPIC -fPIE -gdwarf-4 -Wall (Ubuntu_Clang_14.0.0)`

Compiler output

api.c: api.c:110:17: warning: unused variable 'g' [-Wunused-variable]
api.c:         int8_t f[512], g[512], F[512], G[512];
api.c:                        ^
api.c: api.c:110:9: warning: unused variable 'f' [-Wunused-variable]
api.c:         int8_t f[512], g[512], F[512], G[512];
api.c:                ^
api.c: api.c:110:33: warning: unused variable 'G' [-Wunused-variable]
api.c:         int8_t f[512], g[512], F[512], G[512];
api.c:                                        ^
api.c: api.c:110:25: warning: unused variable 'F' [-Wunused-variable]
api.c:         int8_t f[512], g[512], F[512], G[512];
api.c:                                ^
api.c: 4 warnings generated.

Number of similar (implementation,compiler) pairs: 1, namely:

Implementation	Compiler
`T:avx2`	`clang -march=native -Os -fwrapv -Qunused-arguments -fPIC -fPIE -gdwarf-4 -Wall (Ubuntu_Clang_14.0.0)`

Compiler output

api.c: api.c: In function 'crypto_sign_falcon512tree_avx2_timingleaks':
api.c: api.c:110:40: warning: unused variable 'G' [-Wunused-variable]
api.c:   110 |         int8_t f[512], g[512], F[512], G[512];
api.c:       |                                        ^
api.c: api.c:110:32: warning: unused variable 'F' [-Wunused-variable]
api.c:   110 |         int8_t f[512], g[512], F[512], G[512];
api.c:       |                                ^
api.c: api.c:110:24: warning: unused variable 'g' [-Wunused-variable]
api.c:   110 |         int8_t f[512], g[512], F[512], G[512];
api.c:       |                        ^
api.c: api.c:110:16: warning: unused variable 'f' [-Wunused-variable]
api.c:   110 |         int8_t f[512], g[512], F[512], G[512];
api.c:       |                ^

Number of similar (implementation,compiler) pairs: 4, namely:

Implementation	Compiler
`T:avx2`	`gcc -march=native -mtune=native -O2 -fwrapv -fPIC -fPIE -gdwarf-4 -Wall (11.4.0)`
`T:avx2`	`gcc -march=native -mtune=native -O3 -fwrapv -fPIC -fPIE -gdwarf-4 -Wall (11.4.0)`
`T:avx2`	`gcc -march=native -mtune=native -O -fwrapv -fPIC -fPIE -gdwarf-4 -Wall (11.4.0)`
`T:avx2`	`gcc -march=native -mtune=native -Os -fwrapv -fPIC -fPIE -gdwarf-4 -Wall (11.4.0)`

Compiler output

api.c: api.c:110:25: warning: unused variable 'F' [-Wunused-variable]
api.c:         int8_t f[512], g[512], F[512], G[512];
api.c:                                ^
api.c: api.c:110:33: warning: unused variable 'G' [-Wunused-variable]
api.c:         int8_t f[512], g[512], F[512], G[512];
api.c:                                        ^
api.c: api.c:110:9: warning: unused variable 'f' [-Wunused-variable]
api.c:         int8_t f[512], g[512], F[512], G[512];
api.c:                ^
api.c: api.c:110:17: warning: unused variable 'g' [-Wunused-variable]
api.c:         int8_t f[512], g[512], F[512], G[512];
api.c:                        ^
api.c: 4 warnings generated.

Number of similar (implementation,compiler) pairs: 1, namely:

Implementation	Compiler
`T:fpu`	`clang -march=native -O2 -fwrapv -Qunused-arguments -fPIC -fPIE -gdwarf-4 -Wall (Ubuntu_Clang_14.0.0)`

Compiler output

api.c: api.c:110:25: warning: unused variable 'F' [-Wunused-variable]
api.c:         int8_t f[512], g[512], F[512], G[512];
api.c:                                ^
api.c: api.c:110:9: warning: unused variable 'f' [-Wunused-variable]
api.c:         int8_t f[512], g[512], F[512], G[512];
api.c:                ^
api.c: api.c:110:33: warning: unused variable 'G' [-Wunused-variable]
api.c:         int8_t f[512], g[512], F[512], G[512];
api.c:                                        ^
api.c: api.c:110:17: warning: unused variable 'g' [-Wunused-variable]
api.c:         int8_t f[512], g[512], F[512], G[512];
api.c:                        ^
api.c: 4 warnings generated.

Number of similar (implementation,compiler) pairs: 2, namely:

Implementation	Compiler
`T:fpu`	`clang -march=native -O3 -fwrapv -Qunused-arguments -fPIC -fPIE -gdwarf-4 -Wall (Ubuntu_Clang_14.0.0)`
`T:fpu`	`clang -march=native -Os -fwrapv -Qunused-arguments -fPIC -fPIE -gdwarf-4 -Wall (Ubuntu_Clang_14.0.0)`

Compiler output

api.c: api.c:110:33: warning: unused variable 'G' [-Wunused-variable]
api.c:         int8_t f[512], g[512], F[512], G[512];
api.c:                                        ^
api.c: api.c:110:9: warning: unused variable 'f' [-Wunused-variable]
api.c:         int8_t f[512], g[512], F[512], G[512];
api.c:                ^
api.c: api.c:110:25: warning: unused variable 'F' [-Wunused-variable]
api.c:         int8_t f[512], g[512], F[512], G[512];
api.c:                                ^
api.c: api.c:110:17: warning: unused variable 'g' [-Wunused-variable]
api.c:         int8_t f[512], g[512], F[512], G[512];
api.c:                        ^
api.c: 4 warnings generated.

Number of similar (implementation,compiler) pairs: 1, namely:

Implementation	Compiler
`T:fpu`	`clang -march=native -O -fwrapv -Qunused-arguments -fPIC -fPIE -gdwarf-4 -Wall (Ubuntu_Clang_14.0.0)`

Compiler output

api.c: api.c:110:17: warning: unused variable 'g' [-Wunused-variable]
api.c:         int8_t f[512], g[512], F[512], G[512];
api.c:                        ^
api.c: api.c:110:33: warning: unused variable 'G' [-Wunused-variable]
api.c:         int8_t f[512], g[512], F[512], G[512];
api.c:                                        ^
api.c: api.c:110:9: warning: unused variable 'f' [-Wunused-variable]
api.c:         int8_t f[512], g[512], F[512], G[512];
api.c:                ^
api.c: api.c:110:25: warning: unused variable 'F' [-Wunused-variable]
api.c:         int8_t f[512], g[512], F[512], G[512];
api.c:                                ^
api.c: 4 warnings generated.

Number of similar (implementation,compiler) pairs: 1, namely:

Implementation	Compiler
`T:fpu`	`clang -mcpu=native -O3 -fwrapv -Qunused-arguments -fPIC -fPIE -gdwarf-4 -Wall (Ubuntu_Clang_14.0.0)`

Compiler output

api.c: api.c: In function 'crypto_sign_falcon512tree_fpu_timingleaks':
api.c: api.c:110:40: warning: unused variable 'G' [-Wunused-variable]
api.c:   110 |         int8_t f[512], g[512], F[512], G[512];
api.c:       |                                        ^
api.c: api.c:110:32: warning: unused variable 'F' [-Wunused-variable]
api.c:   110 |         int8_t f[512], g[512], F[512], G[512];
api.c:       |                                ^
api.c: api.c:110:24: warning: unused variable 'g' [-Wunused-variable]
api.c:   110 |         int8_t f[512], g[512], F[512], G[512];
api.c:       |                        ^
api.c: api.c:110:16: warning: unused variable 'f' [-Wunused-variable]
api.c:   110 |         int8_t f[512], g[512], F[512], G[512];
api.c:       |                ^

Number of similar (implementation,compiler) pairs: 4, namely:

Implementation	Compiler
`T:fpu`	`gcc -march=native -mtune=native -O2 -fwrapv -fPIC -fPIE -gdwarf-4 -Wall (11.4.0)`
`T:fpu`	`gcc -march=native -mtune=native -O3 -fwrapv -fPIC -fPIE -gdwarf-4 -Wall (11.4.0)`
`T:fpu`	`gcc -march=native -mtune=native -O -fwrapv -fPIC -fPIE -gdwarf-4 -Wall (11.4.0)`
`T:fpu`	`gcc -march=native -mtune=native -Os -fwrapv -fPIC -fPIE -gdwarf-4 -Wall (11.4.0)`

Compiler output

api.c: api.c:107:9: warning: unused variable 'f' [-Wunused-variable]
api.c:         int8_t f[512], g[512], F[512], G[512];
api.c:                ^
api.c: api.c:107:17: warning: unused variable 'g' [-Wunused-variable]
api.c:         int8_t f[512], g[512], F[512], G[512];
api.c:                        ^
api.c: api.c:107:25: warning: unused variable 'F' [-Wunused-variable]
api.c:         int8_t f[512], g[512], F[512], G[512];
api.c:                                ^
api.c: api.c:107:33: warning: unused variable 'G' [-Wunused-variable]
api.c:         int8_t f[512], g[512], F[512], G[512];
api.c:                                        ^
api.c: 4 warnings generated.

Number of similar (implementation,compiler) pairs: 5, namely:

Implementation	Compiler
`T:ref`	`clang -march=native -O2 -fwrapv -Qunused-arguments -fPIC -fPIE -gdwarf-4 -Wall (Ubuntu_Clang_14.0.0)`
`T:ref`	`clang -march=native -O3 -fwrapv -Qunused-arguments -fPIC -fPIE -gdwarf-4 -Wall (Ubuntu_Clang_14.0.0)`
`T:ref`	`clang -march=native -O -fwrapv -Qunused-arguments -fPIC -fPIE -gdwarf-4 -Wall (Ubuntu_Clang_14.0.0)`
`T:ref`	`clang -march=native -Os -fwrapv -Qunused-arguments -fPIC -fPIE -gdwarf-4 -Wall (Ubuntu_Clang_14.0.0)`
`T:ref`	`clang -mcpu=native -O3 -fwrapv -Qunused-arguments -fPIC -fPIE -gdwarf-4 -Wall (Ubuntu_Clang_14.0.0)`

Compiler output

api.c: api.c: In function 'crypto_sign_falcon512tree_ref_timingleaks':
api.c: api.c:107:40: warning: unused variable 'G' [-Wunused-variable]
api.c:   107 |         int8_t f[512], g[512], F[512], G[512];
api.c:       |                                        ^
api.c: api.c:107:32: warning: unused variable 'F' [-Wunused-variable]
api.c:   107 |         int8_t f[512], g[512], F[512], G[512];
api.c:       |                                ^
api.c: api.c:107:24: warning: unused variable 'g' [-Wunused-variable]
api.c:   107 |         int8_t f[512], g[512], F[512], G[512];
api.c:       |                        ^
api.c: api.c:107:16: warning: unused variable 'f' [-Wunused-variable]
api.c:   107 |         int8_t f[512], g[512], F[512], G[512];
api.c:       |                ^

Number of similar (implementation,compiler) pairs: 4, namely:

Implementation	Compiler
`T:ref`	`gcc -march=native -mtune=native -O2 -fwrapv -fPIC -fPIE -gdwarf-4 -Wall (11.4.0)`
`T:ref`	`gcc -march=native -mtune=native -O3 -fwrapv -fPIC -fPIE -gdwarf-4 -Wall (11.4.0)`
`T:ref`	`gcc -march=native -mtune=native -O -fwrapv -fPIC -fPIE -gdwarf-4 -Wall (11.4.0)`
`T:ref`	`gcc -march=native -mtune=native -Os -fwrapv -fPIC -fPIE -gdwarf-4 -Wall (11.4.0)`