Test results for amd64, comet, crypto_sign/falcon1024tree

[Page version: 20241024 06:31:28]

Measurements for amd64, comet, crypto_sign Test results for amd64, comet, crypto_sign Test results for crypto_sign/falcon1024tree

Computer: comet
Microarchitecture: amd64; Comet Lake (806ec)
Architecture: amd64
CPU ID: GenuineIntel-000806ec-bfebfbff
SUPERCOP version: 20241022
Operation: crypto_sign
Primitive: falcon1024tree

Time	Object size	Test size	Implementation	Compiler	Benchmark date	SUPERCOP version
1026605	223009 0 0	245063 876 1792	`T:avx2`	`clang -march=native -O3 -fwrapv -Qunused-arguments -fPIC -fPIE -gdwarf-4 -Wall`	20240701	20240625
1027832	188963 0 0	210895 876 1760	`T:avx2`	`clang -march=native -O2 -fwrapv -Qunused-arguments -fPIC -fPIE -gdwarf-4 -Wall`	20240701	20240625
1084998	165029 0 0	185551 876 1728	`T:avx2`	`clang -mcpu=native -O3 -fwrapv -Qunused-arguments -fPIC -fPIE -gdwarf-4 -Wall`	20240701	20240625
1112930	80682 0 0	100581 868 1792	`T:avx2`	`clang -march=native -Os -fwrapv -Qunused-arguments -fPIC -fPIE -gdwarf-4 -Wall`	20240701	20240625
1126431	79504 0 0	99310 796 1792	`T:avx2`	`gcc -march=native -mtune=native -O -fwrapv -fPIC -fPIE -gdwarf-4 -Wall`	20240701	20240625
1134858	95495 0 0	114775 876 1728	`T:avx2`	`clang -march=native -O -fwrapv -Qunused-arguments -fPIC -fPIE -gdwarf-4 -Wall`	20240701	20240625
1289637	71080 0 0	89814 788 1760	`T:avx2`	`gcc -march=native -mtune=native -Os -fwrapv -fPIC -fPIE -gdwarf-4 -Wall`	20240701	20240625
1570269	201561 0 0	223654 796 1792	`T:fpu`	`gcc -march=native -mtune=native -O3 -fwrapv -fPIC -fPIE -gdwarf-4 -Wall`	20240701	20240625
1591841	187269 0 0	209463 876 1760	`T:fpu`	`clang -march=native -O2 -fwrapv -Qunused-arguments -fPIC -fPIE -gdwarf-4 -Wall`	20240701	20240625
1632651	222315 0 0	244679 876 1792	`T:fpu`	`clang -march=native -O3 -fwrapv -Qunused-arguments -fPIC -fPIE -gdwarf-4 -Wall`	20240701	20240625
1726784	164126 0 0	184863 876 1728	`T:fpu`	`clang -mcpu=native -O3 -fwrapv -Qunused-arguments -fPIC -fPIE -gdwarf-4 -Wall`	20240701	20240625
1860788	92437 0 0	111903 868 1728	`T:fpu`	`clang -march=native -O -fwrapv -Qunused-arguments -fPIC -fPIE -gdwarf-4 -Wall`	20240701	20240625
1924163	77390 0 0	97230 796 1792	`T:fpu`	`gcc -march=native -mtune=native -O -fwrapv -fPIC -fPIE -gdwarf-4 -Wall`	20240701	20240625
1987159	87224 0 0	107398 796 1792	`T:fpu`	`gcc -march=native -mtune=native -O2 -fwrapv -fPIC -fPIE -gdwarf-4 -Wall`	20240701	20240625
2024765	69272 0 0	88046 788 1760	`T:fpu`	`gcc -march=native -mtune=native -Os -fwrapv -fPIC -fPIE -gdwarf-4 -Wall`	20240701	20240625
3232464	78662 0 0	98621 860 1792	`T:fpu`	`clang -march=native -Os -fwrapv -Qunused-arguments -fPIC -fPIE -gdwarf-4 -Wall`	20240701	20240625
15069862	165539 0 0	186255 868 1728	`T:ref`	`clang -mcpu=native -O3 -fwrapv -Qunused-arguments -fPIC -fPIE -gdwarf-4 -Wall`	20240701	20240625
15504590	183126 0 0	205447 868 1760	`T:ref`	`clang -march=native -O2 -fwrapv -Qunused-arguments -fPIC -fPIE -gdwarf-4 -Wall`	20240701	20240625
15555349	216408 0 0	238847 868 1792	`T:ref`	`clang -march=native -O3 -fwrapv -Qunused-arguments -fPIC -fPIE -gdwarf-4 -Wall`	20240701	20240625
15832023	101328 0 0	121023 868 1728	`T:ref`	`clang -march=native -O -fwrapv -Qunused-arguments -fPIC -fPIE -gdwarf-4 -Wall`	20240701	20240625
16556631	193495 0 0	215654 796 1792	`T:ref`	`gcc -march=native -mtune=native -O3 -fwrapv -fPIC -fPIE -gdwarf-4 -Wall`	20240701	20240625
16629873	89851 0 0	109773 860 1792	`T:ref`	`clang -march=native -Os -fwrapv -Qunused-arguments -fPIC -fPIE -gdwarf-4 -Wall`	20240701	20240625
16834711	92350 0 0	112598 796 1792	`T:ref`	`gcc -march=native -mtune=native -O2 -fwrapv -fPIC -fPIE -gdwarf-4 -Wall`	20240701	20240625
16913942	76066 0 0	94958 788 1760	`T:ref`	`gcc -march=native -mtune=native -Os -fwrapv -fPIC -fPIE -gdwarf-4 -Wall`	20240701	20240625
17279292	85871 0 0	105742 796 1792	`T:ref`	`gcc -march=native -mtune=native -O -fwrapv -fPIC -fPIE -gdwarf-4 -Wall`	20240701	20240625

Checksum failure

d18484228c984002d686e88272fcca550f9e8d9ed563d5f82fb34bde93d86fbd

Number of similar (implementation,compiler) pairs: 2, namely:

Implementation	Compiler
`T:avx2`	`gcc -march=native -mtune=native -O2 -fwrapv -fPIC -fPIE -gdwarf-4 -Wall (12.2.0)`
`T:avx2`	`gcc -march=native -mtune=native -O3 -fwrapv -fPIC -fPIE -gdwarf-4 -Wall (12.2.0)`

Compiler output

api.c: api.c:110:18: warning: unused variable 'g' [-Wunused-variable]
api.c:         int8_t f[1024], g[1024], F[1024], G[1024];
api.c:                         ^
api.c: api.c:110:36: warning: unused variable 'G' [-Wunused-variable]
api.c:         int8_t f[1024], g[1024], F[1024], G[1024];
api.c:                                           ^
api.c: api.c:110:27: warning: unused variable 'F' [-Wunused-variable]
api.c:         int8_t f[1024], g[1024], F[1024], G[1024];
api.c:                                  ^
api.c: api.c:110:9: warning: unused variable 'f' [-Wunused-variable]
api.c:         int8_t f[1024], g[1024], F[1024], G[1024];
api.c:                ^
api.c: 4 warnings generated.

Number of similar (implementation,compiler) pairs: 2, namely:

Implementation	Compiler
`T:avx2`	`clang -march=native -O2 -fwrapv -Qunused-arguments -fPIC -fPIE -gdwarf-4 -Wall (Debian_Clang_14.0.6)`
`T:avx2`	`clang -march=native -O -fwrapv -Qunused-arguments -fPIC -fPIE -gdwarf-4 -Wall (Debian_Clang_14.0.6)`

Compiler output

api.c: api.c:110:27: warning: unused variable 'F' [-Wunused-variable]
api.c:         int8_t f[1024], g[1024], F[1024], G[1024];
api.c:                                  ^
api.c: api.c:110:9: warning: unused variable 'f' [-Wunused-variable]
api.c:         int8_t f[1024], g[1024], F[1024], G[1024];
api.c:                ^
api.c: api.c:110:18: warning: unused variable 'g' [-Wunused-variable]
api.c:         int8_t f[1024], g[1024], F[1024], G[1024];
api.c:                         ^
api.c: api.c:110:36: warning: unused variable 'G' [-Wunused-variable]
api.c:         int8_t f[1024], g[1024], F[1024], G[1024];
api.c:                                           ^
api.c: 4 warnings generated.

Number of similar (implementation,compiler) pairs: 1, namely:

Implementation	Compiler
`T:avx2`	`clang -march=native -O3 -fwrapv -Qunused-arguments -fPIC -fPIE -gdwarf-4 -Wall (Debian_Clang_14.0.6)`

Compiler output

api.c: api.c:110:18: warning: unused variable 'g' [-Wunused-variable]
api.c:         int8_t f[1024], g[1024], F[1024], G[1024];
api.c:                         ^
api.c: api.c:110:27: warning: unused variable 'F' [-Wunused-variable]
api.c:         int8_t f[1024], g[1024], F[1024], G[1024];
api.c:                                  ^
api.c: api.c:110:9: warning: unused variable 'f' [-Wunused-variable]
api.c:         int8_t f[1024], g[1024], F[1024], G[1024];
api.c:                ^
api.c: api.c:110:36: warning: unused variable 'G' [-Wunused-variable]
api.c:         int8_t f[1024], g[1024], F[1024], G[1024];
api.c:                                           ^
api.c: 4 warnings generated.

Number of similar (implementation,compiler) pairs: 2, namely:

Implementation	Compiler
`T:avx2`	`clang -march=native -Os -fwrapv -Qunused-arguments -fPIC -fPIE -gdwarf-4 -Wall (Debian_Clang_14.0.6)`
`T:fpu`	`clang -march=native -O2 -fwrapv -Qunused-arguments -fPIC -fPIE -gdwarf-4 -Wall (Debian_Clang_14.0.6)`

Compiler output

api.c: api.c:110:9: warning: unused variable 'f' [-Wunused-variable]
api.c:         int8_t f[1024], g[1024], F[1024], G[1024];
api.c:                ^
api.c: api.c:110:36: warning: unused variable 'G' [-Wunused-variable]
api.c:         int8_t f[1024], g[1024], F[1024], G[1024];
api.c:                                           ^
api.c: api.c:110:18: warning: unused variable 'g' [-Wunused-variable]
api.c:         int8_t f[1024], g[1024], F[1024], G[1024];
api.c:                         ^
api.c: api.c:110:27: warning: unused variable 'F' [-Wunused-variable]
api.c:         int8_t f[1024], g[1024], F[1024], G[1024];
api.c:                                  ^
api.c: 4 warnings generated.

Number of similar (implementation,compiler) pairs: 1, namely:

Implementation	Compiler
`T:avx2`	`clang -mcpu=native -O3 -fwrapv -Qunused-arguments -fPIC -fPIE -gdwarf-4 -Wall (Debian_Clang_14.0.6)`

Compiler output

api.c: api.c: In function 'crypto_sign_falcon1024tree_avx2_timingleaks':
api.c: api.c:110:43: warning: unused variable 'G' [-Wunused-variable]
api.c:   110 |         int8_t f[1024], g[1024], F[1024], G[1024];
api.c:       |                                           ^
api.c: api.c:110:34: warning: unused variable 'F' [-Wunused-variable]
api.c:   110 |         int8_t f[1024], g[1024], F[1024], G[1024];
api.c:       |                                  ^
api.c: api.c:110:25: warning: unused variable 'g' [-Wunused-variable]
api.c:   110 |         int8_t f[1024], g[1024], F[1024], G[1024];
api.c:       |                         ^
api.c: api.c:110:16: warning: unused variable 'f' [-Wunused-variable]
api.c:   110 |         int8_t f[1024], g[1024], F[1024], G[1024];
api.c:       |                ^

Number of similar (implementation,compiler) pairs: 4, namely:

Implementation	Compiler
`T:avx2`	`gcc -march=native -mtune=native -O2 -fwrapv -fPIC -fPIE -gdwarf-4 -Wall (12.2.0)`
`T:avx2`	`gcc -march=native -mtune=native -O3 -fwrapv -fPIC -fPIE -gdwarf-4 -Wall (12.2.0)`
`T:avx2`	`gcc -march=native -mtune=native -O -fwrapv -fPIC -fPIE -gdwarf-4 -Wall (12.2.0)`
`T:avx2`	`gcc -march=native -mtune=native -Os -fwrapv -fPIC -fPIE -gdwarf-4 -Wall (12.2.0)`

Compiler output

api.c: api.c:110:18: warning: unused variable 'g' [-Wunused-variable]
api.c:         int8_t f[1024], g[1024], F[1024], G[1024];
api.c:                         ^
api.c: api.c:110:27: warning: unused variable 'F' [-Wunused-variable]
api.c:         int8_t f[1024], g[1024], F[1024], G[1024];
api.c:                                  ^
api.c: api.c:110:36: warning: unused variable 'G' [-Wunused-variable]
api.c:         int8_t f[1024], g[1024], F[1024], G[1024];
api.c:                                           ^
api.c: api.c:110:9: warning: unused variable 'f' [-Wunused-variable]
api.c:         int8_t f[1024], g[1024], F[1024], G[1024];
api.c:                ^
api.c: 4 warnings generated.

Number of similar (implementation,compiler) pairs: 1, namely:

Implementation	Compiler
`T:fpu`	`clang -march=native -O3 -fwrapv -Qunused-arguments -fPIC -fPIE -gdwarf-4 -Wall (Debian_Clang_14.0.6)`

Compiler output

api.c: api.c:110:18: warning: unused variable 'g' [-Wunused-variable]
api.c:         int8_t f[1024], g[1024], F[1024], G[1024];
api.c:                         ^
api.c: api.c:110:9: warning: unused variable 'f' [-Wunused-variable]
api.c:         int8_t f[1024], g[1024], F[1024], G[1024];
api.c:                ^
api.c: api.c:110:36: warning: unused variable 'G' [-Wunused-variable]
api.c:         int8_t f[1024], g[1024], F[1024], G[1024];
api.c:                                           ^
api.c: api.c:110:27: warning: unused variable 'F' [-Wunused-variable]
api.c:         int8_t f[1024], g[1024], F[1024], G[1024];
api.c:                                  ^
api.c: 4 warnings generated.

Number of similar (implementation,compiler) pairs: 1, namely:

Implementation	Compiler
`T:fpu`	`clang -march=native -O -fwrapv -Qunused-arguments -fPIC -fPIE -gdwarf-4 -Wall (Debian_Clang_14.0.6)`

Compiler output

api.c: api.c:110:9: warning: unused variable 'f' [-Wunused-variable]
api.c:         int8_t f[1024], g[1024], F[1024], G[1024];
api.c:                ^
api.c: api.c:110:27: warning: unused variable 'F' [-Wunused-variable]
api.c:         int8_t f[1024], g[1024], F[1024], G[1024];
api.c:                                  ^
api.c: api.c:110:18: warning: unused variable 'g' [-Wunused-variable]
api.c:         int8_t f[1024], g[1024], F[1024], G[1024];
api.c:                         ^
api.c: api.c:110:36: warning: unused variable 'G' [-Wunused-variable]
api.c:         int8_t f[1024], g[1024], F[1024], G[1024];
api.c:                                           ^
api.c: 4 warnings generated.

Number of similar (implementation,compiler) pairs: 1, namely:

Implementation	Compiler
`T:fpu`	`clang -march=native -Os -fwrapv -Qunused-arguments -fPIC -fPIE -gdwarf-4 -Wall (Debian_Clang_14.0.6)`

Compiler output

api.c: api.c:110:18: warning: unused variable 'g' [-Wunused-variable]
api.c:         int8_t f[1024], g[1024], F[1024], G[1024];
api.c:                         ^
api.c: api.c:110:36: warning: unused variable 'G' [-Wunused-variable]
api.c:         int8_t f[1024], g[1024], F[1024], G[1024];
api.c:                                           ^
api.c: api.c:110:9: warning: unused variable 'f' [-Wunused-variable]
api.c:         int8_t f[1024], g[1024], F[1024], G[1024];
api.c:                ^
api.c: api.c:110:27: warning: unused variable 'F' [-Wunused-variable]
api.c:         int8_t f[1024], g[1024], F[1024], G[1024];
api.c:                                  ^
api.c: 4 warnings generated.

Number of similar (implementation,compiler) pairs: 1, namely:

Implementation	Compiler
`T:fpu`	`clang -mcpu=native -O3 -fwrapv -Qunused-arguments -fPIC -fPIE -gdwarf-4 -Wall (Debian_Clang_14.0.6)`

Compiler output

api.c: api.c: In function 'crypto_sign_falcon1024tree_fpu_timingleaks':
api.c: api.c:110:43: warning: unused variable 'G' [-Wunused-variable]
api.c:   110 |         int8_t f[1024], g[1024], F[1024], G[1024];
api.c:       |                                           ^
api.c: api.c:110:34: warning: unused variable 'F' [-Wunused-variable]
api.c:   110 |         int8_t f[1024], g[1024], F[1024], G[1024];
api.c:       |                                  ^
api.c: api.c:110:25: warning: unused variable 'g' [-Wunused-variable]
api.c:   110 |         int8_t f[1024], g[1024], F[1024], G[1024];
api.c:       |                         ^
api.c: api.c:110:16: warning: unused variable 'f' [-Wunused-variable]
api.c:   110 |         int8_t f[1024], g[1024], F[1024], G[1024];
api.c:       |                ^

Number of similar (implementation,compiler) pairs: 4, namely:

Implementation	Compiler
`T:fpu`	`gcc -march=native -mtune=native -O2 -fwrapv -fPIC -fPIE -gdwarf-4 -Wall (12.2.0)`
`T:fpu`	`gcc -march=native -mtune=native -O3 -fwrapv -fPIC -fPIE -gdwarf-4 -Wall (12.2.0)`
`T:fpu`	`gcc -march=native -mtune=native -O -fwrapv -fPIC -fPIE -gdwarf-4 -Wall (12.2.0)`
`T:fpu`	`gcc -march=native -mtune=native -Os -fwrapv -fPIC -fPIE -gdwarf-4 -Wall (12.2.0)`

Compiler output

api.c: api.c:107:9: warning: unused variable 'f' [-Wunused-variable]
api.c:         int8_t f[1024], g[1024], F[1024], G[1024];
api.c:                ^
api.c: api.c:107:18: warning: unused variable 'g' [-Wunused-variable]
api.c:         int8_t f[1024], g[1024], F[1024], G[1024];
api.c:                         ^
api.c: api.c:107:27: warning: unused variable 'F' [-Wunused-variable]
api.c:         int8_t f[1024], g[1024], F[1024], G[1024];
api.c:                                  ^
api.c: api.c:107:36: warning: unused variable 'G' [-Wunused-variable]
api.c:         int8_t f[1024], g[1024], F[1024], G[1024];
api.c:                                           ^
api.c: 4 warnings generated.

Number of similar (implementation,compiler) pairs: 5, namely:

Implementation	Compiler
`T:ref`	`clang -march=native -O2 -fwrapv -Qunused-arguments -fPIC -fPIE -gdwarf-4 -Wall (Debian_Clang_14.0.6)`
`T:ref`	`clang -march=native -O3 -fwrapv -Qunused-arguments -fPIC -fPIE -gdwarf-4 -Wall (Debian_Clang_14.0.6)`
`T:ref`	`clang -march=native -O -fwrapv -Qunused-arguments -fPIC -fPIE -gdwarf-4 -Wall (Debian_Clang_14.0.6)`
`T:ref`	`clang -march=native -Os -fwrapv -Qunused-arguments -fPIC -fPIE -gdwarf-4 -Wall (Debian_Clang_14.0.6)`
`T:ref`	`clang -mcpu=native -O3 -fwrapv -Qunused-arguments -fPIC -fPIE -gdwarf-4 -Wall (Debian_Clang_14.0.6)`

Compiler output

api.c: api.c: In function 'crypto_sign_falcon1024tree_ref_timingleaks':
api.c: api.c:107:43: warning: unused variable 'G' [-Wunused-variable]
api.c:   107 |         int8_t f[1024], g[1024], F[1024], G[1024];
api.c:       |                                           ^
api.c: api.c:107:34: warning: unused variable 'F' [-Wunused-variable]
api.c:   107 |         int8_t f[1024], g[1024], F[1024], G[1024];
api.c:       |                                  ^
api.c: api.c:107:25: warning: unused variable 'g' [-Wunused-variable]
api.c:   107 |         int8_t f[1024], g[1024], F[1024], G[1024];
api.c:       |                         ^
api.c: api.c:107:16: warning: unused variable 'f' [-Wunused-variable]
api.c:   107 |         int8_t f[1024], g[1024], F[1024], G[1024];
api.c:       |                ^

Number of similar (implementation,compiler) pairs: 4, namely:

Implementation	Compiler
`T:ref`	`gcc -march=native -mtune=native -O2 -fwrapv -fPIC -fPIE -gdwarf-4 -Wall (12.2.0)`
`T:ref`	`gcc -march=native -mtune=native -O3 -fwrapv -fPIC -fPIE -gdwarf-4 -Wall (12.2.0)`
`T:ref`	`gcc -march=native -mtune=native -O -fwrapv -fPIC -fPIE -gdwarf-4 -Wall (12.2.0)`
`T:ref`	`gcc -march=native -mtune=native -Os -fwrapv -fPIC -fPIE -gdwarf-4 -Wall (12.2.0)`