Test results for amd64, nucnuc, crypto_sign/falcon512tree

[Page version: 20240922 13:29:56]

Measurements for amd64, nucnuc, crypto_sign Test results for amd64, nucnuc, crypto_sign Test results for crypto_sign/falcon512tree

Computer: nucnuc
Microarchitecture: amd64; Airmont (406c3)
Architecture: amd64
CPU ID: GenuineIntel-000406c3-bfebfbff
SUPERCOP version: 20240909
Operation: crypto_sign
Primitive: falcon512tree

Time	Object size	Test size	Implementation	Compiler	Benchmark date	SUPERCOP version
1678994	155048 0 0	175338 796 1784	`T:fpu`	`gcc -march=native -mtune=native -O3 -fwrapv -fPIC -fPIE -gdwarf-4 -Wall`	20240708	20240625
1735849	115745 0 0	135654 836 1720	`T:fpu`	`clang -march=native -O3 -fwrapv -Qunused-arguments -fPIC -fPIE -gdwarf-4 -Wall`	20240708	20240625
1739227	112557 0 0	130806 836 1720	`T:fpu`	`clang -march=native -O2 -fwrapv -Qunused-arguments -fPIC -fPIE -gdwarf-4 -Wall`	20240708	20240625
1785280	77639 0 0	94996 820 1720	`T:fpu`	`clang -march=native -Os -fwrapv -Qunused-arguments -fPIC -fPIE -gdwarf-4 -Wall`	20240708	20240625
1814622	140337 0 0	159958 836 1720	`T:fpu`	`clang -mcpu=native -O3 -fwrapv -Qunused-arguments -fPIC -fPIE -gdwarf-4 -Wall`	20240708	20240625
1968557	87262 0 0	106474 796 1784	`T:fpu`	`gcc -march=native -mtune=native -O2 -fwrapv -fPIC -fPIE -gdwarf-4 -Wall`	20240708	20240625
1998328	70793 0 0	88242 788 1752	`T:fpu`	`gcc -march=native -mtune=native -Os -fwrapv -fPIC -fPIE -gdwarf-4 -Wall`	20240708	20240625
2049057	81486 0 0	100282 796 1784	`T:fpu`	`gcc -march=native -mtune=native -O -fwrapv -fPIC -fPIE -gdwarf-4 -Wall`	20240708	20240625
2489101	84247 0 0	102932 820 1720	`T:fpu`	`clang -march=native -O -fwrapv -Qunused-arguments -fPIC -fPIE -gdwarf-4 -Wall`	20240708	20240625
13753307	122034 0 0	141918 828 1720	`T:ref`	`clang -march=native -O3 -fwrapv -Qunused-arguments -fPIC -fPIE -gdwarf-4 -Wall`	20240708	20240625
13799117	119672 0 0	137870 828 1720	`T:ref`	`clang -march=native -O2 -fwrapv -Qunused-arguments -fPIC -fPIE -gdwarf-4 -Wall`	20240708	20240625
14003336	145412 0 0	165038 828 1720	`T:ref`	`clang -mcpu=native -O3 -fwrapv -Qunused-arguments -fPIC -fPIE -gdwarf-4 -Wall`	20240708	20240625
14446116	144604 0 0	164954 796 1784	`T:ref`	`gcc -march=native -mtune=native -O3 -fwrapv -fPIC -fPIE -gdwarf-4 -Wall`	20240708	20240625
14725210	93801 0 0	113050 796 1784	`T:ref`	`gcc -march=native -mtune=native -O2 -fwrapv -fPIC -fPIE -gdwarf-4 -Wall`	20240708	20240625
14896050	85618 0 0	103276 820 1720	`T:ref`	`clang -march=native -Os -fwrapv -Qunused-arguments -fPIC -fPIE -gdwarf-4 -Wall`	20240708	20240625
15224668	89596 0 0	108418 796 1784	`T:ref`	`gcc -march=native -mtune=native -O -fwrapv -fPIC -fPIE -gdwarf-4 -Wall`	20240708	20240625
15590213	77430 0 0	94994 788 1752	`T:ref`	`gcc -march=native -mtune=native -Os -fwrapv -fPIC -fPIE -gdwarf-4 -Wall`	20240708	20240625
16095020	85694 0 0	104492 820 1720	`T:ref`	`clang -march=native -O -fwrapv -Qunused-arguments -fPIC -fPIE -gdwarf-4 -Wall`	20240708	20240625

Test failure

error 111

Number of similar (implementation,compiler) pairs: 9, namely:

Implementation	Compiler
`T:avx2`	`clang -march=native -O2 -fwrapv -Qunused-arguments -fPIC -fPIE -gdwarf-4 -Wall (Debian_Clang_11.0.1)`
`T:avx2`	`clang -march=native -O3 -fwrapv -Qunused-arguments -fPIC -fPIE -gdwarf-4 -Wall (Debian_Clang_11.0.1)`
`T:avx2`	`clang -march=native -O -fwrapv -Qunused-arguments -fPIC -fPIE -gdwarf-4 -Wall (Debian_Clang_11.0.1)`
`T:avx2`	`clang -march=native -Os -fwrapv -Qunused-arguments -fPIC -fPIE -gdwarf-4 -Wall (Debian_Clang_11.0.1)`
`T:avx2`	`clang -mcpu=native -O3 -fwrapv -Qunused-arguments -fPIC -fPIE -gdwarf-4 -Wall (Debian_Clang_11.0.1)`
`T:avx2`	`gcc -march=native -mtune=native -O2 -fwrapv -fPIC -fPIE -gdwarf-4 -Wall (10.2.1_20210110)`
`T:avx2`	`gcc -march=native -mtune=native -O3 -fwrapv -fPIC -fPIE -gdwarf-4 -Wall (10.2.1_20210110)`
`T:avx2`	`gcc -march=native -mtune=native -O -fwrapv -fPIC -fPIE -gdwarf-4 -Wall (10.2.1_20210110)`
`T:avx2`	`gcc -march=native -mtune=native -Os -fwrapv -fPIC -fPIE -gdwarf-4 -Wall (10.2.1_20210110)`

Compiler output

api.c: api.c:110:17: warning: unused variable 'g' [-Wunused-variable]
api.c:         int8_t f[512], g[512], F[512], G[512];
api.c:                        ^
api.c: api.c:110:33: warning: unused variable 'G' [-Wunused-variable]
api.c:         int8_t f[512], g[512], F[512], G[512];
api.c:                                        ^
api.c: api.c:110:9: warning: unused variable 'f' [-Wunused-variable]
api.c:         int8_t f[512], g[512], F[512], G[512];
api.c:                ^
api.c: api.c:110:25: warning: unused variable 'F' [-Wunused-variable]
api.c:         int8_t f[512], g[512], F[512], G[512];
api.c:                                ^
api.c: 4 warnings generated.

Number of similar (implementation,compiler) pairs: 4, namely:

Implementation	Compiler
`T:avx2`	`clang -march=native -O2 -fwrapv -Qunused-arguments -fPIC -fPIE -gdwarf-4 -Wall (Debian_Clang_11.0.1)`
`T:avx2`	`clang -march=native -O -fwrapv -Qunused-arguments -fPIC -fPIE -gdwarf-4 -Wall (Debian_Clang_11.0.1)`
`T:fpu`	`clang -march=native -O3 -fwrapv -Qunused-arguments -fPIC -fPIE -gdwarf-4 -Wall (Debian_Clang_11.0.1)`
`T:fpu`	`clang -march=native -O -fwrapv -Qunused-arguments -fPIC -fPIE -gdwarf-4 -Wall (Debian_Clang_11.0.1)`

Compiler output

api.c: api.c:110:17: warning: unused variable 'g' [-Wunused-variable]
api.c:         int8_t f[512], g[512], F[512], G[512];
api.c:                        ^
api.c: api.c:110:25: warning: unused variable 'F' [-Wunused-variable]
api.c:         int8_t f[512], g[512], F[512], G[512];
api.c:                                ^
api.c: api.c:110:33: warning: unused variable 'G' [-Wunused-variable]
api.c:         int8_t f[512], g[512], F[512], G[512];
api.c:                                        ^
api.c: api.c:110:9: warning: unused variable 'f' [-Wunused-variable]
api.c:         int8_t f[512], g[512], F[512], G[512];
api.c:                ^
api.c: 4 warnings generated.

Number of similar (implementation,compiler) pairs: 1, namely:

Implementation	Compiler
`T:avx2`	`clang -march=native -O3 -fwrapv -Qunused-arguments -fPIC -fPIE -gdwarf-4 -Wall (Debian_Clang_11.0.1)`

Compiler output

api.c: api.c:110:25: warning: unused variable 'F' [-Wunused-variable]
api.c:         int8_t f[512], g[512], F[512], G[512];
api.c:                                ^
api.c: api.c:110:9: warning: unused variable 'f' [-Wunused-variable]
api.c:         int8_t f[512], g[512], F[512], G[512];
api.c:                ^
api.c: api.c:110:33: warning: unused variable 'G' [-Wunused-variable]
api.c:         int8_t f[512], g[512], F[512], G[512];
api.c:                                        ^
api.c: api.c:110:17: warning: unused variable 'g' [-Wunused-variable]
api.c:         int8_t f[512], g[512], F[512], G[512];
api.c:                        ^
api.c: 4 warnings generated.

Number of similar (implementation,compiler) pairs: 1, namely:

Implementation	Compiler
`T:avx2`	`clang -march=native -Os -fwrapv -Qunused-arguments -fPIC -fPIE -gdwarf-4 -Wall (Debian_Clang_11.0.1)`

Compiler output

api.c: api.c:110:33: warning: unused variable 'G' [-Wunused-variable]
api.c:         int8_t f[512], g[512], F[512], G[512];
api.c:                                        ^
api.c: api.c:110:17: warning: unused variable 'g' [-Wunused-variable]
api.c:         int8_t f[512], g[512], F[512], G[512];
api.c:                        ^
api.c: api.c:110:9: warning: unused variable 'f' [-Wunused-variable]
api.c:         int8_t f[512], g[512], F[512], G[512];
api.c:                ^
api.c: api.c:110:25: warning: unused variable 'F' [-Wunused-variable]
api.c:         int8_t f[512], g[512], F[512], G[512];
api.c:                                ^
api.c: 4 warnings generated.

Number of similar (implementation,compiler) pairs: 1, namely:

Implementation	Compiler
`T:avx2`	`clang -mcpu=native -O3 -fwrapv -Qunused-arguments -fPIC -fPIE -gdwarf-4 -Wall (Debian_Clang_11.0.1)`

Compiler output

api.c: api.c: In function 'crypto_sign_falcon512tree_avx2_timingleaks':
api.c: api.c:110:33: warning: unused variable 'G' [-Wunused-variable]
api.c:   110 |  int8_t f[512], g[512], F[512], G[512];
api.c:       |                                 ^
api.c: api.c:110:25: warning: unused variable 'F' [-Wunused-variable]
api.c:   110 |  int8_t f[512], g[512], F[512], G[512];
api.c:       |                         ^
api.c: api.c:110:17: warning: unused variable 'g' [-Wunused-variable]
api.c:   110 |  int8_t f[512], g[512], F[512], G[512];
api.c:       |                 ^
api.c: api.c:110:9: warning: unused variable 'f' [-Wunused-variable]
api.c:   110 |  int8_t f[512], g[512], F[512], G[512];
api.c:       |         ^

Number of similar (implementation,compiler) pairs: 4, namely:

Implementation	Compiler
`T:avx2`	`gcc -march=native -mtune=native -O2 -fwrapv -fPIC -fPIE -gdwarf-4 -Wall (10.2.1_20210110)`
`T:avx2`	`gcc -march=native -mtune=native -O3 -fwrapv -fPIC -fPIE -gdwarf-4 -Wall (10.2.1_20210110)`
`T:avx2`	`gcc -march=native -mtune=native -O -fwrapv -fPIC -fPIE -gdwarf-4 -Wall (10.2.1_20210110)`
`T:avx2`	`gcc -march=native -mtune=native -Os -fwrapv -fPIC -fPIE -gdwarf-4 -Wall (10.2.1_20210110)`

Compiler output

api.c: api.c:110:9: warning: unused variable 'f' [-Wunused-variable]
api.c:         int8_t f[512], g[512], F[512], G[512];
api.c:                ^
api.c: api.c:110:25: warning: unused variable 'F' [-Wunused-variable]
api.c:         int8_t f[512], g[512], F[512], G[512];
api.c:                                ^
api.c: api.c:110:17: warning: unused variable 'g' [-Wunused-variable]
api.c:         int8_t f[512], g[512], F[512], G[512];
api.c:                        ^
api.c: api.c:110:33: warning: unused variable 'G' [-Wunused-variable]
api.c:         int8_t f[512], g[512], F[512], G[512];
api.c:                                        ^
api.c: 4 warnings generated.

Number of similar (implementation,compiler) pairs: 1, namely:

Implementation	Compiler
`T:fpu`	`clang -march=native -O2 -fwrapv -Qunused-arguments -fPIC -fPIE -gdwarf-4 -Wall (Debian_Clang_11.0.1)`

Compiler output

api.c: api.c:110:25: warning: unused variable 'F' [-Wunused-variable]
api.c:         int8_t f[512], g[512], F[512], G[512];
api.c:                                ^
api.c: api.c:110:17: warning: unused variable 'g' [-Wunused-variable]
api.c:         int8_t f[512], g[512], F[512], G[512];
api.c:                        ^
api.c: api.c:110:33: warning: unused variable 'G' [-Wunused-variable]
api.c:         int8_t f[512], g[512], F[512], G[512];
api.c:                                        ^
api.c: api.c:110:9: warning: unused variable 'f' [-Wunused-variable]
api.c:         int8_t f[512], g[512], F[512], G[512];
api.c:                ^
api.c: 4 warnings generated.

Number of similar (implementation,compiler) pairs: 1, namely:

Implementation	Compiler
`T:fpu`	`clang -march=native -Os -fwrapv -Qunused-arguments -fPIC -fPIE -gdwarf-4 -Wall (Debian_Clang_11.0.1)`

Compiler output

api.c: api.c:110:33: warning: unused variable 'G' [-Wunused-variable]
api.c:         int8_t f[512], g[512], F[512], G[512];
api.c:                                        ^
api.c: api.c:110:17: warning: unused variable 'g' [-Wunused-variable]
api.c:         int8_t f[512], g[512], F[512], G[512];
api.c:                        ^
api.c: api.c:110:25: warning: unused variable 'F' [-Wunused-variable]
api.c:         int8_t f[512], g[512], F[512], G[512];
api.c:                                ^
api.c: api.c:110:9: warning: unused variable 'f' [-Wunused-variable]
api.c:         int8_t f[512], g[512], F[512], G[512];
api.c:                ^
api.c: 4 warnings generated.

Number of similar (implementation,compiler) pairs: 1, namely:

Implementation	Compiler
`T:fpu`	`clang -mcpu=native -O3 -fwrapv -Qunused-arguments -fPIC -fPIE -gdwarf-4 -Wall (Debian_Clang_11.0.1)`

Compiler output

api.c: api.c: In function 'crypto_sign_falcon512tree_fpu_timingleaks':
api.c: api.c:110:33: warning: unused variable 'G' [-Wunused-variable]
api.c:   110 |  int8_t f[512], g[512], F[512], G[512];
api.c:       |                                 ^
api.c: api.c:110:25: warning: unused variable 'F' [-Wunused-variable]
api.c:   110 |  int8_t f[512], g[512], F[512], G[512];
api.c:       |                         ^
api.c: api.c:110:17: warning: unused variable 'g' [-Wunused-variable]
api.c:   110 |  int8_t f[512], g[512], F[512], G[512];
api.c:       |                 ^
api.c: api.c:110:9: warning: unused variable 'f' [-Wunused-variable]
api.c:   110 |  int8_t f[512], g[512], F[512], G[512];
api.c:       |         ^

Number of similar (implementation,compiler) pairs: 4, namely:

Implementation	Compiler
`T:fpu`	`gcc -march=native -mtune=native -O2 -fwrapv -fPIC -fPIE -gdwarf-4 -Wall (10.2.1_20210110)`
`T:fpu`	`gcc -march=native -mtune=native -O3 -fwrapv -fPIC -fPIE -gdwarf-4 -Wall (10.2.1_20210110)`
`T:fpu`	`gcc -march=native -mtune=native -O -fwrapv -fPIC -fPIE -gdwarf-4 -Wall (10.2.1_20210110)`
`T:fpu`	`gcc -march=native -mtune=native -Os -fwrapv -fPIC -fPIE -gdwarf-4 -Wall (10.2.1_20210110)`

Compiler output

api.c: api.c:107:9: warning: unused variable 'f' [-Wunused-variable]
api.c:         int8_t f[512], g[512], F[512], G[512];
api.c:                ^
api.c: api.c:107:17: warning: unused variable 'g' [-Wunused-variable]
api.c:         int8_t f[512], g[512], F[512], G[512];
api.c:                        ^
api.c: api.c:107:25: warning: unused variable 'F' [-Wunused-variable]
api.c:         int8_t f[512], g[512], F[512], G[512];
api.c:                                ^
api.c: api.c:107:33: warning: unused variable 'G' [-Wunused-variable]
api.c:         int8_t f[512], g[512], F[512], G[512];
api.c:                                        ^
api.c: 4 warnings generated.

Number of similar (implementation,compiler) pairs: 5, namely:

Implementation	Compiler
`T:ref`	`clang -march=native -O2 -fwrapv -Qunused-arguments -fPIC -fPIE -gdwarf-4 -Wall (Debian_Clang_11.0.1)`
`T:ref`	`clang -march=native -O3 -fwrapv -Qunused-arguments -fPIC -fPIE -gdwarf-4 -Wall (Debian_Clang_11.0.1)`
`T:ref`	`clang -march=native -O -fwrapv -Qunused-arguments -fPIC -fPIE -gdwarf-4 -Wall (Debian_Clang_11.0.1)`
`T:ref`	`clang -march=native -Os -fwrapv -Qunused-arguments -fPIC -fPIE -gdwarf-4 -Wall (Debian_Clang_11.0.1)`
`T:ref`	`clang -mcpu=native -O3 -fwrapv -Qunused-arguments -fPIC -fPIE -gdwarf-4 -Wall (Debian_Clang_11.0.1)`

Compiler output

api.c: api.c: In function 'crypto_sign_falcon512tree_ref_timingleaks':
api.c: api.c:107:33: warning: unused variable 'G' [-Wunused-variable]
api.c:   107 |  int8_t f[512], g[512], F[512], G[512];
api.c:       |                                 ^
api.c: api.c:107:25: warning: unused variable 'F' [-Wunused-variable]
api.c:   107 |  int8_t f[512], g[512], F[512], G[512];
api.c:       |                         ^
api.c: api.c:107:17: warning: unused variable 'g' [-Wunused-variable]
api.c:   107 |  int8_t f[512], g[512], F[512], G[512];
api.c:       |                 ^
api.c: api.c:107:9: warning: unused variable 'f' [-Wunused-variable]
api.c:   107 |  int8_t f[512], g[512], F[512], G[512];
api.c:       |         ^

Number of similar (implementation,compiler) pairs: 4, namely:

Implementation	Compiler
`T:ref`	`gcc -march=native -mtune=native -O2 -fwrapv -fPIC -fPIE -gdwarf-4 -Wall (10.2.1_20210110)`
`T:ref`	`gcc -march=native -mtune=native -O3 -fwrapv -fPIC -fPIE -gdwarf-4 -Wall (10.2.1_20210110)`
`T:ref`	`gcc -march=native -mtune=native -O -fwrapv -fPIC -fPIE -gdwarf-4 -Wall (10.2.1_20210110)`
`T:ref`	`gcc -march=native -mtune=native -Os -fwrapv -fPIC -fPIE -gdwarf-4 -Wall (10.2.1_20210110)`