Test results for amd64, trident, crypto_sign/falcon512tree

[Page version: 20240912 08:42:05]

Measurements for amd64, trident, crypto_sign Test results for amd64, trident, crypto_sign Test results for crypto_sign/falcon512tree
Computer: trident
Microarchitecture: amd64; Core 2 65nm (6fb)
Architecture: amd64
CPU ID: GenuineIntel-000006fb-bfebfbff
SUPERCOP version: 20240909
Operation: crypto_sign
Primitive: falcon512tree
TimeObject sizeTest sizeImplementationCompilerBenchmark dateSUPERCOP version
125712577433 0 094764 820 1720T:fpuclang -march=native -Os -fwrapv -Qunused-arguments -fPIC -fPIE -gdwarf-4 -Wall2024070420240625
1265767150941 0 0170634 796 1784T:fpugcc -march=native -mtune=native -O3 -fwrapv -fPIC -fPIE -gdwarf-4 -Wall2024070420240625
1292332133141 0 0151478 836 1720T:fpuclang -march=native -O2 -fwrapv -Qunused-arguments -fPIC -fPIE -gdwarf-4 -Wall2024070420240625
1302311139570 0 0159022 836 1720T:fpuclang -march=native -O3 -fwrapv -Qunused-arguments -fPIC -fPIE -gdwarf-4 -Wall2024070420240625
1312104140337 0 0159934 836 1720T:fpuclang -mcpu=native -O3 -fwrapv -Qunused-arguments -fPIC -fPIE -gdwarf-4 -Wall2024070420240625
131962386732 0 0105578 796 1784T:fpugcc -march=native -mtune=native -O2 -fwrapv -fPIC -fPIE -gdwarf-4 -Wall2024070420240625
133113581420 0 099842 796 1784T:fpugcc -march=native -mtune=native -O -fwrapv -fPIC -fPIE -gdwarf-4 -Wall2024070420240625
137323570717 0 088090 788 1752T:fpugcc -march=native -mtune=native -Os -fwrapv -fPIC -fPIE -gdwarf-4 -Wall2024070420240625
180950384271 0 0102940 820 1720T:fpuclang -march=native -O -fwrapv -Qunused-arguments -fPIC -fPIE -gdwarf-4 -Wall2024070420240625
11328094144426 0 0163846 828 1720T:refclang -march=native -O3 -fwrapv -Qunused-arguments -fPIC -fPIE -gdwarf-4 -Wall2024070420240625
11330937138880 0 0157166 828 1720T:refclang -march=native -O2 -fwrapv -Qunused-arguments -fPIC -fPIE -gdwarf-4 -Wall2024070420240625
11563921145412 0 0165014 828 1720T:refclang -mcpu=native -O3 -fwrapv -Qunused-arguments -fPIC -fPIE -gdwarf-4 -Wall2024070420240625
1161841885569 0 0103188 820 1720T:refclang -march=native -Os -fwrapv -Qunused-arguments -fPIC -fPIE -gdwarf-4 -Wall2024070420240625
1243371889158 0 0107658 796 1784T:refgcc -march=native -mtune=native -O -fwrapv -fPIC -fPIE -gdwarf-4 -Wall2024070420240625
1246181485682 0 0104436 820 1720T:refclang -march=native -O -fwrapv -Qunused-arguments -fPIC -fPIE -gdwarf-4 -Wall2024070420240625
12636676138307 0 0158098 796 1784T:refgcc -march=native -mtune=native -O3 -fwrapv -fPIC -fPIE -gdwarf-4 -Wall2024070420240625
1275164892491 0 0111386 796 1784T:refgcc -march=native -mtune=native -O2 -fwrapv -fPIC -fPIE -gdwarf-4 -Wall2024070420240625
1298902377331 0 094842 788 1752T:refgcc -march=native -mtune=native -Os -fwrapv -fPIC -fPIE -gdwarf-4 -Wall2024070420240625

Test failure


error 111

Number of similar (implementation,compiler) pairs: 9, namely:
ImplementationCompiler
T:avx2clang -march=native -O2 -fwrapv -Qunused-arguments -fPIC -fPIE -gdwarf-4 -Wall (Debian_Clang_11.0.1)
T:avx2clang -march=native -O3 -fwrapv -Qunused-arguments -fPIC -fPIE -gdwarf-4 -Wall (Debian_Clang_11.0.1)
T:avx2clang -march=native -O -fwrapv -Qunused-arguments -fPIC -fPIE -gdwarf-4 -Wall (Debian_Clang_11.0.1)
T:avx2clang -march=native -Os -fwrapv -Qunused-arguments -fPIC -fPIE -gdwarf-4 -Wall (Debian_Clang_11.0.1)
T:avx2clang -mcpu=native -O3 -fwrapv -Qunused-arguments -fPIC -fPIE -gdwarf-4 -Wall (Debian_Clang_11.0.1)
T:avx2gcc -march=native -mtune=native -O2 -fwrapv -fPIC -fPIE -gdwarf-4 -Wall (10.2.1_20210110)
T:avx2gcc -march=native -mtune=native -O3 -fwrapv -fPIC -fPIE -gdwarf-4 -Wall (10.2.1_20210110)
T:avx2gcc -march=native -mtune=native -O -fwrapv -fPIC -fPIE -gdwarf-4 -Wall (10.2.1_20210110)
T:avx2gcc -march=native -mtune=native -Os -fwrapv -fPIC -fPIE -gdwarf-4 -Wall (10.2.1_20210110)

Compiler output


api.c: api.c:110:9: warning: unused variable 'f' [-Wunused-variable]
api.c:         int8_t f[512], g[512], F[512], G[512];
api.c:                ^
api.c: api.c:110:33: warning: unused variable 'G' [-Wunused-variable]
api.c:         int8_t f[512], g[512], F[512], G[512];
api.c:                                        ^
api.c: api.c:110:25: warning: unused variable 'F' [-Wunused-variable]
api.c:         int8_t f[512], g[512], F[512], G[512];
api.c:                                ^
api.c: api.c:110:17: warning: unused variable 'g' [-Wunused-variable]
api.c:         int8_t f[512], g[512], F[512], G[512];
api.c:                        ^
api.c: 4 warnings generated.

Number of similar (implementation,compiler) pairs: 1, namely:
ImplementationCompiler
T:avx2clang -march=native -O2 -fwrapv -Qunused-arguments -fPIC -fPIE -gdwarf-4 -Wall (Debian_Clang_11.0.1)

Compiler output


api.c: api.c:110:9: warning: unused variable 'f' [-Wunused-variable]
api.c:         int8_t f[512], g[512], F[512], G[512];
api.c:                ^
api.c: api.c:110:25: warning: unused variable 'F' [-Wunused-variable]
api.c:         int8_t f[512], g[512], F[512], G[512];
api.c:                                ^
api.c: api.c:110:17: warning: unused variable 'g' [-Wunused-variable]
api.c:         int8_t f[512], g[512], F[512], G[512];
api.c:                        ^
api.c: api.c:110:33: warning: unused variable 'G' [-Wunused-variable]
api.c:         int8_t f[512], g[512], F[512], G[512];
api.c:                                        ^
api.c: 4 warnings generated.

Number of similar (implementation,compiler) pairs: 1, namely:
ImplementationCompiler
T:avx2clang -march=native -O3 -fwrapv -Qunused-arguments -fPIC -fPIE -gdwarf-4 -Wall (Debian_Clang_11.0.1)

Compiler output


api.c: api.c:110:33: warning: unused variable 'G' [-Wunused-variable]
api.c:         int8_t f[512], g[512], F[512], G[512];
api.c:                                        ^
api.c: api.c:110:9: warning: unused variable 'f' [-Wunused-variable]
api.c:         int8_t f[512], g[512], F[512], G[512];
api.c:                ^
api.c: api.c:110:25: warning: unused variable 'F' [-Wunused-variable]
api.c:         int8_t f[512], g[512], F[512], G[512];
api.c:                                ^
api.c: api.c:110:17: warning: unused variable 'g' [-Wunused-variable]
api.c:         int8_t f[512], g[512], F[512], G[512];
api.c:                        ^
api.c: 4 warnings generated.

Number of similar (implementation,compiler) pairs: 1, namely:
ImplementationCompiler
T:avx2clang -march=native -O -fwrapv -Qunused-arguments -fPIC -fPIE -gdwarf-4 -Wall (Debian_Clang_11.0.1)

Compiler output


api.c: api.c:110:25: warning: unused variable 'F' [-Wunused-variable]
api.c:         int8_t f[512], g[512], F[512], G[512];
api.c:                                ^
api.c: api.c:110:9: warning: unused variable 'f' [-Wunused-variable]
api.c:         int8_t f[512], g[512], F[512], G[512];
api.c:                ^
api.c: api.c:110:33: warning: unused variable 'G' [-Wunused-variable]
api.c:         int8_t f[512], g[512], F[512], G[512];
api.c:                                        ^
api.c: api.c:110:17: warning: unused variable 'g' [-Wunused-variable]
api.c:         int8_t f[512], g[512], F[512], G[512];
api.c:                        ^
api.c: 4 warnings generated.

Number of similar (implementation,compiler) pairs: 2, namely:
ImplementationCompiler
T:avx2clang -march=native -Os -fwrapv -Qunused-arguments -fPIC -fPIE -gdwarf-4 -Wall (Debian_Clang_11.0.1)
T:fpuclang -mcpu=native -O3 -fwrapv -Qunused-arguments -fPIC -fPIE -gdwarf-4 -Wall (Debian_Clang_11.0.1)

Compiler output


api.c: api.c:110:25: warning: unused variable 'F' [-Wunused-variable]
api.c:         int8_t f[512], g[512], F[512], G[512];
api.c:                                ^
api.c: api.c:110:33: warning: unused variable 'G' [-Wunused-variable]
api.c:         int8_t f[512], g[512], F[512], G[512];
api.c:                                        ^
api.c: api.c:110:9: warning: unused variable 'f' [-Wunused-variable]
api.c:         int8_t f[512], g[512], F[512], G[512];
api.c:                ^
api.c: api.c:110:17: warning: unused variable 'g' [-Wunused-variable]
api.c:         int8_t f[512], g[512], F[512], G[512];
api.c:                        ^
api.c: 4 warnings generated.

Number of similar (implementation,compiler) pairs: 2, namely:
ImplementationCompiler
T:avx2clang -mcpu=native -O3 -fwrapv -Qunused-arguments -fPIC -fPIE -gdwarf-4 -Wall (Debian_Clang_11.0.1)
T:fpuclang -march=native -Os -fwrapv -Qunused-arguments -fPIC -fPIE -gdwarf-4 -Wall (Debian_Clang_11.0.1)

Compiler output


api.c: api.c: In function 'crypto_sign_falcon512tree_avx2_timingleaks':
api.c: api.c:110:33: warning: unused variable 'G' [-Wunused-variable]
api.c:   110 |  int8_t f[512], g[512], F[512], G[512];
api.c:       |                                 ^
api.c: api.c:110:25: warning: unused variable 'F' [-Wunused-variable]
api.c:   110 |  int8_t f[512], g[512], F[512], G[512];
api.c:       |                         ^
api.c: api.c:110:17: warning: unused variable 'g' [-Wunused-variable]
api.c:   110 |  int8_t f[512], g[512], F[512], G[512];
api.c:       |                 ^
api.c: api.c:110:9: warning: unused variable 'f' [-Wunused-variable]
api.c:   110 |  int8_t f[512], g[512], F[512], G[512];
api.c:       |         ^

Number of similar (implementation,compiler) pairs: 4, namely:
ImplementationCompiler
T:avx2gcc -march=native -mtune=native -O2 -fwrapv -fPIC -fPIE -gdwarf-4 -Wall (10.2.1_20210110)
T:avx2gcc -march=native -mtune=native -O3 -fwrapv -fPIC -fPIE -gdwarf-4 -Wall (10.2.1_20210110)
T:avx2gcc -march=native -mtune=native -O -fwrapv -fPIC -fPIE -gdwarf-4 -Wall (10.2.1_20210110)
T:avx2gcc -march=native -mtune=native -Os -fwrapv -fPIC -fPIE -gdwarf-4 -Wall (10.2.1_20210110)

Compiler output


api.c: api.c:110:33: warning: unused variable 'G' [-Wunused-variable]
api.c:         int8_t f[512], g[512], F[512], G[512];
api.c:                                        ^
api.c: api.c:110:17: warning: unused variable 'g' [-Wunused-variable]
api.c:         int8_t f[512], g[512], F[512], G[512];
api.c:                        ^
api.c: api.c:110:25: warning: unused variable 'F' [-Wunused-variable]
api.c:         int8_t f[512], g[512], F[512], G[512];
api.c:                                ^
api.c: api.c:110:9: warning: unused variable 'f' [-Wunused-variable]
api.c:         int8_t f[512], g[512], F[512], G[512];
api.c:                ^
api.c: 4 warnings generated.

Number of similar (implementation,compiler) pairs: 1, namely:
ImplementationCompiler
T:fpuclang -march=native -O2 -fwrapv -Qunused-arguments -fPIC -fPIE -gdwarf-4 -Wall (Debian_Clang_11.0.1)

Compiler output


api.c: api.c:110:25: warning: unused variable 'F' [-Wunused-variable]
api.c:         int8_t f[512], g[512], F[512], G[512];
api.c:                                ^
api.c: api.c:110:17: warning: unused variable 'g' [-Wunused-variable]
api.c:         int8_t f[512], g[512], F[512], G[512];
api.c:                        ^
api.c: api.c:110:33: warning: unused variable 'G' [-Wunused-variable]
api.c:         int8_t f[512], g[512], F[512], G[512];
api.c:                                        ^
api.c: api.c:110:9: warning: unused variable 'f' [-Wunused-variable]
api.c:         int8_t f[512], g[512], F[512], G[512];
api.c:                ^
api.c: 4 warnings generated.

Number of similar (implementation,compiler) pairs: 1, namely:
ImplementationCompiler
T:fpuclang -march=native -O3 -fwrapv -Qunused-arguments -fPIC -fPIE -gdwarf-4 -Wall (Debian_Clang_11.0.1)

Compiler output


api.c: api.c:110:17: warning: unused variable 'g' [-Wunused-variable]
api.c:         int8_t f[512], g[512], F[512], G[512];
api.c:                        ^
api.c: api.c:110:9: warning: unused variable 'f' [-Wunused-variable]
api.c:         int8_t f[512], g[512], F[512], G[512];
api.c:                ^
api.c: api.c:110:33: warning: unused variable 'G' [-Wunused-variable]
api.c:         int8_t f[512], g[512], F[512], G[512];
api.c:                                        ^
api.c: api.c:110:25: warning: unused variable 'F' [-Wunused-variable]
api.c:         int8_t f[512], g[512], F[512], G[512];
api.c:                                ^
api.c: 4 warnings generated.

Number of similar (implementation,compiler) pairs: 1, namely:
ImplementationCompiler
T:fpuclang -march=native -O -fwrapv -Qunused-arguments -fPIC -fPIE -gdwarf-4 -Wall (Debian_Clang_11.0.1)

Compiler output


api.c: api.c: In function 'crypto_sign_falcon512tree_fpu_timingleaks':
api.c: api.c:110:33: warning: unused variable 'G' [-Wunused-variable]
api.c:   110 |  int8_t f[512], g[512], F[512], G[512];
api.c:       |                                 ^
api.c: api.c:110:25: warning: unused variable 'F' [-Wunused-variable]
api.c:   110 |  int8_t f[512], g[512], F[512], G[512];
api.c:       |                         ^
api.c: api.c:110:17: warning: unused variable 'g' [-Wunused-variable]
api.c:   110 |  int8_t f[512], g[512], F[512], G[512];
api.c:       |                 ^
api.c: api.c:110:9: warning: unused variable 'f' [-Wunused-variable]
api.c:   110 |  int8_t f[512], g[512], F[512], G[512];
api.c:       |         ^

Number of similar (implementation,compiler) pairs: 4, namely:
ImplementationCompiler
T:fpugcc -march=native -mtune=native -O2 -fwrapv -fPIC -fPIE -gdwarf-4 -Wall (10.2.1_20210110)
T:fpugcc -march=native -mtune=native -O3 -fwrapv -fPIC -fPIE -gdwarf-4 -Wall (10.2.1_20210110)
T:fpugcc -march=native -mtune=native -O -fwrapv -fPIC -fPIE -gdwarf-4 -Wall (10.2.1_20210110)
T:fpugcc -march=native -mtune=native -Os -fwrapv -fPIC -fPIE -gdwarf-4 -Wall (10.2.1_20210110)

Compiler output


api.c: api.c:107:9: warning: unused variable 'f' [-Wunused-variable]
api.c:         int8_t f[512], g[512], F[512], G[512];
api.c:                ^
api.c: api.c:107:17: warning: unused variable 'g' [-Wunused-variable]
api.c:         int8_t f[512], g[512], F[512], G[512];
api.c:                        ^
api.c: api.c:107:25: warning: unused variable 'F' [-Wunused-variable]
api.c:         int8_t f[512], g[512], F[512], G[512];
api.c:                                ^
api.c: api.c:107:33: warning: unused variable 'G' [-Wunused-variable]
api.c:         int8_t f[512], g[512], F[512], G[512];
api.c:                                        ^
api.c: 4 warnings generated.

Number of similar (implementation,compiler) pairs: 5, namely:
ImplementationCompiler
T:refclang -march=native -O2 -fwrapv -Qunused-arguments -fPIC -fPIE -gdwarf-4 -Wall (Debian_Clang_11.0.1)
T:refclang -march=native -O3 -fwrapv -Qunused-arguments -fPIC -fPIE -gdwarf-4 -Wall (Debian_Clang_11.0.1)
T:refclang -march=native -O -fwrapv -Qunused-arguments -fPIC -fPIE -gdwarf-4 -Wall (Debian_Clang_11.0.1)
T:refclang -march=native -Os -fwrapv -Qunused-arguments -fPIC -fPIE -gdwarf-4 -Wall (Debian_Clang_11.0.1)
T:refclang -mcpu=native -O3 -fwrapv -Qunused-arguments -fPIC -fPIE -gdwarf-4 -Wall (Debian_Clang_11.0.1)

Compiler output


api.c: api.c: In function 'crypto_sign_falcon512tree_ref_timingleaks':
api.c: api.c:107:33: warning: unused variable 'G' [-Wunused-variable]
api.c:   107 |  int8_t f[512], g[512], F[512], G[512];
api.c:       |                                 ^
api.c: api.c:107:25: warning: unused variable 'F' [-Wunused-variable]
api.c:   107 |  int8_t f[512], g[512], F[512], G[512];
api.c:       |                         ^
api.c: api.c:107:17: warning: unused variable 'g' [-Wunused-variable]
api.c:   107 |  int8_t f[512], g[512], F[512], G[512];
api.c:       |                 ^
api.c: api.c:107:9: warning: unused variable 'f' [-Wunused-variable]
api.c:   107 |  int8_t f[512], g[512], F[512], G[512];
api.c:       |         ^

Number of similar (implementation,compiler) pairs: 4, namely:
ImplementationCompiler
T:refgcc -march=native -mtune=native -O2 -fwrapv -fPIC -fPIE -gdwarf-4 -Wall (10.2.1_20210110)
T:refgcc -march=native -mtune=native -O3 -fwrapv -fPIC -fPIE -gdwarf-4 -Wall (10.2.1_20210110)
T:refgcc -march=native -mtune=native -O -fwrapv -fPIC -fPIE -gdwarf-4 -Wall (10.2.1_20210110)
T:refgcc -march=native -mtune=native -Os -fwrapv -fPIC -fPIE -gdwarf-4 -Wall (10.2.1_20210110)