Test results for amd64, jasper, crypto_kem/sntrup953

[Page version: 20241023 21:19:00]

Measurements for amd64, jasper, crypto_kem Test results for amd64, jasper, crypto_kem Test results for crypto_kem/sntrup953

Computer: jasper
Microarchitecture: amd64; Tremont (906c0)
Architecture: amd64
CPU ID: GenuineIntel-000906c0-20-bfebfbff
SUPERCOP version: 20241022
Operation: crypto_kem
Primitive: sntrup953

Time	Object size	Test size	Implementation	Compiler	Benchmark date	SUPERCOP version
1653595	5592 0 0	63883 828 1720	`T:factored`	`clang -march=native -O3 -fwrapv -Qunused-arguments -fPIC -fPIE -gdwarf-4 -Wall`	20241017	20241011
1659456	1950 0 0	56241 820 1720	`T:factored`	`clang -march=native -Os -fwrapv -Qunused-arguments -fPIC -fPIE -gdwarf-4 -Wall`	20241017	20241011
1660656	2298 0 0	57081 820 1720	`T:factored`	`clang -march=native -O -fwrapv -Qunused-arguments -fPIC -fPIE -gdwarf-4 -Wall`	20241017	20241011
1664575	4016 0 0	60035 828 1720	`T:factored`	`clang -march=native -O2 -fwrapv -Qunused-arguments -fPIC -fPIE -gdwarf-4 -Wall`	20241017	20241011
1680052	1785 0 0	55656 804 1720	`T:factored`	`gcc -march=native -mtune=native -Os -fwrapv -fPIC -fPIE -gdwarf-4 -Wall`	20241017	20241011
1689038	2395 0 0	58688 812 1752	`T:factored`	`gcc -march=native -mtune=native -O2 -fwrapv -fPIC -fPIE -gdwarf-4 -Wall`	20241017	20241011
1695298	5882 0 0	63256 812 1752	`T:factored`	`gcc -march=native -mtune=native -O3 -fwrapv -fPIC -fPIE -gdwarf-4 -Wall`	20241017	20241011
1699056	1946 0 0	57672 812 1752	`T:factored`	`gcc -march=native -mtune=native -O -fwrapv -fPIC -fPIE -gdwarf-4 -Wall`	20241017	20241011
1706034	5995 0 0	62931 828 1720	`T:factored`	`clang -mcpu=native -O3 -fwrapv -Qunused-arguments -fPIC -fPIE -gdwarf-4 -Wall`	20241017	20241011
1720286	5995 0 0	63227 828 1720	`factored`	`clang -mcpu=native -O3 -fwrapv -Qunused-arguments -fPIC -fPIE -gdwarf-4 -Wall`	20241017	20241011
1723368	1950 0 0	56537 820 1720	`factored`	`clang -march=native -Os -fwrapv -Qunused-arguments -fPIC -fPIE -gdwarf-4 -Wall`	20241017	20241011
1724178	2395 0 0	58984 812 1752	`factored`	`gcc -march=native -mtune=native -O2 -fwrapv -fPIC -fPIE -gdwarf-4 -Wall`	20241017	20241011
1725095	5592 0 0	64179 828 1720	`factored`	`clang -march=native -O3 -fwrapv -Qunused-arguments -fPIC -fPIE -gdwarf-4 -Wall`	20241017	20241011
1726106	5882 0 0	63552 812 1752	`factored`	`gcc -march=native -mtune=native -O3 -fwrapv -fPIC -fPIE -gdwarf-4 -Wall`	20241017	20241011
1726514	2298 0 0	57377 820 1720	`factored`	`clang -march=native -O -fwrapv -Qunused-arguments -fPIC -fPIE -gdwarf-4 -Wall`	20241017	20241011
1727644	1785 0 0	55952 804 1720	`factored`	`gcc -march=native -mtune=native -Os -fwrapv -fPIC -fPIE -gdwarf-4 -Wall`	20241017	20241011
1733061	1946 0 0	57968 812 1752	`factored`	`gcc -march=native -mtune=native -O -fwrapv -fPIC -fPIE -gdwarf-4 -Wall`	20241017	20241011
1742788	4016 0 0	60331 828 1720	`factored`	`clang -march=native -O2 -fwrapv -Qunused-arguments -fPIC -fPIE -gdwarf-4 -Wall`	20241017	20241011
2393382	20452 0 0	39435 828 1720	`T:compact`	`clang -march=native -O2 -fwrapv -Qunused-arguments -fPIC -fPIE -gdwarf-4 -Wall`	20241017	20241011
2430282	49553 0 0	70819 828 1720	`T:compact`	`clang -march=native -O3 -fwrapv -Qunused-arguments -fPIC -fPIE -gdwarf-4 -Wall`	20241017	20241011
2448248	20452 0 0	39739 828 1720	`compact`	`clang -march=native -O2 -fwrapv -Qunused-arguments -fPIC -fPIE -gdwarf-4 -Wall`	20241017	20241011
2488880	49553 0 0	71123 828 1720	`compact`	`clang -march=native -O3 -fwrapv -Qunused-arguments -fPIC -fPIE -gdwarf-4 -Wall`	20241017	20241011
2600817	24545 0 0	45570 820 1752	`T:compact`	`gcc -march=native -mtune=native -O3 -fwrapv -fPIC -fPIE -gdwarf-4 -Wall`	20241017	20241011
2667834	24545 0 0	45866 820 1752	`compact`	`gcc -march=native -mtune=native -O3 -fwrapv -fPIC -fPIE -gdwarf-4 -Wall`	20241017	20241011
5567908	27746 0 0	47827 828 1720	`T:compact`	`clang -mcpu=native -O3 -fwrapv -Qunused-arguments -fPIC -fPIE -gdwarf-4 -Wall`	20241017	20241011
5637519	27746 0 0	48131 828 1720	`compact`	`clang -mcpu=native -O3 -fwrapv -Qunused-arguments -fPIC -fPIE -gdwarf-4 -Wall`	20241017	20241011
10964342	6386 0 0	24049 820 1720	`T:compact`	`clang -march=native -Os -fwrapv -Qunused-arguments -fPIC -fPIE -gdwarf-4 -Wall`	20241017	20241011
11086792	8076 0 0	26553 820 1720	`T:compact`	`clang -march=native -O -fwrapv -Qunused-arguments -fPIC -fPIE -gdwarf-4 -Wall`	20241017	20241011
11096122	6386 0 0	24353 820 1720	`compact`	`clang -march=native -Os -fwrapv -Qunused-arguments -fPIC -fPIE -gdwarf-4 -Wall`	20241017	20241011
11127633	8076 0 0	26857 820 1720	`compact`	`clang -march=native -O -fwrapv -Qunused-arguments -fPIC -fPIE -gdwarf-4 -Wall`	20241017	20241011
11949320	8047 0 0	27874 820 1752	`T:compact`	`gcc -march=native -mtune=native -O2 -fwrapv -fPIC -fPIE -gdwarf-4 -Wall`	20241017	20241011
12000612	8047 0 0	28178 820 1752	`compact`	`gcc -march=native -mtune=native -O2 -fwrapv -fPIC -fPIE -gdwarf-4 -Wall`	20241017	20241011
12178830	6272 0 0	25544 812 1752	`T:compact`	`gcc -march=native -mtune=native -O -fwrapv -fPIC -fPIE -gdwarf-4 -Wall`	20241017	20241011
12240012	6272 0 0	25848 812 1752	`compact`	`gcc -march=native -mtune=native -O -fwrapv -fPIC -fPIE -gdwarf-4 -Wall`	20241017	20241011
13787765	5188 0 0	22946 812 1720	`compact`	`gcc -march=native -mtune=native -Os -fwrapv -fPIC -fPIE -gdwarf-4 -Wall`	20241017	20241011
13855710	5188 0 0	22642 812 1720	`T:compact`	`gcc -march=native -mtune=native -Os -fwrapv -fPIC -fPIE -gdwarf-4 -Wall`	20241017	20241011
235157968	19295 0 0	40554 820 1752	`ref`	`gcc -march=native -mtune=native -O3 -fwrapv -fPIC -fPIE -gdwarf-4 -Wall`	20241017	20241011
235206184	19295 0 0	40258 820 1752	`T:ref`	`gcc -march=native -mtune=native -O3 -fwrapv -fPIC -fPIE -gdwarf-4 -Wall`	20241017	20241011
238535147	24427 0 0	46115 828 1720	`T:ref`	`clang -march=native -O3 -fwrapv -Qunused-arguments -fPIC -fPIE -gdwarf-4 -Wall`	20241017	20241011
238612444	13378 0 0	32851 828 1720	`T:ref`	`clang -march=native -O2 -fwrapv -Qunused-arguments -fPIC -fPIE -gdwarf-4 -Wall`	20241017	20241011
238667517	24427 0 0	46419 828 1720	`ref`	`clang -march=native -O3 -fwrapv -Qunused-arguments -fPIC -fPIE -gdwarf-4 -Wall`	20241017	20241011
238710757	13378 0 0	33155 828 1720	`ref`	`clang -march=native -O2 -fwrapv -Qunused-arguments -fPIC -fPIE -gdwarf-4 -Wall`	20241017	20241011
247205443	20242 0 0	40875 828 1720	`ref`	`clang -mcpu=native -O3 -fwrapv -Qunused-arguments -fPIC -fPIE -gdwarf-4 -Wall`	20241017	20241011
247924043	20242 0 0	40571 828 1720	`T:ref`	`clang -mcpu=native -O3 -fwrapv -Qunused-arguments -fPIC -fPIE -gdwarf-4 -Wall`	20241017	20241011
266162831	9016 0 0	28874 820 1752	`T:ref`	`gcc -march=native -mtune=native -O2 -fwrapv -fPIC -fPIE -gdwarf-4 -Wall`	20241017	20241011
266303245	9016 0 0	29178 820 1752	`ref`	`gcc -march=native -mtune=native -O2 -fwrapv -fPIC -fPIE -gdwarf-4 -Wall`	20241017	20241011
284408691	7063 0 0	26304 812 1752	`T:ref`	`gcc -march=native -mtune=native -O -fwrapv -fPIC -fPIE -gdwarf-4 -Wall`	20241017	20241011
284724597	7063 0 0	26608 812 1752	`ref`	`gcc -march=native -mtune=native -O -fwrapv -fPIC -fPIE -gdwarf-4 -Wall`	20241017	20241011
287726898	6180 0 0	23618 812 1720	`T:ref`	`gcc -march=native -mtune=native -Os -fwrapv -fPIC -fPIE -gdwarf-4 -Wall`	20241017	20241011
288066371	6180 0 0	23922 812 1720	`ref`	`gcc -march=native -mtune=native -Os -fwrapv -fPIC -fPIE -gdwarf-4 -Wall`	20241017	20241011
289994597	6449 0 0	24433 820 1720	`ref`	`clang -march=native -Os -fwrapv -Qunused-arguments -fPIC -fPIE -gdwarf-4 -Wall`	20241017	20241011
290057830	6449 0 0	24129 820 1720	`T:ref`	`clang -march=native -Os -fwrapv -Qunused-arguments -fPIC -fPIE -gdwarf-4 -Wall`	20241017	20241011
324980466	8861 0 0	27329 820 1720	`T:ref`	`clang -march=native -O -fwrapv -Qunused-arguments -fPIC -fPIE -gdwarf-4 -Wall`	20241017	20241011
325020318	8861 0 0	27633 820 1720	`ref`	`clang -march=native -O -fwrapv -Qunused-arguments -fPIC -fPIE -gdwarf-4 -Wall`	20241017	20241011

Test failure

error 111

Number of similar (implementation,compiler) pairs: 8, namely:

Implementation	Compiler
`avx`	`gcc -march=native -mtune=native -O2 -fwrapv -fPIC -fPIE -gdwarf-4 -Wall (10.2.1_20210110)`
`T:avx`	`gcc -march=native -mtune=native -O2 -fwrapv -fPIC -fPIE -gdwarf-4 -Wall (10.2.1_20210110)`
`avx`	`gcc -march=native -mtune=native -O3 -fwrapv -fPIC -fPIE -gdwarf-4 -Wall (10.2.1_20210110)`
`T:avx`	`gcc -march=native -mtune=native -O3 -fwrapv -fPIC -fPIE -gdwarf-4 -Wall (10.2.1_20210110)`
`avx`	`gcc -march=native -mtune=native -O -fwrapv -fPIC -fPIE -gdwarf-4 -Wall (10.2.1_20210110)`
`T:avx`	`gcc -march=native -mtune=native -O -fwrapv -fPIC -fPIE -gdwarf-4 -Wall (10.2.1_20210110)`
`avx`	`gcc -march=native -mtune=native -Os -fwrapv -fPIC -fPIE -gdwarf-4 -Wall (10.2.1_20210110)`
`T:avx`	`gcc -march=native -mtune=native -Os -fwrapv -fPIC -fPIE -gdwarf-4 -Wall (10.2.1_20210110)`

Compiler output

crypto_kem_sntrup953_factored_kem.S: crypto_kem_sntrup953_factored_kem.S:878:2: error: changed section flags for .rodata.cst32, expected: 0x12
crypto_kem_sntrup953_factored_kem.S:  .section .rodata.cst32
crypto_kem_sntrup953_factored_kem.S:  ^
crypto_kem_sntrup953_factored_kem.S: crypto_kem_sntrup953_factored_kem.S:878:2: error: changed section entsize for .rodata.cst32, expected: 32
crypto_kem_sntrup953_factored_kem.S:  .section .rodata.cst32
crypto_kem_sntrup953_factored_kem.S:  ^
crypto_kem_sntrup953_factored_kem.S: crypto_kem_sntrup953_factored_kem.S:899:2: error: changed section flags for .rodata.cst16, expected: 0x12
crypto_kem_sntrup953_factored_kem.S:  .section .rodata.cst16
crypto_kem_sntrup953_factored_kem.S:  ^
crypto_kem_sntrup953_factored_kem.S: crypto_kem_sntrup953_factored_kem.S:899:2: error: changed section entsize for .rodata.cst16, expected: 16
crypto_kem_sntrup953_factored_kem.S:  .section .rodata.cst16
crypto_kem_sntrup953_factored_kem.S:  ^
crypto_kem_sntrup953_factored_kem.S: crypto_kem_sntrup953_factored_kem.S:912:2: error: changed section flags for .rodata.cst32, expected: 0x12
crypto_kem_sntrup953_factored_kem.S:  .section .rodata.cst32
crypto_kem_sntrup953_factored_kem.S:  ^
crypto_kem_sntrup953_factored_kem.S: crypto_kem_sntrup953_factored_kem.S:912:2: error: changed section entsize for .rodata.cst32, expected: 32
crypto_kem_sntrup953_factored_kem.S:  .section .rodata.cst32
crypto_kem_sntrup953_factored_kem.S:  ^
crypto_kem_sntrup953_factored_kem.S: crypto_kem_sntrup953_factored_kem.S:975:2: error: changed section flags for .rodata.cst16, expected: 0x12
crypto_kem_sntrup953_factored_kem.S:  .section .rodata.cst16
crypto_kem_sntrup953_factored_kem.S:  ^
crypto_kem_sntrup953_factored_kem.S: crypto_kem_sntrup953_factored_kem.S:975:2: error: changed section entsize for .rodata.cst16, expected: 16
crypto_kem_sntrup953_factored_kem.S:  .section .rodata.cst16
crypto_kem_sntrup953_factored_kem.S:  ^
crypto_kem_sntrup953_factored_kem.S: crypto_kem_sntrup953_factored_kem.S:1010:2: error: changed section flags for .rodata.cst32, expected: 0x12
crypto_kem_sntrup953_factored_kem.S: ...

Number of similar (implementation,compiler) pairs: 10, namely:

Implementation	Compiler
`avx`	`clang -march=native -O2 -fwrapv -Qunused-arguments -fPIC -fPIE -gdwarf-4 -Wall (Debian_Clang_11.0.1)`
`T:avx`	`clang -march=native -O2 -fwrapv -Qunused-arguments -fPIC -fPIE -gdwarf-4 -Wall (Debian_Clang_11.0.1)`
`avx`	`clang -march=native -O3 -fwrapv -Qunused-arguments -fPIC -fPIE -gdwarf-4 -Wall (Debian_Clang_11.0.1)`
`T:avx`	`clang -march=native -O3 -fwrapv -Qunused-arguments -fPIC -fPIE -gdwarf-4 -Wall (Debian_Clang_11.0.1)`
`avx`	`clang -march=native -O -fwrapv -Qunused-arguments -fPIC -fPIE -gdwarf-4 -Wall (Debian_Clang_11.0.1)`
`T:avx`	`clang -march=native -O -fwrapv -Qunused-arguments -fPIC -fPIE -gdwarf-4 -Wall (Debian_Clang_11.0.1)`
`avx`	`clang -march=native -Os -fwrapv -Qunused-arguments -fPIC -fPIE -gdwarf-4 -Wall (Debian_Clang_11.0.1)`
`T:avx`	`clang -march=native -Os -fwrapv -Qunused-arguments -fPIC -fPIE -gdwarf-4 -Wall (Debian_Clang_11.0.1)`
`avx`	`clang -mcpu=native -O3 -fwrapv -Qunused-arguments -fPIC -fPIE -gdwarf-4 -Wall (Debian_Clang_11.0.1)`
`T:avx`	`clang -mcpu=native -O3 -fwrapv -Qunused-arguments -fPIC -fPIE -gdwarf-4 -Wall (Debian_Clang_11.0.1)`

Passed TIMECOP

TIMECOP iterations: 1

Number of similar (implementation,compiler) pairs: 27, namely:

Implementation	Compiler
`compact`	`clang -march=native -O2 -fwrapv -Qunused-arguments -fPIC -fPIE -gdwarf-4 -Wall (Debian_Clang_11.0.1)`
`compact`	`clang -march=native -O3 -fwrapv -Qunused-arguments -fPIC -fPIE -gdwarf-4 -Wall (Debian_Clang_11.0.1)`
`compact`	`clang -march=native -O -fwrapv -Qunused-arguments -fPIC -fPIE -gdwarf-4 -Wall (Debian_Clang_11.0.1)`
`compact`	`clang -march=native -Os -fwrapv -Qunused-arguments -fPIC -fPIE -gdwarf-4 -Wall (Debian_Clang_11.0.1)`
`compact`	`clang -mcpu=native -O3 -fwrapv -Qunused-arguments -fPIC -fPIE -gdwarf-4 -Wall (Debian_Clang_11.0.1)`
`compact`	`gcc -march=native -mtune=native -O2 -fwrapv -fPIC -fPIE -gdwarf-4 -Wall (10.2.1_20210110)`
`compact`	`gcc -march=native -mtune=native -O3 -fwrapv -fPIC -fPIE -gdwarf-4 -Wall (10.2.1_20210110)`
`compact`	`gcc -march=native -mtune=native -O -fwrapv -fPIC -fPIE -gdwarf-4 -Wall (10.2.1_20210110)`
`compact`	`gcc -march=native -mtune=native -Os -fwrapv -fPIC -fPIE -gdwarf-4 -Wall (10.2.1_20210110)`
`factored`	`clang -march=native -O2 -fwrapv -Qunused-arguments -fPIC -fPIE -gdwarf-4 -Wall (Debian_Clang_11.0.1)`
`factored`	`clang -march=native -O3 -fwrapv -Qunused-arguments -fPIC -fPIE -gdwarf-4 -Wall (Debian_Clang_11.0.1)`
`factored`	`clang -march=native -O -fwrapv -Qunused-arguments -fPIC -fPIE -gdwarf-4 -Wall (Debian_Clang_11.0.1)`
`factored`	`clang -march=native -Os -fwrapv -Qunused-arguments -fPIC -fPIE -gdwarf-4 -Wall (Debian_Clang_11.0.1)`
`factored`	`clang -mcpu=native -O3 -fwrapv -Qunused-arguments -fPIC -fPIE -gdwarf-4 -Wall (Debian_Clang_11.0.1)`
`factored`	`gcc -march=native -mtune=native -O2 -fwrapv -fPIC -fPIE -gdwarf-4 -Wall (10.2.1_20210110)`
`factored`	`gcc -march=native -mtune=native -O3 -fwrapv -fPIC -fPIE -gdwarf-4 -Wall (10.2.1_20210110)`
`factored`	`gcc -march=native -mtune=native -O -fwrapv -fPIC -fPIE -gdwarf-4 -Wall (10.2.1_20210110)`
`factored`	`gcc -march=native -mtune=native -Os -fwrapv -fPIC -fPIE -gdwarf-4 -Wall (10.2.1_20210110)`
`ref`	`clang -march=native -O2 -fwrapv -Qunused-arguments -fPIC -fPIE -gdwarf-4 -Wall (Debian_Clang_11.0.1)`
`ref`	`clang -march=native -O3 -fwrapv -Qunused-arguments -fPIC -fPIE -gdwarf-4 -Wall (Debian_Clang_11.0.1)`
`ref`	`clang -march=native -O -fwrapv -Qunused-arguments -fPIC -fPIE -gdwarf-4 -Wall (Debian_Clang_11.0.1)`
`ref`	`clang -march=native -Os -fwrapv -Qunused-arguments -fPIC -fPIE -gdwarf-4 -Wall (Debian_Clang_11.0.1)`
`ref`	`clang -mcpu=native -O3 -fwrapv -Qunused-arguments -fPIC -fPIE -gdwarf-4 -Wall (Debian_Clang_11.0.1)`
`ref`	`gcc -march=native -mtune=native -O2 -fwrapv -fPIC -fPIE -gdwarf-4 -Wall (10.2.1_20210110)`
`ref`	`gcc -march=native -mtune=native -O3 -fwrapv -fPIC -fPIE -gdwarf-4 -Wall (10.2.1_20210110)`
`ref`	`gcc -march=native -mtune=native -O -fwrapv -fPIC -fPIE -gdwarf-4 -Wall (10.2.1_20210110)`
`ref`	`gcc -march=native -mtune=native -Os -fwrapv -fPIC -fPIE -gdwarf-4 -Wall (10.2.1_20210110)`