Implementation notes: amd64, gpu, crypto_sign/mqqsig256

Computer: gpu
Architecture: amd64
CPU ID: GenuineIntel-000206d7-bfebfbff
SUPERCOP version: 20190816
Operation: crypto_sign
Primitive: mqqsig256
TimeObject sizeTest sizeImplementationCompilerBenchmark dateSUPERCOP version
121420? ? ?? ? ?refgcc_-march=native_-mtune=native_-O3_-fomit-frame-pointer_-fwrapv2019090620190816
178764? ? ?? ? ?refgcc_-m64_-march=native_-mtune=native_-O2_-fomit-frame-pointer2019090620190816
179660? ? ?? ? ?refgcc_-m64_-march=core-avx-i_-O3_-fomit-frame-pointer2019090620190816
180096? ? ?? ? ?refgcc_-m64_-march=corei7-avx_-O3_-fomit-frame-pointer2019090620190816
182541? ? ?? ? ?refgcc_-march=native_-mtune=native_-O2_-fomit-frame-pointer_-fwrapv2019090620190816
183584? ? ?? ? ?refgcc_-m64_-march=native_-mtune=native_-O3_-fomit-frame-pointer2019090620190816
183612? ? ?? ? ?refgcc_-m64_-march=core2_-msse4.1_-O2_-fomit-frame-pointer2019090620190816
18412540240 0 061051 800 133672refclang_-O3_-fwrapv_-mavx_-maes_-mpclmul_-fomit-frame-pointer_-Qunused-arguments2019090620190816
184458? ? ?? ? ?refgcc_-m64_-march=core2_-O3_-fomit-frame-pointer2019090620190816
184728? ? ?? ? ?refgcc_-m64_-march=core2_-msse4.1_-O3_-fomit-frame-pointer2019090620190816
185019? ? ?? ? ?refgcc_-m64_-march=corei7_-O3_-fomit-frame-pointer2019090620190816
186072? ? ?? ? ?refgcc_-m64_-march=core-avx-i_-O2_-fomit-frame-pointer2019090620190816
187194? ? ?? ? ?refgcc_-m64_-march=core2_-O2_-fomit-frame-pointer2019090620190816
188568? ? ?? ? ?refgcc_-m64_-march=corei7_-O2_-fomit-frame-pointer2019090620190816
190164? ? ?? ? ?refgcc_-m64_-march=core2_-msse4_-O2_-fomit-frame-pointer2019090620190816
190580? ? ?? ? ?refgcc_-m64_-march=core2_-msse4_-O3_-fomit-frame-pointer2019090620190816
19328750938 0 072491 800 133672refclang_-march=native_-O3_-fomit-frame-pointer_-fwrapv_-Qunused-arguments2019090620190816
195258? ? ?? ? ?refgcc_-m64_-march=corei7-avx_-O2_-fomit-frame-pointer2019090620190816
195297? ? ?? ? ?refgcc_-m64_-march=core2_-msse4.1_-O_-fomit-frame-pointer2019090620190816
196695? ? ?? ? ?refgcc_-m64_-march=corei7-avx_-Os_-fomit-frame-pointer2019090620190816
198474? ? ?? ? ?refgcc_-m64_-march=core-avx-i_-Os_-fomit-frame-pointer2019090620190816
199188? ? ?? ? ?refgcc_-m64_-march=native_-mtune=native_-Os_-fomit-frame-pointer2019090620190816
20023250938 0 072491 800 133672refclang_-O3_-fwrapv_-march=native_-fomit-frame-pointer_-Qunused-arguments2019090620190816
204028? ? ?? ? ?refgcc_-m64_-march=core2_-msse4_-O_-fomit-frame-pointer2019090620190816
204996? ? ?? ? ?refgcc_-m64_-march=corei7_-O_-fomit-frame-pointer2019090620190816
205902? ? ?? ? ?refgcc_-m64_-march=core2_-Os_-fomit-frame-pointer2019090620190816
206244? ? ?? ? ?refgcc_-march=native_-mtune=native_-Os_-fomit-frame-pointer_-fwrapv2019090620190816
206670? ? ?? ? ?refgcc_-m64_-march=core2_-O_-fomit-frame-pointer2019090620190816
206931? ? ?? ? ?refgcc_-m64_-march=core2_-msse4.1_-Os_-fomit-frame-pointer2019090620190816
20710040240 0 061051 800 133672refclang_-O3_-fwrapv_-mavx_-fomit-frame-pointer_-Qunused-arguments2019090620190816
208047? ? ?? ? ?refgcc_-m64_-march=corei7_-Os_-fomit-frame-pointer2019090620190816
208053? ? ?? ? ?refgcc_-m64_-march=core2_-msse4_-Os_-fomit-frame-pointer2019090620190816
217254? ? ?? ? ?refgcc_-march=native_-mtune=native_-O_-fomit-frame-pointer_-fwrapv2019090620190816
301512? ? ?? ? ?refgcc_-O3_-fomit-frame-pointer2019090620190816
305756? ? ?? ? ?refgcc_-march=nocona_-O3_-fomit-frame-pointer2019090620190816
306156? ? ?? ? ?refgcc_-funroll-loops_-march=barcelona_-O3_-fomit-frame-pointer2019090620190816
306858? ? ?? ? ?refgcc_-funroll-loops_-fno-schedule-insns_-O3_-fomit-frame-pointer2019090620190816
307143? ? ?? ? ?refgcc_-funroll-loops_-m64_-march=k8_-O3_-fomit-frame-pointer2019090620190816
317660? ? ?? ? ?refgcc_-m64_-O3_-fomit-frame-pointer2019090620190816
317751? ? ?? ? ?refgcc_-march=k8_-O3_-fomit-frame-pointer2019090620190816
321172? ? ?? ? ?refgcc_-march=barcelona_-O3_-fomit-frame-pointer2019090620190816
324072? ? ?? ? ?refgcc_-m64_-march=barcelona_-O3_-fomit-frame-pointer2019090620190816
324236? ? ?? ? ?refgcc_-funroll-loops_-O3_-fomit-frame-pointer2019090620190816
325164? ? ?? ? ?refgcc_-m64_-march=nocona_-O3_-fomit-frame-pointer2019090620190816
325996? ? ?? ? ?refgcc_-m64_-march=k8_-O3_-fomit-frame-pointer2019090620190816
327969? ? ?? ? ?refgcc_-funroll-loops_-march=k8_-O3_-fomit-frame-pointer2019090620190816
328452? ? ?? ? ?refgcc_-funroll-loops_-m64_-march=barcelona_-O3_-fomit-frame-pointer2019090620190816
335048? ? ?? ? ?refgcc_-funroll-loops_-m64_-march=nocona_-O3_-fomit-frame-pointer2019090620190816
347120? ? ?? ? ?refgcc_-funroll-loops_-m64_-O3_-fomit-frame-pointer2019090620190816
354556? ? ?? ? ?refgcc_-fno-schedule-insns_-O3_-fomit-frame-pointer2019090620190816
362772? ? ?? ? ?refgcc_-m64_-march=corei7-avx_-O_-fomit-frame-pointer2019090620190816
363452? ? ?? ? ?refgcc_-funroll-loops_-march=nocona_-O3_-fomit-frame-pointer2019090620190816
375880? ? ?? ? ?refgcc_-m64_-march=core-avx-i_-O_-fomit-frame-pointer2019090620190816
382812? ? ?? ? ?refgcc_-m64_-march=native_-mtune=native_-O_-fomit-frame-pointer2019090620190816
62344854305 0 078123 800 133320refclang_-mcpu=cortex-a8_-mfpu=neon_-O3_-fomit-frame-pointer_-fwrapv_-Qunused-arguments2019090620190816
64872654305 0 078123 800 133320refclang_-mcpu=native_-mfpu=neon_-O3_-fomit-frame-pointer_-fwrapv_-Qunused-arguments2019090620190816
66578854305 0 078123 800 133320refclang_-mcpu=cortex-a9_-mfpu=neon_-O3_-fomit-frame-pointer_-fwrapv_-Qunused-arguments2019090620190816
67448452753 0 075243 800 133320refclang_-O3_-fomit-frame-pointer_-Qunused-arguments2019090620190816
680973? ? ?? ? ?refgcc_-funroll-loops_-march=k8_-O2_-fomit-frame-pointer2019090620190816
696162? ? ?? ? ?refgcc_-funroll-loops_-fno-schedule-insns_-O2_-fomit-frame-pointer2019090620190816
698805? ? ?? ? ?refgcc_-funroll-loops_-march=nocona_-O2_-fomit-frame-pointer2019090620190816
702180? ? ?? ? ?refgcc_-funroll-loops_-march=barcelona_-O_-fomit-frame-pointer2019090620190816
704808? ? ?? ? ?refgcc_-funroll-loops_-m64_-march=nocona_-O2_-fomit-frame-pointer2019090620190816
707868? ? ?? ? ?refgcc_-funroll-loops_-m64_-march=barcelona_-O_-fomit-frame-pointer2019090620190816
709412? ? ?? ? ?refgcc_-funroll-loops_-march=barcelona_-O2_-fomit-frame-pointer2019090620190816
709770? ? ?? ? ?refgcc_-funroll-loops_-O2_-fomit-frame-pointer2019090620190816
724292? ? ?? ? ?refgcc_-funroll-loops_-m64_-march=barcelona_-O2_-fomit-frame-pointer2019090620190816
724468? ? ?? ? ?refgcc_-funroll-loops_-m64_-O_-fomit-frame-pointer2019090620190816
726196? ? ?? ? ?refgcc_-funroll-loops_-m64_-march=k8_-O2_-fomit-frame-pointer2019090620190816
733020? ? ?? ? ?refgcc_-funroll-loops_-march=nocona_-O_-fomit-frame-pointer2019090620190816
737313? ? ?? ? ?refgcc_-funroll-loops_-m64_-march=k8_-O_-fomit-frame-pointer2019090620190816
746224? ? ?? ? ?refgcc_-funroll-loops_-m64_-O2_-fomit-frame-pointer2019090620190816
752036? ? ?? ? ?refgcc_-funroll-loops_-fno-schedule-insns_-O_-fomit-frame-pointer2019090620190816
758187? ? ?? ? ?refgcc_-funroll-loops_-m64_-march=nocona_-O_-fomit-frame-pointer2019090620190816
758907? ? ?? ? ?refgcc_-funroll-loops_-O_-fomit-frame-pointer2019090620190816
799796? ? ?? ? ?refgcc_-funroll-loops_-march=k8_-O_-fomit-frame-pointer2019090620190816
885870? ? ?? ? ?refgcc_-m64_-march=barcelona_-O2_-fomit-frame-pointer2019090620190816
894858? ? ?? ? ?refgcc_-m64_-march=barcelona_-O_-fomit-frame-pointer2019090620190816
902730? ? ?? ? ?refgcc_-O_-fomit-frame-pointer2019090620190816
904365? ? ?? ? ?refgcc_-march=barcelona_-O_-fomit-frame-pointer2019090620190816
905592? ? ?? ? ?refgcc_-march=nocona_-O2_-fomit-frame-pointer2019090620190816
910092? ? ?? ? ?refgcc_-march=nocona_-O_-fomit-frame-pointer2019090620190816
910372? ? ?? ? ?refgcc_-m64_-march=nocona_-O2_-fomit-frame-pointer2019090620190816
912546? ? ?? ? ?refgcc_-m64_-march=nocona_-O_-fomit-frame-pointer2019090620190816
913952? ? ?? ? ?refgcc_-m64_-march=k8_-O2_-fomit-frame-pointer2019090620190816
914001? ? ?? ? ?refgcc_-m64_-march=k8_-O_-fomit-frame-pointer2019090620190816
915048? ? ?? ? ?refgcc_-march=barcelona_-O2_-fomit-frame-pointer2019090620190816
917694? ? ?? ? ?refgcc_-m64_-O_-fomit-frame-pointer2019090620190816
918048? ? ?? ? ?refgcc_-m64_-O2_-fomit-frame-pointer2019090620190816
921224? ? ?? ? ?refgcc_-march=k8_-O2_-fomit-frame-pointer2019090620190816
931875? ? ?? ? ?refgcc_-march=k8_-O_-fomit-frame-pointer2019090620190816
940020? ? ?? ? ?refgcc_-fno-schedule-insns_-O2_-fomit-frame-pointer2019090620190816
944548? ? ?? ? ?refgcc_-fno-schedule-insns_-O_-fomit-frame-pointer2019090620190816
945684? ? ?? ? ?refgcc_-O2_-fomit-frame-pointer2019090620190816
945992? ? ?? ? ?refgcc_-funroll-loops_-march=nocona_-Os_-fomit-frame-pointer2019090620190816
948648? ? ?? ? ?refgcc_-funroll-loops_-m64_-Os_-fomit-frame-pointer2019090620190816
948783? ? ?? ? ?refgcc_-m64_-march=barcelona_-Os_-fomit-frame-pointer2019090620190816
950068? ? ?? ? ?refgcc_-funroll-loops_-Os_-fomit-frame-pointer2019090620190816
951772? ? ?? ? ?refgcc_-march=k8_-Os_-fomit-frame-pointer2019090620190816
953780? ? ?? ? ?refgcc_-m64_-march=nocona_-Os_-fomit-frame-pointer2019090620190816
954256? ? ?? ? ?refgcc_-march=barcelona_-Os_-fomit-frame-pointer2019090620190816
974132? ? ?? ? ?refgcc_-funroll-loops_-m64_-march=barcelona_-Os_-fomit-frame-pointer2019090620190816
975784? ? ?? ? ?refgcc_-funroll-loops_-m64_-march=k8_-Os_-fomit-frame-pointer2019090620190816
977844? ? ?? ? ?refgcc_-m64_-march=k8_-Os_-fomit-frame-pointer2019090620190816
980708? ? ?? ? ?refgcc_-march=nocona_-Os_-fomit-frame-pointer2019090620190816
987356? ? ?? ? ?refgcc_-funroll-loops_-fno-schedule-insns_-Os_-fomit-frame-pointer2019090620190816
994068? ? ?? ? ?refgcc_-funroll-loops_-m64_-march=nocona_-Os_-fomit-frame-pointer2019090620190816
1002453? ? ?? ? ?refgcc_-funroll-loops_-march=barcelona_-Os_-fomit-frame-pointer2019090620190816
1037127? ? ?? ? ?refgcc_-funroll-loops_-march=k8_-Os_-fomit-frame-pointer2019090620190816
1150983? ? ?? ? ?refgcc_-fno-schedule-insns_-Os_-fomit-frame-pointer2019090620190816
1163136? ? ?? ? ?refgcc_-m64_-Os_-fomit-frame-pointer2019090620190816
1172904? ? ?? ? ?refgcc_-Os_-fomit-frame-pointer2019090620190816
3232236? ? ?? ? ?refgcc_-funroll-loops2019090620190816
3247792? ? ?? ? ?refcc2019090620190816
3450020? ? ?? ? ?refgcc2019090620190816

Test failure

Implementation: ref
Security model: unknown
Compiler: gcc -m64 -march=core-avx2 -O2 -fomit-frame-pointer
error 111

Number of similar (compiler,implementation) pairs: 3, namely:
CompilerImplementations
gcc -m64 -march=core-avx2 -O2 -fomit-frame-pointer ref
gcc -m64 -march=core-avx2 -O -fomit-frame-pointer ref
gcc -m64 -march=core-avx2 -Os -fomit-frame-pointer ref

Compiler output

Implementation: ref
Security model: unknown
Compiler: cc
measure.c: /usr/bin/ld: /home/z/supercop/supercop-20190816/supercop-data/gpu/amd64/lib/fastrandombytes.o: relocation R_X86_64_32 against `.bss' can not be used when making a PIE object; recompile with -fPIC
measure.c: /usr/bin/ld: final link failed: Nonrepresentable section on output
measure.c: collect2: error: ld returned 1 exit status

Number of similar (compiler,implementation) pairs: 103, namely:
CompilerImplementations
cc ref
gcc ref
gcc -O2 -fomit-frame-pointer ref
gcc -O3 -fomit-frame-pointer ref
gcc -O -fomit-frame-pointer ref
gcc -Os -fomit-frame-pointer ref
gcc -fno-schedule-insns -O2 -fomit-frame-pointer ref
gcc -fno-schedule-insns -O3 -fomit-frame-pointer ref
gcc -fno-schedule-insns -O -fomit-frame-pointer ref
gcc -fno-schedule-insns -Os -fomit-frame-pointer ref
gcc -funroll-loops ref
gcc -funroll-loops -O2 -fomit-frame-pointer ref
gcc -funroll-loops -O3 -fomit-frame-pointer ref
gcc -funroll-loops -O -fomit-frame-pointer ref
gcc -funroll-loops -Os -fomit-frame-pointer ref
gcc -funroll-loops -fno-schedule-insns -O2 -fomit-frame-pointer ref
gcc -funroll-loops -fno-schedule-insns -O3 -fomit-frame-pointer ref
gcc -funroll-loops -fno-schedule-insns -O -fomit-frame-pointer ref
gcc -funroll-loops -fno-schedule-insns -Os -fomit-frame-pointer ref
gcc -funroll-loops -m64 -O2 -fomit-frame-pointer ref
gcc -funroll-loops -m64 -O3 -fomit-frame-pointer ref
gcc -funroll-loops -m64 -O -fomit-frame-pointer ref
gcc -funroll-loops -m64 -Os -fomit-frame-pointer ref
gcc -funroll-loops -m64 -march=barcelona -O2 -fomit-frame-pointer ref
gcc -funroll-loops -m64 -march=barcelona -O3 -fomit-frame-pointer ref
gcc -funroll-loops -m64 -march=barcelona -O -fomit-frame-pointer ref
gcc -funroll-loops -m64 -march=barcelona -Os -fomit-frame-pointer ref
gcc -funroll-loops -m64 -march=k8 -O2 -fomit-frame-pointer ref
gcc -funroll-loops -m64 -march=k8 -O3 -fomit-frame-pointer ref
gcc -funroll-loops -m64 -march=k8 -O -fomit-frame-pointer ref
gcc -funroll-loops -m64 -march=k8 -Os -fomit-frame-pointer ref
gcc -funroll-loops -m64 -march=nocona -O2 -fomit-frame-pointer ref
gcc -funroll-loops -m64 -march=nocona -O3 -fomit-frame-pointer ref
gcc -funroll-loops -m64 -march=nocona -O -fomit-frame-pointer ref
gcc -funroll-loops -m64 -march=nocona -Os -fomit-frame-pointer ref
gcc -funroll-loops -march=barcelona -O2 -fomit-frame-pointer ref
gcc -funroll-loops -march=barcelona -O3 -fomit-frame-pointer ref
gcc -funroll-loops -march=barcelona -O -fomit-frame-pointer ref
gcc -funroll-loops -march=barcelona -Os -fomit-frame-pointer ref
gcc -funroll-loops -march=k8 -O2 -fomit-frame-pointer ref
gcc -funroll-loops -march=k8 -O3 -fomit-frame-pointer ref
gcc -funroll-loops -march=k8 -O -fomit-frame-pointer ref
gcc -funroll-loops -march=k8 -Os -fomit-frame-pointer ref
gcc -funroll-loops -march=nocona -O2 -fomit-frame-pointer ref
gcc -funroll-loops -march=nocona -O3 -fomit-frame-pointer ref
gcc -funroll-loops -march=nocona -O -fomit-frame-pointer ref
gcc -funroll-loops -march=nocona -Os -fomit-frame-pointer ref
gcc -m64 -O2 -fomit-frame-pointer ref
gcc -m64 -O3 -fomit-frame-pointer ref
gcc -m64 -O -fomit-frame-pointer ref
gcc -m64 -Os -fomit-frame-pointer ref
gcc -m64 -march=core-avx-i -O2 -fomit-frame-pointer ref
gcc -m64 -march=core-avx-i -O3 -fomit-frame-pointer ref
gcc -m64 -march=core-avx-i -O -fomit-frame-pointer ref
gcc -m64 -march=core-avx-i -Os -fomit-frame-pointer ref
gcc -m64 -march=core2 -O2 -fomit-frame-pointer ref
gcc -m64 -march=core2 -O3 -fomit-frame-pointer ref
gcc -m64 -march=core2 -O -fomit-frame-pointer ref
gcc -m64 -march=core2 -Os -fomit-frame-pointer ref
gcc -m64 -march=core2 -msse4.1 -O2 -fomit-frame-pointer ref
gcc -m64 -march=core2 -msse4.1 -O3 -fomit-frame-pointer ref
gcc -m64 -march=core2 -msse4.1 -O -fomit-frame-pointer ref
gcc -m64 -march=core2 -msse4.1 -Os -fomit-frame-pointer ref
gcc -m64 -march=core2 -msse4 -O2 -fomit-frame-pointer ref
gcc -m64 -march=core2 -msse4 -O3 -fomit-frame-pointer ref
gcc -m64 -march=core2 -msse4 -O -fomit-frame-pointer ref
gcc -m64 -march=core2 -msse4 -Os -fomit-frame-pointer ref
gcc -m64 -march=corei7-avx -O2 -fomit-frame-pointer ref
gcc -m64 -march=corei7-avx -O3 -fomit-frame-pointer ref
gcc -m64 -march=corei7-avx -O -fomit-frame-pointer ref
gcc -m64 -march=corei7-avx -Os -fomit-frame-pointer ref
gcc -m64 -march=corei7 -O2 -fomit-frame-pointer ref
gcc -m64 -march=corei7 -O3 -fomit-frame-pointer ref
gcc -m64 -march=corei7 -O -fomit-frame-pointer ref
gcc -m64 -march=corei7 -Os -fomit-frame-pointer ref
gcc -m64 -march=k8 -O2 -fomit-frame-pointer ref
gcc -m64 -march=k8 -O3 -fomit-frame-pointer ref
gcc -m64 -march=k8 -O -fomit-frame-pointer ref
gcc -m64 -march=k8 -Os -fomit-frame-pointer ref
gcc -m64 -march=native -mtune=native -O2 -fomit-frame-pointer ref
gcc -m64 -march=native -mtune=native -O3 -fomit-frame-pointer ref
gcc -m64 -march=native -mtune=native -O -fomit-frame-pointer ref
gcc -m64 -march=native -mtune=native -Os -fomit-frame-pointer ref
gcc -m64 -march=nocona -O2 -fomit-frame-pointer ref
gcc -m64 -march=nocona -O3 -fomit-frame-pointer ref
gcc -m64 -march=nocona -O -fomit-frame-pointer ref
gcc -m64 -march=nocona -Os -fomit-frame-pointer ref
gcc -march=barcelona -O2 -fomit-frame-pointer ref
gcc -march=barcelona -O3 -fomit-frame-pointer ref
gcc -march=barcelona -O -fomit-frame-pointer ref
gcc -march=barcelona -Os -fomit-frame-pointer ref
gcc -march=k8 -O2 -fomit-frame-pointer ref
gcc -march=k8 -O3 -fomit-frame-pointer ref
gcc -march=k8 -O -fomit-frame-pointer ref
gcc -march=k8 -Os -fomit-frame-pointer ref
gcc -march=native -mtune=native -O2 -fomit-frame-pointer -fwrapv ref
gcc -march=native -mtune=native -O3 -fomit-frame-pointer -fwrapv ref
gcc -march=native -mtune=native -O -fomit-frame-pointer -fwrapv ref
gcc -march=native -mtune=native -Os -fomit-frame-pointer -fwrapv ref
gcc -march=nocona -O2 -fomit-frame-pointer ref
gcc -march=nocona -O3 -fomit-frame-pointer ref
gcc -march=nocona -O -fomit-frame-pointer ref
gcc -march=nocona -Os -fomit-frame-pointer ref

Compiler output

Implementation: ref
Security model: unknown
Compiler: gcc -m64 -march=barcelona -O2 -fomit-frame-pointer
measure.c: /usr/bin/ld: /home/z/supercop/supercop-20190816/supercop-data/gpu/amd64/lib/fastrandombytes.o: relocation R_X86_64_32 against `.bss' can not be used when making a PIE object; recompile with -fPIC
measure.c: /usr/bin/ld: final link failed: Nonrepresentable section on output
measure.c: collect2: error: ld returned 1 exit status
measure.c: /usr/bin/ld: /home/z/supercop/supercop-20190816/supercop-data/gpu/amd64/lib/fastrandombytes.o: relocation R_X86_64_32 against `.bss' can not be used when making a PIE object; recompile with -fPIC
measure.c: /usr/bin/ld: final link failed: Nonrepresentable section on output
measure.c: collect2: error: ld returned 1 exit status

Number of similar (compiler,implementation) pairs: 4, namely:
CompilerImplementations
gcc -m64 -march=barcelona -O2 -fomit-frame-pointer ref
gcc -m64 -march=barcelona -O3 -fomit-frame-pointer ref
gcc -m64 -march=barcelona -O -fomit-frame-pointer ref
gcc -m64 -march=barcelona -Os -fomit-frame-pointer ref