glibc/sysdeps/aarch64
Joe Ramsay 49c250106a AArch64: Optimise SVE scalar callbacks
Instead of using SVE instructions to marshall special results into the
correct lane, just write the entire vector (and the predicate) to
memory, then use cheaper scalar operations.

Geomean speedup of 16% in special intervals on Neoverse with GCC 14.

Reviewed-by: Wilco Dijkstra  <Wilco.Dijkstra@arm.com>
(cherry picked from commit 5b82fb1882)
2025-11-18 16:43:46 +00:00
..
bits Update copyright dates with scripts/update-copyrights 2023-01-06 21:14:39 +00:00
fpu AArch64: Optimise SVE scalar callbacks 2025-11-18 16:43:46 +00:00
multiarch AArch64: Use prefer_sve_ifuncs for SVE memset 2025-02-28 14:44:25 +00:00
nptl Update copyright dates with scripts/update-copyrights 2023-01-06 21:14:39 +00:00
sys Update copyright dates with scripts/update-copyrights 2023-01-06 21:14:39 +00:00
Implies
Makefile
Versions
__longjmp.S Update copyright dates with scripts/update-copyrights 2023-01-06 21:14:39 +00:00
__mtag_tag_region.S Update copyright dates with scripts/update-copyrights 2023-01-06 21:14:39 +00:00
__mtag_tag_zero_region.S Update copyright dates with scripts/update-copyrights 2023-01-06 21:14:39 +00:00
abort-instr.h
atomic-machine.h Fix misspellings in sysdeps/ -- BZ 25337 2023-05-30 23:02:29 +00:00
bsd-_setjmp.c
bsd-setjmp.c
configure aarch64: fix check for SVE support in assembler 2024-04-10 14:03:08 +01:00
configure.ac aarch64: fix check for SVE support in assembler 2024-04-10 14:03:08 +01:00
crti.S Update copyright dates with scripts/update-copyrights 2023-01-06 21:14:39 +00:00
crtn.S Update copyright dates with scripts/update-copyrights 2023-01-06 21:14:39 +00:00
dl-audit-check.h Update copyright dates with scripts/update-copyrights 2023-01-06 21:14:39 +00:00
dl-bti.c Update copyright dates with scripts/update-copyrights 2023-01-06 21:14:39 +00:00
dl-dtprocnum.h Update copyright dates with scripts/update-copyrights 2023-01-06 21:14:39 +00:00
dl-irel.h Update copyright dates with scripts/update-copyrights 2023-01-06 21:14:39 +00:00
dl-link.sym
dl-lookupcfg.h Update copyright dates with scripts/update-copyrights 2023-01-06 21:14:39 +00:00
dl-machine.h Update copyright dates with scripts/update-copyrights 2023-01-06 21:14:39 +00:00
dl-prop.h Update copyright dates with scripts/update-copyrights 2023-01-06 21:14:39 +00:00
dl-start.S Update copyright dates with scripts/update-copyrights 2023-01-06 21:14:39 +00:00
dl-tls.h Update copyright dates with scripts/update-copyrights 2023-01-06 21:14:39 +00:00
dl-tlsdesc.S Update copyright dates with scripts/update-copyrights 2023-01-06 21:14:39 +00:00
dl-tlsdesc.h Update copyright dates with scripts/update-copyrights 2023-01-06 21:14:39 +00:00
dl-trampoline.S Update copyright dates with scripts/update-copyrights 2023-01-06 21:14:39 +00:00
dl-tunables.list Update copyright dates with scripts/update-copyrights 2023-01-06 21:14:39 +00:00
e_sqrtl.c Update copyright dates with scripts/update-copyrights 2023-01-06 21:14:39 +00:00
elf-initfini.h Update copyright dates with scripts/update-copyrights 2023-01-06 21:14:39 +00:00
hp-timing.h AArch64: Fix HP_TIMING_DIFF computation [BZ# 29329] 2023-02-22 16:45:59 +00:00
jmpbuf-offsets.h Update copyright dates with scripts/update-copyrights 2023-01-06 21:14:39 +00:00
jmpbuf-unwind.h Update copyright dates with scripts/update-copyrights 2023-01-06 21:14:39 +00:00
ldsodefs.h Update copyright dates with scripts/update-copyrights 2023-01-06 21:14:39 +00:00
libc-mtag.h Update copyright dates with scripts/update-copyrights 2023-01-06 21:14:39 +00:00
libc-tls.c Update copyright dates with scripts/update-copyrights 2023-01-06 21:14:39 +00:00
libm-test-ulps aarch64: Add vector implementations of exp routines 2023-06-30 09:04:26 +01:00
libm-test-ulps-name
linkmap.h Update copyright dates with scripts/update-copyrights 2023-01-06 21:14:39 +00:00
machine-gmon.h Update copyright dates with scripts/update-copyrights 2023-01-06 21:14:39 +00:00
math-tests-trap.h Update copyright dates with scripts/update-copyrights 2023-01-06 21:14:39 +00:00
mcount.c Update copyright dates with scripts/update-copyrights 2023-01-06 21:14:39 +00:00
memchr.S AArch64: Optimize memchr 2023-01-17 15:09:18 +00:00
memcmp.S Update copyright dates with scripts/update-copyrights 2023-01-06 21:14:39 +00:00
memcpy.S Update copyright dates with scripts/update-copyrights 2023-01-06 21:14:39 +00:00
memmove.c
memrchr.S string: Add libc_hidden_proto for memrchr 2023-02-08 17:13:58 -03:00
memset-reg.h Update copyright dates with scripts/update-copyrights 2023-01-06 21:14:39 +00:00
memset.S AArch64: Remove zva_128 from memset 2025-02-28 14:42:29 +00:00
preconfigure i386: Update ___tls_get_addr to preserve vector registers 2025-08-20 11:09:07 -07:00
rawmemchr.S aarch64: correct CFI in rawmemchr (bug 31113) 2024-04-10 14:03:07 +01:00
setjmp.S Update copyright dates with scripts/update-copyrights 2023-01-06 21:14:39 +00:00
sfp-machine.h
sotruss-lib.c Update copyright dates with scripts/update-copyrights 2023-01-06 21:14:39 +00:00
stackinfo.h Update copyright dates with scripts/update-copyrights 2023-01-06 21:14:39 +00:00
start.S Update copyright dates with scripts/update-copyrights 2023-01-06 21:14:39 +00:00
stpcpy.S Update copyright dates with scripts/update-copyrights 2023-01-06 21:14:39 +00:00
strchr.S AArch64: Optimize strchr 2023-01-17 15:09:18 +00:00
strchrnul.S string: Add libc_hidden_proto for strchrnul 2023-02-08 17:13:56 -03:00
strcmp.S Update copyright dates with scripts/update-copyrights 2023-01-06 21:14:39 +00:00
strcpy.S AArch64: Optimize strcpy 2023-01-17 15:09:18 +00:00
strlen.S AArch64: Improve generic strlen 2025-02-28 14:41:56 +00:00
strncmp.S Update copyright dates with scripts/update-copyrights 2023-01-06 21:14:39 +00:00
strnlen.S AArch64: Optimize strnlen 2023-01-17 15:09:18 +00:00
strrchr.S AArch64: Improve strrchr 2023-01-17 15:09:18 +00:00
sysdep.h Update copyright dates with scripts/update-copyrights 2023-01-06 21:14:39 +00:00
tlsdesc.c Update copyright dates with scripts/update-copyrights 2023-01-06 21:14:39 +00:00
tlsdesc.sym
tst-audit.h Update copyright dates with scripts/update-copyrights 2023-01-06 21:14:39 +00:00
tst-audit26.c Update copyright dates with scripts/update-copyrights 2023-01-06 21:14:39 +00:00
tst-audit26mod.c Update copyright dates with scripts/update-copyrights 2023-01-06 21:14:39 +00:00
tst-audit26mod.h Update copyright dates with scripts/update-copyrights 2023-01-06 21:14:39 +00:00
tst-audit27.c Update copyright dates with scripts/update-copyrights 2023-01-06 21:14:39 +00:00
tst-audit27mod.c Update copyright dates with scripts/update-copyrights 2023-01-06 21:14:39 +00:00
tst-audit27mod.h Update copyright dates with scripts/update-copyrights 2023-01-06 21:14:39 +00:00
tst-auditmod26.c Update copyright dates with scripts/update-copyrights 2023-01-06 21:14:39 +00:00
tst-auditmod27.c Update copyright dates with scripts/update-copyrights 2023-01-06 21:14:39 +00:00
tst-ifunc-arg-1.c Update copyright dates with scripts/update-copyrights 2023-01-06 21:14:39 +00:00
tst-ifunc-arg-2.c Update copyright dates with scripts/update-copyrights 2023-01-06 21:14:39 +00:00
tst-vpcs-mod.S Update copyright dates with scripts/update-copyrights 2023-01-06 21:14:39 +00:00
tst-vpcs.c Update copyright dates with scripts/update-copyrights 2023-01-06 21:14:39 +00:00
wordcopy.c