Linus Torvalds a476aae3f1 x86/csum: clean up `csum_partial' further ... Commit 688eb8191b ("x86/csum: Improve performance of `csum_partial`") ended up improving the code generation for the IP csum calculations, and in particular special-casing the 40-byte case that is a hot case for IPv6 headers. It then had _another_ special case for the 64-byte unrolled loop, which did two chains of 32-byte blocks, which allows modern CPU's to improve performance by doing the chains in parallel thanks to renaming the carry flag. This just unifies the special cases and combines them into just one single helper the 40-byte csum case, and replaces the 64-byte case by a 80-byte case that just does that single helper twice. It avoids having all these different versions of inline assembly, and actually improved performance further in my tests. There was never anything magical about the 64-byte unrolled case, even though it happens to be a common size (and typically is the cacheline size). Signed-off-by: Linus Torvalds <torvalds@linux-foundation.org>		2024-01-04 15:42:30 -08:00
..
.gitignore
atomic64_32.c
atomic64_386_32.S
atomic64_cx8_32.S
cache-smp.c
checksum_32.S	x86/headers: Replace #include <asm/export.h> with #include <linux/export.h>	2023-10-03 10:38:07 +02:00
clear_page_64.S	x86/headers: Replace #include <asm/export.h> with #include <linux/export.h>	2023-10-03 10:38:07 +02:00
cmdline.c
cmpxchg8b_emu.S	x86/headers: Replace #include <asm/export.h> with #include <linux/export.h>	2023-10-03 10:38:07 +02:00
cmpxchg16b_emu.S
copy_mc.c	iov_iter, x86: Be consistent about the __user tag on copy_mc_to_user()	2023-09-25 14:30:27 +02:00
copy_mc_64.S
copy_page_64.S	x86/headers: Replace #include <asm/export.h> with #include <linux/export.h>	2023-10-03 10:38:07 +02:00
copy_user_64.S	x86/headers: Replace #include <asm/export.h> with #include <linux/export.h>	2023-10-03 10:38:07 +02:00
copy_user_uncached_64.S	x86/headers: Replace #include <asm/export.h> with #include <linux/export.h>	2023-10-03 10:38:07 +02:00
cpu.c
csum-copy_64.S
csum-partial_64.c	x86/csum: clean up `csum_partial' further	2024-01-04 15:42:30 -08:00
csum-wrappers_64.c	x86/lib: Address kernel-doc warnings	2023-10-03 22:46:47 +02:00
delay.c
error-inject.c
getuser.S	x86/headers: Replace #include <asm/export.h> with #include <linux/export.h>	2023-10-03 10:38:07 +02:00
hweight.S	x86 assembly code improvements for v6.7 are:	2023-10-30 14:18:00 -10:00
inat.c
insn-eval.c
insn.c
iomap_copy_64.S
iomem.c
kaslr.c
Makefile
memcpy_32.c
memcpy_64.S	x86/headers: Replace #include <asm/export.h> with #include <linux/export.h>	2023-10-03 10:38:07 +02:00
memmove_32.S	x86/headers: Replace #include <asm/export.h> with #include <linux/export.h>	2023-10-03 10:38:07 +02:00
memmove_64.S	x86/headers: Replace #include <asm/export.h> with #include <linux/export.h>	2023-10-03 10:38:07 +02:00
memset_64.S	x86/headers: Replace #include <asm/export.h> with #include <linux/export.h>	2023-10-03 10:38:07 +02:00
misc.c
msr-reg-export.c
msr-reg.S
msr-smp.c
msr.c
pc-conf-reg.c
putuser.S	x86/headers: Replace #include <asm/export.h> with #include <linux/export.h>	2023-10-03 10:38:07 +02:00
retpoline.S	Replace <asm/export.h> uses with <linux/export.h> and then remove <asm/export.h>.	2023-10-30 14:04:23 -10:00
string_32.c
strstr_32.c
usercopy.c
usercopy_32.c
usercopy_64.c
x86-opcode-map.txt