FR
live
tag

#performance

Hugging Face rewrites tokenizers in Rust with SIMD and encodes text up to 30× faster

On September 21, 2026, Hugging Face detailed version 1 of its tokenizers library: the same output as v0.23, but encoding 3 to 30 times faster single-threaded on an Apple M4 Max, thanks to SIMD bitstream splitting and a word cache. Teams serving LLMs now have a measured reason to look at the tokenizer — the new bottleneck as models get faster.

Linux 7.4 makes hot-adding memory to VMs and CXL up to 81% faster

A patch series by Yuan Liu (Intel), queued in mm/core.git ahead of the Linux 7.4 merge window, replaces page-by-page zone scans with an optimized contiguity check. Measured: up to 81% less time to hot-add memory to a VM and 75% to hot-remove it, with Samsung also reporting CXL gains.

GNU Coreutils 9.12 speeds up cut and uniq and fixes a recursive traversal race

GNU Coreutils 9.12, released on September 14, 2026, delivers measurable wins — cut up to 4× faster, uniq up to 2.5× — and fixes a race that made -R commands fail against files deleted in parallel. A maintenance release that reminds us the GNU toolkit remains, against its Rust rewrite, the default foundation of every distribution.

Jellyfin 12.0 ships to polish the 10.11 rewrite and demands a full rescan

On September 8, Jellyfin released version 12.0, which drops the “10.” prefix and concentrates most of its work on the performance inherited from the 10.11 rewrite. The migration changes the database with no way back: backup, plugin removal, and a full library scan are mandatory before you reap the gains.

Linux 7.3 slashes memory-management lock contention by up to 500×

Two optimizations merged into the Linux 7.3 merge window cut memory-management lock contention: the worst-case anon_vma lock hold time drops from 705 ms to 1.67 ms, and the zsmalloc path speeds up by as much as 1.83× on modest hardware. Teams running JVMs, databases or KSM under memory pressure get a direct latency win just from upgrading.

Type at least two characters.

↑ ↓ navigate ↵ open esc dismiss