New high-quality hash measures 71GB/s on M4

Summary

rapidhash - Very fast, high quality, platform-independent The fastest recommended hash function by SMHasher. The fastest passing hash in SMHasher3. rapidhash is wyhash' official successor, with improved speed, quality and compatibility. Fast Extremely fast for both short and large inputs. Surpasses 70GB/s on Apple's M4 cpus. The fastest hash function passing all tests in SMHasher. The fastest hash function passing all tests in SMHasher3. Universal Optimized for both AMD64 and AArch64 systems. Compatible with gcc, clang, icx and MSVC. It does not use machine-specific vectorized or cryptographic instruction sets. Prepared for both C and C++ compilation. Excellent Passes all tests in both SMHasher and SMHasher3. Collision-based study showed a collision probability lower than wyhash and close to ideal. Outstanding collision ratio when tested with datasets of 16B and 66B keys: Input Len Nb Hashes Expected Nb Collisions 8 15 Gi 7.0 3 12 15 Gi 7.0 4 16 15 Gi 7.0 8 24 15 Gi 7.0 7 32 15 Gi 7.0 3 40 15 Gi 7.0 3 64 15 Gi 7.0 8 80 15 Gi 7.0 6 120 15 Gi 7.0 5 128 15 Gi 7.0 6 160 15 Gi 7.0 9 1024 15 Gi 7.0 7 4096 15 Gi 7.0 8 8 62 Gi 120.1 123 12 62 Gi 120.1 108 16 62 Gi 120.1 102 24 62 Gi 120.1 112 32 62 Gi 120.1 137 48 62 Gi 120.1 149 64 62 Gi 120.1 161 120 62 Gi 120.1 172 128 62 Gi 120.1 187 160 62 Gi 120.1 183 More results can be found in the collisions folder Outstanding performance Average latency when hashing keys of 4, 8 and 16 bytes Hash M1 Pro M3 Pro Neoverse V2 AMD Turin rapidhash 1.79ns 1.38ns 2.07ns 2.31ns xxh3 1.92ns 1.50ns 2.15ns 2.35ns Peak throughput when hashing files of 16Kb-2Mb Hash M1 Pro M3 Pro M3 Ultra M4 Neoverse V2 rapidhash 47GB/s 57GB/s 61GB/s 71GB/s 37GB/s xxh3 37GB/s 43GB/s 47GB/s 49GB/s 34GB/s The benchmarking program can be found in the bench folder Collision-based hash quality study A perfect hash function distributes its domain uniformly onto the image. When the domain's cardinality is a multiple of the image's cardinality, each potential output ha...