open-source: del.icio.us tag/open-source
open-source
algorithms
hashing
system:has:via
system:has:lang
hash-tables
via:mento.info
open-source: del.icio.us tag/open-source
open-source
algorithms
hashing
system:has:via
system:has:lang
hash-tables
via:mento.info
Nice to see consistent hashing go from obscure to blindingly obvious in a few short whitepapers.
Dynamo is certainly the sexiest discussion of distributed hash tables (DHTs), while Programmer’s Toolbox Part 3: Consistent Hashing is the most straightforward. libketama is open and easy to use implementation of the 64-bit space mapped to a circle style consistent hash, discussed above and originally “popularized” by Chord. (and proposed over a decade ago)
And best quote:
“…and if anyone tells you that you shouldn’t use MD5 for this because it isn’t secure, just nod and back away slowly. You have identified someone not worth arguing with.”
I wrote a User-Defined Function that implements the FNV (Fowler-Voll-No) hash function for MySQL. I'm not the first person to do this -- in fact, I was inspired by the Google patches for MySQL. But my implementation is a little bit different from most, in a very important way that leads directly to much higher performance, especially suited for the Maatkit tools.