大数据分析常用去重算法 BitMap TrieTree HyperLogLog

1. BitMap

https://mp.weixin.qq.com/s/Ur5yYiKgbzB5gv9qpK08wQ

 

2. TrieTree

https://www.jianshu.com/p/e431bd41d676

 

https://blog.bcmeng.com/post/kylin-distinct-count-global-dict.html

https://hexiaoqiao.github.io/blog/2016/11/27/exact-count-and-global-dictionary-of-apache-kylin/

3. HyperLogLog

https://www.jianshu.com/p/55defda6dcd2

https://mp.weixin.qq.com/s/SGVryEXETk-2OuUZdM5aOw