Overview

“Scaling Hadoop for multi-core and highly threaded systems” is the full title of this presentation from Sun’s Jangwoo Kim and Denis Sheahan.

Here they present the basic architecture of CMT (chip multi-threading) processors, designed by Sun for maximum throughput, and then describe the work the team did using Hadoop and other virtualization technologies to help scale CMT. They also present a case study of a small Washington, DC company they worked with that’s using Hadoop for email discovery.