“As InfiniBand is getting used in scientific computing environments, there is a big demand to harness its benefits for enterprise environments for handling big data and analytics. This talk will focus on high-performance and scalable designs of Hadoop using native RDMA support of InfiniBand and RoCE. Designs for various components in Hadoop (such as HDFS, MapReduce, RPC, and HBASE) and their benefits based on the RDMA package for Apache Hadoop will be presented. RDMA-based design for scalable Memcached (used in Web 2.0) and the associated benefits will be presented.”
“Our architecture permits tens of thousands of SSDs to be connected together and accessed in a parallel and concurrent way using direct mapping of memory accesses from a local machine to the I/O bus and memory of a remote machine. This feature allows for data transmission between local and remote system memories without the use of operating system services. It also enables a unique linear scalability of SSDs bandwidth and IOPS and consequently allows computation and data access to scale together linearly. This totally eliminates the bottleneck in bandwidth or IOPS and provides optimal dimensions of performance, capacity, and computation with an unmatched flexibility at a fraction of the costs.”
“Our thought process was that Big Data + a better Workflow = Big Workflow. We coined it as an industry term to denote a faster, more accurate and more cost-effective big data analysis process. It is not a product or trademarked name of Adaptive’s, and we hope it becomes a common term in the industry that is synonymous with a more efficient big data analysis process.”
“Deep storage, and tape library-based storage in general, benefit organizations that are looking to incorporate low-cost, high-density, scalable storage into their fast-growth data environments. Industries that recognize the value and regularly rely on tape storage include education, federal and state government, finance, life sciences, media and entertainment, oil and gas exploration, and Web 2.0, among others.”
We caught up with Mike Boros, Hadoop Product Manager at Cray, to learn about the company’s Big Data solutions. “I think you’ll see Cray continue to focus on Big & Fast, vs. just Big Data. Technologies like Hadoop make hosting large data sets easy. The challenge of getting value from that data set, after it’s large, is what we’re interested in.”
DK Panda from Ohio State University presented this talk at the Stanford HPC & Exascale Conference. “As InfiniBand is getting used in scientific computing environments, there is a big demand to harness its benefits for enterprise environments for handling big data and analytics. This talk will focus on high-performance and scalable designs of Hadoop using native RDMA support of InfiniBand and RoCE.”
By Nikita Ivanov, CEO of GridGain in Memory Computing. In the last 12 months we observed a growing trend that use cases for distributed caching are rapidly going away as customers are moving up stack… in droves. Let me elaborate by highlighting three points that when combined provide a clear reason behind this observation.