Over at GigaOm, GigaStacey writes that the solution for better and faster storage may lie in DSSD, a stealthy chip startup backed by Andy Bechtolsheim. Founded in 2010 by Sun Alums Jeff Bonwick and Bill Moore, DSSD is trying to build a chip that would improve the performance and reliability of flash memory for high performance computing, newer data analytics, and networking.
My sources tell me the startup is building a new type of chip — they said it’s really a module, not a chip — that combines a small amount of processing power with a lot of densely-packed memory. The module runs a pared-down version of Linux designed for storing information on flash memory, and is aimed at big data and other workloads where reading and writing information to disk bogs down the application. This fits with the expertise of the team, but this is a problem that others are trying to solve as well with faster and cheaper SSDs and targeted software to to optimize the flow of bits to a database. But the proposal here appears to be about designing an operating system that takes advantage of the difference in Flash memory when compared to hard drives to boost I/O.
In this video from SC12, Joe Landman from Scalable Informatics describes the company’s latest storage technologies for HPC.
JackRabbit is a tightly coupled high performance computing and storage platform that integrates processing and network connectivity at prices starting at less than $1 per GB. siFlash is intended as a metadata server for parallel file systems, fast NFS and CIFS data storage, and similar high performance use cases. Featuring PCIe-flash cards, SSD-flash devices, or RAID-attached flash, siFlash units have achieved random reads and writes exceeding 950k IOPs to and from storage using 8k block sizes and a 30% write mixture in manufacturer benchmarks.”
In this video from SC12, Steve Simms from Indiana University describes a recent upgrade to the Data Capacitor project, a high-speed, high-capacity storage facility for very large data sets. With 5 PB of storage, Data Capacitor II will support big data applications used in computational research. IU partnered with DataDirect Networks to develop Data Capacitor II, which is scheduled to be installed in the IU Data Center in spring 2013.
This week DataDirect Networks (DDN) announced the SFA7700, a hybrid flash storage appliance with a unique ability to anticipate and optimize the workloads of big data-intensive applications.
DDN has extended its SFA technology to feature even greater levels of efficiency and modularity,” said Henry Baltazar, Senior Analyst, 451 Research. “With appliance-level integration into DDN’s file storage technology and new automation with DDN’s cloud collaboration tools, the SFA7700 is an ideal foundation to DDN’s Big Data portfolio and will enable organizations to ingest, process, store and distribute data with simplicity and scalability.”
According to the company, the SFA7700 hybrid storage appliance is an ideal entry-level system for organizations with big data storage needs. It can start small, supporting 60 SSDs and/or HDDs in a 4U rack for a maximum capacity of 240TBs, and can expand to support up to 396 disks in 20U rack for a maximum capacity of 960TBs. In addition, the SFA7700 also allows organizations to migrate data to a public or private cloud when integrated with DDN’s Web Object Scaler (WOS) cloud storage appliance, facilitating file sharing and collaboration. Read the Full Story.
This week Panasas introduced ActiveStor 14, an SSD-Accelerated Scale-out NAS appliance optimized for extreme bandwidth and small file performance for Big Data workloads. According to the company, the new platform will satisfy the bandwidth requirements of the most demanding high-performance storage applications while opening new opportunities for Panasas parallel storage technology in industries with I/O intensive workloads such as finance, life sciences, energy, and manufacturing.
As big data workloads become pervasive within the enterprise, a parallel architecture is a necessary weapon to address critical analysis in a timely manner in order to drive competitive advantage,” said Faye Pairman, president and CEO at Panasas. “ActiveStor 14 broadens the appeal of our fully integrated parallel file system appliances by supporting a diverse set of workloads and applications—all from a single scale-out NAS solution.”
Panasas plans to demonstrate the new technology next week at the HPC on Wall Street conference, with first shipments scheduled for November. Read the Full Story.
Today GridIron Systems announced that it is collaborating with Big Data software innovator, Zettaset, to develop a reference architecture for virtual Hadoop clusters utilizing Flash to improve the efficiency of inter-node communications. According to the company, the reference architecture provides Hadoop users with an efficient, pre-configured alternative to building and configuring racks of servers, storage, and software for large-scale deployments.
Hadoop is the great enabler for complex analytics that require the aggregation of huge amounts of data from many sources,” said Jim Vogt, CEO at Zettaset. “However, as Hadoop clusters continue to grow, they can suffer from performance degradation. Zettaset has worked closely with GridIron to build a powerful infrastructure platform that combines high density and high performance in a single powerful package. Users can now concentrate on building business value from their data and not worry about the underlying platform.”
In this video, Jonathan Goldick from Violin Memory presents on the company’s high availability flash memory solutions for big data and HPC applications.
The Violin 3200 is a redundant, modular 3U memory array that scales from 500GB to 10TB SLC NAND Flash and provides the industry’s best price/performance attributes. It is the first in the Violin 3000 series of Memory Arrays that scale to more than 140TB in a rack with performance over 2 Million IOPS. The enterprise-grade Violin 3200 includes hardware-based flash RAID across hot-swappable memory modules to provide robust data protection and spike free latency of less than 100 microseconds.
In this video, SDSC Director Michael Norman show us the IOPSoMeter at SC11. SDSC’s revolutionary Gordon flash-based supercomputer hit an unprecedented 35 Million IOPs recently, demonstrating the advantages of high-bandwidth, low-latency SSD storage.
In this video, Eric Eyberg from Texas Memory Systems describes the company’s new RamSan-720 Solid-State storage system, which sets new standards for speed and high-availability. After that, CEO Holly Frost discusses how the storage industry has evolved over the last 30 years. Read the Full Story.
This week AMAX is showcasing scalable Big Data storage solutions at the SEG 2011 conference. The AMAX StorMax-X2 iSCSI clustered storage and StorMax-X3 Scale-Out NAS storage solutions are designed to service customer demand for smaller meta-data as well as large datasets used in applications like 3D seismic imaging and Reverse Time Migration.
With the appropriate equipment and the right partner, companies in the Oil & Gas industry can improve efficiency and ROI across many application areas and gain a competitive advantage,” said James Huang, Product Marketing manager at AMAX. “Our experience with integrating NVIDIA Tesla(R) GPUs and Big Data storage technologies into our HPC product families ensure that our customers are continuously deploying the most advanced solutions designed to minimize complex seismic processing cycle times and increase job throughput.”