In Part 1 of this podcast, the Radio Free HPC team looks at the importance of owning your own archive of enterprise data.

The discussion was prompted by Henry Newman’s presentation entitled: Today’s I/O Challenges for Big Data Analysis from the recent HPC User Forum in Tucson.

Download the MP3 * Download the mobile video * Download 1024p Video * Subscribe on iTunes * RSS Feed

The post Radio Free HPC Looks at Why You Gotta Own Your Own Archive, Part 1 appeared first on Inside-BigData.

In this slidecast, Marty Czekalski from the SCSI Trade Association presents: Extending the SCSI Platform of Innovation.

SCSI Express is the robust and proven SCSI protocol combined with PCIe that creates an industry-standard path to PCIe-based storage. SCSI Express combined with SAS-based solutions provides unprecedented performance and low latency that enterprises demand.

View the slides * Download the MP3 * Subscribe on iTunes* Subscribe to RSS

The post SCSI Express: Extending the SCSI Platform of Innovation appeared first on Inside-BigData.

In this video from the Lustre User Group 2013, Meghan McClelland from Xyratex presents: EIOW – Exascale I/O Working Group.

There is a fierce competition on the storage market to offer the best performing devices, with great management at a low price. The EIOW group, from the outset, decided that it would not attempt to offer an end-to-end solution, which would necessarily involve competing instead of working with storage providers. The focus of EIOW is on middleware to provide, for example, schemas describing data structure and layout, novel access methods to data for applications, a uniform data management infrastructure and a framework for the implementation of layered I/O software, similar in spirit to HDF5 as a specialized use of a parallel file system. We decided EIOW should be open, and have interfaces to layer on lower level storage infrastructure such as object stores, databases and file systems as provided by storage providers, to allow their expertise and leadership in this area to continue to benefit the HPC community.

Download the EIOW whitepaper and slides, or check out our LUG 2013 Video Gallery.

The post Video: EIOW Exascale I/O Working Group appeared first on Inside-BigData.

In this video from the 2013 HPC User Forum, Henry Newman from Instrumental presents: Today’s I/O Challenges for Big Data Analysis.

Those who own the archive own the big data solutions as you cannot move data around.

Download the slides (PDF) or check out the HPC User Forum Video Gallery.

The post Video: Today’s I/O Challenges for Big Data Analysis appeared first on Inside-BigData.

In this slidecast, Scott Gnau from Teradata Labs presents: Teradata Intelligent Memory.

The introduction of Teradata Intelligent Memory allows our customers to exploit the performance of memory within Teradata Platforms, which extends our leadership position as the best performing data warehouse technology at the most competitive price,” said Scott Gnau, president, Teradata Labs. “Teradata Intelligent Memory technology is built into the data warehouse and customers don’t have to buy a separate appliance. Additionally, Teradata enables its customers to buy and configure the exact amount of in-memory capability needed for critical workloads. It is unnecessary and impractical to keep all data in memory, because all data do not have the same value to justify being placed in expensive memory.”

How does Intelligent Memory work? This animation video does a good job of making this advanced technology look simple.

Read the Full Story * View the slides * Download the MP3 * Subscribe on iTunes * Subscribe to RSS

The post Slidecast: Teradata Rolls Out Intelligent Memory Technology appeared first on Inside-BigData.

In this video from the 2013 Open Fabrics Developer Workshop, Bill Boas from Cray presents: Massive I/O Requirements for the SKA Telescope.

Processing the vast quantities of data produced by the SKA will require very high performance central supercomputers capable of 100 petaflops per second processing power. This is about 50 times more powerful than the most powerful supercomputer in 2010 and equivalent to the processing power of about one hundred million PCs.

Download the slides (PDF) or check out more OFA videos in our Open Fabrics Worshop Video Gallery.

The post Video: Massive I/O Requirements for the SKA Telescope appeared first on Inside-BigData.

Gorda recently wrote a post about the rapid growth of the Lustre community, so we started our discussion there and learned a good deal more about the popular file system.

Download the MP3 * Subscribe on iTunes * Subscribe to RSS

The post Podcast: Radio Free HPC Looks at Lustre with Brent Gorda appeared first on Inside-BigData.

In this video from the Lustre User Group 2013, John Fragalla from Xyratex presents: High Availability in Lustre.

Download the slides (PDF) or check out our LUG 2013 Video Gallery.

The post Video: High Availability in Lustre appeared first on Inside-BigData.

In this video from the Lustre User Group 2013, Jeff Denworth from DDN presents: DataDirect Networks Update.

DDN has developed a Hadoop solution that is all about time to value: It simplifies rollout so that enterprises can get up and running more quickly, provides typical DDN performance to accelerate data processing, and reduces the amount of time needed to maintain a Hadoop solution.” said Dave Vellante, Chief Research Officer, Wikibon.org. “For enterprises with a deluge of data but a limited IT budget, the DDN hScaler appliance should be on the short list of potential solutions.”

Download the slides (PDF) or check out our LUG 2013 Video Gallery.

The post Video: DataDirect Networks Update appeared first on Inside-BigData.

In this video from the 2013 Open Fabrics Developer Workshop, D.K. Panda from Ohio State University presents: High Performance RDMA-based Design for Big Data and Web 2.0 memcached.

You can check out more OFA videos at our Open Fabrics Workshop Video Gallery.

The post High Performance RDMA-based Design for Big Data and Web 2.0 memcached appeared first on Inside-BigData.