Discovering Gold with Big Data Analytics and Data-Intensive Computing

Advertisement

Entries filed under “Storage”

SGI Infinite Storage Gateway Appliance Implements DMF in Minutes

Today SGI announced the InfiniteStorage Gateway, an appliance that delivers virtualized data management to lower the cost of high volume storage. Why an appliance? SGI’s Floyd Christofferson described it as a way  to “install DMF within minutes and enable greatly simplified storage management for Big Data.”

The SGI InfiniteStorage Gateway reduces the dependency on high-cost primary storage by creating a virtualized storage fabric that can include any mixture of disk, tape, Zero-Watt Disk or MAID, and object storage. While appearing to users and applications simply as online data, SGI InfiniteStorage Gateway offers IT administrators the ability to keep data protected and online at a fraction of the cost of primary storage systems.

As data growth has continued to sky-rocket, IT organizations increasingly face the problem of infrastructure fragmentation, and the fact that their most expensive primary storage arrays are often used to house mostly inactive data,” said Laura DuBois, program vice president, IDC Storage Systems, Software and Solutions. “Data management is not only about the performance of active data today. It also must provide a seamless long-term strategy for all data that keeps costs at a minimum and reduces IT administrative burden without impacting users.”

With up to 276TB of onboard capacity in a single 4U appliance, the gateway automatically places data on any or all storage devices and locations based upon what works best for the access requirements and data protection policies.

Read the Full Story or View the Slides on Slideshare.


Also posted in Business of Big Data, DMF, Hardware | Leave a comment

You Can’t Keep a Good god Down

In Greek mythology the Titans, known as the elder gods, ruled the earth until the Olympians tossed them out of power.

At Oak Ridge National Laboratory, one of the Titans is not only still with us and doing well, but this modern day diety just got a boost that will help keep it king of the hill for some time to come.

The world’s fastest supercomputer, Titan is capable of delivering a peak capability of over 27 petaflops, ten times more powerful than previous generations of ORNL computers such as Jaguar. This week the Lab announced that it has selected DataDirect Networks to build the world’s fastest file storage system to ensure Titan’s ascendancy in the world of HPC.

Built around DDN’s SFA 12K-40, the system is being designed with 40 petabytes of raw capacity capable of  “ingesting, storing, processing and distributing research data at unprecedented speed,” according to a DDN press release.  The DDN system will work with the Lab’s Lustre parallel file system with a Lustre performance of over one terabyte per second to handle the demands of Titan’s 299,008 CPU cores.

The world’s toughest questions demand the toughest storage and the fastest technology to drive new levels of scientific insight. DDN has spent the better part of a decade engineering a platform that is built precisely and efficiently for today’s Big Data challenges,” comments Jean-Luc Chatelain, chief technology officer at DDN. “As applications everywhere – from energy exploration to climate modeling to energy efficient car manufacturing – continue to drive extreme levels of computational simulation and data analytics, we’re proud to provide the data storage technology that makes such innovation and economic competitiveness possible. We’re honored to continue our long-standing partnership with ORNL today and to be part of the future of Big Data and exascale computing tomorrow.”

ORNL points out that Titan is architecturally unique in a variety of ways, and is a showcase for tomorrow’s computational requirements as Big Data continues to make inroads into the enterprise.

When building the world’s fastest system for data intensive computing, we carefully considered all aspects of high-throughput I/O infrastructure and how efficient storage platforms can complement our supercomputer’s efficiency,” says Buddy Bland, project director for the Oak Ridge Leadership Computing Facility. “The ORNL and DDN teams have worked together to architect a file system designed to enhance the performance of our Titan supercomputer and enable our users to achieve unprecedented simulations and big data insights through massively scalable computing.”

The Olympians may have thought they dethroned the Titans, but as Yogi Berra once said, “It ain’t over till it’s over.”  Titan at ORNL, with some help from DDN, rules supreme…at least for now.

Read the Full Story.


Also posted in HPC, Lustre, Software | Leave a comment

Teradata Streamlines Hadoop Access for the Enterprise

Today Teradata announced that the new Enterprise Access for Hadoop and Unified Data Architecture enable business analysts to reach through Teradata directly into Hadoop to find new business value from the analysis of big, diverse data.

Today’s announcement of Teradata Enterprise Access for Hadoop is another example of our aggressive commitment to building out the Teradata Unified Data Architecture™,” said Scott Gnau, president, Teradata Labs. “Teradata Enterprise Access for Hadoop empowers organizations to dig deeply into files and data residing in Hadoop and combine the data with production business data for analyses – and action.”

Teradata Enterprise Access for Hadoop includes two new, innovative features that make access to data in Hadoop easy and secure for business analysts across the enterprise:

  • Teradata smart loader for Hadoop. For the first time, business analysts have point-and-click convenience to easily browse and move data between Teradata and Hadoop for analysis and self-service business intelligence.
  • Teradata SQL-H. The new Teradata SQL-H gives any user or application across the enterprise direct, on-the-fly access to data stored within Hadoop through standard ANSI SQL, leveraging the security, workload management, and performance of the Teradata data warehouse.

Read the Full Story or check out our RichReport Podcast interview with Scott Gnau.


Also posted in Analytics, Hadoop, Hardware, Software | Leave a comment

Free Ebook: NAS Optimization for Dummies

Our friends at Avere are offering a free copy of NAS Optimization for Dummies.

Big NAS performance comes from your ability to scale, eliminate sources of latency, and gain the advantages of the cloud. Get started with Avere Systems’ Special Edition of NAS Optimization for Dummies by Allen G. Taylor.

In this book, you’ll find:

  • How to configure NAS storage for optimal performance
  • Ways to reduce the cost of upgrades as your storage needs grow
  • How to minimize the impact of multiple users hitting the storage systems at the same time

Read the Full Story.


Also posted in Book Review, I/O, Sponsored Post | Leave a comment

DSSD is Andy Bechtolsheim’s Secret Chip Startup for Big Data

Over at GigaOm, GigaStacey writes that the solution for better and faster storage may lie in DSSD, a stealthy chip startup backed by Andy Bechtolsheim. Founded in 2010 by Sun Alums Jeff Bonwick and Bill Moore, DSSD is trying to build a chip that would improve the performance and reliability of flash memory for high performance computing, newer data analytics, and networking.

My sources tell me the startup is building a new type of chip — they said it’s really a module, not a chip — that combines a small amount of processing power with a lot of densely-packed memory. The module runs a pared-down version of Linux designed for storing information on flash memory, and is aimed at big data and other workloads where reading and writing information to disk bogs down the application. This fits with the expertise of the team, but this is a problem that others are trying to solve as well with faster and cheaper SSDs and targeted software to to optimize the flow of bits to a database. But the proposal here appears to be about designing an operating system that takes advantage of the difference in Flash memory when compared to hard drives to boost I/O.

Read the Full Story.


Also posted in Business of Big Data, Flash and SSD, Hardware, HPC, I/O, Software, Startups, ZFS | Leave a comment

Xyratex Partners with AMD on Apache Hadoop and Object Storage

Today Xyratex announced that that the company is now a strategic supplier for AMD and their SeaMicro solutions for Big Data.

AMD will use Xyratex OneStor Modular Enclosure as one of the building blocks for its big data and storage intensive solutions and optimized the SeaMicro SM15000 server to provide more than five petabytes of storage capacity in two racks for big data applications such as Hadoop and Object Storage.

SeaMicro SM15000 server with the Freedom Fabric Storage solution is known in the market for its superior computing efficiency and storage density, as well as the lowest total cost of ownership,” said Dhiraj Mallick, Corporate Vice President and General Manager of Data Center Server Solutions at AMD. “With the combination of the SM15000 and the Xyratex OneStor data storage product, we have a winning solution that is unmatched in storage density and capacity.”

The combination of Xyratex and AMD products delivers an ultra-dense, high performance platform that eliminates excess hardware costs and cabling while simplifying installation and minimizing footprint requirements.

Read the Full Story.


Also posted in Business of Big Data, Hadoop, Hardware | Leave a comment

DDN – Big Data Evolution

In this video from the HPC Advisory Council Switzerland Conference, James Coomer from DDN presents: Big Data Evolution.

DDN has developed a Hadoop solution that is all about time to value: It simplifies rollout so that enterprises can get up and running more quickly, provides typical DDN performance to accelerate data processing, and reduces the amount of time needed to maintain a Hadoop solution.” said Dave Vellante, Chief Research Officer, Wikibon.org. “For enterprises with a deluge of data but a limited IT budget, the DDN hScaler appliance should be on the short list of potential solutions.”

Download the Slides (PDF).


Also posted in Events, Hadoop, Hardware, Software, Video | Leave a comment

Nimbus Data HALO 2013 Simplifies Management for Cloud and Enterprise Storage Architects

Today Nimbus Data Systems announced HALO 2013, an enhanced version of the company’s award-winning storage operating system. HALO 2013 features improved analytics to gauge the performance and efficiency of Nimbus Data flash memory arrays.

With a new REST-based API, HALO 2013 gives administrators full access to all Nimbus features and statistics, facilitating storage management in large multi-vendor data centers. HALO Mobile brings these advanced monitoring features to the palm of your hand, streaming live statistics directly to iOS and Android-based smartphones and tablets.

Nimbus Data is a pioneer in all-flash storage systems, and today’s announcement extends the first-mover advantage the company has established for itself,” says Benjamin Woo, managing director of Neuralytix, an industry analyst firm. “Nimbus Data recognizes the importance of instrumentation and integration, and providing an open API to the full features of its flash arrays will help drive down total cost of ownership.”

Read the Full Story.


Also posted in Business of Big Data, Cloud, Hardware, Software | Leave a comment

Video: Introducing Panasas ActiveStor 14

In this video from the HPC Advisory Council Switzerland Conference, Derek Burke from Panasas presents: Introducing Panasas ActiveStor 14.

Download the Slides (PDF).


Also posted in Events, Hardware, Video | Leave a comment

Video: Architecting High Availability Lustre Storage Solution – ClusterStor 6000

In this video from the HPC Advisory Council Switzerland Conference, Torben Kling Petersen from Xyratex presents: Architecting High Availability Lustre Storage Solution – ClusterStor 6000.

Part of the ClusterStor family, ClusterStor 6000 is designed to support installations with linear performance scalability in less space, scaling from up to 6 gigabytes per second to installations providing 1 terabyte per second file system throughput, as well as linear data storage capacity from terabytes up to tens of petabytes.

Download the Slides (PDF).


Also posted in Business of Big Data, Events, HPC, Lustre, Software, Video | Leave a comment

Advertisement


View All Videos

inside-bigdata.com is a production of insideHPC, LLC. © 2011-2013 Sitemap