Discovering Gold with Big Data Analytics and Data-Intensive Computing

Entries filed under “HPC”

DSSD is Andy Bechtolsheim’s Secret Chip Startup for Big Data

Over at GigaOm, GigaStacey writes that the solution for better and faster storage may lie in DSSD, a stealthy chip startup backed by Andy Bechtolsheim. Founded in 2010 by Sun Alums Jeff Bonwick and Bill Moore, DSSD is trying to build a chip that would improve the performance and reliability of flash memory for high performance computing, newer data analytics, and networking.

My sources tell me the startup is building a new type of chip — they said it’s really a module, not a chip — that combines a small amount of processing power with a lot of densely-packed memory. The module runs a pared-down version of Linux designed for storing information on flash memory, and is aimed at big data and other workloads where reading and writing information to disk bogs down the application. This fits with the expertise of the team, but this is a problem that others are trying to solve as well with faster and cheaper SSDs and targeted software to to optimize the flow of bits to a database. But the proposal here appears to be about designing an operating system that takes advantage of the difference in Flash memory when compared to hard drives to boost I/O.

Read the Full Story.


Also posted in Business of Big Data, Flash and SSD, Hardware, I/O, Software, Startups, Storage, ZFS | Leave a comment

Video: How to Talk to Your CFO about HPC and Big Data

In this video from the 2013 National HPCC Conference, Rich Brueckner from inside-BigData moderates a panel discussion on How to Talk to Your CFO about HPC and Big Data.

Panelists:

John C. Morris – Pfizer
Dr. George Ball – Raytheon
Henry Tufo – University of Colorado, Boulder
Dr. Flavio Villanustre – LexisNexis

As members of the HPC community, we spend a good share our time sharing our work and best practices with our colleagues. But how do we communicate the business value of high performance computing and Big Data analytics to CFOs who have little affinity to discussions of things like cores, Hadoop, and MPI? In this panel discussion, experts and Big Data and HPC will come together to share best practices and communication strategies that have proven effective when talking to CFOs and other C-level executives.”


Also posted in Business of Big Data, Events, Video | Leave a comment

Panel Discussion: Big Systems, Big Data, Better Products

In this video from the 2013 National HPCC Conference, Bob Feldman moderates a panel discussion entitled: Big Systems, Big Data, Better Products.

Panelists:

  • Devin Jensen – Altair
  • Rene Copeland – SGI
  • Dr. Stephen Wheat – Intel
  • Sanjay Umarji – HP

How will enormous data sets and an endless stream of ever-more granular variables drive supercomputing in the coming years? Will it be like a dust storm that buries us, or flood waters we can redirect and manage? How will it alter the evolution of architecture and subsystems? How will it change computer science education, development tools and job descriptions? And will gargantuan data form a barrier to our evolution to Exascale and beyond by sapping the shrinking resources for funding and creativity?


Also posted in Business of Big Data, Events, Video | Leave a comment

Video: From Extreme Scale Computing to Big Data

In this video from the 2013 National HPCC Conference, Dr. Eng Lim Goh from SGI presents: From Extreme Scale Computing to Big Data.

The internet, sensors and high performance computing are some of the top Big Data producers. Recently, there has been increased focus on extracting more value out of these generated data. Analysis of Big Data sets may be simplified as “looking for needle in a haystack” on one end of a spectrum to “looking for relationships between hay in a stack” on the other. We will discuss the architectural platforms and tools suitable for different parts of this spectrum.”


Also posted in Events, Hadoop, Hardware, Video | Leave a comment

Video: EUDAT and Big Data in Science

In this video from the 2013 National HPCC Conference, Wolfgang Gentzsch presents: EUDAT and Big Data in Science.

Big data science emerges as a new paradigm for scientific discovery that reflects the increasing value of observational, experimental and computer-generated data in virtually all domains, from physics to the humanities and social sciences. Addressing this new paradigm, the EUDAT project is a European data initiative that brings together a unique consortium of 25 partners — including research communities, national data and high performance computing (HPC) centers, technology providers, and funding agencies — from 13 countries. EUDAT aims to build a sustainable cross-disciplinary and cross-national data infrastructure that provides a set of shared services for accessing and preserving research data. The design and deployment of these services is being coordinated by multi-disciplinary task forces comprising representatives from research communities and data centers.”


Also posted in Events, Research, Video | Leave a comment

Video: Architecting High Availability Lustre Storage Solution – ClusterStor 6000

In this video from the HPC Advisory Council Switzerland Conference, Torben Kling Petersen from Xyratex presents: Architecting High Availability Lustre Storage Solution – ClusterStor 6000.

Part of the ClusterStor family, ClusterStor 6000 is designed to support installations with linear performance scalability in less space, scaling from up to 6 gigabytes per second to installations providing 1 terabyte per second file system throughput, as well as linear data storage capacity from terabytes up to tens of petabytes.

Download the Slides (PDF).


Also posted in Business of Big Data, Events, Lustre, Software, Storage, Video | Leave a comment

Blue Waters Ready to Handle Floods of Data

Big Data requires big computing, and the University of Illinois at Urbana-Champaign is doing its part with the launch of Blue Waters, one of the world’s fastest supercomputers.

U of I held an open house a couple of weeks ago, inviting one and all to visit its National Petascale Computing Facility and kick the tires on the $200 million machine built by Cray and funded by the National Science Foundation.

This is a petaflop machine designed to handle the challenging Big Data requirements associated with a wide range of problems – everything from unraveling complex biological systems to simulating the evolution of the cosmos.

This is where you go to get answers to questions about how the world works,’ says Bill Gropp, a computer science professor and one of four U of I researchers who oversaw the five-year development of the machine,” according to a story in Crain’s Chicago Business. The article goes on to say, “Blue Waters will keep the university in the lead on large-scale computing as researchers from around the country apply to the National Science Foundation to use the machine to crunch data for medical research, astrophysics, aerodynamics, weather forecasting, national security and other uses.”

This is not your everyday supercomputer. The Blue Waters system is a Cray XE/XK hybrid machine made up of AMD 6276 “interlagos” processors with a nominal clock speed of at least 2.3 GHz) and NIVIDIA GK110 Kepler accelerators, all connected by the Cray Gemini torus interconnect.

Blue Waters is capable of a sustained speed of over one petaflop, allowing it to perform more than one quadrillion calculations per second. The water-cooled system is housed in 276 black cabinets topped by silvery coolant pipes.

In addition to being really fast, Blue Waters has more than enough memory to handle Big Data requirements – 1.5 petabytes of total system memory and 300 petabytes of long-term storage.

In the Crain’s article, Gropp is quoted as saying, “We want people to ask, ‘What could you do if you could put massive amounts of data on a system and access it in microseconds?’”

The short answer is, “More than you can ever imagine.”

Read the Full Story.


Also posted in Hardware, Video | Leave a comment

Jen-Hsun Huang on How Diverse Companies Tackle Big Data with GPU Computing

In this video from the GPU Technology Conference, Nvidia CEO Jen-Hsun Huang shows how diverse companies are using GPU computing to tackle Big Data.

You can watch the entire keynote at Livestream.

Read the Full Story.


Also posted in Business of Big Data, Events, Video | Leave a comment

Video: Accelerated Computing Goes Beyond HPC to Tackle Big Data

In this video, Sumit Gupta from Nvidia presents: Accelerated Computing Goes Beyond HPC. A wide array of companies are now using GPUs to accelerate Big Data analytics, and Gupta describes how these efforts are delivering competitive advantage.

You can follow the latest developments in accelerated computing over at insideHPC with live coverage all this week from the GPU Technology Conference.


Also posted in Events, Hardware, Video | Leave a comment

Interview: As Registration Opens for ISC’13, Conference Sets a Parallel Course for the Future

 
Registration opened today for ISC’13. The International Supecomputing Conference takes place in Leipzig, Germany June 16-20. Besides a change of venue, the conference agenda has added parallel sessions, new topics, and a two-day industry track. To learn more, I caught up with Martin Meuer, Executive Director of ISC Events.

insideHPC: ISC’13 will be the first conference in your long history with two session tracks. What prompted you to add the new Industry Track?

Martin Meuer: We introduced the Industry Track with the goal to help attendees from the industry make informed decisions about acquiring and operating high-performance computing systems. So, this track will specifically focus on engineering and manufacturing, to help the industry improve product design and time-to-market through the use of HPC.

All the talks in this track are aimed at spurring a dialogue between users, technology companies, hardware vendors, software vendors and service providers. We anticipate a bigger audience from small and medium enterprises (SMEs) at ISC’13.

insideHPC: Did the ISC conference series need to grow to a certain number of attendees to make dual-tracks a viable option?

Martin Meuer: The growing number of attendees naturally influences the volume of the technical program…we see it increasing year after year, leading to many sessions taking place in parallel.

When we decided to introduce industry-based topics, it was clear to us that we needed to revamp the current structure. I would like to point out that ISC’13 will offer even more value to our expected 2,500 attendees as all the sessions in the Industry Track will run as a series of single sessions starting Tuesday June 18 to Wednesday June 19. We are quite confident that this add on and some other new program elements like the Distinguished Speakers Series, will offer our attendees the most comprehensive four-day technical program in the 28 years of conference history.

insideHPC: What will be the highlights of the Industry Track?

Martin Meuer: Here’s the list of topics that we would like to draw your readers attention to:

  • HPC provisioning concepts for the industrial sector
  • Independent software vendors (ISVs) and their HPC products for industry
  • Cloud HPC for SMEs
  • An invited talk about the common needs of engineering and scientific research in regard to HPC: HPC-Accelerated Innovation for Industry
  • An overview of the SME market
  • Many case studies, which will run on both days to give the audience an overview of HPC use in industry

insideHPC: This week you also announced that ISC that it will be giving the Human Brain project a permanent platform at ISC to share their latest research findings for the next 10 years. What can attendees look forward to for their session this year?

Martin Meuer: First of all, we’re glad to mention that ISC is the only scientific computing conference in Europe of a substantial size that attracts scientists, researchers and business leaders from around the globe, thus we are always happy to provide research projects, especially European projects a platform at our conference. When HBP was selected as the European flagship project for 2013, we approached its project manager, Felix Schuermann and the team accepted the offer to share their human brain simulation challenges and progress with our audience.

The HBP team has designed a two hour session entitled “Supercomputing and HBP – Following Brain Research and ICT on 10-year Quest”, and invited a number of speakers, including institutions that supply them with supercomputing infrastructure, for example, the Jülich Research Centre.

This session will focus on the development of ICT (Information and Computing Technology) platforms for neuroinformatics, brain simulation and supercomputing, which is about facilitating
researchers to collect neuroscience data from all over the world and integrating the data in unifying models and simulation of the brain and to check the model against data from biology before releasing it to the global scientific community.

insideHPC: You recently announced an all-new ISC Big Data conference for September 2013. How did that come about?

Martin Meuer: We have been addressing data intensive computing at the ISC Conference for the last few years, and had an intensive BoF discussion on the challenges involved in building successful big data environments at the last ISC Cloud conference. And at this year’s ISC’13, there’ll be two sessions fully dedicated to big data. So, to answer your question, the ISC Big Data is basically a spin-off of our continuous effort to address topics that are highly affecting the current high-performance and high-throughput computing environments.

The first big data conference will be held from September 25 – 26 in Heidelberg, Germany, right after the ISC Cloud’13 conference. This year’s theme is “ISC Big Data – Where Enterprise and HPC Meet“, and it will be chaired by Sverre Jarp, the CTO of CERN openlab. So, building on the existing experience from large HPC installations and data-intensive enterprises, we’ll ensure that the best-of-breed practices and use cases as well as the latest trends get reviewed and shared amongst the 200 international attendees we are expecting at this new conference.

If people are wondering what makes the ISC Big Data so special, here are some insights:

  • Our goal is to encourage an active cross-fertilization between enterprise and HPC/HTC, and
  • We want to establish active links to sites with long traditions in huge data volumes.

For the full description of topics, please visit http://www.isc-events.com/bigdata13.


Also posted in Business of Big Data, Events | Leave a comment

View All Videos

inside-bigdata.com is a production of insideHPC, LLC. © 2011-2013 Sitemap