Discovering Gold with Big Data Analytics and Data-Intensive Computing

Advertisement

Entries filed under “Events”

Video: Massive I/O Requirements for the SKA Telescope

In this video from the 2013 Open Fabrics Developer Workshop, Bill Boas from Cray presents: Massive I/O Requirements for the SKA Telescope.

Processing the vast quantities of data produced by the SKA will require very high performance central supercomputers capable of 100 petaflops per second processing power. This is about 50 times more powerful than the most powerful supercomputer in 2010 and equivalent to the processing power of about one hundred million PCs.

Download the slides (PDF) or check out more OFA videos in our Open Fabrics Worshop Video Gallery.


Also posted in Hardware, HPC, I/O, Network, Video | Leave a comment

Podcast: Radio Free HPC Looks at Lustre with Brent Gorda


 
In this podcast, the Radio Free HPC team discusses Lustre and LUG 2013 with Brent Gorda. Now part of Intel in their High Performance Data Division, Gorda was CEO of Whamcloud when the company was acquired last summer.

Gorda recently wrote a post about the rapid growth of the Lustre community, so we started our discussion there and learned a good deal more about the popular file system.

Download the MP3 * Subscribe on iTunes * Subscribe to RSS


Also posted in HPC, I/O, Lustre, Podcasts | Leave a comment

Video: High Availability in Lustre

In this video from the Lustre User Group 2013, John Fragalla from Xyratex presents: High Availability in Lustre.

Download the slides (PDF) or check out our LUG 2013 Video Gallery.


Also posted in Hardware, HPC, I/O, Lustre, Software, Storage, Video | Leave a comment

Video: Real-Time Big Data Analytics from Deployment to Production

In this video from the Strata 2013 Conference, David Smith from Revolution Analytics describes the five stages of real-time analytics deployment, and the technologies supporting each stage, including Hadoop, R, and database warehousing systems. He also shares some best practices for setting up a the technology stack and processes for model deployment, based on some real-life case studies.


Also posted in Analytics, Software, Video | Leave a comment

High Performance RDMA-based Design for Big Data and Web 2.0 memcached

In this video from the 2013 Open Fabrics Developer Workshop, D.K. Panda from Ohio State University presents: High Performance RDMA-based Design for Big Data and Web 2.0 memcached.

You can check out more OFA videos at our Open Fabrics Workshop Video Gallery.


Also posted in Hardware, HPC, I/O, memcached, Network, Software, Video | Leave a comment

It’s Big Data Week Around the World

In case you weren’t aware of it, we are right in the middle of Big Data Week 2013.  This is a global event featuring a series of community-led Big Data conferences, meetings, workshops, networking events and hackathons.

The event, which runs from April 22-28, has a somewhat British flavor, being produced by media 140 Worldwide headquartered in London. They anticipate that by the end of the week more than 5,000 Big Data practitioners from 20 countries and four continents will participate.

Typical events include:

With more than 200 events, Big Data Week is a platform for thousands of data scientists, data technologists, data visualisers and leaders from the business, not-for-profit and governments sectors to share how Big Data is impacting their organisations,” according to the conference organizers.  “‘Big data has gone from a buzz word to a business reality. Now is the moment to learn from each other to advance the art and science of harnessing data to benefit all aspects of society,’ said Kenneth Cukier, a co-author of the book Big Data: A Revolution That Will Transform How We Live, Work, and Think and the data editor at The Economist, who is keynoting an event on 25th April at Imperial College London.”

The full list of the 200+ events can be found here.

And here’s one of the week’s interesting activities: Teams from around the world will be tasked to find the world’s healthiest city using publically available data sources. They will develop models for ranking the health of a city using sources such as government statistics, weather patterns, Twitter sentiment and any other publically available data sets.

Will London be the winner?  Only Big Data and time will tell.

Read the Full Story.


Also posted in BigData Top100 | 1 Comment

Video: Accelerating Big Data over RDMA

In this video from the 2013 Open Fabrics Developer Workshop, Sreev Doddabalapur from Mellanox presents: Accelerating Big Data over RDMA.

You can check out more OFA videos at our Open Fabrics Workshop Video Gallery.


Also posted in Hardware, HPC, I/O, Network, RDMA, Video | Leave a comment

Video: Warp Mechanics ZFS Array

In this video from the Lustre User Group 2013 conference, Josh Judd from Warp Mechanics presents: Warp Mechanics ZFS Array.

The WARP Mechanics 39830 is a turnkey network-attached non-volatile RAM + SSD system with industry-leading price, performance, and scalability. This system maximizes the IOPs performance for the most demanding application profiles. It is an ultra-dense space and power saving solution. This is optimal for large-scale IO intensive workloads with large live data sets. The 50x high capacity 2TB SSD modules per 4U enclosure are configured into five 10-disk RAID 6 sets to maximize protection and performance. Each RAID set has a two NV-RAM modules serving as write cache. These RAID sets are added to the overall ZFS storage pool and can be allocated to a nearly limitless number of any sized volumes presented to hosts. This yields a flexible 100TB of usable RAID protected SSD storage.

Check out more Lustre presentations at our LUG 2013 Video Gallery.


Also posted in Hardware, HPC, Lustre, Software, Storage, Video, ZFS | Leave a comment

Video: Lustre on Amazon Web Services

In this video from the Lustre User Group 2013 conference, Robert Read from Intel presents: Lustre on Amazon Web Services.

You can check out more Lustre presentations at our LUG 2013 Video Gallery.


Also posted in Cloud, HPC, I/O, Lustre, Software, Video | Leave a comment

Video: Hadoop MapReduce over Lustre

In this video from the Lustre User Group 2013 conference, Omkar Kulkarni from Intel presents: Hadoop MapReduce over Lustre.

You can check out more Lustre presentations at our LUG 2013 Video Gallery.


Also posted in Hadoop, Lustre, Software, Video | Leave a comment

Advertisement


View All Videos

inside-bigdata.com is a production of insideHPC, LLC. © 2011-2013 Sitemap