Discovering Gold with Big Data Analytics and Data-Intensive Computing

Entries filed under “Ceph”

Sage Weil Presents: An Intro to Ceph for HPC

By Rich | Published April 25, 2013

In this video from the Lustre User Group 2013 conference, Sage Weil from Inktank presents: An Intro to Ceph for HPC.

Ceph is a free software unified storage platform designed to present object, block, and file storage from a single distributed cluster. Ceph’s main goals are to be completely distributed without a single point of failure, scalable to the exabyte level, and freely-available. The data is seamlessly replicated, making it fault tolerant. Ceph is a software-based solution and runs on commodity hardware. The system is designed to be both self-healing and self-managing and strives to reduce both administrator and budget overhead.

Check out more presentations at our LUG 2013 Video Gallery.


Also posted in Business of Big Data, HPC, Lustre, Software, Video | Leave a comment

Henry Newman on File System Interface Futures

By Rich | Published January 15, 2013

Over at Enterprise Storage Forum, Henry Newman looks at the future of file systems and examines whether REST will overtake POSIX as an interface of choice for all applications.

We do not have a lot of POSIX file systems that scale today to 10s of PB and billions of files. There are three file systems in production with a parallel namespace (Gluster, PAN-FS, Lustre, and GPFS) and a new entry called Ceph. Ceph, GPFS Lustre and Pan-FS support parallel I/O, which is I/O from multiple threads (these threads could be running on multiple nodes) to a single file, but Gluster does not. On the other side there are dozens of vendors developing REST- and SOAP-based object management interfaces. Vendors are trying to create systems that support billions of objects in a single namespace. Given that the vendors are not constrained by the POSIX atomicity requirements and support for parallel I/O, this is far easier than developing this support inside a POSIX file system.

Read the Full Story.


Also posted in I/O, Lustre, Software, Storage | Leave a comment

Ceph Filesystem Ready to Take Off with Linux Distributions

By Rich | Published December 14, 2012

Over at The Register, Matt Asay writes that the Inktank startup is in a great position to grow now that the Ceph client has been accepted into the Linux kernel.

Ceph is well-positioned to capture greenfield distributed storage opportunities through its so-called object storage approach. In my experience, it’s this greenfield characteristic that should be a great catalyst for Inktank, as it gives Inktank the chance to grow under the radar of the big, incumbent vendors. Since Ceph will be stealing greenfield sales opportunities that never actually hit the radar of the proprietary vendors’ respective sales teams, they won’t know they’re bleeding until Ceph’s momentum is difficult to impossible to stop.

Read the Full Story or check out our interview below with Neil Levine from Inktank at SC12.


Also posted in Business of Big Data, HPC, Software, Video | Leave a comment

View All Videos

inside-bigdata.com is a production of insideHPC, LLC. © 2011-2013 Sitemap