Discovering Gold with Big Data Analytics and Data-Intensive Computing

Entries filed under “Public sector”

Indiana University Helps NASA Manage Big Data

Indiana University has contributed Big Data expertise and infrastructure to NASA’s Operation IceBridge, a decade-long polar ice monitoring project.

For the past four years, IU Research Technologies, a cyberinfrastructure and service center affiliated with the Pervasive Technology Institute (PTI), has provided IT support for the Center for Remote Sensing of Ice Sheets (CReSIS), a National Science Foundation Science and Technology Center led by the University of Kansas. Kansas scientists provide NASA with the radar technology that measures the physical interactions of polar ice sheets in Greenland, Chile and Antarctica. IU experts bring innovative data management and storage solutions to the missions.

Essentially, IU has built a supercomputer that can fly,” said Rich Knepper, manager of IU’s campus bridging and research infrastructure team within Research Technologies. “During this current mission, our system provided analysis of radar data as the data was collected – in real time — allowing mission scientists to see the ice bed information as the plane flies over the Arctic.”

Read the Full Story.


Also posted in Research, Storage | Leave a comment

Arkansas Dodges the Big Data Trough of Disillusionment

With Gartner claiming that Big Data is heading for its fabled “Trough of Disillusionment,” it’s nice to run across a story that shows the technology being warmly embraced with positive outcomes forecasted.

Such is the case with the Arkansas Department of Human Services (DHS), which will be using Big Data to modernize the delivery of social and healthcare services.

IBM announced last week that DHS will be implementing its IBM Smarter Cities solution, which provide Big Data analytics, social program management, and advanced security.  One of the major benefits of the roll out will be to transform an IT infrastructure that for some time ago has been mired in the Slough of Despond, to borrow a term from John Bunyan’s The Pilgrim’s Progress.

This will be DHS’ first step in transforming an IT infrastructure that is composed of more than 30 discrete system silos in an aging architecture,” said Dick Wyatt, chief information officer for Arkansas DHS. “Having a total view of our clients in one application — using the latest technology — will provide DHS with the ability to better manage the services provided. In addition, it will give DHS the ability to react more timely and efficiently to the many changes that are occurring and will continue to occur in the human services and healthcare arena.”

DHS will modernize its infrastructure with a service-oriented architecture that fully integrates its many different programs into, according to the IBM press release, “one re-usable and scalable platform.”  The new system will support such state social programs as Medicaid, the Supplemental Nutrition Assistance Program, and the State Children’s Health Insurance Program. The state’s adoption of Big Data analytics is expected to make it much easier for citizens to not only access government services, but achieve a satisfactory outcome as well.

According to the release, the heart of the new system is the IBM Cúram Social Program Management Platform. DHS is also deploying Cognos business intelligence software, Tivoli security solutions, DB2, Infosphere and Rational capabilities. All the software will run on IBM Power Systems.

So, the expectation is that the ability to crunch and analyze Big Data from DHS and other relevant departments will allow Arkansas to better deliver social programs to its citizens. IBM, of course, is on hand to help. Said Craig Hayman, general manager, Industry Solutions at IBM. “…the state can benefit from our deep healthcare industry expertise combined with an ability to apply that knowledge with Big Data analytics solutions that are secure and maximize existing technology investments.”

Read the Full Story.


Leave a comment

Google Targets Human Traffickers with Help from Big Data

Refugees from Myanmar wait for registration in Thailand after being rescued from a human-trafficking gang along the Malaysian border

Google has announced that it is taking steps to help combat human trafficking – a $32 billion illegal enterprise that exploits 20.9 million people worldwide, according to research from the United Nations Office on Drugs and Crime.

Google’s involvement includes a $3 million grant through its Global Impact Award program to three anti-trafficking organizations – Polaris Project, Liberty Asia and La Strada International.

Google will also leverage its Big Data technical expertise through its Google Ideas task force to build “…the first data-sharing platform to identify global patterns on how the human-trafficking trade operates and how to better protect the victims,” according to a story written by Bernhard Warner in Bloomberg Businessweek.

The story quotes Jared Cohen, director of Google Ideas, who said, “Nine months ago, starting with the Google Ideas Summit, we set out to map, expose, and disrupt the workings of illicit networks. This includes organized crime, narco-trafficking, organ harvesting. Every single one of these networks involved human trafficking.”

The Google Ideas task force will team with Palantir Technologies and Salesforce.com to build a data-sharing platform to identify and analyze how the trafficking trade operates and how to better protect its victims.

The alliance announced on Tuesday means the three anti-trafficking networks, which operate emergency hotlines in North America, Europe, and Southeast Asia, will share data on where the emergency phone calls are originating, the ages of the victims, their home countries, and the types of criminal activities they have been forced into,” writes Warner. “With the help of Salesforce.com, Palantir, and Google, the agencies will be able to crunch data like this in real time to detect crime trends that they can then share with police and policymakers to help protect victims.”

Read the Full Story.


Leave a comment

Video: The CIA’s Grand Challenges with Big Data

In this video from the Structure: Data 2013 conference, Central Intelligence Agency CTO Ira “Gus” Hunt presents: The CIA’s Grand Challenges with Big Data.

Sensors, agents and an Internet of Things are all producing data, all of the time. It would be a vast understatement to say that the CIA has experience in acquiring, handling and analyzing big quantities of data. In this talk, the CTO of the CIA will talk about the scale of the problems his team deals with now, the coming inflection point in the increase in data, the grand challenges we face and why an emphasis on analytics is critical for the future. This is a talk not to be missed.


Also posted in Analytics, Events, Video | Leave a comment

Obama Initiative Leverages Big Data to Explore the Brain

On Tuesday, April 2, President Obama announced a research initiative that has the ambitious goal of “revolutionizing our understanding of the human brain,” according to a White House press release.

Know as BRAIN (Brain Research through Advancing Innovative Neurotechnologies), the initiative is being launched in FY 2014 with an initial budget of about $100 million, a modest amount given the project’s goals.

In short, BRAIN is designed to help researchers find “…new ways to treat, cure, and even prevent brain disorders, such as Alzheimer’s disease, epilepsy, and traumatic brain injury.” Included is support for new technologies that will allow researchers to produce dynamic pictures of the brain that show how individual brain cells and complex neural circuits interact in real time.

This is a foray into Big Data. The initiative will let researchers amass and analyze the data needed to “…explore how the brain records, processes, uses, stores, and retrieves vast quantities of information, and shed light on the complex links between brain function and behavior.”

Among the many public and private organizations involved in the effort are the National Institutes of Health (NIH), the Defense Advanced Research Projects Agency (DARPA), and the National Science Foundation (NSF). NSF in particular is leading the charge in applying the technologies and techniques of Big Data to the initiative.

The National Science Foundation will play an important role in the BRAIN Initiative because of its ability to support research that spans biology, the physical sciences, engineering, computer science, and the social and behavioral sciences,” according to the White House release. “The National Science Foundation intends to support approximately $20 million in FY 2014 in research that will advance this initiative, such as the development of molecular-scale probes that can sense and record the activity of neural networks; advances in ‘Big Data’ that are necessary to analyze the huge amounts of information that will be generated, and increased understanding of how thoughts, emotions, actions, and memories are represented in the brain.”

In a story in Information Week posted the same day, senior editor J. Nicholas Hoover, writes, “On a conference call with reporters after the President’s announcement, National Institutes of Health director Francis Collins said that the brain-mapping initiative might eventually require the handling of yottabytes of data. A yottabyte is equal to a billion petabytes.”

That’s Big Data at its mind-boggling best.

Read the Full Story.


Also posted in Healthcare, Life Sciences, Research, Video | Leave a comment

Video: The Value of Large Scale Entity Analysis for National Security

In this video from the 2013 National HPCC Conference, Dr. Flavio Villanustre and Mary Galvin from LexisNexis present: The Value of Large Scale Entity Analysis for National Security.

HPCC Systems from LexisNexis Risk Solutions works with clients in various industries to manage different types of risk by helping them derive insight from massive data sets. To do this, we have developed our High Performance Computing Cluster (HPCC) technology, making it possible to process and analyze complex, massive data sets in a matter of seconds.


Also posted in Analytics, Events, HPCC, Software, Video | Leave a comment

Privacy and Big Data – What Goes Around Comes Around

In this feature, John Kirkley looks at how the threat of Big Data turning into Big Brother has its roots in Cold War.

The year was 1968 and it was the height of the Cold War. Wanting to know more about how a totalitarian regime might exercise rigid control over its population, the U.S. government asked the RAND corporation, a think tank based in Southern California, to look into the matter.

A bright, young RAND researcher named Paul Armer considered the issue and presented his findings to the Senate Subcommittee on Administrative Practice and Procedure in the form of a seminal document titled “Privacy Aspects of the Cashless and Checkless Society.”

Cost and convenience will ultimately force us to use some form of interconnected electronic payment and bookkeeping network for most transactions, instead of checks and currency,” commented Armer. The danger of personal surveillance – electronic snooping – depends largely on the completeness and centralization of records and the speed of transmission. Airline reservation systems (which can include hotels, car rentals, etc.) are a present example of large amounts of current personal information instantly available. There is little sanctuary for economic privacy in a system where any sizable cash transaction is conspicuous. Access to the files must be limited to a few persons who can be trusted.”

Now it’s 45 years later and as Yogi Berra once remarked, “It’s déjà vu all over again.”

The move to Big Data is sparking new concerns about privacy, and Orwell’s 1984 and the specter of Big Brother are being raised in cautionary postings all over the Internet.

Just one example: Steve Lohr, writing in last week’s New York Times, recalls how, in the 1960s, mainframes were a “significant technological challenge to common notions of privacy.” He describes various attempts to deal with contemporary issues around privacy generated by the rapid ascendancy of Big Data and increasingly sophisticated analytics with the obligatory nod to Orwell.

Featured in the article is Alex Pentland, a computational social scientist and director of the Human Dynamics Lab at M.I.T. He heads up a group at the M.I.T. Media Lab that is taking specific actions to address privacy concerns – including developing specific tools for handling personal data.

He (Pentland) espouses what he calls ‘a new deal on data’ with three basic tenets: you have the right to possess your data, to control how it is used, and to destroy or distribute it as you see fit,” writes Lohr. “Personal data, Dr. Pentland says, is like modern money — digital packets that move around the planet, traveling rapidly but needing to be controlled. ‘You give it to a bank, but there’s only so many things the bank can do with it,’ he says.

“His M.I.T. group is developing tools for controlling, storing and auditing flows of personal data. Its data store is an open-source version, called openPDS. In theory, this kind of technology would undermine the role of data brokers and, perhaps, mitigate privacy risks … Dr. Pentland’s group is also collaborating with law experts, like Scott L. David of the University of Washington, to develop innovative contract rules for handling and exchanging data that insures privacy and security and minimizes risk.”

Read the Full Story.


Leave a comment

Big Data: Big Brother or Nirvana?

Will Big Data help bring about the dystopian vision of George Orwell’s novel 1984 or be a boon for humanity, providing a range of benefits that were unthinkable until just recently?

That’s the question Fred Gallagher, the general manager of Vectorwise tentatively addresses in a blog posted on Wired’s Innovation Insights.

Gallagher pokes gingerly at the 800-pound Big Data gorilla in the room. He notes that the proliferation of social applications, and the use of the Internet in general has fostered a new age in the collection, analysis and leveraging of massive amounts of unstructured data about all of us on an unprecedented scale.

However, just as he appears to be raising the specter of Big Brother, Gallagher asks, “But is the ability to monitor our digital footprint and online activity necessarily a bad thing?”

He cites a number of benefits – everything from finding the best nearby pizza place on Yelp to predicting patterns associated with the outbreak of the flu or anticipating where crimes are likely to occur.

But despite all good things that Big Data can provide, there still exists the potential for misuse,” Gallagher cautions. “But the benefits seem to far outweigh the potential for harm. Not only does Big Data provide more knowledge on consumer behaviors but it can play a role in a medical clinical trial trying to find a cure for an illness or energy and utility companies making more sustainable decisions. And this is just the beginning. How far will Big Data take us in the future? What type of information will we be analyzing and obtaining that we haven’t even thought of yet? As our society continues to innovate and invent, what we can do with information will only continue to evolve. While some may consider Big Data a new form of Big Brother always watching, it may just become an accepted aspect of our future brought on by a society built upon information sharing and interactions.

This is a reasoned approach to the question at hand. But might it be that the inevitable rise of Big Data will have consequences for better or worse far beyond our wildest imaginings? Look out: Taleb’s Black Swan may be waiting for us just around the corner.


Leave a comment

Video: Moneyballing Government with the Code for America

In this video, Jennifer Pahlka describes how the Code for America project. As kind of a “Peace Corps for geeks,” the CFA enlists coders and data scientists to help governments become more connected, lean, and participatory through new opportunities for public service.

Code for America helps governments work better for everyone with the people and the power of the web. Through our Fellowship, Accelerator, and Brigade, we’re building a network of cities, citizens, community groups, and startups, all equally committed to reimagining government for the 21st century.

You’ve got to see this! Pahlka also shares some shocking stories about what Big Data tells about the criminal justice system. Read the Full Story.


Also posted in Business of Big Data, Video | Leave a comment

Podcast: How Well are the Feds Doing with Big Data?

How well is the Federal Government leveraging Big Data? In this podcast, Michael Nelson, a technology policy analyst from Bloomberg Government describes recent progress and obstacles the Feds are running into along the way.

Big Data, it’s is the next big thing expected to trigger $34 billion in worldwide IT spending this year. But harvesting the fruit is tedious work with a lot of steps in the process. Are the big data dollars at your agency being spent in a way that will maximize success? A new Bloomberg study broke down the big data cycle to look at the privacy, security and transparency issues that could be holding you back.

Download the MP3.


Also posted in Business of Big Data, Podcasts | Leave a comment

Advertisement

NAS for Dummies Ad

View All Videos

inside-bigdata.com is a production of insideHPC, LLC. © 2011-2013 Sitemap