• Home
  • Blog
  • About
  • Contact
CloudAve
Software in Business. The Business of Software.
  • Business
    • Analysis
    • Entrepreneurship
    • Marketing
    • Strategy
    • Small business
  • Technology
    • Application Software
    • Infrastructure
    • Open Source
    • Mobile
    • Platforms
    • Product reviews
    • Security
  • Misc
    • Design
    • Just for fun
    • Trends & Concepts
  • Your POV
  • Sponsors
Browse: Home / GigaOM Pro report on Hadoop and cluster management

GigaOM Pro report on Hadoop and cluster management

By Paul Miller on July 24, 2012

My latest piece of work for GigaOM Pro just went live. Scaling Hadoop clusters: the role of cluster management is available to GigaOM Pro subscribers, and was underwritten by StackIQ.

Thanks to everyone who took the time to speak with me during the preparation of this report.

As the blurb describes,

From Facebook to Johns Hopkins University, organizations are coping with the challenge of processing unprecedented volumes of data. It is possible to manually build, run and maintain a large cluster and to use it to run applications such as Hadoop. However, many of the processes involved are repetitive, time-consuming and error-prone. So IT managers (and companies like IBM and Dell) are increasingly turning to cluster-management solutions capable of automating a wide range of tasks associated with cluster creation, management and maintenance.

This report provides an introduction to Hadoop and then turns to more-complicated matters like ensuring efficient infrastructure and exploring the role of cluster management. Also included is an analysis of different cluster-management tools from Rocks to Apachi Ambari and how to integrate them with Hadoop.

Compulsory picture of an elephant as it’s a Hadoop story provided by Flickr user Brian Snelson.

Related articles
  • The unsexy side of big data: 6 tools to manage your Hadoop cluster (gigaom.com)

(Cross-posted @ Paul Miller – The Cloud of DataPaul Miller – The Cloud of Data | Paul Miller – The Cloud of Data)

Post Views: 0

Share:

  • Twitter
  • Facebook
  • LinkedIn

Posted in Open Source | Tagged Administrivia, Apache Hadoop, big data, cluster management, dell, facebook, GigaOM, GigaOM Pro, hadoop, IBM, Johns Hopkins University, rocks, stackiq

Paul Miller

« Previous Next »
feed mail facebook twitter linkedin

Sponsor Posts

    No feed items found.

    No feed items found.

Cloud Tweets

Tweets from @ZoliErdos/cloudave-widget

Popular Posts

  • Home
  • Amazon, Google, Facebook, Microsoft, Apple, and Oracle Org Chart
  • AuthN, AuthZ and Gluecon
  • The Five-Step Maturity Model for Building a Collaborative Organization
  • A fun (and potentially infuriating) mental exercise
  • 10 Critical Requirements for Cloud Applications
  • Hype Cycle for Emerging Technologies 2010: The Rise of Idea Management
  • Does Private SaaS Make Any Sense?

Archives

Authors

  • Adron Hall
  • Chirag Mehta
  • Christian Reilly
  • Dan Morrill
  • Derek Pilling
  • Hutch Carpenter
  • Jarret Pazahanick
  • Jason M. Lemkin
  • Joel York
  • John Taschek
  • Krishnan Subramanian
  • Mark Suster
  • Michael Krigsman
  • Ofir Nachmani
  • Paul Miller
  • Quinton Wall
  • Randy Bias
  • Robert Duffner
  • Sadagopan
  • wprss
  • Zoli Erdos
Sponsored by: