• Home
  • Blog
  • About
  • Contact
CloudAve
Software in Business. The Business of Software.
  • Business
    • Analysis
    • Entrepreneurship
    • Marketing
    • Strategy
    • Small business
  • Technology
    • Application Software
    • Infrastructure
    • Open Source
    • Mobile
    • Platforms
    • Product reviews
    • Security
  • Misc
    • Design
    • Just for fun
    • Trends & Concepts
  • Your POV
  • Sponsors
Browse: Home / GigaOM Pro report on Hadoop and cluster management

GigaOM Pro report on Hadoop and cluster management

By Paul Miller on July 24, 2012

My latest piece of work for GigaOM Pro just went live. Scaling Hadoop clusters: the role of cluster management is available to GigaOM Pro subscribers, and was underwritten by StackIQ.

Thanks to everyone who took the time to speak with me during the preparation of this report.

As the blurb describes,

From Facebook to Johns Hopkins University, organizations are coping with the challenge of processing unprecedented volumes of data. It is possible to manually build, run and maintain a large cluster and to use it to run applications such as Hadoop. However, many of the processes involved are repetitive, time-consuming and error-prone. So IT managers (and companies like IBM and Dell) are increasingly turning to cluster-management solutions capable of automating a wide range of tasks associated with cluster creation, management and maintenance.

This report provides an introduction to Hadoop and then turns to more-complicated matters like ensuring efficient infrastructure and exploring the role of cluster management. Also included is an analysis of different cluster-management tools from Rocks to Apachi Ambari and how to integrate them with Hadoop.

Compulsory picture of an elephant as it’s a Hadoop story provided by Flickr user Brian Snelson.

Related articles
  • The unsexy side of big data: 6 tools to manage your Hadoop cluster (gigaom.com)

(Cross-posted @ Paul Miller – The Cloud of DataPaul Miller – The Cloud of Data | Paul Miller – The Cloud of Data)

Post Views: 0

Share:

  • Twitter
  • Facebook
  • LinkedIn

Posted in Open Source | Tagged Administrivia, Apache Hadoop, big data, cluster management, dell, facebook, GigaOM, GigaOM Pro, hadoop, IBM, Johns Hopkins University, rocks, stackiq

Paul Miller

« Previous Next »
feed mail facebook twitter linkedin

Sponsor Posts

    No feed items found.

    No feed items found.

Cloud Tweets

Tweets from @ZoliErdos/cloudave-widget

Popular Posts

  • Home
  • The Four Quadrants of Innovation: Disruptive vs Incremental
  • Dilbert on the HP CEO Carousel
  • SaaS v. On-premises Software: Which One is More Green?
  • Blog
  • Sponsors
  • If You Start Your Tweet with @name, Few Will See It
  • Decision flow for customer feature requests

Archives

Authors

  • Adron Hall
  • Chirag Mehta
  • Christian Reilly
  • Dan Morrill
  • Derek Pilling
  • Hutch Carpenter
  • Jarret Pazahanick
  • Jason M. Lemkin
  • Joel York
  • John Taschek
  • Krishnan Subramanian
  • Mark Suster
  • Michael Krigsman
  • Ofir Nachmani
  • Paul Miller
  • Quinton Wall
  • Randy Bias
  • Robert Duffner
  • Sadagopan
  • wprss
  • Zoli Erdos
Sponsored by: