• Home
  • Blog
  • About
  • Contact
CloudAve
Software in Business. The Business of Software.
  • Business
    • Analysis
    • Entrepreneurship
    • Marketing
    • Strategy
    • Small business
  • Technology
    • Application Software
    • Infrastructure
    • Open Source
    • Mobile
    • Platforms
    • Product reviews
    • Security
  • Misc
    • Design
    • Just for fun
    • Trends & Concepts
  • Sponsors
Browse: Home / GigaOM Pro report on Hadoop and cluster management

GigaOM Pro report on Hadoop and cluster management

By Paul Miller on July 24, 2012

My latest piece of work for GigaOM Pro just went live. Scaling Hadoop clusters: the role of cluster management is available to GigaOM Pro subscribers, and was underwritten by StackIQ.

Thanks to everyone who took the time to speak with me during the preparation of this report.

As the blurb describes,

From Facebook to Johns Hopkins University, organizations are coping with the challenge of processing unprecedented volumes of data. It is possible to manually build, run and maintain a large cluster and to use it to run applications such as Hadoop. However, many of the processes involved are repetitive, time-consuming and error-prone. So IT managers (and companies like IBM and Dell) are increasingly turning to cluster-management solutions capable of automating a wide range of tasks associated with cluster creation, management and maintenance.

This report provides an introduction to Hadoop and then turns to more-complicated matters like ensuring efficient infrastructure and exploring the role of cluster management. Also included is an analysis of different cluster-management tools from Rocks to Apachi Ambari and how to integrate them with Hadoop.

Compulsory picture of an elephant as it’s a Hadoop story provided by Flickr user Brian Snelson.

Related articles
  • The unsexy side of big data: 6 tools to manage your Hadoop cluster (gigaom.com)

Share:

  • Twitter
  • Facebook
  • LinkedIn
  • Google +1
  • StumbleUpon

(Cross-posted @ The Cloud of Data)

Posted in Open Source | Tagged Administrivia, Apache Hadoop, big data, cluster management, dell, facebook, GigaOM, GigaOM Pro, hadoop, IBM, Johns Hopkins University, rocks, stackiq

Paul Miller

« Previous Next »
feed mail facebook twitter linkedin

Sponsor Posts

Want to Boost CRM Adoption? Eliminate These 4 Obstacles
Want to Boost CRM Adoption? Eliminate These 4 Obstacles
HR Tech Vendors: Who’s Out There?
HR Tech Vendors: Who’s Out There?
4 Ways Customer Service Teams Can Help During a Crisis
4 Ways Customer Service Teams Can Help During a Crisis
The Next Revolution for Finance -- Embedded Analytics
The Next Revolution for Finance -- Embedded Analytics
  • Tags
  • Calendar
  • Comments

accy2 amazon android Apple aws briefs cloud cloud computing collaboration conferences Enterprise enterprise 2.0 Entrepreneurship facebook google humor iaas IBM innovation insights integration ipad iphone marketing microsoft netsuite open source openstack paas platform services saas salesforce.com sap Security Social Business social media software as a service Startup Advice startups Tech Market Analysis twitter vc funding venture capital vmware xero

May 2013
M T W T F S S
« Apr    
 12345
6789101112
13141516171819
20212223242526
2728293031  
  • Ashoo tuli: Very informative.
  • Jarret Pazahanick: Thanks for the comment...
  • Hiks: Thanks Jarret. It’s really a very...
  • Vijay: Good Article… I have been working...
  • jarretpazahanick: Thanks Joost for the kind...
  • joost van assen: That is very good information...
  • jarretpazahanick: Volker – Here is a...
  • Chal: Hi Jarret, Could you please advise on how...
  • Volker Kuecherer: Do you have any information...
  • Experiencia Cloud (BETA): What Makes Cloud...
  • Abhishek: I see nothing wrong with rewarding...
  • CloudAve: always insightful Mark Suster...
  • fred zimny's serve4impact: See on...
  • CloudAve: 5 Key Essentials of Cloud Workloads...
  • jasonlkn: It’s natural … especially...

Archives

Authors

  • Adron Hall
  • Ben Kepes
  • Chirag Mehta
  • Chris Yeh
  • Christian Reilly
  • Colin Berkshire
  • Dan Morrill
  • Dan Pepper
  • Dave Michels
  • Dave Roberts
  • Hutch Carpenter
  • Jacob Morgan
  • Jarret Pazahanick
  • Jason M. Lemkin
  • Jeffrey Vocell
  • Joel York
  • John Taschek
  • Krishnan Subramanian
  • Mark Fidelman
  • Mark Suster
  • Martijn Linssen
  • Michael Krigsman
  • Ofir Nachmani
  • Paul Miller
  • Rakesh Malhotra
  • Randy Bias
  • Sadagopan
  • Scott Bils
  • Zoli Erdos
Sponsored by: