Cookie policy: This site uses cookies (small files stored on your computer) to simplify and improve your experience of this website. Cookies are small text files stored on the device you are using to access this website. For more information on how we use and manage cookies please take a look at our privacy and cookie policies. Some parts of the site may not work properly if you choose not to accept cookies.


HP Discover: HP tightens embrace of Hadoop

  • Print
  • Share
  • Comment
  • Save

HP is making efforts to expand its reach into the market for “Big Data” analytics (extracting useful business intelligence out of large and often chaotic mixes of data), using its hardware, software and services capabilities.

Much of this play is offering customers help with leveraging Apache Hadoop, an open-source distributed-computing framework that provides a way to cluster many simple commodity servers to process massive workloads. It has become one of the most popular platforms in the quickly growing space of unstructured-data analytics.

The company announced on Monday a hardware architecture designed to run Hadoop and unveiled consulting services to help companies use the framework. It also announced that Vertica – a company it bought in March 2011 – will integrate the latest release of its analytics platform (Vertica 6) with Hadoop.

Vertica 6 – also launched on Monday – can use data it gets from a variety of sources, HP says, which Hadoop is now one of. It takes this ability to use many different interfaces from its FlexStore architecture, according to HP.

In a statement, the company said this architecture enabled integrates or federation with Hadoop, Autonomy (another recent analytics acquisition) or literally “any other structured, unstructured or semi-structured data source.”

In addition to Hadoop, the latest version of Vertica adds native support for parallel execution of R (a programming language developed specifically for data analytics), and better support for implementations on cloud infrastructure or for Software-as-a-Service delivery.

HP made all of the announcements at is annual Discover conference in Las Vegas.

The hardware architecture for Hadoop unveiled on Monday is called HP AppSystem for Apache Hadoop. It consists of an 18-node cluster of HP’s latest ProLiant Gen8 DL380 servers and HP networking gear, all managed through the HP Insight Cluster Management software.

The vendor can deliver the system as a “turnkey appliance” for customers that do not have the resources or the desire to design and build a Hadoop system in-house.

HP has developed reference architectures, tools and whitepapers to support the top Hadoop distribution vendors: Cloudera, Hortonworks and MapR. These companies provide commercial products and services associated with Hadoop besides distributing Hadoop itself.

Cloudera, one of the three, is also partnered with a range of major HP competitors, including Acer, Dell, NetApp, SGI, Oracle and Supermicro. Hoartonworks’ partner list includes NetApp, Seamicro and Teradata, as well as Vertica, among others.

MapR’s has EMC, Cisco, IBM, Teradata and VMware as its partners in addition to many more.

Autonomy, whose founder and until recently CEO Mike Lynch was let go in May, is also now more tightly integrated with Hadoop. HP can now embed the unit’s Intelligent Data Operating Layer (IDOL) 10 engine in each server node in a Hadoop cluster.

Rafiq Mohammadi, CEO of Autonomy Promote, an Autonomy unit, said, “IDOL 10 is now part of the Hadoop network. Enterprises can drop an IDOL instance right into a hadoop node.”

IDOL is the “heart” of Autonomy’s infrastructure software, the company says. The secret sauce is the company’s proprietary structure for storing data, optimized for fast processing and data retrieval.

Close coupling with IDOL 10 gives users access to hundreds of its functions, including automatic categorization, clustering, hyperlinking and more.

Lynch's departure was announced on the same day HP announced its Q2 fiscal 2012 earnings and a new restructuring plan that included laying off or sending into early retirement about 27,000 of its staff around the world.

Related images

  • Rafiq Mohammad, CEO, CEO of Autonomy Promote, HP (left), and Colin Mahony, VP and general manager at HP Vertica

Have your say

Please view our terms and conditions before submitting your comment.

  • Print
  • Share
  • Comment
  • Save


  • Overhead Power Distribution – Best Practice in Modular Design

    Tue, 10 Nov 2015 16:00:00

    Overhead power distribution in your data center offers many attractive possibilities but is not without its challenges. Join UE Corp’s Director of Marketing, Mark Swift, and CPI’s Senior Data Center Consultant, Steve Bornfield, for an exploration of the options and some of the pitfalls, supported by real-life examples from the field.

  • Overcoming the Challenges of High Power Density Deployments

    Wed, 4 Nov 2015 19:00:00

    Increasing rack power densities saves space and energy, and improves both OPEX and CAPEX. But it can also create unintended problems that could bring your data center to a screeching halt. Join Raritan’s VP of Products & Marketing, Henry Hsu, and DCD’s CTO Stephen Worn, as they reveal the three key challenges in deploying a high density cabinet, and explain how to: Reduce operating costs, Increase up-time , Improve mean time to repair, become more energy-efficient manage existing capacity and plan for growth.

  • Squeezing the Lemon - The Power to do More with Less

    Tue, 20 Oct 2015 08:00:00

    Energy costs rising, manpower resources falling – managing a data center is getting more stressful by the day. One cold night could be all it takes to tip your power supply over the edge. And let's not forget the never-ending demands from IT for additional space. More information on its own is not the answer. Join Rittal's webinar to understand how to: • Lower your power consumption and OPEX charges, with 'smart' power distribution • Identify issues before they become problems, with intelligent PDUs' monitoring capabilities • Expand your DC as your business grows, with modular PDUs • Profile your power requirements to help you plan and make better-informed decisions REGISTER NOW Note: All attendees will receive a free copy of the latest White Paper from Rittal.

  • Live Customer Roundtable: Optimizing Capacity (12:00 EST)

    Tue, 8 Sep 2015 16:00:00

    The biggest challenge facing many data centers today? Capacity. How to optimize what you have today. And when you need to expand, how to expand your capacity smarter. Learn from the experts about how Data Center Infrastructure Management (DCIM) and Prefabricated Modular Data Centers are driving best practices in how capacity is managed and optimized: - lower costs - improved efficiencies and performance - better IT services delivered to the business - accurate long-range planning Don;t miss out on our LIVE customer roundtable and your chance to pose questions to expert speakers from Commscope, VIRTUS and University of Montana. These enterprises are putting best practices to work today in the only place that counts – the real world.

  • Power Optimization – Can Your Business Survive an Unplanned Outage? (APAC)

    Wed, 26 Aug 2015 05:00:00

    Most outages are accidental; by adopting an intelligent power chain, you can help mitigate them and reduce your mean-time to repair. Join Anixter and DatacenterDynamics for a webinar on the five best practices and measurement techniques to help you obtain the performance data you need to optimize your power chain. Register today!

More link