Cookie policy: This site uses cookies (small files stored on your computer) to simplify and improve your experience of this website. Cookies are small text files stored on the device you are using to access this website. For more information on how we use and manage cookies please take a look at our privacy and cookie policies. Some parts of the site may not work properly if you choose not to accept cookies.

sections

HP Discover: HP tightens embrace of Hadoop

  • Print
  • Share
  • Comment
  • Save

HP is making efforts to expand its reach into the market for “Big Data” analytics (extracting useful business intelligence out of large and often chaotic mixes of data), using its hardware, software and services capabilities.

Much of this play is offering customers help with leveraging Apache Hadoop, an open-source distributed-computing framework that provides a way to cluster many simple commodity servers to process massive workloads. It has become one of the most popular platforms in the quickly growing space of unstructured-data analytics.

The company announced on Monday a hardware architecture designed to run Hadoop and unveiled consulting services to help companies use the framework. It also announced that Vertica – a company it bought in March 2011 – will integrate the latest release of its analytics platform (Vertica 6) with Hadoop.

Vertica 6 – also launched on Monday – can use data it gets from a variety of sources, HP says, which Hadoop is now one of. It takes this ability to use many different interfaces from its FlexStore architecture, according to HP.

In a statement, the company said this architecture enabled integrates or federation with Hadoop, Autonomy (another recent analytics acquisition) or literally “any other structured, unstructured or semi-structured data source.”

In addition to Hadoop, the latest version of Vertica adds native support for parallel execution of R (a programming language developed specifically for data analytics), and better support for implementations on cloud infrastructure or for Software-as-a-Service delivery.

HP made all of the announcements at is annual Discover conference in Las Vegas.

The hardware architecture for Hadoop unveiled on Monday is called HP AppSystem for Apache Hadoop. It consists of an 18-node cluster of HP’s latest ProLiant Gen8 DL380 servers and HP networking gear, all managed through the HP Insight Cluster Management software.

The vendor can deliver the system as a “turnkey appliance” for customers that do not have the resources or the desire to design and build a Hadoop system in-house.

HP has developed reference architectures, tools and whitepapers to support the top Hadoop distribution vendors: Cloudera, Hortonworks and MapR. These companies provide commercial products and services associated with Hadoop besides distributing Hadoop itself.

Cloudera, one of the three, is also partnered with a range of major HP competitors, including Acer, Dell, NetApp, SGI, Oracle and Supermicro. Hoartonworks’ partner list includes NetApp, Seamicro and Teradata, as well as Vertica, among others.

MapR’s has EMC, Cisco, IBM, Teradata and VMware as its partners in addition to many more.

Autonomy, whose founder and until recently CEO Mike Lynch was let go in May, is also now more tightly integrated with Hadoop. HP can now embed the unit’s Intelligent Data Operating Layer (IDOL) 10 engine in each server node in a Hadoop cluster.

Rafiq Mohammadi, CEO of Autonomy Promote, an Autonomy unit, said, “IDOL 10 is now part of the Hadoop network. Enterprises can drop an IDOL instance right into a hadoop node.”

IDOL is the “heart” of Autonomy’s infrastructure software, the company says. The secret sauce is the company’s proprietary structure for storing data, optimized for fast processing and data retrieval.

Close coupling with IDOL 10 gives users access to hundreds of its functions, including automatic categorization, clustering, hyperlinking and more.

Lynch's departure was announced on the same day HP announced its Q2 fiscal 2012 earnings and a new restructuring plan that included laying off or sending into early retirement about 27,000 of its staff around the world.

Related images

  • Rafiq Mohammad, CEO, CEO of Autonomy Promote, HP (left), and Colin Mahony, VP and general manager at HP Vertica

Have your say

Please view our terms and conditions before submitting your comment.

required
required
required
required
required
  • Print
  • Share
  • Comment
  • Save

Webinars

  • Powering Big Data with Big Solar

    Tue, 12 Jul 2016 18:00:00

    The data center industry is experiencing explosive growth. The expansion of online users and increased transactions will result in the online population to reach 50% of the world’s projected population, moving from 2.3 billion in 2012 to an expected 3.6 billion people by 2017. This growth is requiring data centers to address the carbon impact of their business and the increasing need for data centers to integrate more renewable resources into their projects. Join First Solar to learn: -Why major C&I companies are looking to utility-scale solar as a viable addition to their energy sourcing portfolios. -How cost-effective utility-scale solar options can support datacenters in securing renewable supply. -Case study of how a major data center player implemented solar into their portfolio

  • Smart Choices for your Digital Infrastructure

    Tue, 28 Jun 2016 10:00:00

    Your data centre is a key part of successfully transforming and building your digital business. The challenge today is to create a highly reliable, flexible, scalable and cost-effective digital infrastructure. Your cabling system is an important element in the creation of that infrastructure. Attend and learn how to: - Piece together different elements of standards, technical specifications and physical properties in order to choose the right networking equipment - Reduce the time and labour spent maintaining, repairing or installing cabling by adopting improved design and management practices.

  • White Space 39: Attacks on power and cooling

    Tue, 17 May 2016 08:25:00

    This week on White Space, we talk about the security of Industrial Control Systems – the systems that control your CRAC or PDUs. If these devices are connected to a network, attackers can reach them, and shut down a facility. Special guests Ed Ansett and George Rockett.

  • White Space 38: Leaving Las Vegas

    Tue, 10 May 2016 13:25:00

    This week we talk about: Tax Break for a data center Efficiency standards News form the Las Legad event - EMC World The Dell/EMC merger. And much more...

  • Designing Flexibility into your Data Center Power Infrastructure

    Wed, 4 May 2016 18:00:00

    As power density is rapidly increasing in today’s data center, provisioning the right amount of power to the rack without under sizing or over provisioning the power chain has become a real design challenge. Managing the current and future power needs of the data center requires Cap-Ex to deploy a flexible power infrastructure: safely handling peak power demands, balancing critical loads and easily scaling to meet growing power needs. In this webinar you will learn: > How to create Long term power flexibility and improved availability for your operation > How to increase energy efficiency and improve SLAs through a comprehensive set of best practices.

More link