Adaptive Computing, vendor of IT resource management software with a focus in the high performance computing (HPC) space, is planning to integrate its Moab and Torque workload management solutions with Intel's recently announced HPC Distribution for Apache Hadoop.

The distribution, announced by Intel at the SC13 supercomputing conference in Denver earlier this month, combines the chipmaker's distribution for Hadoop software with its Enterprise Edition of Lustre software. Hadoop is a popular framework for big data analytics systems and Lustre is a file system for large compute clusters widely used in the HPC space. Both are open source.

Michael Jackson, president and co-founder of Adaptive, said the solution will combine HPC and big data systems on a single platform. “The convergence between big data and HPC environments will only grow stronger as organizations demand data processing models capable of extracting the results required to make data-driven decisions.”

The integration will enable Hadoop and HPC workloads to run together on the same infrastructure, instead of being in two distinct silos. Adding Adapive's technology to the mix will improve launch speeds and Hadoop processing speeds, according to the software company.

Enterprises and research labs are looking for a flexible software platform that allows big data analytics applications that are based on Hadoop to access data on HPC storage systems, according to Adaptive. Organizations also now expect the same performance and manageability from Hadoop workloads that they get from orchestrating HPC workloads today.