Pivotal, the software startup owned by EMC and General Electric, launched two products earlier this week, both aiming to close what the company refers to as the “big data productivity gap.”
One of the products, called Pivotal Data Dispatch, is actually a solution developed by NYSE Euronext. The equities-exchange operator, owned by IntercontinentalExchange, built the solution to help its analysts quickly access data they needed from the wide variety of data sources available to them.
Abhishek Kashyap, principal product manager at Pivotal, said NYSE had licensed the technology to Pivotal to act as an exclusive reseller for several years. “The version we will be selling is what they developed and what they deploy internally,” he said.
Data Dispatch is essentially a framework for providing views into multiple data assets across different systems. The framework is based on a set of metadata which govern access to data by each user.
The metadata are defined by the IT organization based on policy. It eliminates the need for an analyst to email a request to IT every time they need a set of data to work with.
The second product announced is actually a tighter integration between two existing technologies: Pivotal HD, the company's own Apache Hadoop distribution, and GemFire XD, an in-memory data management system.
In addition to providing the clustering capabilities of Hadoop and high performance of in-memory data processing to individual users, this solution can be coupled with applications, such as those written for high-frequency trading.
At Pivotal, the concept of the “big data productivity gap” is the huge difference between the amount of data available to companies and their ability to derive useful information from it. Tod Paletti, the company's VP of marketing, said enterprises store about 80% of all data generated by their customers on average, but only 3% of the data stored is being put to use.
Pivotal was spun out of EMC and VMware (in which EMC owns a controlling stake) in April. EMC owns about 60% of the venture, 30% is owned by VMware, and the remaining 10% belongs to GE.