Pivotal, an EMC and VMware spinoff, has partnered with NYSE Euronext, operator of some of the world's largest equities markets, to build what appears to be a Hadoop-based big data analytics platform that will tackle real-time data generated by NYSE's exchanges.
Details on the partnership are scarce at the moment. The companies have not offered any information aside from a blog post on Pivotal's website announcing a kick-off event at the end of October, followed by ringing of the closing bell at the end of a trading day on the New York Stock Exchange.
What is clear is that the solution will involve Hadoop and analysing market data. Pivotal blogger Stacey Schneider wrote that this NYSE partnership was “rooted” in some of Pivotal employees' heritage from their VMware days.
The virtualization giant helped NYSE build its Capital Markets Community Platform, a solution underpinned by a hybrid-cloud infrastructure. “Now, with a focus on Hadoop and big, fast data, we are set to help them again,” Schneider wrote.
One-third of the world's equities trading takes place on NYSE's equities markets, which include the New York Stock Exchange, NYSE Euronext, NYSE MKT, NYSE Alternet and NYSE Arca.
“Without previewing any specifics, for anyone in IT, this means one thing—very big data,” Schneider wrote. “And with that much money from that many countries at stake, their data needs are global and fast.”
The only specific product Pivotal has talked about since its unveiling in April is Pivotal One. Paul Maritz, former VMware CEO appointed to run the spinoff, said Pivotal One will be a software suite that will take advantage of Hadoop and in-memory database technology to provide big data analytics capabilities in real time.
Maritz said the company expected to launch it in the fourth quarter of this year. At least one part of the suite, a Hadoop distribution called Pivotal HD, is already available.
EMC, which owns a controlling stake in VMware, owns about 60% of Pivotal. VMware owns about 30%, and the remaining 10% belongs to GE, the US industrial giant with a new focus on big data and the “internet of things.”
Talking about Pivotal at EMC World in Las Vegas in May, Maritz said the company wanted to enable a new IT architecture, which could use a variety of infrastructure clouds underneath, while letting users build next-generation applications on Node JS, Ruby on Rails, Sping, Python and Hadoop.
This architecture would also take into account the fact that traditional business applications, such as Java, Oracle database, SAP and Microsoft Dynamics, will remain part of enterprise IT for a long time, Maritz said.
Pivotal's event at the New York Stock Exchange will take place on 28 October.