SpaceCurve Sets Real-Time Big Data Performance Record

Tens of Gigabytes per Second, Petabytes per Day
Immediately Available for Complex Queries

SEATTLE--(BUSINESS WIRE)--SpaceCurve, the creator of the first third-generation Big Data platform, today announced it has set a real-time Big Data performance record for ingesting streaming data and making records immediately available for complex queries. The ability to deliver immediate insights from multiple layers of high-velocity streaming data is becoming a requirement for Big Data applications and services. SpaceCurve’s performance record demonstrates its ability to meet the demands of the real-time Big Data market.

“We are changing the economics of Big Data by providing real-time analysis and insights on volumes and velocities of data that couldn’t be immediately processed before”

The SpaceCurve test configuration ingested, stored and made available complete, socially rich, location-aware tweet records, averaging 2,500 bytes in size, for advanced real-time analytics. Operations were performed at a rate equal to millions of records per second, hundreds of billions of records per day and petabytes of data per day. (See complete testing overview below.)

“We are changing the economics of Big Data by providing real-time analysis and insights on volumes and velocities of data that couldn’t be immediately processed before,” said John Slitz, CEO of SpaceCurve. “The new response times and capacity standards SpaceCurve has set will disrupt the Big Data market. With SpaceCurve, companies will now be able to monetize highly perishable data in motion as it is created, extending existing investments and delivering new products and services.”

SpaceCurve is developing a third-generation Big Data platform that delivers real-time immersive intelligence and innovative location-based services from larger volumes, higher velocities and wider varieties of data than other systems. By continuously capturing, processing and fusing multiple layers of spatial, temporal, sensor network, social media and other large sets of streaming data, SpaceCurve’s unique database architecture allows organizations to leverage the transformative economics of real-time Big Data and achieve competitive advantage. SpaceCurve technologies are being deployed to beta customers in Q1 2013 with general availability in Q2 2013.

“The full potential of Big Data can only be unleashed with real-time analytics and the big insights, improved business performance and new market-leading applications and services they make possible," said Al Nugent, co-author of the upcoming "Big Data for Dummies" book. “SpaceCurve is transforming the Big Data market through its ability to process and manage large amounts of high-velocity data in real time that isn’t possible with existing technologies. Based on the results of these performance tests, it appears that SpaceCurve is well on its way to providing capabilities that will profoundly change the use of Big Data.”

Testing Overview

• Tweet records tested averaged 2,500 bytes each and contained the tweet itself, the time the tweet was sent, the location from where it was sent, and a complete user record that included who that user was following, who was following the user and patterns of how the user responded to subject matter.
• SpaceCurve’s Big Data platform ingested a continuous data stream, applied algorithms that constructed a pattern and assigned a unique identifier to each record, and used the combination of the pattern and the unique identifier to assign a unique key to each record that determined where to store it and how to organize it. Records were stored as complex data models and were immediately available for complex queries. The entire operation happened in real time.
• Testing was conducted on clusters of commodity hardware. Each node was an Intel 12-core, 2-CPU system with 128GB DRAM and 15TB of storage (split between solid-state drives and spinning platters). Performance numbers are based on a 100-node cluster.

About SpaceCurve

SpaceCurve is developing a third-generation Big Data platform that delivers real-time immersive intelligence and drives innovations in location-based services. By simultaneously meeting the volume, variety and velocity demands of real-time Big Data that current technologies can’t handle, SpaceCurve extends existing Big Data applications and provides new capabilities for services across markets, including mobile, social media, financial trading, energy, communications, transportation, government and other markets.