Background Image

The New Face of Enterprise Data Streaming

20 May 15

Last week I joined several other members of the Push Technology team at Apps World NA.  As part of our participation I spoke on the Developer Stage day 1, and the Enterprise Stage day 2.  During my time on the Enterprise Stage I presented a new area of business that has emerged in the current cloud-based, service-oriented, mobile-obsessed world we live in: Internet Data Streaming.  Internet Data Streaming is the new face of Enterprise Messaging, built to solve a similar set of problems in an ecosystem that is vastly different.

As more and more of our enterprise architectures become service-oriented in nature, our enterprise applications can no longer talk over known and dedicated networks to other internal systems.  To surpass and conquer the issues data transmission over the Internet generates, we need a new solution, one built for the modern world.  As a result, I pose the following definition:

High-throughput, low-latency, bandwidth-conservative information movement between vast numbers of endpoints connected via the Internet.

Breaking this down, what does it mean?  High-throughput means we need to support lots and lots of updates in an event-driven, streaming fashion.  Low-latency means that speed is king, and we need to get the data there quickly.  Bandwidth-conservative drives us to care about every byte we send, being conscious of user’s data plans, while information encompasses any data, facts, figures, streams or other 1’s and 0’s we might need to move.  Speaking of moving, movement does imply a bi-directional nature, necessary to collect statistical data while providing information to consumers.  Finally, a vast number of endpoints doesn’t mean hundreds or thousands, it means 10’s or 100’s of thousands of users, growing to millions of users, all connected at one time, over the Internet.

Out of this, we can generate a checklist to be used when looking at any product that claims to be Internet ready, to see if we can apply the term.  On our checklist, we now have:

High-throughput

Every developer faces a significant throughput problem in the coming years.  With IoT bringing 50 billion+ devices by 2020, there will be more data than ever to move across devices.

Low-latency

No business is ever fully happy with how fast their site or app is.  User preferences for instant data gratification are so strong that apps are uninstalled if they make users wait more than a few seconds.  Speed is king, and real-time data is not the new norm, it’s the new expected.

Bandwidth-conserving

No user wants to pay more for their cell phone bill every month, and no company wants to pay more for increasing bandwidth.  Bandwidth is not free or infinite, especially as we move to a service-orientated model in the cloud.  The new future of scaling criteria will not just be CPU and Memory load, but will also be based on network load.  Savings of just 2 bytes per message to 50,000 users receiving 10 messages per second results in a savings of 31.5 TB over the course of a single year.  Don’t forget that as bandwidth is measured in bits per second, the fewer bits we try to send, the faster we can get them to their destination and the more streams we can support.

Vast scale, without degraded QoS (Quality of Service)

Most services that are built to handle load have a common feature, the connection vs latency graphs are exponential functions.  In other words, as the number of connections increases, the latency of each connection increases, causing all users to slow down.  In a world of mobile devices and constantly changing network conditions, focusing on constant QoS at scale will enable larger numbers of concurrent connections on a single machine, allowing companies to easily handle spikes in user demand.

Internet Sympathy

Contrary to its name, Internet Sympathy is not a greeting card.  Internet Sympathy is about being sympathetic to the realities of mobile devices and the fact that people are often on the go.  As these users move around with these devices, the connectivity will change between EDGE/3G/4G/WiFi, causing (at times) vast fluctuations in performance of mobile devices.  As IoT enters the picture, this introduces even more unreliable connections, requiring developers to focus on Internet Sympathy.

With this checklist in hand, developers can be empowered to choose an Internet Data Streaming provider that solves their needs, and lets them focus on what they do best; building cool apps.

To find out more about our flagship Diffusion product, click here.


The Diffusion Intelligent Data Platform manages, optimizes, and integrates data among devices, systems, and applications. Push Technology pioneered and is the sole provider of real-time delta-data streaming™ technology that powers mission-critical business applications worldwide. Leading brands use Push Technology to fuel revenue growth, customer engagement, and business operations. The products, Diffusion® and Diffusion Cloud™, are available on-premise, in-the-cloud, or in a hybrid configuration, to fit the specific business and infrastructure requirements of the applications operating in today’s mobile obsessed, everything connected world. Learn how Push Technology can reduce infrastructure costs, and increase speed, efficiency, and reliability, of your web, mobile, and IoT application.

LEARN MORE: Case Studies and Developer Resources