0%

Book Description

As the IoT continues to evolve, large vertical capabilities are converging to form an unexpected—and strong—new reference architecture for this emerging network. Machine-to-machine communications, big data, cloud computing, distributed systems, networking, mobile and telco, apps, and smart devices all contribute to IoT capabilities. This O’Reilly report examines the critical role that operational databases play in that convergence.

IoT data management platforms need to handle data in motion (fast data) as well as data at rest (big data). Legacy data systems aren’t designed to manage vast inflows of high-velocity data from multiple devices and sources. But as VoltDB CTO Ryan Betts explains, operational databases have the performance and scalability to combine data from analytics run against collected (big) data with the current state and readings of things (fast).

This report explains how operational databases enable IoT applications to fulfill four data management capabilities:

  • Fast Ingest: In-memory performance and horizontal scalability that provide a single ingestion point for high-velocity data feeds
  • Explore and Analyze: Real-time access to applications and querying engines
  • Act: The ability to trigger events and make decisions based on inbound streams
  • Export: The ability to export accumulated, filtered, enriched, or augmented data to downstream systems

About the author

Ryan Betts, VoltDB CTO, is one of the company’s founding developers. He’s been designing and building distributed systems and high-performance infrastructure software for almost 20 years. Chances are, if you’ve used the Internet, some of your ones and zeros passed through a slice of code he wrote or tested.

Table of Contents

  1. 1. Introduction
    1. What Is the IoT?
    2. Precursors and Leading Indicators
    3. Analytics and Operational Transactions
      1. Streaming Analytics Meet Operational Workflows
      2. Fuzzy Borders, Fog Computing, and the IoT
  2. 2. The Four Activities of Fast Data
    1. Transactions in the IoT
    2. IoT Applications Are More Than Streaming Applications
    3. Functions of a Database in an IoT Infrastructure
      1. Categorizing Data
      2. Categorizing Processing
      3. Combining the Data and Processing Discussions
    4. Ingestion Is More than Kafka
      1. Kafka Use Cases
      2. Beyond Kafka
    5. Real-Time Analytics and Streaming Aggregations
      1. Shortcomings of Streaming Analytics in the IoT
      2. Why Integrate Streaming Analytics and Transactions?
      3. Managing Multiple Streams of High-Velocity Inbound Data
    6. At the End of Every Analytics Rainbow Is a Decision
  3. 3. Writing Real-Time Applications for the IoT
    1. Case Study: Electronics Manufacturing in the Age of the IoT
      1. Fast Data as a Solution
    2. Case Study: Smart Meters
    3. Conclusion
3.133.131.168