Can you give some examples of streaming analytics (such as provided by Spark Streaming, for instance)?

By: Bart Baesens, Seppe vanden Broucke

This QA first appeared in Data Science Briefings, the DataMiningApps newsletter. Also want to submit your question? Just Tweet us @DataMiningApps. Want to remain anonymous? Then send us a direct message and we’ll keep all your details private. Subscribe now for free if you want to be the first to receive our articles and stay up to data on data science news, or follow us @DataMiningApps.


You asked: Can you give some examples of streaming analytics (such as provided by Spark Streaming, for instance)?

Our answer:

Streaming analytics can be useful in a variety of cases. The following overview provides some examples:

  • Twitter is performing real-time analysis to spot rising trends
  • Netflix has a “streaming” version of their recommender system in place, as well as an offline version which is regularly retrained
  • Companies such as Uber are using streaming analytics to get updates on their fleet in real-time
  • Companies working with sensor data also oftentimes retrieve this data in an on-line, streamed manner

Check out “Architecture of Giants” for more insights in the tech stack of big engineering-driving companies and how they’re using stream pipelines such as Spark or Kafka.