IoT Traffic Simulation: Data Pipeline

Agrawal, Anchal

Permalink

https://hdl.handle.net/2142/89997 Copy

Description

Title

IoT Traffic Simulation: Data Pipeline

Author(s)

Agrawal, Anchal

Contributor(s)

Brunner, Robert J.

Issue Date

2016

Keyword(s)

• iot
• kafka
• spark
• hadoop
• cassandra

Date of Ingest

2016-04-21T21:42:59Z

Abstract

This poster discusses the data pipeline for a project involving car and road sensor data, which is processed for creating machine learning models for traffic and weather behavior. The car data includes the coordinates of the car, and the road data includes max/min temperatures, precipitation and humidity. The simulated data is ingested by Kafka and consumed by Spark for stream processing. The data is persisted in Cassandra, a NoSQL datastore. These systems are deployed on NCSA hardware and Microsoft Azure. Each system runs on a cluster of virtual machines. The pipeline is integrated with Python APIs.

Type of Resource

text

Genre of Resource

Conference Poster

Language

en

Permalink

http://hdl.handle.net/2142/89997

Copyright and License Information

Copyright 2016, Agrawal

Owning Collections