Files in this item

FilesDescriptionFormat

application/pdf

application/pdf122617.pdf (1MB)
(no description provided)PDF

Description

Title:IoT Traffic Simulation: Data Pipeline
Author(s):Agrawal, Anchal
Contributor(s):Brunner, Robert J.
Subject(s):iot
kafka
spark
hadoop
cassandra
Abstract:This poster discusses the data pipeline for a project involving car and road sensor data, which is processed for creating machine learning models for traffic and weather behavior. The car data includes the coordinates of the car, and the road data includes max/min temperatures, precipitation and humidity. The simulated data is ingested by Kafka and consumed by Spark for stream processing. The data is persisted in Cassandra, a NoSQL datastore. These systems are deployed on NCSA hardware and Microsoft Azure. Each system runs on a cluster of virtual machines. The pipeline is integrated with Python APIs.
Issue Date:2016
Genre:Conference Poster
Type:Text
Language:English
URI:http://hdl.handle.net/2142/89997
Rights Information:Copyright 2016, Agrawal
Date Available in IDEALS:2016-04-21


This item appears in the following Collection(s)

Item Statistics