Skip to content

Latest commit

 

History

13 Commits

Folders and files

NameName
Last commit message
Last commit date
 
 
 
 
 
 
 
 

Repository files navigation

It's a project named "DataCleaner" which is responsible for the device message tackling. It's using SparkStreaming&KAKFA to tackle the stream data of devies. To simplify the coding process, Scala which supports functional programming is used as the main programing language. This layer tackle the device message from "DeviceGate" layer according to the configuration which can be configure dynamically. For now, only simple configurations, for example value transformation, average value calculation, are supported, and more abundant features are under development. After tackling, tackled messages will be stored into mongodb or hdfs and some information will be pushed to "APIBackend" layer through KAFKA for further use.

About

DataClean layer

Resources

Stars

0 stars

Watchers

1 watching

Forks

Releases

Packages

Contributors

Languages