Apache Nifi

Live Contract Trading Data Harvesting

The goal of this project was to build an ETL system collecting and computing data about trades and trading positions for various cryptocurrencies . The data about trades and trading positions were integrated on-the-fly from multiple trading platforms via REST APIs and web socket.

Sentiment Data Harvesting

The goal of this project was to build an ETL system collecting, normalizing, and aggregating data about popularity index (search volume) of various keywords from Google Trends. The system had two subsystems one for pulling historical data in bulk, the other for current data.