Financial Data Analysis – Kafka, Storm and Spark Streaming

In my earlier posts, we looked at how Spark Streaming can be used to process the streaming loan data and compute the aggregations using Spark SQL. We also looked at how the data can be stored in file system for future batch analysis. We discussed how Spark can be integrated with Kafka to ingest the … Continue reading Financial Data Analysis – Kafka, Storm and Spark Streaming

Application Log Analysis and Data Visualization

Application log data is a useful source of information that provides an insight on how the customer interacts with the product. It also helps in troubleshooting the issues with the application and getting to the root cause of the problem. Most enterprises rely on APM (Application Performance Management) tools to monitor the system health ensuring application availability and performance levels … Continue reading Application Log Analysis and Data Visualization