A

Apache Spark

A Project based around a simulated music streaming app (Spotify for example) generating live user events, to practice handling real time streaming of large amounts of data.

The SalesStream dashboards is an application for monitoring and analyzing revenue data in real time. By leveraging the power of Apache Spark and Apache Kafka, this system ensures that financial data is processed efficiently and in a timely manner, providing companies with up-to-date insights into their revenue streams.

POC - Apache Spark

This project aims to predict the outcome of future presidential elections using artificial intelligence predictions.

Notebooks for Pandas, Spark and Python experiments.

Implementation of Geo-Temporally Weighted Regression (GTWR) using Apache Spark, Spark ML and Apache Sedona.

Implementation of Geographically Weighted Regression (GWR) using Apache Spark, Spark ML and Apache Sedona.

The "Stage Metrics" plugin for Apache Spark to creating metrics by stage status

sentiment analysis using spark ml library. implemented classic ml models: SVM, Logistic Regression, Naive Bayes and Random Forest. implemented embedding: Word2Vec and TF-IDF. also ensemble and hybrid (ml and lexicon based) methods were implemented

Mirror of https://github.com/zero323/pyspark-asyncactions

Execute Hadoop and Spark applications on the BigData@Polito cluster with a single command

Stack Exchange releases "data dumps" of all its publicly available content roughly every three months via archive.org.

This project is an example and a framework for building ETL for this data with Apache Spark and Java.