Skip to content

Repository files navigation

Data Analytics Projects

Python R Jupyter License Status

A portfolio of end-to-end data analytics and data science projects spanning pandemic epidemiology, real estate economics, global security, sports statistics, and quantitative finance.


πŸ“‘ Table of Contents


About This Repository

This repository contains a curated collection of data analytics and data science projects completed as part of an ongoing portfolio. Each project follows a rigorous workflow: problem formulation β†’ data acquisition β†’ cleaning β†’ exploratory analysis β†’ modeling β†’ interpretation.

The work spans multiple domains and tools, demonstrating proficiency in both Python and R, statistical modeling, machine learning, geospatial analysis, and financial time-series analytics.


Projects Overview

# Project Domain Language Focus
1 🦠 COVID-19 Pandemic Analysis Public Health Python Pandemic visualization & EDA
2 🏠 Cracow Real Estate Pricing Real Estate Python Price prediction with ensemble ML
3 πŸ’£ Global Terrorism Database Security / Policy R Geospatial EDA & trend analysis
4 ⌚ Polar Watch β€” Workout Vitals Sports Analytics Python Statistical modeling of fitness data
5 πŸ“ˆ FX Trading Algorithm Analysis Quantitative Finance Python Algorithm performance & risk metrics

Results Snapshot

Project Key Result
COVID-19 ~35M cases analyzed; rural pop vs. cases correlation: -0.46
Cracow Real Estate VotingRegressor ensemble outperformed MLP, GBR, and baseline
Global Terrorism 11-year EDA; ISIL, Taliban, Al-Qaida among deadliest groups
Polar Watch Mixed model RMSE 61 vs. 79 (OLS); 283 workouts analyzed
FX Trading 92 trades; 40% win rate; Monte Carlo: 100K simulations

1. COVID-19 Pandemic Analysis

Python Status Matplotlib

A multi-notebook end-to-end exploratory data analysis of the COVID-19 pandemic. Combines JHU CSSE case time series with World Bank socioeconomic indicators to uncover trends across time, geography, and population health metrics.

Key Highlights

  • Global scale: ~35M confirmed cases analyzed as of October 2020
  • Multi-level analysis: World, continent, and country-level breakdowns
  • Socioeconomic integration: Correlates pandemic metrics with GDP, life expectancy, rural population, and healthcare expenditure
  • Reusable architecture: Custom CovidDataViz class for reproducible plotting

πŸ“‚ View Project


2. Flats in Cracow

Python Status Scikit-learn

A complete data science workflow for predicting residential flat sale prices in Cracow, Poland β€” from web-scraped listing data through cleaning, exploratory analysis, feature engineering, and ensemble regression modeling.

Key Highlights

  • Ensemble modeling: VotingRegressor combining MLP and Gradient Boosting
  • Rich feature engineering: 8+ derived features including log-transforms and ratio features
  • Comprehensive preprocessing: KNN imputation, one-hot encoding, min-max scaling
  • Interpretability: District-level price analysis reveals central vs. outlying area premiums

πŸ“‚ View Project


3. Global Terrorism Database

R Status Tidyverse

An exploratory data analysis and geospatial visualization of the Global Terrorism Database (GTD), covering 2007–2017. Examines attack patterns, casualty distributions, weapon and target types, and the most active terrorist organizations.

Key Highlights

  • 11-year window: 2007–2017, filtered to confirmed terrorist incidents
  • Geospatial mapping: Annotation-style maps of group activity
  • Multidimensional analysis: Time, geography, attack type, weapon, target, and perpetrator
  • Rich visualizations: Faceted time series, correlation matrices, tile plots, stacked area charts

πŸ“‚ View Project


4. Polar Watch β€” Workout Vitals

Python Status Statsmodels

A statistical analysis of workout data exported from a Polar watch. Heart-rate distributions, caloric expenditure, session duration, and sport-type differences are examined, with a focus on comparing strength training against cardiovascular activity.

Key Highlights

  • 283 workouts analyzed over ~1 year
  • Statistical rigor: OLS regression, linear mixed models, VIF, Goldfeld-Quandt, Shapiro-Wilk, Q-Q plots
  • Activity comparison: Strength vs. cardio heart-rate profiles
  • Caloric modeling: RMSE 79 (OLS) β†’ 61 (mixed model), RΒ² up to 0.98 by sport

πŸ“‚ View Project


5. Trading Results Analysis

Python Status Finance

Walk-forward performance analysis of an algorithmic trading system. Examines 92 trades across multiple instruments to evaluate profitability, risk characteristics, trade duration distributions, and statistical properties of returns.

Key Highlights

  • 92 trades analyzed across multiple FX instruments
  • Monte Carlo simulation: 100,000 samples to estimate forward performance
  • Distribution analysis: Profit-per-lot characterized by skew, kurtosis, and fitted distributions
  • Timing edge: Identified profitable intraday patterns (2pm, 4pm)

πŸ“‚ View Project


Technology Stack

Languages & Core Tools

Tool Purpose
Python 3.8+ Primary language for 4 of 5 projects
R 4.0+ Global Terrorism analysis
Jupyter Notebooks All analysis and modeling
Git Version control

Python Libraries

Library Domain Projects
Pandas Data manipulation All Python projects
NumPy Numerical computing All Python projects
Matplotlib Visualization All projects
Scikit-learn ML preprocessing & modeling Flats in Cracow
Statsmodels Statistical modeling Polar
Scipy Statistics & distributions Polar, Trading
wbdata World Bank API access COVID-19
tabulate Table formatting Polar

R Libraries

Library Purpose
tidyverse (dplyr, ggplot2, tidyr) Data manipulation & viz
GGally Matrix & pair plots
rworldmap / mapproj Geospatial visualization
ggrepel Non-overlapping text labels
lubridate Date handling
scales Axis formatting

Requirements by Project

Each project includes a requirements.txt (or requirements.R equivalent) for reproducible setup:

Project Install Command
COVID-19 pip install -r covid19-pandemic-analysis/requirements.txt
Cracow Real Estate pip install -r cracow-real-estate-pricing/requirements.txt
Global Terrorism (R) See global-terrorism-eda/requirements.txt
Polar Watch pip install -r polar-watch-fitness-analysis/requirements.txt
FX Trading pip install -r fx-trading-analysis/requirements.txt

Getting Started

Prerequisites

  • Python 3.8+
  • R 4.0+ (for Global Terrorism project only)
  • Jupyter Notebook or JupyterLab

Installation

# Clone the repository
git clone https://github.com/shsarv/Data-Analytics-Projects-in-python.git
cd Data-Analytics-Projects-in-python

# Install Python dependencies (example for Flats in Cracow)
pip install pandas numpy matplotlib scikit-learn joblib

# Install R dependencies (for Global Terrorism)
install.packages(c("tidyverse", "GGally", "rworldmap", "ggrepel", "mapproj", "lubridate", "scales"))

Each project folder contains a dedicated README.md with specific setup instructions.


Repository Structure

Data-Analytics-Projects-in-python/
β”œβ”€β”€ README.md                           # This file
β”œβ”€β”€ LICENSE
β”œβ”€β”€ covid19-pandemic-analysis/         # 🦠 Pandemic visualization
β”‚   β”œβ”€β”€ data/
β”‚   β”‚   └── download_data.py
β”‚   β”œβ”€β”€ features/
β”‚   β”‚   β”œβ”€β”€ make_all.py
β”‚   β”‚   β”œβ”€β”€ make_cases.py
β”‚   β”‚   β”œβ”€β”€ make_cases_daily_change.py
β”‚   β”‚   β”œβ”€β”€ make_cases_since_t0.py
β”‚   β”‚   β”œβ”€β”€ make_continents.py
β”‚   β”‚   β”œβ”€β”€ make_coordinates.py
β”‚   β”‚   β”œβ”€β”€ make_country_stats.py
β”‚   β”‚   β”œβ”€β”€ make_country_to_continent.py
β”‚   β”‚   β”œβ”€β”€ make_mortality.py
β”‚   β”‚   β”œβ”€β”€ make_world_bank.py
β”‚   β”‚   └── utils.py
β”‚   β”œβ”€β”€ visualizations/
β”‚   β”‚   └── covid_data_viz.py
β”‚   β”œβ”€β”€ notebooks/
β”‚   β”‚   β”œβ”€β”€ Data-wrangling.ipynb
β”‚   β”‚   β”œβ”€β”€ Exploratory-analysis-globally.ipynb
β”‚   β”‚   β”œβ”€β”€ Exploratory_analysis_fancy_plot.ipynb
β”‚   β”‚   β”œβ”€β”€ Exploratory-analysis-mortality.ipynb
β”‚   β”‚   └── Exploratory_analysis_socioeconomic.ipynb
β”‚   └── tests/
β”œβ”€β”€ cracow-real-estate-pricing/        # 🏠 Real estate ML
β”‚   β”œβ”€β”€ 00_Data_Wrangling.ipynb
β”‚   β”œβ”€β”€ 00_Data_Wrangling.pdf
β”‚   β”œβ”€β”€ 01_Exploratory_Analysis.ipynb
β”‚   β”œβ”€β”€ 01_Exploratory_Analysis.pdf
β”‚   β”œβ”€β”€ 02_Model.ipynb
β”‚   β”œβ”€β”€ 02_Model.pdf
β”‚   └── img/
β”œβ”€β”€ global-terrorism-eda/              # πŸ’£ Terrorism EDA
β”‚   β”œβ”€β”€ Global Terrorism.ipynb
β”‚   └── img/
β”œβ”€β”€ polar-watch-fitness-analysis/      # ⌚ Sports statistics
β”‚   β”œβ”€β”€ Polar.ipynb
β”‚   β”œβ”€β”€ Polar.pdf
β”‚   β”œβ”€β”€ mdl_results.txt
β”‚   └── img/
└── fx-trading-analysis/               # πŸ“ˆ Algorithmic trading
    β”œβ”€β”€ Trading Results Analysis.ipynb
    β”œβ”€β”€ Trading Results Analysis.pdf
    └── img/

Contributing

Contributions, issues, and feature requests are welcome. Please feel free to open an issue or submit a pull request.

  1. Fork the project
  2. Create your feature branch (git checkout -b feature/AmazingFeature)
  3. Commit your changes (git commit -m 'Add some AmazingFeature')
  4. Push to the branch (git push origin feature/AmazingFeature)
  5. Open a Pull Request

License

Distributed under the MIT License. See LICENSE for more information.


Author

Sarvesh Kumar Sharma


Built with ❀️ and a lot of β˜•

About

A collection of data analysis and visualization projects designed to uncover insights from diverse datasets. These projects include analyses on COVID-19 trends, stock trading patterns, housing market prices, IoT data, and more, showcasing the power of data-driven storytelling.

Topics

Resources

Stars

242 stars

Watchers

6 watching

Forks

Releases

Packages

Contributors

Languages