Skip to content
View ESousa97's full-sized avatar
🖥️
Coding
🖥️
Coding

Highlights

  • Pro

Block or report ESousa97

Block user

Prevent this user from interacting with your repositories and sending you notifications. Learn more about blocking users.

You must be logged in to block users.

Maximum 250 characters. Please don’t include any personal information such as legal names or email addresses. Markdown is supported. This note will only be visible to you.
Report abuse

Contact GitHub support about this user’s behavior. Learn more about reporting abuse.

Report abuse
ESousa97/README.md

Enoque Sousa — Data Engineer

Building reliable data systems that turn operational complexity into measurable decisions.

LinkedIn Email Portfolio — enoquesousa.com

ABOUT   ·   FOCUS   ·   SELECTED WORK   ·   OPEN SOURCE   ·   TOOLKIT   ·   ACTIVITY

21K+ support tickets analyzed 132 RAG tests in CI 26 years of time-series data Multi-site infrastructure observability

01 · About

BACKGROUND  ·  FOCUS  ·  HOW I WORK

I design and operate reliable data systems that transform operational data into measurable business decisions.

My background is rooted in mission-critical infrastructure and 24/7 enterprise operations, where reliability, observability, security, and incident response are part of the system — not afterthoughts. That operational foundation shapes how I design pipelines, APIs, automation, analytical products, and production services.

My core focus is Data Engineering: ETL and ELT pipelines, event-driven ingestion, data modeling, operational analytics, APIs, data quality, and observability. I also build RAG, semantic retrieval, forecasting, and local-LLM capabilities when they provide clear operational value.

AI augments how I explore, implement, test, document, and improve systems. Architecture, validation, security, and technical decisions remain grounded in software engineering principles.

Important

Current focus — Operating an enterprise helpdesk analytics platform that processes 21,000+ support tickets, combining scheduled incremental ingestion, business-hours MTTR, configurable SLA normalization, trend analysis, statistical projections, and interactive operational dashboards.


02 · Engineering Focus

FOUR DISCIPLINES  ·  ONE SYSTEM



Data Engineering

Incremental ingestion, ETL/ELT, validation, deduplication, data modeling, analytical storage, scheduling, retries, and audit trails.


Operational Analytics

Data products for tickets, events, logs, SLAs, infrastructure health, incident signals, and business-facing operational indicators.


Applied AI & Retrieval

RAG, hybrid search, semantic retrieval, reranking, local inference, time-series forecasting, evaluation, and grounded generation.


Systems & Reliability

Backend services, Windows tooling, secure automation, real-time agents, observability, CLIs, and performance-oriented software.


03 · Selected Engineering Work

PRIVATE CASE STUDIES  ·  INTENTIONALLY ANONYMIZED


Note

Client names, infrastructure identifiers, operational thresholds, proprietary data, and incident details are omitted from every case study below.


Enterprise Helpdesk Analytics Platform   Production Proprietary

Operational intelligence platform that transforms support-ticket lifecycles into reliable SLA, MTTR, backlog, workload, trend, and projection indicators.

scheduled incremental ingestion idempotent processing business-hours time engine configurable SLA normalization statistical projections data-quality controls interactive dashboards

STACK  Python · FastAPI · DuckDB · Polars · React 19 · TypeScript · TanStack Query


Distributed Fleet Observability & Incident Response   Internal Operational System Proprietary

Multi-site observability platform for distributed Windows infrastructure, combining continuous health probes, remote inventory, event and log ingestion, persisted operational history, and real-time dashboards.

The platform includes low-overhead monitoring agents, transition-based alerts, integrity-verified operational artifacts, and guarded workflows designed around allowlists, dry runs, explicit confirmation, and auditability.

TCP health probes latency and availability history Windows event correlation hardware and software inventory SSE live updates Prometheus metrics evidence integrity safe remote automation

STACK  C# · .NET 8 · Rust · PowerShell · TypeScript · Fastify · React · SQLite · SSE · Prometheus


Time-Series Risk Forecasting & AI Decision Support   Academic Research Private

Forecasting pipeline that combines live public data, 26 years of historical time-series data, weather signals, bidirectional LSTM inference, and multi-model LLM synthesis with local inference.

The system applies schema validation, retry and fallback strategies, atomic caching, dependency injection, cross-model consistency checks, and automated testing to produce traceable technical reports.

historical-data ingestion feature preparation GPU training time-series inference multi-model orchestration structured-output validation comprehensive automated test suite

STACK  Python · PyTorch · BiLSTM · CUDA · Public APIs · Local LLMs · pytest


Enterprise Knowledge & AI Platform   Internal System Proprietary

Internal knowledge platform with structured technical documentation, AI-assisted retrieval, protected authentication flows, role-based access control, audit trails, sensitive-data filtering, and conversational support workflows.

large technical knowledge base full-text and fuzzy search contextual AI assistance streaming RBAC session controls rate limiting security headers audit logging

STACK  Next.js · TypeScript · Fuse.js · OpenAI-compatible APIs · JWT · RBAC


04 · Open Source

PUBLIC REPOSITORIES  ·  ENGINEERING PORTFOLIO


py-rag-engine   Open Source 132 tests

End-to-end RAG engine with PDF and Markdown ingestion, recursive and semantic chunking, PostgreSQL and pgvector persistence, hybrid retrieval, Reciprocal Rank Fusion, Cross-Encoder reranking, grounded generation, and offline quality evaluation.

STACK  Python · FastAPI · PostgreSQL · pgvector · SQLAlchemy · RAGAS · pytest


Beam   Open Source Local-first

Secure local clipboard synchronization between Windows and Android. Supports text and image synchronization, LAN discovery, encrypted sessions, device pairing, screenshots, simulated keyboard input, and automatic reconnection — without a cloud relay.

STACK  C# · .NET · WPF · Kotlin · Jetpack Compose · WebSocket · X25519 · AES-256-GCM


wallet-live   Open Source Full-stack Rust

Transactional investment wallet built entirely in Rust, with exact monetary values, immutable transaction history, market quote synchronization, secure session management, role-based authorization, SSR, observability, and containerized deployment.

STACK  Rust · Axum · PostgreSQL · SQLx · Askama · HTMX · OpenTelemetry


Completed Go engineering labs
Repository Systems concepts
godistributedkv Quorum replication, leader election, gRPC, and write-ahead logging.
goobservabilitystack RED metrics, OpenTelemetry, Prometheus, Jaeger, and Grafana.
gocontainerruntime Linux namespaces, cgroups, chroot, and process isolation.
gowasmrunner Isolated WebAssembly execution with memory and timeout limits.

Completed study and systems-engineering repositories, currently archived.


05 · Engineering Toolkit

DATA  ·  BACKEND  ·  SYSTEMS  ·  OBSERVABILITY


Python PostgreSQL DuckDB FastAPI Rust .NET TypeScript Docker OpenTelemetry

View the complete engineering toolkit
Layer Technologies
Data & Backend Python · PostgreSQL · pgvector · DuckDB · Polars · SQLAlchemy · SQLx · FastAPI · Axum · Fastify · Next.js
AI, Retrieval & Forecasting PyTorch · CUDA · BiLSTM · Cross-Encoder reranking · RAGAS · local LLMs · OpenAI-compatible APIs · Fuse.js
Systems & Applications Rust · C# · .NET 8 · WPF · Kotlin · Jetpack Compose · React 19 · HTMX · Askama · PowerShell
Platform, Automation & Observability Docker · OpenTelemetry · Prometheus · Grafana · Jaeger · gRPC · SSE · WebSocket · SQLite · pytest

06 · Engineering Principles

WHAT I OPTIMIZE FOR  ·  AND WHY


Principle How it appears in my work
Correctness before dashboards Typed schemas, validation, deduplication, deterministic business rules, and explicit data-quality checks.
Reliability by design Idempotency, retries, fallbacks, atomic writes, checkpoints, recovery paths, and failure-aware workflows.
Observable by default Structured logs, metrics, traces, health checks, audit trails, historical state, and actionable alerts.
Security with operational controls Least privilege, encryption, allowlists, dry runs, explicit confirmation, secret isolation, and auditable actions.
AI with measurable value Retrieval and models are evaluated, grounded, constrained, and applied only where they improve an actual workflow.

AI-assisted engineering workflow

AI tools support exploration, implementation, testing, documentation, and review. They operate inside an engineering workflow built around specifications, source control, automated tests, static analysis, security review, and human validation.


Claude Code OpenAI Codex Gemini CLI GitHub Copilot Cursor

07 · GitHub Activity

LIVE METRICS  ·  POWERED BY esousa97.com


GitHub contribution activity graph

GitHub statistics

Most used languages

GitHub contribution streak

Recent GitHub activity

Featured GitHub repositories

GitHub contribution grid animation



Let's build systems that remain useful after the demo.

Data Engineering · Operational Analytics · Applied AI · Reliability

Start a conversation Profile views

Footer

Pinned Loading

  1. py-rag-engine py-rag-engine Public

    A lightweight Python RAG engine for ingesting, retrieving, and generating answers from documents.

    Python 2

  2. godeploy-platform godeploy-platform Public archive

    71 - Minimal Go PaaS: Git webhooks, stack auto-detect, Docker builds, and domain-based reverse proxy.

    Go 2

  3. py-etl-pipeline py-etl-pipeline Public archive

    75 - Python ETL: CSV > PostgreSQL with bulk/upsert loads, retries, and optional scheduling.

    Python 2

  4. wallet-live wallet-live Public

    Rust 1