http://jvega.xyz/tags/python/Recent content in Python on Jorge VegaHugoenFri, 10 Jul 2026 14:31:34 +0200http://jvega.xyz/posts/tradingpipelines/Thu, 09 Jul 2026 20:00:00 +0200http://jvega.xyz/posts/tradingpipelines/<p>A proof-of-concept project that proposes an end-to-end architecture for a financial machine learning framework. It covers the full lifecycle — from raw market data ingestion and feature engineering to model training, hyperparameter optimization, model serving, and interactive visualization — all orchestrated as reproducible pipelines.</p> <h2 id="architecture">Architecture</h2> <p>The system is composed of five main layers:</p> <h3 id="data-ingestion">Data Ingestion</h3> <p>Raw financial data is loaded into a local <strong>DuckDB</strong> database using <strong>dlt</strong> incremental pipelines, orchestrated by <strong>Apache Airflow</strong>:</p>