AI Data Engineer | PySpark · Databricks · AWS · Airflow | MSc ML & AI
-
Updated
Jun 8, 2026
AI Data Engineer | PySpark · Databricks · AWS · Airflow | MSc ML & AI
面向在职传统数据工程师的 Data + AI 职业转型项目:基于 DeepSeek smallpond、3FS 与论文的可复现实战
Earnings call RAG pipeline: Hugging Face → chunk → pgvector + Chroma → FastAPI Q&A → 92% retrieval hit rate
Production-grade RAG data platform: lakehouse-backed chunks (Delta/Iceberg) + multi-backend vector stores (pgvector/Qdrant/LanceDB) + hybrid retrieval (BM25 + vector + RRF + reranker) + RAGAS eval. 72 hermetic tests, zero-cost CI.
To associate your repository with the ai-data-engineering topic, visit your repo's landing page and select "manage topics."