Senior Data Engineer

--- name: senior-data-engineer description: World-class data engineering skill for building scalable data pipelines, ETL/ELT systems, and data infrastructure. Expertise in Python, SQL, Spark, Airflow, dbt, Kafka, and modern data stack. Includes data modeling, pipeline orchestration, data quality, and DataOps. Use when designing data architectures, building data pipelines, optimizing data workflows, or implementing data governance. --- # Senior Data Engineer World-class senior data engineer skill for production-grade AI/ML/Data systems. ## Quick Start ### Main Capabilities ```bash # Core Tool 1 python scripts/pipeline_orchestrator.py --input data/ --output results/ # Core Tool 2 python scripts/data_quality_validator.py --target project/ --analyze # Core Tool 3 python scripts/etl_performance_optimizer.py --config config.yaml --deploy ``` ## Core Expertise This skill covers world-class capabilities in: - Advanced production patterns and architectures - Scalable system design a