Search
1 post tagged

dynamic-task-mapping

Stop Creating Multiple Airflow DAGs for Reloads and Parallel Processing
22 min read

Stop Creating Multiple Airflow DAGs for Reloads and Parallel Processing

Modern Airflow and Dynamic Task Mapping to Transform Messy DAG Collections into Clean Solutions

Volker Janz's Picture
Volker Janz in data-engineering airflow python dynamic-task-mapping taskflow-api

Latest Posts

From Scrolls to Similarity Search - Building a Movie Recommender with DuckDB VSS
17 min read

From Scrolls to Similarity Search - Building a Movie Recommender with DuckDB VSS

Volker Janz's Picture
Volker Janz
Stop Creating Multiple Airflow DAGs for Reloads and Parallel Processing
22 min read

Stop Creating Multiple Airflow DAGs for Reloads and Parallel Processing

Volker Janz's Picture
Volker Janz

Explore Tags

ai ai-platforms airflow big-data big-query bigquery cloud data-engineering duckdb dynamic-task-mapping fastapi flink gcp gemini hackathon hugging-face java jekyll kiss life llm lora machine-learning meastro mental-health motivation netflix nicegui nlp orchestration peft python rag recommendation-system s3 similarity-search small-data sql streamlit taskflow-api tech vertex-ai workflow