Explore how Netflix Maestro and Apache Airflow, two powerful workflow orchestration tools, can complement each other. Delve into their features, strengths, and use cases to uncover whether they are companions or competitors.
Explore the essence of pragmatic Data Engineering through a task-solving journey and learn why you should ask WHY?
Discover the basics of using Gemini with Python via VertexAI, creating a Web UI with NiceGUI and using Jinja2 to construct modular prompts
Discover the basics of using Gemini with Python via VertexAI, creating APIs with FastAPI, data validation with Pydantic and the fundamentals of Retrieval-Augmented Generation (RAG)
Practical examples how to use DuckDB as a tool for data wrangling based on Pokémon API data
Practical example on how to create an Airflow DAG to fetch data from the StarCraft II API, utilize DuckDB for processing and Streamlit for visualizing
This article explains the Apache Airflow basics and guides you through the process setting up a local environment as well as writing your first DAG using the TaskFlow API
