Category "directed-acyclic-graphs"

How do I run SQL queries on the airflow meta db from inside an airflow DAG?

I'm looking for a way to extract execution_date, start_date, end_date etc. of the last successful run instance of a task in a DAG and then decide to raise an er

Presenting effect modification in causal graphs

I am quite new to causal inference and want to try some methods for treatment effect estimation. For this purpose, I created a the following data generation pro

Color a subset of vertices but not their edges with visIgraph

How can I set the color of a subset of the graph nodes without also coloring their edges using visNetwork::visIgraph? Currently, my function vis_graph_prototypi

Airflow DAGS Orchestration

I have three DAGs (say, DAG1, DAG2 and DAG3). I have a monthly scheduler for DAG1. DAG2 and DAG3 must not be run directly (no scheduler for these) and must be r

How do I create and pass a test conn_id to the S3_hook.S3Hook(conn_id) to debug a code in airflow DAG

I have a deployed DAG in which I'm using check_for_wildcard_key() to check if files for a particular day are present in an s3 location and then decide which bra

Implementing a DAG in python

I am implementing a DAG in python. I am using a dictionary to implement the DAG. Each key represents a node in the graph. And the value associated with a key re

convert cyclic to acyclic graph

I want to convert a cyclic graph into an acyclic graph. Is there an pseudocode that can do this? I did try to search but most of them returned where mathematica