I have 2 tables where 2nd is dependent on 1st. Whenever new records are added in 1st, I want to run a dagster job. I came across sensors but I am not sure if my requirement can be fulfilled using the functionality they provide. Any ideas?

1 Answer

Asset sensors definitely apply here. If you model your tables as assets, then when the first table is materialized the asset sensor will trigger, which can yield a RunRequest to trigger the Dagster job you want to run.

If you don't have control over the code that defines the table, you could also use a normal sensor, and just have it query your table for new records to determine whether to run your Dagster job.

1

Your Answer

Sign up or log in

Sign up using Google Sign up using Facebook Sign up using Email and Password

Post as a guest

By clicking “Post Your Answer”, you agree to our terms of service and acknowledge that you have read and understand our privacy policy and code of conduct.