Is there a Databricks SQL equivalent to "Create Trigger" logic? Basically every time table X gets new data, a few merge statements need to run on another table.

Alternatively, can a notebook be triggered whenever table X updates?

Even more alternatively, what about monitoring table X with some other Azure service/ADF and triggering required SQL statements?

Desired result is to be able to update a table Y upon updates in table X without this blocking some other activity, so if the solution is code based, it should not block the execution of the rest of the code in a notebook, for example.

CodePudding user response：

If you store your data in Delta Format, you have access to a Change Data Feed.

If the data changes are new files appearing in your data lake, you can also use Autoloader to create a Streaming job that is triggered for each new file.