I have restricted access to the tables in the data catalog in Databricks by selecting the schema and revoking or assigning permissions on the schema by user. This works correctly when I use SQL Warehouses. However, I have a problem: when a user interacts with a schema from a notebook, the policies I defined for the schema in the catalog only apply to SQL Warehouses, but they do not apply to All-Purpose Compute clusters.

How can I ensure that these policies also apply to All-Purpose Compute clusters for data consumption in the schema from a group in Databricks?

I want to prevent users from creating tables in the schemas or overwriting existing tables when using All-Purpose Compute clusters.

Note: We do not have the data catalog enabled.

Thank you so much !!

I attempted to assign permissions to each schema and table as an administrator through Identity and Access -> Management and Permissions. I created a group, added users to that group, and then went to each schema in the data catalog to assign permissions for that group on the respective schema. However, this setup only works for SQL Warehouses and not for All-Purpose Compute clusters. I have not found clear documentation on how to apply group permissions for access to tables when using All-Purpose Compute clusters.