Moreover, Databricks Assistant can ease related tasks such as optimizing an existing Python script a company’s data scientists use for analytics projects.

Immuta said that the updates to the Databricks platform aim to unlock data value and maintain robust data security.

Inference stage: ADF invokes Databricks notebooks through the REST API, passing parameters like script paths and data locations. Databricks auto-scaling clusters optimize performance for large jobs.

Data and AI company Databricks is acquiring data security startup Okera. Recently, customers have increasingly asked about data security when creating custom AI models.