Skip to main content

Privacera Documentation

Databricks Spark plugin

Spark plugin

  1. Create privacera_spark_custom.properties file.

    vi ~/privacera/privacera-manager/config/custom-properties/privacera_spark_custom.properties
  2. Add the following properties as per your preferences.

    Property

    Description

    Example

    privacera.jwt.dbx.login.user.fallback.enable

    Set this property to fallback to the logged-in user when JWT is enabled.

    privacera.jwt.dbx.login.user.fallback.enable=true

    privacera.dbx.system.mounts

    Set this property to pass comma-separated system mount points for Databricks which you want to ignore in the OLAC cluster.

    privacera.dbx.system.mounts=/,/databricks-results,/databricks/mlflow-tracking,/databricks-datasets,/databricks/mlflow-registry

  3. Run the following command.

    cd ~/privacera/privacera-manager/ ./privacera-manager.sh update
    

Access private DNS from Databricks cluster

Create another DNS entry and map it to the private DNS, so that you can access the secondary DNS directly from Databricks. Follow below steps and then upload the modified init script back to DBFS.

OLAC Cluster

  1. Edit ranger_enable_scala.sh file.

    vi ranger_enable_scala.sh
  2. Add the following property.

    export DS_HOST=<alias_host

FGAC Cluster

  1. Edit ranger_enable.sh file.

    vi ranger_enable.sh
  2. Add the following properties.

    export BASE_RANGER_URL=https://<alias_host>:6182
    export BASE_SOLR_URL=https://<alias_host>:6084