- Welcome to Privacera
- Introduction to Privacera
- Privacera Platform installation
- Plan for Privacera Platform
- Privacera Platform overview
- Privacera Platform installation overview
- Privacera Platform deployment size
- Privacera Platform installation prerequisites
- Choose a cloud provider
- Select a deployment type
- Configure proxy for Privacera Platform
- Prerequisites for installing Privacera Platform on Kubernetes
- Default Privacera Platform port numbers
- Required environment variables for installing Privacera Platform
- Privacera Platform system requirements for Azure
- Prerequisites for installing Privacera Manager on AWS
- Privacera Platform system requirements for Docker in GCP
- Privacera Platform system requirements for Docker in AWS
- Privacera Platform system requirements for Docker in Azure
- Privacera Platform system requirements for Google Cloud Platform (GCP)
- System requirements for Privacera Manager Host in GKE
- System requirements for Privacera Manager Host in EKS
- System requirements for Privacera Manager Host in AKS
- Install Privacera Platform
- Download the Privacera Platform installation packages
- Privacera Manager overview
- Install Privacera Manager on Privacera Platform
- Install Privacera Platform using an air-gapped install
- Upgrade Privacera Manager
- Troubleshoot Privacera Platform installation
- Validate Privacera Platform installation
- Common errors and warnings in Privacera Platform YAML config files
- Ansible Kubernetes Module does not load on Privacera Platform
- Unable to view Audit Fluentd audits on Privacera Platform
- Unable to view Audit Server audits on Privacera Platform
- No space for Docker images on Privacera Platform
- Unable to see metrics on Grafana dashboard
- Increase storage for Privacera PolicySync on Kubernetes
- Permission denied errors in PM Docker installation
- Non-portal users can access restricted Privacera Platform resources
- Storage issue in Privacera Platform UserSync and PolicySync
- Privacera Manager not responding
- Unable to Connect to Docker
- Privacera Manager unable to connect to Kubernetes Cluster
- Unable to initialize the Discovery Kubernetes pod
- Unable to upgrade from 4.x to 5.x or 6.x due to Zookeeper snapshot issue
- 6.5 Platform Installation fails with invalid apiVersion
- Database lockup in Docker
- Remove the WhiteLabel Error Page on Privacera Platform
- Unable to start the Privacera Platform portal service
- Connect portal users to Privacera Platform
- Connect Privacera Platform portal users from LDAP
- Set up portal SSO for Privacera Platform with OneLogin using SAML
- Set up portal SSO for Privacea Platform with Okta using SAML
- Set up portal SSO for Privacera Platform with Okta using OAuth
- Set up portal SSO for Privacera Platform with AAD using SAML
- Set up portal SSO for Privacera Platform with PingFederate
- Generate an Okta Identity Provider metadata file and URL
- Connect applications to Privacera Platform for Access Management
- Connect applications to Privacera Platform using the Data Access Server
- Data Access Server overview
- Integrate AWS with Privacera Platform using the Data Access Server
- Integrate GCS and GCP with Privacera Platform using the Data Access Server
- Integrate ADLS with Privacera Platform using the Data Access Server
- Access Kinesis with the Data Access Server on Privacera Platform
- Access Firehose with Data Access Server on Privacera Platform
- Use DynamoDB with Data Access Server on Privacera Platform
- Connect MinIO to Privacera Platform using the Data Access Server
- Use Athena with Data Access Server on Privacera Platform
- Custom Data Access Server properties
- Connect applications to Privacera Platform using the Privacera Plugin
- Overview of Privacera plugins for Databricks
- Connect AWS EMR with Native Apache Ranger to Privacera Platform
- Configure Databricks Spark Fine-Grained Access Control Plugin [FGAC] [Python, SQL]
- Configure Databricks Spark Object-level Access Control Plugin
- Connect Dremio to Privacera Platform via plugin
- Connect Amazon EKS to Privacera Platform using Privacera plugin
- Configure EMR with Privacera Platform
- EMR user guide for Privacera Platform
- Connect GCP Dataproc to Privacera Platform using Privacera plugin
- Connect Kafka datasource via plugin to Privacera Platform
- Connect PrestoSQL standalone to Privacera Platform using Privacera plugin
- Connect Spark standalone to Privacera Platform using the Privacera plugin
- Privacera Spark plugin versus Open-source Spark plugin
- Connect Starburst Enterprise to Privacera Platform via plugin
- Connect Starburst Trino Open Source to Privacera Platform via Plug-In
- Connect Trino Open Source to Privacera Platform via plugin
- Connect applications to Privacera Platform using the Data Access Server
- Configure AuditServer on Privacera Platform
- Configure Solr destination on Privacera Platform
- Enable Solr authentication on Privacera Platform
- Solr properties on Privacera Platform
- Configure Kafka destination on Privacera Platform
- Enable Pkafka for real-time audits in Discovery on Privacera Platform
- AuditServer properties on Privacera Platform
- Configure Fluentd audit logging on Privacera Platform
- Configure High Availability for Privacera Platform
- Configure Privacera Platform system security
- Privacera Platform system security
- Configure SSL for Privacera Platform
- Enable CA-signed certificates on Privacera Platform
- Enable self-signed certificates on Privacera Platform
- Upload custom SSL certificates on Privacera Platform
- Custom Crypto properties on Privacera Platform
- Enable password encryption for Privacera Platform services
- Authenticate Privacera Platform services using JSON Web Tokens
- Configure JSON Web Tokens for Databricks
- Configure JSON Web Tokens for EMR FGAC Spark
- Custom configurations for Privacera Platform
- Privacera Platform system configuration
- Add custom properties using Privacera Manager on Privacera Platform
- Privacera Platform system properties files overview
- Add domain names for Privacera service URLs on Privacera Platform
- Configure Azure PostgreSQL on Privacera Platform
- Spark Standalone properties on Privacera Platform
- AWS Data Access Server properties on Privacera Platform
- Add custom Spark configuration for Databricks on Privacera Platform
- Configure proxy for Privacera Platform
- Configure Azure MySQL on Privacera Platform
- System-level settings for Zookeeper on Privacera Platform
- Configure service name for Databricks Spark plugin on Privacera Platform
- Migrate Privacera Manager from one instance to another
- Restrict access in Kubernetes on Privacera Platform
- System-level settings for Grafana on Privacera Platform
- System-level settings for Ranger KMS on Privacera Platform
- Generate verbose logs on Privacera Platform
- System-level settings for Spark on Privacera Platform
- System-level settings for Azure ADLS on Privacera Platform
- Override Databricks region URL mapping for Privacera Platform on AWS
- Configure Privacera Platform system properties
- EMR custom properties
- Configure AWS Aurora DB (PostgreSQL/MySQL) on Privacera Platform
- Merge Kubernetes configuration files
- Scala Plugin properties on Privacera Platform
- System-level settings for Trino Open Source on Privacera Platform
- System-level settings for Kafka on Privacera Platform
- System-level settings for Graphite on Privacera Platform
- System-level settings for Spark plugin on Privacera Platform
- Create CloudFormation stack
- Configure pod topology for Kubernetes on Privacera Platform
- Configure proxy for Kubernetes on Privacera Platform
- Externalize access to Privacera Platform services with NGINX Ingress
- Custom Privacera Platform portal properties
- Add Data Subject Rights
- Enable or disable the Data Sets menu
- Kubernetes RBAC
- Spark FGAC properties
- Audit Fluentd properties on Privacera Platform
- Switch from Kinesis to Kafka for Privacera Discovery queuing on AWS with Privacera Platform
- Privacera Platform on AWS overview
- Privacera Platform Portal overview
- AWS Identity and Access Management (IAM) on Privacera Platform
- Set up AWS S3 MinIO on Privacera Platform
- Integrate Privacera services in separate VPC
- Install Docker and Docker compose (AWS-Linux-RHEL) on Privacera Platform
- Configure EFS for Kubernetes on AWS for Privacera Platform
- Multiple AWS accounts support in DataServer
- Multiple AWS S3 IAM role support in Data Access Server
- Enable AWS CLI on Privacera Platform
- Configure S3 for real-time scanning on Privacera Platform
- Multiple AWS account support in Dataserver using Databricks on Privacera Platform
- Enable AWS CLI
- AWS S3 Commands - Ranger Permission Mapping
- Plan for Privacera Platform
- PrivaceraCloud setup
- PrivaceraCloud data access methods
- Create PrivaceraCloud account
- Log in to PrivaceraCloud with or without SSO
- Connect applications to PrivaceraCloud
- Connect applications to PrivaceraCloud with the setup wizard
- Connect Azure Data Lake Storage Gen 2 (ADLS) to PrivaceraCloud
- Connect Amazon Textract to PrivaceraCloud
- Connect Athena to PrivaceraCloud
- Connect AWS Lake Formation on PrivaceraCloud
- Get started with AWS Lake Formation
- Create IAM Role for AWS Lake Formation connector
- Connect AWS Lake Formation application on PrivaceraCloud
- Create AWS Lake Formation connectors for multiple AWS regions
- Configuring audit logs for the AWS Lake Formation on PrivaceraCloud
- How to validate a AWS Lake Formation connector
- AWS Lake Formation FAQs for Pull mode
- AWS Lake Formation FAQs for Push mode
- Azure Data Factory Integration with Privacera Enabled Databricks Cluster
- Connect Google BigQuery to PrivaceraCloud
- Connect Cassandra to PrivaceraCloud for Discovery
- Connect Databricks to PrivaceraCloud
- Connect Databricks SQL to PrivaceraCloud
- Connect Databricks to PrivaceraCloud
- Configure Databricks SQL PolicySync on PrivaceraCloud
- Databricks SQL fields on PrivaceraCloud
- Databricks SQL Masking Functions
- Connect Databricks SQL to Hive policy repository on PrivaceraCloud
- Enable Privacera Encryption services in Databricks SQL on PrivaceraCloud
- Example: Create basic policies for table access
- Connect Dataproc to PrivaceraCloud
- Connect Dremio to PrivaceraCloud
- Connect DynamoDB to PrivaceraCloud
- Connect Elastic MapReduce from Amazon application to PrivaceraCloud
- Connect EMR application
- EMR Spark access control types
- PrivaceraCloud configuration
- AWS IAM roles using CloudFormation setup
- Create a security configuration
- Create EMR cluster
- Kerberos required for EMR FGAC or OLAC
- Create EMR cluster using CloudFormation setup (Recommended)
- Create EMR cluster using CloudFormation EMR templates
- EMR template: Spark_OLAC, Hive, Trino (for EMR versions 6.4.0 and above)
- EMR Template for Multiple Master Node: Spark_OLAC, Hive, Trino (for EMR version 6.4.0 and above)
- EMR template: Spark_OLAC, Hive, PrestoSQL (for EMR versions 6.x to 6.3.1)
- EMR template: Spark_FGAC, Hive, Trino (for EMR versions 6.4.0 and above)
- EMR Template for Multiple Master Node: Spark_FGAC, Hive, Trino (for EMR version 6.4.0 and above)
- EMR template: Spark_FGAC, Hive, PrestoSQL (for EMR versions 6.x to 6.3.1)
- Create EMR cluster using CloudFormation AWS CLI
- Create CloudFormation stack
- Create EMR cluster using CloudFormation EMR templates
- Manually create EMR cluster using AWS EMR console
- EMR Native Ranger Integration with PrivaceraCloud
- Connect EMRFS S3 to PrivaceraCloud
- Connect Files to PrivaceraCloud
- Connect Google Cloud Storage to PrivaceraCloud
- Connect Glue to PrivaceraCloud
- Connect Kinesis to PrivaceraCloud
- Connect Lambda to PrivaceraCloud
- Connect MS SQL to PrivaceraCloud
- Connect MySQL to PrivaceraCloud for Discovery
- Connect Open Source Apache Spark to PrivaceraCloud
- Connect Oracle to PrivaceraCloud for Discovery
- Connect PostgreSQL to PrivaceraCloud
- Connect Power BI to PrivaceraCloud
- Connect Presto to PrivaceraCloud
- Connect Redshift to PrivaceraCloud
- Redshift Spectrum PrivaceraCloud overview
- Connect Snowflake to PrivaceraCloud
- Starburst Enterprise with PrivaceraCloud
- Connect Starbrust Trino to PrivaceraCloud
- Connect Starburst Enterprise Presto to PrivaceraCloud
- Connect Synapse to PrivaceraCloud
- Connect S3 to PrivaceraCloud
- Connect Trino to PrivaceraCloud
- Connect Vertica to PrivaceraCloud
- Starburst Trino and Trino SQL command permissions
- Starburst Trino and Trino SQL command permissions - Iceberg connector
- Manage applications on PrivaceraCloud
- Connect users to PrivaceraCloud
- Data sources on PrivaceraCloud
- PrivaceraCloud custom configurations
- Access AWS S3 buckets from multiple AWS accounts on PrivaceraCloud
- Configure multiple JWTs for EMR
- Access cross-account SQS queue for PostgreSQL audits on PrivaceraCloud
- AWS Access with IAM role on PrivaceraCloud
- Databricks cluster deployment matrix with Privacera plugin
- Whitelist py4j security manager via S3 or DBFS
- General functions in PrivaceraCloud settings
- Cross account IAM role for Databricks
- Operational status of PrivaceraCloud and RSS feed
- How to get support
- Access Management
- Get started with Access Management
- Users, groups, and roles
- UserSync
- Add UserSync connectors
- UserSync connector properties on Privacera Platform
- UserSync connector fields on PrivaceraCloud
- UserSync system properties on Privacera Platform
- About Ranger UserSync
- Customize user details on sync
- UserSync integrations
- SCIM Server User-Provisioning on PrivaceraCloud
- Azure Active Directory UserSync integration on Privacera Platform
- LDAP UserSync integration on Privacera Platform
- Policies
- How polices are evaluated
- General approach to validating policy
- Resource policies
- About service groups on PrivaceraCloud
- Service/Service group global actions
- Create resource policies: general steps
- About secure database views
- PolicySync design on Privacera Platform
- PolicySync design and configuration on Privacera Platform
- Relationships: policy repository, connector, and datasource
- PolicySync topologies
- Connector instance directory/file structure
- Required basic PolicySync topology: always at least one connector instance
- Optional topology: multiple connector instances for Kubernetes pods and Docker containers
- Recommended PolicySync topology: individual policy repositories for individual connectors
- Optional encryption of property values
- Migration to PolicySync v2 on Privacera Platform 7.2
- Databricks SQL connector for PolicySync on Privacera Platform
- Databricks SQL connector properties for PolicySync on Privacera Platform
- Dremio connector for PolicySync on Privacera Platform
- Dremio connector properties for PolicySync on Privacera Platform
- Configure AWS Lake Formation on Privacera Platform
- Get started with AWS Lake Formation
- Create IAM Role for AWS Lake Formation connector for Platform
- Configure AWS Lake Formation connector on Privacera Platform
- Create AWS Lake Formation connectors for multiple AWS regions for Platform
- Setup audit logs for AWS Lake Formation on Platform
- How to validate a AWS Lake Formation connector
- AWS Lake Formation FAQs for Pull mode
- AWS Lake Formation FAQs for Push mode
- AWS Lake Formation Connector Properties
- Google BigQuery connector for PolicySync on Privacera Platform
- BigQuery connector properties for PolicySync on Privacera Platform
- Microsoft SQL Server connector for PolicySync on Privacera Platform
- Microsoft SQL connector properties for PolicySync on Privacera Platform
- PostgreSQL connector for PolicySync on Privacera Platform
- PostgreSQL connector properties for PolicySync on Privacera Platform
- Power BI connector for PolicySync
- Power BI connector properties for PolicySync on Privacera Platform
- Redshift and Redshift Spectrum connector for PolicySync
- Redshift and Redshift Spectrum connector properties for PolicySync on Privacera Platform
- Snowflake connector for PolicySync on Privacera Platform
- Snowflake connector properties for PolicySync on Privacera Platform
- PolicySync design and configuration on Privacera Platform
- Configure resource policies
- Configure ADLS resource policies
- Configure AWS S3 resource policies
- Configure Athena resource policies
- Configure Databricks resource policies
- Configure DynamoDB resource policies
- Configure Files resource policies
- Configure GBQ resource policies
- Configure GCS resource policies
- Configure Glue resource policies
- Configure Hive resource policy
- Configure Lambda resource policies
- Configure Kafka resource policies
- Configure Kinesis resource policies
- Configure MSSQL resource policies
- Configure PowerBI resource policies
- Configure Presto resource policies
- Configure Postgres resource policies
- Configure Redshift resource policies
- Configure Snowflake resource policies
- Configure Policy with Attribute-Based Access Control (ABAC) on PrivaceraCloud
- Attribute-based access control (ABAC) macros
- Configure access policies for AWS services on Privacera Platform
- Configure policy with conditional masking on Privacera Platform
- Create access policies for Databricks on Privacera Platform
- Order of precedence in PolicySync filter
- Example: Manage access to Databricks SQL with Privacera
- Service/service group global actions on the Resource Policies page
- Tag policies
- Policy configuration settings
- Security zones
- Manage Databricks policies on Privacera Platform
- Use a custom policy repository with Databricks
- Configure policy with Attribute-Based Access Control on Privacera Platform
- Create Databricks policies on Privacera Platform
- Example: Create basic policies for table access
- Examples of access control via programming
- Secure S3 via Boto3 in Databricks notebook
- Other Boto3/Pandas examples to secure S3 in Databricks notebook with PrivaceraCloud
- Secure Azure file via Azure SDK in Databricks notebook
- Control access to S3 buckets with AWS Lambda function on PrivaceraCloud or Privacera Platform
- Service Explorer
- Audits
- Required permissions to view audit logs on Privacera Platform
- About PolicySync access audit records and policy ID on Privacera Platform
- View audit logs
- View PEG API audit logs
- Generate audit logs using GCS lineage
- Configure Audit Access Settings on PrivaceraCloud
- Configure AWS RDS PostgreSQL instance for access audits
- Accessing PostgreSQL Audits in Azure
- Accessing PostgreSQL Audits in GCP
- Configure Microsoft SQL server for database synapse audits
- Examples of audit search
- Reports
- Discovery
- Get started with Discovery
- Planning for Privacera Discovery
- Install and Enable Privacera Discovery
- Set up Discovery on Privacera Platform
- Set up Discovery on AWS for Privacera Platform
- Set up Discovery on Azure for Privacera Platform
- Set up Discovery on Databricks for Privacera Platform
- Set up Discovery on GCP for Privacera Platform
- Enable Pkafka for real-time audits in Discovery on Privacera Platform
- Customize topic and table names on Privacera Platform
- Enable Discovery on PrivaceraCloud
- Scan resources
- Supported file formats for Discovery Scans
- Privacera Discovery scan targets
- Processing order of scan techniques
- Register data sources on Privacera Platform
- Data sources on Privacera Platform
- Add a system data source on Privacera Platform
- Add a resource data source on Privacera Platform
- Add AWS S3 application data source on Privacera Platform
- Add Azure ADLS data source on Privacera Platform
- Add Databricks Spark SQL data source on Privacera Platform
- Add Google BigQuery (GBQ) data source on Privacera Platform
- Add Google Pub-Sub data source on Privacera Platform
- Add Google Cloud Storage data source on Privacera Platform
- Set up cross-project scanning on Privacera Platform
- Google Pub-Sub Topic message scan on Privacera Platform
- Add JDBC-based systems as data sources for Discovery on Privacera Platform
- Add and scan resources in a data source
- Start a scan
- Start offline and realtime scans
- Scan Status overview
- Cancel a scan
- Trailing forward slash (/) in data source URLs/URIs
- Configure Discovery scans
- Tags
- Add Tags
- Import Tags
- Add, edit, or delete Tag attributes
- Edit Tag descriptions
- Delete Tags
- Export Tags
- Search for Tags
- Fetch AWS S3 Tags
- Propagate Privacera Discovery Tags to Ranger
- TagSync using Apache Ranger on Privacera Platform
- Add Tags with Ranger REST API
- Dictionaries
- Types of dictionaries
- Dictionary Keys
- Manage dictionaries
- Default dictionaries
- Add a dictionary
- Import a dictionary
- Upload a dictionary
- Enable or disable a dictionary
- Include a Dictionary
- Exclude a dictionary
- Add keywords to an included dictionary
- Edit a dictionary
- Copy a dictionary
- Export a dictionary
- Search for a dictionary
- Test dictionaries
- Dictionary tour
- Patterns
- Models
- Rules
- Configure scans
- Scan setup
- Adjust default scan depth on Privacera Platform
- Classifications using random sampling on PrivaceraCloud
- Enable Discovery Realtime Scanning Using IAM Role on PrivaceraCloud
- Enable Real-time Scanning on ADLS Gen 2 on PrivaceraCloud
- Enable Real-time Scanning of S3 Buckets on PrivaceraCloud
- Connect ADLS Gen2 Application for Data Discovery on PrivaceraCloud
- Include and exclude resources in GCS
- Configure real-time scan across projects in GCP
- Enable offline scanning on ADLS Gen 2 on PrivaceraCloud
- Include and exclude datasets and tables in GBQ
- Google Sink to Pub/Sub
- Tags
- Data zones on Privacera Platform
- Planing data zones on Privacera Platform
- Data Zone Dashboard
- Enable data zones on Privacera Platform
- Add resources to a data zone on Privacera Platform
- Create a data zone on Privacera Platform
- Edit data zones on Privacera Platform
- Delete data zones on Privacera Platform
- Import data zones on Privacera Platform
- Export data zones on Privacera Platform
- Disable data zones on Privacera Platform
- Create tags for data zones on Privacera Platform
- Data zone movement
- Data zones overview
- Configure data zone policies on Privacera Platform
- Encryption for Right to Privacy (RTP) on Privacera Platform
- Workflow policy use case example
- Define Discovery policies on Privacera Platform
- Disallowed Groups policy
- Disallowed Movement Policy
- Compliance Workflow policies on Privacera Platform
- De-identification policy
- Disallowed Subnets Policy
- Disallowed Subnet Range Policy
- Disallowed Tags policy
- Expunge policy
- Disallowed Users Policy
- Right to Privacy policy
- Workflow Expunge Policy
- Workflow policy
- View scanned resources
- Discovery reports and dashboards
- Alerts Dashboard
- Discovery Dashboard
- Built-in reports
- Offline reports
- Saved Reports
- Reports with the Query Builder
- Discovery Health Check
- Set custom Discovery properties on Privacera Platform
- Get started with Discovery
- Encryption
- Get started with Encryption
- The encryption process
- Encryption architecture and UDF flow
- Install Encryption on Privacera Platform
- Encryption on Privacera Platform deployment specifications
- Configure Ranger KMS with Azure Key Vault on Privacera Platform
- Enable telemetry data collection on Privacera Platform
- AWS S3 bucket encryption on Privacera Platform
- Set up PEG and Cryptography with Ranger KMS on Privacera Platform
- Provide user access to Ranger KMS
- PEG custom properties
- Enable Encryption on PrivaceraCloud
- Encryption keys
- Master Key
- Key Encryption Key (KEK)
- Data Encryption Key (DEK)
- Encrypted Data Encryption Key (EDEK)
- Rollover encryption keys on Privacera Platform
- Connect to Azure Key Vault with a client ID and certificate on Privacera Platform
- Connect to Azure Key Vault with Client ID and Client Secret on Privacera Platform
- Migrate Ranger KMS master key on Privacera Platform
- Ranger KMS with Azure Key Vault on Privacera Platform
- Schemes
- Encryption schemes
- Presentation schemes
- Masking schemes
- Scheme policies
- Formats
- Algorithms
- Scopes
- Deprecated encryption schemes
- About LITERAL
- User-defined functions (UDFs)
- Encryption UDFs for Apache Spark on PrivaceraCloud
- Hive UDFs for encryption on Privacera Platform
- StreamSets Data Collector (SDC) and Privacera Encryption on Privacera Platform
- Trino UDFs for encryption and masking on Privacera Platform
- Privacera Encryption UDFs for Trino
- Prerequisites for installing Privacera crypto plugin for Trino
- Install the Privacera crypto plugin for Trino using Privacera Manager
- privacera.unprotect with optional presentation scheme
- Example queries to verify Privacera-supplied UDFs
- Privacera Encryption UDFs for Starburst Enterprise Trino on PrivaceraCloud
- Syntax of Privacera Encryption UDFs for Trino
- Prerequisites for installing Privacera Crypto plug-in for Trino
- Download and install Privacera Crypto jar
- Set variables in Trino etc/crypto.properties
- Restart Trino to register the Privacera encryption and masking UDFs for Trino
- Example queries to verify Privacera-supplied UDFs
- Privacera Encryption UDF for masking in Trino on PrivaceraCloud
- Databricks UDFs for Encryption
- Create Privacera protect UDF
- Create Privacera unprotect UDF
- Run sample queries in Databricks to verify
- Create a custom path to the crypto properties file in Databricks
- Create and run Databricks UDF for masking
- Privacera Encryption UDF for masking in Databricks on PrivaceraCloud
- Set up Databricks encryption and masking
- Get started with Encryption
- API
- REST API Documentation for Privacera Platform
- Access Control using APIs on Privacera Platform
- UserSync REST endpoints on Privacera Platform
- REST API endpoints for working tags on Privacera Platform
- PEG REST API on Privacera Platform
- API authentication methods on Privacera Platform
- Anatomy of the /protect API endpoint on Privacera Platform
- Construct the datalist for protect
- Deconstruct the datalist for unprotect
- Example of data transformation with /unprotect and presentation scheme
- Example PEG API endpoints
- /unprotect with masking scheme
- REST API response partial success on bulk operations
- Audit details for PEG REST API accesses
- REST API reference
- Make calls on behalf of another user on Privacera Platform
- Troubleshoot REST API Issues on Privacera Platform
- Encryption API date input formats
- Supported day-first date input formats
- Supported month-first date input formats
- Supported year-first date input formats
- Examples of supported date input formats
- Supported date ranges
- Day-first formats
- Date input formats and ranges
- Legend for date input formats
- Year-first formats
- Supported date range
- Month-first formats
- Examples of allowable date input formats
- PEG REST API on PrivaceraCloud
- REST API prerequisites
- Anatomy of a PEG API endpoint on PrivaceraCloud
- About constructing the datalist for /protect
- About deconstructing the response from /unprotect
- Example of data transformation with /unprotect and presentation scheme
- Example PEG REST API endpoints for PrivaceraCloud
- Audit details for PEG REST API accesses
- Make calls on behalf of another user on PrivaceraCloud
- Apache Ranger API on PrivaceraCloud
- API Key on PrivaceraCloud
- Administration and Releases
- Privacera Platform administration
- Portal user management
- Change password for Privacera Platform services
- Generate tokens on Privacera Platform
- Validations on Privacera Platform
- Health check on Privacera Platform
- Event notifications for system health
- Export or import a configuration file on Privacera Platform
- Logs on Privacera Platform
- Increase Privacera Platform portal timeout for large requests
- Platform Support Policy and End-of-Support Dates
- Enable Grafana metrics on Privacera Platform
- Enable Azure CLI on Privacera Platform
- Migrate from Databricks Spark to Apache Spark
- Migrate from PrestoSQL to Trino
- Ranger Admin properties on Privacera Platform
- Basic steps for blue/green upgrade of Privacera Platform
- Event notifications for system health
- Metrics
- Get ADLS properties
- PrivaceraCloud administration
- About the Account page on PrivaceraCloud
- Statistics on PrivaceraCloud
- PrivaceraCloud dashboard
- Event notifications for system health
- Metrics
- Usage statistics on PrivaceraCloud
- Update PrivaceraCloud account info
- Manage PrivaceraCloud accounts
- Create and manage IP addresses on PrivaceraCloud
- Scripts for AWS CLI or Azure CLI for managing connected applications
- Add UserInfo in S3 Requests sent via Data Access Server on PrivaceraCloud
- Previews
- PrivaceraCloud previews
- Preview: Scan Electronic Health Records with NER Model
- Preview: File Explorer for GCS
- Preview: File Explorer for Azure
- Preview: OneLogin setup for SAML-SSO
- Preview: File Explorer for AWS S3
- Preview: PingFederate UserSync
- Preview: Azure Active Directory SCIM Server UserSync
- Preview: OneLogin UserSync
- Privacera UserSync Configuration
- Governed Data Stewardship on PrivaceraCloud
- Overview of Governed Data Stewardship on PrivaceraCloud
- Concepts in Governed Data Stewardship
- Supported Applications
- Prerequisites and planning
- Additional features
- Applications and database resources
- Granular permissions on resources
- Automatic expiry of access for shared datasets or projects
- At-a-glance dashboards by role
- Optional data steward
- Privacera Discovery scans by admin or data owner
- Optional project leader
- Optional terms of use
- Discoverability of shared datasets
- User request access to datasets
- Notifications
- Overview to examples by role
- Databricks Partner Connect - Quickstart for Unity Catalog
- Privacera Platform previews
- Preview: AlloyDB connector for PolicySync
- Configure AWS Lake Formation on Privacera Platform
- Get started with AWS Lake Formation
- Create IAM Role for AWS Lake Formation connector for Platform
- Configure AWS Lake Formation connector on Privacera Platform
- Create AWS Lake Formation connectors for multiple AWS regions for Platform
- Setup audit logs for AWS Lake Formation on Platform
- How to validate a AWS Lake Formation connector
- AWS Lake Formation FAQs for Pull mode
- AWS Lake Formation FAQs for Push mode
- AWS Lake Formation Connector Properties
- PrivaceraCloud previews
- Release documentation
- Previous versions of Privacera Platform documentation
- PrivaceraCloud Release Notes
- Updates in PrivaceraCloud release 7.9
- Updates in PrivaceraCloud release 7.8
- Updates in PrivaceraCloud release 7.7
- Updates in PrivaceraCloud release 7.6
- Updates in PrivaceraCloud release 7.5
- Updates in PrivaceraCloud release 7.4
- Updates in PrivaceraCloud release 7.3
- Updates in PrivaceraCloud release 7.2
- Updates in PrivaceraCloud release 7.1
- PrivaceraCloud browser compatibility
- Documentation changelog
- Known Issues in PrivaceraCloud release
- Privacera Platform Release Notes
- Privacera documentation changelog
- For PrivaceraCloud 7.9 release, 2023-05-10
- For Privacera Platform 7.8 release, 2023-05-09
- For PrivaceraCloud 7.8 release, 2023-03-12
- For PrivaceraCloud 7.7 release, 2023-03-14
- For PrivaceraCloud 7.6 release, 2023-02-13
- For PrivaceraCloud 7.5 release, 2023-02-07
- For Privacera Platform 7.5 release 2023-02-07
- Privacera system security initiatives
- Privacera Platform administration
PrivaceraCloud Release Notes
This document contains information about the new features and enhancements in Privacera products and services, updates to supported third-party systems, and important announcements for each release. Release notes are available with every new version of the Privacera software package.
Each release comes with product documentation that explains any new features or enhancements.
For more information about feature availability, see Privacera's Product Support Policy
Updates in PrivaceraCloud release 7.9
Access Management updates
Audit data retention: For best performance in viewing audit data, the short term storage of audit data has been modified to 5 days.
All of the audit data is available for you via long term storage. The archived audit logs from PrivaceraCloud are stored in Azure ADLS storage and AWS S3 buckets. If you have any questions, contact Privacera Support.
Preview Databricks Unity Catalog: The Unity Catalog connector is now certified in the Azure Databricks environment.
Unity Catalog Connector's native implementation supports Masking, Row-Level Filtering, and Column-Level access control.
The AWS Lake Formation connector is now generally available for configuration with Privacera. It can be configured in either pull or push mode.
Attribute-based Access Control (ABAC) now supports nested Role-Level Filter policies.
When you delete a service from the Resource Policies page, a warning message appears if Governed Data Stewardship (GDS) is enabled for that service.
UI updates
The Access Management > Audit page now displays the total record count at the bottom.
Supported versions of third-party systems in PrivaceraCloud
The versions of third-party systems that PrivaceraCloud supports are listed in the following table:
Third-Party System | Supported Versions |
---|---|
Databricks Runtime Version | 7.3 LTS, 9.1 LTS , 10.4 LTS, 11.3 LTS, 12.2 LTS, 13.0 (Preview) |
Databricks Spark Version | 3.0.1, 3.1.2, 3.2.1, 3.3.0, 3.3.2 |
Open Source Spark Plug-In | 3.3.2 |
EMR (Privacera Plug-Ins) | 6.5.0, 6.10.0 |
EMR (Native Ranger Plug-In) | 6.3.1 |
Open Source Trino | 402, 407, 411 |
Dremio Software (with PolicySync connector) | 22.0, 23.0, 24.0 |
Dremio Software (with Ranger Plug-In) | 20.0, 21.7 |
Starburst Enterprise | 393 LTS, 402 LTS, 407 LTS |
Access Management updates
Support for filtering databases and tables in the EMR Hive Glue metastore
EMR Hive Glue metastore now supports filtering databases and tables based on access policy.
Creating select access policy for AWS Lake Formation in Apache Ranger for pull mode
The row-level filter policy in Lake Formation with all columns creates an access policy in Apache Ranger for * columns in pull mode.
Support access control on functions in PostgreSQL
PrivaceraCloud now supports access control policies on PostgreSQL functions.
UserSync updates
Support of service principal in Databricks for Privacera UserSync
Databricks Privacera UserSync now supports specifying a service principal.
UI updates
Improved policy creation page
Improved policy creation page with intuitive information to create policies.
Improved Account Settings screen
The account admin can now edit the personal information on Account Settings screen.
REST API changes
Formerly, for an unauthorized user call, the REST API for Access Manager and Ranger returned the HTTP response code 401-Unauthorized. Instead, the REST API now returns response code 403-Forbidden (unauthorized).
The REST API response body now does not return attributes or fields that have no values. This has improved the response time for many calls.
Supported versions of third-party systems in PrivaceraCloud
The versions of third-party systems that PrivaceraCloud supports are listed in the following table:
Third-Party System | Supported Versions |
---|---|
Databricks Runtime Version | 7.3 LTS, 9.1 LTS , 10.4 LTS, 11.3 LTS, 12.2 LTS |
Databricks Spark Version | 3.0.1, 3.1.2, 3.2.1, 3.3.0, 3.3.2 |
Open Source Spark Plug-In | 3.3.2 |
EMR (Privacera Plug-Ins) | 6.5.0, 6.10.0 |
EMR (Native Ranger Plug-In) | 6.3.1 |
Open Source Trino | 402, 407, 411 |
Dremio Software (with PolicySync connector) | 22.0, 23.0, 24.0 |
Dremio Software (with Ranger Plug-In) | 20.0, 21.7 |
Starburst Enterprise | 393 LTS, 402 LTS, 407 LTS |
Access Management updates
Support of DROP permission for AWS Redshift tables
The Privacera PolicySync connector now supports DROP
permission for AWS Redshift tables.
Improved dataset and resource listing page in Governed Data Stewardship
The dataset and resource listing pages display a configurable number of rows per page.
Support of access management for EMR's Multiple master node configuration
EMR clusters with multiple master nodes can be configured for access management.
UI updates
Introducing restart functionality in PrivaceraCloud Portal
When any configuration outside of the application configuration is changed, you need to restart your application, encryption, or UserSync. This is to ensure that the updated configuration functions properly. This functionality is added for Applications, Encryption, and UserSync services.
PrivaceraCloud is now in the Whitelisted IP addresses list
PrivaceraCloud has been added to the list of Whitelisted IP Addresses.
Special characters are not allowed in PrivaceraCloud
Special characters such as <
, >
, &
, and "
are not allowed when configuring things in PrivaceraCloud.
Supported versions of third-party systems in PrivaceraCloud
The versions of third-party systems that PrivaceraCloud supports are listed in the following table:
Third-Party System | Supported Versions |
---|---|
Databricks Runtime Version | 7.3 LTS, 9.1 LTS , 10.4 LTS, 11.3 LTS, 12.2 LTS (Preview) |
Databricks Spark Version | 3.0.1, 3.1.2, 3.2.1, 3.3.0, 3.3.2 |
Open Source Spark Plug-In | 3.3.1 |
EMR (Privacera Plug-Ins) | 6.5.0, 6.9.0 |
EMR (Native Ranger Plug-In) | 6.3.1 |
Open Source Trino | 393, 402, 407 |
Dremio Software (with PolicySync connector) | 22.0, 23.0 |
Dremio Software (with Ranger Plug-In) | 20.0, 21.7 |
Starburst Enterprise | 393 LTS, 402 LTS, 407 LTS |
UI updates
Improved notifications page for access request message
The access request message for the datasets appears in the notifications. When accepted, the notification is removed.
Resources remain same after deleting data owner
When the owner of a data domain is deleted, the resources shared by that owner are not deleted and remain in datasets.
Free text search is now available in Audit page
The search feature on the Audit page has been improved to support free text search and autocomplete. You can now modify your search.
Introducing an existing policy cloning option
Existing Policy can now be cloned to the same and different services.
New property for Databricks FGAC and OLAC
For Databricks FGAC and OLAC, the property spark.hadoop.privacera.fgac.use.displayname
controls whether the Databricks Service Principal name is used for access control and recorded in the audit logs. By default, the Service Principal ID is used, not the name.
Supported versions of third-party systems in PrivaceraCloud
The versions of third-party systems that PrivaceraCloud supports are listed in the following table:
Third-Party System | Supported Versions |
---|---|
Databricks Runtime Version | 7.3 LTS, 9.1 LTS , 10.4 LTS, 11.3 LTS, 12.1 (Preview) |
Databricks Spark Version | 3.0.1, 3.1.2, 3.2.1, 3.3.0, 3.3.1 |
Open Source Spark Plug-In | 3.3.1 |
EMR (Privacera Plug-Ins) | 6.5.0, 6.9.0 |
EMR (Native Ranger Plug-In) | 6.3.1 |
Open Source Trino | 393, 402, 406 |
Dremio Software (with PolicySync connector) | 22.0, 23.0 |
Dremio Software (with Ranger Plug-In) | 20.0, 21.0 |
Starburst Enterprise | 393 LTS, 402 LTS, 406 |
Access Management updates
Support for access control when writing to S3 using Kafka
Confluent Kafka and Open Source Kafka now support access control when writing to S3.
UI updates
Enable data domain-related notifications to IT admin user
Users with the IT Admin role can now receive notifications about data management-related activities such as, dataset access requests, resource creation and additions to the data domain, and resource deletions from the data domain.
Improved search in the user management table
Filters/search boxes have been added above each column in the user management table to improve usability.
Supported versions of third-party systems in PrivaceraCloud
The versions of third-party systems that PrivaceraCloud supports are listed in the following table:
Third-Party System | Supported Versions |
---|---|
Databricks Runtime Version | 7.3 LTS, 9.1 LTS , 10.4 LTS, 11.3 LTS |
Databricks Spark Version | 3.0.1, 3.1.2, 3.2.1, 3.3.0 |
Open Source Spark Plug-In | 3.3.0 |
EMR (Privacera Plug-Ins) | 6.3.1, 6.5.0, 6.8.0 |
EMR (Native Ranger Plug-In) | 6.3.1 |
Open Source Trino | 393, 402, 403 |
Dremio Software (with PolicySync connector) | 22.0, 23.0 |
Dremio Software (with Ranger Plug-In) | 20.0, 21.0 |
Starburst Enterprise | 393 LTS, 402 LTS |
Access Management updates
Preview - Databricks Unity Catalog Supports FGAC
The Databricks Unity Catalog Connector (on AWS) now supports Fine Grained Access Control (FGAC).
Oracle application supports as a resource in Domain, shared datasets, and projects
The Oracle Application now appears on the Add Resource
pop-up while adding Oracle resources to the Data Domain, Shared Data Set, and Project Data Set.
Support of Tag-based policies in a Security Zone
Security Zone now supports Tag-based policies created through a Data Domain.
Discovery updates
GCS supports offline scanning
GCS files and folders (except ORC and PARQUET file formats) support offline scanning for PII information, allowing you to create appropriate tag-based access policies.
Introducing auto approval option for datasets and projects
Data owners can now select the auto approval option for datasets and projects. This allows for instant approval notification and access to datasets and projects.
Supported versions of third-party systems
The versions of third-party systems that PrivaceraCloud supports are listed in the following table:
Third-Party System | Supported Versions |
---|---|
Databricks Runtime Version | 7.3 LTS, 9.1 LTS, 10.4 LTS, 11.3 LTS |
Databricks Spark Version | 3.0.1, 3.1.2, 3.2.1, 3.3.0 |
Open Source Spark Plugin | 3.2.2, 3.3.0 |
EMR (Privacera Plug-ins) | 6.2.1, 6.3.1, 6.4.0, 6.5.0, 6.6.0, 670, 680 |
EMR (Native Ranger Plug-in) | 6.3.1 |
Open Source Trino | 393, 402 |
Standalone Dremio | 20.0, 21.0 |
Standalone Dremio (Hive Native Ranger Plugin) | 20.0, 21.0 |
Starburst Enterprise | 393 LTS, 402 LTS |
Access Management updates
Support for access control in GDS for SE and SEP
Governed Data Stewardship (GDS) now supports access control for Starburst Enterprise (SE) and Starburst Enterprise Presto (SEP).
Support for PolicySync-based access control in Oracle application
Oracle database now supports access control through PolicySync. On-premises installation of Oracle Database 19c is supported.
Discovery update
Introducing offline scanning in Discovery for GBQ
Google BigQuery (GBQ) now supports offline scanning in Discovery to scan for PII information in Tables and Views.
Encryption update
Introducing Encryption for Snowflake resources
Encryption is now certified for Snowflake resources to encrypt and decrypt the column using external UDFs. Snowflake resources support user/role/group-based masking policies.
Supported versions of third-party systems
The versions of third-party systems that PrivaceraCloud supports are listed in the following table:
Third-Party System | Supported Versions |
---|---|
Databricks Runtime Version | 7.3 LTS, 9.1 LTS , 10.4 LTS, 11.3 LTS |
Databricks Spark Version | 3.0.1, 3.1.2, 3.2.1, 3.3.0 |
Open Source Spark Plugin | 3.2.2, 3.3.0 |
EMR (Privacera Plug-ins) | 6.2.1, 6.3.1, 6.4.0, 6.5.0, 6.6.0, 6.7.0, 6.8.0 |
EMR (Native Ranger Plug-in) | 6.3.1 |
Open Source Trino | 380, 389 |
Standalone Dremio | 20.0, 21.0, 22.0 |
Standalone Dremio (Hive Native Ranger Plugin) | 20.0, 21.0 |
Starburst Enterprise | 370 LTS, 380 LTS, 393 LTS |
Access Management updates
Change in permission for the Databricks application
The privacera_hive
service must be granted the alter
permission rather than the update
permission for databricks versions less than 10.4 LTS. Add a new policy to the privacera hive
service for the database, and grant alter
permission.
Preview: Introducing Databricks Unity Catalog
The Databricks Unity Catalog connector is now supported by the PrivaceraCloud portal.
Support for multiple AWS applications for access control
Multiple AWS accounts can be added using the application name in the PrivaceraCloud portal. All the created AWS accounts are displayed as tabs in the File Explorer to access S3 buckets.
Support for multiple subscriptions in Azure
Multiple subscriptions for access control in Databricks on Azure and dataserver are supported.
Improved policycache service
The policycache service now supports cache persistence. Deactivated services and deleted cases can be managed in Policycache.
Enabling access control for Dataproc and Textract applications
You can now use Access Manager service for Textract and Dataproc applications.
Additional permissions are added for more security reasons
Previously, when creating a table with a location, only read or write permissions were granted. It is now recommended to grant read, write, and delete permissions to ensure consistency for multiple flavors of creating tables for different Spark versions (7.3, 9.1, 10.3, and 11.3), different file formats (parquet, csv, json, and delta), and additional security reasons.
Discovery updates
GBQ supports for Data Discovery
GBQ now supports Data Discovery for scanning resources.
Limit the volume of Text/Verchar datatypes during scanning
Limit the volume of data read during the scan for all the JDBC data sources where we used Text/Varchar datatypes.
Support for Encryption and Decryption functionalities for BigQuery
The BigQuery application now supports Encryption and Decryption functionalities for sensitive data based on Apache Ranger access authorisation.
Introducing UTF-8 encoding for other than English language characters
UTF-8 encoding is now used to encrypt other than English language language characters.
Enabling PolicySync for Dremio application
The Dremio application now supports PolicySync features.
Tags column on the Audit page displays attributes
The tags column in the access audit log record is currently populated when the accessed resource has any tags associated with it. If the tag has any attributes, the values of those attributes are displayed in the audit log record.
Improvement in Datasets
The user of a shared dataset can now add the resource to a project.
Addition of Client OAuth option in ADLS Gen2 application
The ADLS Gen2 application now has Shared Key and Client OAuth options. Previously, you could only configure ADLS Gen2 with the Shared Key option. Now, you can create Tenant and Clients for your ADLS Gen2 application using the Client OAuth option.
Improvement in About modal window
The About modal window now displays specific component information, including the Privacera release version.
Supported versions of third-party systems
The versions of third-party systems that PrivaceraCloud supports are listed in the following table:
Third-Party System | Supported Versions |
---|---|
Databricks Runtime Version | 7.3 LTS, 9.1 LTS , 10.4 LTS, 11.1 |
Databricks Spark Version | 3.0.1, 3.1.2, 3.2.1, 3.3.0 |
Open Source Spark Plugin | 3.2.2, 3.3.0 |
EMR (Privacera Plug-ins) | 6.2.1, 6.3.1, 6.4.0, 6.5.0, 6.6.0, 6.7.0 |
EMR (Native Ranger Plug-in) | 6.3.1 |
Open Source Trino | 380, 393, 397, 398, 401 |
Standalone Dremio | 20.0, 21.0, 22.0 |
Standalone Dremio (Hive Native Ranger Plugin) | 20.0, 21.0 |
Starburst Enterprise | 370 LTS, 380 LTS, 393 LTS |
Access Management updates
Introducing Amazon Textract application for Access control
The Amazon Textract application can now be connected to PrivaceraCloud for access control.
Access control of multiple AWS accounts via dataserver.
The AWS S3 service supports access control via dataserver across multiple AWS accounts.
Support for OSS versions 3.2.2 and 3.3.0 access control
Spark plugin access control supports Kubernetes deployment of Open Source Spark (OSS) versions 3.2.2 and 3.3.0.
Certify access control support for EMR version 5.36.0
Access control support for EMR version 5.36.0 has been certified. You can configure EMR Hive, FGAC/OLAC Spark.
Preview: Dremio PolicySync connector
Access-control lists (ACLs) are supported by the Dremio PolicySync connector on both Physical datasets (PDS) and Virtual datasets (VDS).
Preview: Support of conditional masking in Snowflake connector
The Snowflake connector now supports conditional masking for access control using its native masking policy.
Improvement in the PolicySync Audit logs
Audit logs for Redshift, GBQ, Snowflake, and PostgreSQL PolicySync connectors are now improved.
Discovery updates
DynamoDB support for Data Discovery
DynamoDB datasource scan is supported for discovering sensitive elements and sync tags identified by Ranger.
Preview: Support scanning of Database views
Discovery now supports scanning of database views to be able to tag them.
Encryption updates
Introducing "mask" UDF for Trino
Trino now supports a masking scheme to protect UDFs.
Preview: Introducing PEG Integration with OSS
Introducing PEG Integration with Open Source Spark (OSS).
Introducing PEG Integration with Open Source Trino
Introducing PEG Integration with Open Source Trino Version 394.
Certify PEG scheme policies
With the Apache Ranger Security Zone, PEG schema policies are now certified.
UI updates
The new "Identity" menu in the PrivaceraCloud UI
The new Identity menu in the UI Settings, which allows you to configure LDAP/AD and Single Sign-On. Earlier, the Datasource menu included LDAP/AD and Single Sign-On, but now Datasource only includes UserSync.
Improved Notification page
To clear all the unread notifications, a new button labelled Mark All as Read has been added.
Supported versions of third-party systems
The versions of third-party systems that PrivaceraCloud supports are listed in the following table:
Third-Party System | Supported Versions |
---|---|
Databricks Runtime Version | 7.3 LTS, 9.1 LTS , 10.4 LTS, 11.1 |
Databricks Spark Version | 3.0.1, 3.1.2, 3.2.1, 3.3.0 |
Open Source Spark Plugin | 3.2.2, 3.3.0 |
EMR (Privacera Plug-ins) | 6.2.1, 6.3.1, 6.4.0, 6.5.0, 6.6.0, 6.7.0 |
EMR (Native Ranger Plug-in) | 6.3.1 |
Open Source Trino | 380, 393, 394, 395 |
Standalone Dremio | 20.0, 21.0 |
Standalone Dremio (Hive Native Ranger Plugin) | 20.0, 21.0 |
Starburst Enterprise | 370 LTS, 380 LTS |
PrivaceraCloud browser compatibility
Supported Browser | Minimum Version |
---|---|
Google Chrome | 47 |
Safari | 9 |
Firefox | 45 |
Opera | 36 |
Microsoft Edge | 12 |
Documentation changelog
For documentation updates in this release, see Privacera documentation changelog.