Skip to main content

Privacera Documentation

Table of Contents

Enable Discovery on PrivaceraCloud

To enable Discovery, click the Discovery toggle button.

Enable real-time scanning of an AWS S3 bucket

To enable real-time scanning on an S3 bucket, do the following steps. This step assumes you have an existing setup of an AWS SQS account with a queue created. If you do not have an AWS SQS account, set up an account and then create a queue.

  1. Click ENABLE button next to the Real-Time Scanning.

    The Real-Time Scanning Info dialog appears.

  2. Get the following information from the AWS SQS account and enter them in the given fields:

    • With Use IAM Role disabled:

      • SQS Endpoint

      • SQS Access Key

      • SQS Secret Key

      • SQS Region

      • SQS Queue Name

    • With Use IAM Role enabled:

      • SQS Endpoint

      • SQS IAM Role

      • SQS Region

      • SQS Queue Name

  3. Click Test Connection to check if the connection is successful, and then click Save Settings.

Thereafter, use the toggle to either disable or enable real-time scanning, and use the pen icon to modify the existing configuration.

Configure real-time scanning for Azure ADLS on PrivaceraCloud

For real-time scanning to be configured, you need to configure an Azure Event Hub. It will process all the events sent from the Azure storage container, whenever a new resource gets added.

Event Hub requires a storage account to store checkpoint information. Checkpointing is a process by which readers (i.e Pkakfa) mark or commit their position within a partition event sequence. In this case, Azure blob storage container is used for storing checkpoints while processing events from Azure Event Hubs.

  1. Configure Event Hub:

    1. Create an Event Hub namespace with a region similar to the region of a Storage Account you want to monitor. Refer to Microsoft documentation on how to Create an Event Hubs namespace .

      Use this Event Hub namespace name in Eventhub Namespace.

    2. Create an Event Hub in the Event Hub namespace. Refer to Microsoft documentation on how to Create an event hub .

      Use this event hub name in Eventhub Name.

    3. Get Eventhub Sas Key Name and Eventhub Sas key:

      1. Navigate to Event hub namespace > Event hub.

      2. Under Settings, click Shared access policies.

      3. Click +Add to create a new Sas policy.

        The Add SAS Policy section is displayed on the right.

      4. Enter a policy name and select appropriate claims.

      5. Click the new policy to populate keys.

        Use the policy name in Eventhub Sas Key Name, and use either the Primary key or Secondary key in Eventhub Sas key.

  2. Create Consumer Group for Pkafka:

    1. Navigate to Event Hubs namespace > Event Hub > Consumer Groups > +Consumer Group. The Consumer Groups tab will be under Entities of the Event Hub page.

    2. Create a consumer group with name as pkafkagroup1.

  3. Configure Checkpoint Storage for Pkafka:

    1. Get Eventhub Storage Account Name:

      Use an existing storage account or create a storage account to use with Eventhub. Refer to Microsoft documentation on how to Create a Storage Account.

      Use this storage account name in Eventhub Storage Account Name.

    2. Get Eventhub Storage Account Key:

      1. Navigate to the storage account.

      2. Under Security + networking, click Access keys.

      3. Click Show Keys for keys to be populated.

      4. Use Key1 value in Eventhub Storage Account Key.

    3. Get Eventhub Storage Container Name:

      Use an existing container name or create a storage container to use with Eventhub. Refer to Microsoft documentation on how to Create a Container .

      Use this container name in Eventhub Storage Container Name.

    4. Get the Eventhub URL Prefix:

      1. Navigate to the container.

      2. Open the container and click Properties, container property details are populated on the right.

      3. Use the URL prefix in Eventhub Storage Url Prefix.

  4. Enable Real-Time Scan:

    1. Click ENABLE button next to the Real-Time Scanning.

      The Real-Time Scanning Info dialog appears.

    2. Provide the following information:

      • Eventhub Namespace

      • Eventhub Name

      • Eventhub Sas Key Name

      • Eventhub Sas key

      • Eventhub Storage Url Prefix

      • Eventhub Storage Account Name

      • Eventhub Storage Account Key

      • Eventhub Storage Container Name

    3. Click Test Connection to check if the connection is successful, and then click Save Settings.

Thereafter, use the toggle to either disable or enable real-time scanning, and use the pen icon to modify the existing configuration.