Multiple AWS S3 IAM role support in Dataserver

Dataserver supports configuring IAM Role which will be assumed to send the request to AWS S3 including in bucket level.

You want to run Spark queries in Databricks to query data available in buckets which are in multiple AWS accounts. Mutliple IAM role support in Dataserver will solve the problem by mapping buckets into specific IAM roles.

For each query, Privacera Dataserver will -

Extract bucketName from the request.
Find the IAM Role to be assumed from the mapping property, DATASERVER_AWS_S3_MULTI_ACCOUNT_MAPPING.

The following are the steps to configure IAM role.

SSH to EC2 instance where Privacera Dataserver is installed.

Enable multi-account access in Privacera Dataserver. Click the tab to reveal steps for Privacera Manager CLI and UI.

cd ~/privacera/privacera-manager
cp config/sample-vars/vars.dataserver.aws.yml config/custom-vars/
vi config/custom-vars/vars.dataserver.aws.yml

Add the new property.

DATASERVER_AWS_S3_MULTI_ACCOUNT_ACCESS_ENABLE:"true"
DATASERVER_AWS_S3_MULTI_ACCOUNT_DEFAULT_IAM:"<default-role-ARN>"
DATASERVER_AWS_S3_MULTI_ACCOUNT_MAPPING:-"<role-arn>|<bucketA,bucketB*>"-"<role-arn>|<bucketC*,bucketD>"

Property	Description
DATASERVER_AWS_S3_MULTI_ACCOUNT_ACCESS_ENABLE	Property to enable or disable the AWS S3 multiple IAM role support in Dataserver.
DATASERVER_AWS_S3_MULTI_ACCOUNT_DEFAULT_IAM	Property to set the role ARN of the AWS S3 bucket. The default IAM role will be used, if IAM Role mapping is not found for any s3 bucket This bucket can be a shared bucket containing common artifacts or resources.
DATASERVER_AWS_S3_MULTI_ACCOUNT_MAPPING	Property to define the mapping between role ARNs and buckets. You can add comma-separated buckets.

Note

The above role-bucket mapping applicable only for AWS S3 service and not applicable for other AWS services. To authenticate other AWS services, Dataserver will always use 'DefaultRole'.
Wildcards are supported while specifying bucket names in the mapping. For example, buck*.

Update Privacera Manager. Click the tab to reveal steps for Privacera Manager CLI and UI.
Run the following command.
```
cd ~/privacera/privacera-manager
./privacera-manager.sh update
```
Set assume role permission for Dataserver Instance Role in AWS console.
- The IAM role used for Privacera Dataserver instance will be used to assume other roles. Hence, this IAM role (instance IAM role) should have permissions to assume other roles (IAM roles configured in Security config JSON ) which can be given from AWS Console.
- Login to AWS console and go to IAM Service and then click Roles.
- Select Privacera Dataserver Role* and edit the existing or Add New Policy.
- Enter the following definition.
```
        {
        "Version": "2012-10-17",
        "Statement": [
            {
            "Sid": "VisualEditor0",
            "Effect": "Allow",
            "Action": "sts:AssumeRole",
            "Resource": [
                "arn:aws:iam::123456789012:role/RoleA",
                "arn:aws:iam::987654321012:role/RoleB",
                "arn:aws:iam::123456654321:role/DefaultRole"
            ]
            }
        ]
        }
```

Each IAM Role which is added above needs to have trust on the IAM role attached to your Privacera Dataserver (e.g. arn:aws:iam::999999999999:role/PRIV_DATASERVER_ROLE).

Go to IAM Service and click Roles.
Select your IAM Role and edit Trust Relationship.

Enter the following definition.

        {
        "Version": "2012-10-17",
        "Statement": [
            {
            "Effect": "Allow",
            "Principal": {
                "AWS": [
                "arn:aws:iam::999999999999:role/PRIV_DATASERVER_ROLE"
                ]
            },
            "Action": "sts:AssumeRole"
            }
        ]
        }

Privacera Platform

Table of ContentsTable of Contents

Multiple AWS S3 IAM role support in Dataserver

Multiple AWS S3 IAM role support in Dataserver