How to connect Amazon Redshift with SharePoint

This "how-to-connect" documentation will explain the initial configuration of an example connection from Amazon Redshift to a SharePoint Online List in Office 365. We will be synchronizing data stored in Amazon Redshift.

 

This guide presupposes that you have installed the Layer2 Cloud Connector and that you are familiar with its basic functionality. The Layer2 Cloud Connector User Documentation will provide you with all necessary information.

 

 

Contents

1. Configuring Amazon Redshift

2. Configuring the Layer2 Cloud Connector

2.1 Creating a new connection

2.2 Configuring the Data Entity 1

2.3 Configuring the Data Entity 2

2.4 Running your connection

3. Hints and known issues

3.1 Connection direction

3.2 Data model

1. Configuring Amazon Redshift

Download and install the ODBC Amazon Redshift driver here. Open your AWS console, open your Redshift dashboard and click on Connect client. Select the ODBC Driver with the same downloaded and installed version. Select a configured cluster and copy the ODBC URL.

 

Amazon Redshift ODBC URL

 

Go to your AWS console and open the VPC dashboard. Go to Security Groups.

 

Amazon Redshift Security Groups

 

Click on Inbound Rules and Edit Rules.

 

Amazon Redshift Inbound Rules

 

Add a new rule. Set the Type to All TCP and the Source to My IP.

 

Amazon Redshift Add Rule

 

2. Configuring the Layer2 Cloud Connector

2.1. Creating a new connection

Create a new connection by using the Create New Connection option in the Actions pane (right-hand side). The new connection will appear at the bottom of the Connection Manager List (left-hand side). Click on your newly created connection to open the connection configuration settings.

 

Choose a meaningful name for your connection and replace the current "New Connection" Connection Title with it.

 

Connections to Amazon Redshift are read-only connections. We will choose Left to Right as Synchronization Direction.

 

Step 1 Amazon Redshift connection setup.png

 

 

2.2. Configuring the Data Entity 1

We will now set up our Data Entities. Go to the data entity “Data Entity 1” to open the configuration settings.

 

Choose a Data Entity Title. It is recommended to give your entities meaningful names to maintain an overview when you decide to set up multiple connections.

 

Select the Data Provider for ODBC from the data provider list. You can search for ODBC by typing into the selection box.

 

Step 2 Amazon Redshift integration source setup.png

 

For the Connection String, we need the information mentioned in step 1. You can copy the below connection string and adjust it to match your gathered information. Use the Verify Connection String option to evaluate if the provided connection string is valid.

 

 

Driver={Amazon Redshift (x64)};Server=redshift-cluster-1.cquczniyclls.us-east-2.redshift.amazonaws.com;Database=dev;UID=awsuser;Port=5439;

 

 

  • "Driver=your_ODBC_URL;" this property must be set to the copied ODBC URL from step 1.

 

Enter the user master password into the Password field. The field masks the value for better security.

 

The Select Statement text box is used to define specific data queries. We will be gathering all data from our employees table. You can copy the below select statement and adjust it to match your needs. Save your changes by using the right-hand pane option Save Changes.

 

SELECT * FROM public.employees

 

Step 2.5 Amazon Redshift integration connection string setup.png

 

To check if all necessary columns are received, you can use the Preview Data option on the right-hand pane which will provide you with a pop-up window showing your sample data from your Amazon Redshift entity.

 

 

Preview data of Amazon Redshift integration.png

 

2.3. Configuring the Data Entity 2

We are going to send the data to a custom SharePoint Online list. It's required that you set up this list prior to the next steps. Your list should contain matching columns according to your source entity.

 

Use the left-hand pane to switch to the data entity "Data Entity 2". We will be using the Layer2 SharePoint Provider for this setup. 

 

For more information about the SharePoint provider visit:

https://www.layer2solutions.com/support/cloud-connector-faqs/layer2-csom-sharepoint-ado-net-provider.

 

You can copy the below Connection String which contains the minimum of required properties to connect to your custom SharePoint Online list.

 

URL=https://your_custom_sharepoint_list_url/AllItems.aspx;Authentication=Office365;User=User@domain.com;

 

  • "URL=https://your_custom_sharepoint_url/AllItems.aspx;" this property defines the URL of your custom list that will be addressed.
  • "Authentication=Office365;" this property will determine the authentication method used. Office365 is the default authentication method to access Microsoft Office365 / SharePoint Online. This method will not work in case of federation, e.g. ADFS. For further authentication method, you can consult the provider specifications linked above.
  • "User=User@domain.com;" this property should describe the user you wish to connect to SharePoint to. 

 

Enter the password that belongs to the user account used in the connection string into the Password field. Save your changes by using the right-hand pane option Save Changes.

 

Step 3 Amazon Redshift integration target setup.png

 

In the next step, we will configure our mapping settings. Click on the Mappings option on the left-hand pane. If your fields from SharePoint are named identical to the fields from your source system, the Enable Auto Mapping option will match those columns. Disabling this option allows you to match your columns as needed. Save your changes by using the right-hand pane option Save Changes.

 

Step 4 Amazon Redshift integration mapping.png

 

2.4. Running your connection

To run your connection switch back to the main connection configuration node and use the Run Now Button located on the bottom of the setup page. The Run Synchronization Toolbox will also display the synchronization process. 

 

Step 5 Amazon Redshift data integration start.png

 

Below is a data preview of the information we have access in our source entity:

 

Amazon Redshift integration ready.png

 

This will be the result in our SharePoint Online list after our initial successful synchronization:

 

Finished Amazon Redshift integration.png

3. Hints and known issues

 

3.1. Connection direction

As far as tested, this connection supports uni-directional only.

3.2. Data model

To see all the tables and views you can access with the Amazon Redshift provider, check your cluster in the AWS Redshift console.

 

↑Top

Search for more data integration & synchronization solutions

Icon of Contact us - Chat - Layer2 leading solutions

Any Questions?

Drop us a short note with your inquiry by filling out the contact us form.

 

Icon for Layer2 Solutions Finder- Layer2 leading solutions

About the Layer2 Cloud Connector

Get more information about the Layer2 Cloud Connector on the product page.

 

 

Ifoc for free trial product regsitration - Layer2 leading solutions

Register for a free trial

Get your free trial version of the Layer2 Cloud Connector by a quick registration.