Skip to content

get-data-amazon-s3.md

Latest commit

 

History

History
76 lines (46 loc) · 3.54 KB

get-data-amazon-s3.md

File metadata and controls

76 lines (46 loc) · 3.54 KB
title Get data from Amazon S3
description Learn how to get data from Amazon S3 in a KQL database in Real-Time Intelligence.
ms.reviewer tzgitlin
ms.topic how-to
ms.custom sfi-image-nochange
ms.date 02/27/2025
ms.subservice rti-eventhouse
ms.search.form Get data in a KQL Database

Get data from Amazon S3

In this article, you learn how to get data from Amazon S3 into either a new or existing table. Amazon S3 is an object storage service built to store and retrieve data.

For more information on Amazon S3, see What is Amazon S3?.

Prerequisites

Source

  1. On the lower ribbon of your KQL database, select Get Data.

    In the Get data window, the Source tab is selected.

  2. Select the data source from the available list. In this example, you're ingesting data from Amazon S3.

    :::image type="content" source="media/get-data-amazon-s3/get-data-as3-tile.png" alt-text="Screenshot of the get data tiles with the Amazon S3 option highlighted.":::

Configure

  1. Select a target table. If you want to ingest data into a new table, select +New table and enter a table name.

    [!NOTE] Table names can be up to 1024 characters including spaces, alphanumeric, hyphens, and underscores. Special characters aren't supported.

  2. In the URI field, paste the connection string of a single bucket, or an individual object in the following format.

    Bucket: https://BucketName.s3.RegionName.amazonaws.com;AwsCredentials=AwsAccessID,AwsSecretKey

    Optionally, you can apply bucket filters to filter data according to a specific file extension.

    :::image type="content" source="media/get-data-amazon-s3/configure-tab.png" alt-text="Screenshot of configure tab with new table entered and an Amazon S3 connection string pasted." lightbox="media/get-data-amazon-s3/configure-tab.png":::

  3. Select Next.

Inspect

The Inspect tab opens with a preview of the data.

To complete the ingestion process, select Finish.

:::image type="content" source="media/get-data-amazon-s3/inspect-data.png" alt-text="Screenshot of the inspect tab." lightbox="media/get-data-amazon-s3/inspect-data.png":::

[!INCLUDE get-data-inspect]

[!INCLUDE get-data-edit-columns]

:::image type="content" source="media/get-data-amazon-s3/edit-columns.png" alt-text="Screenshot of columns open for editing." lightbox="media/get-data-amazon-s3/edit-columns.png":::

[!INCLUDE mapping-transformations]

[!INCLUDE get-data-process-event-advanced-options-data-type]

Summary

In the Data preparation window, all three steps are marked with green check marks when data ingestion finishes successfully. You can select a card to query, drop the ingested data, or see a dashboard of your ingestion summary.

:::image type="content" source="media/get-data-amazon-s3/summary.png" alt-text="Screenshot of summary page with successful ingestion completed." lightbox="media/get-data-amazon-s3/summary.png":::

Related content