What data sources are supported by the Engine?

This article summarizes the different data sources the AI & Analytic Engine supports for data import.

When importing data to the Engine, users have the option to import from any of the following sources:

Data Source Type

Data Source

Description

Connection

Files

 

Local file upload

Upload/download files from the user’s terminal (local file system)

Import

Export

HTTP/HTTPS

Import files from the world-wide web

Import

FTP/FTPS/SFTP

Import files from an FTP server

Import

Cloud storage

AWS S3

Import files from an AWS S3 bucket

Import

Google Cloud Storage

Import files from a Google Cloud Storage bucket

Import

Azure Blob Storage

Import files from an Azure Blob Storage account

Import

Database

SQL Server

Import a table or query result from an SQL Server database

Compatible with Microsoft Azure SQL

Import

Export

MySQL

Import a table or query result from a MySQL database

Export a dataset to a MySQL database

Compatible with Microsoft Azure MySQL, Amazon Aurora for MySQL, and Huawei GaussDB for MySQL

Import

Export

PostgreSQL

Import a table or query result from a PostgreSQL database

Export a dataset to a PostgreSQL database

Compatible with Microsoft Azure PostgreSQL, Amazon Aurora for PostgreSQL, and Google AlloyDB for PostgreSQL

Import

Export

InterSystems

Import a table or query result from an InterSystem IRIS database

Export a dataset to a InterSystem IRIS database

Import

Export

Oracle

Import a table or query result from an Oracle database

Export a dataset to a Oracle database

Import

Export

Snowflake

Import a table or query result from a Snowflake database

Export a dataset to a Oracle database

Import

Export

MongoDB

Import a collection or query result from a MongoDB database

Export a dataset to a MongoDB database

Import

Export

AWS RDS

DB types supported: MySQL, PostgreSQL, MariaDB, Oracle, SQL Server

Import

Export

AWS REDSHIFT

Import a table or query result from AWS Redshift database

Export a dataset to a AWS Redshift database

Import

Export

Google Cloud SQL

DB types supported: MySQL, PostgreSQL, or SQL Server

Import

Export

Google BigQuery

Import a table or query result from Google BigQuery database

Export a dataset to a Google BigQuery database

Import

Export

App

Stripe

Import a dataset (“object”) from a Stripe account

Import

Google Sheet

Import a Google Sheet from Google Drive

Import

💡Data sources in the “Files” and “Cloud storage” categories support importing data from files stored in a particular type of source.

Supported file extensions are:

  • CSV (comma-separated values)

  • TSV (tab-separated values)

  • PSV (Pipe Separated Values)

  • JSON-lines

  • Parquet

:mortar_board: For more information on changing the configurations while creating a new dataset from CSV or JSON-lines files read, how to change the configurations and schema.