> ## Documentation Index
> Fetch the complete documentation index at: https://wisdomai-add-trigger-agent-api.mintlify.site/llms.txt
> Use this file to discover all available pages before exploring further.

# Supported Data Sources

This page covers the data sources that can be connected to WisdomAI, including databases, data warehouses, and CSV files. It outlines the connection requirements, necessary configurations, and troubleshooting tips for seamless integration.

WisdomAI works with the following data sources:

* PostgreSQL
* Microsoft SQL Server
* Databricks
* Snowflake
* Google BigQuery
* Amazon Redshift
* ClickHouse *(Beta)*
* Trino *(Beta)*
* CSV files

To learn how to connect to your Data Sources, read the [Basic Tutorial: Connect and Test](/setting-up-wisdom-ai/basic-tutorial-connect-and-test).

## Connection Requirements

This section outlines common prerequisites for connecting to data sources. Specific requirements are detailed under each data source.

* **Network Access:** Ensure WisdomAI has network access to your database or data warehouse host. This may involve configuring firewall rules or security groups.
* **Authentication Details:** You will need the correct credentials (username, password, keys, etc.) for your chosen data source.
* **SSL/TLS Configuration:** For secure connections, ensure your database/data warehouse is configured to accept SSL/TLS connections, and configure WisdomAI accordingly (e.g., `SSL Mode: require` for PostgreSQL).
* **Service Accounts (Google BigQuery):** For BigQuery, a Google Cloud service account with appropriate BigQuery permissions is required.

  <Info>
    For PostgreSQL and Amazon Redshift, you can optionally configure an SSH Tunnel to connect through a bastion host.
  </Info>

<Tabs>
  <Tab title="PostgreSQL">
    The following table lists all the requirements you need to provide when connecting to PostgreSQL.

    | Requirement              | Description                                                              |
    | :----------------------- | :----------------------------------------------------------------------- |
    | Host                     | Server address or IP                                                     |
    | Port                     | Typically `5432`                                                         |
    | Database                 | Name of the database                                                     |
    | Username                 | Database user with read access                                           |
    | Password                 | User's password                                                          |
    | SSL Mode                 | Recommended for secure connections                                       |
    | SSH Host                 | Hostname or IP address of the bastion host (optional)                    |
    | SSH Port                 | Port number on the SSH host (optional)                                   |
    | SSH Username             | The username required to log in to the bastion host (optional)           |
    | Authentication Method    | You can authenticate using either a Private Key or a Password (optional) |
    | SSH Private Key/Password | The Private Key or Password used for the SSH authentication (optional)   |

    Find below an example connection:

    ```txt
    Host: postgres.example.com
    Port: 5432
    Database: analytics
    Username: wisdom_reader
    Password: ********
    SSL Mode: require
    ```
  </Tab>

  <Tab title="Microsoft SQL Server">
    The following table lists all the requirements you need to provide when connecting to Microsoft SQL Server.

    | Requirement              | Description                                   |
    | :----------------------- | :-------------------------------------------- |
    | Server                   | SQL Server address or instance name           |
    | Port                     | Typically `1433`                              |
    | Database                 | Name of the database                          |
    | Authentication           | SQL Server or Windows Authentication          |
    | Username                 | SQL Server login with read access             |
    | Password                 | Login password                                |
    | Trust Server Certificate | Whether to trust the server's SSL certificate |

    Here's an example connection:

    ```txt
    Server: sqlserver.example.com
    Port: 1433
    Database: business_data
    Authentication: SQL Server
    Username: wisdom_reader
    Password: ********
    Trust Server Certificate: True
    ```
  </Tab>

  <Tab title="Databricks">
    The following table lists all the requirements you need to provide when connecting to Databricks.

    | Requirement     | Description                      |
    | :-------------- | :------------------------------- |
    | Server Hostname | Databricks SQL endpoint hostname |
    | HTTP Path       | HTTP path for the SQL endpoint   |
    | Username        | Databricks username              |
    | Password        | Databricks password              |
    | Catalog         | Optional Databricks catalog name |
    | Schema          | Optional schema name             |

    Below is an example key pair connection:

    ```txt
    Server Hostname: dbc-xxxx-yyyy.cloud.databricks.com
    HTTP Path: /sql/1.0/warehouses/abcdef123456
    Username: wisdom_user
    Password: ********
    Catalog: main
    Schema: default
    ```
  </Tab>

  <Tab title="Snowflake">
    The following table lists all the requirements you need to provide when connecting to Snowflake.

    | Requirement      | Description                           |
    | :--------------- | :------------------------------------ |
    | Account          | Snowflake account identifier          |
    | Username         | Snowflake user with access privileges |
    | Private Key File | Private Key File                      |
    | Warehouse        | Compute warehouse to use              |
    | Database         | Database name                         |
    | Schema           | Schema name (optional)                |
    | Role             | User role (optional)                  |

    To set up key pair authentication for Snowflake:

    1. Generate an RSA key pair (2048-bit minimum length).
    2. Register the public key with your Snowflake user.
    3. Use the private key (PEM format) when creating a WisdomAI connection.

    Here's an example key pair connection:

    ```txt
    Account: xy12345.us-east-1
    Username: wisdom_analytics
    Private Key File: Upload your private key file (.p8 or .pem format)
    Warehouse: ANALYTICS_WH
    Database: BUSINESS_DATA
    Schema: PUBLIC
    Role: ANALYST_ROLE
    ```

    Access the [Snowflake Docs](https://docs.snowflake.com/en/user-guide/key-pair-auth.html) to get more information about Key Pair Authentication.
  </Tab>

  <Tab title="Google BigQuery">
    The following table lists all the requirements you need to provide when connecting to Google BigQuery.

    | Requirement    | Description                       |
    | :------------- | :-------------------------------- |
    | Project ID     | Google Cloud project identifier   |
    | Authentication | Service account key (JSON format) |
    | Dataset        | Default dataset (optional)        |

    Find below an example connection:

    ```txt
    Project ID: my-analytics-project-123
    Authentication: Upload service account key JSON file
    Dataset: analytics_data
    ```

    <warning>
      You'll need to create a service account in Google Cloud with appropriate permissions on the BigQuery datasets you want to access.
    </warning>
  </Tab>

  <Tab title="Amazon Redshift">
    The following table lists all the requirements you need to provide when connecting to Amazon Redshift.

    | Requirement              | Description                                                              |
    | :----------------------- | :----------------------------------------------------------------------- |
    | Host                     | Redshift cluster endpoint                                                |
    | Port                     | Typically `5439`                                                         |
    | Database                 | Database name                                                            |
    | Username                 | Database user with read access                                           |
    | Password                 | User password                                                            |
    | Schema                   | Schema name (optional)                                                   |
    | SSH Host                 | Hostname or IP address of the bastion host (optional)                    |
    | SSH Port                 | Port number on the SSH host (optional)                                   |
    | SSH Username             | The username required to log in to the bastion host (optional)           |
    | Authentication Method    | You can authenticate using either a Private Key or a Password (optional) |
    | SSH Private Key/Password | The Private Key or Password used for the SSH authentication (optional)   |
  </Tab>

  <Tab title="CSV Files">
    You can also upload CSV files to a Domain. Here are the requirements for these files:

    * File must be in valid CSV format
    * Maximum file size: 100MB
    * UTF-8 encoding recommended
    * Headers should be in the first row

    To learn how to upload them, read [Upload CSV files](/setting-up-wisdom-ai/basic-tutorial-connect-and-test#upload-csv-files).
  </Tab>
</Tabs>

## Integrations

Connect WisdomAI to your essential business applications and services to unlock deeper insights from all your data.

### ETL Integration for SaaS Applications

WisdomAI works with leading (Extract, Transform, and Load) ETL partners to provide data integration from various SaaS applications.

WisdomAI leverages **Fivetran** or **Airbyte** to ETL data from SaaS applications into a customer-owned data warehouse, alternatively into a WisdomAI managed **BigQuery** based analytics environment.

### Supported SaaS Data Sources

A non-exhaustive list of SaaS Sources include:

* CRM tools (Salesforce, Hubspot)
* Financial systems (Netsuite)
* Ticketing systems (Jira, Zendesk)
* Marketing platforms (Google Analytics, Facebook Ads)

### Setting Up SaaS Integration

To integrate data from SaaS applications, please contact WisdomAI support at `support@askwisdom.ai`. Our team will work with you to set up the appropriate ETL pipelines using our partner technologies.

## Limits

This section details any known limitations or restrictions when connecting to data sources.

* **CSV File Size:** Maximum CSV file size for direct upload is 100MB. For larger CSV datasets, consider uploading them to a data warehouse (e.g., S3, Google Cloud Storage) and connecting WisdomAI to the warehouse.
* **Query Limits:** Be aware of any rate limits or query concurrency limits imposed by your database or data warehouse provider. WisdomAI's queries will contribute to these limits.
* **Data Type Support:** While WisdomAI strives to support a wide range of data types, some highly specialized or proprietary data types might require specific handling or may not be fully supported. Contact us if you request any assistance.

## Troubleshooting

Understand common problems and systematic troubleshooting techniques that can help you quickly identify and resolve connectivity issues.

### Common Connection Issues

| **Issue**             | **Possible Causes**                                                                 | **Resolution**                                                                                             |
| --------------------- | ----------------------------------------------------------------------------------- | ---------------------------------------------------------------------------------------------------------- |
| Connection Timeout    | - Network latency  <br /> - Firewall blocking  <br /> - Server overload             | - Check network connectivity  <br /> - Verify firewall rules  <br /> - Increase connection timeout setting |
| Authentication Failed | - Incorrect credentials  <br /> - Expired API keys/tokens  <br /> - Account lockout | - Verify username/password  <br /> - Regenerate API keys  <br /> - Check account status                    |
| Permission Denied     | - Insufficient privileges  <br /> - IP restriction  <br /> - Resource access limits | - Update user permissions  <br /> - Whitelist IP addresses  <br /> - Check resource quotas                 |

For persistent connection issues, contact WisdomAI support at `support@askwisdom.ai` with the connection ID and error logs for assistance.

## Next Steps

* [Basic Tutorial Connect and Test](/setting-up-wisdom-ai/basic-tutorial-connect-and-test)
* [Advanced Data Modeling: Creating Knowledge](/setting-up-wisdom-ai/advanced-data-modeling-creating-knowledge)
* [Provide Feedback to the System](/setting-up-wisdom-ai/provide-feedback-to-the-system)
* [Turn Answers into Stories](/using-wisdom-ai-everyday/turn-answers-into-stories)