> For the complete documentation index, see [llms.txt](https://v2.dataos.info/llms.txt). Markdown versions of documentation pages are available by appending `.md` to page URLs; this page is available as [Markdown](https://v2.dataos.info/concepts/resources/nilus/sources.md). # Sources Overview Nilus source connectors are organized by pipeline mode. Start with the mode that matches the kind of work you want the pipeline to do, then open the connector-specific page for requirements, source options, examples, behavior, troubleshooting, and related docs. ## Browse by pipeline mode * [Batch Sources](/concepts/resources/nilus/batch/batch-sources.md): periodic full, incremental, or query-based reads. * [CDC Sources](/concepts/resources/nilus/cdc/cdc-sources.md): log-based row-level change capture. * [Stream Sources](/concepts/resources/nilus/stream/stream-sources.md): continuous consumption from event systems. * [Metadata Sources](/concepts/resources/nilus/metadata-pipelines/metadata-sources.md): catalog introspection that publishes source context without copying rows. * [Custom Sources](/concepts/resources/nilus/batch/custom-sources.md): advanced extension paths for SQL queries or user-authored sources when a first-party connector is not available. ## All published sources | Connector | Pipeline Mode | Category | | ------------------------------------------------------------------------------------------------------------------------- | ----------------------- | --------- | | [AWS Redshift](/concepts/resources/nilus/batch/batch-sources/aws-redshift.md) | Batch | Database | | [Azure Synapse](/concepts/resources/nilus/batch/batch-sources/azure-synapse.md) | Batch via MS SQL Server | Database | | [ClickHouse](/concepts/resources/nilus/batch/batch-sources/clickhouse.md) | Batch | Database | | [Custom Query (SQL Sources)](/concepts/resources/nilus/batch/custom-sources/custom-query-sql-sources.md) | Custom | Custom | | [Custom Source](/concepts/resources/nilus/batch/custom-sources/creating-custom-source.md) | Custom | Custom | | [Databricks](/concepts/resources/nilus/batch/batch-sources/databricks.md) | Batch | Database | | [Databricks (Metadata)](/concepts/resources/nilus/metadata-pipelines/metadata-sources/databricks-metadata.md) | Metadata | Database | | [DataOS Lakehouse (Metadata)](/concepts/resources/nilus/metadata-pipelines/metadata-sources/dataos-lakehouse-metadata.md) | Metadata | Database | | [Delta Lake](/concepts/resources/nilus/batch/batch-sources/delta-lake.md) | Batch | Database | | [Google Analytics](/concepts/resources/nilus/batch/batch-sources/google-analytics.md) | Batch | SaaS API | | [Google BigQuery](/concepts/resources/nilus/batch/batch-sources/google-bigquery.md) | Batch | Database | | [Google Sheets](/concepts/resources/nilus/batch/batch-sources/google-sheets.md) | Batch | SaaS API | | [HubSpot](/concepts/resources/nilus/batch/batch-sources/hubspot.md) | Batch | SaaS API | | [IBM DB2](/concepts/resources/nilus/cdc/cdc-sources/ibm-db2.md) | CDC | Database | | [Kafka](/concepts/resources/nilus/stream/stream-sources/kafka.md) | Stream | Streaming | | [MongoDB (Batch)](/concepts/resources/nilus/batch/batch-sources/mongodb.md) | Batch | Database | | [MongoDB (CDC)](/concepts/resources/nilus/cdc/cdc-sources/mongodb.md) | CDC | Database | | [MS SQL Server (Batch)](/concepts/resources/nilus/batch/batch-sources/ms-sql-server.md) | Batch | Database | | [MS SQL Server (CDC)](/concepts/resources/nilus/cdc/cdc-sources/ms-sql-server.md) | CDC | Database | | [MySQL (Batch)](/concepts/resources/nilus/batch/batch-sources/mysql.md) | Batch | Database | | [MySQL (CDC)](/concepts/resources/nilus/cdc/cdc-sources/mysql.md) | CDC | Database | | [NATS](/concepts/resources/nilus/stream/stream-sources/nats.md) | Stream | Streaming | | [PostgreSQL (Batch)](/concepts/resources/nilus/batch/batch-sources/postgresql.md) | Batch | Database | | [PostgreSQL (CDC)](/concepts/resources/nilus/cdc/cdc-sources/postgresql.md) | CDC | Database | | [Salesforce](/concepts/resources/nilus/batch/batch-sources/salesforce.md) | Batch | SaaS API | | [Snowflake](/concepts/resources/nilus/batch/batch-sources/snowflake.md) | Batch | Database | | [Snowflake (Metadata)](/concepts/resources/nilus/metadata-pipelines/metadata-sources/snowflake-metadata.md) | Metadata | Database | | [Stripe](/concepts/resources/nilus/batch/batch-sources/stripe.md) | Batch | SaaS API | ## Pipeline mode * **Batch**: periodic full or incremental loads. See [Understanding Batch Pipeline Config](/concepts/resources/nilus/batch/pipeline-config.md) and [Batch Sample Configs](/concepts/resources/nilus/batch/sample-configs.md). * **CDC**: log-based change data capture for relational and document stores. See [Understanding CDC Pipeline Config](/concepts/resources/nilus/cdc/service-config.md) and [CDC Sample Configs](/concepts/resources/nilus/cdc/sample-configs.md). * **Stream**: continuous consumption from event/streaming systems. See [Understanding Stream Pipeline Config](/concepts/resources/nilus/stream.md) and [Stream Sample Configs](/concepts/resources/nilus/stream/sample-configs.md). * **Metadata**: catalog introspection that publishes source inventory and, where supported, profiling, classification, lineage, and usage into the DataOS metadata catalog without copying rows. See [Understanding Metadata Pipeline Config](/concepts/resources/nilus/metadata-pipelines/pipeline-config.md) and [Metadata Sample Configs](/concepts/resources/nilus/metadata-pipelines/sample-configs.md). * **Custom**: advanced paths for custom SQL or user-authored source logic when a first-party connector does not fit. ## Category * **Database**: relational engines, NoSQL stores, columnar warehouses, and lakehouse-backed targets accessed through SQL or a native client. * **SaaS API**: REST/GraphQL APIs for SaaS products. Most use OAuth or API tokens and ship as Nilus-managed connectors. * **Streaming**: event/streaming systems consumed through a long-lived consumer. * **Custom**: escape hatches for systems without a built-in connector. [Custom Query (SQL Sources)](/concepts/resources/nilus/batch/custom-sources/custom-query-sql-sources.md) covers arbitrary SQL against a JDBC-compatible source; [Custom Source](/concepts/resources/nilus/batch/custom-sources/creating-custom-source.md) covers user-authored Python connectors for systems Nilus does not yet support natively. --- # Agent Instructions This documentation is published with GitBook. GitBook is the documentation platform designed so that both humans and AI agents can read, navigate, and reason over technical content effectively. Learn more at gitbook.com. ## Querying This Documentation If you need additional information that is not directly available in this page, you can query the documentation dynamically by asking a question. Perform an HTTP GET request on the current page URL with the `ask` query parameter, and the optional `goal` query parameter: ``` GET https://v2.dataos.info/concepts/resources/nilus/sources.md?ask=&goal= ``` `ask` is the immediate question: it should be specific, self-contained, and written in natural language. `goal` is optional and describes the broader end goal you are ultimately trying to accomplish on behalf of the user. GitBook uses it to tailor the answer towards what is most useful for that goal. The response will contain a direct answer to the question and relevant excerpts and sources from the documentation. Use this mechanism when the answer is not explicitly present in the current page, you need clarification or additional context, or you want to retrieve related documentation sections.