Batch sources
Index of Nilus batch source connectors by category (database vs. SaaS API), linking to each connector's requirements, options, and behavior.
Batch sources read data on a scheduled or manually triggered cadence. Use them for full refreshes, incremental snapshots, and bounded query-based extraction.
SQL batch sources that accept source_table: "query:..." share one extract path. On a DataOS Lakehouse destination, table reads and query: write different Iceberg decimal types. See custom query (SQL sources) and schema evolution.
For batch manifest shape, see batch pipeline config. For worked examples, see batch sample configs.
Published batch sources
Database
Supported through the MS SQL Server batch source against a compatible dedicated SQL pool.
Last updated
Was this helpful?