Overview
Connectors enable seamless integration of external data sources into Airfold. They allow you to query external data sources as if they were native Airfold tables.Key Features
- Native table-like interface for all connected data sources
- Support for multiple data source types
- Configurable refresh strategies
- Seamless integration with endpoints and queries
Supported Data Sources
| Data Source | Status | Documentation |
|---|---|---|
| Snowflake | Available | View |
| Amazon S3 | Available | View |
| PostgreSQL | Available | View |
| BigQuery | Coming Soon | Coming Soon |
| Kafka | Coming Soon | Coming Soon |
Configuration
Refresh strategy
Each connector requires a defined refresh strategy that determines how data synchronization is handled.Available Strategies
replace
- Replaces entire dataset on each refresh interval
- Best for complete dataset synchronization
- Use when maintaining historical data is not required
append
- Adds new records to existing dataset
- Maintains historical data
- Ideal for time-series or log data
- Best when tracking data changes over time
Error Handling
Connectors implement automatic retry logic and provide detailed error messages for common issues:- Connection timeouts
- Authentication failures
- Schema validation errors
- Rate limiting