Merge remote-tracking branch 'upstream/dev' into feature_udf_lifecycle

Author: CosmosNi

config/plugin_config

@@ -59,6 +59,7 @@ connector-http-myhours
 connector-http-notion
 connector-http-onesignal
 connector-http-wechat
+connector-http-airtable
 connector-hudi
 connector-iceberg
 connector-influxdb

docs/en/architecture/design-philosophy.md

@@ -445,46 +445,30 @@ Many sinks only need Writer + Committer; AggregatedCommitter is for complex case
 
 However, for Flink translation, SeaTunnel checkpoints align with Flink checkpoints to avoid duplication.
 
-## 6. Future Directions
+## 6. Lessons Learned
 
-### 6.1 Planned Enhancements
-
-- **Dynamic Scaling**: Add/remove workers during job execution
-- **Adaptive Batch Size**: Auto-tune batch sizes based on throughput
-- **Query Pushdown**: Push filters/projections to sources
-- **Vectorized Execution**: Process batches of rows (columnar)
-- **Speculative Execution**: Mitigate stragglers
-
-### 6.2 Research Directions
-
-- **Machine Learning Integration**: ML-based optimization (split sizing, parallelism)
-- **Unified Batch and Streaming**: True unified processing model
-- **Global Query Optimization**: Cross-pipeline optimization
-
-## 7. Lessons Learned
-
-### 7.1 What Worked Well
+### 6.1 What Worked Well
 
 1. **Engine Independence**: Validated by successful Zeta engine addition without API changes
 2. **Split-based Parallelism**: Scales well to 1000+ parallel tasks
 3. **Explicit Schema**: Caught many bugs early, enabled schema evolution
 4. **Two-Phase Commit**: Reliable exactly-once semantics
 
-### 7.2 What Could Be Better
+### 6.2 What Could Be Better
 
 1. **API Complexity**: Enumerator/Committer adds learning curve for simple connectors
 2. **Class Loader Issues**: Occasional conflicts with shaded dependencies
 3. **Checkpoint Latency**: Large state causes checkpoint delays
 4. **Documentation Gaps**: Architecture docs lagged behind code
 
-### 7.3 If Starting Over
+### 6.3 If Starting Over
 
 1. **Simplify API**: Provide higher-level abstractions for simple sources/sinks
 2. **Async I/O Support**: First-class async API for non-blocking connectors
 3. **Built-in Metrics**: Standardized metrics collection in API
 4. **Schema Registry Integration**: Tighter integration with external schema registries
 
-## 8. Conclusion
+## 7. Conclusion
 
 SeaTunnel's architecture reflects careful trade-offs between competing concerns:
 - Engine independence vs engine-specific optimization
@@ -494,7 +478,7 @@ SeaTunnel's architecture reflects careful trade-offs between competing concerns:
 
 The V2 redesign addressed major V1 limitations while establishing principles for long-term evolution. Understanding these design philosophies helps contributors make consistent decisions and users understand SeaTunnel's strengths and appropriate use cases.
 
-## 9. References
+## 8. References
 
 - [Architecture Overview](overview.md)
 - [Source Architecture](api-design/source-architecture.md)

docs/en/connectors/changelog/connector-http-airtable.md

@@ -0,0 +1,6 @@
+<details><summary> Change Log </summary>
+
+| Change | Commit | Version |
+| --- | --- | --- |
+
+</details>

docs/en/connectors/sink/Airtable.md

@@ -0,0 +1,88 @@
+import ChangeLog from '../changelog/connector-http-airtable.md';
+
+# Airtable
+
+> Airtable sink connector
+
+## Description
+
+Used to write data to Airtable.
+
+## Key Features
+
+- [ ] [exactly-once](../../introduction/concepts/connector-v2-features.md)
+- [ ] [cdc](../../introduction/concepts/connector-v2-features.md)
+- [ ] [support multiple table write](../../introduction/concepts/connector-v2-features.md)
+
+## Options
+
+|            name             |  type   | required | default value |
+|-----------------------------|---------|----------|---------------|
+| token                       | String  | Yes      | -             |
+| base_id                     | String  | Yes      | -             |
+| table                       | String  | Yes      | -             |
+| api_base_url                | String  | No       | https://api.airtable.com |
+| typecast                    | boolean | No       | false         |
+| batch_size                  | int     | No       | 10            |
+| request_interval_ms         | int     | No       | 220           |
+| rate_limit_backoff_ms       | int     | No       | 30000         |
+| rate_limit_max_retries      | int     | No       | 3             |
+| common-options              |         | No       | -             |
+
+### token [String]
+
+Airtable personal access token. You can create one at https://airtable.com/create/tokens.
+
+### base_id [String]
+
+The ID of the Airtable base (starts with `app`).
+
+### table [String]
+
+The table name or table ID to write to.
+
+### api_base_url [String]
+
+Airtable API base URL. Default is `https://api.airtable.com`.
+
+### typecast [boolean]
+
+If true, Airtable will automatically convert values to match the field type. Default false.
+
+### batch_size [int]
+
+Number of records per API request. Maximum 10 per Airtable API limit. Default 10.
+
+### request_interval_ms [int]
+
+Minimum interval in milliseconds between API requests. Default 220ms.
+
+### rate_limit_backoff_ms [int]
+
+Base backoff time in milliseconds when receiving a 429 (rate limit) response. Default 30000ms.
+
+### rate_limit_max_retries [int]
+
+Maximum number of retries after receiving a 429 response. Default 3.
+
+### common options
+
+Sink plugin common parameters, please refer to [Sink Common Options](../common-options/sink-common-options.md) for details.
+
+## Example
+
+```hocon
+sink {
+  Airtable {
+    token = "patXXXXXXXX.XXXXXXXX"
+    base_id = "appXXXXXXXX"
+    table = "Shipments"
+    typecast = true
+    batch_size = 10
+  }
+}
+```
+
+## Changelog
+
+<ChangeLog />

docs/en/connectors/source/Airtable.md

@@ -0,0 +1,182 @@
+import ChangeLog from '../changelog/connector-http-airtable.md';
+
+# Airtable
+
+> Airtable source connector
+
+## Description
+
+Used to read data from Airtable.
+
+## Key features
+
+- [x] [batch](../../introduction/concepts/connector-v2-features.md)
+- [ ] [stream](../../introduction/concepts/connector-v2-features.md)
+- [ ] [exactly-once](../../introduction/concepts/connector-v2-features.md)
+- [x] [column projection](../../introduction/concepts/connector-v2-features.md)
+- [ ] [parallelism](../../introduction/concepts/connector-v2-features.md)
+- [ ] [support user-defined split](../../introduction/concepts/connector-v2-features.md)
+
+## Options
+
+|            name             |  type   | required | default value |
+|-----------------------------|---------|----------|---------------|
+| token                       | String  | Yes      | -             |
+| base_id                     | String  | Yes      | -             |
+| table                       | String  | Yes      | -             |
+| api_base_url                | String  | No       | https://api.airtable.com |
+| view                        | String  | No       | -             |
+| fields                      | List    | No       | -             |
+| filter_by_formula           | String  | No       | -             |
+| max_records                 | int     | No       | -             |
+| page_size                   | int     | No       | -             |
+| sort                        | String  | No       | -             |
+| cell_format                 | String  | No       | -             |
+| return_fields_by_field_id   | boolean | No       | -             |
+| record_metadata             | List    | No       | -             |
+| time_zone                   | String  | No       | -             |
+| user_locale                 | String  | No       | -             |
+| request_interval_ms         | int     | No       | 220           |
+| rate_limit_backoff_ms       | int     | No       | 30000         |
+| rate_limit_max_retries      | int     | No       | 3             |
+| schema                      | Config  | No       | -             |
+| schema.fields               | Config  | No       | -             |
+| format                      | String  | No       | text          |
+| content_field               | String  | No       | -             |
+| json_field                  | Config  | No       | -             |
+| common-options              | config  | No       | -             |
+
+### token [String]
+
+Airtable personal access token. You can create one at https://airtable.com/create/tokens.
+
+### base_id [String]
+
+The ID of the Airtable base (starts with `app`).
+
+### table [String]
+
+The table name or table ID to read from.
+
+### api_base_url [String]
+
+Airtable API base URL. Default is `https://api.airtable.com`.
+
+### view [String]
+
+The name or ID of a view in the table. Only records visible in this view will be returned.
+
+### fields [List]
+
+A list of field names to include in the response.
+
+### filter_by_formula [String]
+
+An Airtable formula to filter records. See [Airtable formula reference](https://support.airtable.com/docs/formula-field-reference).
+
+### max_records [int]
+
+Maximum total number of records to return.
+
+### page_size [int]
+
+Number of records per page (1-100).
+
+### sort [String]
+
+Sort definition as a JSON array, e.g. `[{"field":"Name","direction":"asc"}]`.
+
+### cell_format [String]
+
+The format for cell values, either `json` or `string`.
+
+### return_fields_by_field_id [boolean]
+
+If true, field keys in the response will be field IDs instead of field names.
+
+### record_metadata [List]
+
+Additional record metadata to return, e.g. `["commentCount"]`.
+
+### time_zone [String]
+
+The time zone for formatting date/time values.
+
+### user_locale [String]
+
+The user locale for formatting values.
+
+### request_interval_ms [int]
+
+Minimum interval in milliseconds between API requests. Default 220ms (to stay within Airtable's 5 requests/second limit).
+
+### rate_limit_backoff_ms [int]
+
+Base backoff time in milliseconds when receiving a 429 (rate limit) response. Default 30000ms.
+
+### rate_limit_max_retries [int]
+
+Maximum number of retries after receiving a 429 response. Default 3.
+
+### schema [Config]
+
+#### fields [Config]
+
+The schema fields of upstream data. For more details, please refer to [Schema Feature](../../introduction/concepts/schema-feature.md).
+
+### format [String]
+
+The format of upstream data, supports `json` and `text`, default `text`.
+
+### content_field [String]
+
+JsonPath expression to extract data from the response. For Airtable, you typically use `$.records[*].fields` to extract the fields from each record.
+
+### json_field [Config]
+
+This parameter helps you configure the schema and must be used with schema.
+
+### common options
+
+Source plugin common parameters, please refer to [Source Common Options](../common-options/source-common-options.md) for details.
+
+## Example
+
+Read from an Airtable table and output raw text:
+
+```hocon
+source {
+  Airtable {
+    token = "patXXXXXXXX.XXXXXXXX"
+    base_id = "appXXXXXXXX"
+    table = "Shipments"
+    format = "text"
+    max_records = 10
+  }
+}
+```
+
+Read with schema and extract record fields:
+
+```hocon
+source {
+  Airtable {
+    token = "patXXXXXXXX.XXXXXXXX"
+    base_id = "appXXXXXXXX"
+    table = "Shipments"
+    content_field = "$.records[*].fields"
+    filter_by_formula = "{Status} = 'Shipped'"
+    schema = {
+      fields {
+        Name = string
+        Status = string
+        Weight = float
+      }
+    }
+  }
+}
+```
+
+## Changelog
+
+<ChangeLog />