[source-Mixpanel][destination-bigquery] OOM / Exit Code 143 when processing large individual JSON records (500MB+) #72312
Description
Connector Name
Mixpanel
Connector Version
3.6.1
What step the error happened?
During the sync
Relevant information
We are experiencing a consistent Exit Code 143 (OOM) at the very end of a long fetch (2 hours).
The specific behavior observed is:
The source successfully reads and emits approximately 1.7M rows (~500MB of raw data).
We can actually see the data populated in the airbyte_internal temporary tables in BigQuery.
However, the sync fails during the final transition/normalization phase before moving data to the permanent destination table.
On retry, the system crashes again, likely because it tries to re-process the buffered data or the "state" isn't properly committed due to the memory pressure.
Relevant log output
Contribute
- Yes, I want to contribute
Internal Tracking: https://github.com/airbytehq/oncall/issues/11022