...
| Info | ||
|---|---|---|
| ||
Kept sheets in a Datameer X workbook which contains large strings (e.g. 200MB of JSON) will result in big Parquet files. |
...
- restructure the workbook chain and make it a multi layer data transformation where only the required data is defined as kept/ result sheet
- increase the JVM heap space for the Datameer X job
Breaking up the Workflow When Having High Number of Sheets and Joints
...