hi channel, I know it is not right place. A simple

transform(generate_data(20), forecast, partition={"num":500, "by":"unique_id"}).show()

throws error. can anyone help. error

8 ERROR ArrowPythonRunner: Python worker exited unexpectedly (crashed)
org.apache.spark.api.python.PythonException: Traceback (most recent call last):
  File "/opt/anaconda3/envs/bigdata/lib/python3.8/site-packages/pyspark/python/lib/pyspark.zip/pyspark/worker.py", line 1225, in main
    eval_type = read_int(infile)