6

Recently I am facing an issue in pyspark like Fatal error: python kernel unresponsive.

Is it a memory error or some other type of error? Can someone please shed some light on it?

Improve this question
3
  • What runtime are you using? Commented Oct 17, 2022 at 12:31
  • I'm getting the same error in a job that runs OPTIMIZE on a moderately small table. Runtime 11.2. The problem appeared in the last month Commented Nov 7, 2022 at 13:50
  • Frustrating how this question isn't getting any attention. This thread on the Databricks forum mentions how it is caused by running out of RAM on your cluster. Wish I could say more about what types of query / code can cause the issue, and how you could prevent it ... Commented May 9, 2023 at 4:46
Related questions
2
Cannot create Dataframe in PySpark
0
'SparkSession' object has no attribute 'databricks'
2
Error connecting to databricks in python with databricks-connect
Load 7 more related questions Show fewer related questions

0

Reset to default

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service and acknowledge you have read our privacy policy.

Start asking to get answers

Find the answer to your question by asking.

Ask question

Explore related questions

See similar questions with these tags.