Palash Gupta (@palashgupta) started discussion #104
I started building an application using Spark 2.0.0 and some times I faced "Failed to get broadcast variable" error from Spark & it stopped processing. Currently I'm resolving to delete all running application, blockmanager directory, lib file created in /tmp directory and re-running the spark applications. My experience tells me that when I run multiple spark applications or one long running spark applications hang then it gives me the error.
As I don't understand the root cause of the problem with confidence, I want to know probable reasons to look into it.
Thanks for your support & will be waiting for your reply.
Best Regards, Palash Gupta