You might have been a victim of skewed data when performing some operations in Spark especially that requires a shuffle like a Join and you might have noticed that your job takes longer and you don’t know what is going on and why it’s happening. This article will help you answer some questions related to skewed data.
Solving Data Skewness in Spark
Solving Data Skewness in Spark
Solving Data Skewness in Spark
You might have been a victim of skewed data when performing some operations in Spark especially that requires a shuffle like a Join and you might have noticed that your job takes longer and you don’t know what is going on and why it’s happening. This article will help you answer some questions related to skewed data.