Spark UDFs (User Defined Functions) are not the best thing a developer will use, they look so cool especially the syntax to write them is really cool, looks attractive and make the code cleaner but the problem with UDFs are related to performance especially a big impact if you are using Python because it is non JVM language.