When to pick SparkSQL vs DataFrame vs Dataset
Spark offers so many different APIs and languages that it can be overwhelming which way is “best.”
In this article I will be discussing the tradeoffs between each since there’s a lot of dogma and misinformation out there about it!
The SparkSQL API
SQL APIs are data scientists and analys…
