Spark 2.0 is here

After months of eagerly waiting, it’s finally here! I’ve been using nightly builds for the last few months, but for those not willing to live on the edge, Spark 2.0 is now officially out. I could highlight all the wonderful changes and enhancements, but the good folks over at Databricks have done such a good job, I’m not going to bother. Check out their post here. Suffice it to say that there are over 2,500 changes and performance has been drastically improved in almost all areas. There are new and simpler ways to do many things, but backwards compatibility is still very much a focus.

Leave a comment