All I want for Christmas is My Two Dot One

Spark 2.1-rc5 was marked as the official Spark2.1 just in time for Christmas. Streaming applications have got the Gold treatment, with Structured Streaming receiving a lot of attention in order to stabilize the API and engine. Event Time watermarks should make it much...

Spark 2.0.2 released

Spark 2.0 is continuing to harden and the second maintenance release has arrived. This release contains critical bug fixes that for Spark 2.0. All 2.0 users are encouraged to upgrade to this release.

Spark 2.0.1 has arrived

After 2 months of contributors squashing lots of bugs, Apache has released Spark 2.0.1. Given the complete rewrite of many subsystems within the code base for 2.0, it’s not surprising that it contains over 100 critical bug fixes. All Spark 2.0 users are...

Spark 2.0 is here

After months of eagerly waiting, it’s finally here! I’ve been using nightly builds for the last few months, but for those not willing to live on the edge, Spark 2.0 is now officially out. I could highlight all the wonderful changes and enhancements, but...

Is SAS still relevant?

I’m increasingly being asked the same question in a number of different ways. Essentially the question boils down to this; Given that open-source analytics, and Apache Spark in particular have become such a force to be reckoned with, does SAS still have any...