by Ian J. Ghent | Jul 11, 2017 | Apache Spark, Python, R
After over 3 months of intensive testing, Spark 2.2 was released today. This release contains over 1,100 improvements, bug fixes, and new features. The most importantly, Spark now has a Cost-Based Optimizer (CBO). Huawei and Databricks worked together on the ability...
by Ian J. Ghent | Mar 6, 2017 | Apache Spark, Python
We are proud to be offering a free training day in Ottawa on Tuesday April 25, 2017 in Ottawa. Please email inquiry@wisewithdata.com if you would like to attend. Spaces are limited. Below is a syllabus of the topics that will be covered, which includes live coding...
by Content Manager | Jan 14, 2016 | Apache Spark, Java, Python, R, Scala, Uncategorized
The next major release of Apache Spark is now available. As usual, it contains a huge number of improvements across a the whole platform. Here’s a quick run down of some of the big changes: New Dataset API The Dataframes API, and it’s major advantages...
by Ian J. Ghent | Oct 21, 2015 | Apache Spark, Java, Python, R, Scala
The revolution of Spark is igniting an vigorous debate within the data operations, data science and analytic professionals community. Spark supports of 4 different programming languages (not including SQL), making choosing a programming language difficult. Although...
