Spark 1.5
ships Spark's Project Tungsten initiative, a cross-cutting performance
update that uses binary memory management and code generation to
dramatically improve latency of most Spark jobs. This release also
includes several updates to Spark's DataFrame API and SQL optimizer,
along with new Machine Learning algorithms and feature transformers, and
several new features in Spark's native streaming engine
