Apr 24, 2014
Richard Harris
Concurrent, an enterprise data application platform company, and Hortonworks, a provider of enterprise Apache Hadoop, have announced the Concurrent Cascading SDK will now be integrated and delivered with the Hortonworks Data Platform (HDP). In addition, Hortonworks will certify, support and deliver the Cascading application development framework for data applications on Hadoop.
Hortonworks will certify, support and deliver the Cascading SDK with HDP guaranteeing the ongoing compatibility of Cascading-based applications across future releases of HDP with continuous compatibility testing and direct HDP customer support for Cascading.
Cascading will now also support Apache Tez which enables Hadoop projects to meet demands for faster response times and delivering near real-time big data processing. Tez is a general data-processing fabric and MapReduce replacement that provides a framework for executing a complex topology of tasks. In addition, Tez executes on top of Apache Hadoop YARN, a sub-project of Hadoop which separates resource management and processing components. YARN fundamentally enables a broader array of interaction patterns for data stored in HDFS beyond MapReduce and makes Hadoop 2.0 a more general data processing platform.
Companies that already use Cascading, Lingual, Scalding or Cascalog, or any other dynamic programming language APIs and frameworks built on top of Cascading, can now migrate to newer versions of HDP that support Apache Tez, with zero investment required to take advantage of this improved processing environment.