November 18, 2014
Hadoop is still a young technology and working with it can be difficult for enterprise organizations. To help alleviate the challenges, Concurrent has announced the latest version of Driven, a big data application performance-monitoring and management system.
Driven is purpose-built to address the challenges of enterprise application development and deployment for business-critical data applications, delivering control and performance management for enterprises seeking to achieve operational excellence.
As a company, Concurrent is mainly focused on app development and app management. Concurrent defines apps as business IPs that come together with the data and create a competitive advantage for how a business runs. Concurrent was initially founded around an open source framework called Cascading. The purpose of Cascading is to make it easier for users to build data oriented applications on top of Hadoop. Cascading has performed very well to the tune of 285,000 downloads per month.
Driven was spawned out of the need to manage many of applications that users created with Cascading on top of Hadoop.
When business users create these applications, many of the platforms for Hadoop do not offer performance management of the applications as they run. Driven is the tool that business users can apply to their applications to view its performance as it runs. According to Concurrent, these data pipelines can be thought of as supply chains. The output is the data product that an analyst or data scientist consumes at the end. “Driven is focused around the most minute detail. I can tune it at a very fine-grain level, but I can zoom back out and look at it from a specific application level,” explained Chris Wensel, founder and CTO of Concurrent.
The newest version of Driven includes a deeper visualization into data apps, a metadata repository, and new segmentation techniques. The deeper visualization allows users to debug, manage, monitor and search applications more effectively and in real time. The metadata repository is a scalable, searchable, and fine-grained metadata repository that easily captures end-to-end visibility of data applications. By having a complete history of the applications telemetry users are able view the applications performance since its inception. New segmentation support provides greater insights across all applications. Users have the ability to segment applications by tags, names, teams or organization, and easily track for general Hadoop utilization, SLA management or internal/external chargeback.