Pages

05 October, 2016

Spot may soon fight cybercrime as an Apache project

Cloudera, the global provider of data management and analytics built on Apache Hadoop and open source technologies, has announced a proposal in collaboration with Intel to donate Spot to the Apache Software Foundation (ASF).

Apache Spot (incubating*), formerly called Open Network Insight (ONI), is a community-developed open source project started by Intel that aims to increase visibility into security threats by providing advanced threat detection using big data analytics and machine learning. By leveraging Apache Hadoop for infinite log management and data storage scale, and the Apache Spark data processing platform for machine learning and near real-time anomaly detection, organisations and cybersecurity application developers are unlocking new analytics functionality unmatched by previous applications. Apache Spot is also optimised for Cloudera Distribution Hadoop (CDH).

Spot allows organisations to detect unknown cyber threats more effectively. “The proposed donation of Spot to the Apache Software Foundation marks a momentous occasion for the cybersecurity industry and the project,” said Tom Reilly, CEO at Cloudera. “Our collaborations with leading organisations and the community at large is unlocking unprecedented analytic threat sharing capabilities.”

“The open source community is the perfect environment for Apache Spot to take a collective, peer-driven approach to fighting cybercrime,” said Ron Kasabian, VP and GM, Analytics & Artificial Intelligence Solutions Group at Intel. “The combined expertise of contributors will help further Apache Spot’s open data model vision and provide the grounds for collaboration on the world’s toughest and constantly evolving challenges in cybersecurity analytics.” Since Spot’s launch earlier this year, Intel, Cloudera and their collaborators, including Anomoli, Centrify, Cloudwick, Cybraics, eBay, Endgame, Jask, Streamsets and Webroot, have been building momentum behind the project as the community continues to rally behind the vision for Apache Spot:

● Comprehensive cybersecurity hub and open data models
Apache Hadoop gives organisations a single platform for collecting and managing all of their security data. Apache Spot leverages Hadoop and provides common open data models for network, endpoint, and user. These open data Models provide a standard format of enriched event data that makes it easier to integrate cross-application data to gain enterprise visibility and develop new analytic functionality.

● Collaboration on analytics
Cyber criminals collaborate all of the time; Apache Spot will help the security industry do the same. Leading cybersecurity data scientists have been contributing to Apache Spot and developing out of the box machine learning capabilities that allow organisations to discover abnormal and malicious behaviours using Apache Spark. Apache Spot’s open data models ensure that organisations will be able to quickly share new analytics with one another as new threats are discovered. Apache Hadoop further allows organisations to run these analytics against historic datasets, helping organisations identify past threats that have slipped through the cracks.

● Rich ecosystem
As cybersecurity applications continue to be built by enterprises and vendors in the space, Apache Spot will accelerate the development of these solutions, working with the strong community of partners already part of the Apache Spot effort. Leveraging Apache Spot as a cybersecurity analytics framework, organisations can spend more time building the analytics and visualisations that help discover cybercrime and less time building systems to ingest, integrate, store, and process any volume or variety of security data.

Interested?

Watch the video of Cloudera and Intel executives discussing Apache Spot (incubating)

*Incubation is the first step for a project to be considered an open source initiatives that is overseen by the ASF.

No comments:

Post a Comment