Network security intelligence integration big data analysis platform focuses on customer security service applications, with a harmonious society as the construction vision, collect various network data intelligently, integrate with various data resources from the third party, data management as a method, based on the three basic resource information databases including time, space, relationship and behavior, combine independent innovation algorithms and practical models, realizes the refinement from information to knowledge, depicts the character map deeply, perceives various security threats intelligently, constructs a secure big data fusion analysis system that integrates service process’s man-machine visualization and data comprehensive analysis.

The system includes data collection, data pre-processing, data storage and analysis, data application, and service visualization display.

Data collection layer: mainly for diversified data, labeling and categorizing all kinds of independent system data to ensure real-time, standardized and normalized of data collection.

Data pre-processing layer: Differentiate different types of data; remove abnormal data, remove duplicate data, and stream processing.

Data storage and analysis layer: Large-capacity TB, PB level data fast storage, fast hierarchical distribution storage and analysis.

Data application layer: through the combination of point and surface, construct a space-time stereoscopic architecture based on multi-data fusion, realize multi-source integration of data, multi-track joint control, multi-dimensional analysis, and maximize the value of data mining through multi-source data fusion.

Service visualization display layer: using computer graphics and image processing technology, realizing three-dimensional map stereoscopic display and dynamic large-screen real-time presentation, personnel portraits, relationship mining presentation, intelligent alarm and intelligent reminders.

Five data layers are interlocked, forming a big data security application system that can be pre-judged beforehand, responsive in the event, and excavated afterwards.

The network security intelligent integration big data analysis platform has the following advantages:

1) Advanced knowledge map and neural network technology: through access to real-time collected data and integration of multi-source data, greatly enhance the awareness of service, overall or local senses awareness, achieving comprehensive control, real-time response and prediction for abnormal situations.

2) Powerful calculation engine: With precise computing resource control, its key performance exceed 6 to 8 times of Storm, data calculation delay is optimized to seconds or even sub-seconds, and single job throughput can be achieved in millions (records/second) )level. It not only ensures the accuracy of data processing in various service scenarios, but also deeply integrates various cloud data storages without additional data integration work.

3) Excellent data service engine: Based on years of experience in the industry, the platform has innovatively developed a data service engine that can quickly extract valuable feature data from massive data and convert it into standard and trusted data through data governance.

4) Professional data analysis middleware: based on a deep understanding of the industry service, the platform embeds a large number of data analysis middleware, which can be flexible combined and overlay multiplexing, simplifying the service development process greatly.

5) Practical application of wisdom: the service application starts from the practical thinking and deeply studies the security technology and warfare method. It has formed a variety of wisdom applications that have practical significance and have been verified in many scenarios. After the platform is deployed, it can quickly exert its effectiveness, create safety value for customers.

6) Fast response to customer demand: based on the deep understanding of customer needs in the security industry and the powerful data analysis and mining capabilities provided by the platform, customized security applications can be developed according to the different needs of customers, launching service applications that meet customer’s needs quickly.