CN116566968A

CN116566968A - Distributed network data remote grabbing system based on cloud technology

Info

Publication number: CN116566968A
Application number: CN202310632342.4A
Authority: CN
Inventors: 潘圆; 吴志远; 谢虎; 李琳
Original assignee: Sino Telecom Technology Co inc
Current assignee: Sino Telecom Technology Co inc
Priority date: 2023-05-31
Filing date: 2023-05-31
Publication date: 2023-08-08

Abstract

The invention relates to a distributed network data remote grabbing system based on cloud technology, which comprises the following steps: at least one TAP device, the TAP device being installed at an outlet of the target network; each TAP device interacts with the cloud end through a control channel; each TAP device interacts with the restoring device through a service channel; the TAP equipment can access the Internet, the erection condition of the TAP equipment is loose, and the adoption of the cloud technology enables unified and centralized management of a large number of equipment and services to be possible, and the flexibility of the system is higher.

Description

Distributed network data remote grabbing system based on cloud technology

Technical Field

The invention relates to the technical field of communication, in particular to a distributed network data remote grabbing system based on cloud technology.

Background

A large number of data acquisition and analysis systems are widely applied in the fields of network security, network data analysis, criminal investigation security and the like. These systems typically include both software systems and hardware devices operating simultaneously. From the traditional data analysis platform to the remote data analysis platform, the acquisition and analysis of network data are very convenient and efficient. However, with the development of such fields, the target data volume and the kinds of access modes of the end users have been increased explosively. For an ever-increasing number of hardware platforms, and a large number of distributed systems, one of the following problems is how to maintain efficient management of these systems.

Disclosure of Invention

The invention aims to provide a distributed network data remote grabbing system based on cloud technology, which aims to solve the problems in the background technology.

In order to achieve the above purpose, the present invention provides the following technical solutions: a cloud technology-based distributed network data remote grabbing system, comprising: at least one TAP device, the TAP device being installed at an outlet of the target network; each TAP device interacts with the cloud end through a control channel; each TAP device interacts with the restoring device through a service channel; each of the TAP devices has access to the Internet.

Optionally, the cloud end is a device management platform, and performs unified management on the plurality of TAP devices, so as to realize one or more of device state viewing, target network related information viewing, and downstream access network user information viewing.

Optionally, the TAP device supports one or more of FTTX access mode and electrical ethernet line access mode, including but not limited to.

Optionally, the restoring device is provided with a plurality of groups of mirror image ports, and the target data collected by the restoring device is distributed to one or more third-party data analysis devices under the same network according to the requirement.

Optionally, the restoration device has a NAT function, allowing the migration of the actual network outlet of the target data from the target network to the network where the restoration device is located.

Optionally, the TAP device borrows a line under the target network, and the cloud reports a feature message, where the message includes basic information and verification information of the TAP device; and after the cloud terminal receives the characteristic message and passes verification, the cloud terminal starts to manage the TAP equipment.

Optionally, the cloud terminal remotely manages the online TAP device, when determining that the service data of the TAP device needs to be corresponding to the restore device, the cloud terminal distributes the data of the TAP device to the restore device corresponding to the TAP device, and in the whole process, the cloud terminal can manage the TAP device all the time.

Compared with the prior art, the invention has the beneficial effects that:

according to the distributed network data remote grabbing system based on the cloud technology, the TAP equipment is loose in erection condition, and the cloud technology is adopted, so that unified and centralized management of a large number of equipment and services becomes possible, and the flexibility of the system is higher.

Drawings

FIG. 1 is a flow chart of a control method of the present invention.

Detailed Description

In order to further describe the technical means and effects adopted by the present invention for achieving the intended purpose, the following detailed description will refer to the specific implementation, structure, characteristics and effects according to the present invention with reference to the accompanying drawings and preferred embodiments.

As shown in fig. 1, a distributed network data remote grabbing system based on cloud technology includes: at least one TAP device, the TAP device being installed at an outlet of the target network; each TAP device interacts with the cloud end through a control channel; each TAP device interacts with the restoring device through a service channel; each TAP device can access the Internet to realize data return.

The cloud end is a device management platform, the TAP device does not directly communicate with any restoring device in a default state, and instead, the TAP device communicates with the cloud end uniformly, the cloud end performs uniform management on a plurality of TAP devices, and one or more of device state checking, target network related information checking and downstream access network user information checking can be realized.

After the TAP equipment needs to confirm the network address of the corresponding remote network restoration equipment, the cloud end can play the role of an 'distributor', namely, the TAP equipment is distributed to the corresponding remote network restoration equipment for use by utilizing the confirmed address through a management channel; when the network address of the remote restoration device corresponding to the TAP device is changed, the TAP device can be subjected to corresponding configuration modification through the cloud again; when the remote restore device of the TAP device goes offline for various possible reasons, the TAP device may be recycled by the cloud for reassignment, as the cloud platform is always present.

The invention adopts a management channel and a service channel which are mutually separated. The management channel is a channel for carrying out bidirectional communication between the TAP equipment and the cloud; the service channel is a channel in which the TAP device transmits data of the target network to the restoration device, and a channel in which the restoration device reinjects the data to the target network. The invention can realize the effect of separating management from service, so that the remote network restoration device can concentrate on and process the received data without performing management operation on the front end, and the cloud end can concentrate on managing all TAP devices without concern about huge service flow. The invention has great flexibility, and the management channel and the service channel can be essentially shared so as to be compatible with the traditional distributed mode.

The TAP device supports one or more of FTTX access mode and electrical ethernet lines for different end user access types, including but not limited to.

The restore device serves to aggregate and distribute large amounts of target data while still supporting remote management of the TAP device. The reduction equipment is provided with a plurality of groups of mirror image ports, and target data collected by the reduction equipment can be distributed to one or more third-party data analysis equipment under the same network according to the need. The restoration device has NAT function, which allows the migration of the actual network outlet of the target data from the target network to the network where the restoration device is located.

The TAP equipment borrows a line under a target network, and the cloud reports a characteristic message which contains basic information and verification information of the TAP equipment; and after the cloud terminal receives the characteristic message and passes verification, the cloud terminal starts to manage the TAP equipment.

The cloud terminal remotely manages the on-line TAP equipment, when determining that the service data of the TAP equipment needs to correspond to the restoration equipment, the cloud terminal distributes the data of the TAP equipment to the restoration equipment corresponding to the TAP equipment, and in the whole process, the cloud terminal can manage the TAP equipment all the time.

The extremely high compatibility of the hardware equipment can meet most application scenes, reduces the compatibility expenditure and complexity of the system, and realizes the complete separation of service logic and the type of the target network. Secondly, the erection cost and difficulty of the TAP equipment and the network restoration equipment benefit from the line type self-adaption, the automatic adjustment of the light path attenuation and the user line multiplexing technology, and the cost and difficulty are greatly reduced. Most importantly, due to the adoption of the cloud, unified and centralized management of a large number of devices and services becomes possible, so that the system has stronger flexibility.

The present invention is not limited to the above embodiments, but is capable of modification and variation in detail, and other modifications and variations can be made by those skilled in the art without departing from the scope of the present invention.

Claims

1. A cloud technology-based distributed network data remote Cheng Zhuaqu system, comprising:

at least one TAP device, the TAP device being installed at an outlet of the target network;

each TAP device interacts with the cloud end through a control channel;

each TAP device interacts with the restoring device through a service channel;

each of the TAP devices has access to the Internet.

2. The cloud technology-based distributed network data remote Cheng Zhuaqu system of claim 1, wherein the cloud is a device management platform for unified management of a plurality of TAP devices, and implementation includes, but is not limited to, one or more of device status viewing, target network related information viewing, and downstream access network user information viewing.

3. A cloud technology based distributed network data remote Cheng Zhuaqu system according to claim 2, wherein the TAP device supports one or more of FTTX access mode and access mode in an electrical ethernet line.

4. The cloud technology-based distributed network data remote Cheng Zhuaqu system according to claim 3, wherein the restoration device is provided with a plurality of groups of mirror image ports, and target data collected by the restoration device are distributed to one or more third-party data analysis devices under the same network as required.

5. The cloud technology based distributed network data management system Cheng Zhuaqu of claim 4, wherein said restore device has NAT functionality allowing the migration of the actual network egress of the target data from the target network to the network where the restore device is located.

6. The cloud technology-based distributed network data remote Cheng Zhuaqu system according to claim 5, wherein the TAP device borrows a line under a target network, and the cloud reports a characteristic message, wherein the message contains basic information and verification information of the TAP device;

and after the cloud terminal receives the characteristic message and passes verification, the cloud terminal starts to manage the TAP equipment.

7. The cloud technology-based distributed network data remote Cheng Zhuaqu system of claim 6, wherein the cloud terminal remotely manages the TAP devices online, and when determining that the corresponding restore devices are needed for the service data of the TAP devices, the cloud terminal distributes the data of the TAP devices to the corresponding restore devices, and in the whole process, the cloud terminal can manage the TAP devices all the time.