CN115640114A - Migration method and device of data acquisition equipment and server - Google Patents

Migration method and device of data acquisition equipment and server Download PDF

Info

Publication number
CN115640114A
CN115640114A CN202110814723.5A CN202110814723A CN115640114A CN 115640114 A CN115640114 A CN 115640114A CN 202110814723 A CN202110814723 A CN 202110814723A CN 115640114 A CN115640114 A CN 115640114A
Authority
CN
China
Prior art keywords
data
storage node
time period
node
message
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202110814723.5A
Other languages
Chinese (zh)
Inventor
单如俊
陈伟洪
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Huawei Technologies Co Ltd
Original Assignee
Huawei Technologies Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Huawei Technologies Co Ltd filed Critical Huawei Technologies Co Ltd
Priority to CN202110814723.5A priority Critical patent/CN115640114A/en
Publication of CN115640114A publication Critical patent/CN115640114A/en
Pending legal-status Critical Current

Links

Images

Landscapes

  • Information Retrieval, Db Structures And Fs Structures Therefor (AREA)

Abstract

A migration method, a migration device and a migration server of data acquisition equipment are used for ensuring the integrity of data acquired by the data acquisition equipment in the migration process of the data acquisition equipment. The method of the embodiment of the application comprises the following steps: when the first storage node receives and stores the data acquired by the data acquisition equipment, the management node sends a first notification message to the second storage node, wherein the first notification message is used for indicating the second storage node to receive and store the data acquired by the data acquisition equipment; the management node receives a second notification message from the second storage node, wherein the second notification message is used for indicating that the second storage node stores the data acquired by the data acquisition equipment; and the management node responds to the second notification message and sends a third notification message to the first storage node, wherein the third notification message is used for indicating the first storage node to disconnect the data transmission connection with the data acquisition equipment.

Description

Migration method and device of data acquisition equipment and server
Technical Field
The embodiment of the application relates to the field of communication, in particular to a migration method and device of data acquisition equipment and a server.
Background
In recent years, the development of the clustering technology is promoted by the explosive increase of the user quantity and the data quantity, and the clustering technology is gradually used by most media platforms. Clusters generally interconnect two or more independent nodes (e.g., servers) through corresponding hardware and software, and cooperatively provide services such as application programs, system resources, data and the like to users, thereby greatly improving the scalability and usability of multimedia platforms.
When a certain node in the cluster is overloaded, part of the services running on the node need to be migrated to other nodes with lighter loads. In the prior art, the migration of the service is performed in a fast reestablishment manner, that is, a certain service on a node with a heavy load is firstly turned off, and then the service is quickly restarted on another node with a light load. For example, a node a in a cluster is connected to at least one network camera, the node a executes a storage service on a code stream acquired by the network camera connected to the node a, when a load of the node a is greater than a threshold value, the cluster first controls the node a to disconnect from the network camera 1, the node a stops receiving the code stream acquired by the network camera 1, the connection between the network camera 1 and the cluster is interrupted, then the cluster controls a node B to connect to the network camera 1, and the node B receives and stores the code stream acquired by the network camera 1.
In the prior art, even if the service can be quickly rebuilt at other nodes, the service is still temporarily interrupted, so that data is lost during interruption.
Disclosure of Invention
The embodiment of the application provides a migration method and device of data acquisition equipment and a server, which are used for ensuring that data acquired by the data acquisition equipment is not lost in the migration process of the data acquisition equipment.
A first aspect of the embodiments of the present application provides a migration method for a data acquisition device, including:
when the first storage node receives and stores the data acquired by the data acquisition equipment, the management node sends a first notification message to the second storage node, wherein the first notification message is used for indicating the second storage node to receive and store the data acquired by the data acquisition equipment; the management node receives a second notification message from the second storage node, wherein the second notification message is used for indicating that the second storage node stores the data acquired by the data acquisition equipment; and the management node responds to the second notification message and sends a third notification message to the first storage node, wherein the third notification message is used for indicating the first storage node to disconnect the data transmission connection with the data acquisition equipment.
The data received by the first storage node from the data acquisition equipment is first data, and the data received by the second storage node from the data acquisition equipment is second data; the first acquisition time period of the first data partially coincides with the second acquisition time period of the second data, the first data and the second data being partially identical.
Therefore, before the data acquisition equipment is migrated from the first storage node to the second storage node, the management node firstly sends a first notification of accessing the data acquisition equipment to the second storage node, so that the second storage node is accessed to the data acquisition equipment and receives and stores data sent by the data acquisition equipment. After the second storage node is determined to store the data from the data acquisition equipment, the first storage node is informed to disconnect the data transmission connection with the data acquisition equipment, so that data loss caused by connection interruption between the data acquisition equipment and the cluster due to migration is avoided in the migration process of the data acquisition equipment, and the data from the data acquisition equipment stored in the cluster is complete.
After the data acquisition equipment is migrated to the second storage node, first data acquired by the data acquisition equipment in a first acquisition time period is stored in the first storage node, and second data acquired in a second acquisition time period is stored in the second storage node. In the time period that the data acquisition equipment sends data to the second storage node and the connection between the data acquisition equipment and the first storage node is disconnected, the data acquisition equipment sends the acquired data to the first storage node and the second storage node at the same time, the first acquisition time period is partially overlapped with the second acquisition time period of the second data, and the first data and the second data are partially identical.
In some optional embodiments, after the management node sends the third notification message to the first storage node in response to the second notification message, the method further includes:
the method comprises the steps that a management node receives a data acquisition message sent by a client, the data acquisition message is used for requesting to acquire data acquired by data acquisition equipment in a target time period, the target time period comprises a superposition time period, and the superposition time period is a time period superposed between a first acquisition time period and a second acquisition time period; the management node sends an indication message to the client, the indication message is used for indicating the client to acquire third data from the first storage node or acquire fourth data from the second storage node, the third data and the fourth data are acquired by the data acquisition equipment in a coincidence time period, and the third data and the fourth data are the same.
As can be seen, since the third data and the fourth data stored in the first storage node and the second storage node are the same, when the target time period requested by the client includes the overlapping time period, if the data sent to the client by the first storage node and the second storage node includes the repeated data, the phenomenon of pause and repetition may occur when the client plays the data. The management node thus issues an indication message to the client to instruct the client to retrieve the duplicate portion of data from one of the first storage node and the second storage node, thereby avoiding the second storage node and the first storage node from repeatedly sending the same data to the client.
In some optional embodiments, after the management node sends the third notification message to the first storage node in response to the second notification message, the method further includes: the method comprises the steps that a management node receives a data acquisition message sent by a client, wherein the data acquisition message is used for requesting to acquire data acquired by data acquisition equipment in a target time period, the target time period comprises a superposition time period, and the superposition time period is a time period superposed between a first acquisition time period and a second acquisition time period; the management node sends an indication message to the client, the indication message is used for indicating the client to acquire fifth data from the first storage node and acquire sixth data from the second storage node, the fifth data and the sixth data are both part of coincident data, the coincident data is data acquired by the data acquisition equipment in a coincident time period, the fifth data and the sixth data are completely or partially different, and the fifth data and the sixth data can be spliced into coincident data.
As can be seen, the management node may further control the client to obtain a part of the overlapped data from each of the first storage node and the second storage node through the indication message, so that the client obtains complete and non-overlapped data from the first storage node and the second storage node.
In some optional embodiments, after sending the third notification message to the first storage node according to the second notification message, the method further includes: the management node sends a first updating message to the data service node, wherein the first updating message is used for indicating the data service node to record the incidence relation among the second storage node, the data acquisition equipment and the second acquisition time period; and the management node sends a second updating message to the data service node, wherein the second updating message is used for indicating the data service node to update the association relation among the first storage node, the data acquisition equipment and the first acquisition time period.
Therefore, the management node updates and maintains the association among the storage nodes, the data acquisition equipment and the acquisition time in the migration process of controlling the data acquisition equipment, so that when a subsequent client initiates a data acquisition request to the management node, the management node can know which storage nodes the data required by the client is stored in, and the client can be accurately instructed to request the corresponding storage nodes to acquire the data of the data acquisition equipment.
In some optional embodiments, the data acquisition device is a webcam and the data is a video stream.
Therefore, for data such as video streams with strict requirements on data time sequence and data integrity, the method provided by the embodiment of the application can ensure that the data acquired by the network camera is completely stored.
In some optional embodiments, the method further comprises: and the management node removes repeated data from the first video stream and the second video stream and splices the repeated data to form a time-coherent video stream.
Therefore, the video streams stored by the first storage node and the second storage node can be spliced into a continuous video in time, and the situation that the network camera switches the storage nodes to cause frame loss can not occur. When the target time period requested by the client comprises the coincidence time period, the management node performs deduplication and splicing on the repeated data, and can instruct the client to acquire a coherent and smooth video stream.
In the process of migrating the network camera, the network camera is not connected with any node, so that the video stream is interrupted.
In some optional embodiments, the management node, the second storage node, and the first storage node are any one of a container, a virtual machine, a network video recorder, or a storage server, respectively.
A second aspect of the embodiments of the present application provides a migration apparatus for data acquisition equipment, including:
the sending unit is used for sending a first notification message to the second storage node when the first storage node receives and stores the data acquired by the data acquisition equipment, wherein the first notification message is used for indicating the second storage node to receive and store the data acquired by the data acquisition equipment; the receiving unit is used for receiving a second notification message from the second storage node, wherein the second notification message is used for indicating that the second storage node stores the data acquired by the data acquisition equipment; and the sending unit is further configured to send a third notification message to the first storage node, where the third notification message is generated in response to the second notification message, and the third notification message is used to instruct the first storage node to disconnect the data transmission connection with the data acquisition device.
The data received by the first storage node from the data acquisition equipment is first data, and the data received by the second storage node from the data acquisition equipment is second data; the first acquisition time period of the first data partially coincides with the second acquisition time period of the second data, the first data and the second data being partially identical.
In some optional embodiments, the receiving unit is further configured to receive a data acquisition message sent by the client, where the data acquisition message is used to request to acquire data acquired by the data acquisition device in a target time period, the target time period includes a coincidence time period, and the coincidence time period is a time period in which the first acquisition time period and the second acquisition time period coincide with each other; the sending unit is further configured to send an indication message to the client, where the indication message is used to indicate the client to acquire third data from the first storage node or acquire fourth data from the second storage node, the third data and the fourth data are data acquired by the data acquisition device in a coincidence time period, and the third data and the fourth data are the same.
In some optional embodiments, the receiving unit is further configured to receive a data acquisition message sent by the client, where the data acquisition message is used to request to acquire data acquired by the data acquisition device in a target time period, the target time period includes a coincidence time period, and the coincidence time period is a time period in which the first acquisition time period and the second acquisition time period coincide with each other; the sending unit is further configured to send an indication message to the client, where the indication message is used to indicate the client to acquire fifth data from the first storage node and sixth data from the second storage node, the fifth data and the sixth data are both part of coincidence data, the coincidence data is data acquired by the data acquisition device in a coincidence time period, the fifth data and the sixth data are completely or partially different, and the fifth data and the sixth data can be spliced into the coincidence data.
In some optional embodiments, the sending unit is further configured to send a first update message to the data service node, where the first update message is used to instruct the data service node to record an association relationship among the second storage node, the data acquisition device, and the second acquisition time period; and the sending unit is further used for sending a second updating message to the data service node, wherein the second updating message is used for indicating the data service node to update the association relationship among the first storage node, the data acquisition equipment and the first acquisition time period.
In some alternative embodiments, the data is a video stream.
In some optional embodiments, the first data is a first video stream, the second data is a second video stream, and the apparatus further comprises: and the duplication removing unit is used for removing duplication data from the first video stream and the second video stream and splicing the first video stream and the second video stream to form a time-coherent video stream.
In some alternative embodiments, the device is any one of a container, a virtual machine, a network video recorder, or a storage-type server.
A third aspect of the embodiments of the present application provides a server, including a processor and a memory; the memory may be a transient storage memory or a persistent storage memory; the processor is configured to communicate with the memory and to execute the operations of the instructions in the memory to perform the method of the first aspect or the optional embodiments of the first aspect.
A fourth aspect of embodiments of the present application provides a computer-readable storage medium, including instructions, which, when executed on a computer, cause the computer to perform the method of the first aspect or the optional implementation manner of the first aspect.
Drawings
Fig. 1 is a schematic structural diagram of an embodiment of a cluster system provided in the present application;
fig. 2 is a schematic flowchart of a first embodiment of a migration method of a data acquisition device provided in the present application;
FIG. 3 is a schematic flow chart diagram illustrating a second embodiment of a migration method for a data collection device provided in the present application;
fig. 4 is a schematic structural diagram of a first embodiment of a migration apparatus of a data acquisition device provided in the present application;
fig. 5 is a schematic structural diagram of an embodiment of a server provided in the present application.
Detailed Description
The embodiment of the application provides a migration method and a migration device for data acquisition equipment, which are used for completely storing data acquired by the data acquisition equipment in the process of switching nodes for storing the data by the data acquisition equipment.
First, a cluster system to which the technical solution of the present application is applied is introduced. As shown in fig. 1, fig. 1 is a schematic structural diagram of an embodiment of a cluster system provided in the present application, where a cluster system 100 in the embodiment of the present application includes at least two nodes 101, and each node is connected to at least one data acquisition device 102. It can be understood that the number of the nodes 101 and the data acquisition devices 102 in fig. 1 is only an example, the number of the nodes 101 may be 2 or more, and the number of the nodes 101 in practical application may also be dynamically expanded or contracted according to requirements, which is not limited in this application.
The node 101 may be a physical node such as a network video recorder or a storage server, or may be a virtual node such as a virtual machine or a container. Node 101 includes a processor and memory, and thus has computing and memory capabilities. The processor comprises at least one of a central processor, a graphic processor and the like. The memory comprises a hard disk, the hard disk can be a solid state disk, a mechanical hard disk or other types of hard disks, and the hard disk is used for storing data acquired by the data acquisition equipment.
The data acquisition device 102 may be a webcam, a microphone, a camera, or the like. The data collection device 102 has a communication function, and is capable of establishing a communication connection with at least one node 101 in the cluster system 100 in a wired or wireless manner, and transmitting collected data to the corresponding node 101 through the communication connection. After receiving the data from the data acquisition device, the node 101 stores the data locally. The data may be a video stream, an audio stream, or a picture, among others.
Nodes 101 in cluster system 100 may be functionally divided into storage nodes 1011 and data service nodes 1012. The storage node 1011 is connected to at least one data acquisition device 102 and stores data from the data acquisition device 102. The data service node 1012 is used to store the association information and status information of each storage node in the cluster system 100. The association information includes an association mapping relationship between each storage node 1011, the data acquisition device 102, and data, and the like. The status information may be reported periodically to the data service node 1012 by each storage node 1011 in the cluster system 100 through a heartbeat channel, and the status information includes, for example, the survival status of the storage node 1011, the usage of various resources (a central processing unit, a graphics processing unit, a storage space, a bandwidth, or the like), and the like.
The data service node 1012 may be deployed in the cluster system 100 as an independent node, or may be deployed in combination with the storage node 1011. In other words, one or more of the storage nodes 1011 assume the role of the data service node 1012.
The cluster system 100 runs a management service, and the management service has a scheduling function, and is specifically used for managing scaling and load balancing of the nodes 101 in the cluster system 100. The management service may be deployed on one or more nodes 101 in the cluster system 100. The management service may be deployed in the storage node 1011 or the data service node 1012. When the node 101 running the management service is heavily loaded or down, the management service may also drift to other nodes 101 to continue running.
The management service may periodically or aperiodically obtain the latest status information of each storage node 1011 from the data service node 1012 and calculate the load status of each storage node 1011 according to the status information. When there is a storage node 1011 load exceeding the threshold, the management service performs a load balancing operation on the storage node 1011.
A storage node 1011 load exceeding a threshold may indicate that one or more of the bandwidth, processor, and memory space of the storage node 1011 are scarce. The resource shortage of the storage node 1011 is mainly caused by, for example, a large number of data acquisition devices 102 connected thereto, which causes a bandwidth resource shortage, or a high code rate, a high resolution, a long data retention period and the like of data transmitted to the storage node by the data acquisition devices 102, which causes a processor and a storage space shortage.
Thus, the management service may achieve load balancing by migrating one or more data collection devices 102 connected to that storage node 1011 to other storage nodes 1011 in the cluster system 100. The term "migration" in this embodiment refers to switching the storage node 1011 connected to the data acquisition device 102 to change the storage node 1011 storing data acquired subsequently by the data acquisition device 102.
With reference to the cluster system 100, the data collected by the data collection device 102 is not lost in the migration process of the data collection device 102 according to the following embodiments.
Fig. 2 is a schematic flow chart of a first embodiment of a migration method of a data acquisition device provided in the present application, where the present embodiment includes the following steps:
201: when the first storage node receives and stores the data acquired by the data acquisition equipment, the management node sends a first notification message to the second storage node, wherein the first notification message is used for indicating the second storage node to receive and store the data acquired by the data acquisition equipment.
The management node is a node deployed by the management service. When the management service is deployed in the first storage node, the management node and the first storage node are the same node; when the management service is deployed in the second storage node, the management node and the second storage node are the same node. But the first storage node is not the same node as the second storage node. When the management service is deployed on other nodes except the first storage node, the management node and the first storage node are different nodes; when the management service is deployed on other nodes except the second storage node, the management node and the second storage node are different nodes.
The management node is used for responding to the detection that the load of the first storage node exceeds a threshold value, determining a data acquisition device to be migrated from the data acquisition devices connected with the first storage node, and then sending a first notification message to the second storage node. The first notification message is used for instructing the second storage node to receive and store the data collected by the data collection device.
Specifically, the first notification message carries device identification information and authentication information of the data acquisition device. The device identification information includes, for example, at least one of a device number, an IP address, a port number, and a media access control address (MAC). The authentication information includes, for example, a user name and a password. And the second storage node initiates a connection request to the data acquisition equipment according to the equipment identification information, wherein the connection request carries the user name and the password. And the data acquisition equipment authenticates the user name and the password, and after the user name and the password are authenticated to be legal, the data acquisition equipment sends an authentication success notice to the second storage node so as to establish the connection between the data acquisition equipment and the second storage node.
And the second storage node responds to the authentication success notice and sends a flow fetching request to the data acquisition equipment. The streaming request includes parameters such as a channel number and a data type. And after receiving the stream taking request, the data acquisition equipment sends the acquired data to the second storage node according to the parameters in the stream taking request.
At this time, the data acquisition device and the first storage node are still in a connected state, and the first storage node is still receiving the data acquired from the data acquisition device and storing the data.
202: the management node receives a second notification message from the second storage node, wherein the second notification message is used for indicating that the second storage node stores the data collected by the data collection device.
Wherein the second notification message is generated by the second storage node in response to data sent by the stored data collection device. The second notification message may include at least one of device identification information of the data acquisition device, acquisition time corresponding to the first frame of data acquired by the data acquisition device and stored in the second storage node, a storage address of the data acquired by the data acquisition device, a code rate, a resolution, a data type, a retention period, and the like.
And after the second storage node generates a second notification message, the second notification message is sent to the management node.
The management node determines that the second storage node has started to store the first data from the data acquisition device according to the second notification message. That is, at this time, the second storage node and the first storage node both receive and store the data acquired by the data acquisition device.
The second storage node receives and stores the data of the data acquisition equipment and then notifies the management node, so that the second storage node can store the data of the data acquisition equipment, and the situation that the data is lost due to power failure and downtime because the data is not written into a hard disk of the second storage node after the second storage node sends the second notification to the management node can be avoided. Of course, the second storage node may also send the second notification message to the management node after receiving the data of the storage data acquisition device, so as to improve the migration efficiency of the data acquisition device, which is not limited in this application.
203: and the management node responds to the second notification message and sends a third notification message to the first storage node, wherein the third notification message is used for indicating the first storage node to disconnect the data transmission connection with the data acquisition equipment.
And after the management node determines that the second storage node stores the data of the data acquisition device based on the second notification message, the management node sends a third notification message to the first storage node. And the first storage node disconnects the data transmission connection with the data acquisition equipment according to the third notification message, does not receive and store the data acquired by the data acquisition equipment any more, and completes the migration of the data acquisition equipment.
The data received by the first storage node from the data acquisition device is first data, and the data received by the second storage node from the data acquisition device is second data. The first storage node is disconnected from the data acquisition device after the second storage node stores the data acquired by the data acquisition device, so that the first acquisition time period of the first data partially coincides with the second acquisition time period of the second data. The time period of coincidence between the first acquisition time and the second acquisition time is a coincidence time period. The first data and the second data are partially the same, and the same data between the first data and the second data is acquired by the data acquisition equipment in the overlapping time period. Specifically, the two endpoint times of the first acquisition time period are a first start time and a first end time respectively, and the two endpoint times of the second acquisition time period are a second start time and a second end time respectively. The first start time is the acquisition time corresponding to the first frame data in the first data stored in the first storage node, and the first end time is the acquisition time corresponding to the last frame in the first data stored in the first storage node. The second starting time is the acquisition time corresponding to the first frame data in the second data stored by the second storage node. Because the data acquisition device is in a connected state with the second storage node, the first termination time may be the current time or the acquisition time corresponding to the last frame of second data stored in the second storage node. It is to be understood that the first frame of data is a frame of data of the first data or the second data with the earliest collection time, and the last frame of data is a frame of data of the first data or the second data with the latest collection time.
It should be noted that, in the embodiment of the present application, the first data and the second data refer to data acquired by the same data acquisition device at different time periods. The data type, the acquisition method and the like of the first data and the second data are the same, and the first data and the second data can be spliced according to the acquisition time sequence.
In this embodiment, a data acquisition device is taken as a network camera, and data is taken as a video stream. For example, the network camera is connected to the first storage node in advance, and the first storage node stores 12:00: video streams captured since 00. When the load of the first storage node exceeds a threshold value, the management node determines to migrate the network camera to a second storage node, the second storage node is connected with the network camera and stores the video stream of the network camera, and the network camera is disconnected from the first storage node. Firstly, the management node sends a first notification message to the second storage node, so that the second storage node establishes connection with the network camera according to the first notification message, and receives 12 th of the network camera from 2021, 6, 2, of the network camera: 00:00 video stream collected in real time and storing the video stream. At this time, the data stream collected by the network camera is simultaneously sent to the second storage node and the first storage node, and the second storage node and the first storage node both store the video stream. After the second storage node stores the video stream data, a second notification message is fed back to the management node to notify the management node that the second storage node has started to store the video stream. And the management node responds to the second notification message and then sends a third notification message to the first storage node to indicate the first storage node to disconnect from the network camera. The first storage node disconnects the network camera according to the third notification message, so as to stop receiving and storing the video stream subsequently acquired by the network camera, and the time of the last frame of the video stream of the network camera stored by the first storage node is 12/6/2/2021: 05:00. the network camera stored in the second storage node is 12:00:00 as a second video stream, and storing, by the first storage node, a target network camera in a location 12 in 2021, 5, month 1, or: 00: year 00 to 2021, 6 month 2 day 12:05:00 as the first video stream. Target webcam in 2021, 6 month, 2 day 12:00: 6/month 2/day 12 from 00 to 2021: 05: and storing the video stream acquired in the time of 00 by the second storage node and the first storage node, wherein the time is a coincidence time period. And the video stream acquired by the target network camera in the coincidence time period is a coincidence data stream and is stored by the second storage node and the first storage node. It can be seen that, in the process of migrating the target network camera, the video stream collected by the target network camera is always stored by at least one node, and the video stream is completely stored.
According to the embodiment of the application, before the data acquisition equipment is migrated from the first storage node to the second storage node, the first notification message for receiving and storing the data acquired by the data acquisition equipment is sent to the second storage node, so that the second storage node is connected with the data acquisition equipment and receives and stores the data sent by the data acquisition equipment. After determining that the second storage node has received the data from the data acquisition device, the management node notifies the first storage node to disconnect the data transmission connection with the data acquisition device, and the first storage node no longer receives the data of the data acquisition device. The data acquisition equipment always sends data to at least one of the second storage node and the first storage node in the process, so that data loss caused by no connection with any node can be avoided in the process of switching the data storage nodes by the data acquisition equipment, and the data acquired by the data acquisition equipment can be completely stored.
When a client requests a cluster to acquire target data of a data acquisition device for playing, if the target data sent by the cluster to the client includes coincident data, a video, an image or an audio played by the client is repeated and unsmooth. Therefore, deduplication processing is required for the coincident data. The client may be a browser/server (B/S) client or a client/server (CS) client. The client may retrieve the data, decode the data and play it through a display, monitor, speaker, or the like.
There are various ways to deduplicate the repeated data, for example, the cluster or the client may perform deduplication on the coincidence time corresponding to the repeated data, or the cluster deletes the repeated data stored in the cluster. The specific implementation mode is as follows:
1. the management node performs duplication removal on the coincidence time
Fig. 3 is a schematic flowchart of a second embodiment of a migration method of a data acquisition device provided in the present application, where the present embodiment includes the following steps:
301: when the first storage node receives and stores the data acquired by the data acquisition equipment, the management node sends a first notification message to the second storage node, wherein the first notification message is used for indicating the second storage node to receive and store the data acquired by the data acquisition equipment.
302: the management node receives a second notification message from the second storage node, wherein the second notification message is used for indicating that the second storage node stores the data collected by the data collection device.
303: and the management node responds to the second notification message and sends a third notification message to the first storage node, wherein the third notification message is used for indicating the first storage node to disconnect the data transmission connection with the data acquisition equipment.
Steps 301 to 303 refer to the first embodiments 201 to 203 of the migration method of the data acquisition device, and therefore are not described herein again.
304: and the management node receives a data acquisition message sent by the client.
The data acquisition message is used for requesting to acquire data acquired by the data acquisition equipment in a target time period so as to play the data and the like.
The data acquisition message comprises equipment identification information of the data acquisition equipment and a target time period. And the management node acquires the node for storing the data acquired by the data acquisition equipment in the target time period according to the equipment identification information and the target time period. In this embodiment, the target time period includes a coincidence time period.
305: the management node sends an indication message to the client.
Because the target time period comprises the coincidence time period, the data (namely coincidence data) acquired by the data acquisition equipment in the coincidence time period is stored in the first storage node and the second storage node, and in order to avoid the client from acquiring repeated data, the management node sends an indication message to the client. The indication message is used for indicating the client to acquire the coincident data from the second storage node and/or the first storage node so as to avoid the client acquiring repeated data from the cluster.
The data acquisition device is taken as a network camera, and the data is exemplified as a video stream. The first data is a first video stream and the second data is a second video stream. Repeated video frames are included between the first video stream and the second video stream. The management node needs to perform an operation of removing duplicate video frames from the first video stream and the second video stream, so that the video streams obtained by the client are complete and coherent, and neither video frame is lost nor redundant video frames are duplicated.
The generation process of the indication message is as follows:
in particular, the management node may send a query request to the data serving node. The query request carries the device identification information and the target time period to indicate which node the data acquired by the data acquisition device corresponding to the data service node query device identification information in the target time period is stored in.
The data service node determines that the node connected with the data acquisition equipment has a first storage node and a second storage node in the association mapping table according to the equipment identification information, determines that the first storage node stores first sub-target data acquired by the data acquisition equipment in a first sub-target time period according to the target time period, and stores second sub-target data acquired by the data acquisition equipment in a second sub-target time period. The first sub-goal time period is a time period formed from a goal starting time to a first ending time of the goal time period. The second sub-target time period is a time period from the second start time to the target end time of the target time period. The first sub-goal period and the second sub-goal period each include a coincidence period. The first sub-target data and the second sub-target data each include coincidence data. The coincidence data stored in the first storage node is third data, and the coincidence data stored in the second storage node is fourth data.
The association mapping table specifically stores association mapping relations among the storage nodes, the data acquisition equipment and acquisition time periods corresponding to data stored by the storage nodes.
The association mapping table stores not only the association mapping between a node and a data acquisition device which is connected with the node but also the association mapping between data acquisition devices which are connected with the node but disconnected from the node. Therefore, the migration track of the data acquisition equipment, nodes where the data of the data acquisition equipment is stored, and nodes where the data acquired by the data acquisition equipment in which time period is stored can be obtained based on the associated mapping table.
For example, a description is given by taking a data acquisition device as a network camera and a node as a storage server, where the association mapping table is shown in table 1. It should be noted that table 1 is only an example and is not intended to limit the present application. For example, the association mapping table includes fields such as a storage server, a network camera, a recording start time, and a recording end time. The video recording starting time and the video recording ending time are two endpoint times of the data acquisition time period. The video recording starting time is the acquisition time corresponding to the first frame of video image of the network camera stored in the node, and the video recording ending time is the acquisition time corresponding to the last frame of video image of the network camera stored in the node. In table 1, the video termination time is "0" to indicate that the storage server is not disconnected from the corresponding network camera when looking up table 1, and still receives and stores the video stream from the network camera, although other values or characters such as "1" may be used for representing the video stream, which is not limited in this application. Based on table 1, it can be derived that the network camera 1 is migrated as a data collecting apparatus from the storage server a (second storage node) to the storage server B (first storage node). The storage server a stores 12 of the network camera 1 in 2021, 5, month 1:00 to 2021 year 6, month 2, day 12:05, 00, and the webcam 2 was, in 2021, 5, month 1, day 12: 00. The storage server B stores the network camera 3 in the file 12 in 2021, 5, month 1, and day 12:00, to the current moment, and the network camera 1, from 2021, 6, month, 2, 12: 00.
When the device identifier in the data acquisition message is 1 and the target time period is 11 in 6 months and 2 days in 2021 and 13 in 6 months and 2 days in 2021, the data service node queries the data of the storage server a and the storage server B in the association mapping table, wherein the data of the network camera 1 is stored in the storage server a and the storage server B. The data service node compares the target time period with the video recording start time and the video recording end time of the video stream stored in the storage server a by the network camera 1, and the video recording start time and the video recording end time of the video stream stored in the storage server B by the network camera 1, so that the data service node can obtain that the storage server a stores 12 of the video stream of the network camera 1 in 2021, 6, 2:00 to 2021 year 6, month 2, day 12:05, 00, and the storage server B stores 12 of the network camera 1 in 2021, 6 months and 2 days: 00 to 2021 year 6 month 2 day 13. Year 2021, 6 month 2 day 11:00 to 2021 year 6, month 2, day 12:05:00 to 2021, 6 month, 2 day 13. Year 2021, 6 month 2 day 12:00 to 2021 year 6, month 2, day 12: 05.
TABLE 1 Association mapping table
Figure BDA0003169600800000101
The information in the association mapping table may be updated by the control of the management node or by the data service node itself. The specific updating process is as follows:
a. management node updating association mapping table
And the management node controls the addition and the closing of the nodes in the cluster and the scheduling of the migration of the data acquisition equipment connected with the nodes. Therefore, the management node can timely know the change conditions of the node and the data acquisition equipment, so that the associated mapping table in the data service node can be timely and quickly updated.
The management node can determine the scheduling completion conditions and scheduling completion moments of the nodes and the data acquisition equipment through the notification messages fed back by the nodes in the scheduling process, so as to update the association mapping table.
For example, the second notification message includes a first start time of the data acquisition device received by the second storage node. And the management node generates a first updating message according to the second notification message and sends the first updating message to the data service node. The first update message includes node identification information of the second storage node, device identification information of the data acquisition device, and a second start time, so as to indicate the data service node to record an association relationship among the second storage node, the data acquisition device, and the second acquisition time, thereby updating the association mapping table, and keeping the association relationship between the node in the association mapping table and the data acquisition device consistent with the actual association relationship.
After the first storage node is disconnected from the data acquisition device, a fourth notification message can be sent to the management node. The fourth notification message may carry identification information of the data acquisition device and the first termination time. And the management node generates a second updating message according to the fourth notification message and sends the second updating message to the data service node. The second update message includes node identification information of the first storage node, device identification information of the data acquisition device, and a first termination time, so as to indicate the data service node to record the first termination time in a corresponding field in the association mapping table according to the second update message, so as to associate the first storage node, the data acquisition device, and the first acquisition time period.
b. Data service node updating association mapping table
Specifically, when the connection state between the node and the data acquisition device changes, the node may report a state change message to the data service node, so that the data service node updates the association mapping table according to the state change message. In this case, the management node is not required to send an update message to the data service node.
For example, the second storage node sends the first state change message to the data service node after the second start time of acquiring the data of the data acquisition device. The first state change message includes node identification information of the second storage node, device identification information of the data acquisition device, the second start time, and the like. The data service node associates the second storage node with the data acquisition device and the second start time in the association mapping table according to the first state change message, thereby updating the association mapping table.
And after the first storage node is disconnected from the data acquisition equipment, sending a second state change message to the data service node. The second state change message includes node identification information of the first storage node, device identification information of the data acquisition device, the first termination time, and the like. And the data service node records the first termination time in a corresponding field in the association mapping table according to the second state change message so as to associate the first storage node, the data acquisition equipment and the first termination time.
After inquiring a first association relation between the first storage node and the data acquisition equipment and a first sub-target time period and a second association relation between the second storage node and the data acquisition equipment and a second sub-target time period, the data service node sends the first association relation and the second association relation to the management node.
And the management node determines that the starting time (namely the second starting time) of the second sub-target time period is earlier than the ending time (namely the first ending time) of the first sub-target time period according to the first association relationship and the second association relationship, and determines that the starting time of the second sub-target time period to the ending time of the first sub-target time period is a coincidence time period.
Since both the second storage node and the first storage node contain coincidence data, the management node may generate an indication message instructing the client to acquire coincidence data from the second storage node, or generate an indication message controlling the client to acquire coincidence data from the first storage node, or generate an indication message controlling the client to acquire a part of coincidence data from each of the second storage node and the first storage node. The specific generation process of the indication message is as follows:
first mode, generating indication message for indicating client to obtain coincidence data from first storage node
On the time axis, the start time of the first sub-goal period is earlier than the start time of the second sub-goal period. Therefore, the management node can directly determine that the first sub-goal time period is the first acquisition time period, and remove the overlapping time period in the second sub-goal time period as the second acquisition time period, thereby performing deduplication on the overlapping time. The management node generates an indication message which comprises a third association relation among the first storage node, the first acquisition time period and the first authentication information of the first storage node and a fourth association relation among the second storage node, the second acquisition time period and the second authentication information of the second storage node.
The management node may operate based on the termination time of the first acquisition period (i.e., the first termination time). Specifically, the management node takes the next time of the first termination time as the start time of the second acquisition period. The next time may be the next second, the next millisecond, the next minute, or the like, and may be determined according to the frequency of data acquisition by the data acquisition device, which is not limited in this application. For example, the management node will be 11/6/2/2021: 00 to 2021 year 6, month 2, day 12:05: the next second at 05: 05: 05 to 2021 year 6, month 2, day 13:00:00. Therefore, the target data acquired by the client from the second storage node and the first storage node are complete, continuous and do not coincide. Of course, the management node may also convert the coincidence time period into the coincidence duration, and subtract the coincidence duration from the start time of the second target time period to obtain the start time of the second acquisition time period.
The client requests the first storage node to acquire first sub-target data corresponding to the first acquisition time period by using the first authentication information in the indication message, and the first storage node sends the first sub-target data to the client after verifying that the authentication information is legal. The client requests the second storage node to acquire third sub-target data corresponding to the second acquisition time period by using the second authentication information in the indication message (the third sub-target data is data obtained by removing fourth data from the second sub-target data), and the second storage node sends the third sub-target data to the client after verifying that the authentication information is legal. The first acquisition time period includes a coincidence time period, so that the first sub-target data includes the third data, and the client is coincidence data acquired from the first storage node.
Second, generating an indication message for indicating the client to acquire the coincidence data from the second storage node
Different from the generation of the indication message for indicating the client to acquire the coincidence data from the first storage node, the management node directly determines that the second sub-target time period is the second acquisition time period, and removes the coincidence time period in the first sub-target time period as the first acquisition time period, so as to perform deduplication on the coincidence time. The management node generates an indication message which comprises a third association relation among the first storage node, the first acquisition time period and the authentication information of the first storage node and a fourth association relation among the second storage node, the second acquisition time period and the authentication information of the second storage node.
The management node removing the coinciding period of the first sub-period may be operated based on a start time of the second acquisition period (i.e., the second start time). Specifically, the management node takes the last time of the second start time as the end time of the first acquisition period. The last time may be last second, last millisecond, last minute, or the like, and may be determined according to a frequency of data acquisition by the data acquisition device, which is not limited in this application. For example, the management node will compare 12/6/2/2021: 00 to 2021 year 6 month 2 day 13 as second acquisition period, 2021 year 6 month 2 day 12:00, last second of 00, i.e. 6/month/2/2021, 11:59 as the termination time of the first acquisition period, the first acquisition period is 2021, 6 months, 2 days 11:00 to 2021 year 6, month 2, day 11:59:59.
The client requests the first storage node to acquire fourth sub-target data corresponding to the first acquisition time period by using the first authentication information in the indication message (the fourth sub-target data is data obtained by removing the third data from the first sub-target data), and the first storage node sends the fourth sub-target data to the client after verifying that the authentication information is legal. The client requests the second storage node to acquire second sub-target data corresponding to the second acquisition time period by using the second authentication information in the indication message, and the second storage node sends the second sub-target data to the client after verifying that the authentication information is legal. Wherein the second retrieval time period includes a coincidence time period, so that the second sub-target data includes the fourth data, and thus the client is coincidence data retrieved from the second storage node.
Third, generating an indication message for indicating the client to acquire the coincidence data from the second storage node and the first storage node
The management node may further generate an indication message instructing the client to obtain a part of the coincidence data from each of the second storage node and the first storage node, respectively.
For example, the management node may determine an arbitrary time within the overlapping time period as the end time of the first acquisition time period, and then determine the start time of the second acquisition time period according to the end time of the first acquisition time period. Or, the management node determines any time within the overlapping time period as a starting time of the second acquisition time period, and then determines an ending time of the second acquisition time period according to the starting time of the second acquisition time period, which is not limited in this application. For example, the management node may determine that the first acquisition period is 2021, 6, month 2, day 11:00 to 2021 year 6, month 2, day 12:02, 59, and the second acquisition period 12, 6/2/2021: 03: 00:00.
The management node generates an indication message including a third association relation among the first storage node, the first acquisition time period and the first authentication information of the first storage node, and a fourth association relation among the second storage node, the second acquisition time period and the second authentication information of the second storage node.
And the client acquires the fifth sub-target data from the first storage node according to the first acquisition time period in the indication message, and acquires the sixth sub-target data from the second storage node according to the second acquisition time period. The fifth sub-targeting data includes fifth data, and the sixth sub-targeting data includes sixth data. The sixth data and the fifth data are both part of the coincidence data, and the sixth data and the fifth data are completely different, and the sixth data and the fifth data can form complete coincidence data.
Of course, the first acquisition time period and the second acquisition time period may have overlapping portions, so that the sixth data and the fifth data are the same, and the sixth data and the fifth data can form complete overlapping data after deduplication. And after the client receives the indication message, the client performs deduplication processing on the overlapped time period or the overlapped data.
2. Client-side deduplication of coincident time/coincident data
After acquiring the first association message and the second association message, the management node may not perform deduplication processing on the coincidence time, and sends an indication message including the first association message and the second association message to the client.
And the client judges that the target time period has a coincidence time period according to the first association message and the second association message, and performs deduplication processing on the coincidence time period, so as to acquire coincidence data from the first storage node and/or the second storage node. The specific process of removing the coincidence time period by the client may refer to the relevant content of the management node for removing the coincidence time period, and therefore, the detailed description is omitted here.
Of course, the client may not duplicate the overlapping time period, and the client acquires the first sub-target data from the first storage node and acquires the second sub-target data from the second storage node. The client may delete the coincident data in the first sub-target data or the second sub-target data.
Or when the client plays the first sub-target data or the second sub-target data, the client does not decode the coincident data in the first sub-target data or the second sub-target data. For example, after the client finishes decoding the first sub-target data, the client determines the next frame of data to be decoded in the second sub-target data according to the time code of the last frame of data of the first sub-target data, so that the target data is played completely and continuously.
When the indication message received by the client is the indication message in the third manner, and the first acquisition time period and the second acquisition time period have a overlapped part, the client may also perform deduplication processing on the overlapped time period, or perform deduplication processing on an overlapped part in the sixth data and the fifth data, or not decode the overlapped part in the sixth data and the fifth data.
3. Management node control deleting coincident data in cluster
Of course, the management node of the present application may also acquire the overlapping time period after the data acquisition device is migrated from the first storage node to the second storage node, and send a deletion instruction to the first storage node and/or the second storage node.
The deletion instruction comprises equipment identification information and a coincidence time period of the data acquisition equipment so as to indicate the first storage node and/or the second storage node to delete coincidence data, which are stored by the first storage node and acquired by the data acquisition equipment in the coincidence time period, of the node. In this way, the storage space occupied by storing the coincidence data in the cluster can be released.
After controlling the first storage node and/or the second storage node to delete the overlapped data, the management node may further send an update message to the data service node to update the corresponding termination time and/or start time in the association mapping table. Or after the first storage node and/or the second storage node deletes the overlapped data, sending a storage change message to the data service node, so that the data node updates the corresponding termination time and/or starting time in the association mapping table according to the storage change message.
It should be noted that the management node sends a deletion instruction to the first storage node and the second storage node to instruct the first storage node and the second storage node to delete the coincidence data, which is acquired by the data acquisition device and stored by the nodes in the coincidence time period, that is, the first storage node and the second storage node delete a part of the coincidence data, and the non-deleted coincidence data in the first storage node and the non-deleted coincidence data in the second storage node can still form complete coincidence data. That is, the first storage node and the second storage node originally store two copies of the coincident data in total, and after the first storage node and the second storage node delete a part of the coincident data, the first storage node and the second storage node store one copy of the coincident data in total. Therefore, the integrity of the data is ensured while the redundant data is deleted.
Fig. 4 is a schematic structural diagram of a migration apparatus of a data acquisition device according to an embodiment of the present application, where the apparatus includes:
a sending unit 401, configured to send a first notification message to a second storage node when a first storage node receives and stores data acquired by data acquisition equipment, where the first notification message is used to instruct the second storage node to receive and store the data acquired by the data acquisition equipment;
a receiving unit 402, configured to receive a second notification message from a second storage node, where the second notification message is used to indicate that the second storage node has stored data acquired by the data acquisition device;
the sending unit 401 is further configured to send a third notification message to the first storage node, where the third notification message is generated in response to the second notification message, and the third notification message is used to instruct the first storage node to disconnect the data transmission connection with the data acquisition device.
The data received by the first storage node from the data acquisition equipment is first data, and the data received by the second storage node from the data acquisition equipment is second data; the first acquisition time period of the first data partially coincides with the second acquisition time period of the second data, the first data and the second data being partially identical.
The functions and processes executed by each unit in the migration apparatus of the data acquisition device in this embodiment are similar to those executed by the management node in fig. 2, and are not described again here.
In some optional embodiments, the receiving unit 402 is further configured to receive a data obtaining message sent by the client, where the data obtaining message is used to request to obtain data collected by the data collection device in a target time period, the target time period includes a coincidence time period, and the coincidence time period is a time period between the first collection time period and the second collection time period. The sending unit 401 is further configured to send an indication message to the client, where the indication message is used to indicate the client to obtain third data from the first storage node or obtain fourth data from the second storage node, where the third data and the fourth data are data acquired by the data acquisition device in a coincidence time period, and the third data and the fourth data are the same.
In some optional embodiments, the receiving unit 402 is further configured to receive a data obtaining message sent by the client, where the data obtaining message is used to request to obtain data collected by the data collection device in a target time period, where the target time period includes a coincidence time period, and the coincidence time period is a time period between a first collection time period and a second collection time period.
In some optional embodiments, the sending unit 401 is further configured to send a first update message to the data service node, where the first update message is used to instruct the data service node to record an association relationship among the second storage node, the data acquisition device, and the second acquisition time period. The sending unit 401 is further configured to send a second update message to the data service node, where the second update message is used to instruct the data service node to update an association relationship among the first storage node, the data acquisition device, and the first acquisition time period.
In some alternative embodiments, the data is a video stream.
In some alternative embodiments, the first data is a first video stream and the second data is a second video stream. The device still includes: and a deduplication unit 403, configured to remove duplicate data from the first video stream and the second video stream and splice the two streams to form a time-coherent video stream.
The functions and processes executed by each unit in the migration apparatus of the data acquisition device in this embodiment are similar to those executed by the management node in fig. 3, and are not described again here.
Fig. 5 is a schematic structural diagram of a server according to an embodiment of the present application, where the server 500 may include one or more processors 501 and a memory 502, and one or more applications or data are stored in the memory 502.
The processor 501 may be one or more chips or one or more integrated circuits. For example, the processor 501 may be one or more field-programmable gate arrays (FPGAs), application Specific Integrated Circuits (ASICs), system on chips (socs), central Processing Units (CPUs), network Processors (NPs), digital signal processing circuits (DSPs), micro Controllers (MCUs), programmable Logic Devices (PLDs), or other integrated chips, or any combination thereof.
Memory 502 may be volatile storage or persistent storage. The program stored in memory 502 may include one or more modules, each of which may include a sequence of instructions operating on a server. Further, the processor 501 may be configured to communicate with the memory 502 to execute a series of instruction operations in the memory 502 on the server 500.
Server 500 may also include one or more power supplies 503, one or more wired or wireless network interfaces 504, one or more input-output interfaces 505, and/or one or more operating systems, such as Windows Server, mac OS XTM, unixTM, linuxTM, freeBSDTM, etc.
The processor 501 may perform the operations performed by the management node in the embodiments shown in fig. 2 to 3, which are not described herein again.
In another embodiment of the present application, there is also provided a computer-readable storage medium having stored therein computer-executable instructions, which when executed by at least one processor of an apparatus, the apparatus performs the method for detecting a passive intermodulation signal described in the above-mentioned embodiments of fig. 2 to 3.
It is clear to those skilled in the art that, for convenience and brevity of description, the specific working processes of the above-described systems, apparatuses and units may refer to the corresponding processes in the foregoing method embodiments, and are not described herein again.
The foregoing has been provided with specific examples to illustrate the principles and embodiments of the present application, and the above description of the embodiments is only provided to help understand the method and its core ideas of the present application; meanwhile, for a person skilled in the art, according to the idea of the present application, there may be variations in the specific embodiments and the application scope, and in summary, the content of the present specification should not be construed as a limitation to the present application.

Claims (18)

1. A migration method of a data acquisition device, the method comprising:
when a first storage node receives and stores data acquired by the data acquisition equipment, a management node sends a first notification message to a second storage node, wherein the first notification message is used for indicating the second storage node to receive and store the data acquired by the data acquisition equipment;
the management node receives a second notification message from the second storage node, wherein the second notification message is used for indicating that the second storage node stores the data acquired by the data acquisition equipment;
and the management node responds to the second notification message and sends a third notification message to the first storage node, wherein the third notification message is used for indicating the first storage node to disconnect the data transmission connection with the data acquisition equipment.
2. The method of claim 1, wherein the data received by the first storage node from the data acquisition device is first data and the data received by the second storage node from the data acquisition device is second data; a first acquisition time period of the first data partially coincides with a second acquisition time period of the second data, the first data and the second data being partially identical.
3. The method of claim 2, wherein after the management node sends a third notification message to the first storage node in response to the second notification message, further comprising:
the management node receives a data acquisition message sent by a client, wherein the data acquisition message is used for requesting to acquire data acquired by the data acquisition equipment in a target time period, the target time period comprises a coincidence time period, and the coincidence time period is a time period coincident with the first acquisition time period and the second acquisition time period;
the management node sends an indication message to the client, where the indication message is used to indicate the client to obtain third data from the first storage node or fourth data from the second storage node, where the third data and the fourth data are data collected by the data collection device in the coincidence time period, and the third data and the fourth data are the same.
4. The method of claim 2, wherein after the management node sends a third notification message to the first storage node in response to the second notification message, further comprising:
the management node receives a data acquisition message sent by a client, wherein the data acquisition message is used for requesting to acquire data acquired by the data acquisition equipment in a target time period, the target time period comprises a superposition time period, and the superposition time period is a time period superposed between the first acquisition time period and the second acquisition time period;
the management node sends an indication message to the client, the indication message is used for indicating the client to acquire fifth data from the first storage node and acquire sixth data from the second storage node, the fifth data and the sixth data are parts of coincident data, the coincident data is data acquired by the data acquisition equipment in a coincident time period, the fifth data and the sixth data are completely or partially different, and the fifth data and the sixth data can be spliced into the coincident data.
5. The method according to any of claims 2 to 4, wherein after sending the third notification message to the first storage node according to the second notification message, the method further comprises:
the management node sends a first updating message to a data service node, wherein the first updating message is used for indicating the data service node to record the association relationship among the second storage node, the data acquisition equipment and the second acquisition time period;
and the management node sends a second updating message to the data service node, wherein the second updating message is used for indicating the data service node to update the association relation among the first storage node, the data acquisition equipment and the first acquisition time period.
6. The method according to any one of claims 2 to 5, wherein the data acquisition device is a web cam and the data is a video stream.
7. The method of claim 6, wherein the first data is a first video stream and the second data is a second video stream, the method further comprising:
and the management node removes repeated data from the first video stream and the second video stream and splices the repeated data to form a time-coherent video stream.
8. The method according to any of claims 1 to 7, wherein the management node, the second storage node and the first storage node are each any of a container, a virtual machine, a network video recorder or a storage server.
9. A migration apparatus of a data acquisition device, the apparatus comprising:
the sending unit is used for sending a first notification message to a second storage node when a first storage node receives and stores data acquired by the data acquisition equipment, wherein the first notification message is used for indicating the second storage node to receive and store the data acquired by the data acquisition equipment;
a receiving unit, configured to receive a second notification message from the second storage node, where the second notification message is used to indicate that the second storage node has stored the data acquired from the data acquisition device;
the sending unit is further configured to send a third notification message to the first storage node, where the third notification message is generated in response to the second notification message, and the third notification message is used to instruct the first storage node to disconnect the data transmission connection with the data acquisition device.
10. The apparatus of claim 9, wherein the data received by the first storage node from the data acquisition device is first data and the data received by the second storage node from the data acquisition device is second data; a first acquisition time period of the first data partially coincides with a second acquisition time period of the second data, the first data and the second data being partially identical.
11. The apparatus of claim 10,
the receiving unit is further configured to receive a data acquisition message sent by a client, where the data acquisition message is used to request to acquire data acquired by the data acquisition device in a target time period, the target time period includes a coincidence time period, and the coincidence time period is a time period where the first acquisition time period and the second acquisition time period coincide with each other;
the sending unit is further configured to send an indication message to the client, where the indication message is used to indicate the client to obtain third data from the first storage node or fourth data from the second storage node, where the third data and the fourth data are data acquired by the data acquisition device in the coincidence time period, and the third data and the fourth data are the same.
12. The apparatus of claim 10,
the receiving unit is further configured to receive a data acquisition message sent by a client, where the data acquisition message is used to request to acquire data acquired by the data acquisition device in a target time period, the target time period includes a coincidence time period, and the coincidence time period is a time period in which the first acquisition time period and the second acquisition time period coincide with each other;
the sending unit is further configured to send an indication message to the client, where the indication message is used to indicate the client to obtain fifth data from the first storage node and obtain sixth data from the second storage node, where the fifth data and the sixth data are both part of overlapping data, the overlapping data is data collected by the data collection device in an overlapping time period, the fifth data and the sixth data are completely or partially different, and the fifth data and the sixth data can be spliced to be the overlapping data.
13. The apparatus of any one of claims 10 to 12,
the sending unit is further configured to send a first update message to a data service node, where the first update message is used to instruct the data service node to record an association relationship among the second storage node, the data acquisition device, and the second acquisition time period;
the sending unit is further configured to send a second update message to the data service node, where the second update message is used to instruct the data service node to update an association relationship among the first storage node, the data acquisition device, and the first acquisition time period.
14. The apparatus according to any of claims 10 to 13, wherein the data is a video stream.
15. The apparatus of claim 14, wherein the first data is a first video stream, wherein the second data is a second video stream, and wherein the apparatus further comprises:
and the duplication removing unit is used for removing duplication data from the first video stream and the second video stream and splicing the duplication data to form a time-coherent video stream.
16. The apparatus according to any one of claims 9 to 15, wherein the apparatus is any one of a container, a virtual machine, a network video recorder, or a storage server.
17. A server, comprising a processor and a memory;
the processor is configured to communicate with the memory and execute instructions in the memory to perform the method of any of claims 1 to 8.
18. A computer-readable storage medium comprising instructions that, when executed on a computer, cause the computer to perform the method of any one of claims 1 to 8.
CN202110814723.5A 2021-07-19 2021-07-19 Migration method and device of data acquisition equipment and server Pending CN115640114A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202110814723.5A CN115640114A (en) 2021-07-19 2021-07-19 Migration method and device of data acquisition equipment and server

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202110814723.5A CN115640114A (en) 2021-07-19 2021-07-19 Migration method and device of data acquisition equipment and server

Publications (1)

Publication Number Publication Date
CN115640114A true CN115640114A (en) 2023-01-24

Family

ID=84939961

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202110814723.5A Pending CN115640114A (en) 2021-07-19 2021-07-19 Migration method and device of data acquisition equipment and server

Country Status (1)

Country Link
CN (1) CN115640114A (en)

Similar Documents

Publication Publication Date Title
US11350139B2 (en) Video live broadcast method and apparatus
US20210092188A1 (en) Edge application management method and system
US20210105177A1 (en) Network-Assisted Consensus Protocol
EP3127018B1 (en) Geographically-distributed file system using coordinated namespace replication
WO2020147331A1 (en) Micro-service monitoring method and system
RU2595482C2 (en) Ensuring transparency failover in file system
CN105872016B (en) The operation method of virtual machine in a kind of desktop cloud
US10313452B2 (en) Migrating a chat message service provided by a chat server to a new chat server
US10579595B2 (en) Method and device for calling a distributed file system
WO2017152736A1 (en) Hadoop distributed file system hdfs management method, device and system
CN110545327B (en) Information pushing method and system
CN111459749A (en) Prometous-based private cloud monitoring method and device, computer equipment and storage medium
US20180343217A1 (en) Providing video to subscribers of a messaging system
CN101808127A (en) Data backup method, system and server
WO2021184992A1 (en) Mirror image file uploading method, related device and computer storage medium
CN111342986B (en) Distributed node management method and device, distributed system and storage medium
CN110445826B (en) Session information acquisition method, device and server
WO2021254214A1 (en) Migration method and apparatus for android application program
EP3570169A1 (en) Method and system for processing device failure
WO2012136091A2 (en) Data migration method and system in peer-to-peer network
CN109522177A (en) A kind of task daily record processing system, method and device
CN108984191A (en) A kind of method, apparatus and electronic equipment of application update
EP3349416A1 (en) Relationship chain processing method and system, and storage medium
CN115640114A (en) Migration method and device of data acquisition equipment and server
US9852031B2 (en) Computer system and method of identifying a failure

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination