KR20220110963A - Video recovery method for network disconnection in cloud-based video security system and the system therefor - Google Patents

Abstract

A video recovery method for network disconnection in a cloud-based video security system and a system therefor are disclosed. A video recovery method according to an embodiment of the present invention includes the following steps: (a) monitoring the status of a network with a cloud server; (b) storing backup image data and a backup image list associated with the backup image data in a memory built in a camera when the connection to the network is lost; and (c) after the connection to the network is restored, transmitting the backup image data and the backup image list stored in the memory to the cloud server in response to a request from the cloud server.

Description

VIDEO RECOVERY METHOD FOR NETWORK DISCONNECTION IN CLOUD-BASED VIDEO SECURITY SYSTEM AND THE SYSTEM THEREFOR}

The present invention relates to a method for recovering an image from a network disconnection in a cloud-based image security system and a system therefor.

The video security field is continuously growing, and among them, the cloud video security field is receiving a lot of attention. Unlike the built-in system installed directly from the customer's side, the cloud-based video security system that utilizes a network has a problem in that the video is lost when the network between the camera and the cloud server is disconnected. In order to solve this problem, the network status is monitored to save the backup image in the camera's internal memory when a network disconnection problem occurs. method is required.

SUMMARY OF THE INVENTION The present invention aims to solve the above-mentioned needs and/or problems.

Another object of the present invention is to implement an image restoration method for network disconnection and a system therefor in a cloud-based image security system that can guarantee a seamless overall restoration image even if the network connection is disconnected in the middle.

An image restoration method according to an embodiment of the present invention is an image restoration method for network disconnection by a camera included in a cloud-based image security system,

(a) monitoring the state of the network with the cloud server;

(b) storing backup image data and a backup image list associated with the backup image data in a memory built in the camera when the connection with the network is disconnected; and

(c) after the connection to the network is restored, transmitting the backup image data and the backup image list stored in the memory to the cloud server in response to the request of the cloud server.

In a preferred embodiment, the state of the network may be determined as either connection or disconnection based on the heartbeat packet.

In a preferred embodiment, the backup image data stored in the memory includes the first image data before the network is disconnected, the second image data while the network is disconnected, and the third image data after the network connection is restored. can do.

Here, the first image data may be image data generated for at least 15 seconds before the network is disconnected, and the third image data may be image data generated for at least 30 seconds after the connection to the network is restored.

In a preferred embodiment, when all of the first to third image data are transmitted to the cloud server, the memory area for storing the first to third image data of the memory may be formatted.

In a preferred embodiment, step (c) includes: transmitting the backup image list in response to receiving a request for the backup image list from the cloud server; Thereafter, based on the backup image list, the method may include transmitting the backup image data included in the backup image list to the cloud server.

An image restoration method according to an embodiment of the present invention is an image restoration method for network disconnection by a cloud server included in a cloud-based image security system,

(a) when the connection to the network is restored, requesting the camera to transmit the backup image data and the backup image list stored in the memory;

(b) storing the backup image data received from the camera in a time unit in a memory;

and (c) mapping the backup image data stored in the memory in units of time and the cloud image data received from the camera and stored in the memory before the connection to the network is cut in units of time to generate an entire restored image.

In a preferred embodiment, when both the backup image data and the cloud image data exist in at least a partial time domain in step (c), the cloud server selects only one of the backup image data and the cloud image data according to a predetermined condition. Thus, it is possible to generate a fully restored image.

In a preferred embodiment, the predetermined condition is a condition in which the cloud image data is selected with a higher priority than the backup image data. You can select data to create a fully restored image.

In this case, the fully restored image may be made in a form in which image data is seamlessly connected so that there is no loss of image data due to disconnection of the network connection.

According to the present invention, it is possible to prevent image loss of image data stored in the cloud server that may occur according to a change in the connection state of the network between the camera and the cloud server. As there is no loss of image data, the reliability of the image security service can be guaranteed. In particular, in the present invention, the connection with the network is cut off because the camera temporarily stores in the memory the image data acquired during the time when at least one, preferably at least two, particularly preferably at least three heartbeat signals are received. However, by transmitting the image data temporarily stored before the disconnection to the cloud server, it is possible to ensure that a seamlessly restored image is created.

An image recovery method for network disconnection in a cloud-based video security system according to an embodiment of the present invention and an effect of the system therefor will be described as follows.

According to the present invention, even if the network connection is cut in the middle, it is possible to guarantee a seamless full recovery image.

The effects obtainable in the present invention are not limited to the above-mentioned effects, and other effects not mentioned will be clearly understood by those of ordinary skill in the art to which the present invention belongs from the following description. .

BRIEF DESCRIPTION OF THE DRAWINGS The accompanying drawings, which are included as a part of the detailed description to facilitate the understanding of the present invention, provide embodiments of the present invention, and together with the detailed description, explain the technical features of the present invention.
1 is a flowchart of an image restoration method according to an embodiment of the present invention.
2 is a flowchart of an image restoration method according to another embodiment of the present invention.
3 is a block diagram of an image security system according to an embodiment of the present invention.
4 is a block diagram of an electronic device applicable to an embodiment of the present invention.

Hereinafter, an embodiment disclosed in the present invention will be described in detail with reference to the accompanying drawings, but the same or similar components are assigned the same reference numbers regardless of reference numerals, and redundant description thereof will be omitted. The suffixes "module" and "part" for components used in the following description are given or mixed in consideration of only the ease of writing the specification, and do not have distinct meanings or roles by themselves. In addition, in describing the embodiments disclosed in the present invention, if it is determined that detailed descriptions of related known technologies may obscure the gist of the embodiments disclosed in the present invention, the detailed description thereof will be omitted. In addition, the accompanying drawings are only for easy understanding of the embodiments disclosed in the present invention, and the technical spirit disclosed in the present invention is not limited by the accompanying drawings, and all changes included in the spirit and scope of the present invention , should be understood to include equivalents or substitutes.

Terms including ordinal numbers such as first, second, etc. may be used to describe various elements, but the elements are not limited by the terms. The above terms are used only for the purpose of distinguishing one component from another.

When a component is referred to as being “connected” or “connected” to another component, it may be directly connected or connected to the other component, but it is understood that other components may exist in between. it should be On the other hand, when it is said that a certain element is "directly connected" or "directly connected" to another element, it should be understood that the other element does not exist in the middle.

The singular expression includes the plural expression unless the context clearly dictates otherwise.

In the present application, terms such as “comprises” or “have” are intended to designate that a feature, number, step, operation, component, part, or combination thereof described in the specification exists, but one or more other features It should be understood that this does not preclude the possibility of addition or existence of numbers, steps, operations, components, parts, or combinations thereof.

1 is a flowchart of an image restoration method according to an embodiment of the present invention.

An image restoration method according to an embodiment of the present invention is an image restoration method for network disconnection by a camera included in a cloud-based image security system, and includes the following steps.

(a) monitoring the state of the network with the cloud server (S110),

(b) storing the backup image data and the backup image list associated with the backup image data in a memory built in the camera when the connection to the network is cut (S120); and

(c) after the connection to the network is restored, transmitting the backup image data and the backup image list stored in the memory to the cloud server in response to the request of the cloud server (S130).

In a preferred embodiment, the state of the network may be determined as either connection or disconnection based on the heartbeat packet. Heartbeat packets are transmitted/received between the camera and the cloud server at a predetermined cycle. For example, the heartbeat packet may be transmitted/received at a cycle of 5 seconds. The cloud server sends a heartbeat packet to the camera at least every 5 seconds, and the camera checks the received heartbeat packet to determine that it is connected to the network if a heartbeat packet is detected, and if no heartbeat packet is detected, the network determined to be disconnected from When it is determined to be connected to the network based on the heartbeat packet, the camera transmits the image data acquired by the image sensor to the cloud server through the network. The image data transmitted from the camera is stored in the memory of the cloud server, and in this specification, the image data stored in the memory of the cloud server while the network connection between the camera and the cloud server is maintained is referred to as “cloud image data”.

In a preferred embodiment, the backup image data stored in the memory includes the first image data before the network is disconnected, the second image data while the network is disconnected, and the third image data after the network connection is restored. can do. The first image data may be image data generated for at least 15 seconds before the network is disconnected, and the third image data may be image data generated for at least 30 seconds after the connection to the network is restored.

In the case of the first image data, the length of the image may be set to an integer multiple of the period of the heartbeat packet. For example, the length of the video may be set to at least one heartbeat packet period, preferably at least two heartbeat packet periods, and particularly preferably at least three heartbeat packet periods. Meanwhile, the length of the image may be fixedly set to 15 seconds. The pre-stored first image data can then be used in a seamless connection process with the cloud image data stored in advance in the cloud server, so that a completely restored image without loss of image data due to the disconnection of the network connection can be created. have.

The second image data is image data transmitted by the camera while the network connection between the camera and the cloud server is maintained, and is stored as cloud image data in the cloud server.

Like the first image data, the third image data is additional image data transmitted from the camera to create a completely reconstructed image without image loss. The camera stores the image data in the memory for a predetermined time (for example, 30 seconds) even if the network connection with the cloud server is restored again. The stored image data is then transferred to the cloud server according to the request of the cloud server, and it is possible to prevent minute image loss that may occur immediately after the network connection is restored. Here, the predetermined time corresponding to the time length of the third image data may be set longer than that of the first image data, preferably at least twice that of the first image data.

Meanwhile, the time length of the first image data and the time length of the third image data may be substituted with each other if necessary. For example, the time of the first image data may be longer than the time of the third image data, or at least twice the time of the third image data may be set.

In a preferred embodiment, when all of the first to third image data are transmitted to the cloud server, the memory area for storing the first to third image data of the memory may be formatted. The camera's memory, unlike cloud servers, has limited battery capacity and thus needs to be formatted whenever a predetermined condition and/or a predetermined cycle is achieved or reached. The memory of the camera according to the present invention formats the memory when all of the first to third image data is transmitted to the cloud server, that is, when there is no longer a need to record image data for image restoration, effectively reducing the capacity of the memory. can manage Memory capacity is also very important in the field of image security, and if all images are recorded in the memory without considering the capacity of the memory, the problem of not being able to store any more images due to the limitation of the memory inevitably arises. The present invention relates to a process of storing image data required for image restoration in a memory of a camera, and by formatting the memory as all image data required for image restoration is transmitted, it is possible to prevent the problem of failing to obtain image data according to the memory capacity. can

In a preferred embodiment, step (c) is a step of delivering the backup image list in response to receiving a request for a backup image list from the cloud server, and thereafter, based on the backup image list, a backup image included in the backup image list It may include transmitting the data to a cloud server.

The backup image list has information related to the backup image data. The backup image data is divided into predetermined time units and configured. That is, the backup image data is composed of a plurality of partial image data having a predetermined time length. Each of the plurality of partial image data is mapped with corresponding viewpoint information, and the backup image list is composed of or includes the plurality of partial image data and corresponding viewpoint information. The time point information is for later sorting cloud image data and backup image data based on time. Cloud image data and backup image data are sorted according to time using built-in or mapped time point information, respectively. When duplicate image data exists at a specific time point, that is, when both cloud image data and backup image data exist at a specific time point, the cloud server selects one of them to generate a restored image. The process of generating a restored image using the viewpoint information in this way will be described in detail later in the image restoration method by the cloud server to be described below.

Meanwhile, the camera has a feature of generating not only backup image data but also a backup image list, and the cloud server requests and receives a backup image list in preference to the backup image data. The backup image list has information for classifying the backup image data and time information corresponding to the backup image data. The cloud server may request and receive backup image data corresponding to each viewpoint information based on the backup image list. By using the time information included in the backup image list, the cloud server can not only sort the backup image data and the cloud image data based on time later, but also receive only a portion of the backup image data required for image restoration. may be

2 is a flowchart of an image restoration method according to another embodiment of the present invention.

An image restoration method according to another embodiment of the present invention is an image restoration method for network disconnection by a cloud server included in a cloud-based image security system, and includes the following steps.

(a) when the connection to the network is restored, requesting the camera to transmit the backup image data stored in the memory and the backup image list (S210),

(b) storing the backup image data received from the camera in a time unit in a memory (S220);

(c) creating an entire restored image by mapping the backup image data stored in the memory in units of time and the cloud image data received from the camera and stored in the memory in units of time before the network is disconnected (S230).

In a preferred embodiment, when both the backup image data and the cloud image data exist in at least a partial time domain in step (c), the cloud server selects only one of the backup image data and the cloud image data according to a predetermined condition. Thus, it is possible to generate a fully restored image. Here, at least a partial time region in which the backup image data and the cloud image data coexist is determined based on viewpoint information mapped or embedded in the backup image data and viewpoint information mapped or embedded in the cloud image data as described above. The cloud server sorts the two image data based on time based on the time point information, and selects and maintains either the backup image data or the cloud image data when both image data exist at a specific time point.

In a preferred embodiment, the predetermined condition is a condition in which the cloud image data is selected with a higher priority than the backup image data. You can select data to create a fully restored image.

In this case, the fully restored image may be made in a form in which image data is seamlessly connected so that there is no loss of image data due to disconnection of the network connection.

According to the present invention, it is possible to prevent image loss of image data stored in the cloud server that may occur according to a change in the connection state of the network between the camera and the cloud server. As there is no loss of image data, the reliability of the image security service can be guaranteed. In particular, in the present invention, the connection with the network is cut off because the camera temporarily stores in the memory the image data acquired during the time when at least one, preferably at least two, particularly preferably at least three heartbeat signals are received. However, by transmitting the image data temporarily stored before the disconnection to the cloud server, it is possible to ensure that a seamlessly restored image is created.

3 is a block diagram of an image security system according to an embodiment of the present invention.

Referring to FIG. 3 , the video security system 100 includes a camera 110 and a cloud server 120 connected to the camera 110 through a network. The camera 110 and the cloud server 120 typically include a memory, a processor, and a transceiver, which is hereinafter referred to as an example of the electronic device 1 described in FIG. 4 . In particular, the camera 110 may further include an image sensor and/or an image processor for acquiring an image, unlike the cloud server 120 . The image restoration method of FIGS. 1 and 2 may be realized by the camera 110 and the cloud server 120 included in the image security system of FIG. 3 , in particular, by the processor of the camera 110 and the cloud server 120 . and specific operations overlap with those described above.

4 is a block diagram of an electronic device applicable to an embodiment of the present invention.

Referring to FIG. 4 , the electronic device 1 includes a memory 10 , a transceiver 20 and a processor 30 .

The memory 10 may be connected to the processor and may store various types of data, signals, methods, information, programs, codes, or instructions. Memory may consist of ROM, RAM, EPROM, flash memory, hard drive, registers, cache memory, computer readable storage medium, and/or combinations thereof. The memory may be located inside and/or external to the processor. The memory may also be connected to the processor through a variety of technologies, such as wired or wireless connections.

The transceiver 20 may transmit or receive user data, control information, radio signals/channels, and the like to other devices. For example, the transceiver may be coupled to the processor and may transmit and receive wireless signals. For example, the processor may control the transceiver to transmit user data, control information, or radio signals to other devices. The processor may also control the transceiver to receive user data, control information, or radio signals from other devices. In addition, the transceiver may be connected to an antenna, and the transceiver may be configured to transmit/receive user data, control information, radio signals/channels, and the like through the antenna.

The processor 30 may be referred to as a controller, microcontroller, microprocessor, or microcomputer. The processor may be implemented by hardware, firmware, software, or a combination thereof. For example, an Application Specific Integrated Circuit (ASIC), a Digital Siganl Processor (DSP), a Digital Signal Processing Device (DSPD), a Programmable Logic Device (PLD), or Field Programmable Gate Arrays (FPGA) may be included in the processor. Methods according to various embodiments of the present invention may be implemented using firmware or software, and the firmware or software may be implemented to include modules, procedures, functions, and the like. Firmware or software configured to perform the method according to various embodiments of the present invention may be included in a processor or stored in a memory to be driven by the processor.

The present invention described above can be implemented as computer-readable code on a medium in which a program is recorded. The computer-readable medium includes all kinds of recording devices in which data readable by a computer system is stored. Examples of computer-readable media include Hard Disk Drive (HDD), Solid State Disk (SSD), Silicon Disk Drive (SDD), ROM, RAM, CD-ROM, magnetic tape, floppy disk, optical data storage device, etc. There is also a carrier wave (eg, transmission over the Internet) that is implemented in the form of. Accordingly, the above detailed description should not be construed as restrictive in all respects but as exemplary. The scope of the present invention should be determined by a reasonable interpretation of the appended claims, and all modifications within the equivalent scope of the present invention are included in the scope of the present invention.

Claims (15)

As a video recovery method for network disconnection by a camera included in a cloud-based video security system,
(a) monitoring the state of the network with the cloud server;
(b) storing backup image data and a backup image list associated with the backup image data in a memory built in the camera when the connection with the network is disconnected; and
(c) after the connection to the network is restored, in response to a request from the cloud server, transmitting the backup image data and the backup image list stored in the memory to the cloud server.
According to claim 1,
The video recovery method, wherein the network status is determined by either connection or disconnection based on the heartbeat packet.
3. The method of claim 1 or 2,
The backup image data stored in the memory includes the first image data before the network is disconnected, the second image data while the network is disconnected, and the third image data after the connection to the network is restored. How to recover.
4. The method of claim 3,
The first image data is image data generated for at least 15 seconds before the network is disconnected.
4. The method of claim 3,
The third image data is image data generated for at least 30 seconds after the connection with the network is restored.
4. The method of claim 3,
When all of the first to third image data is transmitted to the cloud server, the memory area for storing the first to third image data of the memory is formatted, the image recovery method. 3. The method of claim 1 or 2,
Step (c) includes: transmitting the backup image list in response to receiving a request for the backup image list from the cloud server; and
thereafter, based on the backup image list, transmitting the backup image data included in the backup image list to a cloud server.
As a video recovery method for network disconnection by a cloud server included in a cloud-based video security system,
(a) when the connection to the network is restored, requesting the camera to transmit the backup image data stored in the memory and the backup image list;
(b) storing the backup image data received from the camera in a time unit in a memory;
(c) generating an entire restored image by mapping the backup image data stored in the memory in units of time and the cloud image data received from the camera and stored in the memory before the network is disconnected in units of time, How to recover video.
9. The method of claim 8,
In step (c), when both the backup image data and the cloud image data exist in at least a part of the time domain, the cloud server selects only one of the backup image data and the cloud image data according to a predetermined condition to restore the entire restored image. A method of restoring an image that is to be created.
10. The method of claim 9,
The predetermined condition is a condition in which the cloud image data is selected with a higher priority than the backup image data. Creating a restored image, an image recovery method.
11. The method according to any one of claims 8 to 10,
The image restoration method of claim 1, wherein the entire restoration image is made in a form in which image data is seamlessly connected so that there is no loss of image data due to the disconnection of the network connection.
A camera included in a cloud-based video security system for video recovery against network disconnection, the camera comprising an image sensor, a memory, a transceiver, and a processor,
The processor is
(a) the operation of monitoring the status of the network with the cloud server;
(b) storing backup image data and a backup image list associated with the backup image data in a memory built in the camera when the connection with the network is disconnected;
(c) after the connection to the network is restored, the camera performs an operation of transmitting the backup image data and the backup image list stored in the memory to the cloud server in response to the request of the cloud server.
A cloud server included in a cloud-based video security system for video recovery against network disconnection, wherein the cloud server includes a memory, a transceiver, and a processor,
The processor is
(a) When the connection to the network is restored, the operation of requesting the camera to transmit the backup image data stored in the memory and the backup image list;
(b) storing the backup image data received from the camera in the memory in units of time;
(c) mapping the backup image data stored in the memory in units of time and the cloud image data received from the camera and stored in the memory in units of time before the connection with the network is cut off to generate a full restored image, cloud server.
A computer system-readable recording medium in which a program for executing the image recovery method according to claim 1 in a computer system is recorded.
A computer system-readable recording medium in which a program for executing the image recovery method according to claim 8 in a computer system is recorded.

Images