KR102590136B1 - Cloud server for monitoring live videos, and operating method thereof - Google Patents

Abstract

A method of operating a cloud server for live video monitoring is disclosed. A method of operating a cloud server for live video monitoring includes the steps of decoding compressed video captured by a plurality of cameras - the compressed video includes main signals and preliminary signals; synchronizing the time of the decoded video; Encoding the time-synchronized video; converting compressed frames of the encoded video into compressed images and storing them in a compressed image storage; Monitoring the compressed image of the main signal and the compressed image of the preliminary signal stored in the compressed image storage; If it is determined that there is a problem with the compressed image, converting all frames of the decoded video into an uncompressed image and storing it in an uncompressed image storage; And monitoring the uncompressed image stored in the uncompressed image storage, and if it is determined that there is a problem with the uncompressed image of the main signal, requesting the operator terminal to switch the preliminary signal to a new main signal. do.

Description

Cloud server for monitoring live video and its operating method {CLOUD SERVER FOR MONITORING LIVE VIDEOS, AND OPERATING METHOD THEREOF}

The present disclosure relates to a cloud server for monitoring live video and its operating method. More specifically, it relates to a cloud server and its operating method for synchronizing time between live videos captured by a plurality of cameras and monitoring video errors. .

In the case of live video shot with multiple cameras, it is important to synchronize the transmission time between videos shot by each camera. When synchronizing the transmission time between multiple videos with broadcasting equipment, a method of matching PTS (Presentation Time Stamp) is used to maintain the correct decoding order and playback order for each video output.

As related prior art, there is Korean Patent Publication No. 10-2025157 (Title of the invention: System for transmitting multiple captured images and its control method, Applicant: LG U Plus Co., Ltd.). The registered patent publication discloses a system for transmitting multiple captured images and a method for controlling the same. Specifically, the prior art method includes the steps of (a) receiving each captured image signal from a plurality of cameras; (b) playing back images for each camera using each captured image signal received from the plurality of cameras; (c) synchronizing the captured video signals of each camera with each other based on at least one of analysis according to a preset algorithm for the video for each camera played in step (b) and selection by the manager; (d) generating one integrated video signal by multiplexing each of the synchronized captured video signals; (e) transmitting the integrated video signal generated in step (d) to a receiving terminal, wherein step (c) includes: (c1) an administrator for the video for each camera being played in step (b); performing a forward/backward movement by a preset frame interval according to the selection and then performing a pause at a specific video frame; (c2) It includes the step of synchronizing the captured video signals of each camera based on the paused video frame for each camera.

When time synchronization between multiple videos is handled by a cloud server, transmission of uncompressed signals is impossible, so even if a problem occurs in the video, it is difficult to know in which section the problem occurred.

However, technical challenges are not limited to the above-mentioned technical challenges, and other technical challenges may exist.

A method of operating a cloud server for live video monitoring according to an embodiment includes the steps of decoding compressed video captured by a plurality of cameras - the compressed video includes main signals and preliminary signals; synchronizing the time of the decoded video; Encoding the time-synchronized video; converting compressed frames of the encoded video into compressed images and storing them in a compressed image storage; Monitoring the compressed image of the main signal and the compressed image of the preliminary signal stored in the compressed image storage; If it is determined that there is a problem with the compressed image, converting all frames of the decoded video into an uncompressed image and storing it in an uncompressed image storage; And monitoring the uncompressed image stored in the uncompressed image storage, and if it is determined that there is a problem with the uncompressed image of the main signal, requesting the operator terminal to switch the preliminary signal to a new main signal. do.

The method includes converting encoded video and audio signals into one container; And it may further include chunking the container into a streamable form and creating a streaming profile.

The step of monitoring the compressed image may be performed when the size of the compressed image file of the main signal and the compressed image file of the preliminary signal differs by more than a threshold or when the size of only one of the two compressed image files is less than or equal to the threshold. It can be determined that there is at least one abnormality.

In the step of monitoring the uncompressed image, it may be determined that there is a problem if the uncompressed image is broken or black.

Monitoring the compressed image may further include transmitting the compressed image of the main signal and the compressed image of the preliminary signal from the compressed image storage to the operator terminal via the Web.

The step of monitoring the uncompressed image may further include transmitting the uncompressed image from the uncompressed image storage to the operator terminal via the Web.

A cloud server for live video monitoring according to an embodiment includes a decoder that decodes compressed video captured by a plurality of cameras, the compressed video including main signals and preliminary signals; a synchronization unit that synchronizes the time of the decoded video; an encoder for encoding the time-synchronized video; a video-compressed image converter that converts compressed frames of the encoded video into compressed images and stores them in a compressed image storage; a compressed image monitoring unit that monitors the compressed image of the main signal and the compressed image of the preliminary signal stored in the compressed image storage; a video-uncompressed image converter that converts entire frames of the decoded video into uncompressed images and stores them in an uncompressed image storage when the compressed image monitoring unit determines that there is an abnormality; And an uncompressed image that monitors the uncompressed image stored in the uncompressed image storage and, if it is determined that there is a problem with the uncompressed image of the main signal, requests the operator terminal to switch the preliminary signal to a new main signal. Includes a monitoring unit.

The server includes a multiplexer (MUX) that converts encoded video and audio signals into one container; And it may further include a package manager that chunks the container into a streaming-capable form and creates a streaming profile.

The compressed image monitoring unit is configured to operate in at least one of the following cases: a size difference between the compressed image file of the main signal and the compressed image file of the preliminary signal is greater than or equal to a threshold value, and the size of only one of the two compressed image files is less than or equal to a threshold value. It can be determined that there is something wrong.

The uncompressed image monitoring unit may determine that there is a problem when the uncompressed image is broken or black.

The compressed image monitoring unit may transmit the compressed image of the main signal and the compressed image of the preliminary signal from the compressed image storage to the operator terminal through the web.

The uncompressed image monitoring unit may transmit the uncompressed image from the uncompressed image storage to the operator terminal through the web.

The cloud server according to one embodiment can further include a package manager and adjust the PTS between each video on a chunk basis.

In addition, the cloud server according to one embodiment monitors compressed images at all times, and when an abnormality is found, it monitors all uncompressed images, and if there is an abnormality in the main signal, it can switch to a preliminary signal.

1A and 1B are diagrams for explaining a cloud server for live video monitoring according to an embodiment.
FIG. 2 is a diagram illustrating an image processing method in existing hardware and steps performed by a cloud server according to an embodiment.
Figure 3 is a flowchart to explain a process in which a cloud server monitors video according to an embodiment.
Figure 4 is a flowchart illustrating a method of operating a cloud server for live video monitoring according to an embodiment.

Specific structural or functional descriptions of the embodiments are disclosed for illustrative purposes only and may be changed and implemented in various forms. Accordingly, the actual implementation form is not limited to the specific disclosed embodiments, and the scope of the present specification includes changes, equivalents, or substitutes included in the technical idea described in the embodiments.

Terms such as first or second may be used to describe various components, but these terms should be interpreted only for the purpose of distinguishing one component from another component. For example, a first component may be named a second component, and similarly, the second component may also be named a first component.

When a component is referred to as being “connected” to another component, it should be understood that it may be directly connected or connected to the other component, but that other components may exist in between.

Singular expressions include plural expressions unless the context clearly dictates otherwise. In this specification, terms such as “comprise” or “have” are intended to designate the presence of the described features, numbers, steps, operations, components, parts, or combinations thereof, and are intended to indicate the presence of one or more other features or numbers, It should be understood that this does not exclude in advance the possibility of the presence or addition of steps, operations, components, parts, or combinations thereof.

Unless otherwise defined, all terms used herein, including technical or scientific terms, have the same meaning as commonly understood by a person of ordinary skill in the art. Terms as defined in commonly used dictionaries should be interpreted as having meanings consistent with the meanings they have in the context of the related technology, and unless clearly defined in this specification, should not be interpreted in an idealized or overly formal sense. No.

Hereinafter, embodiments will be described in detail with reference to the attached drawings. In the description with reference to the accompanying drawings, identical components will be assigned the same reference numerals regardless of the reference numerals, and overlapping descriptions thereof will be omitted.

<Cloud server for live video monitoring>

1A and 1B are diagrams for explaining a cloud server for live video monitoring according to an embodiment.

1A and 1B, components of a cloud server for live video monitoring according to one embodiment are shown. Since FIG. 1B is a diagram to explain that the main signal and the preliminary signal in FIG. 1A are stored in different instances, they will be described together with FIG. 1A. The cloud server 100 for live video monitoring according to one embodiment includes a decoder 110, a synchronization unit 120, an encoder 130, a video-compressed image converter 140, a compressed image storage 143, and a compressed image. It includes a monitoring unit 147, a video-uncompressed image converter 150, an uncompressed image storage 153, and an uncompressed image monitoring unit 157, and further includes a multiplexer 160 and a package manager 170. You can.

The decoder 110 decodes compressed images captured by a plurality of cameras for time synchronization. Compressed images captured by multiple cameras each include a main signal and a spare signal, which is used to switch the spare signal to the main signal when the main signal is not normal. The synchronization unit 120 synchronizes the time of the video decoded by the decoder 110, and synchronization can be performed by matching the same time information to the reference video frame for each camera video. However, this is only an example and not limited thereto, and various time synchronization methods may be used. The encoder 130 performs encoding on the time-synchronized video in the synchronization unit 120 so that the video can be transmitted.

The cloud server 100 includes a compressed image monitoring unit 147 and an uncompressed image monitoring unit 157 to determine whether there is a problem with the main signal. In order to monitor compressed images and uncompressed images, the cloud server 100 includes a video-compressed image converter 140 and a compressed image storage 143, a video-uncompressed image converter 150, and an uncompressed image storage 153. Includes.

The video-compressed image converter 140 converts the compressed frame of the video encoded by the encoder 130, for example, the I frame, which is the main frame, into an image. The conversion speed of the video-compressed image converter 140 may be, but is not limited to, 1 image per 0.5 second or 1 image per second. The video-compressed image converter 140 stores the converted compressed image in the compressed image storage 143, which is a common storage that stores compressed images of both the main signal and the preliminary signal.

The video-uncompressed image converter 150 converts all uncompressed frames into images after being decoded in the decoder 110 and before being encoded in the encoder 130. The video-image conversion speed of the video-uncompressed image converter 150 may vary depending on the frame rate of the video. For example, for 30 FPS (Frame Per Second), 30 images per second, and for 60 FPS, 60 images per second. It will be converted to an image. The video-uncompressed image converter 150 stores the converted uncompressed image in the uncompressed image storage 153. Unlike the compressed image storage 143, which is a common storage, the uncompressed image storage 153 stores the main signal and This is the memory of each instance where preliminary signals are stored. For convenience of explanation, the uncompressed image storage 153 is shown as one within the cloud server 100, but the uncompressed image of the main signal is the memory of the instance storing the main signal, and the uncompressed image of the preliminary signal is the memory of the instance storing the main signal. It can be divided into memories of stored instances, which are shown in detail in Figure 1b.

To explain that the main signal and the preliminary signal are stored in different instances, referring to FIG. 1B, the instance in which the main signal is stored and the instance in which the preliminary signal is stored are shown separately. The main signal and the preliminary signal are stored in each instance through different networks, and as described above, the compressed images of both the main signal and the preliminary signal are stored in the compressed image storage 143, which is a common storage. Unlike this, the uncompressed images of the main signal and the preliminary signal are stored in the uncompressed image storage 153a and the uncompressed image storage 153b, which are memories of each instance.

Returning to FIG. 1A, the compressed image monitoring unit 147 operates at all times and monitors the compressed image of the main signal and the compressed image of the preliminary signal stored in the compressed image storage 143. The compressed image monitoring unit 147 compares the compressed image of the main signal and the compressed image of the preliminary signal, and when the size of the two files differs by more than a threshold, the size of only one of the two files is less than the threshold. In some cases, it may be determined that something is wrong. For example, if a black screen occurs in only one file, the compression rate increases significantly and it is stored in less than 1kbyte. Therefore, if the size of the two compressed images differs by more than 10% or the size of only one file is less than 1kbyte, it is judged that there is a problem. do. In addition, even for the same image, the compression rate may be different, so if the size of the two files differs by less than a critical value, for example, 5%, it can be judged as normal. If the compressed image monitoring unit 147 determines that there is an abnormality, the video-uncompressed image converter 150 converts the entire frame of the video decoded by the decoder 110 into an uncompressed image for detailed monitoring and stores the uncompressed image. Save it at (153).

In the case of determining whether a compressed image is abnormal, the compressed image monitoring unit 147 transmits the compressed image of the main signal and the compressed image of the preliminary signal stored in the compressed image storage 143 to the operator terminal 200 via the Web. The operator can monitor the compressed image of the main signal and the compressed image of the preliminary signal. The operator checks the compressed image using the operator terminal 200, and if it is determined that the compressed image of the main signal is different from the compressed image of the preliminary signal, or if there is an error in the still cut, detailed monitoring is performed. For detailed monitoring, the video-uncompressed image converter 150 converts entire frames of the decoded video into uncompressed images and stores them in the uncompressed image storage 153.

Unlike the video-compressed image converter 140 and the compressed image monitoring unit 147, the video-uncompressed image converter 150 and the uncompressed image monitoring unit 157 are operated by the compressed image monitoring unit 147 or the operator. It operates only when it is determined that there is a problem. This is because compressed images require approximately 2 Mb per second for storage based on 1080p video, but uncompressed images require approximately 1.5 Gb per second, requiring a much larger capacity. Therefore, because constantly storing and monitoring uncompressed images causes excessive waste of resources, constant monitoring is performed only on compressed images, and if there is a problem, monitoring is performed on the uncompressed images.

The uncompressed image monitoring unit 157 may monitor the uncompressed image stored in the uncompressed image storage 153 and determine that there is a problem if the uncompressed image is broken or has a black screen. Monitoring of uncompressed images As described for compressed image monitoring, the uncompressed image monitoring unit 157 transmits the uncompressed images stored in the uncompressed image storage 153 to the operator terminal 200 via the web. This allows operators to monitor uncompressed images. If the uncompressed image monitoring unit 157 determines that there is an error in the uncompressed image of the main signal, it requests the operator terminal 200 to switch the preliminary signal to a new main signal. If the operator monitors the uncompressed image through the operator terminal 200 and determines that there is a problem with the uncompressed image of the main signal, the preliminary signal is switched to a new main signal without a request from the uncompressed image monitoring unit 157. can do.

If there is no problem with the converted video image, the compressed video and audio are converted into one container in the multiplexer 160, and the package manager 170 converts them into a transport stream (TS) or MP4, etc. A streaming profile can be created by chunking the container with streaming-capable HLS (HTTP Live Streaming) or MPEG-DASH (Dynamic Adaptive Streaming over HTTP). Although omitted in FIG. 1A for convenience of explanation, it can later be transmitted to the user terminal through Cloud CDN (Contents Delivery Network). In addition to Cloud CDN, the cloud server 100 according to an embodiment may further include a receiving unit that receives images captured by a plurality of cameras.

FIG. 2 is a diagram illustrating an image processing method in existing hardware and steps performed by a cloud server according to an embodiment.

Referring to FIG. 2, the image processing process processed by existing broadcasting equipment and which steps the cloud server 100 according to one embodiment performs are shown. In existing hardware, video captured by multiple cameras (cameras 1 to 4) is compressed and transmitted in the UHD encoder, and decoded again in the UHD decoder to produce uncompressed signals transmitted through a switcher, FS (Frame Store), splitter, multi-encoder, It is provided to the user terminal in the form of HLS (HTTP Live Streaming) through an L3 switch. The cloud server 100 performs functions ranging from a UHD decoder to a packager, and as described in FIG. 1A, a CDN (Contents Delivery Network) may also be included in the cloud server 100.

In the case of the existing hardware method, the uncompressed signal was connected to the redundant monitor 230, and a person manually judged whether the video signal was normal and manually switched it if there was a problem with the main signal. In addition, through monitoring of the FS equipment, a person manually determined that the sync was out of sync (250) and manually corrected the sync according to the late incoming signal.

Since uncompressed signals cannot be transmitted in a cloud environment, it is difficult to monitor which section the problem occurred in. For this purpose, the cloud server 100 has a compressed image monitoring unit 157 that monitors only the compressed image of the encoded video, as described in FIG. 1A. If there is an error in the compressed image, it converts all of the decoded video into an image and monitors it. Including the uncompressed image monitoring unit 147, it is possible to monitor which section a problem has occurred.

Figure 3 is a flowchart to explain a process in which a cloud server monitors video according to an embodiment.

Referring to FIG. 3, steps in which monitoring is performed in a cloud server according to an embodiment are shown. The decoder 110 decodes compressed images captured by a plurality of cameras for time synchronization (305). Compressed images captured by a plurality of cameras may be images compressed by the UHD encoder described in FIG. 2, and each includes a main signal and a preliminary signal. The synchronization unit 120 synchronizes the time of the video decoded by the decoder 110 (310), and the encoder 130 performs encoding (315) on the time-synchronized video so that the video can be transmitted. If there is no problem with the video image, after encoding in the encoder, the compressed video and audio are converted into a single container in the multiplexer 160 and package manager 170, and HLS (HTTP Live Streaming) capable of streaming is used. Alternatively, a streaming profile is created by chunking with MPEG-DASH (Dynamic Adaptive Streaming over HTTP) (320).

The cloud server according to one embodiment includes a video-compressed image converter 140 to monitor in which section an video error occurs. The video-compressed image converter 140 converts the video encoded by the encoder 130 into a compressed image (330) and stores it in the compressed image storage 143 (335). The compressed image monitoring unit 147 constantly monitors (340) the compressed image of the main signal and the compressed image of the preliminary signal. As described in FIG. 1A, when the compressed image of the main signal and the compressed image of the preliminary signal are compared and the size of the two files differs by more than a threshold, in at least one of the following cases, the size of only one of the two files is less than the threshold. It can be determined that there is something wrong. If the compressed image monitoring unit 147 determines that there is a problem, it requests the operation of the video-uncompressed image converter 150 (343). Compressed image monitoring, as described in FIG. 1A, is performed by the compressed image monitoring unit 147 sending the compressed image of the main signal and the compressed image of the preliminary signal stored in the compressed image storage 143 to the operator terminal 200 via the web. By transmitting (346), the operator can monitor the compressed image of the main signal and the compressed image of the preliminary signal. If the operator is monitoring through the operator terminal 200, if the operator determines that the compressed image of the main signal and the compressed image of the preliminary signal are different, or if the operator determines that there is an error in the still cut, the video-free video is monitored through the operator terminal 200. The operation of the compressed image converter 150 may be requested (349).

If it is determined that there is an error in the compressed image, the video-uncompressed image converter 150 converts all uncompressed frames of the video decoded by the decoder 110 into images (350) and stores them in the uncompressed image storage 153. Save (355). The uncompressed image monitoring unit 157 monitors 360 the uncompressed image stored in the uncompressed image storage 153, and may determine that there is a problem if the uncompressed image is broken or has a black screen. As described in FIG. 1A, the uncompressed image monitoring unit 157 transmits the uncompressed image stored in the uncompressed image storage 153 to the operator terminal 200 via the web (365). ) allows the operator to monitor uncompressed images. If the uncompressed image monitoring unit 157 determines that there is an error in the uncompressed image of the main signal, it requests the operator terminal 200 to switch the preliminary signal to a new main signal. If the operator monitors the uncompressed image through the operator terminal 200 and determines that there is a problem with the uncompressed image of the main signal, the operator switches the preliminary signal to a new main signal without a request from the uncompressed image monitoring unit 157 ( switch) can be done.

<How to operate a cloud server for live video monitoring>

Figure 4 is a flowchart illustrating a method of operating a cloud server for live video monitoring according to an embodiment.

Referring to FIG. 4, the cloud server 100 decodes compressed images captured by a plurality of cameras for time synchronization (410). Compressed images captured by multiple cameras each include main signals and preliminary signals. The cloud server 100 synchronizes (415) the time of the decoded images. Synchronization may be performed by matching the same time information to the reference image frame for each camera, but this is only an example and is not limited thereto. The cloud server 100 performs encoding on the time-synchronized video so that the video can be transmitted (420). In order to determine whether there is a problem with the compressed image of the main signal, the cloud server 100 converts a compressed frame of the encoded video, for example, an I frame, into a compressed image and stores it in a compressed image storage (425). The speed of converting video into a compressed image can be, but is not limited to, 1 image per 0.5 second or 1 image per second.

A method of operating a cloud server for live monitoring according to an embodiment determines whether there is an abnormality by monitoring a compressed image stored in a compressed image storage (435), by comparing the compressed image of the main signal and the compressed image of the preliminary signal, If the size of the files differs by more than the threshold, it can be determined that there is a problem in at least one of the two files or cases where only one file size is less than the threshold. For example, if a black screen occurs in only one file, the compression rate increases significantly and it is stored in less than 1kbyte. Therefore, if the size of the two compressed images differs by more than 10% or the size of only one file is less than 1kbyte, it is judged that there is a problem. do. In addition, even for the same image, the compression rate may be different, so if the size of the two files differs by less than a critical value, for example, 5%, it can be judged as normal.

In the case of determining whether the compressed image is abnormal, when the compressed image of the main signal and the compressed image of the preliminary signal stored in the compressed image storage are transmitted to the operator terminal 200 through the Web, the operator can You can monitor compressed images. The operator may check the compressed image using the operator terminal 200 and determine that the compressed image of the main signal is different from the compressed image of the preliminary signal, or may determine that there is an error in the still cut.

If it is determined that there is an error in the compressed image (443), an operation is requested to the video-uncompressed image converter (450) for detailed monitoring, and the entire frame of the decoded video is converted to an uncompressed image and stored in the uncompressed image storage. Do (455). The video-image conversion speed of the video-uncompressed image converter can vary depending on the frame rate of the video. For example, 30 FPS (Frame Per Second) converts to 30 images per second, and 60 FPS converts to 60 images per second. can do. As explained in Figure 1b, unlike the compressed images of both the main signal and the preliminary signal are stored in the compressed image storage, which is a common storage, the uncompressed images of the main signal and the preliminary signal are stored in the uncompressed image storage, which is the memory of each instance. do. Unless there is a problem with the compressed image (447), compressed image monitoring continues (430).

Unlike compressed image monitoring, video-uncompressed image conversion and uncompressed image monitoring operate only when the compressed image monitoring unit or operator determines that there is a problem with the compressed image. This is because, as explained in Figure 1a, compressed images require approximately 2 Mb per second for storage based on 1080p video, but uncompressed images require approximately 1.5 Gb per second, requiring a much larger capacity. Therefore, because constantly storing and monitoring uncompressed images causes excessive waste of resources, constant monitoring is performed only on compressed images, and if there is a problem, monitoring is performed on the uncompressed images.

A method of operating a cloud server for live monitoring according to an embodiment is to monitor (460) the uncompressed image stored in the uncompressed image storage when there is a problem with the compressed image and when the uncompressed image is broken or displays a black screen. It can be determined (465) that something is wrong. As described in FIG. 1A, uncompressed image monitoring also allows the operator to monitor the uncompressed image by transmitting the uncompressed image stored in the uncompressed image storage to the operator terminal 200 via the web. If it is determined (473) that there is an error in the uncompressed image of the main signal, the operator terminal 200 is requested to switch the preliminary signal to a new main signal (480). If the operator monitors the uncompressed image through the operator terminal 200 and determines that there is a problem with the uncompressed image of the main signal, the preliminary signal is switched to a new main signal without a request from the uncompressed image monitoring unit 157. can do. If there is no problem with the uncompressed image (477), monitoring of the uncompressed image can be continued, or if there is no problem with the uncompressed image after a certain period of time, monitoring of the uncompressed image can be terminated. However, even in this case, compressed image monitoring continues.

If there is no problem with the video image, a method of operating a cloud server for live video monitoring according to an embodiment includes converting encoded video and audio signals into one container and chunking the container into a streamable form. The step of chunking and creating a streaming profile may be further included. Specifically, a streaming profile (streaming profile) is created by chunking a container such as Transport Stream (TS) or MP4 into HLS (HTTP Live Streaming) or MPEG-DASH (Dynamic Adaptive Streaming over HTTP) that can stream. profile) can be created and then transmitted to the user terminal through Cloud CDN (Contents Delivery Network). In addition, the method of operating a cloud server for live video monitoring according to an embodiment may further include receiving compressed video captured by a plurality of cameras before decoding 410.

The embodiments described above may be implemented with hardware components, software components, and/or a combination of hardware components and software components. For example, the devices, methods, and components described in the embodiments may include, for example, a processor, a controller, an arithmetic logic unit (ALU), a digital signal processor, a microcomputer, and a field programmable gate (FPGA). It may be implemented using a general-purpose computer or a special-purpose computer, such as an array, programmable logic unit (PLU), microprocessor, or any other device capable of executing and responding to instructions. The processing device may execute an operating system (OS) and software applications running on the operating system. Additionally, a processing device may access, store, manipulate, process, and generate data in response to the execution of software. For ease of understanding, a single processing device may be described as being used; however, those skilled in the art will understand that a processing device includes multiple processing elements and/or multiple types of processing elements. It can be seen that it may include. For example, a processing device may include multiple processors or one processor and one controller. Additionally, other processing configurations, such as parallel processors, are possible.

Software may include a computer program, code, instructions, or a combination of one or more of these, which may configure a processing unit to operate as desired, or may be processed independently or collectively. You can command the device. Software and/or data may be used on any type of machine, component, physical device, virtual equipment, computer storage medium or device to be interpreted by or to provide instructions or data to a processing device. , or may be permanently or temporarily embodied in a transmitted signal wave. Software may be distributed over networked computer systems and stored or executed in a distributed manner. Software and data may be stored on a computer-readable recording medium.

The method according to the embodiment may be implemented in the form of program instructions that can be executed through various computer means and recorded on a computer-readable medium. A computer-readable medium may include program instructions, data files, data structures, etc., singly or in combination, and the program instructions recorded on the medium may be specially designed and constructed for the embodiment or may be known and available to those skilled in the art of computer software. It may be possible. Examples of computer-readable recording media include magnetic media such as hard disks, floppy disks, and magnetic tapes, optical media such as CD-ROMs and DVDs, and magnetic media such as floptical disks. -Includes optical media (magneto-optical media) and hardware devices specifically configured to store and execute program instructions, such as ROM, RAM, flash memory, etc. Examples of program instructions include machine language code, such as that produced by a compiler, as well as high-level language code that can be executed by a computer using an interpreter, etc.

The hardware devices described above may be configured to operate as one or multiple software modules to perform the operations of the embodiments, and vice versa.

As described above, although the embodiments have been described with limited drawings, those skilled in the art can apply various technical modifications and variations based on this. For example, the described techniques are performed in a different order than the described method, and/or components of the described system, structure, device, circuit, etc. are combined or combined in a different form than the described method, or other components are used. Alternatively, appropriate results may be achieved even if substituted or substituted by an equivalent.

Therefore, other implementations, other embodiments, and equivalents of the claims also fall within the scope of the claims described below.

Claims (13)

In the method of operating a cloud server for live video monitoring,
Decoding compressed images captured by a plurality of cameras, the compressed images including main signals and preliminary signals;
synchronizing the time of the decoded video;
Encoding the time-synchronized video;
converting compressed frames of the encoded video into compressed images and storing them in a compressed image storage;
Continuously monitoring the compressed image of the main signal and the compressed image of the preliminary signal stored in the compressed image storage;
If it is determined that there is a problem with the compressed image,
Converts the entire frame of the decoded video into an uncompressed image and stores it in an uncompressed image storage, monitors the uncompressed image stored in the uncompressed image storage, and determines that there is a problem with the uncompressed image of the main signal. Request the terminal to switch the preliminary signal to a new main signal,
If it is determined that there is no problem with the compressed image,
Converting the encoded video and audio signals into one container, chunking the container into a streamable form, and generating a streaming profile.
Including,
How a cloud server operates for live video monitoring.
delete According to paragraph 1,
The step of monitoring the compressed image is,
When the size of the compressed image file of the main signal and the compressed image file of the preliminary signal differs by more than a threshold value, and
When the size of only one of the two compressed image files above is less than the threshold
In at least one case, it is judged that there is an abnormality,
How a cloud server operates for live video monitoring.
According to paragraph 1,
The step of monitoring the uncompressed image is,
If the uncompressed image is broken or black, it is determined that there is a problem,
How a cloud server operates for live video monitoring.
According to paragraph 1,
The step of monitoring the compressed image is,
Transmitting the compressed image of the main signal and the compressed image of the preliminary signal from the compressed image storage to the operator terminal through the Web.
Containing more,
How a cloud server operates for live video monitoring.
According to paragraph 1,
The step of monitoring the uncompressed image is,
Transmitting the uncompressed image from the uncompressed image storage to the operator terminal via the Web
Containing more,
How a cloud server operates for live video monitoring.
In a cloud server for live video monitoring,
a decoder for decoding compressed images captured by a plurality of cameras, wherein the compressed images include main signals and preliminary signals;
a synchronization unit that synchronizes the time of the decoded video;
an encoder for encoding the time-synchronized video;
a video-compressed image converter that converts compressed frames of the encoded video into compressed images and stores them in a compressed image storage;
a compressed image monitoring unit that constantly monitors the compressed image of the main signal and the compressed image of the preliminary signal stored in the compressed image storage;
a video-uncompressed image converter that converts entire frames of the decoded video into uncompressed images and stores them in an uncompressed image storage when the compressed image monitoring unit determines that there is an abnormality;
Uncompressed image monitoring that monitors the uncompressed image stored in the uncompressed image storage and, if it is determined that there is a problem with the uncompressed image of the main signal, requests the operator terminal to switch the preliminary signal to a new main signal. wealth;
A multiplexer (MUX) that converts encoded video and audio signals into one container; and
A package manager that chunks the container into a streamable form and creates a streaming profile.
Including,
Cloud server for live video monitoring.
delete In clause 7,
The compressed image monitoring unit,
When the size of the compressed image file of the main signal and the compressed image file of the preliminary signal differs by more than a threshold value, and
When the size of only one of the two compressed image files above is less than the threshold
In at least one case, it is judged that there is an abnormality,
Cloud server for live video monitoring.
In clause 7,
The uncompressed image monitoring unit,
If the uncompressed image is broken or black, it is determined that there is a problem,
Cloud server for live video monitoring.
In clause 7,
The compressed image monitoring unit,
Transmitting the compressed image of the main signal and the compressed image of the preliminary signal from the compressed image storage to the operator terminal via the Web,
Cloud server for live video monitoring.
In clause 7,
The uncompressed image monitoring unit,
Transmitting the uncompressed image from the uncompressed image storage to the operator terminal via the Web,
Cloud server for live video monitoring.
A computer program stored in a computer-readable recording medium in combination with hardware to execute the method of any one of claims 1 and 3 to 6.

Images