KR101231009B1 - Network video server and video control method thereof - Google Patents

Abstract

The network video server and its video control method receive a plurality of streaming data sets respectively transmitted from a plurality of network cameras connected with the network video server. Each streaming data set has a first streaming data piece having a first image resolution, and a second streaming data piece having a second image resolution lower than the first image resolution. The network video server decodes the first streaming data fragment from one of the network cameras into a video data frame during full-screen mode and outputs the video data frame, and decoded first from all network cameras during split-screen mode. Two pieces of streaming data are combined into video data frames to output video data frames. Thus, it is possible to ensure the sharpness and smoothness of video frames during the full-screen mode and the split-screen mode.

Description

Network video server and its video control method {NETWORK VIDEO SERVER AND VIDEO CONTROL METHOD THEREOF}

The present invention relates to a network video server and a video control method thereof, and more particularly, to a network video server and a video control method for outputting clear and smooth frames in full-screen mode and split-screen mode.

In order to protect from robbery, most residences and workplaces are equipped with an anti-burglar security system. Of these, the fairgrounds and museums additionally have their own surveillance systems for recording, playback and monitoring.

Typical surveillance systems include a plurality of cameras and video servers. Each camera is connected to a video server via a cable and the recorded video data is transferred to the video server for recording. Surveillance systems cameras and video servers have been evolved by technology development and Internet development, and have evolved into web cameras and digital network video servers, respectively. Video data captured by each web camera is converted into streaming data, and the streaming data is transmitted to and stored in a digital network video server. When performing the playback function, the digital network video server decodes the stored streaming data into video data, and then outputs the video data to the display device to play the video data.

In order to ensure the sharpness of the frame during reproduction, the network video server may be set to a mode for outputting streaming data having a high resolution such as D1 resolution. However, streaming data with high resolution has a very large amount of data to be processed, which significantly reduces the performance of the network video server when decoding streaming data, especially when playing back real-time video data. Worse yet, there is a possibility that the network video server decodes the streaming data into incomplete video data, causing discontinuous frames and severe frame lags on the display device.

On the other hand, in order to smoothly reproduce video frames during playback, the network video server may be set to a mode that outputs low resolution streaming data such as CIF resolution. While continuous and uninterrupted frames may be displayed on the screen, these video frames may be blurred and unclear due to the low resolution of the streaming data.

It is a first object of the present invention to provide a video control method of a video server that outputs clear and smooth frames under full-screen mode and split-screen mode.

It is a second object of the present invention to provide a network video server comprising a processor, a plurality of video transmission ports, a storage unit, a decoding unit, an output port and a user interface.

In order to achieve the above object, the video control method receives a plurality of streaming data sets. Each streaming data set has a first streaming data piece and a second streaming data piece. Each first streaming data piece has a first image resolution, each second streaming data piece has a second image resolution, and the first image resolution is higher than the second image resolution. The video control method has a full-screen mode and a split-screen mode.

The full-screen mode decodes the first streaming data fragment from one of the streaming data sets into a video data frame and outputs the video data frame during the full-screen mode.

The split-screen mode decodes a second streaming data piece from each streaming data set into a video data piece, combines the decoded video data pieces into a video data frame, and outputs a video data frame during the split-screen mode.

Video transport ports are coupled to the processor and receive streaming data sets.

The network video server according to the invention comprises a processor, a plurality of video transmission ports, a storage unit, a decoding unit, an output port and a user interface.

The storage unit is coupled to the processor and is controlled by the processor to store the streaming data sets received by the video transmission ports in the storage unit.

The decoding unit is coupled to the processor to decode either one of the first streaming data pieces and the second streaming data pieces of streaming data sets into a video data frame, and outputs the video data frame.

The output port is connected to the decoding unit and outputs decoded video data.

The user interface receives an operation command and sends an operation command to the processor to cause the processor to control the network video server so that the network video server operates according to the operation command.

The processor receives the first streaming data fragment of a preset one of the streaming data sets from the corresponding video transmission port according to the operation command output from the user interface, and transmits the first streaming data fragment to the decoding unit to decode the decoding unit. Decode the first piece of streaming data into a video data frame and output the video data frame during full-screen mode.

The processor receives a second streaming data piece of each streaming data set from a corresponding video transmission port according to an operation command output from the user interface, and transmits the second streaming data piece of each set of streaming data sets to a decoding unit. The decoding unit causes the second streaming data piece of each streaming data set to be decoded into the video data piece, and combines the video data pieces into the video data frame to output the video data frame during the split-screen mode.

In order to ensure the smoothness of video frames when video frames are displayed in split-screen mode, the network video server simply decodes the second streaming data of low resolution to reduce the overhead of the network video server. In order to ensure the sharpness of the video frames when the video frames are displayed in full-screen mode, the network video server instead decodes the first streaming data having a high resolution and outputs the video frames having a higher definition. Thus, the performance of the network video server can be balanced taking into account clear and smooth video frames during the full-screen mode and the split-screen mode.

According to the present invention, there is provided a network video server for outputting clear and smooth frames under full-screen mode and split-screen mode, and a video control method of the network video server.

Other objects, advantages and novel features of the present invention will become more apparent from the following detailed description with reference to the accompanying drawings.

1 is a schematic diagram of a network video server according to the present invention applied to a network surveillance system.
2 is a functional block diagram of the network video server of FIG.

Referring to FIG. 1, a network video server 20 according to the present invention is applied to a network surveillance environment, is connected to a plurality of network cameras 10 through a network 30, and is connected to a plurality of network cameras 10 from a network camera 10. Receive streaming data sets respectively. Each streaming data set has a first streaming data fragment and a second streaming data fragment output from each network camera 10. The first streaming data piece and the second streaming data piece of each streaming data set have a first image resolution and a second image resolution, respectively, wherein the first image resolution is higher than the second image resolution. For example, the first image resolution follows D1 resolution or 720x480 pixels, 2M resolution or 1600x1200 pixels, 1.3M resolution or 1280x1024 pixels, and the second image resolution follows CIF (Common Intermediate Format) resolution or 360x240 pixels.

Referring to FIG. 2, the network video server 20 includes a processor 21, a plurality of video transmission ports 22, a storage unit 23, a decoding unit 24, an output port 25 and a user interface 26. )

Processor 21 executes a video control process. The video transmission ports 22 are connected to the processor 21 and are each connected to the network cameras 10 via the network 30 and configured to receive streaming data sets from the network cameras 10, respectively. The storage unit 23 is connected to the processor 21 and controlled by the processor 21 to store the streaming data sets respectively received from the video transmission ports 22 in the storage unit 23. The decoding unit 24 is connected to the processor 21 to decode the first streaming data pieces or the second streaming data pieces into the video data pieces, and outputs the video data pieces. The output port 25 is connected to the decoding unit 24 and is configured to be connected to the display device 40 to transmit the pieces of video data processed by the decoding unit 24 to the display device 40. The user interface 26 receives an operation command for operating the network video server 20, and transmits an operation command to the processor 21 to cause the processor 21 to control the network video server 20 so as to transmit the network video server 20. The server 20 functions to operate according to an operation command. For example, users may set the network video server 20 to a real time mode or a playback mode through the operation of the user interface 26. During the real time mode, the processor 21 receives streaming data sets from the video transmission ports 22, sends the first streaming data pieces or the second streaming data pieces to the decoding unit 24, and the decoding unit 24. ) To decode the first streaming data pieces or the second streaming data pieces into video data and output the video data. During the playback mode, the processor 21 retrieves the first streaming data pieces or the second streaming data pieces stored in the storage unit 23 and transmits them to the decoding unit 24, and controls the decoding unit 24 to control the first. Decode the streaming data pieces or the second streaming data pieces into video data and output the video data.

The video control process executed by the processor 21 may be applied when the network video server 20 is in the real time mode or the playback mode, and the full-screen mode and the split-screen selected through the operation of the user interface 26. Has a mode. When the full-screen mode is selected, the network camera 10 is further selected through the operation of the user interface 26. The processor 21 receives the first streaming data fragment output by the selected network camera 10 from the corresponding video transmission port 22 when the network video server 20 is in the real time mode, or the network video server ( When 20) is in the playback mode, the storage unit 23 retrieves the first streaming data piece associated with the selected network camera 10. The processor 21 sends the received or retrieved first streaming data fragment to the decoding unit 24, causing the decoding unit 24 to decode the first streaming data fragment into a video data frame to be displayed for full-screen mode. The video data frame is sent to the output port 25. When the split-screen mode is selected, all network cameras 10 are automatically selected. The processor 21 receives the second streaming data fragment output by each network camera 10 from the corresponding video transmission port 22 when the network video server 20 is in the real time mode, or the network video server ( If 20 is in the playback mode, the second streaming data piece associated with the network camera 10 is retrieved from the storage unit 23. The processor 21 further sends the received or retrieved second streaming data to the decoding unit 24 to cause the decoding unit 24 to decode the second streaming data piece into the video data piece, and to display all network cameras 10. Video data pieces into a video data frame to be displayed for the split-screen mode to send the video data frame to the output port 25. During the split-screen mode, each video data frame may be divided into a plurality of sub-windows equal to the number of network cameras 10. For example, if there are sixteen network cameras 10, each video data frame has sixteen sub-windows.

Processor 21 may be implemented by a physically multi-threaded approach. For example, suppose there are four network cameras 10. When each network camera 10 simultaneously outputs the first streaming data fragment and the second streaming data fragment at the same time, the first streaming data fragments and the second streaming data fragments of the network cameras 10 are simultaneously received to thereby receive the first stream data. And eight threads are required between the processor 21 and the video transmission ports 22 to store the second streaming data pieces in the storage unit 23. In addition, eight threads are required between the processor 21 and the decoding unit 24 to transfer the first and second pieces of streaming data from the processor 21 to the decoding unit 24, from the storage unit 23. At least one thread is required between the processor 21 and the storage unit 23 to retrieve the first and second streaming unit data.

When the network video server 20 is in the real time mode and the split-screen mode, the processor 21 adopts four of the threads between the processor 21 and the video transmission ports 22, so that the video transmission ports Send the second streaming data pieces received from 22 to the decoding unit 24 via four threads. When the network video server 20 is in the real time mode and the full-screen mode, the processor 21 adopts one of the threads between the processor 21 and the video transmission ports 22 to correspond to the corresponding video transmission port ( The second streaming data pieces received from 22 are sent via a thread to the decoding unit 24. The operation of the processor 21 when the network video server 20 is in the playback mode and the split-screen mode or the full-screen mode is stored with the processor 21 in order for the processor 21 to retrieve the requested streaming data. It is basically similar to the case where the network video server 20 is in real time mode and in split-screen mode or full-screen mode, except that the threads between the units 23 still need to be used. Since the real time mode and the playback mode of the network video server 20 do not exist at the same time, a thread between the processor 21 and the decoding unit 24 in order to transmit corresponding streaming data from the processor 21 to the decoding unit 24. Only four of these are required. Thus, program coding can be simplified, and memory can be further saved so that the overall operating performance of the network video server 20 is improved.

In short, the present invention simultaneously receives from each network camera 10 a piece of streaming data having a high resolution such as D1, 2M or 1.3M resolution and a piece of streaming data having a low resolution such as CIP resolution. While the network video server 20 is in the split-screen mode, when the users view the split-screen display captured by the network camera 10 in the real time mode or the playback mode, the network video server 20 is configured to display each network camera ( Decoding the second streaming data from 10) and combining all the decoded second streaming data to form and output a video data frame, thereby reducing the overhead of the network video server 20 and displaying the video data frame. When you do smoothness can be secured. If the user sees a full-screen display taken by one of the network cameras 10 in real time mode or playback mode while the network video server 20 is in full-screen mode, the network video server 20 is connected to the network. By decoding the first streaming data from the camera 10 to form a video data frame, the sharpness of the output frame can be secured. Thus, the present invention can provide the desired resolution and performance to match the actual surveillance conditions to output clear and smooth video data frames in full-screen mode and split-screen mode.

While the various features and advantages of the present invention, together with the configuration and function of the present invention, have been described clearly above, the disclosed subject matter is merely illustrative. The details can be modified, and in particular within the basic principles of the invention the shape, size and arrangement of the components can be modified to the extent indicated by the broad and general meaning of the terminology expressed in the appended claims.

10: camera
20: network video server
30: network

Claims (8)

A video control method of a video server for receiving a plurality of streaming data sets, each streaming data set having a first streaming data piece having a first image resolution and a second streaming data piece having a second image resolution, In the video control method of the video server, the first image resolution is higher than the second image resolution,
Selectively extract a first streaming data fragment of one of a preset and received streaming data set and a previously received streaming data set to decode it into a video data frame, output the video data frame, and receive the previously received The streaming data set is further stored in the video server; And
Extract a second streaming data piece of each of the preset received and each received streaming data set and each received streaming data set, decode it into video data pieces, combine the decoded video data pieces into a video data frame, and And a split-screen mode for outputting the video data frames, wherein each previously received set of streaming data is further stored in the video server. delete A network video server executing the video control method according to claim 1,
A processor;
A plurality of video transmission ports coupled to the processor to receive the streaming data sets;
A decoding unit coupled to the processor to decode any one of the first streaming data pieces and the second streaming data pieces of the streaming data sets into the video data frame and output the video data frame;
An output port connected to the decoding unit to output a decoded video data frame; And
A user interface for receiving an operation command and transmitting the operation command to the processor to cause the processor to control the network video server so that the network video server operates according to the operation command,
During the full-screen mode, the processor receives a first set of streaming data pieces of one of the streaming data sets from a corresponding video transmission port according to the operation command output from the user interface, and the first Send one streaming data fragment to the decoding unit to cause the decoding unit to decode the first streaming data fragment into the video data frame, output the video data frame,
During the split-screen mode, the processor receives a second streaming data piece of each streaming data set from a corresponding video transmission port in accordance with the operation command output from the user interface, and each of the streaming data sets Send the second streaming data piece of the set to the decoding unit to cause the decoding unit to decode the second streaming data piece of each streaming data set into the video data piece, and combine video data pieces into the video data frame. And output the video data frame. The method of claim 3, wherein
A storage unit coupled to the processor, the storage unit controlled by the processor to store the streaming data sets received by the video transmission ports,
During the full-screen mode, the processor receives a first set of streaming data pieces of the streaming data sets from a corresponding video transmission port or from the storage unit in accordance with the operation command output from the user interface. Retrieve a first streaming data piece of the preset streaming data set, and send the first streaming data piece to the decoding unit to cause the decoding unit to decode the first streaming data piece into the video data frame, Output the video data frame,
During the split-screen mode, the processor retrieves or receives a second streaming data piece of each of the streaming data sets from the storage unit or corresponding video transmission port in accordance with the operation command output from the user interface. And send a second streaming data piece of each streaming data set to the decoding unit to cause the decoding unit to decode a second streaming data piece of each streaming data set into the video data piece. And combine the video frames to output the video data frames. The method of claim 3, wherein
First streaming data fragments and second streaming data fragments of the streaming data sets, each running between the processor and the video transmission ports, twice the number of the video transmission ports and received from the video transmission ports, respectively. A plurality of first threads for respectively transmitting the data to the processor; And
Executed between the processor and the decoding unit, doubling the number of video transmission ports, and transmitting the first streaming data pieces and the second streaming data pieces of the streaming data sets from the processor to the decoding unit, respectively. Further comprising a plurality of second threads. The method of claim 4, wherein
First streaming data fragments and second streaming data fragments of the streaming data sets, each running between the processor and the video transmission ports, twice the number of the video transmission ports and received from the video transmission ports, respectively. A plurality of first threads for respectively transmitting the data to the processor; And
A one of the first streaming data pieces and the second streaming data pieces of the streaming data sets from the processor to the decoding unit, which is executed between the processor and the decoding unit and is equal to the number of the video transmission ports. And further comprising a plurality of second threads, each transmitting. The method of claim 5, wherein
Running between the processor and the transmission ports, twice the number of the video transmission ports, respectively, the first streaming data fragments and the second streaming data fragments of the streaming data sets received from the video transmission ports, respectively. A plurality of first threads transmitting to the processor, and a third thread running between the processor and the transmission ports and retrieving the streaming data sets from a storage unit; And
A plurality of executions between the processor and the decoding unit, twice the number of the video transmission ports, and transmitting first streaming data fragments and second streaming data fragments of the streaming data sets from the processor to the decoding unit, respectively. Further comprising second threads of the network video server. The method according to claim 6,
The first streaming data fragments and the second streaming data fragments of the streaming data sets received from the video transmission ports, each being twice the number of the video transmission ports, running between the processor and the video transmission ports. A plurality of first threads each transmitting to transport ports, and a third thread running between the processor and the video transmission ports and retrieving the streaming data sets from the storage unit; And
A one of the first streaming data pieces and the second streaming data pieces of the streaming data sets from the processor to the decoding unit, which is executed between the processor and the decoding unit and is equal in number to the video transmission ports. And a plurality of second threads, each transmitting.

Images