KR101668858B1 - Method for transmitting multi-channel video stream, and surveillance system using the same method - Google Patents

Method for transmitting multi-channel video stream, and surveillance system using the same method Download PDF

Info

Publication number
KR101668858B1
KR101668858B1 KR1020150059196A KR20150059196A KR101668858B1 KR 101668858 B1 KR101668858 B1 KR 101668858B1 KR 1020150059196 A KR1020150059196 A KR 1020150059196A KR 20150059196 A KR20150059196 A KR 20150059196A KR 101668858 B1 KR101668858 B1 KR 101668858B1
Authority
KR
South Korea
Prior art keywords
camera
video stream
resolution
channel
camera channel
Prior art date
Application number
KR1020150059196A
Other languages
Korean (ko)
Other versions
KR20150124409A (en
Inventor
안기옥
김민기
이태원
김은승
유재성
채옥삼
Original Assignee
주식회사 이타기술
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 주식회사 이타기술 filed Critical 주식회사 이타기술
Publication of KR20150124409A publication Critical patent/KR20150124409A/en
Application granted granted Critical
Publication of KR101668858B1 publication Critical patent/KR101668858B1/en

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00—Television systems
    • H04N7/18—Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast
    • G—PHYSICS
    • G08—SIGNALLING
    • G08B—SIGNALLING OR CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS
    • G08B13/00—Burglar, theft or intruder alarms
    • G08B13/18—Actuation by interference with heat, light, or radiation of shorter wavelength; Actuation by intruding sources of heat, light, or radiation of shorter wavelength
    • G08B13/189—Actuation by interference with heat, light, or radiation of shorter wavelength; Actuation by intruding sources of heat, light, or radiation of shorter wavelength using passive radiation detection systems
    • G08B13/194—Actuation by interference with heat, light, or radiation of shorter wavelength; Actuation by intruding sources of heat, light, or radiation of shorter wavelength using passive radiation detection systems using image scanning and comparing systems
    • G08B13/196—Actuation by interference with heat, light, or radiation of shorter wavelength; Actuation by intruding sources of heat, light, or radiation of shorter wavelength using passive radiation detection systems using image scanning and comparing systems using television cameras
    • G08B13/19665—Details related to the storage of video surveillance data
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/236—Assembling of a multiplex stream, e.g. transport stream, by combining a video stream with other content or additional data, e.g. inserting a URL [Uniform Resource Locator] into a video stream, multiplexing software data into a video stream; Remultiplexing of multiplex streams; Insertion of stuffing bits into the multiplex stream, e.g. to obtain a constant bit-rate; Assembling of a packetised elementary stream

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)

Abstract

A method of transmitting a multi-channel video stream in cooperation with a transmission device connected to a plurality of camera devices, the method comprising: generating a request resolution for each camera channel corresponding to each of the plurality of camera devices, Transmitting the requested resolution for each camera channel to the transmitting device, and receiving a video stream including a plurality of camera channels from the transmitting device, wherein the video stream is based on the requested resolution for each camera channel And the plurality of camera channels whose resolution is adjusted.

Description

METHOD FOR TRANSMITTING MULTI-CHANNEL VIDEO STREAM, AND SURVEILLANCE SYSTEM USING THE SAME METHOD,

The present invention relates to a multi-channel video stream transmission method and a control system using the same.

The control system installs a plurality of CCTV cameras in the surveillance area and outputs images received from a plurality of CCTV cameras to the display. However, since the conventional control system outputs images on a two-dimensional plane, it is difficult to quickly identify an image in which an event occurs, and it may be difficult to quickly check the position where the camera is installed even if an image in which an event occurs is checked.

Recently, the control system has been developed to visualize and display the surveillance structure as a three-dimensional structural model, and to mix and display the CCTV video stream inputted in real time in a virtual environment. Such a three-dimensional structural model-based control system can provide intuitive and efficient integrated control. However, the conventional three-dimensional structural model-based control system has limited network and system resources capable of processing a high-resolution video stream. Therefore, the control system based on the three-dimensional structure model up to now has a limitation in reducing the number of cameras or lowering the resolution, and there is a limit in that it is difficult to represent a high-resolution multi-channel video stream in real time on a three-dimensional structure.

In particular, the number of cameras to be controlled is increasing exponentially with the introduction of IP-based digital cameras. Therefore, since systems with limited resources are difficult to simultaneously encode / decode multi-channel video streams, the system must be continuously added, and the more the number of cameras, the more serious this phenomenon becomes. Also, as the number of camera channels increases, the network bandwidth required for video stream transmission increases, which makes it difficult to increase the number of camera channels. These barriers are still limited even with video streaming techniques with variable data rates.

The present invention provides a multi-channel video stream transmission method and a control system using the multi-channel video stream transmission method. In particular, a problem to be solved by the present invention is to provide a method of transmitting a multi-channel video stream at a variable resolution according to a three-dimensional user's viewpoint, a method of stream transmission without a temporary interruption when changing to a variable resolution, and a control system using the method.

A method of transmitting a multi-channel video stream in cooperation with a transmission apparatus connected to a plurality of camera apparatuses, the method comprising: Generating a requested resolution for each channel, transmitting the requested resolution for each camera channel to the transmitting device, and receiving a video stream including a plurality of camera channels from the transmitting device, And the plurality of camera channels whose resolution is adjusted based on the requested resolution for each camera channel.

The method for transmitting a multi-channel video stream may further include receiving positioning information for each camera channel, the position and size of each of the plurality of camera channels in the video stream from the transmission device.

The multi-channel video stream transmission method may further include separating the plurality of camera channels from the video stream based on the camera-channel-specific arrangement information, and outputting the separated camera channels to a designated location .

In the multi-channel video stream transmission method, the designated location may be a location mapped to a three-dimensional structure model.

A method of transmitting a multi-channel video stream received from a plurality of camera apparatuses by a transmission apparatus of a control system according to another embodiment of the present invention, the method comprising: receiving a request resolution for a camera channel of each of the plurality of camera apparatuses; Identifying a plurality of camera channels included in the plurality of input video streams, changing resolution of each camera channel based on the requested resolution of the plurality of camera channels identified, And combining the plurality of camera channels whose resolution is changed to generate an output video stream.

The multi-channel video stream transmission method may further include storing the received requested resolution, and transmitting the received requested resolution to a plurality of lower layer transmission devices.

The step of transmitting to the plurality of lower layer transmission apparatuses may include separating the received request resolution for each camera channel related to each of the plurality of lower layer transmission apparatuses and transmitting the separated requested resolution to the lower layer transmission apparatuses . ≪ / RTI >

The receiving a plurality of input video streams may receive a video stream from the plurality of lower layer transmission devices.

The receiving of the requested resolution may further comprise receiving the requested resolution from the client device and transmitting the output video stream to the client device.

The multi-channel video stream transmission method may further include generating placement information of each of the plurality of camera channels included in the output video stream, and transmitting the placement information to the client apparatus, The location and size of each camera channel transmitted in the output video stream.

The multi-channel video stream transmission method stores the requested resolution for each camera channel, the location and size of each camera channel in the received video stream, and the location and size of each camera channel in the output video stream in the video stream transmission information table The method comprising the steps of:

The multi-channel video stream transmission method includes receiving a resolution change request for an arbitrary camera channel, and changing a resolution requested for the arbitrary camera channel stored in the video stream transmission information table to a resolution included in the resolution change request Step < / RTI >

The control system according to another embodiment of the present invention is a control system for generating a request resolution for each camera channel for a camera channel corresponding to each of a plurality of camera devices and transmitting the requested resolution for each camera channel, The resolution of the plurality of camera channels transmitted from each of the plurality of camera devices is changed based on the requested resolution for each camera channel, and the output video generated by combining the plurality of camera channels whose resolution is changed And a transmission device for transmitting the stream to the client device.

Wherein the transmission device generates placement information of each of the plurality of camera channels included in the output video stream and transmits the placement information to the client device, Location, and size.

The client apparatus may separate the plurality of camera channels from the output video stream based on the placement information, and output each separated camera channel to a designated position.

The designated position may be a position mapped to the three-dimensional structural model.

According to the embodiment of the present invention, since the video stream is transmitted based on the resolution requested by the client apparatus, the network bandwidth can be efficiently used. According to the embodiment of the present invention, it is easy to expand the number of cameras that the client apparatus can control. In addition, according to the embodiment of the present invention, intuitive and efficient integrated control can be performed based on a three-dimensional virtualization technique of mixing three-dimensional structure information and camera images input in real time into a virtual environment.

1 is a diagram illustrating a conventional multi-channel video stream transmission method.
2 is a schematic block diagram of a control system according to an embodiment of the present invention.
3 to 6 are diagrams illustrating a method of transmitting a multi-channel video stream according to an embodiment of the present invention.
7 is an exemplary diagram of a control system according to another embodiment of the present invention.
8 and 9 are flowcharts of a method for transmitting a multi-channel video stream according to an embodiment of the present invention.
10 is a configuration diagram of a transmission apparatus according to an embodiment of the present invention.

Hereinafter, embodiments of the present invention will be described in detail with reference to the accompanying drawings so that those skilled in the art can easily carry out the present invention. The present invention may, however, be embodied in many different forms and should not be construed as limited to the embodiments set forth herein. In order to clearly illustrate the present invention, parts not related to the description are omitted, and similar parts are denoted by like reference characters throughout the specification.

Throughout the specification, when an element is referred to as "comprising ", it means that it can include other elements as well, without excluding other elements unless specifically stated otherwise.

Also, the terms " part, "" module," and " module ", etc. in the specification mean a unit for processing at least one function or operation and may be implemented by hardware or software or a combination of hardware and software have.

1 is a diagram illustrating a conventional multi-channel video stream transmission method.

Referring to FIG. 1, the transmission server 11 of the conventional control system 10 encodes the camera image as it is and transmits it to the client 13. The client 13 decodes the received images and outputs them according to the display resolution.

As described above, in the conventional control system 10, since the client 13 outputs the received images according to the display resolution, the transmission server 11, which does not know the resolution per image set by the client 13, Quot; When the control system 10 is installed, the encoding resolution can be set in advance on the basis of the image-specific resolution set in the client 13, but it is difficult for the client 13 to vary the resolution for each image already set. Therefore, only a video stream having a fixed transmission rate can be transmitted in a fixed network bandwidth, so that the number of video channels that can be transmitted is limited.

In the following, a method of simultaneously transmitting a multi-channel video stream and a control system using the same will be described.

FIG. 2 is a schematic configuration diagram of a control system according to an embodiment of the present invention, and FIGS. 3 to 6 are views illustrating a method of transmitting a multi-channel video stream according to an embodiment of the present invention.

2, the control system 100 includes a plurality of camera devices 20-1, 20-2, ..., 20-n, at least one transmission device 200, and a client device 300 .

The plurality of camera apparatuses 20-1, 20-2, ..., 20-n are installed at designated locations and are connected to the transmission apparatus 200 via a wired or wireless communication network. Each of the plurality of camera apparatuses transmits a video stream to the transmission apparatus 200. Each of the plurality of camera apparatuses can receive a control signal from the transmission apparatus 200 and operate according to the control signal.

The transmission apparatus 200 receives a video stream from a plurality of camera apparatuses, bundles the received video streams into one video stream, and transmits the video stream to the client apparatus 300. If the video stream of the camera apparatus is defined as a camera channel, the transmission apparatus 200 encodes and mixes (multiplexes) multiple channels and outputs the multiplexed signals. At this time, the transmitting apparatus 200 may receive the control signal from the client apparatus 300, adjust the resolution (size) of each of the camera channels based on the control signal, and then transmit the video stream to the client apparatus 300 . Here, the control signal includes the requested resolution for each camera channel. The number of transmission devices 200 may vary according to the number of camera devices and the requested resolution of the client device 300, and may be hierarchically connected as a tree structure.

The transmitting apparatus 200 receives a real time video stream from n camera apparatuses. The camera channel output from the camera device or the camera device has a unique identifier. The transmitting apparatus 200 and each camera apparatus can transmit and receive a video stream using a real time streaming protocol (RTSP).

The transmitting apparatus 200 mixes n input video streams to generate one output video stream. The output video stream includes n camera channels. The transmission apparatus 200 divides the output video stream into n regions and maps (arranges) n camera channels to n regions. That is, the transmission apparatus 200 divides a frame into n regions. Then, the transmission apparatus 200 generates placement information for each camera channel on the basis of the position information of the output video stream in which n camera channels are arranged. At this time, the n regions may have the same size or different sizes depending on the camera channel. The transmission apparatus 200 determines the image size of each camera channel based on the requested resolution of each camera channel transmitted from the client apparatus 300.

The transmitting apparatus 200 transmits the output video stream to the receiving apparatus. The output video stream may be transmitted using RTSP. The receiving device may be the client device 300 or another transmitting device of the controlling system.

The transmitting apparatus 200 transmits the arrangement information per camera channel in the output video stream to the n camera channels to the receiving apparatus. The arrangement information for each camera channel may be transmitted using a protocol such as HTTP and ARP.

The client device 300 receives the video stream from the transmission device 200. The client device 300 displays the received video stream. At this time, the client device 300 may map each of the plurality of camera channels included in the video stream to a three-dimensional structure model and output the same. To this end, the client device 300 models the surveillance area (structure) where the camera device is installed as a three-dimensional structural model, and maps each camera channel to a specific point in the three-dimensional structural model based on the installed position of the camera device.

The client device 300 can determine the resolution of each of a plurality of camera devices (camera channels). The client device 300 determines a request resolution for each camera channel and transmits a control signal including a request resolution list for each camera channel to the transmission device 200. For example, it is possible to request a high-resolution image from a camera device installed at a first location, and to request an image with a resolution lower than the first location from a camera device installed at a second location. The client device 300 may request a resolution change and change the resolution of at least one camera channel whenever the user's three-dimensional line of sight changes. Here, the resolution corresponds to the size of the image.

The client device 300 encodes / decodes using a multi-GPU (Multi-GPU). The client device 300 can upload the variable size video to the GPU in a double buffer manner in consideration of the limited GPU memory and the copy bandwidth from the CPU to the GPU. In addition, the client device 300 may use a GPU kernel algorithm and an OpenGL texture algorithm that simultaneously decode a plurality of camera channels.

Referring to FIG. 3, the client device 300 receives the resolution of each camera channel. For example, the resolution of the first camera device CCTV1 may be 980x445, and the resolution of the second camera device CCTV2 may be 353x381. The client device 300 may provide an interface screen capable of determining the resolution of each camera channel. The client device 300 may provide an interface screen that allows the user to determine the camera channel resolution by increasing or decreasing the image size.

Referring to FIG. 4, the client apparatus 300 transmits a resolution list for each camera channel to the transmission apparatus 200. That is, the client device 300 requests resolution required for each camera channel. At this time, the client device 300 can adjust the resolution (image size) of the camera channel input according to the display screen and transmit the resized resolution list.

Referring to FIG. 5, the transmission apparatus 200 adjusts the resolution of each camera channel based on the requested resolution for each camera channel. The transmitting apparatus 200 transmits the encoded video stream to the client apparatus 300.

Referring to FIG. 6, the client device 300 receives a video stream including a plurality of camera channels. The client device 300 can output each of the plurality of camera channels included in the video stream to the mapped positions of the three-dimensional structural model based on the camera channel information and the mapping information of the three-dimensional structural model.

7 is an exemplary diagram of a control system according to another embodiment of the present invention.

Referring to FIG. 7, a plurality of transmission apparatuses may be hierarchically connected. For example, each of the plurality of first layer transmission devices 200-1a, 200-1b, ..., and 200-1m is connected to a plurality of camera devices. The primary layer transmission apparatus may correspond to the transmission apparatus described with reference to FIG.

A plurality of the first layer transmission devices 200-1a to 200-1m may be connected to the second layer transmission device 200-2a. The second layer transmission apparatus may correspond to the reception apparatus described with reference to FIG.

The secondary layer transmission apparatus 200-2a receives m real time video streams. The second layer transmission apparatus 200-2a mixes m input video streams to generate one output video stream. The output video stream may include n * m camera channels. The second layer transmission apparatus generates placement information for each camera channel based on the position information of the output video stream in which n * m camera channels are arranged. The second layer transmission apparatus 200-2a may divide the output video stream into n * m regions based on the requested resolution for each camera channel. The requested resolution for each camera channel may be requested from the client device 300. [

The secondary layer transmission apparatus 200-2a transmits the output video stream to the receiving apparatus. The output video stream may be transmitted using RTSP. The receiving apparatus may be the client apparatus 300 or a tertiary layer transmitting apparatus.

At least one transmission device, such as the secondary layer transmission device 200-2a, may be added to the secondary layer. Also, the output video stream of the transmission devices of the second layer can be transmitted to the transmission device of the third layer. On the other hand, the output video stream of the primary layer transmission device may be transmitted to the transmission device or client device 300 of the tertiary layer or higher.

Thus, the transmitting apparatus 200 mixes input video streams to generate one output video stream. Then, the transmitting apparatus 200 transmits the arrangement information for each camera channel in the output video stream to the receiving apparatus. Then, the receiving apparatus can identify and separate each camera channel from the input video stream based on the camera channel-by-camera placement information.

In the following, video stream transmission information will be described.

The camera channel has unique identification information (e.g., GUID) associated with the camera device. The video stream output from the camera device is transmitted to the designated destination device. To this end, the camera device / transmission device / client device manages video stream transmission information for each camera channel. The video stream transmission information includes channel information received from a previous node based on the current node and channel information transmitted to the next node. That is, as shown in Table 1, video stream packet information includes previous node information (IP address of previous node, RTSP address, conversion information including information converted from previous node), next node information (IP address of next node, Conversion information including the information converted in step < RTI ID = 0.0 > The conversion information may include conversion information including the requested resolution requested by the client device 300 and the size and location in the input / output video stream. The address of the next node may be the address of the device receiving the output video stream, which may be the address of the client device / transfer device. The location and size of the input video stream (the video stream received from the previous node) determines where the corresponding camera channel is located and transmitted in the video stream transmitted from the previous node (e.g., a camera device or a lower layer of the transmission device) . The position and size of the output video stream (video stream transmitted to the next node) are information indicating where the corresponding camera channel is disposed and transmitted in the video stream output from the transmission apparatus 200. The transmitting apparatus 200 arranges a plurality of camera channels in the output video stream and transmits the arrangement information of the plurality of camera channels (size and position in the transmission video stream) to the receiving apparatus. At this time, the transmitting apparatus 200 can transmit the arrangement information for each camera channel to the receiving apparatus through a protocol different from the video stream, for example, HTTP.

The client device / transmission device can store and update the video stream transmission information table as shown in Table 1. [ The video stream transmission information table may be shared in the client device / transmission device. Or the video stream transmission information table may be stored in a separate storage device, and the client device / transmission device may access the storage device to record or refer to the video stream transmission information table. The transmitting apparatus can manage only the tables for the camera apparatuses connected to the transmitting apparatus.

Camera identification information
(GUID) Previous node (origin) information Next node (destination) information Previous
Of the node
IP address Previous
Of the node
RTSP address Conversion Information next
Of the node
IP address Conversion Information request
resolution  The position and size of the input video stream received from the previous node Resolution requested Location and size of the output video stream to be sent to the next node CCTV1 CCTV2

The video stream transmission information is determined by the number of CCTV cameras. The previous node may be a CCTV camera, or may be a transport device (video stream encoding server) of a previous (lower) layer. The next node may be the next (higher) layer transport device (video stream encoding server), or it may be the end client. The size of any video channel in the received video stream may be greater than the output video stream. That is, the current node (transmitting apparatus) can convert the size of a video channel included in the received video stream based on the requested resolution and output it.

The transmission apparatus 200 records the requested resolution received from the client apparatus 300 in the video stream transmission information table. The transmission apparatus 200 determines the size and arrangement position of each camera channel based on the requested resolution of each camera channel recorded in the video stream transmission information table. The transmission apparatus 200 records the size and arrangement position of each camera channel in the video stream transmission information table. Then, the transmitting apparatus 200 transmits the arrangement information per camera channel (size and position in the transmission video stream) to the receiving apparatus.

The arrangement information for each camera channel can be transmitted via HTTP as shown in Table 2, for example. Thus, the video stream transmission information transmitted via HTTP is simplified, and the complex information related to the video stream is stored in the video stream transmission information table.

<? xml version = "1.0" encoding = "utf-8">
<! - ITA Technology Inc. Video Info ,. Video Control System ->
<! - Algorithm Method List ->
<vodeo-list>
"video-source index =" 1 "org-width =" 1920 "org-height =" 1080 "type =" rtsp "codec =" h264 "
<guid> EB4153F1-FA55-409E-BEFB-07565FCDA683 </ guid>
<source-ip> 127.0.0.1 </ source-ip>
<destation-ip> 127.0.0.126 </ destation-ip>
<rtsp-address> rtsp: //127.0.0.1: 554 / h264 / live </ rtsp-address>
<width> 200 </ width>
<height> 100 </ height>
<top> 0 </ top>
<bottom> 100 </ bottom>
<left> 300 </ left>
<right> 499 </ right>
</ video-source>
"video-source index =" 2 "org-width =" 1920 "org-height =" 1080 "type =" rtsp "codec =" h264 "
<guid> EB4153F1-FA55-409E-BEFB-07565FCDA683 </ guid>
<source-ip> 127.0.0.2 </ source-ip>
<destation-ip> 127.0.0.126 </ destation-ip>
<rtsp-address> rtsp: //127.0.0.2: 554 / h264 / live </ rtsp-address>
<width> 300 </ width>
<height> 150 </ height>
<top> 0 </ top>
<bottom> 150 </ bottom>
<left> 0 </ left>
<right> 299 </ right>
</ video-source>
<! - ... ->
</ vodeo-list>

8 and 9 are flowcharts of a method for transmitting a multi-channel video stream according to an embodiment of the present invention.

Referring to FIG. 8, the client device 300 is connected to all the camera devices connected to the control system, and can view images in real time through camera channels connected to the respective camera devices. If it is not necessary to monitor all the camera channels at the same resolution, the client device 300 can set different resolutions for each camera channel as described with reference to FIGS.

The client device 300 generates the requested resolution for each camera channel (S110). The requested resolution for each camera channel can be input from the user. For this, the client device 300 may provide an interface screen that allows the user to determine the camera channel resolution by increasing or decreasing the image size. The camera devices arranged in the three-dimensional structural model can be automatically aligned on the display screen to determine the resolution for each camera channel. For example, the client apparatus 300 may determine a resolution for each camera channel by dividing an area where a horizontal size and a vertical size are fixed, as shown in FIG. If the sizes of the divided regions are different, the resolutions of the camera channels are set differently. If the sizes of the divided regions are the same, the resolutions of the camera channels are set equal to each other.

The client device 300 transmits the requested resolution for each camera channel to the transmission device 200 (S120). The client apparatus 300 requests resolution of the camera channel to the highest layer transmission apparatus. Each camera channel has unique identification information.

The client device 300 receives the video stream and the arrangement information for each camera channel from the transmission device 200 (S130). The video stream includes a plurality of camera channels. The arrangement information for each camera channel indicates the position and size of each camera channel in the video stream. Each camera channel may have different resolution depending on the priority. The priority is determined based on the resolution requested by the client device 300, and the priority of the camera channel having a large requested resolution (size) is high. That is, the camera channel having the higher priority requested by the client device 300 has a higher resolution than the camera channel having the lower priority. Since the transmission apparatus must transmit the camera channels by dividing the area where the horizontal size and the vertical size are fixed, it may be difficult to properly encode / mix the requested resolution. Therefore, the transmitting apparatus regards the resolution of each camera channel as a priority and adjusts the size of each camera channel based on the priority.

The client device 300 divides the video stream into a plurality of channels based on the arrangement information for each camera channel (S140).

The client device 300 outputs the divided channels to the display screen (S150). The display screen may be a screen including a three-dimensional structural model. Each camera channel may be mapped to a three-dimensional structural model corresponding to the installation position of the camera apparatus and output.

Referring to FIG. 9, the transmitting apparatus 200 receives the requested resolution for each camera channel requested by the client apparatus 300 (S210). When receiving a resolution change request for a certain camera channel, the transmitting apparatus 200 changes the requested resolution stored in the video stream transmission information table to the resolution included in the resolution change request.

The transmitting apparatus 200 stores the requested resolution for each camera channel and transmits the requested resolution for each camera channel to the lower layer transmitting apparatus (S220). At this time, the transmission apparatus of the upper layer knows the camera channel information transmitted by the transmission apparatuses of the lower layer. Therefore, the transmission apparatus of the upper layer can separate the resolution of each camera channel related to the transmission apparatus of the lower layer from the resolution list of the entire camera channels, and transmit the separated resolution list to the transmission apparatus of the lower layer.

The transmitting apparatus 200 receives a plurality of video streams (S230). The transmitting apparatus 200 waits until it receives all of the plurality of video streams. The input video stream can be received from the camera device or from a lower layer of transmission device.

The transmitting apparatus 200 identifies the camera channels included in the input video streams (S240).

The transmitting apparatus 200 confirms the requested resolution of each camera channel (S250). The transmitting apparatus 200 extracts the requested resolution of each camera channel from the video stream transmission information table.

The transmitting apparatus 200 adjusts the size of each camera channel based on the requested resolution of each camera channel, and arranges camera channels to generate a video stream (S260). The transmission apparatus 200 determines the size of each camera channel based on the requested resolution. Then, a plurality of camera channels are arranged in a maximum resolution size (frame) in which a horizontal size and a vertical size are fixed, and the size of each camera channel is adjusted so that a plurality of camera channels are included in the maximum resolution size. In this case, the camera channel having a high priority may not reduce the size of the camera channel, and if a blank space is generated as a result of the placement, the size of a certain camera channel may be adjusted to be larger than the requested size. Alternatively, as shown in FIG. 4, when the client device 300 adjusts the resolution (image size) of each camera channel according to the display screen and transmits the size-adjusted resolution list, the transmission device 200 transmits the resolution- The size of the camera channel can be adjusted based on the resolution.

The transmitting apparatus 200 generates placement information of the camera channels mixed in the output video stream (S270).

The transmitting apparatus 200 outputs a video stream including a plurality of channels and layout information (S280).

10 is a configuration diagram of a transmission apparatus according to an embodiment of the present invention.

Referring to FIG. 10, the transmitting apparatus 200 changes the resolution without stopping the streaming. That is, the transmitting apparatus 200 changes the resolution of the input video stream to the resolution requested by the client apparatus 300. At this time, the transmission apparatus 200 can change the resolution as much as possible than the requested resolution.

The transmission apparatus 200 includes an input unit 210, a video decoder 220, a video mixer 230, a video encoder 240, and an output unit 250. The transmission apparatus 200 further includes a video information storage unit 260. [

The input unit 210 receives a plurality of video streams.

The video decoder 220 decodes the input video stream.

The video mixer 230 changes the resolution of the camera channels included in the input video stream based on the requested resolution for each camera channel stored in the video information storage unit 260. [ The video mixer 230 sizes each camera channel based on the requested resolution. A plurality of camera channels are arranged in a frame having a fixed horizontal size and a vertical size, and the size of each camera channel is adjusted so that a plurality of camera channels are included in the frame. The video mixer 230 mixes camera channels whose resolution is changed to generate a video stream.

The video encoder 240 encodes the video stream output from the video mixer 230.

The output unit 250 outputs the video stream output from the video encoder 240 to the destination address. The output unit 250 may be, for example, a server supporting RTSP.

The video information storage unit 260 stores the resolution for each camera channel requested by the client apparatus 300. For example, the video information storage unit 260 may store the video stream transmission information table described with reference to Table 1, and record the requested resolution for each camera channel.

In this manner, the transmission apparatus 200 changes the size of the input video based on the resolution (size) requested by the client apparatus 300, and encodes the input video. The transmitting apparatus 200 stores the requested resolution for each camera channel transmitted from the client apparatus 300, and converts and encodes frames of the input channel based on the requested resolution for each camera channel. As described above, the transmitting apparatus 200 and the client apparatus 300 implement a synchronized encoding / decoding scheme sharing a resolution for each camera channel. Accordingly, the control system 10 can freely change the resolution of the camera channel according to the network status, the computing resource status, the control status (for example, the change of the control object and the change of the control area). In particular, instead of transmitting all channels at the same resolution, the transmitting apparatus 200 may vary the resolution of the camera channel to meet the request of the client apparatus 300, so that many camera channels can be transmitted while efficiently using the network.

As described above, according to the embodiment of the present invention, since the video stream is transmitted based on the resolution requested by the client apparatus, the network bandwidth can be efficiently used. According to the embodiment of the present invention, it is easy to expand the number of controllable cameras. In addition, according to the embodiment of the present invention, intuitive and efficient integrated control can be performed based on a three-dimensional virtualization technique of mixing three-dimensional structure information and camera images input in real time into a virtual environment.

The embodiments of the present invention described above are not implemented only by the apparatus and method, but may be implemented through a program for realizing the function corresponding to the configuration of the embodiment of the present invention or a recording medium on which the program is recorded.

While the present invention has been particularly shown and described with reference to exemplary embodiments thereof, it is to be understood that the invention is not limited to the disclosed exemplary embodiments, It belongs to the scope of right.

Claims (16)

A method of transmitting a multi-channel video stream in cooperation with a transmission apparatus connected to a plurality of camera apparatuses by a client apparatus of a control system,
Generating a requested resolution for each camera channel for a camera channel corresponding to each of the plurality of camera devices,
Transmitting the requested resolution for each camera channel to the transmission device,
Receiving a video stream comprising a plurality of camera channels from the transmitting device,
Receiving, from the transmission apparatus, arrangement information for each camera channel indicating the position and size of each of the plurality of camera channels in the video stream;
Separating the plurality of camera channels in the video stream based on the camera channel-by-camera placement information, and
And outputting each separated camera channel to a designated position
Lt; / RTI &gt;
The step of generating the per-channel request resolution
Receiving the resolution for each camera channel, generating the requested resolution for each channel by scaling the input camera channel resolution to fit the display screen,
Wherein the video stream comprises the plurality of camera channels whose resolution is adjusted based on the requested resolution for each camera channel. delete delete The method of claim 1,
Wherein the designated location is a location mapped to a three-dimensional structural model. A method for transmitting a multi-channel video stream received from a plurality of camera apparatuses by a transmission apparatus of a control system,
Receiving a request resolution for a camera channel of each of the plurality of camera devices,
Storing the received request resolution,
Separating the received requested resolution with the received requested resolution for each camera channel associated with each of a plurality of lower layer transmission devices,
Transmitting the separated request resolution to the lower layer transmission apparatus,
Receiving a plurality of input video streams from each of the plurality of lower layer transport devices,
Identifying a plurality of camera channels included in the plurality of input video streams,
Changing resolution of each camera channel based on the requested resolution of the plurality of camera channels identified;
Generating an output video stream by combining the plurality of camera channels whose resolution is changed,
Generating placement information of each of the plurality of camera channels included in the output video stream, and
Transmitting the placement information to a client device
/ RTI &gt;
Wherein the placement information comprises the location and size of each camera channel transmitted in the output video stream. delete delete delete The method of claim 5,
Wherein receiving the requested resolution comprises receiving the requested resolution from a client device,
Transmitting the output video stream to the client device
Channel video stream. delete The method of claim 5,
Storing the requested resolution for each camera channel in the video stream transmission information table, the location and size of each camera channel in the received video stream, and the location and size of each camera channel in the output video stream
Channel video stream. 12. The method of claim 11,
Receiving a resolution change request for a random camera channel, and
Changing the requested resolution for the arbitrary camera channel stored in the video stream transmission information table to a resolution included in the resolution change request
Channel video stream. As a control system,
The resolution for each camera channel is input to the camera channel corresponding to each of the plurality of camera devices, the requested resolution for each camera channel is adjusted by adjusting the resolution for each camera channel to fit the display screen, The client device, and
The resolution of the plurality of camera channels transmitted from each of the plurality of camera devices is changed based on the requested resolution for each camera channel, and the plurality of camera channels whose resolution is changed are combined to generate A transmission apparatus for transmitting an output video stream to the client apparatus
Lt; / RTI &gt;
Wherein the client device and the transmission device manage and share a video stream transmission information table,
The video stream transmission information table
The requested resolution for each camera channel, the location and size of each camera channel in the received video stream, and the location and size of each camera channel in the output video stream. The method of claim 13,
The transmission device
Generating placement information of each of the plurality of camera channels included in the output video stream, transmitting the placement information to the client device,
Wherein the placement information comprises the location and size of each camera channel transmitted in the output video stream. The method of claim 14,
The client device
Separates the plurality of camera channels from the output video stream based on the arrangement information, and outputs each separated camera channel to a designated position. 16. The method of claim 15,
Wherein said designated location is a location mapped to a three-dimensional structural model.
KR1020150059196A 2014-04-28 2015-04-27 Method for transmitting multi-channel video stream, and surveillance system using the same method KR101668858B1 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
KR20140050966 2014-04-28
KR1020140050966 2014-04-28

Publications (2)

Publication Number Publication Date
KR20150124409A KR20150124409A (en) 2015-11-05
KR101668858B1 true KR101668858B1 (en) 2016-10-24

Family

ID=57122661

Family Applications (1)

Application Number Title Priority Date Filing Date
KR1020150059196A KR101668858B1 (en) 2014-04-28 2015-04-27 Method for transmitting multi-channel video stream, and surveillance system using the same method

Country Status (1)

Country Link
KR (1) KR101668858B1 (en)

Families Citing this family (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US9071220B2 (en) * 2013-03-07 2015-06-30 Qualcomm Incorporated Efficient N-factorial differential signaling termination network
US9363071B2 (en) 2013-03-07 2016-06-07 Qualcomm Incorporated Circuit to recover a clock signal from multiple wire data signals that changes state every state cycle and is immune to data inter-lane skew as well as data state transition glitches
US9374216B2 (en) 2013-03-20 2016-06-21 Qualcomm Incorporated Multi-wire open-drain link with data symbol transition based clocking
US9735948B2 (en) 2013-10-03 2017-08-15 Qualcomm Incorporated Multi-lane N-factorial (N!) and other multi-wire communication systems
US9755818B2 (en) 2013-10-03 2017-09-05 Qualcomm Incorporated Method to enhance MIPI D-PHY link rate with minimal PHY changes and no protocol changes
US9203599B2 (en) * 2014-04-10 2015-12-01 Qualcomm Incorporated Multi-lane N-factorial (N!) and other multi-wire communication systems
KR101987062B1 (en) * 2017-11-21 2019-06-10 (주)루먼텍 System for distributing and combining multi-camera videos through ip and a method thereof
KR102062138B1 (en) * 2019-05-10 2020-01-03 배경 Apparatus for processing monitoring image

Family Cites Families (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR101037797B1 (en) * 2009-04-03 2011-05-27 주식회사 다림비젼 Multiviewer system Showing Videos on 3D Virtual Monitors in a 3D Virtual Graphic video wall realizing Virtual Video Wall supporting unlimited number inputs of either Analog or Digital, IP videos
KR101302803B1 (en) * 2011-05-26 2013-09-02 주식회사 엘지씨엔에스 Intelligent image surveillance system using network camera and method therefor

Also Published As

Publication number Publication date
KR20150124409A (en) 2015-11-05

Similar Documents

Publication Publication Date Title
KR101668858B1 (en) Method for transmitting multi-channel video stream, and surveillance system using the same method
US10021301B2 (en) Omnidirectional camera with multiple processors and/or multiple sensors connected to each processor
EP2490179B1 (en) Method and apparatus for transmitting and receiving a panoramic video stream
US8911291B2 (en) Display system and display method for video wall
KR102670822B1 (en) Methods and apparatus for volumetric video transmission
US9843725B2 (en) Omnidirectional camera with multiple processors and/or multiple sensors connected to each processor
US11792463B2 (en) Method of video transmission and display
EP3782368A1 (en) Processing video patches for three-dimensional content
US8639046B2 (en) Method and system for scalable multi-user interactive visualization
US20210227236A1 (en) Scalability of multi-directional video streaming
US10757463B2 (en) Information processing apparatus and information processing method
KR101528863B1 (en) Method of synchronizing tiled image in a streaming service providing system of panoramic image
US11076162B2 (en) Method and network equipment for encoding an immersive video spatially tiled with a set of tiles
CN107438203B (en) Method for establishing and receiving list, network equipment and terminal
GB2568020A (en) Transmission of video content based on feedback
US11457053B2 (en) Method and system for transmitting video
JP2017022529A (en) Communication system, communication device, communication method, and program
KR101562789B1 (en) Method for both routing and switching multi-channel hd/uhd videos and the apparatus thereof
GB2526148A (en) Seamless display of a video sequence with increased frame rate
US20170078355A1 (en) Encoding device, decoding device, computer program product, and streaming system
KR102213423B1 (en) Apparatus and method for distributing of ultra high definition videos using scalers
KR20170045633A (en) Method for providing panoramic video service, panoramic video providing server and system
WO2020204253A1 (en) Region-of-interest-based vr image receiving apparatus and method
TW201501516A (en) Multi-stream images display system, multi-stream images display apparatus and method thereof
JP7296219B2 (en) Receiving device, transmitting device, and program

Legal Events

Date Code Title Description
A201 Request for examination
E902 Notification of reason for refusal
E701 Decision to grant or registration of patent right
GRNT Written decision to grant