JP4981584B2

JP4981584B2 - Video transmission system relay device

Info

Publication number: JP4981584B2
Application number: JP2007220287A
Authority: JP
Inventors: 聡平田; 享伊藤; 幹生小松; 嘉浩谷川
Original assignee: Panasonic Corp; Matsushita Electric Industrial Co Ltd
Current assignee: Panasonic Corp; Panasonic Holdings Corp
Priority date: 2007-08-27
Filing date: 2007-08-27
Publication date: 2012-07-25
Anticipated expiration: 2027-08-27
Also published as: JP2009055363A

Description

本発明は、動画像の映像データを互いに伝送速度が異なる複数種類の伝送路を介して送信する１乃至複数の映像送信装置と、前記伝送路を介して伝送される映像データを受信する複数の映像受信装置とを有する映像伝送システムに用いられ、前記伝送路の途中に設けられて映像送信装置から送信された映像データを１乃至複数の映像受信装置に中継する中継装置に関するものである。 The present invention provides one or more video transmission apparatuses that transmit video data of moving images via a plurality of types of transmission paths having different transmission speeds, and a plurality of video data that are transmitted via the transmission paths. The present invention relates to a relay device that is used in a video transmission system having a video receiving device and relays video data transmitted from a video transmitting device provided in the middle of the transmission path to one or more video receiving devices.

従来の映像伝送システムとして、ドアホン子器、インターホン親機、インターホン副親機などで構成されたインターホンシステムが提供されている（例えば、特許文献１参照）。このようなインターホンシステムでは、映像送信装置たるインターホン親機が、宅外に設置されているドアホン子器から受け取った映像信号を自身の表示デバイス（液晶ディスプレイなど）に表示すると同時に伝送路を介して接続され、且つ宅内に設置されている映像受信装置たるインターホン副親機等に映像信号を送信する機能を有している。
特開２００４−２９５４０８号公報 As a conventional video transmission system, an interphone system including a door phone slave unit, an interphone master unit, an interphone sub-master unit, and the like is provided (for example, see Patent Document 1). In such an intercom system, the interphone master unit, which is a video transmission device, displays the video signal received from the door phone slave installed outside the home on its own display device (liquid crystal display, etc.) and at the same time via the transmission path. It has a function of transmitting a video signal to an interphone sub-master device or the like that is connected and installed in the house as a video receiver.
JP 2004-295408 A

ところで、映像送信装置が互いに伝送速度の異なる複数種類の伝送路を介して複数種類の映像受信装置に接続されている場合、従来では、最も伝送速度の遅い伝送路に合わせた低フレームレートの映像しか伝送することができず、伝送速度の速い伝送路に接続されている映像受信装置においても低画質の映像しか再生できないことになって伝送効率が著しく低下するという問題があった。 By the way, when a video transmission device is connected to a plurality of types of video reception devices via a plurality of types of transmission paths having different transmission speeds, conventionally, a low frame rate video matched to the transmission path with the slowest transmission speed. However, even a video receiver connected to a transmission path having a high transmission speed can reproduce only low-quality video, resulting in a problem that transmission efficiency is significantly reduced.

本発明は上記事情に鑑みて為されたものであり、その目的は、伝送速度が異なる複数種類の伝送路を介して映像データを伝送する場合の伝送効率を向上することができる映像伝送システムの中継装置を提供することにある。 The present invention has been made in view of the above circumstances, and an object of the present invention is to provide a video transmission system capable of improving transmission efficiency when video data is transmitted through a plurality of types of transmission paths having different transmission speeds. It is to provide a relay device.

請求項１の発明は、上記目的を達成するために、動画像の映像データを互いに伝送速度が異なる複数種類の伝送路を介して送信する１乃至複数の映像送信装置と、前記伝送路を介して伝送される映像データを受信する複数の映像受信装置とを有する映像伝送システムに用いられ、前記伝送路の途中に設けられて映像送信装置から送信された映像データを１乃至複数の映像受信装置に中継する中継装置であって、映像送信装置から受け取った映像データを圧縮する映像圧縮手段と、映像圧縮手段で圧縮された映像データを映像受信装置に接続された１乃至複数の伝送路に送出する送信手段と、送信手段から各伝送路への映像データの送出手順を制御する制御手段とを備え、映像圧縮手段は、動画像を構成する各フレームを複数の領域に分割するとともに個々の領域毎に、単独で伸長可能な基準映像符号化方式並びに基準映像符号からの差分を補償する補償映像符号化方式で圧縮処理を行い、制御手段は、伝送路の伝送速度が相対的に速いほど１フレームに含まれる基準映像符号化方式で圧縮された映像データの割合を増やし、伝送路の伝送速度が相対的に遅いほど１フレームに含まれる補償映像符号化方式で圧縮された映像データの割合を増やして送信手段から当該伝送路へ映像データを送出させるものであって、複数フレームに亘る各領域毎の平均輝度を算出するとともに平均輝度が所定値よりも高い領域を基準映像符号化方式で圧縮させ、平均輝度が所定値よりも低い領域を補償映像符号化方式で圧縮させることを特徴とする。
請求項２の発明は、上記目的を達成するために、動画像の映像データを互いに伝送速度が異なる複数種類の伝送路を介して送信する１乃至複数の映像送信装置と、前記伝送路を介して伝送される映像データを受信する複数の映像受信装置とを有する映像伝送システムに用いられ、前記伝送路の途中に設けられて映像送信装置から送信された映像データを１乃至複数の映像受信装置に中継する中継装置であって、映像送信装置から受け取った映像データを圧縮する映像圧縮手段と、映像圧縮手段で圧縮された映像データを映像受信装置に接続された１乃至複数の伝送路に送出する送信手段と、送信手段から各伝送路への映像データの送出手順を制御する制御手段とを備え、映像圧縮手段は、動画像を構成する各フレームを複数の領域に分割するとともに個々の領域毎に、単独で伸長可能な基準映像符号化方式並びに基準映像符号からの差分を補償する補償映像符号化方式で圧縮処理を行い、制御手段は、伝送路の伝送速度が相対的に速いほど１フレームに含まれる基準映像符号化方式で圧縮された映像データの割合を増やし、伝送路の伝送速度が相対的に遅いほど１フレームに含まれる補償映像符号化方式で圧縮された映像データの割合を増やして送信手段から当該伝送路へ映像データを送出させるものであって、複数フレームに亘る各領域毎のコントラストの平均値を算出するとともにコントラストの平均値が所定値よりも高い領域を基準映像符号化方式で圧縮させ、コントラストの平均値が所定値よりも低い領域を補償映像符号化方式で圧縮させることを特徴とする。
請求項３の発明は、上記目的を達成するために、動画像の映像データを互いに伝送速度が異なる複数種類の伝送路を介して送信する１乃至複数の映像送信装置と、前記伝送路を介して伝送される映像データを受信する複数の映像受信装置とを有する映像伝送システムに用いられ、前記伝送路の途中に設けられて映像送信装置から送信された映像データを１乃至複数の映像受信装置に中継する中継装置であって、映像送信装置から受け取った映像データを圧縮する映像圧縮手段と、映像圧縮手段で圧縮された映像データを映像受信装置に接続された１乃至複数の伝送路に送出する送信手段と、送信手段から各伝送路への映像データの送出手順を制御する制御手段とを備え、映像圧縮手段は、動画像を構成する各フレームを複数の領域に分割するとともに個々の領域毎に、単独で伸長可能な基準映像符号化方式並びに基準映像符号からの差分を補償する補償映像符号化方式で圧縮処理を行い、制御手段は、伝送路の伝送速度が相対的に速いほど１フレームに含まれる基準映像符号化方式で圧縮された映像データの割合を増やし、伝送路の伝送速度が相対的に遅いほど１フレームに含まれる補償映像符号化方式で圧縮された映像データの割合を増やして送信手段から当該伝送路へ映像データを送出させるものであって、各フレーム内で人物が写っている領域を基準映像符号化方式で圧縮させ、人物が写っていない領域を補償映像符号化方式で圧縮させることを特徴とする。
請求項４の発明は、上記目的を達成するために、動画像の映像データを互いに伝送速度が異なる複数種類の伝送路を介して送信する１乃至複数の映像送信装置と、前記伝送路を介して伝送される映像データを受信する複数の映像受信装置とを有する映像伝送システムに用いられ、前記伝送路の途中に設けられて映像送信装置から送信された映像データを１乃至複数の映像受信装置に中継する中継装置であって、映像送信装置から受け取った映像データを圧縮する映像圧縮手段と、映像圧縮手段で圧縮された映像データを映像受信装置に接続された１乃至複数の伝送路に送出する送信手段と、送信手段から各伝送路への映像データの送出手順を制御する制御手段とを備え、映像圧縮手段は、動画像を構成する各フレームを複数の領域に分割するとともに個々の領域毎に、単独で伸長可能な基準映像符号化方式並びに基準映像符号からの差分を補償する補償映像符号化方式で圧縮処理を行い、制御手段は、伝送路の伝送速度が相対的に速いほど１フレームに含まれる基準映像符号化方式で圧縮された映像データの割合を増やし、伝送路の伝送速度が相対的に遅いほど１フレームに含まれる補償映像符号化方式で圧縮された映像データの割合を増やして送信手段から当該伝送路へ映像データを送出させるものであって、フレームの中央の領域を基準映像符号化方式で圧縮させ、周辺の領域を補償映像符号化方式で圧縮させることを特徴とする。 According to a first aspect of the present invention, in order to achieve the above object, one or a plurality of video transmission apparatuses that transmit video data of moving images via a plurality of types of transmission paths having different transmission speeds, and the transmission paths 1 to a plurality of video receiving apparatuses used in a video transmission system having a plurality of video receiving apparatuses for receiving video data transmitted in the same manner and provided in the middle of the transmission path. A video compression unit that compresses video data received from the video transmission device, and sends the video data compressed by the video compression unit to one or more transmission lines connected to the video reception device And a control means for controlling the transmission procedure of the video data from the transmission means to each transmission path, and the video compression means divides each frame constituting the moving image into a plurality of regions. In each area, compression processing is performed using a reference video coding method that can be expanded independently and a compensation video coding method that compensates for a difference from the reference video code. The rate of video data compressed by the reference video coding method included in one frame increases as the speed increases, and the video compressed by the compensated video coding method included in one frame increases as the transmission speed of the transmission path is relatively slow. The video data is sent from the transmission means to the transmission path by increasing the data ratio, and the average luminance for each area over a plurality of frames is calculated and the area where the average luminance is higher than a predetermined value is used as a reference video code. The compression method is used, and a region where the average luminance is lower than a predetermined value is compressed using the compensated video coding method .
In order to achieve the above object, a second aspect of the present invention provides one or more video transmission apparatuses that transmit video data of moving images via a plurality of types of transmission paths having different transmission speeds, and the transmission paths. 1 to a plurality of video receiving apparatuses used in a video transmission system having a plurality of video receiving apparatuses for receiving video data transmitted in the same manner and provided in the middle of the transmission path. A video compression unit that compresses video data received from the video transmission device, and sends the video data compressed by the video compression unit to one or more transmission lines connected to the video reception device And a control means for controlling the transmission procedure of the video data from the transmission means to each transmission path, and the video compression means divides each frame constituting the moving image into a plurality of regions. In each area, compression processing is performed using a reference video coding method that can be expanded independently and a compensation video coding method that compensates for a difference from the reference video code. The rate of video data compressed by the reference video coding method included in one frame increases as the speed increases, and the video compressed by the compensated video coding method included in one frame increases as the transmission speed of the transmission path is relatively slow. An area in which the ratio of data is increased and video data is transmitted from the transmission means to the transmission path, and an average value of contrast for each area over a plurality of frames is calculated and an area where the average value of contrast is higher than a predetermined value Is compressed by the reference video coding method, and a region where the average value of contrast is lower than a predetermined value is compressed by the compensation video coding method .
According to a third aspect of the present invention, in order to achieve the above object, one or a plurality of video transmitting apparatuses that transmit video data of moving images via a plurality of types of transmission paths having different transmission speeds, and the transmission paths. 1 to a plurality of video receiving apparatuses used in a video transmission system having a plurality of video receiving apparatuses for receiving video data transmitted in the same manner and provided in the middle of the transmission path. A video compression unit that compresses video data received from the video transmission device, and sends the video data compressed by the video compression unit to one or more transmission lines connected to the video reception device And a control means for controlling the transmission procedure of the video data from the transmission means to each transmission path, and the video compression means divides each frame constituting the moving image into a plurality of regions. In each area, compression processing is performed using a reference video coding method that can be expanded independently and a compensation video coding method that compensates for a difference from the reference video code. The rate of video data compressed by the reference video coding method included in one frame increases as the speed increases, and the video compressed by the compensated video coding method included in one frame increases as the transmission speed of the transmission path is relatively slow. The ratio of data is increased and video data is transmitted from the transmission means to the transmission path, and the area where the person is shown in each frame is compressed by the reference video coding method, and the area where the person is not shown is It is characterized in that it is compressed by a compensated video coding system.
According to a fourth aspect of the present invention, in order to achieve the above object, one or a plurality of video transmission apparatuses for transmitting video data of moving images via a plurality of types of transmission paths having different transmission speeds, and the transmission paths. 1 to a plurality of video receiving apparatuses used in a video transmission system having a plurality of video receiving apparatuses for receiving video data transmitted in the same manner and provided in the middle of the transmission path. A video compression unit that compresses video data received from the video transmission device, and sends the video data compressed by the video compression unit to one or more transmission lines connected to the video reception device And a control means for controlling the transmission procedure of the video data from the transmission means to each transmission path, and the video compression means divides each frame constituting the moving image into a plurality of regions. In each area, compression processing is performed using a reference video coding method that can be expanded independently and a compensation video coding method that compensates for a difference from the reference video code. The rate of video data compressed by the reference video coding method included in one frame increases as the speed increases, and the video compressed by the compensated video coding method included in one frame increases as the transmission speed of the transmission path is relatively slow. The ratio of data is increased and video data is transmitted from the transmission means to the transmission path. The central area of the frame is compressed by the reference video encoding system, and the peripheral area is compressed by the compensated video encoding system. It is characterized by that.

請求項１の発明によれば、伝送速度が速い伝送路には圧縮率の低い基準映像符号化方式で圧縮された映像データの割合を増やし、伝送速度が遅い伝送路には圧縮率の高い補償映像符号化方式で圧縮された映像データの割合を増やして伝送するため、それぞれの伝送路の伝送速度に応じた映像データを送信することができ、その結果、伝送速度が異なる複数種類の伝送路を介して映像データを伝送する場合の伝送効率を向上することができる。 According to the first aspect of the present invention, the ratio of video data compressed by the reference video coding method having a low compression rate is increased for a transmission line with a high transmission rate, and the compensation with a high compression rate is provided for a transmission line with a low transmission rate. Since the ratio of video data compressed by the video encoding method is increased and transmitted, video data corresponding to the transmission speed of each transmission path can be transmitted. As a result, multiple types of transmission paths with different transmission speeds It is possible to improve the transmission efficiency when transmitting video data via the network.

請求項５の発明は、請求項１〜４の何れかの発明において、映像圧縮手段は、基準映像符号化方式で圧縮処理を行う第１の圧縮処理部と、補償映像符号化方式で圧縮処理を行う第２の圧縮処理部とを有することを特徴とする。 According to a fifth aspect of the present invention, in any one of the first to fourth aspects of the present invention, the video compression means includes a first compression processing unit that performs a compression process using a reference video encoding method, and a compression process that uses a compensated video encoding method. And a second compression processing unit.

請求項５の発明によれば、圧縮に要する処理時間を短縮することができる。 According to the invention of claim 5, the processing time required for compression can be shortened.

本発明によれば、伝送速度が異なる複数種類の伝送路を介して映像データを伝送する場合の伝送効率を向上することができるという効果がある。 According to the present invention, there is an effect that it is possible to improve transmission efficiency when video data is transmitted through a plurality of types of transmission paths having different transmission speeds.

以下、本発明の技術思想を戸建て住戸用のインターホンシステムに用いられる中継装置に適用した実施形態について、図面を参照して詳細に説明する。但し、本発明の技術思想が適用可能な映像伝送システム並びに中継装置はインターホンシステム及びその中継装置に限定されるものではない。 DESCRIPTION OF EMBODIMENTS Hereinafter, an embodiment in which the technical idea of the present invention is applied to a relay device used in an intercom system for a detached house will be described in detail with reference to the drawings. However, the video transmission system and the relay device to which the technical idea of the present invention can be applied are not limited to the interphone system and the relay device.

まず、本実施形態におけるインターホンシステム（映像伝送システム）について説明する。このインターホンシステムは、図２に示すように住戸Ｈの外玄関に設置されたドアホン子器１００と、住戸Ｈの屋内に設置されたインターホン親機（映像送信装置）１と、伝送路（ＬＡＮケーブル）Ｌｓを介してインターホン親機１と接続されたルータ３と、宅内に設置されるとともに伝送路Ｌｓを介してルータ３と接続されたインターホン副親機２Ａと、宅内に設置されるとともに伝送路Ｌｓを介してルータ３と接続された中継装置４と、宅内に設置されるとともに伝送路Ｌｓを介して中継装置４に接続されたインターホン副親機２Ｂ並びに無線アダプタ５と、宅内に設置されて無線アダプタ５と通信する無線インターホン副親機２Ｃと、伝送路Ｌｓを介してルータ３と接続されルータ３を含む宅内ネットワークを広域ネットワーク（インターネット）に接続するためのインターネット接続装置６とで構成される。但し、本発明は映像データの伝送に係るものであるから、本実施形態では音声伝送に関する構成についての図示並びに説明を省略する。 First, the intercom system (video transmission system) in this embodiment will be described. As shown in FIG. 2, this intercom system includes a doorphone slave unit 100 installed at the exterior entrance of the dwelling unit H, an interphone master unit (video transmission device) 1 installed indoors in the dwelling unit H, and a transmission path (LAN cable). ) A router 3 connected to the intercom base unit 1 via Ls, an interphone sub-base unit 2A installed in the house and connected to the router 3 via the transmission path Ls, and a transmission path installed in the house The relay device 4 connected to the router 3 via Ls, the interphone sub-master 2B and the wireless adapter 5 installed in the house and connected to the relay device 4 via the transmission line Ls, and installed in the home A wireless interphone sub-master 2C communicating with the wireless adapter 5 and a home network including the router 3 connected to the router 3 via the transmission line Ls are connected to a wide area network (in Composed of the Internet connection device 6 for connection to Netto). However, since the present invention relates to transmission of video data, illustration and description of the configuration related to audio transmission are omitted in this embodiment.

ルータ３は、イーサネット（登録商標）と呼ばれるＬＡＮ規格（IEEE 802.3）に準拠した従来周知のものであって、通信速度が最大10Mbpsの10BASE-Tと通信速度が最大100Mbpsの100BASE-TXの両方式に対応している。ルータ３には複数のポート（図示せず）が設けられており、それぞれのポートにＬＡＮケーブル（伝送路Ｌｓ）が接続されている。インターネット接続装置６は、ＤＳＬモデム若しくはケーブルモデム、ＯＮＵ(Optical Network Unit)からなり、ルータ３を介してインターホン親機１やインターホン副親機２Ａ，２Ｂ，２Ｃをインターネットに接続する機能を有している。但し、この種のルータ３やインターネット接続装置６については従来周知であるから詳細な説明を省略する。 The router 3 is a conventionally well-known router conforming to a LAN standard (IEEE 802.3) called Ethernet (registered trademark), and both a 10BASE-T communication speed up to 10 Mbps and a 100BASE-TX communication speed up to 100 Mbps. It corresponds to. The router 3 is provided with a plurality of ports (not shown), and a LAN cable (transmission path Ls) is connected to each port. The Internet connection device 6 includes a DSL modem, a cable modem, and an ONU (Optical Network Unit), and has a function of connecting the interphone master unit 1 and the interphone sub-master units 2A, 2B, and 2C to the Internet via the router 3. Yes. However, since this type of router 3 and Internet connection device 6 are well known in the art, a detailed description thereof will be omitted.

ドアホン子器１００は、通話用のマイクロホン及びスピーカ、来訪者を撮像するＣＣＤカメラのような撮像装置、来訪者に操作される呼出釦、呼出釦が操作された時に信号線Ｌｄを介して呼出信号を送出する呼出信号送出回路などを具備した従来周知のものであって、撮像装置で撮像した映像（アナログの映像信号）を信号線Ｌｄを介してインターホン親機１に送信するとともに、インターホン親機１との間で信号線Ｌｄを介してアナログの音声信号を双方向で送受信する。 The doorphone slave unit 100 includes a call microphone and speaker, an imaging device such as a CCD camera that images a visitor, a call button operated by the visitor, and a call signal via a signal line Ld when the call button is operated. And transmitting a video image (analog video signal) captured by the imaging device to the interphone base unit 1 via the signal line Ld, and a interphone base unit. An analog audio signal is transmitted and received bidirectionally to and from 1 via the signal line Ld.

映像送信装置たるインターホン親機１は、図示は省略しているが、ドアホン子器１００から信号線Ｌｄを介して伝送されるアナログの映像信号を取り込み、取り込んだアナログの映像信号をディジタルの映像信号に変換し且つ圧縮して伝送路Ｌｓに送出するとともに、通話用のマイクロホン及びスピーカ、映像を表示するための表示デバイス（例えば、液晶ディスプレイ）、呼出音に応答する際に操作される応答釦、応答釦が操作された時にドアホン子器１００との間に形成される通話路を介して音声信号を授受する通話回路なども備えている。 Although not shown in the figure, the interphone master unit 1 that is a video transmission device takes in an analog video signal transmitted from the doorphone slave unit 100 via the signal line Ld, and converts the taken analog video signal into a digital video signal. And a compressed microphone and speaker, a display device for displaying video (for example, a liquid crystal display), a response button operated when responding to a ringing tone, There is also provided a call circuit for transmitting and receiving an audio signal through a call path formed with the door phone slave unit 100 when the response button is operated.

映像受信装置たるインターホン副親機２Ａ，２Ｂは、映像信号のディジタル変換及び圧縮処理のための構成を除く基本的な構成がインターホン親機１と共通であって、インターホン親機１との間でディジタルの音声データ並びに映像データをパケットにより送受信することでドアホン子器１００と通話するとともにドアホン子器１００の撮像装置で撮像された映像（動画像）を表示デバイスに表示することができる。 Interphone sub-master units 2A and 2B, which are video receivers, have the same basic configuration as interphone master unit 1 except for the configuration for digital conversion and compression processing of video signals. By transmitting and receiving digital audio data and video data in packets, a call can be made to the doorphone slave unit 100 and a video (moving image) captured by the imaging device of the doorphone slave unit 100 can be displayed on the display device.

同じく映像受信装置たる無線インターホン副親機２Ｃは、映像信号のディジタル変換及び圧縮処理のための構成を除く基本的な構成がインターホン親機１と共通であって、無線アダプタ５との間でディジタルの音声データ並びに映像データを無線信号により送受信することでドアホン子器１００と通話するとともにドアホン子器１００の撮像装置で撮像された映像（動画像）を表示デバイスに表示することができる。尚、無線アダプタ５は無線ＬＡＮの規格（IEEE 802.11a/b/g等）に対応した従来周知のものであるから詳細な説明は省略する。 Similarly, the wireless interphone sub-master 2C, which is also a video receiver, has the same basic configuration as that of the interphone master 1 except for the digital conversion and compression processing of the video signal. By transmitting and receiving the audio data and the video data by wireless signals, it is possible to make a call with the doorphone slave unit 100 and to display the video (moving image) captured by the imaging device of the doorphone slave unit 100 on the display device. Since the wireless adapter 5 is a conventionally known one corresponding to a wireless LAN standard (IEEE 802.11a / b / g, etc.), detailed description thereof is omitted.

中継装置４は、図１に示すように複数のポートを有し各ポートを介してパケットを送受信するネットワークインタフェース部４０と、マイコンを主構成要素とする制御部４１と、パケットにより受信した映像データに対して後述する圧縮処理を行う映像圧縮処理部４２とを備えている。図２に示したシステム構成例では、ネットワークインタフェース部４０の複数のポートにはＬＡＮケーブルからなる伝送路Ｌｓを介して各々ルータ３、映像受信装置たるインターホン副親機２Ｂ並びに無線アダプタ５が接続されている。ここで、宅内ネットワーク（インターホンシステム）を構成する全ての機器、すなわち、インターホン親機１、インターホン副親機２Ａ，２Ｂ，２Ｃ、ルータ３、中継装置４、無線アダプタ５には固有のアドレス（プライベートＩＰアドレス）が割り当てられ、各機器同士は当該アドレスによって互いを識別してパケットを送受信することができる。 As shown in FIG. 1, the relay device 4 includes a network interface unit 40 that has a plurality of ports and transmits / receives a packet through each port, a control unit 41 having a microcomputer as a main component, and video data received by the packet. Are provided with a video compression processing unit 42 for performing compression processing to be described later. In the system configuration example shown in FIG. 2, a router 3, an interphone sub-master 2 </ b> B serving as a video reception device, and a wireless adapter 5 are connected to a plurality of ports of the network interface unit 40 via a transmission line Ls formed of a LAN cable. ing. Here, all devices constituting the home network (interphone system), that is, the interphone master unit 1, the interphone sub-master units 2A, 2B, 2C, the router 3, the relay device 4, and the wireless adapter 5 have unique addresses (private IP address) is assigned, and the devices can identify each other by the address and transmit / receive packets.

而して、来訪者がドアホン子器１００の呼出釦を操作すると信号線Ｌｄを介してドアホン子器１００からインターホン親機１へ呼出信号が送信されるとともに、ドアホン子器１００では撮像装置が起動して来訪者を撮像した映像信号が信号線Ｌｄを介してインターホン親機１へ送信される。インターホン親機１では、呼出信号を受信するとスピーカから呼出音を鳴動させるとともにドアホン子器１００から受け取ったアナログの映像信号によって表示デバイスに来訪者の映像を表示させる。そして、住戸Ｈの住人がインターホン親機１の応答釦を操作すれば、ドアホン子器１００との間に通話路を形成するとともに通話回路を起動することにより、インターホン親機１とドアホン子器１００との間で通話が可能となる。また、インターホン親機１では、呼出信号を受け取ると呼出音鳴動のコマンドを含むパケットを全ての映像受信装置（インターホン副親機２Ａ，２Ｂ，２Ｃ）に向けて送信（マルチキャスト）するとともに、ドアホン子器１００から受け取ったアナログの映像信号をディジタル変換し且つ圧縮して生成した映像データを含むパケットを各インターホン副親機２Ａ，２Ｂ，２Ｃに個別に送信（ユニキャスト）する。インターホン副親機２Ａ，２Ｂ，２Ｃでは、呼出信号のパケットを受信するとスピーカから呼出音を鳴動させ、さらに映像データのパケットを受信すると当該映像データを伸長して表示デバイスに来訪者の映像を表示させる。そして、住戸Ｈの住人が何れかのインターホン副親機２Ａ，２Ｂ，２Ｃの応答釦を操作すれば、当該インターホン副親機２Ａ，２Ｂ，２Ｃとインターホン親機１との間で音声データを含むパケットが送受信され、インターホン親機１を介して何れかのインターホン副親機２Ａ，２Ｂ，２Ｃとドアホン子器１００との間で通話が可能となる。 Thus, when a visitor operates the call button of the door phone slave unit 100, a call signal is transmitted from the door phone slave unit 100 to the interphone master unit 1 via the signal line Ld, and the imaging device is activated in the door phone slave unit 100. Then, the video signal obtained by imaging the visitor is transmitted to the intercom base unit 1 through the signal line Ld. When the intercom base unit 1 receives the call signal, the intercom base unit 1 makes a ringing sound from the speaker and displays an image of the visitor on the display device by an analog video signal received from the doorphone slave unit 100. Then, if the resident of the dwelling unit H operates the response button of the interphone master unit 1, the intercom master unit 1 and the door phone sub unit 100 are formed by forming a communication path with the door phone sub unit 100 and starting the communication circuit. Calls can be made with In addition, when the interphone master unit 1 receives a call signal, it transmits (multicasts) a packet including a ringing tone command to all the video receivers (interphone sub-master units 2A, 2B, 2C), and also uses a door phone. Packets containing video data generated by digitally converting and compressing the analog video signal received from the device 100 are individually transmitted (unicast) to each interphone sub-master unit 2A, 2B, 2C. Interphone sub-master units 2A, 2B, and 2C, when receiving a call signal packet, ring a ringing tone from a speaker, and when receiving a video data packet, expand the video data and display a visitor's video on the display device. Let Then, if the resident of the dwelling unit H operates the response button of any of the interphone secondary master units 2A, 2B, 2C, the voice data is included between the interphone secondary master unit 2A, 2B, 2C and the interphone master unit 1. Packets are transmitted and received, and a call can be made between any of the interphone sub-master units 2A, 2B, 2C and the doorphone slave unit 100 via the interphone master unit 1.

ところで、映像受信装置たるインターホン副親機２Ａ，２Ｂ，２Ｃのうち、インターホン副親機２Ｂは最大通信速度が100Mbpsの100BASE-TXに対応しているが、無線インターホン副親機２Ｃについては、無線アダプタ５との間の通信速度がIEEE 802.11b規格における最大速度（約11Mbps）以下に制限されるため、中継装置４に接続されている２つの伝送路Ｌｓ、すなわち、インターホン副親機２Ｂに接続されている伝送路Ｌｓと無線インターホン副親機２Ｃ（無線アダプタ５）に接続されている伝送路Ｌｓとで伝送速度が互いに異なっている。このように映像送信装置たるインターホン親機１から映像受信装置たる各インターホン副親機２Ｂ，２Ｃへ映像データを送信する伝送路Ｌｓの伝送速度（通信速度）が互いに異なっているため、映像データのデータ量を固定してしまうと最も通信速度の遅い伝送路Ｌｓ、例えば、無線インターホン副親機２Ｃ（無線アダプタ５）と接続された伝送路Ｌｓがボトルネックとなって伝送効率が低下してしまうことになる。具体的には、相対的に通信速度の速い伝送路Ｌｓに合わせて映像データのデータ量を多くすると通信速度の遅い伝送路Ｌｓに接続された映像受信装置（例えば、無線インターホン副親機２Ｃ）では映像を再生することができず、反対に、相対的に通信速度の遅い伝送路Ｌｓに合わせて映像データのデータ量を少なくすると通信速度の速い伝送路Ｌｓに接続された映像受信装置（例えば、インターホン副親機２Ｂ）では本来再生可能な画質よりも低い画質で映像を再生しなければならず、その結果、映像データの伝送効率が低下してしまうことになる。 Of the interphone sub-master units 2A, 2B, and 2C that are video receivers, the interphone sub-master unit 2B supports 100BASE-TX with a maximum communication speed of 100 Mbps, but the radio interphone sub-master unit 2C is wireless. Since the communication speed with the adapter 5 is limited to the maximum speed (about 11 Mbps) or less in the IEEE 802.11b standard, it is connected to the two transmission lines Ls connected to the relay device 4, that is, the interphone sub-master 2B. The transmission speeds of the transmission line Ls and the transmission line Ls connected to the wireless intercom sub-master 2C (wireless adapter 5) are different from each other. Since the transmission speeds (communication speeds) of the transmission lines Ls for transmitting the video data from the interphone master unit 1 as the video transmission device to the interphone sub-master units 2B and 2C as the video reception devices are different from each other, If the amount of data is fixed, the transmission path Ls with the slowest communication speed, for example, the transmission path Ls connected to the wireless intercom sub-master 2C (wireless adapter 5) becomes a bottleneck and the transmission efficiency decreases. It will be. Specifically, if the amount of video data is increased in accordance with the transmission path Ls having a relatively high communication speed, the video receiving apparatus (for example, the wireless interphone sub-master 2C) connected to the transmission path Ls having a low communication speed. However, if the amount of video data is reduced in accordance with the transmission path Ls having a relatively low communication speed, a video receiving apparatus (for example, connected to the transmission path Ls having a high communication speed) (for example, In the interphone sub-master 2B), it is necessary to reproduce the video with an image quality lower than the image quality that can be originally reproduced. As a result, the transmission efficiency of the image data is lowered.

そのために本実施形態では、以下で説明するように、中継装置４が伝送路Ｌｓの通信速度に応じて映像データのデータ量を増減することによって伝送効率の向上を図っている。 Therefore, in the present embodiment, as described below, the relay apparatus 4 increases and decreases the data amount of the video data according to the communication speed of the transmission path Ls, thereby improving the transmission efficiency.

中継装置４では、映像送信装置たるインターホン親機１から受け取った映像データを制御部４１が伸長してフレームを再現し、当該フレームを順次映像圧縮処理部４２に引き渡す。映像圧縮処理部４２では、ＭＰＥＧ規格（例えば、ＭＰＥＧ−４）に準拠した圧縮方式で映像データを圧縮している。具体的には、同一フレーム内の周辺画素のみを用いて対象画素を予測するフレーム内予測符号化方式（基準映像符号化方式）で映像データを圧縮する第１の圧縮処理部（図示せず）と、時間的に隣接するフレームのうち過去のフレームの画素を用いて対象画素の差分を予測する片方向フレーム間予測符号化方式（補償映像符号化方式）で映像データを圧縮する第２の圧縮処理部（図示せず）とを有し、それぞれの圧縮処理部が同時且つ並行して映像データを圧縮している。ここで、第１の圧縮処理部で圧縮された映像データは単独で伸長可能なデータであって通常Ｉ(Intra coded)ピクチャと呼ばれ、第２の圧縮処理部で圧縮された映像データはＩピクチャとペアでのみ伸長可能なデータであって通常Ｐ(Predictive coded)ピクチャと呼ばれる。さらに本実施形態における映像圧縮処理部４２では、図３に示すように縦横に等間隔で分割した複数（図示例では５×５＝２５）の領域Ｒij（i,j=1,2,…,25）を各フレーム毎に設定し、第１及び第２の圧縮処理部がそれぞれ各領域Ｒij内の画素について基準映像符号化方式と補償映像符号化方式で圧縮処理を実行して図示しないメモリに格納している。すなわち、当該メモリには各フレームについてそれぞれの領域Ｒij毎にＩピクチャの映像データとＰピクチャの映像データとが両方とも格納されており、制御部４１において、各領域Ｒij毎にＩピクチャ又はＰピクチャの何れか一方の映像データを選択することで一つのフレームに対応する映像データを構成することができ、ＩピクチャとＰピクチャの比率に応じて一つのフレームを構成する映像データのデータ量を増減することが可能である。例えば、図３（ａ）に示すように全ての領域ＲijでＩピクチャを選択すればデータ量が最も多くなるとともに最も高画質となり、Ｐピクチャの比率が増えるにつれてデータ量が減少して画質が低下することになる。 In the relay device 4, the control unit 41 decompresses the video data received from the interphone master unit 1 that is a video transmission device, reproduces the frame, and sequentially delivers the frame to the video compression processing unit 42. The video compression processing unit 42 compresses video data by a compression method compliant with the MPEG standard (for example, MPEG-4). Specifically, a first compression processing unit (not shown) that compresses video data by an intra-frame predictive coding method (reference video coding method) that predicts a target pixel using only peripheral pixels in the same frame. And second compression for compressing video data by a unidirectional inter-frame predictive coding method (compensated video coding method) that predicts a difference of a target pixel using pixels of a past frame among temporally adjacent frames. Each of the compression processing units compressing the video data simultaneously and in parallel. Here, the video data compressed by the first compression processing unit is data that can be decompressed independently and is usually called an I (Intra coded) picture, and the video data compressed by the second compression processing unit is I Data that can be decompressed only in pairs with pictures, and is usually called a P (Predictive coded) picture. Further, in the video compression processing unit 42 in the present embodiment, as shown in FIG. 3, a plurality of (in the illustrated example, 5 × 5 = 25) regions Rij (i, j = 1, 2,...) Divided at equal intervals vertically and horizontally. 25) is set for each frame, and the first and second compression processing units execute compression processing on the pixels in each region Rij using the reference video coding method and the compensated video coding method, and store them in a memory (not shown). Storing. That is, in the memory, both I-picture video data and P-picture video data are stored for each region Rij for each frame, and in the control unit 41, I-picture or P-picture is stored for each region Rij. The video data corresponding to one frame can be configured by selecting one of the video data, and the data amount of the video data constituting one frame is increased or decreased according to the ratio of the I picture and the P picture. Is possible. For example, as shown in FIG. 3 (a), if an I picture is selected in all regions Rij, the amount of data becomes the largest and the highest in image quality, and the amount of data decreases and the image quality decreases as the ratio of P pictures increases. Will do.

而して、映像送信装置たるインターホン親機１から受け取った映像データを映像受信装置たるインターホン副親機２Ｂ，２Ｃに中継するに当たり、例えば、伝送速度が相対的に速い伝送路（インターホン副親機２Ｂに接続された伝送路）Ｌｓに対しては、図３（ａ）に示すように全てのフレームＦ_m,Ｆ_m+1,Ｆ_m+2,Ｆ_m+3,…において各領域ＲijをＩピクチャで構成した映像データを送信し、伝送速度が相対的に遅い伝送路伝送路（無線アダプタ５＜無線インターホン副親機２Ｃ＞に接続された伝送路）Ｌｓに対しては、図３（ｂ）に示すようにフレームの各領域ＲijをＩピクチャで構成した映像データの間に、例えばフレームの各領域ＲijにおけるＩピクチャとＰピクチャの比率を９：１６とした映像データを２フレーム分だけ送信したり、あるいは、図３（ｃ）に示すようにフレームの各領域ＲijをＩピクチャで構成した映像データの間に、例えばフレームの各領域ＲijにおけるＩピクチャとＰピクチャの比率を２：２３とした映像データを２フレーム分だけ送信すれば、それぞれの伝送路Ｌｓに応じた適切なデータ量の映像データを送信することができ、映像データのデータ量を固定した場合と比較して伝送効率を向上することができる。なお、各伝送路Ｌｓ毎の伝送速度（通信速度）については、予め各インターホン副親機２Ｂ，２Ｃから中継装置４にパケットで通知するか、あるいは手動で設定し、各インターホン副親機２Ｂ，２Ｃのアドレスと対応付けてメモリに記憶しておけばよい。 Thus, when relaying the video data received from the interphone master unit 1 as the video transmission device to the interphone sub master units 2B and 2C as the video reception device, for example, a transmission path (interphone sub master unit having a relatively high transmission speed). for transmission lines) Ls connected to 2B, all of the frames F _m, as shown in FIG. _{3 (a), F m +} 1, F m + 2, F m + 3, the regions Rij in ... For a transmission path transmission path (transmission path connected to the wireless adapter 5 <wireless interphone sub-master 2C>) Ls that transmits video data composed of I pictures and has a relatively low transmission speed, FIG. As shown in b), between the video data in which each area Rij of the frame is composed of I pictures, for example, only 2 frames of video data in which the ratio of I picture to P picture in each area Rij of the frame is 9:16 Send or have Or, as shown in FIG. 3C, between the video data in which each region Rij of the frame is composed of I pictures, for example, a video in which the ratio of I picture and P picture in each region Rij of the frame is 2:23 If data is transmitted for only two frames, video data with an appropriate data amount corresponding to each transmission line Ls can be transmitted, and transmission efficiency is improved as compared with a case where the data amount of video data is fixed. be able to. Note that the transmission speed (communication speed) for each transmission line Ls is notified in advance from each interphone sub-master unit 2B, 2C to the relay device 4 or set manually, and each interphone sub-master unit 2B, It may be stored in the memory in association with the 2C address.

ここで、一つのフレームにおいて各領域Ｒijの符号化方式として基準映像符号化方式（Ｉピクチャ）及び補償映像符号化方式（Ｐピクチャ）の何れを選択するかという制御部４１の選択方法について説明する。 Here, a selection method of the control unit 41 for selecting which of the reference video coding method (I picture) and the compensation video coding method (P picture) as the coding method of each region Rij in one frame will be described. .

１番目の選択方法は、複数のフレームに亘って各領域Ｒij毎の平均輝度を算出し、平均輝度が所定値よりも高い領域ＲijをＩピクチャ、所定値よりも低い領域ＲijをＰピクチャとする方法である。２番目の選択方法は、複数のフレームに亘って各領域Ｒij毎のコントラストの平均値を算出し、当該平均値が所定値よりも高い領域ＲijをＩピクチャ、所定値よりも低い領域ＲijをＰピクチャとする方法である。３番目の選択方法は、フレーム内で人物が写っている領域ＲijをＩピクチャ、人物が写っていない領域ＲijをＰピクチャとする方法である。この３番目の選択方法においては、例えば、人の目、口、鼻などの特徴部分に対するパターンマッチングによって人物の写っている領域Ｒijと人物が写っていない領域Ｒijを区別すればよい。なお、ドアホン子器１００で来訪者を撮像する場合、通常、来訪者の顔が画面中央に写ることが多いので、４番目の選択方法として、単純に中央の領域ＲijをＩピクチャ、周辺の領域ＲijをＰピクチャとする方法としてもよい。 In the first selection method, the average luminance for each region Rij is calculated over a plurality of frames, and a region Rij whose average luminance is higher than a predetermined value is an I picture, and a region Rij whose average luminance is lower than a predetermined value is a P picture. Is the method. In the second selection method, an average value of contrast for each region Rij is calculated over a plurality of frames, a region Rij whose average value is higher than a predetermined value is an I picture, and a region Rij whose average value is lower than a predetermined value is P. This is a method of making a picture. The third selection method is a method in which a region Rij in which a person is captured in a frame is an I picture, and a region Rij in which a person is not captured is a P picture. In the third selection method, for example, a region Rij where a person is captured and a region Rij where a person is not captured may be distinguished by pattern matching with respect to features such as human eyes, mouth, and nose. Note that when a visitor is imaged with the doorphone slave unit 100, the face of the visitor is usually reflected in the center of the screen. Therefore, as a fourth selection method, the center area Rij is simply an I picture and the surrounding area. Rij may be a P picture.

本発明に係る中継装置の実施形態を示すブロック図である。It is a block diagram which shows embodiment of the relay apparatus which concerns on this invention. 同上を用いた映像伝送システムであるインターホンシステムのシステム構成図である。It is a system configuration | structure figure of the intercom system which is a video transmission system using the same as the above. 同上の動作説明図である。It is operation | movement explanatory drawing same as the above.

Explanation of symbols

４中継装置
４０ネットワークインタフェース部
４１制御部
４２映像圧縮処理部 4 relay device 40 network interface unit 41 control unit 42 video compression processing unit

Claims

One or more video transmission devices that transmit video data of moving images via a plurality of types of transmission paths having different transmission speeds, and a plurality of video reception devices that receive video data transmitted via the transmission paths, A relay device that relays video data transmitted from a video transmission device provided in the middle of the transmission path to one or more video reception devices,
Video compression means for compressing the video data received from the video transmission apparatus, transmission means for sending the video data compressed by the video compression means to one or more transmission paths connected to the video reception apparatus, Control means for controlling the video data sending procedure to the transmission line,
The video compression means divides each frame constituting a moving image into a plurality of regions and a reference video coding method that can be expanded independently for each region and compensated video coding that compensates for a difference from the reference video code. Compression process
The control means increases the proportion of video data compressed by the reference video coding method included in one frame as the transmission speed of the transmission path is relatively high, and increases to one frame as the transmission speed of the transmission path is relatively low. Increasing the ratio of video data compressed by the included compensated video coding system and sending video data from the transmission means to the transmission path, calculating the average luminance for each region over multiple frames and averaging A relay device for a video transmission system, wherein a region having a luminance higher than a predetermined value is compressed by a reference video coding method, and a region having an average luminance lower than a predetermined value is compressed by a compensated video coding method .

One or more video transmission devices that transmit video data of moving images via a plurality of types of transmission paths having different transmission speeds, and a plurality of video reception devices that receive video data transmitted via the transmission paths, A relay device that relays video data transmitted from a video transmission device provided in the middle of the transmission path to one or more video reception devices,
Video compression means for compressing the video data received from the video transmission apparatus, transmission means for sending the video data compressed by the video compression means to one or more transmission paths connected to the video reception apparatus, Control means for controlling the video data sending procedure to the transmission line,
The video compression means divides each frame constituting a moving image into a plurality of regions and a reference video coding method that can be expanded independently for each region and compensated video coding that compensates for a difference from the reference video code. Compression process
The control means increases the proportion of video data compressed by the reference video coding method included in one frame as the transmission speed of the transmission path is relatively high, and increases to one frame as the transmission speed of the transmission path is relatively low. The ratio of video data compressed by the compensated video coding method included is increased and video data is transmitted from the transmission means to the transmission path, and the average value of contrast for each region over a plurality of frames is calculated. together was the average value of contrast compressed by reference video encoding method the region higher than a predetermined value, film average contrasts you characterized thereby compressed-compensated video coding scheme region lower than a predetermined value image A relay device for a transmission system.

One or more video transmission devices that transmit video data of moving images via a plurality of types of transmission paths having different transmission speeds, and a plurality of video reception devices that receive video data transmitted via the transmission paths, A relay device that relays video data transmitted from a video transmission device provided in the middle of the transmission path to one or more video reception devices,
Video compression means for compressing the video data received from the video transmission apparatus, transmission means for sending the video data compressed by the video compression means to one or more transmission paths connected to the video reception apparatus, Control means for controlling the video data sending procedure to the transmission line,
The video compression means divides each frame constituting a moving image into a plurality of regions and a reference video coding method that can be expanded independently for each region and compensated video coding that compensates for a difference from the reference video code. Compression process
The control means increases the proportion of video data compressed by the reference video coding method included in one frame as the transmission speed of the transmission path is relatively high, and increases to one frame as the transmission speed of the transmission path is relatively low. The ratio of the video data compressed by the included compensated video coding method is increased and the video data is sent from the transmission means to the transmission path, and the area where the person is shown in each frame is the reference video coding A relay device for a video transmission system, characterized in that a region in which a person is not captured is compressed by a compensation video coding method.

One or more video transmission devices that transmit video data of moving images via a plurality of types of transmission paths having different transmission speeds, and a plurality of video reception devices that receive video data transmitted via the transmission paths, A relay device that relays video data transmitted from a video transmission device provided in the middle of the transmission path to one or more video reception devices,
Video compression means for compressing the video data received from the video transmission apparatus, transmission means for sending the video data compressed by the video compression means to one or more transmission paths connected to the video reception apparatus, Control means for controlling the video data sending procedure to the transmission line,
The video compression means divides each frame constituting a moving image into a plurality of regions and a reference video coding method that can be expanded independently for each region and compensated video coding that compensates for a difference from the reference video code. Compression process
The control means increases the proportion of video data compressed by the reference video coding method included in one frame as the transmission speed of the transmission path is relatively high, and increases to one frame as the transmission speed of the transmission path is relatively low. Increasing the proportion of video data compressed with the included compensated video encoding method and sending video data from the transmission means to the transmission path, compressing the central area of the frame with the reference video encoding method, A relay device for a video transmission system, wherein a peripheral region is compressed by a compensated video encoding method.

2. The video compression means includes a first compression processing unit that performs compression processing using a reference video coding method and a second compression processing unit that performs compression processing using a compensated video coding method. The relay apparatus of the video transmission system in any one of -4.