JP2009118193A - Image distribution system and image distribution method - Google Patents

Image distribution system and image distribution method Download PDF

Info

Publication number
JP2009118193A
JP2009118193A JP2007289109A JP2007289109A JP2009118193A JP 2009118193 A JP2009118193 A JP 2009118193A JP 2007289109 A JP2007289109 A JP 2007289109A JP 2007289109 A JP2007289109 A JP 2007289109A JP 2009118193 A JP2009118193 A JP 2009118193A
Authority
JP
Japan
Prior art keywords
image
line
packet
packets
data
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
JP2007289109A
Other languages
Japanese (ja)
Inventor
Masami Ogino
正実 荻野
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Meidensha Corp
Meidensha Electric Manufacturing Co Ltd
Original Assignee
Meidensha Corp
Meidensha Electric Manufacturing Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Meidensha Corp, Meidensha Electric Manufacturing Co Ltd filed Critical Meidensha Corp
Priority to JP2007289109A priority Critical patent/JP2009118193A/en
Publication of JP2009118193A publication Critical patent/JP2009118193A/en
Pending legal-status Critical Current

Links

Images

Landscapes

  • Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
  • Data Exchanges In Wide-Area Networks (AREA)

Abstract

<P>PROBLEM TO BE SOLVED: To enhance a real-time distribution of moving images, and to decrease a deterioration of an image quality. <P>SOLUTION: In a system or method of dividing moving image data into packets and transmitting each packet through a plurality of lines, an image dividing portion 11 adjusts a division size (data amount) of a packet according to a bandwidth of each line to be distributed to each line. A line monitoring portion 19 monitors whether or not a deficit ratio of a received packet per line has become equal to or more than a fixed value, and when it has become equal to or more than the fixed value, the image dividing portion separates the line and distributes the moving images by using the remaining normal lines. <P>COPYRIGHT: (C)2009,JPO&INPIT

Description

本発明は、画像配信装置側で取り込んだ動画データをパケットに分割し、各パケットを複数のネットワーク回線を通して受信側に配信するための画像配信システムおよび方法に関する。   The present invention relates to an image distribution system and method for dividing moving image data captured on an image distribution apparatus side into packets and distributing each packet to a reception side through a plurality of network lines.

この種の画像配信システムは、図2に例を示すように、動画(映像)は、画像端末(エンコーダ)1はカメラで撮影した画像をエンコーダでMPEG形式のデータに変換して画像配信装置2に送り、画像配信装置2でMPEGデータを各パソコン3に配信し、パソコン3で個別に再生表示する。このとき、MPEGデータはパケットに分割して転送するが、各パソコンとは1回線で接続される。   In this type of image distribution system, as shown in FIG. 2, for example, a video (video) image terminal (encoder) 1 converts an image captured by a camera into MPEG format data by an encoder, and an image distribution apparatus 2 The image distribution apparatus 2 distributes the MPEG data to each personal computer 3 and the personal computer 3 individually reproduces and displays the data. At this time, the MPEG data is divided into packets and transferred, but is connected to each personal computer through one line.

このような画像配信システムにおいて、受信側が低い処理能力の場合や回線が狭い帯域の場合に画像データをリアルタイムで受信できなくなる場合がある。この対策として、画像データを複数のパケットに分割して送受信し、受信側でパケットの連続性の管理で再構築可能にする。さらに、画像を2次元平面でタイル状に分割し、これらを圧縮処理して複数の回線でマルチキャスト送信し、受信側で伸張(デコード)して画像を再構築する(例えば、特許文献1参照)。
特開2002−320226号公報
In such an image distribution system, there are cases where image data cannot be received in real time when the receiving side has low processing capability or when the line has a narrow bandwidth. As a countermeasure, image data is divided into a plurality of packets and transmitted / received, and can be reconstructed by managing the continuity of packets on the receiving side. Furthermore, the image is divided into tiles on a two-dimensional plane, these are compressed, multicast transmitted over a plurality of lines, and decompressed (decoded) on the receiving side to reconstruct the image (for example, see Patent Document 1). .
JP 2002-320226 A

特許文献1の手法では、携帯電話等の伝送帯域の低い(32kbps)回線の場合など、1つの回線で転送できるデータ量が少ないとき、複数の回線を使ったマルチキャスト送信し、受信側で画像を再構築する。   In the method of Patent Document 1, when the amount of data that can be transferred by one line is small, such as a line having a low transmission band (32 kbps) such as a cellular phone, multicast transmission using a plurality of lines is performed and images are received on the receiving side. Rebuild.

この配信方法において、受信側装置の一部に受信失敗を起こした場合、所定時間の間、パケットの送信を停止し、この後パケットの送信速度を所定時間だけ低下させる。このため、パケットの送信停止中はパケットの破棄と同じになり、リアルタイム性を損なう。   In this distribution method, when a reception failure occurs in a part of the receiving side device, the transmission of the packet is stopped for a predetermined time, and then the transmission speed of the packet is decreased by the predetermined time. For this reason, when the packet transmission is stopped, it becomes the same as the packet discard, and the real-time property is impaired.

また、パケットの送信速度を低下させる期間では、帯域が狭い場合にデータを間引くのと同じに、画像品質が悪くなる。   Further, in the period in which the packet transmission speed is reduced, the image quality is deteriorated in the same manner as when data is thinned out when the bandwidth is narrow.

本発明の目的は、動画配信のリアルタイム性を高め、かつ画像品質の低下を少なくした画像配信システムおよび画像配信方法を提供することにある。   An object of the present invention is to provide an image distribution system and an image distribution method that improve the real-time property of moving image distribution and reduce deterioration in image quality.

本発明は、前記の課題を解決するため、動画データをパケットに分割し、各パケットを複数の回線を通して送信するシステムまたは方法において、各回線の帯域に応じてパケットの分割サイズ(データ量)を調整し、さらに、各回線のパケット欠損率監視により、ある回線が異常になった場合には残りの正常な回線を通して動画を配信するようにしたもので、以下のシステムおよび方法を特徴とする。   In order to solve the above-described problem, the present invention divides moving image data into packets, and in a system or method for transmitting each packet through a plurality of lines, the packet division size (data amount) is set according to the bandwidth of each line. In addition, by monitoring the packet loss rate of each line, when a certain line becomes abnormal, a moving image is distributed through the remaining normal lines, and the following system and method are characterized.

(1)画像端末からの画像データをMPEGデータに変換し、これをパケットに分割して複数の回線を通して受信側に送信し、受信側は各回線を通して受信するパケットから画像を再構築する画像配信システムであって、
各回線の帯域に応じてパケットの分割サイズ(データ量)を調整して各回線に分配する画像分割手段を備えたことを特徴とする。
(1) Image distribution in which image data from an image terminal is converted into MPEG data, divided into packets, transmitted to a receiving side through a plurality of lines, and the receiving side reconstructs an image from packets received through each line. A system,
An image dividing means for adjusting the packet division size (data amount) according to the bandwidth of each line and distributing the packet to each line is provided.

(2)回線ごとの受信パケットの欠損率が一定以上になったか否かを監視する回線監視手段を備え、
前記画像分割手段は、パケット欠損率が一定以上になった場合、該当回線を切り離して、残りの正常な回線を使って動画を配信する手段を備えたことを特徴とする。
(2) Provided with line monitoring means for monitoring whether or not the loss rate of received packets for each line has exceeded a certain level,
The image dividing means includes means for disconnecting the corresponding line and distributing the moving image using the remaining normal lines when the packet loss rate exceeds a certain level.

(3)画像端末からの画像データをMPEGデータに変換し、これをパケットに分割して複数の回線を通して受信側に送信し、受信側は各回線を通して受信するパケットから画像を再構築する画像配信方法であって、
各回線の帯域に応じてパケットの分割サイズ(データ量)を調整して各回線に分配する画像分割手順を有することを特徴とする。
(3) Image distribution in which image data from an image terminal is converted into MPEG data, divided into packets, transmitted to the receiving side through a plurality of lines, and the receiving side reconstructs an image from packets received through each line. A method,
An image dividing procedure for adjusting the packet division size (data amount) according to the bandwidth of each line and distributing the packet to each line is provided.

(4)回線ごとの受信パケットの欠損率が一定以上になったか否かを監視する回線監視手順を有し、
前記画像分割手順は、パケット欠損率が一定以上になった場合、該当回線を切り離して、残りの正常な回線を使って動画を配信する手順を有することを特徴とする。
(4) It has a line monitoring procedure for monitoring whether or not the loss rate of received packets for each line has exceeded a certain level,
The image segmentation procedure includes a procedure of disconnecting the corresponding line and distributing a moving image using the remaining normal lines when the packet loss rate becomes a certain level or more.

以上のとおり、本発明によれば、各パケットを複数の回線を通して送信するシステムまたは方法において、各回線の帯域に応じてパケットの分割サイズ(データ量)を調整して配信するため、帯域が異なる回線を利用した画像配信でリアルタイム性を高めかつ画像品質の低下を少なくした画像伝送ができる。   As described above, according to the present invention, in a system or method for transmitting each packet through a plurality of lines, the packet division size (data amount) is adjusted and distributed according to the band of each line, so the bands are different. Image transmission using a line can improve the real-time performance and reduce image quality degradation.

また、使用する回線の選択自由度を高めることができる。   In addition, the degree of freedom in selecting the line to be used can be increased.

また、各回線のパケット欠損率監視により、ある回線が異常になった場合には残りの正常な回線を通して動画を配信することができる。   Further, by monitoring the packet loss rate of each line, if a certain line becomes abnormal, a moving image can be distributed through the remaining normal lines.

図1は、本発明の実施形態を示す画像配信システムの構成図である。このシステムは、基本的には、画像配信装置側で画像データを分割し、複数回線を同時に使用して画像データを受信装置になるパソコンに伝送する。パソコン側では、複数の回線を通して送られてきたデータを一つの連続した動圃データに組み立てて動画を再生する。   FIG. 1 is a configuration diagram of an image distribution system showing an embodiment of the present invention. In this system, basically, image data is divided on the image distribution apparatus side, and the image data is transmitted to a personal computer as a receiving apparatus using a plurality of lines simultaneously. On the personal computer side, data sent through a plurality of lines is assembled into one continuous motion data and a moving image is reproduced.

画像分割部11は、画像端末1で撮影した動画の一つの画像データを回線の帯域の大きさに応じてパケットに分割する。この分割は回線の帯域管理テーブル12にもつ帯域データに従って行う。すなわち、回線の帯域が広ければパケットサイズ(データ量)を大きくし、帯域が狭ければパケットサイズを小さくする。   The image dividing unit 11 divides one piece of image data of a moving image taken by the image terminal 1 into packets according to the bandwidth of the line. This division is performed according to the bandwidth data stored in the bandwidth management table 12 of the line. That is, the packet size (data amount) is increased if the bandwidth of the line is wide, and the packet size is decreased if the bandwidth is narrow.

画像分割部11で分割した各パケットにはシーケンス番号と回線番号を付加して画像配信部13に渡す。画像配信部13では、画像分割部11から渡されたパケットを、各回線から送信する。   A sequence number and a line number are added to each packet divided by the image dividing unit 11 and passed to the image distributing unit 13. The image distribution unit 13 transmits the packet passed from the image division unit 11 from each line.

パソコン側の受信部14は、各回線を通して受信した受信パケットのシーケンス番号をシーケンス番号管理テーブル15に登録すると共に、画像データ(パケット)を画像再構築バッファ16に複数パケット分だけ順次保存/更新する。   The receiving unit 14 on the personal computer side registers the sequence number of the received packet received through each line in the sequence number management table 15 and sequentially stores / updates the image data (packet) in the image reconstruction buffer 16 for a plurality of packets. .

画像構築部17は、一定周期(t1)でシーケンス番号管理テーブル15をスキャンし、完成した画像(シーケンス番号の欠落のない画像データ)が受信されていれば、その画像データを再構築し、画像再生部18に渡して画像を再生する。また、画像構築部17は、一定時間内に再構築されなかった場合、後から送られた画像が再構築された場合は構築中の画像データを破棄する。   The image construction unit 17 scans the sequence number management table 15 at a constant period (t1), and if a completed image (image data with no missing sequence number) is received, the image construction unit 17 reconstructs the image data. The image is transferred to the reproduction unit 18 and reproduced. Further, the image construction unit 17 discards the image data being constructed when the image is not reconstructed within a predetermined time and the image sent later is reconstructed.

なお、画像構築部17は、後から送られてきた画像データが完成した場合、又は画像データの先頭パケットを受信してから一定時間(t2)経過しても当該パケットをもつ画像データの全てが揃わなかったものは破棄する。   Note that the image construction unit 17 determines that all of the image data having the packet remains when the image data sent later is completed, or even after a predetermined time (t2) has elapsed since the reception of the first packet of the image data. Discard items that are not aligned.

画像配信装置側の回線監視部19は、定期的に受信部14で受信したパケット数を問合せて、回線ごとに送信パケット数と受信パケット数を比較し、パケット欠損の比率がn%以上の場合、この監視結果を帯域管理テーブル12に書き込んでおく。画像分割部11は、パケット分割に際して、パケット欠損率が高い回線を切離して、残りの正常な回線にパケットを分割して画像データを送信する。   The line monitoring unit 19 on the image delivery apparatus side periodically inquires about the number of packets received by the receiving unit 14, compares the number of transmitted packets and the number of received packets for each line, and the ratio of packet loss is n% or more. The monitoring result is written in the bandwidth management table 12. When dividing the packet, the image dividing unit 11 disconnects the line with a high packet loss rate, divides the packet into the remaining normal lines, and transmits the image data.

以上の画像配信システム構成と配信方法によれば、複数回線を同時に使用し、回線の帯域に応じてパケットの分割サイズ(データ量)を調整して回線別に送信する。この配信手法により、帯域が異なる回線を利用した配信で高品質の画像伝送ができるし、使用する回線の選択自由度を高めることができる。   According to the image distribution system configuration and the distribution method described above, a plurality of lines are used simultaneously, the packet division size (data amount) is adjusted according to the band of the line, and transmission is performed for each line. With this distribution technique, high-quality image transmission can be performed by distribution using lines with different bands, and the degree of freedom of selection of lines to be used can be increased.

例えば、パケットを分割伝送する回線として、携帯電話、PHS、防災無線等の異なった種類の回線を組み合わせて運用することができる。しかも、災害のときなど(携帯電話等がかかり難い場合)でも、品質は落ち(パラパラ動画になる)ても、動画を送ることができる。   For example, different types of lines such as mobile phones, PHSs, and disaster prevention radios can be used in combination as lines for dividing and transmitting packets. Moreover, even in the event of a disaster (when it is difficult to make a mobile phone or the like), even if the quality drops (becomes a flip video), it is possible to send a video.

また、各回線のパケット欠損率から各回線の異常の有無を監視しておくことにより、ある回線が異常になった場合でも、残りの正常な回線を通して動画を送ることができる。この回線管理と切り離しにより、従来の所定時間のパケットの送信停止やその後のパケットの送信速度低下による対策に比べて、リアルタイム性を確保し、かつ画像品質の低下も少なくなる。   Further, by monitoring the presence / absence of abnormality in each line from the packet loss rate of each line, even if a certain line becomes abnormal, a moving image can be transmitted through the remaining normal lines. By disconnecting from this line management, the real-time property is ensured and the deterioration of the image quality is reduced as compared with the conventional countermeasures for stopping the packet transmission for a predetermined time and for reducing the packet transmission speed thereafter.

なお、実施形態では、画像配信装置とパソコン(画像表示クライアント)の間の仕組みを示したが、画像端末1と画像配信装置の間の動画転送にも応用できる。この場合、画像配信装置→画像端末、パソコン→画像配信装置とした逆方向のパケット送信になる。   In the embodiment, the mechanism between the image distribution apparatus and the personal computer (image display client) is shown, but the present invention can also be applied to moving image transfer between the image terminal 1 and the image distribution apparatus. In this case, packet transmission is performed in the reverse direction in the order of image distribution device → image terminal, personal computer → image distribution device.

本発明の実施形態を示す画像配信システムの構成図。The block diagram of the image delivery system which shows embodiment of this invention. 画像配信システムの例。An example of an image distribution system.

符号の説明Explanation of symbols

11 画像分割部
12 帯域管理テーブル
13 パケット送信部
14 パケット受信部
15 シーケンス番号管理テーブル
16 画像再構築バッファ
17 画像構築部
18 画像再生部
19 回線監視部
DESCRIPTION OF SYMBOLS 11 Image division part 12 Band management table 13 Packet transmission part 14 Packet reception part 15 Sequence number management table 16 Image reconstruction buffer 17 Image construction part 18 Image reproduction part 19 Line monitoring part

Claims (4)

画像端末からの画像データをMPEGデータに変換し、これをパケットに分割して複数の回線を通して受信側に送信し、受信側は各回線を通して受信するパケットから画像を再構築する画像配信システムであって、
各回線の帯域に応じてパケットの分割サイズ(データ量)を調整して各回線に分配する画像分割手段を備えたことを特徴とする画像配信システム。
This is an image distribution system that converts image data from an image terminal into MPEG data, divides it into packets, transmits the packets to a receiving side through a plurality of lines, and the receiving side reconstructs an image from packets received through each line. And
An image distribution system comprising image dividing means for adjusting a packet division size (data amount) according to a bandwidth of each line and distributing the packet to each line.
回線ごとの受信パケットの欠損率が一定以上になったか否かを監視する回線監視手段を備え、
前記画像分割手段は、パケット欠損率が一定以上になった場合、該当回線を切り離して、残りの正常な回線を使って動画を配信する手段を備えたことを特徴とする請求項1に記載の画像配信システム。
Line monitoring means for monitoring whether or not the loss rate of received packets for each line has exceeded a certain level,
2. The image dividing means according to claim 1, further comprising means for disconnecting the corresponding line and distributing a moving image using the remaining normal lines when the packet loss rate exceeds a certain level. Image distribution system.
画像端末からの画像データをMPEGデータに変換し、これをパケットに分割して複数の回線を通して受信側に送信し、受信側は各回線を通して受信するパケットから画像を再構築する画像配信方法であって、
各回線の帯域に応じてパケットの分割サイズ(データ量)を調整して各回線に分配する画像分割手順を有することを特徴とする画像配信方法。
This is an image distribution method in which image data from an image terminal is converted into MPEG data, divided into packets and transmitted to a receiving side through a plurality of lines, and the receiving side reconstructs an image from packets received through each line. And
An image distribution method comprising an image division procedure for adjusting a packet division size (data amount) according to a bandwidth of each line and distributing the packet to each line.
回線ごとの受信パケットの欠損率が一定以上になったか否かを監視する回線監視手順を有し、
前記画像分割手順は、パケット欠損率が一定以上になった場合、該当回線を切り離して、残りの正常な回線を使って動画を配信する手順を有することを特徴とする請求項3に記載の画像配信方法。
A line monitoring procedure for monitoring whether or not the loss rate of received packets for each line has exceeded a certain level,
4. The image according to claim 3, wherein the image segmentation procedure includes a procedure of disconnecting the corresponding line and distributing a moving image using the remaining normal lines when the packet loss rate becomes a certain level or more. Delivery method.
JP2007289109A 2007-11-07 2007-11-07 Image distribution system and image distribution method Pending JP2009118193A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
JP2007289109A JP2009118193A (en) 2007-11-07 2007-11-07 Image distribution system and image distribution method

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
JP2007289109A JP2009118193A (en) 2007-11-07 2007-11-07 Image distribution system and image distribution method

Publications (1)

Publication Number Publication Date
JP2009118193A true JP2009118193A (en) 2009-05-28

Family

ID=40784822

Family Applications (1)

Application Number Title Priority Date Filing Date
JP2007289109A Pending JP2009118193A (en) 2007-11-07 2007-11-07 Image distribution system and image distribution method

Country Status (1)

Country Link
JP (1) JP2009118193A (en)

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2012060311A (en) * 2010-09-07 2012-03-22 Nippon Hoso Kyokai <Nhk> Stream dividing apparatus and reception apparatus
KR102144231B1 (en) * 2019-11-18 2020-08-12 에이미파이(주) Method for transmitting video pictures being captured by a drone through cellular networks in real time and apparatus for said method

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2012060311A (en) * 2010-09-07 2012-03-22 Nippon Hoso Kyokai <Nhk> Stream dividing apparatus and reception apparatus
KR102144231B1 (en) * 2019-11-18 2020-08-12 에이미파이(주) Method for transmitting video pictures being captured by a drone through cellular networks in real time and apparatus for said method

Similar Documents

Publication Publication Date Title
US10701370B2 (en) System and method for automatic encoder adjustment based on transport data
CN102598617B (en) System and method of transmitting content from a mobile device to a wireless display
US9042444B2 (en) System and method for transmission of data signals over a wireless network
US7940653B2 (en) Audiovisual data transport protocol
WO2020086452A1 (en) Low-latency video internet streaming for management and transmission of multiple data streams
CN101848382A (en) Method and system for adjusting video streaming image resolution ratio and code stream
US9749542B2 (en) Decoder and monitor system
AU2021200428B2 (en) System and method for automatic encoder adjustment based on transport data
KR101539812B1 (en) Moving-picture image data-distribution method
JP2009118193A (en) Image distribution system and image distribution method
US20060259939A1 (en) Method, system and receiving device for transmitting screen frames from one to many terminals
JP2005033373A (en) Apparatus and method for transmitting data and for receiving data, and data telecommunication system
JP2011151566A (en) Broadcast system, broadcasting signal transmitter-receiver, and broadcasting signal transmission method
JP4049378B2 (en) Server in bidirectional image communication system, processing method thereof, and program
JP6512700B2 (en) Video signal transmission system and video signal transmission method
JP2009060553A (en) Method of transceiving mpeg data
JP2009239514A (en) Motion picture distribution apparatus, going-through device, and motion picture distribution system and method
KR100326534B1 (en) Multicasting Method of Distributed System
JP2016174235A (en) Data transmission system and load distribution device
JP2006109011A (en) Server in bidirectional image communication system, its processing method and program
US9288648B2 (en) Transport stream packet generation device and method of generating transport stream packet thereof
JP2005020466A (en) Video signal encoding device and video conference system using the same
JP2005175787A (en) Device, system, and method for distributing data
JP2009100015A (en) Video data distribution system, video distribution server, and video receiving client
JP2012253822A (en) Transmission/reception method of mpeg data