US7557840B2 - Control method and system for a remote video chain - Google Patents

Control method and system for a remote video chain Download PDF

Info

Publication number
US7557840B2
US7557840B2 US10/798,234 US79823404A US7557840B2 US 7557840 B2 US7557840 B2 US 7557840B2 US 79823404 A US79823404 A US 79823404A US 7557840 B2 US7557840 B2 US 7557840B2
Authority
US
United States
Prior art keywords
video stream
video
image region
processing
processing chain
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Expired - Fee Related, expires
Application number
US10/798,234
Other languages
English (en)
Other versions
US20040212701A1 (en
Inventor
Francois Ladouceur
Briac Hardouin
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Orange SA
Original Assignee
France Telecom SA
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by France Telecom SA filed Critical France Telecom SA
Assigned to FRANCE TELECOM reassignment FRANCE TELECOM ASSIGNMENT OF ASSIGNORS INTEREST (SEE DOCUMENT FOR DETAILS). Assignors: HARDOUIN, BRIAC, LADOUCEUR, FRANCOIS
Publication of US20040212701A1 publication Critical patent/US20040212701A1/en
Application granted granted Critical
Publication of US7557840B2 publication Critical patent/US7557840B2/en
Expired - Fee Related legal-status Critical Current
Adjusted expiration legal-status Critical

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00—Television systems
    • H04N7/14—Systems for two-way working
    • H04N7/15—Conference systems
    • E—FIXED CONSTRUCTIONS
    • E05—LOCKS; KEYS; WINDOW OR DOOR FITTINGS; SAFES
    • E05B—LOCKS; ACCESSORIES THEREFOR; HANDCUFFS
    • E05B1/00—Knobs or handles for wings; Knobs, handles, or press buttons for locks or latches on wings
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00—Television systems
    • H04N7/14—Systems for two-way working
    • H04N7/141—Systems for two-way working between two video terminals, e.g. videophone
    • H04N7/147—Communication arrangements, e.g. identifying the communication as a video-communication, intermediate storage of the signals
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00—Television systems
    • H04N7/14—Systems for two-way working
    • H04N7/141—Systems for two-way working between two video terminals, e.g. videophone
    • H04N7/148—Interfacing a video terminal to a particular transmission medium, e.g. ISDN

Definitions

  • the invention pertains to a control method and device for a remote video chain.
  • videophone telecommunications use a video processing chain comprising a capture module, a coding module and a transmission module.
  • the first category of parameters groups together all those commands with which it is possible to remotely modify the behavior of the coding module of the video stream transmitter, by acting on its particular parameters.
  • protocol H.323 which applies to multimedia communication systems for IP networks (Internet Protocol) offers the possibility of sending a command to enable action upon the remote coder so as to increase the quality of images in a transmitted video stream to the detriment of fluidity, or conversely. Commands of this category are too restrictive and only offer the possibility of globally processing the transmitted video signal.
  • the second category groups together remote piloting commands for a camera, these commands being defined in protocols which lay down standardized commands to be sent to a remote camera, so as to modify its field of filming by acting mechanically on its orientation and zoom.
  • the application of these protocols in videophone telecommunications implies the use of compatible motorized cameras.
  • the purpose of the present invention is to eliminate these disadvantages.
  • This objective is achieved by providing a control method for a remote video processing chain producing a video stream to be transmitted to a terminal, with a view to acting upon the video stream, this method comprising steps during which the terminal transmits a command to the remote video processing chain in order to modify the video stream, and the remote video processing chain carries out the command on the video stream before transmitting it to the terminal.
  • the video stream processing commands executable by the remote video processing chain comprise processing commands to be applied to an image region, which contain a definition of an image region of the image contained in the transmitted video stream, associated with a definition of a processing operation to be applied to the image region, execution by the remote video chain of a processing command to be applied to an image region comprising a selection step to select the image region in the video stream defined by the command, and a processing step to apply the processing operation defined in the command to the image region selected in the video stream.
  • this process also comprises an activation step to activate an optional module in the video processing chain to carry out at least in part a command given by the terminal.
  • the video stream processing commands executable by the video processing chain comprise a zoom command associated with an image region to magnify the image region, a movement command to move the image region transmitted in the video stream subsequent to execution of the zoom command, and optionally a resolution increase command associated with an image region to increase the resolution of the image region to the detriment of the remainder of the image transmitted in the video stream.
  • the video processing chain restores a default image configuration in the video stream after a preset time interval starting from the time of execution of a video stream processing command.
  • video stream processing commands executable by the video processing chain comprise a restore command for restoring a default image configuration of the images transmitted in the video stream.
  • the transmission of processing commands for transmitted video stream is conducted in accordance with protocol H.323 or SIP in messages which are ignored by the terminal if it is not compliant with them.
  • the invention also concerns a system for controlling a first remote video processing chain producing a video stream which is transmitted to a first terminal via a telecommunications network, so as to act upon the transmitted video stream, this system comprising transmission means installed in the first terminal for transmitting to the first remote video processing chain processing commands to be applied to the video stream to be transmitted, and command receiving and execution means installed in the first remote video processing chain, for receiving and executing video stream processing commands on the video stream to be transmitted by the first processing chain.
  • the video stream processing commands executable by the first remote video processing chain comprise processing commands to be applied to an image region, containing a definition of an image region of the image contained in the video stream, associated with a definition of a processing operation to be applied to the image region,
  • the command receiving and execution means installed in the first remote video processing chain comprising selection means for selecting in the video stream the image region defined in a processing command to be applied to said image region, and application means for applying the processing operation defined in the command to the image region selected in the video stream.
  • this system comprises optional modules inserted in the first video processing chain to carry out at least in part the commands defining a processing operation to be applied to an image region in the transmitted video stream.
  • the optional modules comprise a reframing module.
  • the first video processing chain is installed in a second terminal comprising transmission means for transmitting commands to a second video processing chain installed in the first terminal to modify a video stream transmitted by the second video processing chain, the second video processing chain comprising command receiving and execution means for modifying the video stream it transmits.
  • FIG. 1 is a schematic of an example of a videophone telecommunications system to which the method of the invention applies;
  • FIG. 2 gives a more detailed diagram of a video processing and command processing chain of the invention, integrated in a terminal;
  • FIG. 3 shows the software organization of programs installed in a terminal.
  • FIG. 1 shows a videophone telecommunications system comprising two terminals 2 , 3 between which a videophone telecommunication is set up.
  • Each terminal is equipped with a display screen 5 , command members such as a keyboard 4 and mouse 6 , a camera 7 , a microphone 8 and at least one speaker 9 .
  • terminal 2 is connected via a local network 10 and a local server 11 to a public telecommunications network 1 , while terminal 3 is connected directly to network 1 .
  • terminals 2 , 3 via networks 1 , 10 and server 11 exchange video streams containing the images taken by cameras 7 and sounds captured by microphones 8 .
  • the exchanged video streams conform, for example, to protocol H.263+ and to QCIF image format (Quarter Common Intermediate), a frequently used video image format in videophone and videoconferencing communications.
  • QCIF image format Quarter Common Intermediate
  • the invention may also apply to other image formats, such as SQCIF, CIF, 4CIF, 16 CIF.
  • each terminal 2 , 3 comprises a video processing chain such as the one shown in FIG. 2 .
  • This chain is piloted by a command processing chain 21 .
  • the video processing chain 20 comprises a video transmission part to transmit video images taken by the camera or derived from another source 19 to another terminal, and a video receiving part to receive a video stream emitted by this other terminal and to display it on screen 5 .
  • the command processing chain comprises a command transmission part designed to transmit commands to the video processing chain of the other terminal, and a command receiving part designed to receive commands emitted by the other terminal and to pilot the transmission part of the video processing chain in relation to commands received.
  • the video transmission part comprises a capture module 22 which receives the video images taken by camera 7 of the terminal or derived from another source, and a coding module 24 designed to code the video stream provided by capture module 22 , in particular to compress this stream so as to adapt it to the assigned transmission rate, and a transmission module 26 connected to a communication module of the terminal to place the coded video stream, generated by coding module 24 , in the form of packets for its transmission.
  • the video receiving part comprises a video receiving module 29 designed to reconstitute a video stream from the packets received by the terminal, a video decoding module 30 connected to the receiving module and designed to decode the video stream, and a display module 31 which is connected on one side to the decoding module and on the other side to the display screen 5 of the terminal to reconstruct the decoded video stream.
  • optional modules 23 , 25 are also inserted in the transmission part of the video processing chain 20 upstream and/or downstream from coding module 24 , and/or integrated in the latter depending upon the configuration of terminal 2 , 3 .
  • the receiving part of the command processing chain comprises a command receiving module 28 which delivers received commands to a control module 27 , this module piloting the emitting part of the video processing chain, and in particular the capture module, optional modules 23 , 25 and coding module 24 as well as the video source 19 when applicable.
  • the transmission part of the command processing chain comprises a command module 32 which is connected to control members 4 , 6 of the terminal, and which generates commands from the commands given by the user by means of terminal control members 4 , 6 , and a command transmission module 33 connected to command module 32 and which transmits commands generated by command module 32 .
  • a command processing layer 21 a uses a software layer 41 implementing protocol H.323, for example, or SIP (Session Initiation Protocol) to transmit and receive commands from a remote terminal.
  • protocol H.323 the commands are transmitted in the form of “Facility” messages enabling the transmission of owner data.
  • SSIP protocol the commands may be transmitted using the “INFO” message.
  • a video processing layer 20 a uses a software layer 40 implementing protocol RTP (Real Time Protocol) or analog, to transmit and receive video streams in the form of packets.
  • the two layers 40 and 41 are designed to be interfaced with a layer 42 implementing the protocol TCP/IP (Transmission Control Protocol/Internet Protocol) grouping together the protocols used for the Internet network.
  • Layer 42 can be used to physically access the network using transport layer 43 .
  • terminal 2 receives a video stream H263+ in QCIF format which is processed by the receiving part of the video processing chain 20 .
  • the user can act upon the video stream received by means of keyboard 4 and/or mouse 6 by applying commands to the transmission part of the command processing chain 21 .
  • commands are received and processed by the receiving part of the command processing chain 21 of the other terminal 3 and are used to pilot the transmission part of the video processing chain of terminal 3 .
  • piloting commands which are generated by command module 32 are in the following format for example:
  • an image region is defined by its shape and size, for example “RECTANGLE ( ⁇ coordinates of upper left point>, ⁇ coordinates of lower right point>)”.
  • these commands may be:
  • control module 27 can apply several solutions to carry out this command.
  • control module 27 transmits a command to be applied to the camera for best framing of the region indicated in the command.
  • control module 27 applied to capture module 22 a format change command for incoming images so as to obtain greater resolution, for example requesting format CIF(352 ⁇ 288 pixels) instead of previously selected QCIF (176 ⁇ 144 pixels).
  • Controls module 27 then activates optional reframing module 23 between the capture module 22 and the coding module so as only to select one part of the image captured and more precisely that part of the image contained in the region indicated in the received command.
  • the control module 27 may also modify its outgoing format so that it corresponds to that of the specified region, i.e. in the example of the above command, 96 ⁇ 64 pixels.
  • the transmission rate has to be increased since the data transmitted to the decoding module 30 is greater.
  • the invention proposes the local increase in resolution of video images by assigning all or part of the transmission stream available to only one part of the image. The transmission part of the video processing chain will then concentrate its resources on the region requested by the remote user so as to offer the best quality possible by degrading or not coding those zones located outside the requested region.
  • reception module 28 receives a command for better resolution, for example:
  • part of the image is a still image
  • the user can therefore act on the remote video chain using this command so as no longer to receive this still part and to concentrate the resources of the video transmission chain on the desired part of the image.
  • the user can give a command in the following form for example:
  • the coordinates of the requested image region are expressed in relation to the current image region.
  • the capture source may be a motorized camera or a module for capturing a window in a still image (for example a computer display window). If the capture source can be moved, the command module acts directly on the source to endeavor to reach the region specified in the received command. If not, the control module 27 activates and commands an optional reframing module 23 and applies to it the region of the image to be transmitted.
  • the remote terminal may be a server which produces a video image grouping together several video streams for videoconferencing.
  • commands may be provided to act specifically on one of the video streams and on the presentation of the video streams in the image.

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
  • Compression Or Coding Systems Of Tv Signals (AREA)
US10/798,234 2003-03-13 2004-03-11 Control method and system for a remote video chain Expired - Fee Related US7557840B2 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
FR0303122 2003-03-13
FR0303122A FR2852473A1 (fr) 2003-03-13 2003-03-13 Procede et systeme de controle d'une chaine video distante

Publications (2)

Publication Number Publication Date
US20040212701A1 US20040212701A1 (en) 2004-10-28
US7557840B2 true US7557840B2 (en) 2009-07-07

Family

ID=32843100

Family Applications (1)

Application Number Title Priority Date Filing Date
US10/798,234 Expired - Fee Related US7557840B2 (en) 2003-03-13 2004-03-11 Control method and system for a remote video chain

Country Status (6)

Country Link
US (1) US7557840B2 (ja)
EP (1) EP1465425A1 (ja)
JP (1) JP2004282762A (ja)
KR (1) KR100989660B1 (ja)
CN (1) CN100536558C (ja)
FR (1) FR2852473A1 (ja)

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20130286153A1 (en) * 2012-04-26 2013-10-31 Wizard Of Ads, Sunpop Studios Ltd System and Method for Remotely Configuring and Capturing a Video Production
US10771801B2 (en) 2012-09-14 2020-09-08 Texas Instruments Incorporated Region of interest (ROI) request and inquiry in a video chain

Families Citing this family (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR100565328B1 (ko) * 2004-06-02 2006-03-30 엘지전자 주식회사 Ｒｔｓｐ 프로토콜을 이용한 원격 제어 시스템 및 방법
JP4568078B2 (ja) * 2004-10-20 2010-10-27 三洋電機株式会社 サーバ
KR100784971B1 (ko) 2006-07-06 2007-12-11 삼성전자주식회사 휴대 단말기 간 원격 제어 시스템과 이를 이용한업그레이드 시스템 및 방법
KR20080014329A (ko) * 2006-08-10 2008-02-14 삼성전자주식회사 영상표시장치 및 그 제어방법과 프로그램이 기록된 기록매체
US20090150435A1 (en) * 2007-12-08 2009-06-11 International Business Machines Corporation Dynamic updating of personal web page
CN102088593B (zh) * 2011-01-18 2012-10-24 西安电子科技大学 基于蓝牙3.0规范的mpeg4压缩视频传输通信系统及方法
CN106358004B (zh) * 2015-07-14 2019-08-16 腾讯科技（深圳）有限公司 视频通话方法及装置
US11910130B2 (en) * 2021-03-02 2024-02-20 Carnegie Mellon University Media control device and system

Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO1995011566A1 (en) 1993-10-20 1995-04-27 Videoconferencing Systems, Inc. Adaptive videoconferencing system
EP0776130A2 (en) 1995-11-27 1997-05-28 Canon Kabushiki Kaisha Camera control system with variable frame rate
US20010010545A1 (en) * 1996-01-30 2001-08-02 Akitomo Sasaki Camera control system
US20020118272A1 (en) 2001-02-23 2002-08-29 Jeremy Bruce-Smith Video conferencing system
US20030122936A1 (en) * 2002-01-02 2003-07-03 Pyle Norman C. Proxy-based remote control method and system for a digital image capture device
US6774927B1 (en) * 1999-12-22 2004-08-10 Intel Corporation Video conferencing method and apparatus with improved initialization through command pruning
US20050036036A1 (en) * 2001-07-25 2005-02-17 Stevenson Neil James Camera control apparatus and method

Family Cites Families (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH08294120A (ja) * 1995-04-19 1996-11-05 Oki Electric Ind Co Ltd 動画像通信システム
JPH09261522A (ja) * 1996-03-27 1997-10-03 Nippon Telegr & Teleph Corp <Ntt> 可変領域を得うる映像配信方法、ならびにシステム
JP4813635B2 (ja) * 1999-06-16 2011-11-09 ソニー株式会社 画像編集装置及び画像編集方法
JP4552252B2 (ja) * 2000-01-21 2010-09-29 株式会社セガ 音声および画像の入力機能と通信機能を持ったゲーム装置
JP2001238200A (ja) * 2000-02-22 2001-08-31 Hitachi Building Systems Co Ltd 防犯カメラの記録装置
JP2001285842A (ja) * 2000-03-29 2001-10-12 Minolta Co Ltd 監視システム
JP2002034010A (ja) * 2000-07-18 2002-01-31 Nagano Japan Radio Co テレビ電話システム

Patent Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO1995011566A1 (en) 1993-10-20 1995-04-27 Videoconferencing Systems, Inc. Adaptive videoconferencing system
EP0776130A2 (en) 1995-11-27 1997-05-28 Canon Kabushiki Kaisha Camera control system with variable frame rate
US20010010545A1 (en) * 1996-01-30 2001-08-02 Akitomo Sasaki Camera control system
US6774927B1 (en) * 1999-12-22 2004-08-10 Intel Corporation Video conferencing method and apparatus with improved initialization through command pruning
US20020118272A1 (en) 2001-02-23 2002-08-29 Jeremy Bruce-Smith Video conferencing system
US20050036036A1 (en) * 2001-07-25 2005-02-17 Stevenson Neil James Camera control apparatus and method
US20030122936A1 (en) * 2002-01-02 2003-07-03 Pyle Norman C. Proxy-based remote control method and system for a digital image capture device

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20130286153A1 (en) * 2012-04-26 2013-10-31 Wizard Of Ads, Sunpop Studios Ltd System and Method for Remotely Configuring and Capturing a Video Production
US8810625B2 (en) * 2012-04-26 2014-08-19 Wizard of Ads, SunPop Studios Ltd. System and method for remotely configuring and capturing a video production
US10771801B2 (en) 2012-09-14 2020-09-08 Texas Instruments Incorporated Region of interest (ROI) request and inquiry in a video chain
US12081782B2 (en) 2012-09-14 2024-09-03 Texas Instruments Incorporated Region of interest (ROI) request and inquiry in a video chain

Also Published As

Publication number Publication date
JP2004282762A (ja) 2004-10-07
KR100989660B1 (ko) 2010-10-26
EP1465425A1 (fr) 2004-10-06
US20040212701A1 (en) 2004-10-28
CN100536558C (zh) 2009-09-02
KR20040081370A (ko) 2004-09-21
CN1531340A (zh) 2004-09-22
FR2852473A1 (fr) 2004-09-17

Similar Documents

Publication Publication Date Title
US11695970B2 (en) System and method for controlling media content capture for live video broadcast production
US7710450B2 (en) System and method for dynamic control of image capture in a video conference system
US8988486B2 (en) Adaptive video communication channel
KR100906687B1 (ko) 다지점회의시스템 및 다지점회의장치
EP2676432B1 (en) Remote controlled studio camera system
US8624953B2 (en) Non-bandwidth intensive method for providing multiple levels of censoring in an A/V stream
JP2002007294A (ja) 画像配信システム及び方法並びに記憶媒体
CN102342066A (zh) 实时多媒体流处理带宽管理
US7557840B2 (en) Control method and system for a remote video chain
CN102447875A (zh) 一种对视频会议终端集中监控的方法和系统及相关装置
US20160057355A1 (en) Decoder and monitor system
CN110602440A (zh) 一种音视频数据流的传输方法、装置及终端
KR101357158B1 (ko) 화상 통신용 디스플레이 장치 및 화상 통신 방법
KR20120138720A (ko) 사용자 단말에 의해 제어가 가능한 제어유닛을 구비한 단말장치를 활용한 네트워크 광고시스템
CN113923396B (zh) 基于视频会议场景下的远程桌面控制方法、装置和介质
CN112839197B (zh) 图像码流处理方法、装置、系统及存储介质
KR102192240B1 (ko) 5g 디지털 통신을 이용한 원격지 커뮤니케이션 시스템
US11800158B2 (en) Video production systems and methods
CN105323530B (zh) 多媒体的协作系统、设备的控制方法及装置
US10455074B2 (en) Information processing system, information processing terminal, and control method and control program of information processing terminal
KR19990061602A (ko) 화상회의 시스템의 영상 구성 제어 방법
CN104702970A (zh) 一种同步视频数据的方法、设备及系统
CN114928593A (zh) 一种信息处理方法、装置及电子设备
JP2008072249A (ja) 通信装置

Legal Events

Date Code Title Description
AS Assignment

Owner name: FRANCE TELECOM, FRANCE

Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNORS:LADOUCEUR, FRANCOIS;HARDOUIN, BRIAC;REEL/FRAME:014696/0313;SIGNING DATES FROM 20040422 TO 20040503

REMI Maintenance fee reminder mailed
LAPS Lapse for failure to pay maintenance fees
STCH Information on status: patent discontinuation

Free format text: PATENT EXPIRED DUE TO NONPAYMENT OF MAINTENANCE FEES UNDER 37 CFR 1.362

FP Lapsed due to failure to pay maintenance fee

Effective date: 20130707