EP1185142A2 - System zur Betrachtung eines visuellen Inhalts - Google Patents

System zur Betrachtung eines visuellen Inhalts Download PDF

Info

Publication number
EP1185142A2
EP1185142A2 EP01115771A EP01115771A EP1185142A2 EP 1185142 A2 EP1185142 A2 EP 1185142A2 EP 01115771 A EP01115771 A EP 01115771A EP 01115771 A EP01115771 A EP 01115771A EP 1185142 A2 EP1185142 A2 EP 1185142A2
Authority
EP
European Patent Office
Prior art keywords
display
movie
dialog
viewer
text
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Withdrawn
Application number
EP01115771A
Other languages
English (en)
French (fr)
Other versions
EP1185142A3 (de
Inventor
Edward G. Newman
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Xybernaut Corp
Original Assignee
Xybernaut Corp
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Xybernaut Corp filed Critical Xybernaut Corp
Publication of EP1185142A2 publication Critical patent/EP1185142A2/de
Publication of EP1185142A3 publication Critical patent/EP1185142A3/de
Withdrawn legal-status Critical Current

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04S—STEREOPHONIC SYSTEMS 
    • H04S1/00—Two-channel systems

Definitions

  • the invention relates to a system for viewing visual content according to the features of claim 1.
  • the invention is generally related to a method for viewing closed captioning during movies, displayed or available to be displayed, at the theater or on TV or other display devices. It includes a head mounted display for watching the closed caption text or for watching subtitled information for movies which are being shown in a language foreign to the viewer of the movie or for the benefit of those who are hearing impaired.
  • This application is related to concurrently filed application entitled, "System for delivering synchronized audio content to viewers of movies," and pending application, "Multimedia I/O Interface Device for use at Entertainment Events,” both commonly assigned.
  • a potential solution is to use subtitled text in the movie theater so that hearing impaired people can read the dialog while others listen to it. This is being done on a very small scale in a few cities. There are currently six theaters in six different cities which have dedicated screens for open captions which are permanently displayed and tens of others which show captioned versions on certain days of the month. The open captions appear as printed text at the bottom of the screen simultaneous to the dialog. The reason this captioning hasn't become more pervasive is that those who are not hearing impaired, who make up a much larger percentage of the population, do not wish to see this text being displayed as it visually detracts from the image on the screen.
  • Another demographic is native citizens who wish to watch foreign films which are shown in the U.S. In larger metropolitan cities, popular foreign movies are frequently played at theaters in their original language either without subtitles or with permanent subtitles. It would be desirable for persons attending these films to designate a language to view the movies in.
  • Another object of this invention is to create a system which will be in synchronization with active dialog, and will display that dialog to viewers in text or symbolic format.
  • Yet another object of this invention is to create a system which will provide individualized captioning for viewers of motion pictures while at the movie theater or elsewhere.
  • Still yet another object of this invention is to provide a system which is worn on the head like glasses.
  • An additional object of this invention is to provide a system which will display dialog to the viewer without obstructing his view of the action on the screen.
  • Yet another additional object of this invention is to provide a system which allows users to selectively choose the language of the displayed dialog.
  • a head worn device for viewing closed caption text and optionally listening to dialog while watching motion pictures at the movie theater or while attending other public events, or at home via a television receiver.
  • FIG. 1 illustrates a system level diagram of the fundamental components.
  • the film source 101 feeds through a communications link 102 to a central router/processor 100.
  • the router/processor 100 will at least handle the broadcast of the closed caption text. Optionally, it may perform on-the-fly conversion of audio dialog to closed captioning and even translation to other languages if necessary.
  • the output of this router will be transmitted through communications link 104, which could be a wired or wireless link, to the individual user viewer means 103, which can include head mounted displays, flat panel display, neck hung display, wrist worn display, or any other suitable display. It may be desirable to have a lighted display in some instances.
  • "Viewing means" includes any suitable user supported display in the context of the present disclosure and claims.
  • FIGs 2 and 3 illustrate wired and wireless headset or viewing means embodiments whereby the headset 103 is configured as a set of glasses.
  • the headset glasses 103 use power/signal wire 106 to connect to a connector in or near a theater seat, via connector 107.
  • control module 105 In the data stream is control module 105, used to affect various controls available to the head mounted display 103.
  • the connector 107 is replaced with a combined battery pack and wireless receiver 108 so that the device can operate in a wire free mode, thus eliminating the need for connector 107.
  • Figure 4 illustrates the system in the context of an event, other than a movie, where persons may be moving around within a certain range. While similar to the movie theater embodiment, the devices in this case will preferably be wireless so that persons can use them while moving about the event.
  • the event management computer and transmitter 109 routes and sends out any audio messages to the attendees of the events, via wireless communication link 110, to be displayed on the user headset display 103.
  • the computer 109 can also perform translation of messages if desired.
  • FIG. 5 illustrates an exemplary control module 105.
  • Brightness control 113, focus control 114 and position control 115 are shown.
  • There is an optional language selection interface and control 116 which allows users to designate the language of the closed caption text which will appear on their display units 103.
  • the invention is directed to a method of delivering and viewing closed caption or subtitled or symbolic text dialog in movie theaters or at other locations or events. It is comprised essentially of a binocular, monocular, or eyeglass-type head mounted display 103, a central router and processor 100, and a transmission mechanism and protocol 104.
  • the enclosures of concurrently filed application entitled, "System for delivering synchronized audio content to viewers of movies” and pending application entitled “Multimedia I/O Interface Device for use at Entertainment Events” are hereby incorporated by reference into the disclosure of this invention.
  • the display 103 can be in the form of a pair of electronic glasses or visors with an integral screen.
  • the screen or viewing means allows viewers to look through it so that they can view the real time movie, but also displays text which is correlated to the current dialog occurring in the motion picture or at the event, in a manner analogous to the heads up displays used by pilots in military aircraft who need to be able to read textual output while also looking ahead. This will allow deaf persons to go to movie theaters and follow the dialog in a manner that is transparent to those who are not hearing impaired.
  • moving theaters is meant any location where a movie can be seen.
  • the display 103 can also have a control 116 for selecting the language of either the spoken or subtitled dialog, which will allow viewers who wish to see or listen to the dialog in a language other than the one being broadcast on the screen the ability to do so.
  • the invention will require the ability to deliver, in real time or near real time, the text content to the viewers' display units so that it will correlate to the action on the screen.
  • Closed captioning technology is well known in the entertainment production business as it comes standard on televisions now to accommodate hearing impaired persons.
  • CCML ⁇ a time or frame based Closed Caption Markup Language
  • the beginning and end of the text dialog can be tagged to frames of the film so that it would be seamlessly and synchronously integrated with the dialog in the movie.
  • a simple software protocol could be written to facilitate the creation and positioning of the closed caption text.
  • This CCML ⁇ will create a new standard for merging closed captioning to existing movie playback formats. It will also be useful for digital movies because of the similar manner in which digital movies are produced using a series of single frames. Using frame tags, a portion of text can be given stop and start points so that it is synchronized with the audible dialog and action on the screen. This standard can also be used for delivering commercial information, movie trailer dialog, and safety information such as that which is typically broadcast prior to the beginning of a feature presentation. Alternatively, a robust captioning engine, running on the router/processor 100, could be used which could either prior to the movie, simultaneous to the movie or slightly ahead of the movie compile and deliver the translated text.
  • This engine would possess a high quality textual and contextual translation engine in order to perform several language translations on-the-fly.
  • the central router and processor 100 will handle the broadcast of this data to the individual user devices 103.
  • This will be comprised of at least a transmitter and alternatively a server computer to perform the processing on-the-fly or slightly ahead of time generation and/or translation and/or transmission of the closed caption text.
  • the invention would serve as a preprocessor that interfaces between the video signal source of a movie and the television display.
  • the text is produced and is synchronized with the action in the movie, it merely needs to be delivered to the head mounted display of the viewers.
  • This can be accomplished through one of several embodiments using existing and/or future technologies. These embodiments can be generally segmented into two types, wired and unwired.
  • the device itself has a plug on it that plugs into a connector which is integral to the movie theater seat. Much like airplane headphones, the user merely sits down and plugs them in.
  • the connector will provide both power and content to the device 103. This will eliminate the need for an integral power supply, will enhance reliability of the system, and minimize the cost of the individual devices 103.
  • viewers can purchase the devices either at the theater or elsewhere, reducing the cost to the movie theater owners who merely provide the backbone and interface connection to the viewer's devices 103.
  • the format of the data itself will be either digital or analog, as only fairly narrow bandwidth will be required to carry this textual information.
  • the display 103 itself can be digital or analog as both methods have well known advantages and disadvantages.
  • the data can be transmitted wirelessly.
  • This could either be as closed circuit analog TV, RF, or through digital transmission means such as IEEE 802.11, or any other existing or future transmission protocols.
  • a low power closed circuit TV transmitter could be placed in the projector room or elsewhere in the theater servicing the entire room with each language broadcast on a different channel band.
  • a wireless LAN transmitter/- receiver could be placed in the projector room or elsewhere in the theater so that wireless communications could be maintained with individual headsets 103.
  • the headsets themselves will possess wireless receiving means 108 in order to receive the signal.
  • analog transmission means are utilized, then the headset 103 will require an integral analog signal receiver and optionally a tuner. In either case it may be desirable to include a headphone speaker or speakers for those who are not completely deaf, but hearing impaired to the extent that they can not easily hear text dialog without selective amplification, due to other background noise and music in the movie soundtrack.
  • the device will have an integrated interface 111 for ordering food or beverages from the concession area outside the theater which are delivered to the seat location of the user/wearer of the system.
  • the interface will be comprised of item selection buttons 112.
  • the users When the users get the devices, upon arrival at the theater, or sometime before that, they can establish a billing account to pay for such items that are ordered while at the movie or event, or they can pay for them at time of delivery. This will have particular benefits if the device derives its power and signal from the seat location as it will enable the person delivering the food to identify the exact location of the person ordering it.
  • the device 103 can be worn or carried at events or attractions such as sporting events, amusement parks, artistic events, or other publicly or privately attended events where audio information is broadcast aloud.
  • events or attractions such as sporting events, amusement parks, artistic events, or other publicly or privately attended events where audio information is broadcast aloud.
  • promotional/advertisement information, safety information, public service information, and information specific to the event or attraction can be delivered to those who are hearing impaired or those who do not speak the language of the broadcast dialog. This would not only enhance the experience of the attendees but would also allow those who are sponsoring and managing the event or attraction to deliver information to a wider audience further increasing the return on investment for themselves.
  • the power in either wireless embodiment, the power could be supplied via a connector built in to the theater's seat, or the headset 103 itself could have an integral or attached battery supply.
  • the headset 103 As more efficient fuel cells are developed, it will eventually become cost efficient to use batteries. However, at present, drawing the power for the device 103 from the connection in the theater's seats will increase overall system reliability, reduce costs, and eliminate device interrupts due to loss of power.
  • the viewing unit itself, several companies such as Sony Corporation, Shimadzu Corporation, Minolta Corporation, MicroVision, among others, all make small monocular and binocular displays head mounted displays. They are worn comfortably on the head like eyeglasses or headsets and can support analog or digital signal display.
  • the display 103 will optionally have a channel selector 116 which allows the wearer to selectively choose the language he wishes to view or listen to the subtitled text in. It will also optionally have manual focus 114, brightness 113, and positioning 115 controls so that the user can move the text line to a position which optimizes his viewing of the action on the screen.
  • the system can automatically detect its distance from the screen and adjust the focus, brightness and position for optimum viewability. It could also attach to, fit over, or extend beyond a viewer's prescription glasses enabling him to wear his glasses if necessary to view the movie screen.
  • the disclosed invention overcomes the current deficiencies of the state of the art in the motion picture and entertainment industry. It creates a new standard for selectively delivering dialog to viewers of movies in the theater or persons attending other events, that is invisible to those who are not using it. It provides heretofore unknown flexibility in accommodating those who are either hearing impaired or who do not understand the language the movie is being played in. It also provides a medium for interaction with the facility and/or event management and a platform for commercial transactions.

Landscapes

  • Physics & Mathematics (AREA)
  • Engineering & Computer Science (AREA)
  • Acoustics & Sound (AREA)
  • Signal Processing (AREA)
  • Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
  • Devices For Indicating Variable Information By Combining Individual Elements (AREA)
EP01115771A 2000-08-30 2001-07-10 System zur Betrachtung eines visuellen Inhalts Withdrawn EP1185142A3 (de)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
US65054700A 2000-08-30 2000-08-30
US650547 2000-08-30

Publications (2)

Publication Number Publication Date
EP1185142A2 true EP1185142A2 (de) 2002-03-06
EP1185142A3 EP1185142A3 (de) 2004-09-22

Family

ID=24609361

Family Applications (1)

Application Number Title Priority Date Filing Date
EP01115771A Withdrawn EP1185142A3 (de) 2000-08-30 2001-07-10 System zur Betrachtung eines visuellen Inhalts

Country Status (3)

Country Link
EP (1) EP1185142A3 (de)
JP (1) JP2002153684A (de)
CA (1) CA2350015A1 (de)

Cited By (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2006037146A1 (en) * 2004-10-05 2006-04-13 Guy Rischmueller Method and system for providing broadcast captions
WO2008059075A1 (es) * 2006-11-16 2008-05-22 Centro Especial De Integracion Audiovisual Y Formacion, S.L.L. Sistema de distribución de subtítulos y audiodescripcion para salas de cine
ES2394695A1 (es) * 2010-11-18 2013-02-04 Dimas LASTERRA HUARTE Unidad de accesibilidad audiovisual.
WO2015134878A1 (en) * 2014-03-07 2015-09-11 Thomson Licensing Simultaneous subtitle closed caption system
EP2821921A4 (de) * 2012-03-01 2015-11-11 Sony Corp Kommunikationsvorrichtung, kommunikationssystem, steuerungsverfahren dafür und system sowie programm zur ausführung dieses verfahrens auf einem computer
EP3096517A1 (de) * 2015-05-22 2016-11-23 TP Vision Holding B.V. Tragbare intelligente brille
US10506295B2 (en) 2014-10-09 2019-12-10 Disney Enterprises, Inc. Systems and methods for delivering secondary content to viewers
US10712562B2 (en) 2016-05-11 2020-07-14 Hcl Technologies Limited Immersive multimedia viewing
US11209581B2 (en) 2019-06-19 2021-12-28 Universal City Studios Llc Techniques for selective viewing of projected images
US11375347B2 (en) 2013-02-20 2022-06-28 Disney Enterprises, Inc. System and method for delivering secondary content to movie theater patrons

Families Citing this family (14)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR100448452B1 (ko) 2000-06-09 2004-09-13 엘지전자 주식회사 고밀도 광 기록매체의 메뉴 지원방법
KR100460910B1 (ko) * 2002-10-04 2004-12-09 현대자동차주식회사 자동차 극장에서 다국적 자막 지원장치 및 방법
WO2004032136A1 (en) 2002-10-04 2004-04-15 Lg Electronics Inc. Recording medium having a data structure for managing reproduction of graphic data and recording and reproducing methods and apparatuses
US7616865B2 (en) * 2003-04-30 2009-11-10 Lg Electronics Inc. Recording medium having a data structure for managing reproduction of subtitle data and methods and apparatuses of recording and reproducing
KR20050005074A (ko) 2003-07-01 2005-01-13 엘지전자 주식회사 고밀도 광디스크의 그래픽 데이터 관리방법 및 그에 따른고밀도 광디스크
KR20050004339A (ko) 2003-07-02 2005-01-12 엘지전자 주식회사 고밀도 광디스크의 그래픽 데이터 관리방법 및 그에 따른고밀도 광디스크
KR20050064150A (ko) 2003-12-23 2005-06-29 엘지전자 주식회사 고밀도 광디스크의 메뉴 구성방법 및 실행방법과기록재생장치
JP2007061412A (ja) * 2005-08-31 2007-03-15 Takashi Kumon 字幕表示システムおよび方法、プログラム
US8601526B2 (en) 2008-06-13 2013-12-03 United Video Properties, Inc. Systems and methods for displaying media content and media guidance information
US9014546B2 (en) 2009-09-23 2015-04-21 Rovi Guides, Inc. Systems and methods for automatically detecting users within detection regions of media devices
MX341574B (es) * 2010-01-05 2016-08-25 Rovi Guides Inc Sistemas y métodos para proporcionar una funcionalidad de aplicaciones para guías de medios utilizando un dispositivo de comunicaciones inalámbricas.
US9201627B2 (en) 2010-01-05 2015-12-01 Rovi Guides, Inc. Systems and methods for transferring content between user equipment and a wireless communications device
WO2013179535A1 (ja) * 2012-05-28 2013-12-05 Ｚｉｍａｋｕプラス株式会社 付加情報表示システム
US9674563B2 (en) 2013-11-04 2017-06-06 Rovi Guides, Inc. Systems and methods for recommending content

Family Cites Families (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
FR2603389B1 (fr) * 1986-09-02 1988-11-10 Sodeteg Systeme de visualisation individuelle et synchronisee pour salle de spectacle ou salle de reunion
US5648789A (en) * 1991-10-02 1997-07-15 National Captioning Institute, Inc. Method and apparatus for closed captioning at a performance
AU7684694A (en) * 1993-09-10 1995-03-27 Figaro Systems, Inc. Electronic libretto display apparatus and method
US6005536A (en) * 1996-01-16 1999-12-21 National Captioning Institute Captioning glasses

Cited By (15)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2006037146A1 (en) * 2004-10-05 2006-04-13 Guy Rischmueller Method and system for providing broadcast captions
US7738834B2 (en) 2004-10-05 2010-06-15 Guy Rischmueller Method and system for providing broadcast captions
WO2008059075A1 (es) * 2006-11-16 2008-05-22 Centro Especial De Integracion Audiovisual Y Formacion, S.L.L. Sistema de distribución de subtítulos y audiodescripcion para salas de cine
ES2300214A1 (es) * 2006-11-16 2008-06-01 Centro Especial De Integracion Audiovisual Y Formacion S.L.L. Sistema de distribucion de subtitulos y audiodescripcion para salas d e cine.
ES2300214B1 (es) * 2006-11-16 2009-05-01 Centro Especial De Integracion Audiovisual Y Formacion S.L.L. Sistema de distribucion de subtitulos y audiodescripcion para salas d e cine.
ES2394695A1 (es) * 2010-11-18 2013-02-04 Dimas LASTERRA HUARTE Unidad de accesibilidad audiovisual.
CN104137087B (zh) * 2012-03-01 2017-06-09 索尼公司 通信装置、通信系统、用于它们的控制方法以及使得计算机执行该方法的程序
EP2821921A4 (de) * 2012-03-01 2015-11-11 Sony Corp Kommunikationsvorrichtung, kommunikationssystem, steuerungsverfahren dafür und system sowie programm zur ausführung dieses verfahrens auf einem computer
US11375347B2 (en) 2013-02-20 2022-06-28 Disney Enterprises, Inc. System and method for delivering secondary content to movie theater patrons
WO2015134878A1 (en) * 2014-03-07 2015-09-11 Thomson Licensing Simultaneous subtitle closed caption system
US10506295B2 (en) 2014-10-09 2019-12-10 Disney Enterprises, Inc. Systems and methods for delivering secondary content to viewers
EP3096517A1 (de) * 2015-05-22 2016-11-23 TP Vision Holding B.V. Tragbare intelligente brille
US10712562B2 (en) 2016-05-11 2020-07-14 Hcl Technologies Limited Immersive multimedia viewing
US11209581B2 (en) 2019-06-19 2021-12-28 Universal City Studios Llc Techniques for selective viewing of projected images
CN114007711A (zh) * 2019-06-19 2022-02-01 环球城市电影有限责任公司 用于所投影的图像的选择性察看的技术

Also Published As

Publication number Publication date
EP1185142A3 (de) 2004-09-22
CA2350015A1 (en) 2002-02-28
JP2002153684A (ja) 2002-05-28

Similar Documents

Publication Publication Date Title
EP1185142A2 (de) System zur Betrachtung eines visuellen Inhalts
EP1185138A2 (de) System zur Verteilung von Audioinhalt
US10080061B1 (en) Distributing audio signals for an audio/video presentation
JP4503292B2 (ja) 携帯デバイスをワイヤレスにトリガするシステムおよび方法
US8201080B2 (en) Systems and methods for augmenting audio/visual broadcasts with annotations to assist with perception and interpretation of broadcast content
TW488168B (en) Method and apparatus for user-controlled selective overlay in a streaming media
TW482986B (en) Automatic personalized media identification system
KR20050083825A (ko) 휴대용 장치에 디지털 데이터를 스트리밍하기 위한 장치
US20030219708A1 (en) Presentation synthesizer
JP6271194B2 (ja) 携帯デバイスへのセカンドスクリーン情報の提供方法
US20100225654A1 (en) Theatre Seatback Display
CN110352597A (zh) 用于回放虚拟现实4d内容的系统和方法
CN111835988B (zh) 字幕的生成方法、服务器、终端设备及系统
CN101334908A (zh) 一种带多媒体播放功能的银行排队叫号方法及系统
KR20090032428A (ko) 미용실 컴퓨터 시스템
US20220264193A1 (en) Program production apparatus, program production method, and recording medium
JP4037884B2 (ja) 字幕表示システム
GB2240233A (en) Interactive marketing apparatus including concealed television surveillance
Perego Audio description norms in Italy: state of the art and the case of “Senza Barriere”
Costa-Montenegro et al. SubTitleMe, subtitles in cinemas in mobile devices
Slobodzian Film and video technology: Issues of access for hard of hearing and deaf students
Carney et al. Caption decoders: Expanding options for hearing impaired children and adults
Christopoulos et al. Smart Subs Subtitling App for Watching Live Virtual Dome Performances
CN201066517Y (zh) 一种带多媒体播放功能的银行排队叫号系统
Klein et al. Universal accessible closed captioning and sign language

Legal Events

Date Code Title Description
PUAI Public reference made under article 153(3) epc to a published international application that has entered the european phase

Free format text: ORIGINAL CODE: 0009012

17P Request for examination filed

Effective date: 20010718

AK Designated contracting states

Kind code of ref document: A2

Designated state(s): AT BE CH CY DE DK ES FI FR GB GR IE IT LI LU MC NL PT SE TR

AX Request for extension of the european patent

Free format text: AL;LT;LV;MK;RO;SI

PUAL Search report despatched

Free format text: ORIGINAL CODE: 0009013

AK Designated contracting states

Kind code of ref document: A3

Designated state(s): AT BE CH CY DE DK ES FI FR GB GR IE IT LI LU MC NL PT SE TR

AX Request for extension of the european patent

Extension state: AL LT LV MK RO SI

RIC1 Information provided on ipc code assigned before grant

Ipc: 7A 63J 5/10 B

Ipc: 7H 04S 1/00 A

17Q First examination report despatched

Effective date: 20050207

AKX Designation fees paid

Designated state(s): AT BE CH CY DE DK ES FI FR GB GR IE IT LI LU MC NL PT SE TR

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: THE APPLICATION IS DEEMED TO BE WITHDRAWN

18D Application deemed to be withdrawn

Effective date: 20050618