CA2350247A1 - System for delivering synchronized audio content to viewers of movies - Google Patents

Abstract

The invention is basically a headphone speaker system for use at motion picture theaters for hearing impaired persons and persons who don't speak the language that the original movie dialog is being shown in. The system is comprised of a plurality of headphone speaker devices 105, a control module 108, a central router/processor 103, and a transmission protocol 104. The device 105 is worn over the ears of viewers like typical headphones and using the control module 108, allows them to selectively amplify the volume of the textual dialog and to designate a language to listen to the dialog in. It will permit hearing impaired persons who have difficulty in discriminating dialog over ambient sounds in a theater to clearly hear the dialog and also permit persons who speak a foreign language there will be a choice of language for the closed caption text. The device 105 will either receive its signal information wirelessly or will plug into a connector built into the seat or other nearby structure. Power will either be integral or attached to the device or will also be supplied by a hardwire connection. The device can also be used by attendees of events who suffer from either partial hearing loss or are unable to understand the native language as a means of delivering information about the event.

Description

~3~~ r.._ r.,.~:v,...:..,. c, uchronized ALdio ('ontent to Viewers of Movies Invention The invention is generally related to a method for providing audio content during movies, displayed or available to be displayed at the theater. It includes head or ear mounted speakers, such as headphones, for listening to audio dialog for movies which are being shown in a language foreign to the viewer of the movie or for the benefit of those who are hearing impaired. It relies on a communication mechanism for delivering this audio information in real time or near real time. The invention can also be used to display announcements or other audio information at events such as sporting, art, or educational events. This application is related to concurrently filed application entitled, "Head mounted display for viewing subtitles and closed captions in movie theaters," and pending application "Multimedia I/O Interface Device for use at Entertainment Events," both commonly assigned.
Background of the Invention:
2o The world motion picture industry has developed into a multibillion dollar a year business. Centered in the US, the industry is creating hundreds of feature films per year which generate billions of dollars annually at the box office. Due to the combinations and mergers which now characterize the motion picture industry, movies are being made by large diversified media companies which also own consumer product companies. As a result, motion pictures are more frequently being used as vehicles for advertising products and promoting the parent company's suite of goods. Even before movies start in the theater, it is now common to see commercials being played, and there are always short trailers describing other upcoming or currently released movies. Thus, it is important to these media companies to maximize their return on investment by making the movies available to the largest possible viewing audience. There are tens of thousands of movie showings in the U.S. alone each day which creates an enormous potential for market exposure.
However, at the present there are several significant segments of the market which are not being addressed by the motion picture industry. First of all, is the hearing impaired segment. According to the National Association of the Deaf, a U.S.
based non-profit organization, there are 28 million deaf or hard of hearing persons in the U.S. alone. This is at least 10% of the nation's population and is likely to be a to consistent or higher percentage in other countries as well. It includes those who are completely deaf and those with selective deafness who have difficulty hearing dialog over other ambient sounds and noises. Currently, the motion picture industry creates movies with no provisions to accommodate those people. Deaf persons are forced to wait until the movie comes out on video and to get a copy with the dialog in subtitle format at the bottom of the picture. This text corresponds in real time to all verbal dialog in the movie. A problem with this is that even when the movies do come out on video cassette, most are not available with this feature. Thus, deaf people are discouraged from or unable to watch movies either in their first run or at home. A
potential solution is to use subtitled text in the movie theater so that hearing impaired 2o people can read the dialog while others listen to it. This is being done on a very small scale in a few cities. There are currently six theaters in six different cities which have dedicated screens for open captions which are permanently displayed and tens of others which show captioned versions on certain days of the month. The open captions appear as printed text at the bottom of the screen simultaneous to the dialog.

The reason this captioning hasn't become more pervasive is that those who are not hearing impaired, who make up a much larger percentage of the population, do not wish to see this text being displayed as it visually detracts from the image on the screen. Also, it is not cost effective to broadcast two versions of the movie, one with subtitles and one without them when only ten percent or less of the box office ticket is hearing impaired. Hearing impaired people with selective deafness can wait until the few first run movies that are captioned come out on video tape and comfortably watch them at home where they can control the volume. However, they are generally discouraged from attending the theater because it is difficult for them to discriminate 1o the dialog over the ambient sound and there are currently no provisions which allow for individualized amplification of the dialog in the theater.
Recently, two class action lawsuits have been filed in the U.S., one in Oregon and the other in the District of Columbia, against movie theater companies.
The suits assert that these companies have not made sufficient efforts to accommodate hearing impaired persons at the theater. The lawsuit states that the theaters failed to make "reasonable modification" in their practices, and failed to take necessary steps to insure that deaf people are not excluded from or denied first run movies.
Thus, there is a clear and present need for a solution to mitigate this problem, a solution which will be cost effective and robust, but which will not alienate current movie goers. It is in the interest of the film makers, the theater owners, and the viewing public to come up with an effective solution to this problem.
The second significant demographic currently being ignored by the motion picture industry is the non-English speaking one. Thus, the same problem of non-accommodation exists with respect to foreign language dialog. A significant percentage of persons living in the U.S. do not speak English at least as a first language. According to the 1990 census, Hispanic Americans accounted for 8.8%
of the U.S. population. By the 2000 census, this percentage will likely be well over 10%. Asian Americans such as Chinese, Vietnamese, and Koreans also make up an important percentage of the national demographic. Much of the rapid growth of each of these populations is due to the recent immigration of persons who speak little or no English. These people are discouraged from seeing first run movies at the theater because they are unable to understand the English dialog. However, the media industry is recognizing the market power of this demographic as evidenced by the 1o growth of Hispanic television and radio networks and Asian television networks.
This problem could be potentially solved by writing subtitled translation of the dialog on the screen; however, this still suffers from the limitation that it is visually displeasing to those who don't need the subtitled text. Also, it allows for only two simultaneous languages to be broadcast, the one the sound track is recorded in and the subtitled one.
Another demographic is native citizens who wish to watch foreign films which are shown in the U.S. In larger metropolitan cities, popular foreign movies are frequently played at theaters in their original language either without subtitles or with permanent subtitles. It would be desirable for persons attending these films to designate a language to view the movies in.
Thus, there exists a need for a cost effective system for allowing viewers of movies to listen to dialog, which corresponds in real time or near-real time to the dialog of the movie, in a language of the viewer's choice and can be selectively amplified.

Summary of the Invention:
It is an object of this invention to create a system which is devoid of the shortcomings described above.
It is another object of this invention to create a system for listening to audio corresponding to real time dialog of motion pictures.
It is an additional object of this invention to create a system which allows viewers to selectively amplify the dialog portion of the a movie's audio soundtrack.
Another object of this invention is to create a system which will deliver that l0 dialog to a viewer in synchronization with spoken action on the screen.
Yet another object of this invention is to create a system which will provide individualized volume control for the dialog portion of the audio of motion pictures while at the movie theater or elsewhere.
Still yet another object of this invention is to provide a system which is worn 15 on the head or over the ears.
A further object of this invention is to provide a system which will provide dialog audio content of movies to hearing impaired persons in a manner which is able to be selectively amplified within frequency bands by the viewer.
Yet another additional object of this invention is to provide a system which 20 allows users to selectively choose the language of dialog that they will listen to.
These and additional objects of this invention are accomplished generally through a head worn device for listening to dialog while watching motion pictures at the movie theater or for listening to information while attending public events.

Brief Description of the Drawings Figure 1 illustrates a theater embodiment with all the system components.
Figure 2 illustrates an exemplary headphone-type device in a wired connection embodiment.
Figure 3 illustrates an exemplary headphone-type device with an integral control module.
Figure 4 illustrates an exemplary ear piece-type headset embodiment of the system.
Figure 5 illustrates a wireless embodiment with an integral control module, battery, and wireless receiver.
1o Figure 6 illustrates a close up view of an exemplary control module with optional concessions interface.
Detailed Description of the Drawings Figure 1 illustrates a system level diagram of the fundamental components.
The film source 101 feeds through a communications link 102 to a central 15 router/processor 100. The router/processor 103 will at least handle the broadcast of the audio dialog. Optionally, it may perform on-the-fly conversion of source's audio dialog to one or more alternative languages prior to transmission. By "different audio dialog" or "different dialog" or "alternative language" is meant throughout this disclosure and claims as any dialog different from the original movie dialog, different 20 in either the language of the dialog, or in a version of the movie soundtrack which has only the spoken, sung, or otherwise verbalized portion of the movie's audio soundtrack but remains in the original language. The output of this router 103 will be transmitted through communications link 104, which could be a wired or wireless link, to the individual user audio devices 105.

Figure 2 illustrates a minimal embodiment including the audio headphone-type speakers 105 with power/signal cable 106 and attached connector 107 for connecting to a power/signal source. Figure 3 is similar in scope, but includes control module 108, which affords control of the output of the headphone speakers 105.
Figure 4 demonstrates a different type of speaker embodiment, namely, ear piece type speakers 109, which may or may not include control module 108 for controlling the speakers 109. These ear piece-type speakers 109 are another popular and accepted type of headphone speaker.
Figure S illustrates an exemplary wireless embodiment for the system to whereby, the audio headphone device 105 receives its signal wirelessly via the integrated control module, battery, and wireless receiver 110. This device 110, combines the functionality of the control module 108, but also supplies power for the headphones 105 and receives the signal representative of the audio dialog via a wireless communication protocol 104.
Figure 6 illustrates an exemplary control module 108. Language selection buttons 112 are included to allow the wearer to choose at least one language to listen to the audio dialog in. A volume control dial or button 111 is also included for adjusting the output level of the headphone speakers 105. There may also be a concessions interface 113 depending upon where the device is used, which contains 2o item selection buttons 114 allowing users to select specific concession items to be delivered to their location. This will be particularly useful if the device is used in a movie theater or other location as it will allow persons to order concession items without having to leave their seat. By "movie theater" is meant throughout this disclosure and claims, anywhere a movie can be seen.

CA 02350247 2001-06-11 w Detailed Description of the Invention:
The invention is directed to a method of delivering individualized audio dialog in movie theaters or at other events. It is comprised essentially of a headphone-type speaker device 105 with integrated amplifier with gain control, a central router/processor 103, and a transmission protocol 104. The headphones 105 can be in the form of typical stereophonic headphones or alternatively a monophonic headphone. The device will possess a control 111 allowing viewers to selectively amplify the dialog portion of the audio. This dialog whether in the same language or a different will be correlated to the instant dialog occurring in the motion picture.
1o This will allow hearing impaired persons who have difficulty in discriminating dialog over ambient noise in a movie theater to go to the theater and follow the dialog in a manner that is transparent to those who are not hearing impaired. It will allow those persons with partial hearing loss to selectively amplify the dialog on the sound track which is output by their speaker(s), persons such as those who wear hearing aid devices to amplify the sound of voices and other noises. Finally, it can also have a control 112 for selecting the language of the spoken dialog, which will allow viewers who which to see or listen to the dialog in a language other then the one being transmitted on the screen the ability to do so. This will create the opportunity for non-native speakers to attend movies they might otherwise be discouraged from attending.
The invention will require the ability to deliver in real time the dialog content to the viewers' headphone units 105 so that it will be correlated to the action on the screen. For this invention to work robustly and accurately, several versions of the dialog will have to be created when the final version of the movie is produced, both in English and other popular languages. This is frequently done with popular U.S.

produced movies and television shows when they are broadcast abroad. The dialog is dubbed over in whatever the native language is of the country in which it is broadcast in. Initially, it may be most cost effective to make several versions of the dialog prior to showing the movie and then selectively broadcasting the different dialogs.
However, as computers and voice processors become more robust, it will become possible to on-the-fly process the audio sound track, parse out the voice dialog, translate it both verbatim and in context, and to rebroadcast the desired language of broadcast. In this manner the central processor 103 would ideally be a certain time period ahead of the actual output to the screen so that enough time will be available 1o for this processing. It will be particularly useful for digital movies and analog movies with digital soundtracks encoded, as the digital nature of the source makes it easier to perform voice processing on it, removing the step of analog to digital (A/D) conversion which might otherwise be necessary. This standard can also be used or delivering commercial information, movie trailer dialog, and safety information such as that which is typically broadcast prior to the beginning of a feature presentation.
Once the audio, if in a different language, is produced and is synchronized with the action in the movie, it needs to be delivered to the audio headphone device of the viewers. If it is the same language as the original movie, then it merely needs to be delivered to the headphones of the viewer for selective amplification. To perform the actual transmission there will be a central router/processor 103 which is in communication 102 with the film source 101. It will transmit at least one version of the dialog to the head phone devices 105 via transmission protocol 104.
Optionally, it may take the audio from the movie source, in the form of an electronic signal, and if necessary, perform translation of the audio in near real time before transmission. The CA 02350247 2001-06-11 , -actual transmission can be accomplished through one of several embodiments using existing technology. These embodiments can be generally segmented into two types, wired and unwired. In a wired embodiment, the device itself has a plug on it that plugs into a connector which is integral to the movie theater seat. Much like airplane headphones, with some additional functionality, the user merely sits down and plugs the device 105 in. The connector 107 will provide both power and content to the device 105. This will eliminate the need for an integral power supply, will enhance reliability of the system, and minimize the cost of the individual devices. In this embodiment, the device 105 will be a commercially available device which can be to purchased at the theater or elsewhere by persons wishing to take advantage of this feature. This will minimize the necessary investment by the theater owners since the viewers will be supplying their own equipment while the theaters merely supply the backbone to support it and a plug interface. It will also allow for a uniform standard interface to be established between viewer's devices 105 and the theaters delivery system. The format of the audio itself could be either digital or analog, as only fairly narrow bandwidth will be required to carry this audio dialog information.
In another embodiment, the audio data can be transmitted wirelessly. This could either be as closed circuit analog TV, RF, or through digital transmission means such as IEEE 802.11, or any other existing or yet undiscovered transmission protocol.
2o If analog technology is used, a low power closed circuit radio transmitter could be placed in the projector room or elsewhere in the theater servicing the entire room with each language broadcast on a different channel band. If digital transmission is used, a wireless LAN transmitter/receiver could be placed in the projector room or elsewhere in the theater so that wireless communications could be maintained with individual headphone headsets 105. The headsets 105 themselves will need to have wireless receiving means 110 in order to receive the signal. This could be a separate receiver box 110 which is connected to the headset which could also house the battery for the receiver or a receiver integral to the headset 105, or the seats themselves could contain the receiver or transceiver. If analog transmission means are utilized, then the headset will require an integral TV signal receiver and tuner. In either case it will be desirable to include a selective gain control 111 with the headphone speaker 105 or speakers so that those who are not completely deaf, but hearing impaired to the extent that they can not easily hear text dialog without selective amplification, due to other to background noise and music in the movie soundtrack, can adjust the output level of the dialog to the optimum level for their individual needs.
In an additional embodiment, the device will have an integrated interface 113 for ordering food or beverages from the concession area outside the theater which are delivered to the seat location of the user/wearer of the system. When the users get the is devices 105, upon arrival at the theater, or sometime before that, they can establish a billing account to pay for such items that are ordered while at the movie.
Alternatively, they can pay for such items at time of delivery.
In yet another embodiment, the device 105 can be worn or carried at events or attractions such as sporting events, amusement parks, artistic events, or other publicly 20 or privately attended events where audio information is broadcast aloud. In this manner promotional/advertisement information, safety information, public service information, and information specific to the event or attraction can be delivered to those who are hearing impaired or those who don't speak the language of the broadcast dialog. This would not only enhance the experience of the attendees but ii would also allow those who are sponsoring and managing the event or attraction to deliver information to a wider audience further increasing the return on investment for themselves.
As to the power supply, in either wireless embodiment, the power could be supplied via a connector built in to the theater's seat, or the headset 105 itself could have an integral or attached battery supply. As more efficient fuel cells are developed, it will eventually become cost efficient to use batteries. However, at present, drawing the power for the device 105 from the connection in the theater's seats will increase overall system reliability, reduce costs, and eliminate device 1o interrupts due to loss of power.
As to the headphone unit 105 itself, several commercial electronics companies such as Sony Corporation, Aiwa, Panasonic, RCA, and Toshiba, among others, all make small, high fidelity headphone speakers. They are wom comfortably on the head and can support direct analog or converted digital output. They will require is slight modification to include a control unit 108 with channel selector, gain control, and optionally a commerce interface113 for ordering concession items. The headphone unit 105 or control unit 108 may have a channel selector 112 which allows the wearer to selectively choose the language he wishes to listen to the audio dialog.
It may also have gain control 111 which works like an equalizer allowing users to 2o selectively amplify specific frequency bands. Modern hearing aids now can be tailored to meet the specific hearing deficiencies of those who wear them to that extent that frequency bands which are least audible to the wearer are amplified the most. Analogously, the device may have at least a bass and treble amplification control, and optionally, higher resolution controls for amplifying specific frequency bands within the spoken voice frequency spectrum of 20 Hz to 20,000 Hz.
Thus, the disclosed invention overcomes the current deficiencies of the state of the art in the motion picture industry. It creates a new standard for selectively delivering alternative dialogs to viewers of movies in the theater that is invisible to those who are not using it. It provides heretofore unknown flexibility in accommodating those who are either hearing impaired or who do not understand the language the move is being played in. It also provides a medium for interaction with the facility and/or event management and a platform for commercial transactions.
l0 The preferred and optimumly preferred embodiments of the present invention have been described herein to illustrate the underlying principles of the invention, but it is to be understood that numerous modifications, designs, and alterations may be made without departing from the spirit and scope of this invention.

Claims

We Claim:
(1) A system for listening to a different audio dialog in a movie theater comprising:
Individual listening means worn by the viewer for viewing the dialog;
Delivery means for delivering a signal representative of said dialog to said listening means;
And power means for supplying power to said viewing means.
(2) A system for listening to a different audio dialog in a movie theater comprising:
A speaker device for listening to the dialog;
A centralized router for broadcasting the audio dialog in real time with a movie's spoken dialog;
A transmission protocol for delivering the spoken dialog to a viewer's headphone speaker;
A power delivery mechanism for supplying power to the display.
(3) The system of claim 2 wherein said speaker device is a head worn headphone device.
(4) The system of claim 2 wherein said speaker device is a ear piece type speaker device.
(5) The system of claim 2 wherein said speaker device is operable to fit around a person's eyeglasses.
(6) The system of claim 2 wherein said speaker device possesses means for individualized control of the amplification of said audio dialog.
(7) The system of claim 6 wherein said means includes means for independently controlling the amplification of at least two frequency bands.
(8) The system of claim 2 wherein said speaker device possess means for designating at least one channel of audio dialog, wherein said channel represents a language that the audio dialog is broadcast in.
(9) The system of claim 2 wherein said transmission protocol is selected from the group consisting of wired and wireless transmission protocols.

(10) The system of claim 2 wherein the power delivery mechanism includes a power connector integral to a movie seat and is connected via a power cable to the display.
(11) The system of claim 2 wherein the power delivery mechanism includes a DC type power storage device integral or attached to the display.
(12) The system of claim 2 wherein said speaker device is an analog audio device.
(13) The system of claim 2 wherein said speaker device is a digital audio device.

(14) The system of claim 2 wherein said transmission protocol is wired transmission facilitated by a output connector in a movie theater seat.
(15) The system of claim 2 wherein said transmission protocol is a wireless transmission protocol facilitated by a wireless receiver integral or attached to said headphone device.
(16) A system for listening to audio dialog in a movie theater comprising:
A speaker device for listening to the dialog;
A processor and router for broadcasting said audio dialog to said speaker device;
A transmission protocol for delivering the audio dialog to an attendee's speaker device;
A power delivery mechanism for supplying power to the device.
(17) The system of claim 15 wherein said device is a stereophonic headphone type audio device.
(18) The system of claim 15 wherein said device is a ear piece type audio device.
(19) The system of claim 15 wherein said speaker device is operable to fit around a viewer's eyeglasses.

(20) The system of claim 15 wherein activation means are included in said device for ordering food or beverages to be delivered to the location of the viewer.
(21) The system of claim 15 wherein means are included for selectively controlling the amplification of the audio dialog output by said device.
(22) The system of claim 21 wherein said means includes means for independently controlling the amplification of at least two frequency bands.
(23) The system of claim 15 wherein said speaker device possess means for designating at least one channel of audio dialog, wherein said channel represents a language that the audio dialog is broadcast in.
(24) A system for delivering audio content related to an event to attendees of an event who are hearing impaired, the system comprising:
A audio speaker device for listening to said content;
A processor and router for broadcasting said content;
A transmission protocol for delivering the textual portion of said content;
A power mechanism for supplying power to said display.
(25) The system of claim 24 wherein said audio speaker device includes a control for allowing a listener to select a desired language to listen to said content.

(26) The system of claim 24 wherein said device is a headphone speaker device.
(27) The system of claim 24 wherein said device is an ear piece type speaker device.
(28) The system of claim 24 wherein said device is operable to fit around a listener's prescription eyeglasses.