WO1993004748A1 - Jeu video a dialogue audiovisuel interactif - Google Patents

Jeu video a dialogue audiovisuel interactif Download PDF

Info

Publication number
WO1993004748A1
WO1993004748A1 PCT/US1992/006030 US9206030W WO9304748A1 WO 1993004748 A1 WO1993004748 A1 WO 1993004748A1 US 9206030 W US9206030 W US 9206030W WO 9304748 A1 WO9304748 A1 WO 9304748A1
Authority
WO
WIPO (PCT)
Prior art keywords
character
talking
voice
characters
verbal
Prior art date
Application number
PCT/US1992/006030
Other languages
English (en)
Inventor
Robert Macandrew Best
Original Assignee
Best Robert M
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Best Robert M filed Critical Best Robert M
Publication of WO1993004748A1 publication Critical patent/WO1993004748A1/fr

Links

Classifications

    • G—PHYSICS
    • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09B—EDUCATIONAL OR DEMONSTRATION APPLIANCES; APPLIANCES FOR TEACHING, OR COMMUNICATING WITH, THE BLIND, DEAF OR MUTE; MODELS; PLANETARIA; GLOBES; MAPS; DIAGRAMS
    • G09B7/00—Electrically-operated teaching apparatus or devices working with questions and answers
    • G09B7/02—Electrically-operated teaching apparatus or devices working with questions and answers of the type wherein the student is expected to construct an answer to the question which is presented or wherein the machine gives an answer to the question presented by a student
    • G09B7/04—Electrically-operated teaching apparatus or devices working with questions and answers of the type wherein the student is expected to construct an answer to the question which is presented or wherein the machine gives an answer to the question presented by a student characterised by modifying the teaching programme in response to a wrong answer, e.g. repeating the question, supplying a further explanation
    • A—HUMAN NECESSITIES
    • A63—SPORTS; GAMES; AMUSEMENTS
    • A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
    • A63F13/00—Video games, i.e. games using an electronically generated display having two or more dimensions
    • A63F13/40—Processing input control signals of video game devices, e.g. signals generated by the player or derived from the environment
    • A63F13/42—Processing input control signals of video game devices, e.g. signals generated by the player or derived from the environment by mapping the input signals into game commands, e.g. mapping the displacement of a stylus on a touch screen to the steering angle of a virtual vehicle
    • A63F13/424—Processing input control signals of video game devices, e.g. signals generated by the player or derived from the environment by mapping the input signals into game commands, e.g. mapping the displacement of a stylus on a touch screen to the steering angle of a virtual vehicle involving acoustic input signals, e.g. by using the results of pitch or rhythm extraction or voice recognition
    • A—HUMAN NECESSITIES
    • A63—SPORTS; GAMES; AMUSEMENTS
    • A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
    • A63F13/00—Video games, i.e. games using an electronically generated display having two or more dimensions
    • A63F13/45—Controlling the progress of the video game
    • A63F13/47—Controlling the progress of the video game involving branching, e.g. choosing one of several possible scenarios at a given point in time
    • A—HUMAN NECESSITIES
    • A63—SPORTS; GAMES; AMUSEMENTS
    • A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
    • A63F13/00—Video games, i.e. games using an electronically generated display having two or more dimensions
    • A63F13/80—Special adaptations for executing a specific game genre or game mode
    • A63F13/822—Strategy games; Role-playing games
    • A—HUMAN NECESSITIES
    • A63—SPORTS; GAMES; AMUSEMENTS
    • A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
    • A63F2300/00—Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game
    • A63F2300/60—Methods for processing data by generating or executing the game program
    • A63F2300/6063—Methods for processing data by generating or executing the game program for sound processing
    • A63F2300/6072—Methods for processing data by generating or executing the game program for sound processing of an input signal, e.g. pitch and rhythm extraction, voice recognition
    • A—HUMAN NECESSITIES
    • A63—SPORTS; GAMES; AMUSEMENTS
    • A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
    • A63F2300/00—Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game
    • A63F2300/60—Methods for processing data by generating or executing the game program
    • A63F2300/63—Methods for processing data by generating or executing the game program for controlling the execution of the game in time
    • A63F2300/632—Methods for processing data by generating or executing the game program for controlling the execution of the game in time by branching, e.g. choosing one of several possible story developments at a given point in time
    • A—HUMAN NECESSITIES
    • A63—SPORTS; GAMES; AMUSEMENTS
    • A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
    • A63F2300/00—Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game
    • A63F2300/80—Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game specially adapted for executing a specific type of game
    • A63F2300/807—Role playing or strategy games

Definitions

  • This invention relates to video games, animated cartoons, and picture/sound synchronization.
  • Video games have some of the characteristics of motion picture film animation.
  • the editing together of several shots in a sequence to have a desired effect is called montage.
  • Parallel montage means alternately cross-cutting between two shots or scenes to provide an illusion of simultaneity.
  • the montage alternates between shots of pursuer and pursued.
  • This illusion of simultaneity is important if characters in different scenes are talking with each other on a telephone, two-way radio, or through a door, or if one character is distantly influenced by a character in another scene, either by hearing what the other character says or by watching what the other character does in the other scene.
  • a character in one scene may be watching another character through a window or on a television monitor or the like and thus be influenced by what the other character says or does.
  • each choice by the human can be immediately followed by a synthesized voice or digitized voice recording that speaks the words selected by the human player, so the human will quickly adjust to the fact that the spoken words he hears for his side of the dialog are initiated by his ingers rather than his vocal cords.
  • the characters in prior-art video games and computer games, especially role-playing games, are of two types: player-controlled characters (or player characters) and non-player characters.
  • a player-controlled character is a human player's animated counterpart and does and says what the human player chooses to have him do and say.
  • Non-player characters are not directly controlled by a human player, but can be indirectly influenced by a human player, either by responding to an action selected by the human player or by responding to what a player- controlled character does or says.
  • FIG. 1 illustrates two scenes of an animated cartoon talking game with two characters in one scene and one character in a second scene talking with each other through time using a radio-like device.
  • One or more human players (hands shown pushing buttons) select some of what the characters say.
  • FIG. 2 illustrates the scene following FIG. 1 in which one of the animated characters responds to danger by giving a verbal command to an off-screen character, a command actually selected by a human player (hand shown pushing button) .
  • FIG. 3 illustrates two scenes in which an animated character acts in response to the verbal command from FIG. 2 followed by a scene illustrating the effect of the character's action, that is a surprised dinosaur.
  • FIG. 4 illustrates dialog between three characters in various scenes.
  • This invention is a video game method that simulates voice dialog between a human game player and two or more animated characters that appear on a video screen in different scenes that are set at different locations.
  • one character may be in a field with wild animals, while a second character is inside a building.
  • the animated picture alternates between the two scenes to give an illusion that the actions in both scenes are happening simultaneously.
  • a wall or equivalent separation device may be shown on the video screen to emphasize this scene separation.
  • the characters, being separated in space in different scenes, are not able in this example to talk with each other face to face.
  • Human players may participate in dialog between scenes either by directly controlling the words a character says or indirectly by playing the role of a third off-screen character who talks with the on-screen characters.
  • Each player has a hand ⁇ held controller that displays two or more phrases or actions.
  • a player responds by pressing a button next to a selected phrase or action or by moving a cursor.
  • An animated character then acts or verbally responds as if it had been spoken to by the human player or by one of the other characters. Speech recognition is not required. Human game players are thus given an illusion of active participation in dialog and adventures with these characters.
  • a video game system displays on a TV or video screen an animated picture sequence to one or more human game players.
  • Each human player holds a hand-held controller 28 having about three push buttons 16 next to a liquid-crystal display. Every few seconds alternative words, phrases, sentences or other verbal expressions 15 are displayed on controller 28 to give the human player a selection of things to "say" to animated characters or for the characters to say to each other or to human players. If a player's controller is lacking a display, equivalent verbal expressions may be displayed on a TV or video screen and be manually selected by the human player pressing one or more push-buttons. Each time an animated character talks, his or her or its mouth should make appropriate speaking movements that are lip-synchronized with corresponding voice sounds.
  • the video game system displays two animated characters 12 and 13 and nearby dinosaurs.
  • Character 12 is talking into a hand-held radio-like device 31 to a third off-screen character 22 in another scene 19 to be subsequently displayed.
  • Character 12 speaks the words "The dinosaurs have seen us.” into radio-like device 31.
  • Controller 28 then displays to the human player three sentences 15 of alternative words that character 12 can say next.
  • Human player's hand 17 is shown pressing button 16 to select the words "Beam us back.”
  • the game system then generates the selected words in the voice sounds 14 of character 12 (indicated as a cartoon voice balloon for purposes of illustration) .
  • the game system next displays scene 19 in which character 22 is an operator of a time-travel machine 32 which can communicate by voice and through time with character 12 in the dinosaur scene.
  • Character 22 can watch characters 12 and 13 on video monitors or the like. Character 22 responds to the words "Beam us back” with voice sounds 18 in the distinctive voice of character 22. Controller 28 then displays three new alternative sentences 20 that character 22 can say next. The human player presses the button to select the words "I can move you sideways.” The game system then generates voice sounds 21 of character 22 saying the selected words.
  • the display changes back to the dinosaur scene 11 in which character 12 and 13 are in acute danger and character 13 is ready to speak.
  • the controller then displays three alternative sentences 23 she can say.
  • the human player selects the words "Move us quick.”
  • the game system then generates voice sounds 24 of character 13.
  • the game system next displays time-machine scene 19 again in which character 22 responds to the FIG. 2 request with voice sounds 25.
  • the game system then changes back to scene 11 in which the dinosaur is shown with a surprised expression on its face because characters 12 and 13 have just disappeared as a result of the action by character 22 in the other scene 19.
  • the game system displays a sequence of three scenes in which a human player 17 acts as an intermediary between character 22 in the time-machine scene 19 and character 12 in a tent scene 34.
  • the characters sense danger and character 13 requests help from character 22 in time-machine scene 19.
  • the controller 28 displays three alternative sentences for character 12 to say in tent scene 34.
  • the human player 17 selects "I don't see it.” which character 12 then speaks as voice balloon 30.
  • the game system displays dinosaur scene 11 again where the danger has become acute for character 13 who speaks the words in balloon 33.
  • character 12, 13 and 22 are player-controlled characters that the human player or players control.
  • One or two or three human players may play the roles of the three animated characters.
  • the game system may generate voice sounds speaking the selected sentence or it may perform an action specified on controller 28.
  • a button 16 selects a simulated verbal response to the previous words spoken by an animated character and also selects the new dialog sequence including the new alternative sentences that correspond to the selected simulated verbal response that was shown on controller 28.
  • the selected dialog sequence that results includes the face and voice of the animated character speaking words which are responsive to the human player's selected verbal response.
  • a telephone or two-way radio or other voice communication apparatus may be substituted for radio-like device 31.
  • a communication apparatus need not be shown.
  • Various conversations between characters in two or more different scenes may also occur by characters speaking to each other through openings in a door, wall, roof, floor, car body or equivalent.
  • the picture sequence need not explicitly show a wall or other scene separation device.
  • Each animated character can be an animated cartoon, digitized live action, analog live action, a sprite or the like, or a composite thereof, and can be player controlled or not player controlled.
  • the word "scene” has been used herein to mean a sequence of video frames showing substantially the same location. The details and background of a scene may change as in scrolling, panning, scaling, rotation and zoom while remaining the same scene.
  • the time-travel story is given here only by way of example and may be replaced by other game stories that use parallel montage scenes.
  • a chase scene may parallel a phone-the-police scene in which a human game player talks with the good guy who is driving the car chasing the bad guy and also talks with another good guy left behind who is phoning the police from a phone booth.
  • the police dispatcher scene may then alternate with the phone booth scene with the human player selecting words to say in this dialog.
  • the police dispatcher scene may then alternate with the patrol car scene with a human player again selecting some of the dialog.
  • the human player may act as an intermediary between the two parallel scenes.
  • Another example is an accident scene in parallel with a going-for-help scene.
  • a human may also play the role of an off-screen character who speaks to character 22 who speaks to character 12 in another scene who speaks to character 13. Or a human player may speak to character 12 who speaks to character 13 who speaks to character 22 in another scene.
  • Human players may input choices on controller 28 using any of a variety of input devices such as push buttons, rotatable knobs, pressure sensitive membrane, proximity sensitive pads or screen overlay, light pen, light sensitive gun, joy stick, mouse, track ball, moving a cursor or crosshairs or scrolling through highlighted options, icons, speech recognition, etc.

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Physics & Mathematics (AREA)
  • Acoustics & Sound (AREA)
  • Human Computer Interaction (AREA)
  • Theoretical Computer Science (AREA)
  • Business, Economics & Management (AREA)
  • Educational Administration (AREA)
  • Educational Technology (AREA)
  • General Physics & Mathematics (AREA)
  • User Interface Of Digital Computer (AREA)

Abstract

Procédés pour jeux vidéo consistant à simuler un dialogue vocal entre un joueur humain (17) et deux ou plusieurs personnages animés parlants (12, 22) dans différentes scènes (11, 19) qui apparaissent en alternance sur un écran vidéo pour donner l'illusion que les actions des deux scènes se déroulent simultanément, malgré le fait qu'elles soient séparées dans le temps ou dans l'espace. Les personnages parlent les uns avec les autres par l'intermédiaire d'une radio bidirectionnelle (31) ou d'un téléphone ou d'une ouverture dans une paroi, telle qu'une fenêtre ou une porte. Chaque joueur tient une commande (28) qui affiche deux ou plusieurs locutions variables (15, 20) que le joueur humain doit dire à un personnage ou qu'un personnage doit dire (14), ou qui expriment des actes que le personnage doit faire. Le joueur (17) répond en appuyant sur un bouton (16) proche de la locution sélectionnée. Un personnage animé agit alors ou répond vocalement (18) comme si le joueur humain ou l'un des personnages lui avait parlé. Ce jeu donne donc aux joueurs humains l'illusion de participer activement au dialogue avec ces personnages.
PCT/US1992/006030 1991-09-09 1992-07-16 Jeu video a dialogue audiovisuel interactif WO1993004748A1 (fr)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
US75635691A 1991-09-09 1991-09-09
US756,356 1991-09-09

Publications (1)

Publication Number Publication Date
WO1993004748A1 true WO1993004748A1 (fr) 1993-03-18

Family

ID=25043116

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/US1992/006030 WO1993004748A1 (fr) 1991-09-09 1992-07-16 Jeu video a dialogue audiovisuel interactif

Country Status (3)

Country Link
JP (1) JPH05111579A (fr)
AU (1) AU2393092A (fr)
WO (1) WO1993004748A1 (fr)

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP0747881A2 (fr) * 1995-06-05 1996-12-11 AT&T IPM Corp. Système et méthode pour écran vidéo d'affichage contrÔlé par la voix
US8317611B2 (en) * 1992-05-22 2012-11-27 Bassilic Technologies Llc Image integration, mapping and linking system and methodology
US9135954B2 (en) 2000-11-27 2015-09-15 Bassilic Technologies Llc Image tracking and substitution system and methodology for audio-visual presentations
CN111790153A (zh) * 2019-10-18 2020-10-20 厦门雅基软件有限公司 对象的展示方法、装置、电子设备及计算机可读存储介质

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP0016314A1 (fr) * 1979-02-05 1980-10-01 Best, Robert MacAndrew Procédé et dispositif de dialogue parlé entre une image vidéo et un être humain
US4846693A (en) * 1987-01-08 1989-07-11 Smith Engineering Video based instructional and entertainment system using animated figure
WO1992008531A1 (fr) * 1990-11-14 1992-05-29 Best Robert M Jeux video parlants

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP0016314A1 (fr) * 1979-02-05 1980-10-01 Best, Robert MacAndrew Procédé et dispositif de dialogue parlé entre une image vidéo et un être humain
US4846693A (en) * 1987-01-08 1989-07-11 Smith Engineering Video based instructional and entertainment system using animated figure
WO1992008531A1 (fr) * 1990-11-14 1992-05-29 Best Robert M Jeux video parlants

Cited By (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US8317611B2 (en) * 1992-05-22 2012-11-27 Bassilic Technologies Llc Image integration, mapping and linking system and methodology
US8905843B2 (en) 1992-05-22 2014-12-09 Bassilic Technologies Llc Image integration, mapping and linking system and methodology
EP0747881A2 (fr) * 1995-06-05 1996-12-11 AT&T IPM Corp. Système et méthode pour écran vidéo d'affichage contrÔlé par la voix
EP0747881A3 (fr) * 1995-06-05 1998-03-04 AT&T IPM Corp. Système et méthode pour écran vidéo d'affichage contrÔlé par la voix
US5890123A (en) * 1995-06-05 1999-03-30 Lucent Technologies, Inc. System and method for voice controlled video screen display
US9135954B2 (en) 2000-11-27 2015-09-15 Bassilic Technologies Llc Image tracking and substitution system and methodology for audio-visual presentations
CN111790153A (zh) * 2019-10-18 2020-10-20 厦门雅基软件有限公司 对象的展示方法、装置、电子设备及计算机可读存储介质

Also Published As

Publication number Publication date
AU2393092A (en) 1993-04-05
JPH05111579A (ja) 1993-05-07

Similar Documents

Publication Publication Date Title
US5393070A (en) Talking video games with parallel montage
US5393072A (en) Talking video games with vocal conflict
US5358259A (en) Talking video games
US5393073A (en) Talking video games
US5393071A (en) Talking video games with cooperative action
US4333152A (en) TV Movies that talk back
US4569026A (en) TV Movies that talk back
US4445187A (en) Video games with voice dialog
EP1262955B1 (fr) Système et méthode de contrôle vocal de caractères dans un environnement ludique, à l'aide d'un menu
US6529875B1 (en) Voice recognizer, voice recognizing method and game machine using them
Tekin et al. Ways of spectating: Unravelling spectator participation in Kinect play
US20090191519A1 (en) Online and computer-based interactive immersive system for language training, entertainment and social networking
WO1993004748A1 (fr) Jeu video a dialogue audiovisuel interactif
US6982716B2 (en) User interface for interactive video productions
WO2022221902A1 (fr) Système et procédé de performance dans un environnement de réalité virtuelle
Nakatsu et al. Interactive movie system with multi-person participation and anytime interaction capabilities
Larsen et al. Multi modal user interaction in an automatic pool trainer
JPH05228260A (ja) 共同動作の対話ビデオゲーム方法
US20220040581A1 (en) Communication with in-game characters
US20220360827A1 (en) Content distribution system, content distribution method, and content distribution program
JPH05293252A (ja) 音声対立を利用する対話ビデオゲーム方法
US20240009559A1 (en) Communication with in-game characters
JP2001296877A (ja) 音声による会話を行うプログラム実行装置、そのためのプログラム
JP3537172B2 (ja) ゲーム装置及びゲーム装置の出力表示方法
JPH09139928A (ja) 多地点ビデオ会議システム

Legal Events

Date Code Title Description
AK Designated states

Kind code of ref document: A1

Designated state(s): AT AU BB BG BR CA CH CS DE DK ES FI GB HU KP KR LK LU MG MN MW NL NO PL RO RU SD SE

AL Designated countries for regional patents

Kind code of ref document: A1

Designated state(s): AT BE CH DE DK ES FR GB GR IT LU MC NL SE BF BJ CF CG CI CM GA GN ML MR SN TD TG

DFPE Request for preliminary examination filed prior to expiration of 19th month from priority date (pct application filed before 20040101)
WA Withdrawal of international application
REG Reference to national code

Ref country code: DE

Ref legal event code: 8642

NENP Non-entry into the national phase

Ref country code: CA