US20090258703A1 - Motion Assessment Using a Game Controller - Google Patents
Motion Assessment Using a Game Controller Download PDFInfo
- Publication number
- US20090258703A1 US20090258703A1 US12/417,384 US41738409A US2009258703A1 US 20090258703 A1 US20090258703 A1 US 20090258703A1 US 41738409 A US41738409 A US 41738409A US 2009258703 A1 US2009258703 A1 US 2009258703A1
- Authority
- US
- United States
- Prior art keywords
- participant
- participants
- movement
- game
- motion
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Abandoned
Links
Images
Classifications
-
- A—HUMAN NECESSITIES
- A63—SPORTS; GAMES; AMUSEMENTS
- A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
- A63F13/00—Video games, i.e. games using an electronically generated display having two or more dimensions
- A63F13/20—Input arrangements for video game devices
- A63F13/21—Input arrangements for video game devices characterised by their sensors, purposes or types
- A63F13/213—Input arrangements for video game devices characterised by their sensors, purposes or types comprising photodetecting means, e.g. cameras, photodiodes or infrared cells
-
- A63F13/12—
-
- A—HUMAN NECESSITIES
- A63—SPORTS; GAMES; AMUSEMENTS
- A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
- A63F13/00—Video games, i.e. games using an electronically generated display having two or more dimensions
- A63F13/20—Input arrangements for video game devices
- A63F13/21—Input arrangements for video game devices characterised by their sensors, purposes or types
- A63F13/215—Input arrangements for video game devices characterised by their sensors, purposes or types comprising means for detecting acoustic signals, e.g. using a microphone
-
- A—HUMAN NECESSITIES
- A63—SPORTS; GAMES; AMUSEMENTS
- A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
- A63F13/00—Video games, i.e. games using an electronically generated display having two or more dimensions
- A63F13/30—Interconnection arrangements between game servers and game devices; Interconnection arrangements between game devices; Interconnection arrangements between game servers
-
- A—HUMAN NECESSITIES
- A63—SPORTS; GAMES; AMUSEMENTS
- A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
- A63F13/00—Video games, i.e. games using an electronically generated display having two or more dimensions
- A63F13/80—Special adaptations for executing a specific game genre or game mode
-
- A—HUMAN NECESSITIES
- A63—SPORTS; GAMES; AMUSEMENTS
- A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
- A63F2300/00—Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game
- A63F2300/10—Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game characterized by input arrangements for converting player-generated signals into game device control signals
- A63F2300/1087—Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game characterized by input arrangements for converting player-generated signals into game device control signals comprising photodetecting means, e.g. a camera
- A63F2300/1093—Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game characterized by input arrangements for converting player-generated signals into game device control signals comprising photodetecting means, e.g. a camera using visible light
-
- A—HUMAN NECESSITIES
- A63—SPORTS; GAMES; AMUSEMENTS
- A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
- A63F2300/00—Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game
- A63F2300/50—Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game characterized by details of game servers
- A63F2300/53—Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game characterized by details of game servers details of basic data processing
- A63F2300/538—Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game characterized by details of game servers details of basic data processing for performing operations on behalf of the game client, e.g. rendering
-
- A—HUMAN NECESSITIES
- A63—SPORTS; GAMES; AMUSEMENTS
- A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
- A63F2300/00—Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game
- A63F2300/50—Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game characterized by details of game servers
- A63F2300/57—Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game characterized by details of game servers details of game services offered to the player
- A63F2300/572—Communication between players during game play of non game information, e.g. e-mail, chat, file transfer, streaming of audio and streaming of video
-
- A—HUMAN NECESSITIES
- A63—SPORTS; GAMES; AMUSEMENTS
- A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
- A63F2300/00—Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game
- A63F2300/60—Methods for processing data by generating or executing the game program
- A63F2300/6045—Methods for processing data by generating or executing the game program for mapping control signals received from the input arrangement into game commands
Abstract
Description
- This application claims priority to U.S. Provisional Patent Application Ser. No. 61/043,696, filed 9 Apr. 2008, which application is incorporated herein in its entirety by this reference thereto.
- Embodiments of this invention relate to interactive media. More particularly, embodiments of this invention relate to motion assessment of an individual using a game controller in connection with interactive media.
- Simon says is a game for three or more players, most often children. One of the people is “it”—i.e. Simon. The others must do what Simon tells them to do when asked with a phrase beginning with “Simon says.” If Simon says “Simon says jump,” then the other players must jump. Those players who do not jump are out. However, if Simon says simply “jump,” without first saying “Simon says,” players do not jump. Those who do jump are out. In general, it is the spirit of the command, not the actions that matters. If Simon says “Simon says touch your toes,” players only have to show that they are trying to touch their toes. It is the ability to distinguish between valid and invalid commands, rather than physical ability, that matters.
- It is Simon's task to try to get everyone out as quickly as possible, and it is every one else's job to stay in for as long as possible. The last of Simon's followers to stay in wins.
- Simon says is an example of a game that is played by a group of people, where each player is present at the same place at the same time. Games of this type are therefore not amenable to distributed play, for example with players at various remote locations, because there is no known way of coordinating and assessing each player's movement, for example, in response to a command from Simon in the Simon says game.
- Thus, there is a need in the art, for a technique that assesses user motion in multiplayer games, where such games require physical interaction of the users although the players are at different locations.
- The disadvantages associated with the prior art are overcome by embodiments of the present invention directed to a technique for motion assessment of an individual using a game controller in connection with interactive media. In an embodiment, the media may be a multiplayer game, such as Simon says, where game play is based, at least in part, upon coordinated or directed physical interaction of multiple players.
- The teachings of the present invention can be readily understood by considering the following detailed description in conjunction with the accompanying drawings, in which:
-
FIG. 1 is a block schematic diagram of a system for motion assessment pursuant to game play according to an embodiment of the invention; and -
FIG. 2 is a block schematic diagram of a game server according to an embodiment of the invention. - Although the following detailed description contains many specific details for the purposes of illustration, anyone of ordinary skill in the art will appreciate that many variations and alterations to the following details are within the scope of the invention. Accordingly, the exemplary embodiments of the invention described below are set forth without any loss of generality to, and without imposing limitations upon, the claimed invention.
- An embodiment of the invention is directed to a technique for motion assessment of an individual using a game controller in connection with interactive media. In an embodiment, the media may be a multiplayer game, such as Simon says, where game play is based, at least in part, upon coordinated or directed physical interaction of multiple players.
-
FIG. 1 is a block schematic diagram of a system for motion assessment pursuant to game play according to an embodiment of the invention. InFIG. 1 , a plurality of participant locations are linked by anetwork 14, such as the Internet. In the example ofFIG. 1 , the game of Simon says involves amaster site 10, where one ormore individuals 13 issue instructions, which are captured via amotion assessment device 11, such as a video camera and game console. Those skilled in the art will appreciate that other motion assessment mechanisms are available and could be used in connection with the invention, for example, ultrasonic motion detectors, infrared motion detectors, laser motion detectors, hand-held motion detectors, motion detectors that are worn on the body, and combinations thereof. Generally, the participant who is demonstrating a motion is best assessed with avideo camera 19. This allows demonstrated motions to be exhibited ondisplays 18 a-18 n at various participant sites. Adisplay 18 may also be provided at the master site to allow the master to observe actions of the participants and/or to observe demonstrated actions, should the master be moved to another site. However, commands may be provided verbally, rather than being demonstrated, or the demonstrated movements may be stored locally at each of the participant sites and may be displayed upon receipt of a selection command from a master participant. - A plurality of participant sites 12 a-12 n allow one or more participants 17 a-17 n to respond to such instruction pursuant to game play. Actions of the participants at these sites are assessed via a motion assessment device 15 a-15 n, as discussed above which, in this embodiment, includes a
video camera 19 a-19 n. In this embodiment, participant site12 n assesses motion withdevices 34 that are worn on each participant's wrist. - In this embodiment, a
game server 16 coordinates game play, scoring, and can also provide image and voice recognition functions and other capability. Other embodiments rely upon a game console for such functions, while still other embodiments do not rely upon a game console, but provide all image and display information directly to a game server. Further, it is not necessary for each participant to use the same motion assessment mechanism. Thus, some locations may employ hand-held devices, while others may employ video cameras, etc. - An embodiment of the invention uses a video camera, such as the Sony PlayStation Eye, which is a digital camera device that operates in conjunction with the PlayStation 3 video game console. Interaction of game players may also be captured with a game controller or other device. The video game console and/or a game server operates to record movements between players or any entity, as detected by the video camera, game controller, or other modality, and to compare those movements between people at remote locations, for example on other sides of the Internet, as well a detecting multiple individuals at a same location and tracking their motions separately pursuant to game play. Other embodiments of the invention contemplate any other video camera and game console or game console equivalent, such as the Sony EyeToy and PlayStation 2. Additionally, and as discussed above, other capture modalities may be used in conjunction with the video camera, such as a motion detector, which may be an ultrasonic motion detection device, a magnetic motion capture device, an RF or IR motion capture device, a pressure sensitive device, such as an active floor mat, a device that tracks gravitational forces and/or acceleration, or a device that is held in the hand or attached to the game player's body, such as the Sony SIXAXIS wireless controller, or the like. Further, a device specifically designed for capturing motion images in three dimensions may be used, such as an array multiple, spaced cameras, a laser guided device, or the like.
-
FIG. 2 is a block schematic diagram of a game server according to an embodiment of the invention. InFIG. 2 , anetwork interface 30 provides communications to and from the game server. This embodiment is intended to operate in connection with a system of the type shown inFIG. 1 . Those skilled in the art will appreciate that the elements in the game server discussed below are not all necessary to practice the invention. The network interface receives voice information, such as voice commands, and video information, such as captured images of participants in the game, from each game location. - The voice information is routed to a
voice processor 29 that identifies spoken commands, such as “Hands on head,” and looks up a pose for such command in apose database 20. The voice information may also be routed to the various participant locations via arouting mechanism 31. - The video information is routed to a
video processor 28, which performs the functions of accessing the pose database pursuant to operation of apose capture module 21. The video processor also provides video information to the routing mechanism for viewing at each participant location. Animage extraction module 27 operates under supervision of the video processor and in conjunction with aplayer database 22 to identify participants and, in conjunction with the pose capture module and pose database, to identify participant actions. Pose information from the pose database is provided to a comparemodule 26 under control of the video and/or voice processors, where a pose template is compared with an extracted image and a determination of accuracy, etc. is made with reference to standards stored in ametrics database 23. A result of the comparison is provided to ascoring module 25. Scoring results are both stored and retrieved from ascore database 24 for display to the participants with regard to game play. The score results and image information are combined at acomposite module 32 and thence routed to the game participants. - In an embodiment that implements the classic game of Simon says, kids (and/or others) play Simon says against one another. At least one game player, who may be a master, i.e. “it,” and who is chosen randomly or who is chosen by some other scheme, describes a motion to be undertaken by the other game players. The master's commands are routed to all participants, for example via a network connection. The master may then make some motion in front of the video camera, which is captured and analyzed by, for example the game console and/or game server. When other kids try to do that movement, those movements are also captured, for example, by a video camera, and a component of the game console and/or game server programming compares the captured movements against those of the master to determine whether or not the master's movement was mimicked correctly or close enough to qualify as a successful action. The action may also be judged on the timeliness of the participant response, e.g. who was first, how fast was the response, did a time-out occur before the action was completed? The system may also simply observe and determine whether the game participants executed the correct motion, based upon, for example, verbal commands from the master.
- One method of tracking the participant comprises processing images captured by, for example, the video camera and identifying both the identity of the participant, if there are multiple participants at a location, by recognizing, for example, each participant's face; and by tracking movement each participant's head, arms, legs, and torso, to identify, for example, a pose of the participant's body for purposes of comparison with that of a master and/or an arc of movement of the participant's body, for example, to identify compliance of the participant with more complex movements.
- In an embodiment, a microphone associated with the video camera or otherwise situated in connection with at least a master, may be provided to capture user commands and, for example, via voice recognition, translate such commands into signals that are used to look up a pre-recorded motion template. For example, if the master says “Simon says put your hands on your head,” then a voice recognition module translates this command into a signal that looks up a “hands on head” template in a pose database. The pose captured from each of the participants is compared to the template of the pose and compliance is then determined and recorded for each participant. In this embodiment, the master need not demonstrate the pose, but merely commands that a pose be assumed. While these commands are captured for purposes of template look-up, as described above, a mechanism, such as a network, is also provided for routing these commands to each participant to allow them to be heard at each location.
- Further, while the video camera is used to capture images of the participant's for analysis by the game console and/or game server, the images may also be provided to the master, for example to provide comments upon observed poses and the like. Also, if a remote classroom setting is provided, the game console and/or game server may be programmed to determine if a participant is not present or has left the view of the camera. In this way, an embodiment of the invention may be used to take class attendance and determine if each participant is indeed participating. This aspect of the invention may be used, not only in a game setting, but also in an instructional or educational setting, as discussed below.
- The game console and/or game server may include programming that performs such motion-capture video analysis. While face recognition or other schemes for identifying individuals within a group may be applied in those embodiments where multiple individuals participate at a single location, it will be appreciated by those skilled in the art that each individual in the group may wear an identification device, such as an article of clothing that is a particular color and/or that has a particular marking; or an electronic bracelet or other such signaling device may be worn by each individual. In those cases where a single individual is present at a location, it is only necessary to know the location, for example by a network address, to identify the individual for purposes of tracking the individual's movements and scoring the individual's execution of these movements. Other embodiments contemplate the use of voice recognition to identify participants.
- Likewise, a group's reaction can be captured, analyzed and scored. Thus, if Simon says “Put your hands on your head,” the system could determine how many participants within a group reacted correctly. The group could be scored on this basis. In this way, groups of players could compete against other groups of players, e.g. the 4th grade class could compete against the 5th grade class, the boys could compete against the girls, the students could compete against the faculty, etc.
- Another embodiment provides educational and/or tutorial activities, for example where a pre-recorded demonstration of a desired movement by a teacher or other instruction is presented to one or more session participants, rather than having a master participant in real-time, as in the Simon says example above. Such instruction may be, for example, how to execute a golf swing, a tennis stroke, or other complex motion. A participant in such session views a demonstration of the motion and/or other instructional information, for example, on a television or other display. A video camera or other device captures the participant's motions, analyzes and compares the captured motions with an ideal motion, and is then judged or graded on how well he mimicked the action that was demonstrated to him.
- An embodiment of the invention provides a reference gesture that, for example, is generated by a live person, e.g. over the Internet, who performs an action. The action that the user is performing may be displayed to the other participants by a video clip of the person doing it, i.e. the system records the person demonstrating the gesture and then it shows it as a video clip. The camera can also capture such gestures from multiple angles, or multiple cameras can be used, such that a plurality of views from the plane of the camera can be combined to provide a 3D view that allows each participant to see all perspectives of what the action is, whether it is for a Simon says game, a golf swing or tennis serve analyzer, or for learning dance moves.
- An embodiment of the invention provides each participant with the ability to speak and move an object. Thus, each participant can create a login based on, for example, a unique manipulation of a game controller.
- An embodiment comprehends gesture recording, where the gesture occurs in free space. A scoring aspect of invention determines what tolerance a participant's gesture achieves relative to a reference gesture, e.g. a snapshot. The game console and/or game server include programming that is used to compare differences between a reference gesture which may be captured, e.g. from a 3D tracking device, from a camera, or a combination of both, or which may be pre-recorded, e.g. an expert gesture, and some change over time for some purpose. Depending on the change, results are provided, such as the person moved the wrong way; or in a golf swing, from the time they start the swing to the time they end the swing, there is some change over time. For example, with regard to a golf swing, the gesture, i.e. the swing would be decomposed into various critical elements, where certain parts of the motion are more important than other parts of the motion. Thus, an embodiment of the invention provides a weighting of the critical elements within a movement or gesture, such as a golf swing, and relative to a reference, a person's performance is scored based on the weighting of various elements within an actual captured image.
- An embodiment provides a library of functions, such as various types of golf swing or tennis serves. Such motions are all pre-computed and the video camera is used to capture a person's execution relative to the reference in the library to identify how much the person's performance deviates from the idealized motion. Further, an expert could watch the person execute a movement in real time and provide instruction and performance evaluation based upon analysis of a captured movement relative to a reference movement. In this example, the expert may be an instructor at a remote location who is observing the person's performance with the video camera at the person's location via a network.
- Likewise, several individuals can demonstrate a skill simultaneously and be judged and ranked accordingly. For example, there could be an on-line golf swing competition in which each individual is observed and graded by the system. Results and ranking would then be exhibited on each participant's display. A human expert may also participant in the judging activity.
- An embodiment starts game play when a participant makes a particular gesture that is recognized by the system as a sign that game play is to commence. Such gesture can be specified in advance by the game developer, or it can be recorded by a participant, for example in the Simon says game, a participant, perhaps the master, would lift his hands above his head to start a game play session. This aspect of the invention thus concerns performing an action and determining whether or not the action was taken, e.g. did the participants commence game play?
- One embodiment comprises a game in which an initial position is established for a player by another player, where the player who is being instructed must follow the instructions of the other player. The person following the instructions has a reference picture taken on the initial position, and then after a command is issued by the instructing player, a further image is taken or further information is gathered and compared against the reference picture in real time to determine if it was performed according to some critical performance characteristic, e.g. quickly enough, accurately enough, or should not have been performed at all. As with Simon says, one person may be the leader and other participants follow some form of instruction, imperative command, or illustration of an action, and the participants then respond accordingly.
- An embodiment of the invention may also be used in games that employ objects, as well as individual participants. For example, Hullabaloo (Cranium, Inc, Seattle, Wash.) is a talking game that is played with different colored cards. The cards are placed on the floor and the game instructs the game players where to move, often entangling the players, one with the other. An embodiment of the invention, in this vein, uses physical objects at each participant's location that are represented icons on a display as well. The objects are placed on the floor and the participants physically move to the objects as instructed by the icons. The invention tracks the participants, as discussed above, over a network based system.
- In addition to tracking the individual, game elements could be placed in a room and the system uses the video camera or other such expedient to know the position of the game elements as well. Thus, an embodiment provides for, and tracks, both the players who are in the room, where the system knows their position, and the game elements that are a part of the play. Another embodiment identifies objects that are in a room, such as a table or chair, and assigns them a role in a game. For example, a participant may be instructed to sit on the chair or to lie down on the rug.
- While the above is a complete description of the preferred embodiment of the present invention, it is possible to use various alternatives, modifications and equivalents. Therefore, the scope of the present invention should be determined not with reference to the above description but should, instead, be determined with reference to the appended claims, along with their full scope of equivalents. Any feature described herein, whether preferred or not, may be combined with any other feature described herein, whether preferred or not. In the claims that follow, the indefinite article “A”, or “An” refers to a quantity of one or more of the item following the article, except where expressly stated otherwise. The appended claims are not to be interpreted as including means-plus-function limitations, unless such a limitation is explicitly recited in a given claim using the phrase “means for.”
Claims (19)
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US12/417,384 US20090258703A1 (en) | 2008-04-09 | 2009-04-02 | Motion Assessment Using a Game Controller |
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US4369608P | 2008-04-09 | 2008-04-09 | |
US12/417,384 US20090258703A1 (en) | 2008-04-09 | 2009-04-02 | Motion Assessment Using a Game Controller |
Publications (1)
Publication Number | Publication Date |
---|---|
US20090258703A1 true US20090258703A1 (en) | 2009-10-15 |
Family
ID=41164456
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US12/417,384 Abandoned US20090258703A1 (en) | 2008-04-09 | 2009-04-02 | Motion Assessment Using a Game Controller |
Country Status (1)
Country | Link |
---|---|
US (1) | US20090258703A1 (en) |
Cited By (37)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20090042246A1 (en) * | 2004-12-07 | 2009-02-12 | Gert Nikolaas Moll | Methods For The Production And Secretion Of Modified Peptides |
US20090221368A1 (en) * | 2007-11-28 | 2009-09-03 | Ailive Inc., | Method and system for creating a shared game space for a networked game |
US20100004896A1 (en) * | 2008-07-05 | 2010-01-07 | Ailive Inc. | Method and apparatus for interpreting orientation invariant motion |
US20100113153A1 (en) * | 2006-07-14 | 2010-05-06 | Ailive, Inc. | Self-Contained Inertial Navigation System for Interactive Control Using Movable Controllers |
US20100210359A1 (en) * | 2009-02-17 | 2010-08-19 | Eric Krzeslo | Computer videogame system with body position detector that requires user to assume various body positions |
US7899772B1 (en) | 2006-07-14 | 2011-03-01 | Ailive, Inc. | Method and system for tuning motion recognizers by a user using a set of motion signals |
US7917455B1 (en) | 2007-01-29 | 2011-03-29 | Ailive, Inc. | Method and system for rapid evaluation of logical expressions |
US20110162005A1 (en) * | 2009-12-30 | 2011-06-30 | Cevat Yerli | Computer-controlled video entertainment system |
US20110162004A1 (en) * | 2009-12-30 | 2011-06-30 | Cevat Yerli | Sensor device for a computer-controlled video entertainment system |
EP2347809A1 (en) * | 2010-01-20 | 2011-07-27 | Blue Banana bvba | Crowd control system and method |
US20120157200A1 (en) * | 2010-12-21 | 2012-06-21 | Microsoft Corporation | Intelligent gameplay photo capture |
US8251821B1 (en) | 2007-06-18 | 2012-08-28 | Ailive, Inc. | Method and system for interactive control using movable controllers |
CN102668555A (en) * | 2009-12-01 | 2012-09-12 | 创新科技有限公司 | Methods and systems for consuming media content among a group of at least two entities |
US20120276994A1 (en) * | 2011-04-28 | 2012-11-01 | Microsoft Corporation | Control of separate computer game elements |
US20120277001A1 (en) * | 2011-04-28 | 2012-11-01 | Microsoft Corporation | Manual and Camera-based Game Control |
US8439733B2 (en) | 2007-06-14 | 2013-05-14 | Harmonix Music Systems, Inc. | Systems and methods for reinstating a player within a rhythm-action game |
US8444464B2 (en) | 2010-06-11 | 2013-05-21 | Harmonix Music Systems, Inc. | Prompting a player of a dance game |
US8449360B2 (en) | 2009-05-29 | 2013-05-28 | Harmonix Music Systems, Inc. | Displaying song lyrics and vocal cues |
US8465366B2 (en) | 2009-05-29 | 2013-06-18 | Harmonix Music Systems, Inc. | Biasing a musical performance input to a part |
US20130260885A1 (en) * | 2012-03-29 | 2013-10-03 | Playoke Gmbh | Entertainment system and method of providing entertainment |
US8550908B2 (en) | 2010-03-16 | 2013-10-08 | Harmonix Music Systems, Inc. | Simulating musical instruments |
US8663013B2 (en) | 2008-07-08 | 2014-03-04 | Harmonix Music Systems, Inc. | Systems and methods for simulating a rock band experience |
US8678896B2 (en) | 2007-06-14 | 2014-03-25 | Harmonix Music Systems, Inc. | Systems and methods for asynchronous band interaction in a rhythm action game |
US8686269B2 (en) | 2006-03-29 | 2014-04-01 | Harmonix Music Systems, Inc. | Providing realistic interaction to a player of a music-based video game |
US20140094304A1 (en) * | 2012-09-28 | 2014-04-03 | Red Robot Labs, Inc. | Apparatus and Method for In-Game Video Capture |
US8702485B2 (en) | 2010-06-11 | 2014-04-22 | Harmonix Music Systems, Inc. | Dance game and tutorial |
US20140206422A1 (en) * | 2013-01-22 | 2014-07-24 | Nintendo Co., Ltd. | Storage medium storing game program, game device, game system, and game process method |
US9024166B2 (en) | 2010-09-09 | 2015-05-05 | Harmonix Music Systems, Inc. | Preventing subtractive track separation |
US20150243013A1 (en) * | 2014-02-27 | 2015-08-27 | Microsoft Corporation | Tracking objects during processes |
US9358456B1 (en) | 2010-06-11 | 2016-06-07 | Harmonix Music Systems, Inc. | Dance competition game |
US9433858B2 (en) | 2013-01-04 | 2016-09-06 | International Business Machines Corporation | Access control of user based photograph bundles |
US20170156035A1 (en) * | 2013-10-20 | 2017-06-01 | Oahu Group, Llc | Method and system for determining object motion by capturing motion data via radio frequency phase and direction of arrival detection |
US20170282056A1 (en) * | 2014-08-23 | 2017-10-05 | James Ashton | Method and apparatus for playing a game |
US9981193B2 (en) | 2009-10-27 | 2018-05-29 | Harmonix Music Systems, Inc. | Movement based recognition and evaluation |
US10357714B2 (en) | 2009-10-27 | 2019-07-23 | Harmonix Music Systems, Inc. | Gesture-based user interface for navigating a menu |
US11602697B2 (en) * | 2017-09-05 | 2023-03-14 | State Space Labs Inc. | Sensorimotor assessment and training |
US11896910B2 (en) | 2017-09-05 | 2024-02-13 | State Space Labs, Inc. | System and method of cheat detection in video games |
Citations (11)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US6126548A (en) * | 1997-10-08 | 2000-10-03 | Illusion, Inc. | Multi-player entertainment system |
US20010003712A1 (en) * | 1997-12-31 | 2001-06-14 | Gregory Robert Roelofs | Exoskeletal platform for controlling multi-directional avatar kinetics in a virtual environment |
US20030171147A1 (en) * | 1999-09-24 | 2003-09-11 | Sinclair Matthew Frazer | Interactive voice, wireless game system using predictive command input |
US20040077423A1 (en) * | 2001-11-16 | 2004-04-22 | Weston Denise Chapman | Interactive quest game |
US20050075153A1 (en) * | 2003-07-01 | 2005-04-07 | Gaelco, S.A. | Multimedia system and method for remote monitoring or refereeing in amusement machines |
US20060166737A1 (en) * | 2005-01-26 | 2006-07-27 | Bentley Kinetics, Inc. | Method and system for athletic motion analysis and instruction |
US20070196809A1 (en) * | 2006-02-21 | 2007-08-23 | Mr. Prabir Sen | Digital Reality Sports, Games Events and Activities in three dimensional and interactive space display environment and information processing medium |
US20080316324A1 (en) * | 2007-06-22 | 2008-12-25 | Broadcom Corporation | Position detection and/or movement tracking via image capture and processing |
US7702608B1 (en) * | 2006-07-14 | 2010-04-20 | Ailive, Inc. | Generating motion recognizers for arbitrary motions for video games and tuning the motion recognizers to the end user |
US20100151942A1 (en) * | 2007-05-16 | 2010-06-17 | Ronen Horovitz | System and method for physically interactive board games |
US7789742B1 (en) * | 1999-05-12 | 2010-09-07 | Wilbert Q. Murdock | Smart golf club multiplayer system for the internet |
-
2009
- 2009-04-02 US US12/417,384 patent/US20090258703A1/en not_active Abandoned
Patent Citations (11)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US6126548A (en) * | 1997-10-08 | 2000-10-03 | Illusion, Inc. | Multi-player entertainment system |
US20010003712A1 (en) * | 1997-12-31 | 2001-06-14 | Gregory Robert Roelofs | Exoskeletal platform for controlling multi-directional avatar kinetics in a virtual environment |
US7789742B1 (en) * | 1999-05-12 | 2010-09-07 | Wilbert Q. Murdock | Smart golf club multiplayer system for the internet |
US20030171147A1 (en) * | 1999-09-24 | 2003-09-11 | Sinclair Matthew Frazer | Interactive voice, wireless game system using predictive command input |
US20040077423A1 (en) * | 2001-11-16 | 2004-04-22 | Weston Denise Chapman | Interactive quest game |
US20050075153A1 (en) * | 2003-07-01 | 2005-04-07 | Gaelco, S.A. | Multimedia system and method for remote monitoring or refereeing in amusement machines |
US20060166737A1 (en) * | 2005-01-26 | 2006-07-27 | Bentley Kinetics, Inc. | Method and system for athletic motion analysis and instruction |
US20070196809A1 (en) * | 2006-02-21 | 2007-08-23 | Mr. Prabir Sen | Digital Reality Sports, Games Events and Activities in three dimensional and interactive space display environment and information processing medium |
US7702608B1 (en) * | 2006-07-14 | 2010-04-20 | Ailive, Inc. | Generating motion recognizers for arbitrary motions for video games and tuning the motion recognizers to the end user |
US20100151942A1 (en) * | 2007-05-16 | 2010-06-17 | Ronen Horovitz | System and method for physically interactive board games |
US20080316324A1 (en) * | 2007-06-22 | 2008-12-25 | Broadcom Corporation | Position detection and/or movement tracking via image capture and processing |
Cited By (63)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20090042246A1 (en) * | 2004-12-07 | 2009-02-12 | Gert Nikolaas Moll | Methods For The Production And Secretion Of Modified Peptides |
US8686269B2 (en) | 2006-03-29 | 2014-04-01 | Harmonix Music Systems, Inc. | Providing realistic interaction to a player of a music-based video game |
US8051024B1 (en) | 2006-07-14 | 2011-11-01 | Ailive, Inc. | Example-based creation and tuning of motion recognizers for motion-controlled applications |
US9261968B2 (en) | 2006-07-14 | 2016-02-16 | Ailive, Inc. | Methods and systems for dynamic calibration of movable game controllers |
US9405372B2 (en) | 2006-07-14 | 2016-08-02 | Ailive, Inc. | Self-contained inertial navigation system for interactive control using movable controllers |
US7899772B1 (en) | 2006-07-14 | 2011-03-01 | Ailive, Inc. | Method and system for tuning motion recognizers by a user using a set of motion signals |
US20100113153A1 (en) * | 2006-07-14 | 2010-05-06 | Ailive, Inc. | Self-Contained Inertial Navigation System for Interactive Control Using Movable Controllers |
US7917455B1 (en) | 2007-01-29 | 2011-03-29 | Ailive, Inc. | Method and system for rapid evaluation of logical expressions |
US8690670B2 (en) | 2007-06-14 | 2014-04-08 | Harmonix Music Systems, Inc. | Systems and methods for simulating a rock band experience |
US8439733B2 (en) | 2007-06-14 | 2013-05-14 | Harmonix Music Systems, Inc. | Systems and methods for reinstating a player within a rhythm-action game |
US8444486B2 (en) | 2007-06-14 | 2013-05-21 | Harmonix Music Systems, Inc. | Systems and methods for indicating input actions in a rhythm-action game |
US8678896B2 (en) | 2007-06-14 | 2014-03-25 | Harmonix Music Systems, Inc. | Systems and methods for asynchronous band interaction in a rhythm action game |
US8678895B2 (en) | 2007-06-14 | 2014-03-25 | Harmonix Music Systems, Inc. | Systems and methods for online band matching in a rhythm action game |
US8251821B1 (en) | 2007-06-18 | 2012-08-28 | Ailive, Inc. | Method and system for interactive control using movable controllers |
US20090221368A1 (en) * | 2007-11-28 | 2009-09-03 | Ailive Inc., | Method and system for creating a shared game space for a networked game |
US20100004896A1 (en) * | 2008-07-05 | 2010-01-07 | Ailive Inc. | Method and apparatus for interpreting orientation invariant motion |
US8655622B2 (en) | 2008-07-05 | 2014-02-18 | Ailive, Inc. | Method and apparatus for interpreting orientation invariant motion |
US8663013B2 (en) | 2008-07-08 | 2014-03-04 | Harmonix Music Systems, Inc. | Systems and methods for simulating a rock band experience |
US20100210359A1 (en) * | 2009-02-17 | 2010-08-19 | Eric Krzeslo | Computer videogame system with body position detector that requires user to assume various body positions |
US8517834B2 (en) * | 2009-02-17 | 2013-08-27 | Softkinetic Studios Sa | Computer videogame system with body position detector that requires user to assume various body positions |
US8449360B2 (en) | 2009-05-29 | 2013-05-28 | Harmonix Music Systems, Inc. | Displaying song lyrics and vocal cues |
US8465366B2 (en) | 2009-05-29 | 2013-06-18 | Harmonix Music Systems, Inc. | Biasing a musical performance input to a part |
US9981193B2 (en) | 2009-10-27 | 2018-05-29 | Harmonix Music Systems, Inc. | Movement based recognition and evaluation |
US10357714B2 (en) | 2009-10-27 | 2019-07-23 | Harmonix Music Systems, Inc. | Gesture-based user interface for navigating a menu |
US10421013B2 (en) | 2009-10-27 | 2019-09-24 | Harmonix Music Systems, Inc. | Gesture-based user interface |
EP2507994A4 (en) * | 2009-12-01 | 2013-07-17 | Creative Tech Ltd | Methods and systems for consuming media content among a group of at least two entities |
EP2507994A1 (en) * | 2009-12-01 | 2012-10-10 | Creative Technology Ltd. | Methods and systems for consuming media content among a group of at least two entities |
CN102668555A (en) * | 2009-12-01 | 2012-09-12 | 创新科技有限公司 | Methods and systems for consuming media content among a group of at least two entities |
US9486701B2 (en) | 2009-12-30 | 2016-11-08 | Crytek Gmbh | Computer-controlled video entertainment system |
EP2340877A3 (en) * | 2009-12-30 | 2013-11-13 | Gface GmbH | Computer-controlled video entertainment system |
EP2340878A3 (en) * | 2009-12-30 | 2013-11-20 | Gface GmbH | Sensor device for a computer-controlled video entertainment system |
US20110162004A1 (en) * | 2009-12-30 | 2011-06-30 | Cevat Yerli | Sensor device for a computer-controlled video entertainment system |
US20110162005A1 (en) * | 2009-12-30 | 2011-06-30 | Cevat Yerli | Computer-controlled video entertainment system |
EP2347809A1 (en) * | 2010-01-20 | 2011-07-27 | Blue Banana bvba | Crowd control system and method |
US8636572B2 (en) | 2010-03-16 | 2014-01-28 | Harmonix Music Systems, Inc. | Simulating musical instruments |
US8568234B2 (en) | 2010-03-16 | 2013-10-29 | Harmonix Music Systems, Inc. | Simulating musical instruments |
US9278286B2 (en) | 2010-03-16 | 2016-03-08 | Harmonix Music Systems, Inc. | Simulating musical instruments |
US8550908B2 (en) | 2010-03-16 | 2013-10-08 | Harmonix Music Systems, Inc. | Simulating musical instruments |
US8874243B2 (en) | 2010-03-16 | 2014-10-28 | Harmonix Music Systems, Inc. | Simulating musical instruments |
US9358456B1 (en) | 2010-06-11 | 2016-06-07 | Harmonix Music Systems, Inc. | Dance competition game |
US8702485B2 (en) | 2010-06-11 | 2014-04-22 | Harmonix Music Systems, Inc. | Dance game and tutorial |
US8562403B2 (en) | 2010-06-11 | 2013-10-22 | Harmonix Music Systems, Inc. | Prompting a player of a dance game |
US8444464B2 (en) | 2010-06-11 | 2013-05-21 | Harmonix Music Systems, Inc. | Prompting a player of a dance game |
US9024166B2 (en) | 2010-09-09 | 2015-05-05 | Harmonix Music Systems, Inc. | Preventing subtractive track separation |
US9848106B2 (en) * | 2010-12-21 | 2017-12-19 | Microsoft Technology Licensing, Llc | Intelligent gameplay photo capture |
US20120157200A1 (en) * | 2010-12-21 | 2012-06-21 | Microsoft Corporation | Intelligent gameplay photo capture |
US9259643B2 (en) * | 2011-04-28 | 2016-02-16 | Microsoft Technology Licensing, Llc | Control of separate computer game elements |
US20120276994A1 (en) * | 2011-04-28 | 2012-11-01 | Microsoft Corporation | Control of separate computer game elements |
US20120277001A1 (en) * | 2011-04-28 | 2012-11-01 | Microsoft Corporation | Manual and Camera-based Game Control |
US20130260885A1 (en) * | 2012-03-29 | 2013-10-03 | Playoke Gmbh | Entertainment system and method of providing entertainment |
US20140094304A1 (en) * | 2012-09-28 | 2014-04-03 | Red Robot Labs, Inc. | Apparatus and Method for In-Game Video Capture |
US9433858B2 (en) | 2013-01-04 | 2016-09-06 | International Business Machines Corporation | Access control of user based photograph bundles |
US9539504B2 (en) * | 2013-01-22 | 2017-01-10 | Nintendo Co., Ltd. | Storage medium storing game program, game device, game system, and game process method |
US20140206422A1 (en) * | 2013-01-22 | 2014-07-24 | Nintendo Co., Ltd. | Storage medium storing game program, game device, game system, and game process method |
US9867013B2 (en) * | 2013-10-20 | 2018-01-09 | Oahu Group, Llc | Method and system for determining object motion by capturing motion data via radio frequency phase and direction of arrival detection |
US20170156035A1 (en) * | 2013-10-20 | 2017-06-01 | Oahu Group, Llc | Method and system for determining object motion by capturing motion data via radio frequency phase and direction of arrival detection |
US9911351B2 (en) * | 2014-02-27 | 2018-03-06 | Microsoft Technology Licensing, Llc | Tracking objects during processes |
US20150243013A1 (en) * | 2014-02-27 | 2015-08-27 | Microsoft Corporation | Tracking objects during processes |
US20170282056A1 (en) * | 2014-08-23 | 2017-10-05 | James Ashton | Method and apparatus for playing a game |
US11602697B2 (en) * | 2017-09-05 | 2023-03-14 | State Space Labs Inc. | Sensorimotor assessment and training |
US11896910B2 (en) | 2017-09-05 | 2024-02-13 | State Space Labs, Inc. | System and method of cheat detection in video games |
US11904245B2 (en) | 2017-09-05 | 2024-02-20 | State Space Labs, Inc. | System and method for cheat detection |
US11951403B2 (en) | 2017-09-05 | 2024-04-09 | State Space Labs, Inc. | System and method for improving game performance |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US20090258703A1 (en) | Motion Assessment Using a Game Controller | |
CN102448561B (en) | Gesture coach | |
Boccanfuso et al. | CHARLIE: An adaptive robot design with hand and face tracking for use in autism therapy | |
Limbu et al. | Using sensors and augmented reality to train apprentices using recorded expert performance: A systematic literature review | |
US10474793B2 (en) | Systems, apparatus and methods for delivery and augmentation of behavior modification therapy and teaching | |
WO2011084245A2 (en) | Camera navigation for presentations | |
CN102947777A (en) | User tracking feedback | |
CN102331840A (en) | User selection and navigation based on looped motions | |
US20190126145A1 (en) | Exercise motion system and method | |
Wiehr et al. | betaCube: Enhancing training for climbing by a self-calibrating camera-projection unit | |
KR102088335B1 (en) | Mixed reality-based learning game providing system that can simultaneously learn and exercise | |
US20220277506A1 (en) | Motion-based online interactive platform | |
Barioni et al. | BalletVR: a Virtual Reality System for Ballet Arm Positions Training | |
Nishida et al. | Synthetic evidential study as primordial soup of conversation | |
AU2020102908A4 (en) | IOTM- Class Monitoring System: IoT and AI based Monitoring System for Faculty and their Course Materials Availability | |
Losilla et al. | An Augmented Reality Mirror Exergame using 2D Pose Estimation. | |
CN111613104B (en) | Cognitive learning system and system thinking learning method thereof | |
Matsuura et al. | Double-sided design for reinforcing private training of basketball with an advanced imagery opponent | |
TWM581261U (en) | Cognitive learning system | |
US20230241453A1 (en) | Exercise motion system and method | |
Cidota et al. | [POSTER] Affording Visual Feedback for Natural Hand Interaction in AR to Assess Upper Extremity Motor Dysfunction | |
Vitale | EVALUATION ANDMEASUREMENTS OF KINECTMOVEMENT DETECTION IN PHYSICAL THERAPY | |
Matsuura et al. | Design of a one-on-one training system for basketball players | |
KR20230153552A (en) | VR-based training system and method for improving distraction and impulsivity in children and adolescents with ADHD | |
Jayaraj | Improving the immersion in a virtual reality batting simulator with real-time performance capture and haptics |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
AS | Assignment |
Owner name: SONY COMPUTER ENTERTAINMENT AMERICA INC., CALIFORN Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:BRUNSTETTER, AARON PHILIP;REEL/FRAME:022498/0484 Effective date: 20090330 |
|
AS | Assignment |
Owner name: SONY COMPUTER ENTERTAINMENT AMERICA LLC, CALIFORNI Free format text: CHANGE OF NAME;ASSIGNOR:SONY COMPUTER ENTERTAINMENT AMERICA INC.;REEL/FRAME:025331/0483 Effective date: 20100401 |
|
STCB | Information on status: application discontinuation |
Free format text: ABANDONED -- FAILURE TO RESPOND TO AN OFFICE ACTION |
|
AS | Assignment |
Owner name: SONY INTERACTIVE ENTERTAINMENT AMERICA LLC, CALIFORNIA Free format text: CHANGE OF NAME;ASSIGNOR:SONY COMPUTER ENTERTAINMENT AMERICA LLC;REEL/FRAME:038626/0637 Effective date: 20160331 Owner name: SONY INTERACTIVE ENTERTAINMENT AMERICA LLC, CALIFO Free format text: CHANGE OF NAME;ASSIGNOR:SONY COMPUTER ENTERTAINMENT AMERICA LLC;REEL/FRAME:038626/0637 Effective date: 20160331 |