WO2012106978A1 - 一种人机互动的控制方法及其运用 - Google Patents

一种人机互动的控制方法及其运用 Download PDF

Info

Publication number
WO2012106978A1
WO2012106978A1 PCT/CN2012/000108 CN2012000108W WO2012106978A1 WO 2012106978 A1 WO2012106978 A1 WO 2012106978A1 CN 2012000108 W CN2012000108 W CN 2012000108W WO 2012106978 A1 WO2012106978 A1 WO 2012106978A1
Authority
WO
WIPO (PCT)
Prior art keywords
user
self
character
action
virtual
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Ceased
Application number
PCT/CN2012/000108
Other languages
English (en)
French (fr)
Chinese (zh)
Inventor
黄得锋
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Individual
Original Assignee
Individual
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Individual filed Critical Individual
Priority to EP21188983.7A priority Critical patent/EP3950076A1/en
Priority to EP12745158.1A priority patent/EP2674204A4/en
Priority to KR1020137023483A priority patent/KR101679805B1/ko
Priority to JP2013552821A priority patent/JP6193764B2/ja
Publication of WO2012106978A1 publication Critical patent/WO2012106978A1/zh
Priority to US13/963,666 priority patent/US10058773B2/en
Anticipated expiration legal-status Critical
Ceased legal-status Critical Current

Links

Classifications

    • AHUMAN NECESSITIES
    • A63SPORTS; GAMES; AMUSEMENTS
    • A63FCARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
    • A63F13/00Video games, i.e. games using an electronically generated display having two or more dimensions
    • A63F13/20Input arrangements for video game devices
    • AHUMAN NECESSITIES
    • A63SPORTS; GAMES; AMUSEMENTS
    • A63FCARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
    • A63F13/00Video games, i.e. games using an electronically generated display having two or more dimensions
    • A63F13/20Input arrangements for video game devices
    • A63F13/21Input arrangements for video game devices characterised by their sensors, purposes or types
    • A63F13/212Input arrangements for video game devices characterised by their sensors, purposes or types using sensors worn by the player, e.g. for measuring heart beat or leg activity
    • AHUMAN NECESSITIES
    • A63SPORTS; GAMES; AMUSEMENTS
    • A63FCARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
    • A63F13/00Video games, i.e. games using an electronically generated display having two or more dimensions
    • A63F13/55Controlling game characters or game objects based on the game progress
    • AHUMAN NECESSITIES
    • A63SPORTS; GAMES; AMUSEMENTS
    • A63FCARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
    • A63F13/00Video games, i.e. games using an electronically generated display having two or more dimensions
    • A63F13/20Input arrangements for video game devices
    • A63F13/23Input arrangements for video game devices for interfacing with the game device, e.g. specific interfaces between game controller and console
    • AHUMAN NECESSITIES
    • A63SPORTS; GAMES; AMUSEMENTS
    • A63FCARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
    • A63F13/00Video games, i.e. games using an electronically generated display having two or more dimensions
    • A63F13/40Processing input control signals of video game devices, e.g. signals generated by the player or derived from the environment
    • A63F13/42Processing input control signals of video game devices, e.g. signals generated by the player or derived from the environment by mapping the input signals into game commands, e.g. mapping the displacement of a stylus on a touch screen to the steering angle of a virtual vehicle
    • A63F13/422Processing input control signals of video game devices, e.g. signals generated by the player or derived from the environment by mapping the input signals into game commands, e.g. mapping the displacement of a stylus on a touch screen to the steering angle of a virtual vehicle automatically for the purpose of assisting the player, e.g. automatic braking in a driving game
    • AHUMAN NECESSITIES
    • A63SPORTS; GAMES; AMUSEMENTS
    • A63FCARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
    • A63F13/00Video games, i.e. games using an electronically generated display having two or more dimensions
    • A63F13/40Processing input control signals of video game devices, e.g. signals generated by the player or derived from the environment
    • A63F13/42Processing input control signals of video game devices, e.g. signals generated by the player or derived from the environment by mapping the input signals into game commands, e.g. mapping the displacement of a stylus on a touch screen to the steering angle of a virtual vehicle
    • A63F13/428Processing input control signals of video game devices, e.g. signals generated by the player or derived from the environment by mapping the input signals into game commands, e.g. mapping the displacement of a stylus on a touch screen to the steering angle of a virtual vehicle involving motion or position input signals, e.g. signals representing the rotation of an input controller or a player's arm motions sensed by accelerometers or gyroscopes
    • AHUMAN NECESSITIES
    • A63SPORTS; GAMES; AMUSEMENTS
    • A63FCARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
    • A63F13/00Video games, i.e. games using an electronically generated display having two or more dimensions
    • A63F13/80Special adaptations for executing a specific game genre or game mode
    • A63F13/803Driving vehicles or craft, e.g. cars, airplanes, ships, robots or tanks
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/002Specific input/output arrangements not covered by G06F3/01 - G06F3/16
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0481Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0481Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
    • G06F3/04815Interaction with a metaphor-based environment or interaction object displayed as three-dimensional [3D], e.g. changing the user viewpoint with respect to the environment or object
    • AHUMAN NECESSITIES
    • A63SPORTS; GAMES; AMUSEMENTS
    • A63FCARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
    • A63F13/00Video games, i.e. games using an electronically generated display having two or more dimensions
    • A63F13/20Input arrangements for video game devices
    • A63F13/21Input arrangements for video game devices characterised by their sensors, purposes or types
    • AHUMAN NECESSITIES
    • A63SPORTS; GAMES; AMUSEMENTS
    • A63FCARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
    • A63F2300/00Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game
    • A63F2300/10Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game characterized by input arrangements for converting player-generated signals into game device control signals
    • A63F2300/1087Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game characterized by input arrangements for converting player-generated signals into game device control signals comprising photodetecting means, e.g. a camera
    • AHUMAN NECESSITIES
    • A63SPORTS; GAMES; AMUSEMENTS
    • A63FCARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
    • A63F2300/00Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game
    • A63F2300/50Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game characterized by details of game servers
    • A63F2300/55Details of game data or player data management
    • A63F2300/5546Details of game data or player data management using player registration data, e.g. identification, account, preferences, game history
    • A63F2300/5553Details of game data or player data management using player registration data, e.g. identification, account, preferences, game history user representation in the game field, e.g. avatar
    • AHUMAN NECESSITIES
    • A63SPORTS; GAMES; AMUSEMENTS
    • A63FCARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
    • A63F2300/00Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game
    • A63F2300/60Methods for processing data by generating or executing the game program
    • A63F2300/6045Methods for processing data by generating or executing the game program for mapping control signals received from the input arrangement into game commands
    • AHUMAN NECESSITIES
    • A63SPORTS; GAMES; AMUSEMENTS
    • A63FCARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
    • A63F2300/00Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game
    • A63F2300/60Methods for processing data by generating or executing the game program
    • A63F2300/6045Methods for processing data by generating or executing the game program for mapping control signals received from the input arrangement into game commands
    • A63F2300/6054Methods for processing data by generating or executing the game program for mapping control signals received from the input arrangement into game commands by generating automatically game commands to assist the player, e.g. automatic braking in a driving game
    • AHUMAN NECESSITIES
    • A63SPORTS; GAMES; AMUSEMENTS
    • A63FCARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
    • A63F2300/00Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game
    • A63F2300/60Methods for processing data by generating or executing the game program
    • A63F2300/66Methods for processing data by generating or executing the game program for rendering three dimensional images
    • A63F2300/6607Methods for processing data by generating or executing the game program for rendering three dimensional images for animating game characters, e.g. skeleton kinematics
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F2203/00Indexing scheme relating to G06F3/00 - G06F3/048
    • G06F2203/01Indexing scheme relating to G06F3/01
    • G06F2203/012Walk-in-place systems for allowing a user to walk in a virtual environment while constraining him to a given position in the physical environment
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F30/00Computer-aided design [CAD]
    • G06F30/20Design optimisation, verification or simulation

Definitions

  • the user needs to have a large amount of motion space, and the movement has limitations, such as: When the user has moved to the wall, but the next action of the avatar also requires the user to move backwards toward the wall.
  • some prior art techniques reduce the activity space of the avatar (note that the avatar is not the user), so that the user does not have to move or minimize the activity during the control process, but such a method makes the game available. Playability is greatly reduced, and its use value is very limited.
  • Some prior art techniques allow the user to move to the same location through a treadmill or the like, but there are also: The user needs to continue to consume physical energy, so it is difficult to continue man-machine interaction for a long time, and the user is also difficult to exercise at will.
  • the prior art of reducing the avatar's activity space also includes manipulating moving tools, such as chariots, but the various controls on the chariot do not need to be reconnected, but this traditional way, in addition to the above drawbacks
  • Self-character refers to a virtual character that can be manipulated by the user in the virtual world and considered by the user to be his own, but human or any moving object.
  • micro-action scheme When the user implements a certain one or a group of qualified micro-actions, a control command can be issued to the computer; the micro-action here refers especially to the user's small-scale action, such as: the corresponding arbitrary joint movement displacement is less than 20cm, the specific performance is as follows: arm fretting, foot micro-curve; The above conditions of the present invention include, in particular, the case where the command is not issued.
  • the virtual world gives action or action to the instrument in the self-character or virtual world.
  • the action plan includes a continuous action combination, an action force, a speed, and the like.
  • Active joints Users not all joint activities can control the activities of my self-characteristic parts. Especially when the self-character is non-human, there are no joints on the user's body. Therefore, the "active joint” referred to in the present invention refers to virtual The world gives the self-actor a movable part and corresponds to the joint of the user's actual body. On the other hand, when the active part of the self-character is more than the actual number of active joints of the user, the other methods introduced by the present invention are adopted; in addition, the active joint referred to herein is not limited to the skeleton joint, and it generally refers to the movable body. Any part of the body, such as any point on the entire upper arm.
  • Reverse action The virtual world scene in which the self-player is located performs a vector action with the same vector value but opposite direction to the command issued by the user; the vector action particularly refers to the displacement change and the volume change at any time point, as shown in the figure. 1 shows: With the vector action as the ordinate and the time as the abscissa, the coordinate system corresponding to the virtual world scene where the self-character is located is axis-symmetric with the abscissa, such as: From time point tl At time t2, when the user wants to advance 5 meters in the southeast direction, it is only necessary to move the scene of the self-character to the northwest direction by 5 meters during the time period; for example: From time point t1 to time point t2, the user wants The proportion of the whole body becomes 2 times larger.
  • the scene of the self-character is reduced by twice in the same time period.
  • the user's transformation or deformation instruction it is possible to preferentially determine whether the eye and the distance between the eyes are included, if the eyes And the distance between the eyes does not change, then the scene does not change in volume, that is, the volume vector of the scene Volume vector operation between the eye and the eye having the self-character distance: Vector the same value and opposite relationship.
  • the user instruction may preferably be associated with a motion vector and a visual vector of a self-character head, such as: speed, displacement; the visual vector such as: a volume change of the self-character.
  • Palm As shown in Figure 2, the palm 1 includes the joints on all the palms 1 including the wrists 11, such as the fingers 12.
  • the foot 2 includes the joints on all the feet 2, including the ankles 21, such as the toes 22.
  • the index for evaluating the range of motion It may be the displacement and direction of the tracked part, the angle between the tracked part at two points in time, and the like.
  • Motion amplification In order to strive for the user's true feelings and the synchronization requirements in the interactive process, the following two rules are set: 1. Within the scope of human perception, the motion amplification preferably only amplifies the user's motion amplitude and intensity; 2. When the range of human perception is exceeded, the motion amplification can also amplify the user's motion speed.
  • the user performs various controls in the same "manipulation position" without displacement, and is not limited by the virtual world space and time:
  • the invention achieves the above technical effects by using an action amplification method, and the action amplification method includes:
  • the maximum allowable range of the virtual allowable actions of the self-character in the virtual world is N
  • the actual exercise limit is greater than the maximum allowable action, and in order to more effectively achieve the effect of the present technology, when the virtual world process adopts the action amplification system, it is preferable to limit the user's limb. It is only allowed to perform small micro-motions.
  • the user allows the micro-motion scheme to satisfy: When the user completes any micro-motion with the maximum amplitude M, the angle change value of any adjacent two parts except the palm and the sole of the torso is less than 30 degrees.
  • an allowable micro-motion scheme involves the angles of the upper arm and the lower arm. When the front and rear angles of the action are 120 degrees and 140 degrees, the angle between the adjacent two parts is +20 degrees.
  • the form (pose) of the user and the self-character does not require the same or similar.
  • the present invention can provide a continuous action command, and the user can keep turning and the like when the user continues to act on the elastic device. Therefore, the user can control any action scheme of the self character in any posture.
  • the maximum amplitude M of the present invention is preferably within plus or minus 5 degrees.
  • restriction scheme can also be optimized for one or more of the following:
  • the corresponding part of the user can be subjected to a corresponding proportion and a load acceptable to the user.
  • the virtual world receives user instructions:
  • the motion positioning point control system is: one or more positioning sensing elements are provided on the user body or on the props, and the position (three-dimensional coordinates) of each positioning sensing component changes with time, thereby determining that the user is arbitrary A gesture in time or an action change in a certain period of time.
  • the method for determining the change of the position of the positioning sensor includes the following steps:
  • the method of controlling the self-role action by locating the position change of the sensing part is to give the virtual world a self-character Al, A2 ⁇ An, a total of n individually movable parts, controlled according to the following two situations:
  • the N active parts can find the corresponding active joints on the user, the N, N2 ⁇ Nn N positioning sensing elements are respectively set on the corresponding active joints, and tracked at any time point t When the three-dimensional position of Nl, N2 ⁇ Nn changes, the three-dimensional position of each positioning sensor is changed, and the corresponding part of the self-character is controlled to perform related actions; 2) when the N active parts cannot completely find the corresponding active joint on the user Assume that there are several active parts Mx that cannot find the corresponding relationship. First, the active joint Nx of the user can select a total of s active parts of Mxl, Mxl ⁇ Mxs of the self-character, and adopt one or all of the selection method and the combination method.
  • the selection method means that after the active joint Nx determines the corresponding control active part, it can be directly and directly controlled; the group ⁇ " method means that when the active part needs to be replaced, the third command can be adopted.
  • use other active joints to jointly select different active parts such as:
  • the user's arm can choose to control the self-angle The arm and the wing, the movable joint is set as the toe, when the toe is picked up, the user controls the wing, and when it is released, the arm is controlled; when the third command refers to a command menu, the selection interface is jumped out, by selecting Make sure you want to control the active part.
  • Method for controlling self-role action by locating the position change of the sensing member further includes dividing the movable portion and the non-movable portion on the body and the prop of the user, and respectively setting the position sensing member for the movable portion; wherein the prop and the virtual world are Corresponding to the item or appliance, so that when the prop is manipulated, the corresponding item or appliance in the virtual world can be manipulated accordingly, in other words It is to use the positioning sensor to control the things (people or objects) in the corresponding virtual world.
  • the corresponding method of locating the sensing element or its change and the self-role action or active part is to make the positioning sensing parts on the different joints of the user have different distinguishing features, and corresponding to the active part of the self-character or different through different distinguishing features action.
  • the distinguishing feature is a different spot density or spotting rule on the positioning sensing member.
  • the present invention also introduces a sleeve-type fixed point control device suitable for the above virtual world method ":
  • each kit has one or more sensing points.
  • the device is intended to completely determine the position and posture of the user at any point in time by the position of each of the sensing points positioned on the user.
  • the device is also limited to the above-described joint arrangement of the sensing points at the joint.
  • the present invention also provides a method for a user to see their body enter the virtual world:
  • the implementation method is to adopt the system of the body, the panoramic system and the scene moving system at the same time.
  • the following describes each system one by one.
  • the scene movement system utilizes a reverse vector action of a scene in which the self-character in the virtual world is located, so that the user has an illusion of performing various movements or transformations (body reduction or enlargement or shape change);
  • the reverse action is a vector action in which the scene of the self-character in the virtual world is opposite to the direction of the head of the self-character and the vector value is the same, and the two are in the coordinate system with the same vector action and time as the coordinate axes,
  • the vector action time chart has an axisymmetric relationship with the time axis.
  • the panoramic system enables the user to only see the scene in the virtual world, but does not see the scene in reality, and the virtual world scene covers the entire visual range of the user; the system especially refers to the user wearing full 3D glasses.
  • the glasses on the screen and its virtual world screen cover the entire visual range of the user.
  • the self-contained system satisfies the same position of the user and the self-character in the virtual world and synchronizes the user's body with the self-character activity, so that when the user wants to see his or her body, he can see his various actions in the virtual world. .
  • the present invention adopts a selection method and a combination method, so that a person with physical disabilities passes through a part with active muscle energy.
  • the "motion zooming system" introduced by the present invention can realize all the functions or capabilities all the virtual worlds can give to the user without displacement or only a slight displacement, and enable the user to only control the same position in the whole process of the virtual world. At the same time, it is also convenient to realize that the user's moving part and the virtual world character moving part are consistent, so that the user can easily get started.
  • the three-point positioning method introduced by the invention enables the computer to realize the speed that the human body cannot perceive, so that the self-character and the user can perform various actions synchronously, thereby solving the problem of the image lag, and then enabling the user to complete the human-computer interaction more conveniently for a long time. Less There will be a situation where the user is dizzy.
  • the "sleeve-type fixed-point control device” introduced by the invention enables the user to directly control the action of various parts of the body, and can control the corresponding "induction positioning point" to perform related commands, thereby enabling the user to see himself or himself.
  • the devices controlled in the virtual world perform related actions.
  • the use of the device effectively shortens the preparation time for the user before entering the virtual world, and the preparation process required for the user, so that the user can perform the virtual world in a convenient manner.
  • the "induction positioning point system” introduced by the invention enables the system to control the self-role action by tracking various vector changes (including: displacement, speed, direction) occurring at each positioning point; the solution can effectively simplify the "sleeve type fixed point control"
  • the device makes it purely mechanical, without any electronic system, can avoid electronic short circuit to cause physical injury to the user; at the same time, because the user is in use, each positioning point is positioned at each corresponding part of the user, Moreover, the user only performs micro-action, so the displacement of each positioning point is very small, so zero damage of the device can be realized to ensure the service life of the device.
  • Figure 1 is a vector action time diagram of the same vector action in the virtual world where the self-character scene and the self-character head are in the same vector, where t: time, V: volume, S: displacement
  • Curve A is the displacement or volume vector action time diagram of the scene where the self character is located in the virtual world.
  • Curve B is the displacement or volume vector action time diagram of the head of the self character.
  • Figure 2 is a schematic view of the user's joints.
  • Embodiment 1 A method for controlling human-computer interaction
  • a control method for human-computer interaction which establishes "user micro-motion database” and “self-action virtual action data”; and stipulates “action amplification rules” and "human-computer interaction rules”.
  • the "User Micro-Action Database” also includes "Using the Allow Micro-Action Scheme Database”. 1, user micro-action database:
  • a virtual action part corresponding to the self-character defined by the user's active part that is, a part of the self-character that can be controlled
  • Action parameters of the virtual action part Shift, speed, velocity; Determine the magnification of the motion range of each virtual action part relative to the motion range of the user's active part.
  • the embodiment further provides a human-machine synchronization system, and the human-machine synchronization system includes: a user micro-action recognition system and a micro-action matching command rule system.
  • the user's micro-motion recognition system it defines the active part and the inactive part of the user's body or prop, and respectively has different positioning features on different active parts; construct a virtual three-dimensional coordinate system, and The distance measuring device is fixed on three or more known coordinate points which are not on the same straight line; the specific identification methods are as follows:
  • the user micro motion recognition system in the embodiment is intended to track the movement of the user's limbs. It can also be provided with two or more positioning sensors on any active part, at least two of which are in x, y, The coordinate values on the z-axis are different, so that the horizontal or vertical rotation angle of the active part within a certain period of time can be determined.
  • the micro-motion matching command rule system the user controls the limb movement to cause a certain regular displacement change of the sensing point on the limb, and matches the action scheme of the self-character, which includes:
  • the virtual world is given a self-character Al, A2 ⁇ An, a total of n individual movable parts A, and any one of the individually movable parts Ax is provided with Axl, Ax2 ⁇ Axm, and a total of m kinds of permitted actions, and Axx is any allowed action. , controlled in the following two situations.
  • the strength of Ax implementation corresponds to Ax'
  • the corresponding joint curvature and the joint jitter frequency, the condition that the Ax uses the maximum force is: When the user's Ax' reaches the maximum amplitude;
  • Ax should also consider the tension degree, the moving speed and the execution time corresponding to Ax', Realize the user to manipulate the virtual world more naturally, and make the movement of the self role conform to the natural law as much as possible;
  • the joint described in this embodiment is intended to completely determine the position and posture of the user at any point in time by the position of each of the sensing points positioned on the user, and the present inventors particularly cite one of them to satisfy the purpose.
  • Total joints three joints per finger, wrist joint, elbow joint, shoulder joint, any three points on the head that are not on the same line, one joint of each toe, ankle joint, calf, thigh, buttocks , the midpoint of the spine.
  • the active joint is set as the toe.
  • the user controls the wing, and when it is released, the arm is controlled.
  • the third command refers to a command menu
  • the selection interface is jumped out, and the active part is controlled by selecting and confirming.
  • the method for controlling the self-character action by locating the position change of the sensing component further comprises dividing the movable part and the non-movable part on the body and the prop of the user, and respectively setting the position sensing part of the movable part; wherein the item and the item in the virtual world Or the corresponding equipment, so that when the props are manipulated, the corresponding items or appliances in the virtual world can be manipulated accordingly, in other words, the positioning inductive means is used to control the things (people or objects) in the corresponding virtual world.
  • the positioning sensing members on the different joints of the user have different distinguishing features, and corresponding to the active parts of the self-characteristics or different actions through different distinguishing features.
  • the distinguishing feature is a different coating point density or a coating point rule on the positioning sensing member. If the coating point density is d or the position sensing component having the coating rule 1 changes position, an active part of the self character performs correspondingly. Permitted action; coating density or coating rules can be achieved by stamping.
  • the rule that does not trigger the command is preferred, and of course, the rule that triggers the command may also be used.
  • the sleeve-type fixed-point control device may also implant a controller in the device, so that the controller senses various vector changes (including displacement, speed, and direction) occurring at each positioning point; "Positioning point system", Cocoa effectively simplifies the "sleeve-type fixed-point control device", making it purely mechanical, without any electronic system. Because the virtual world process, only the micro-action of each part of the user, so can do equipment zero Damage, that is, to ensure the service life of the equipment, and to avoid possible physical short circuit in the electronic system to cause physical harm to the user.
  • the sleeve-type fixed point control device of this embodiment includes a palm kit, an arm kit, a head kit, a sole kit, a leg kit, a hip kit, and a waist kit; each kit has one or more inductive positioning points.
  • the device is intended to completely determine the position and posture of the user at any point in time by the position of each of the sensing points positioned on the user.
  • the device is also limited to the above-described joint arrangement of the sensing points at the joint.
  • the embodiment further provides a human-machine interaction system, which comprises: a reaction sensing device and an activated device; the human-machine interaction system is mainly used for correction: the maximum allowable micro-motion amplitude of the user Mm And the ratio Mm/Nm of the maximum virtual allowable action amplitude Nm of the self-character; and the Mm/Nm value is larger than the normal state, that is, when the reaction-aware device and the action-aware device operate, Nm is reduced according to factors such as the following.
  • the eye image capturing device may be implemented by various prior art techniques, such as the "eye image collecting device” of the patent number "200610072961.9";
  • the effect effect of the self-character is: the morphological change and the kinetic energy change after the self-character is acted; the effect effect produced by the self-character is fed back to the user by the action sensory device, or the corresponding part is changed.
  • the virtual maximum amplitude allows the user to see the effect of the self-character, while visually producing the same or similar illusion of being perceived by the device.
  • the self-player wants to attack a game character, first lock the target, when the self-playing character punches a punch, it acts on the opponent's arm, and is attacked by the opponent's arm.
  • the self-character will inevitably be reacted; here, when the target is blocked, the self-character is also affected by the target block, and the effect of the setting device is superimposed. .
  • the allowable action execution condition of the self-character is not to sense the position of the anchor point at a certain time, but to change the position relative to the previous time point;
  • the action amplification system and the motion positioning point control system can be used in combination or separately;
  • the present invention also includes a voice control system that allows the user to issue commands through voice to control the allowed actions of the self character and the basic operations of the virtual world, such as: exit, save.
  • the system also includes a voice recognition system, such as pre-recording the user's voice and matching the commands.
  • This virtual world allows the self-character to have deformability.
  • the number of parts is greater than the number of joints of the person. What should I do?
  • the virtual world method also allows the user to have super powers such as emptying objects.
  • the starting condition of the instruction is: the sensing positioning points on the user's arm are on the same straight line, and the sensing positioning points on the palm are integrated with claws and facing the article;
  • the virtual world judges the magnitude of the suction, the maximum value of the self-acting suction can be predetermined, and the condition of the value can be the frequency of the finger shaking.
  • the frequency is reduced, the suction force is correspondingly reduced.
  • the virtual world When the virtual world receives the user's intention, it will calculate and compare the difficulty of suction and the item being sucked. When the gravity of the item is too large or the adsorption force of the original position is too large, the user is required to increase the intensity of the grasp. At this time, the degree of bending of the fingers will be strengthened, and the jitter of the fingers will be intensified, and the jitter of the sensing points on the fingers will be intensified, and the computer will be tightened by the user to further judge whether the absorption can be completed.
  • the present invention also provides a sleeve-type fixed point control device", the user With the corresponding gloves, foot covers, brackets and helmets, you can control the sensing points that are attached to each joint of the whole body, so it is very practical.
  • the user Due to the action amplification method, the user has no physical correspondence between the body position and posture of the body and the self-character. Therefore, the position of the sensing point cannot be determined by itself, but the heads of the two (by the eyes) are in the virtual world. The position and orientation are the same. How do you say that users can also determine coordinates in the virtual world? First, the user's vision is obtained through the glasses, and the coordinates of the eyeglass in the virtual world are determinable, because the relative positions of the eyeball and the glasses are always the same, and therefore, the coordinates of the user's eyeball in the virtual world can be determined.
  • It includes: a body system, a panoramic system, a scene movement system, an action judgment system, and an action amplification system.
  • the panoramic system refers to a virtual world process, and the virtual world image always covers the entire visual range of the user, so that the user can only see the scene in the virtual world, but does not see the scene in reality; the screen and the virtual world on the glasses The screen covers the entire visual range of the user; the technology can adopt the prior art such as "Mobile Video Glasses Integrated with CMMB Receiving Module” with the patent number "200810066897.2".
  • the body-holding system satisfies the same position of the user and the self-character in the virtual world, and the user's physical activity is synchronized with the self-character activity, so that when the user looks at the body of the self-character, he or she mistakenly thinks that it is his own real body; the user's body
  • the method of synchronizing the activity with the self-character activity is to determine the action performed by the user through the action positioning point control system, determine the content of the command issued by the user through the related action, and then control the activity of the self-character pair on the active part.
  • the scene movement system utilizes the reverse action of the scene in which the self-character is located in the virtual world, so that the user has an illusion that various movements or transformations (body reduction or enlargement or shape change) are being performed; determination of the scene in which the self-character is located
  • Methods include:
  • the positioning member is provided with three positioning sensing members not in the same straight line, and the positioning sensing member can be determined in the position of the virtual world. , thereby determining the position of the user's head in the virtual world and the orientation of the face;
  • the virtual world picture is determined by the position of the user's head in the virtual world and the face orientation.
  • the mounting position of the positioning member in this embodiment is focused on satisfying the position at which the head can be synchronized, and thus it is also possible to mount various instruments on the user's head.
  • the synchronization relationship between the user and the self-character in the face may also be an action amplification system.
  • This embodiment is to make the virtual world more realistic, including one or more of the random obstacle systems such as the olfactory system, the haptic system, and the physical fatigue;
  • the physical fatigue randomization system can be combined with a sleeve-type fixed point control device, such as a retractable advancement mechanism connected to the sole assembly, and a retractable hand grip in the palm set.
  • a sleeve-type fixed point control device such as a retractable advancement mechanism connected to the sole assembly, and a retractable hand grip in the palm set.
  • the barrier system includes a reaction sensing device and an activated sensing device; the activated sensing device satisfies: when any object in the virtual world acts on a certain part or parts of the self character, the obstacle system is based on The object motion characteristic acts on the corresponding part of the user; the reaction sensing device satisfies: when the self role acts on any object of the virtual world, Firstly, according to the action characteristics of the self-character and the immediate state of the object, the system judges the part of the self-action being reacted and the reaction effect, and the obstacle-setting system acts on the corresponding part of the user with the equal factor effect.
  • the obstacle system changes the load of the reaction sensing device and the object to be sensed to the user according to the degree of fatigue or maximum movement of the self character.
  • the user Before the virtual world, the user must be fixed on a certain control position (such as: bed), the user moves any limb, and the corresponding person in the virtual world performs a complete action, so that the user can perform any action in the same place.
  • a certain control position such as: bed
  • the control position When the control position is performed, the position of the body does not change after the action, thereby reducing the user's exercise space.
  • the obstacle system limits the maximum range of motion of the user's torso, such as: the foot plate device elastically contacts the user's foot plate; the arm limit device is placed on the user's arm with an interference fit.
  • the obstacle-disposing mechanism is disposed above the portion where the user is allowed to move, and the obstacle-setting mechanism is kept at a certain distance from the user's torso (referred to as a free space) under normal conditions, so that the user parts do not touch the obstacle-setting mechanism. , the micro-action can be performed without any action; the obstacle-disconnecting mechanism is provided with an elastic load active area (called load space).
  • load space an elastic load active area
  • the obstacle-setting mechanism acts as a reaction of the target to the user
  • the obstacle-setting mechanism reduces the free space and acts on the corresponding torso of the user
  • the video apparatus of the present invention is not limited to a facility for viewing through the eyes, and the "human body electronic implant and its artificial vision system" of the patent number "00820024.6” has given a method of obtaining an image by the eye.
  • Embodiment 3 - Game method
  • a game method that pays for a self-character's super-powerful approach including the following steps:
  • the morphological changes described in this embodiment include position, shape, state, and material change, wherein the shape includes deformation, flow, change between particles, etc.; state changes include: gas, solid, liquid-to-liquid transition, etc.; Changes in motion such as displacement, speed of motion, and acceleration.
  • the virtual environment of the present invention is further provided with at least one or more virtual environments in a future environment, a past environment, and a dream environment.
  • the invention can open the user to reset the authority of the object side parameter in the virtual environment, so that the user can construct, adjust and delete the virtual environment by himself. Therefore, it is very easy for the user to materialize the imaginary object, which is unimaginable beyond the traditional tools.
  • Example 4 A method of viewing a space design or a space sample
  • a method of viewing a space design or a spatial sample which includes the following steps:
  • Embodiment 5 A film shooting method
  • a film shooting method :
  • Example 6 A method of simulating an experiment
  • steps 2) -4) are repeated as needed.
  • This experimental method not only does not cause harm to the user, but also has zero cost and high experimental precision.
  • Example 7 - Tourism method
  • a travel method :

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Human Computer Interaction (AREA)
  • Theoretical Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Health & Medical Sciences (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Biophysics (AREA)
  • Cardiology (AREA)
  • General Health & Medical Sciences (AREA)
  • Heart & Thoracic Surgery (AREA)
  • Processing Or Creating Images (AREA)
  • User Interface Of Digital Computer (AREA)
PCT/CN2012/000108 2011-02-11 2012-01-20 一种人机互动的控制方法及其运用 Ceased WO2012106978A1 (zh)

Priority Applications (5)

Application Number Priority Date Filing Date Title
EP21188983.7A EP3950076A1 (en) 2011-02-11 2012-01-20 Method for controlling man-machine interaction and application thereof
EP12745158.1A EP2674204A4 (en) 2011-02-11 2012-01-20 METHOD FOR CONTROLLING HUMAN-MACHINE INTERACTION AND APPLYING THEREOF
KR1020137023483A KR101679805B1 (ko) 2011-02-11 2012-01-20 인간과 컴퓨터가 인터랙티브하는 제어방법 및 그의 응용
JP2013552821A JP6193764B2 (ja) 2011-02-11 2012-01-20 ヒューマンコンピュータインタラクションの制御方法及びその運用
US13/963,666 US10058773B2 (en) 2011-02-11 2013-08-09 Man-machine interaction controlling method and applications thereof

Applications Claiming Priority (4)

Application Number Priority Date Filing Date Title
CN201110036356.7 2011-02-11
CN201110036356 2011-02-11
CN2011104581683A CN102541260B (zh) 2011-02-11 2011-12-30 一种人机互动的控制方法及其运用
CN201110458168.3 2011-12-30

Related Child Applications (1)

Application Number Title Priority Date Filing Date
US13/963,666 Continuation US10058773B2 (en) 2011-02-11 2013-08-09 Man-machine interaction controlling method and applications thereof

Publications (1)

Publication Number Publication Date
WO2012106978A1 true WO2012106978A1 (zh) 2012-08-16

Family

ID=46348299

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2012/000108 Ceased WO2012106978A1 (zh) 2011-02-11 2012-01-20 一种人机互动的控制方法及其运用

Country Status (6)

Country Link
US (1) US10058773B2 (https=)
EP (2) EP3950076A1 (https=)
JP (3) JP6193764B2 (https=)
KR (1) KR101679805B1 (https=)
CN (8) CN107050852A (https=)
WO (1) WO2012106978A1 (https=)

Families Citing this family (28)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN107050852A (zh) * 2011-02-11 2017-08-18 漳州市爵晟电子科技有限公司 一种游戏系统及其穿套式定点控制设备
CN103207667B (zh) * 2011-12-24 2018-10-23 漳州市科达企业咨询有限公司 一种人机互动的控制方法及其运用
CN103544636A (zh) * 2013-11-08 2014-01-29 梁涛 基于虚拟商场的互动方法及设备
CN105979855B (zh) 2014-02-11 2019-05-28 苹果公司 检测正在穿戴可穿戴电子设备的肢体
US10827268B2 (en) 2014-02-11 2020-11-03 Apple Inc. Detecting an installation position of a wearable electronic device
CN108776541A (zh) * 2014-04-11 2018-11-09 黄得锋 一种人机互动的控制方法
CN108139804A (zh) * 2015-10-15 2018-06-08 索尼公司 信息处理装置与信息处理方法
CN105867600A (zh) * 2015-11-06 2016-08-17 乐视移动智能信息技术(北京)有限公司 一种交互方法和设备
CN105488834B (zh) * 2015-12-01 2019-03-19 网易(杭州)网络有限公司 角色面部朝向的调整方法及装置
CN105892754A (zh) * 2016-05-27 2016-08-24 北京小鸟看看科技有限公司 一种手指动作识别方法和系统
JP6756236B2 (ja) 2016-10-31 2020-09-16 富士通株式会社 アクション指示プログラム、アクション指示方法及び画像生成装置
US10901494B2 (en) 2017-03-28 2021-01-26 Wipro Limited Method and a system for providing gesture-based interaction with a virtual product
JP7078035B2 (ja) * 2017-03-31 2022-05-31 ソニーグループ株式会社 情報処理装置、情報処理方法、およびプログラム
CN107158709A (zh) * 2017-05-16 2017-09-15 杭州乐见科技有限公司 一种基于游戏引导运动的方法和设备
ES2963483T3 (es) 2017-09-05 2024-03-27 Apple Inc Dispositivo electrónico usable con electrodos para detectar parámetros biológicos
EP4470456A3 (en) 2017-09-26 2025-02-26 Apple Inc. Optical sensor subsystem adjacent a cover of an electronic device housing
DE102017009169A1 (de) 2017-10-02 2019-04-04 Holger Wild Interaktives Oberkörperabbildgerät
KR101967072B1 (ko) * 2017-12-14 2019-04-08 김민철 사용자 활동 기반 가상 객체 관리 방법, 이를 수행하는 가상 객체 관리 장치 및 이를 기록한 기록매체
CN108553893B (zh) * 2018-04-28 2021-11-16 网易(杭州)网络有限公司 赛车游戏中车辆转向的控制方法和装置
CN110908568B (zh) * 2018-09-18 2022-11-04 网易(杭州)网络有限公司 一种虚拟对象的控制方法和装置
CN111221416B (zh) * 2020-01-06 2021-12-07 腾讯科技(深圳)有限公司 一种虚拟道具分配的方法、服务器及终端设备
US11055891B1 (en) 2020-03-10 2021-07-06 Microsoft Technology Licensing, Llc Real time styling of motion for virtual environments
CN112527109B (zh) * 2020-12-04 2022-05-17 上海交通大学 基于坐姿的vr全身动作控制方法、系统及计算机可读介质
US12396686B2 (en) 2021-08-31 2025-08-26 Apple Inc. Sensing health parameters in wearable devices
US20240085987A1 (en) * 2022-09-12 2024-03-14 Apple Inc. Environmentally Aware Gestures
JP7372717B1 (ja) 2023-03-30 2023-11-01 mirrorX株式会社 プログラム、情報処理装置及び方法
JP2026052898A (ja) * 2024-09-12 2026-03-25 株式会社Jvcケンウッド 操作装置、操作システム、及び操作方法
CN119556803A (zh) * 2025-02-05 2025-03-04 广州美术学院 一种基于虚拟环境的虚拟体验交互控制方法及相关装置

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5577981A (en) * 1994-01-19 1996-11-26 Jarvik; Robert Virtual reality exercise machine and computer controlled video system
US5913727A (en) * 1995-06-02 1999-06-22 Ahdoot; Ned Interactive movement and contact simulation game
CN1231753A (zh) * 1996-08-14 1999-10-13 挪拉赫梅特·挪利斯拉莫维奇·拉都色夫 追踪并显示使用者在空间的位置与取向的方法,向使用者展示虚拟环境的方法以及实现这些方法的系统
US7205979B2 (en) * 1987-03-17 2007-04-17 Sun Microsystems, Inc. Computer data entry and manipulation apparatus and method
CN101890237A (zh) * 2010-07-16 2010-11-24 叶尔肯·拜山 游戏控制器及其控制方法

Family Cites Families (58)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6408289B1 (en) * 1993-06-11 2002-06-18 Mri Devices Daum Gmbh Shapeable elastic body with master unit and method of controlling
JP2840923B2 (ja) * 1994-11-11 1998-12-24 富士通株式会社 プロダクションシステム
EP0761265A4 (en) * 1994-12-30 2005-03-16 Sega Corp VIDEO GAME SYSTEM FOR GAME SIMULATION OF A COMICHEFT
GB9525047D0 (en) * 1995-12-07 1996-02-07 Philips Electronics Nv Virtual body control device
JPH10302083A (ja) * 1997-04-30 1998-11-13 Yamaha Corp Cgモデルの動作制御システム
US6522312B2 (en) * 1997-09-01 2003-02-18 Canon Kabushiki Kaisha Apparatus for presenting mixed reality shared among operators
JP4332254B2 (ja) * 1999-04-28 2009-09-16 株式会社アミテック インテリジェント型手袋型手形入力装置
EP1060772B1 (en) * 1999-06-11 2012-02-01 Canon Kabushiki Kaisha Apparatus and method to represent mixed reality space shared by plural operators, game apparatus using mixed reality apparatus and interface method thereof
US6377281B1 (en) * 2000-02-17 2002-04-23 The Jim Henson Company Live performance control of computer graphic characters
JP2002032788A (ja) * 2000-07-14 2002-01-31 Nippon Telegr & Teleph Corp <Ntt> 仮想現実提供方法、仮想現実提供装置及び仮想現実提供プログラムを記録した記録媒体
JP2002123840A (ja) * 2000-10-17 2002-04-26 Nippon Telegr & Teleph Corp <Ntt> 臨場感型仮想現実提供処理方法および装置
US9682319B2 (en) * 2002-07-31 2017-06-20 Sony Interactive Entertainment Inc. Combiner method for altering game gearing
JP2004129180A (ja) * 2002-09-30 2004-04-22 Atsusato Fujii 仮想空間体験のためのシステム
US9177387B2 (en) * 2003-02-11 2015-11-03 Sony Computer Entertainment Inc. Method and apparatus for real time motion capture
GB0306875D0 (en) * 2003-03-25 2003-04-30 British Telecomm Apparatus and method for generating behavior in an object
JP4048999B2 (ja) * 2003-04-15 2008-02-20 セイコーエプソン株式会社 画像処理装置及び画像処理方法
US9274598B2 (en) * 2003-08-25 2016-03-01 International Business Machines Corporation System and method for selecting and activating a target object using a combination of eye gaze and key presses
WO2006023153A1 (en) * 2004-08-23 2006-03-02 Gamecaster, Inc. Apparatus, methods and systems for viewing and manipulating a virtual environment
JP2006163886A (ja) * 2004-12-08 2006-06-22 Canon Inc 情報入力方法及び情報入力装置
JP4406693B2 (ja) * 2005-01-28 2010-02-03 学校法人立命館 バルーンアクチュエータ、エンドエフェクタ、及び医療用器具
CN102989174B (zh) * 2006-05-04 2016-06-29 美国索尼电脑娱乐公司 获得用于控制游戏程序的运行的输入
JP4848515B2 (ja) * 2006-06-12 2011-12-28 国立大学法人九州工業大学 アバター動作制御システム、そのプログラム及び方法
JP4148281B2 (ja) * 2006-06-19 2008-09-10 ソニー株式会社 モーションキャプチャ装置及びモーションキャプチャ方法、並びにモーションキャプチャプログラム
US8336078B2 (en) * 2006-07-11 2012-12-18 Fmr Corp. Role-based access in a multi-customer computing environment
CN101110102A (zh) * 2006-07-20 2008-01-23 中国科学院自动化研究所 基于玩家拳头的游戏场景和角色控制方法
EP2059315A4 (en) * 2006-08-24 2011-10-26 Howard W Lutnick COMPUTER TERMINAL SYSTEM WITH MULTIPLE DISPLAY SCREENS
US8926534B2 (en) * 2006-09-19 2015-01-06 Myomo, Inc. Powered orthotic device and method of using same
EP2132650A4 (en) * 2007-03-01 2010-10-27 Sony Comp Entertainment Us SYSTEM AND METHOD FOR COMMUNICATING WITH A VIRTUAL WORLD
US8706914B2 (en) * 2007-04-23 2014-04-22 David D. Duchesneau Computing infrastructure
US8726194B2 (en) * 2007-07-27 2014-05-13 Qualcomm Incorporated Item selection using enhanced control
US20090221368A1 (en) * 2007-11-28 2009-09-03 Ailive Inc., Method and system for creating a shared game space for a networked game
US8419545B2 (en) * 2007-11-28 2013-04-16 Ailive, Inc. Method and system for controlling movements of objects in a videogame
CN102124423A (zh) * 2008-01-22 2011-07-13 新世代株式会社 摄像装置、在线游戏系统、操作物、输入方法、图像解析装置、图像解析方法以及记录媒体
CN101256673A (zh) * 2008-03-18 2008-09-03 中国计量学院 用于在实时视频跟踪系统中跟踪手臂运动的方法
JP2009276996A (ja) * 2008-05-14 2009-11-26 Canon Inc 情報処理装置、情報処理方法
US8130207B2 (en) * 2008-06-18 2012-03-06 Nokia Corporation Apparatus, method and computer program product for manipulating a device using dual side input devices
US8793498B2 (en) * 2008-08-11 2014-07-29 Nbcuniversal Media, Llc System and method for forensic analysis of media works
CN102176888B (zh) * 2008-08-25 2015-11-25 苏黎世大学数学和自然科学部 可调整的虚拟现实系统
TWI373361B (en) * 2008-10-09 2012-10-01 Univ Nat Chiao Tung Glove puppet manipulation system
CN101732858B (zh) * 2008-11-11 2013-10-30 盛乐信息技术(上海)有限公司 现实与虚拟结合的联网游戏系统及实现方法
US8253801B2 (en) * 2008-12-17 2012-08-28 Sony Computer Entertainment Inc. Correcting angle error in a tracking system
US9256282B2 (en) * 2009-03-20 2016-02-09 Microsoft Technology Licensing, Llc Virtual object manipulation
JP2010231290A (ja) * 2009-03-26 2010-10-14 National Institute Of Advanced Industrial Science & Technology 頭部運動による入力装置及び方法
US9067097B2 (en) * 2009-04-10 2015-06-30 Sovoz, Inc. Virtual locomotion controller apparatus and methods
US20100302253A1 (en) * 2009-05-29 2010-12-02 Microsoft Corporation Real time retargeting of skeletal data to game avatar
US9400559B2 (en) * 2009-05-29 2016-07-26 Microsoft Technology Licensing, Llc Gesture shortcuts
US20100302138A1 (en) * 2009-05-29 2010-12-02 Microsoft Corporation Methods and systems for defining or modifying a visual representation
KR20100138700A (ko) * 2009-06-25 2010-12-31 삼성전자주식회사 가상 세계 처리 장치 및 방법
US9159151B2 (en) * 2009-07-13 2015-10-13 Microsoft Technology Licensing, Llc Bringing a visual representation to life via learned input from the user
TW201104494A (en) * 2009-07-20 2011-02-01 J Touch Corp Stereoscopic image interactive system
KR101993848B1 (ko) * 2009-07-22 2019-06-28 임머숀 코퍼레이션 플랫폼에 걸쳐 햅틱 피드백을 갖는 상호작용 터치 스크린 게임 메타포
CN102141685B (zh) * 2009-11-29 2016-02-24 黄得锋 一种3d成像装置
US8284157B2 (en) * 2010-01-15 2012-10-09 Microsoft Corporation Directed performance in motion capture system
US20110221755A1 (en) * 2010-03-12 2011-09-15 Kevin Geisner Bionic motion
US20110289455A1 (en) * 2010-05-18 2011-11-24 Microsoft Corporation Gestures And Gesture Recognition For Manipulating A User-Interface
CN107050852A (zh) * 2011-02-11 2017-08-18 漳州市爵晟电子科技有限公司 一种游戏系统及其穿套式定点控制设备
CN202120199U (zh) * 2011-06-13 2012-01-18 深圳市远望落星山科技有限公司 一种光影跟踪系统
CN102253713B (zh) * 2011-06-23 2016-10-12 康佳集团股份有限公司 面向三维立体影像显示系统

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7205979B2 (en) * 1987-03-17 2007-04-17 Sun Microsystems, Inc. Computer data entry and manipulation apparatus and method
US5577981A (en) * 1994-01-19 1996-11-26 Jarvik; Robert Virtual reality exercise machine and computer controlled video system
US5913727A (en) * 1995-06-02 1999-06-22 Ahdoot; Ned Interactive movement and contact simulation game
CN1231753A (zh) * 1996-08-14 1999-10-13 挪拉赫梅特·挪利斯拉莫维奇·拉都色夫 追踪并显示使用者在空间的位置与取向的方法,向使用者展示虚拟环境的方法以及实现这些方法的系统
CN101890237A (zh) * 2010-07-16 2010-11-24 叶尔肯·拜山 游戏控制器及其控制方法

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
See also references of EP2674204A4

Also Published As

Publication number Publication date
JP6722624B2 (ja) 2020-07-15
US10058773B2 (en) 2018-08-28
JP2019061707A (ja) 2019-04-18
CN106984041B (zh) 2021-07-06
CN102631781A (zh) 2012-08-15
CN106943743B (zh) 2024-04-26
CN106943743A (zh) 2017-07-14
CN106964150A (zh) 2017-07-21
KR20140049503A (ko) 2014-04-25
JP2018022498A (ja) 2018-02-08
JP6193764B2 (ja) 2017-09-06
CN102631781B (zh) 2017-04-05
US20130331964A1 (en) 2013-12-12
EP2674204A1 (en) 2013-12-18
EP2674204A4 (en) 2015-01-28
CN102681655B (zh) 2017-07-07
CN106943742A (zh) 2017-07-14
CN102541260B (zh) 2013-04-03
CN106984041A (zh) 2017-07-28
CN106964150B (zh) 2021-03-02
JP6749384B2 (ja) 2020-09-02
JP2014510336A (ja) 2014-04-24
CN102681655A (zh) 2012-09-19
KR101679805B1 (ko) 2016-11-25
CN106943742B (zh) 2024-04-26
EP3950076A1 (en) 2022-02-09
CN102541260A (zh) 2012-07-04
CN107050852A (zh) 2017-08-18

Similar Documents

Publication Publication Date Title
WO2012106978A1 (zh) 一种人机互动的控制方法及其运用
Caserman et al. A survey of full-body motion reconstruction in immersive virtual reality applications
CN106980385B (zh) 一种虚拟装配装置、系统及方法
Ma et al. Hand rehabilitation learning system with an exoskeleton robotic glove
US11262841B2 (en) Wireless wrist computing and control device and method for 3D imaging, mapping, networking and interfacing
CN103019386B (zh) 一种人机互动的控制方法及其运用
CN109453509A (zh) 一种基于肌电和运动捕捉的虚拟上肢控制系统及其方法
Wang et al. Feature evaluation of upper limb exercise rehabilitation interactive system based on kinect
CN110404243A (zh) 一种基于体态测量的康复方法及康复系统
Du et al. A mobile gesture interaction method for augmented reality games using hybrid filters
Yeh et al. An integrated system: virtual reality, haptics and modern sensing technique (VHS) for post-stroke rehabilitation
Cloud et al. Experiments with a camera-based human-computer interface system
Ni et al. A solution of human-computer remote interaction with tactile feedback
Sawant et al. Use of Artificial Intelligence Systems for Hand Motor Recovery in Stroke: A Narrative Review
Jirina Overview of Controllers of User Interface for Virtual Reality
Hernoux et al. Is a Time-Of-Flight Camera Better than a Mouse for 3D Direct Selection in Virtual Worlds?
NAN DEVELOPMENT OF A COMPUTER PROGRAM TO ASSIST UPPER LIMB REHABILITATION USING KINECT
CN121927256A (zh) 脑卒中患者上肢运动康复训练系统
Chaplygin et al. Augmented Reality Application for Hand Motor Skills Rehabilitation
Tripicchio Virtual Reality Sports Training.
Gieser et al. Pot hunter: A virtual reality game for analyzing range of motion
HK40009363A (en) Wireless wrist computing and control device and method for 3d imaging, mapping, networking and interfacing

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 12745158

Country of ref document: EP

Kind code of ref document: A1

ENP Entry into the national phase

Ref document number: 2013552821

Country of ref document: JP

Kind code of ref document: A

NENP Non-entry into the national phase

Ref country code: DE

WWE Wipo information: entry into national phase

Ref document number: 2012745158

Country of ref document: EP

ENP Entry into the national phase

Ref document number: 20137023483

Country of ref document: KR

Kind code of ref document: A