JP2009153583A - Human body action-sensing electronic-game controller - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide a user control interface in an electronic game, which is more perfect and delicate, by connecting an image sensing input module with an inertia sensing input module to sense user's various body actions or motion states. <P>SOLUTION: The human body action-sensible electronic-game controller includes the inertia sensing input module, the image sensing input module and a control unit. The image sensing input module receives an image of user's body silhouette, discriminates it and generates signals representing user's shift or the specified position. The inertia sensing input module senses user's body action and generates signals for a rotation, a rhythm, a swing or a force, representing the action. The control unit receives these signals, arranges them and generates control signals to control a specified cursor on an electronic-game display screen. <P>COPYRIGHT: (C)2009,JPO&INPIT

Description

  The present invention relates to an electronic game controller capable of sensing human body movements, and in particular, can sense human body movements by sensing various movements of the user and allowing the user to operate and control specific indicators on the electronic game display screen. The present invention relates to an electronic game controller.

  With the rapid development of electronic elements and software development, new electronic game control interfaces have appeared one after another, and users are not limited to traditional control panels and hand-held levers, but users can play electronic games. In order to improve the interactive enjoyment of time, it is necessary to have a complete user control interface.

  Conventionally, a method in which an inertial sensing element senses a user's movement and operates a specific cursor on a display screen is performed by the user wearing the inertial sensing element or holding the inertial sensing element by hand, The signal is generated while being detected by the inertial sensing element. However, the user's movement, such as displacement, posture or hand movement, is difficult to identify and detect by the conventional inertial sensing element, and usually the user operates another controller (for example, control lever) It is necessary to input and control these signals representing the user's displacement.

  Conventionally, a method of operating a specific cursor on a display screen by receiving a change in a user's body contour is, for example, receiving a user's body image with an image receiving unit of a video camera, and other electronic elements or software operations In processing, the image identifies changes in simulation plane coordinates. For example, when the image moves up, down, left and right on the simulation plane coordinates, a specific cursor on the display screen can be operated and controlled to generate up, down, left and right movement. For example, when an image is enlarged or reduced, a specific cursor on the display screen can be operated and controlled like forward or backward. However, more video cameras will receive changes in the user's body profile if they try to sense more user movements, such as rotation, disciplined movement, amount of swing or force. Furthermore, it is necessary to perform enormous image digitization and image signal calculation processing. As a result, the response of the specific cursor is greatly delayed, the sharpness is insufficient, a good real-time control characteristic cannot be achieved, and the number and cost of electronic equipment such as image reception or image processing must be increased.

  Therefore, the present inventor was impressed that the above-mentioned defects could be improved, and made extensive observations and researches based on the experience accumulated in this area since many years. The present invention has been proposed which can be improved effectively.

  The main object of the present invention is to provide a more complete electronic game control interface for a user and control a specific cursor on an electronic game display screen by combining a method for sensing one or more types of user actions. An electronic game controller capable of sensing human body movements is provided.

  In order to achieve the above object, the present invention provides an electronic game controller capable of sensing a human body motion for sensing a contour and motion of a user and generating a signal to control a specific cursor on an electronic game display screen. , An inertial sensing module that senses a user's motion acceleration and angular velocity and generates a signal; and a sensing signal calculation that receives the signal from the inertial sensing module and generates an acceleration and angular velocity signal representative of the user's motion An inertial sensing input module having a unit and a wireless transfer module that receives a signal from the sensing signal calculation unit and outputs a signal in a wireless transfer method, and receives an image of all or part of a user's body contour Receiving the image received by the image receiving unit. And an image sensing input module having an image signal calculation unit that digitizes an image, identifies an image change on a time axis, and outputs a signal representative of a user's body displacement, and the wireless transfer module And a control unit for receiving and aligning signals from the image signal arithmetic unit, generating a control signal, and controlling a specific cursor on the electronic game display screen by the control signal. Is an electronic game controller capable of sensing

  The present invention has the following advantageous effects.

  The inertial sensing input module senses the acceleration and angular velocity generated by the user's body, generates a motion signal such as rotation of the user's movement, rhythm, hand shake or amount of force, and is responsive. Not only does it have high features, it also meets the needs of real-time control.

  The image sensing input module receives an image of the user's body contour, and further generates a signal representative of the user's body displacement or special posture by image processing and calculation. Therefore, the user can observe his / her displacement while viewing the electronic game display screen and reacts based on the game content in real time, so that the user can play according to the content of the interactive electronic game. .

  Also, by matching the signals from the inertial sensing input module and the image sensing input module by the control unit, the present invention is highly responsive and can simultaneously meet the needs of real-time control. The apparatus can be simplified, the inertial sensing input module and the image sensing input module can assist and align with each other, and the present invention provides a more complete and detailed electronic game control interface when a user plays an electronic game. The fun of interactive simulation can be further improved.

  It is believed that the features and technical contents of the present invention can be understood more deeply by referring to the detailed description and the accompanying drawings below, but the above drawings are used only for reference and explanation, and It is not limited.

  FIG. 1 shows an embodiment of an electronic game controller capable of sensing a human body motion according to the present invention. As shown in FIG. 1, the motion and contour of a user are sensed and a signal is generated to generate an electronic game. An electronic game controller capable of sensing a human body motion for controlling a specific cursor on a display screen, and includes an inertial sensing input module 1, an image sensing input module 2, and a control unit 3.

  The inertial sensing input module 1 includes an inertial sensing module 11, a sensing signal calculation unit 12, and a wireless transfer module 13.

  The inertial sensing module 11 generates a signal by sensing the acceleration and angular velocity of the movement of the user's body along the X, Y, and Z axes. In the present embodiment, the inertial sensing module 11 is disposed near the center of gravity of the user's body (for example, the waist) or is held by the user's hand. The inertial sensing module 11 includes at least one accelerometer or at least one gyroscope.

  The sensing signal calculation unit 12 receives a signal from the inertial sensing module 11, and generates an acceleration and angular velocity signal representative of the user's center of gravity or limb through calculation processing.

  The wireless transfer module 13 receives a signal generated by the sensing signal calculation unit 12 and further transfers the signal to the control unit 3 by a wireless transfer method.

  The image sensing input module 2 includes an image receiving unit 21 and an image signal calculation unit 22. The image receiving unit 21 is one or a plurality of video cameras, and is installed facing the user. For example, the image receiving unit 21 is installed at the front, upper, left and right sides or the rear where the user faces the electronic game display screen, or is installed at one or more locations around the user in accordance with the head mounted display. You may do it. Thus, the image receiving unit 21 is directed to the user and receives an image of all or a part (for example, a face) of the user's body contour. The user's body image received from the image receiving unit 21 is further transferred to the image signal calculation unit 22 to digitize the image and define it within the plane reference coordinates.

  The image signal computation unit 22 computes the user's image defined in the plane reference coordinates, identifies the change of the image with respect to the time axis on the plane reference coordinates, and the user's body is left, right, top, When moving down, front, back, or when the posture is changed or the hand is moved, the image defined in the plane reference coordinates is the corresponding left, right, up, down displacement, area enlargement or reduction, or shape Changes. The image signal calculation unit 22 further represents the left, right, up, down, front and back displacement of the user's body, or a special posture and hand movement based on the change in the plane reference coordinates. Generate a signal.

  The control unit 3 receives signals from the sensing signal calculation unit 12 (via transfer of the wireless transfer module 13) and the image signal calculation unit 22, respectively, and aligns both signals in accordance with the time axis, and Control signals corresponding to various operations are generated. For example, the control unit 3 can process a signal from the sensing signal calculation unit 12 and generates a control signal representative of a movement state such as rotation of the user's body, rhythm (for example, running), swing or ability, Alternatively, it is possible to simultaneously generate a control signal representative of the displacement or posture change of the user by combining the signals from the image signal calculation unit 22.

  When the user further uses the present invention to play an interactive electronic game in accordance with a game host or personal computer, the inertial sensing input module 1 and the image sensing input module 2 sense a user's movement signal, A specific cursor on the electronic game display screen can be controlled by a control signal generated by the control unit 3, and the specific cursor can simulate various movements or motion states of the user's body.

  FIG. 2 shows another embodiment of the present invention. In this embodiment, a user is playing an interactive electronic game that simulates a tennis movement using the present invention, and the user has a game lever 4 equipped with an inertial sensing input module 1. The image receiving unit 21 is two video cameras 5, and the two video cameras 5 are installed in front and above when the user faces the electronic game display screen. That is, it is directed to the user at one location above the display device 6 and above the user's head.

  In this manner, the inertial sensing input module 1 mounted in the game lever 4 detects movements of the user's hand, rotation, and the like by the inertial sensing module 11 and generates a signal. The sensing signal calculation unit 12 receives a signal from the inertial sensing module 11, and generates a signal representative of an operation such as a user's hand shake or rotation through calculation processing. The wireless transfer module 13 receives a signal generated by the sensing signal calculation unit 12 and transfers the signal to the control unit 3 mounted in the personal computer 7.

  The video camera 5 provided in front of the user (upper side of the display device) receives the image of the body contour of the user, and further transfers the image to the image signal calculation unit 22 mounted in the personal computer 7, After the arithmetic processing of the signal arithmetic unit 22, the user identifies and generates a signal representative of the left-right displacement that opposes the display screen. Similarly, the video camera 5 provided at one location above the user's head also receives the image of the body contour of the user, and further transfers the image to the image signal calculation unit 22 and passes through the calculation process. A signal representative of the longitudinal displacement facing the display screen is identified and generated. Signals generated by the sensing signal calculation unit 12 (via transfer of the wireless transfer module 13) and the image signal calculation unit 22 are all transferred to the control unit 3.

  The control unit 3 aligns these signals according to the time axis, generates control signals corresponding to various operations of the user, controls a specific cursor that is positioned on the display screen and represents the user, Simulate various movements and movements when a user plays tennis. This provides the user with the pleasure of playing tennis in pairs with a person at a real tennis court.

  FIG. 3 shows another embodiment of the present invention. The control unit 3 further includes a control selection module 31. The control selection module 31 receives a control command from a user or electronic game software, generates a signal to the control unit 3, and the control unit 3 receives all or part of the inertial sensing input module 1 and the image sensing input module 2. It is converted so that only the signal can be received. The control unit 3 has different signal reception modes, for example, 1) Only one input module can input a signal. That is, only the signals of the inertial sensing input module 1 or the image sensing input module 2 can be input. 2) A signal is input by an input module that senses the signal preferentially. 3) A signal can be input simultaneously by both input modules. The user can change the sensing or signal input method according to the contents of the electronic game or operation habits.

  As can be seen from the embodiments of the present invention described above, the inertial sensing input module 1 senses the acceleration and angular velocity generated by the user's body, and rotates the user's body motion, rhythm, hand swing or force. It not only has the feature of generating high responsiveness, but also meets the needs of real-time control.

  The image sensing input module 2 is a method of receiving an image of the user's body contour, and further generates a signal representative of the user's body displacement or special posture through image processing and calculation, and the user displays an electronic game display screen. The user can observe his / her displacement while watching the game, reacts based on the game content in real time, and can play according to the game content when the user plays the interactive electronic game.

  Further, by matching the signals from the inertial sensing input module 1 and the image sensing input module 2 by the control unit 3, the present invention can be provided with the need for real-time control with high responsiveness. Therefore, the inertial sensing input module 1 and the image sensing input module 2 can assist and align with each other. As a result, the present invention can further enhance the fun of interactive simulation when a user plays an electronic game as a more complete and detailed electronic game control interface.

  However, the foregoing description is merely a detailed description of the preferred specific embodiments and drawings of the present invention, and does not limit the scope of the claims of the present invention. Any expert who has ordinary knowledge in the field, who should be based on the scope of the claims, can make appropriate changes or modifications within the field of the present invention. It goes without saying that it should be delivered within the scope.

It is a block diagram which shows the structure of the electronic game controller which can sense a human body movement. It is a figure which shows the other Example of the electronic game controller which can sense a human body movement. It is a figure which shows the other Example of the electronic game controller which can sense a human body movement.

Explanation of symbols

DESCRIPTION OF SYMBOLS 1 Inertial sensing input module 2 Image sensing input module 3 Control unit 11 Inertial sensing module 12 Sensing signal operation unit 13 Wireless transfer module 21 Image receiving unit 22 Image signal operation unit 31 Control selection module 4 Game lever 5 Video camera 6 Display device 7 Personal computer

Claims (5)

An electronic game controller capable of sensing a human body motion for sensing a user's outline and motion and generating a signal to control a specific cursor on the electronic game display screen,
It consists of an inertial sensing input module, an image sensing input module, and a control unit.
The inertial sensing input module
An inertial sensing module that generates a signal by sensing the acceleration and angular velocity of the user's movement;
A sensing signal computing unit that receives signals from the inertial sensing module and generates acceleration and angular velocity signals representative of the user's movements;
A wireless transfer module that receives a signal from the sensing signal calculation unit and outputs a signal by a wireless transfer method;
The image sensing input module
An image receiving unit for receiving an image of all or part of a user's body contour;
An image signal calculation unit that receives the image received by the image receiving unit and digitizes the image, and that identifies a change in the image on the time axis and outputs a signal representative of the user's body displacement; ,
The control unit
Receiving and aligning signals from the wireless transfer module and the image signal arithmetic unit, generating a control signal, and controlling a specific cursor on the electronic game display screen by the control signal, capable of sensing human movement Electronic game controller.   The electronic game controller according to claim 1, wherein the inertial sensing input module is mounted on a game lever.   The electronic game controller according to claim 1, wherein the inertial sensing module includes at least one accelerometer or at least one gyroscope.   The electronic game controller according to claim 1, wherein the image receiving unit includes one or a plurality of video cameras. The control unit further includes a control selection module;
The control selection module receives a user or electronic game command, generates a signal to the control unit, and the control unit receives only all or a part of the signals from the inertial sensing input module and the image sensing input module. 2. The electronic game controller capable of sensing a human body motion according to claim 1, wherein the electronic game controller cannot sense.

Images