WO2018020212A1 - Control module for computer entertainment system - Google Patents

Control module for computer entertainment system Download PDF

Info

Publication number
WO2018020212A1
WO2018020212A1 PCT/GB2017/052050 GB2017052050W WO2018020212A1 WO 2018020212 A1 WO2018020212 A1 WO 2018020212A1 GB 2017052050 W GB2017052050 W GB 2017052050W WO 2018020212 A1 WO2018020212 A1 WO 2018020212A1
Authority
WO
WIPO (PCT)
Prior art keywords
control
control module
game
data
signals
Prior art date
Application number
PCT/GB2017/052050
Other languages
French (fr)
Inventor
Sachin Patel
Original Assignee
Mvr Global Limited
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Mvr Global Limited filed Critical Mvr Global Limited
Publication of WO2018020212A1 publication Critical patent/WO2018020212A1/en

Links

Classifications

    • A—HUMAN NECESSITIES
    • A63—SPORTS; GAMES; AMUSEMENTS
    • A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
    • A63F13/00—Video games, i.e. games using an electronically generated display having two or more dimensions
    • A63F13/20—Input arrangements for video game devices
    • A63F13/21—Input arrangements for video game devices characterised by their sensors, purposes or types
    • A63F13/211—Input arrangements for video game devices characterised by their sensors, purposes or types using inertial sensors, e.g. accelerometers or gyroscopes
    • A—HUMAN NECESSITIES
    • A63—SPORTS; GAMES; AMUSEMENTS
    • A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
    • A63F13/00—Video games, i.e. games using an electronically generated display having two or more dimensions
    • A63F13/20—Input arrangements for video game devices
    • A63F13/21—Input arrangements for video game devices characterised by their sensors, purposes or types
    • A63F13/212—Input arrangements for video game devices characterised by their sensors, purposes or types using sensors worn by the player, e.g. for measuring heart beat or leg activity
    • A—HUMAN NECESSITIES
    • A63—SPORTS; GAMES; AMUSEMENTS
    • A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
    • A63F13/00—Video games, i.e. games using an electronically generated display having two or more dimensions
    • A63F13/20—Input arrangements for video game devices
    • A63F13/22—Setup operations, e.g. calibration, key configuration or button assignment
    • A—HUMAN NECESSITIES
    • A63—SPORTS; GAMES; AMUSEMENTS
    • A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
    • A63F13/00—Video games, i.e. games using an electronically generated display having two or more dimensions
    • A63F13/25—Output arrangements for video game devices
    • A63F13/26—Output arrangements for video game devices having at least one additional display device, e.g. on the game controller or outside a game booth
    • A—HUMAN NECESSITIES
    • A63—SPORTS; GAMES; AMUSEMENTS
    • A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
    • A63F13/00—Video games, i.e. games using an electronically generated display having two or more dimensions
    • A63F13/40—Processing input control signals of video game devices, e.g. signals generated by the player or derived from the environment
    • A63F13/42—Processing input control signals of video game devices, e.g. signals generated by the player or derived from the environment by mapping the input signals into game commands, e.g. mapping the displacement of a stylus on a touch screen to the steering angle of a virtual vehicle
    • A63F13/428—Processing input control signals of video game devices, e.g. signals generated by the player or derived from the environment by mapping the input signals into game commands, e.g. mapping the displacement of a stylus on a touch screen to the steering angle of a virtual vehicle involving motion or position input signals, e.g. signals representing the rotation of an input controller or a player's arm motions sensed by accelerometers or gyroscopes

Definitions

  • This invention relates generally to a control module for use with a computer entertainment system for enhancing compatibility thereof with a head-mounted display.
  • Head-mounted displays of various types are known, and typically comprise a video display screen and means of mounting the display screen in front of a wearer's eyes.
  • increasing development within the gaming industry has resulted in systems which provide a user with a virtual reality experience by including a head-mounted display wherein the game footage is displayed on the display screen in front of, and close to, the wearer's eyes, with the object of fully immersing the user in the virtual reality world generated as the game is being played.
  • WO2014/108693 describes a more cost-effective and flexible solution comprising a head-mounted display including attachment means for removably securing a display screen therein such that it is located in front of the user's eyes, in use; and, optionally, speakers located in the headset and located near the wearer's ears, in use, for outputting game sounds.
  • the video display screen may, for example, be provided in the form of a stand-alone mobile phone or portable gaming device.
  • the video display screen may be configured to receive (wirelessly or otherwise) and display video data representative of game progression from the main game control box. In all cases, however, a separate, hand-held controller is required to be provided to enable the user to manipulate all aspects of the game.
  • a typical controller for this purpose is illustrated in Figure 1 of the drawings, and comprises a gamepad 110 including conventional control input devices, such as joysticks or thumb sticks 111 and buttons 113.
  • the gamepad 110 further comprises an inertial sensor 112, which is typically an accelerometer and gyroscope, that produces signals in response to the position, motion, orientation or change in orientation of the gamepad 110.
  • signals from the inertial sensor 112 are used to generate position and orientation data for the gamepad 110, and such data may be used to calculate many physical aspects of the gamepad 110, such as for example, its acceleration and velocity, along any axis, its tilt, pitch, yaw, roll, as well as any telemetry points of the gamepad 110.
  • the manner in which a user physically moves the gamepad 110 can be used as another input for controlling the game.
  • one of the joysticks 111 may be used to move the player's avatar through the game, whilst movement of the gamepad 110 (i.e. data from the inertial sensor 112) may be used to selectively alter the player's field of view within the game footage (e.g. 'looking' left and right within a scene).
  • the user is able to select, within the computer game setup, which aspects of the game are controlled by each of the control input devices, in accordance with personal preference.
  • US 2014/0364209 describes a virtual reality game system having a head-mounted display and a hand-held gamepad includes at least one control input device, manipulation of which causes corresponding control signals to be generated and transmitted to the game control box, for example, to cause the player's avatar to move around within the game scene and/or effect operations such as shooting.
  • An inertial sensor is provided on the head-mounted display for generating signals corresponding to movement of the user's head, and such signals are transmitted to the game control box and converted into control signals to change the player' s field of view of the game scene.
  • the player may turn their head to the left, causing a corresponding signals to be sent from the inertial sensor to the game control box.
  • the processor in the control box converts the movement signal to a control signal and causes the game player's field of view, as displayed on the screen, to change as if their avatar was looking to its left.
  • the processor in the control box itself i.e. the main game control unit, must be configured to receive and process the inertial sensor signals in order to cause associated manipulation of the game.
  • the resultant system is an integrated system, pre-programmed to include all control features.
  • a user wishes to employ a head-mounted display with an existing system, configured only to respond to a hand-held gamepad control input, there is currently no facility to enable them to experience the full virtual reality game experience offered by inertial sensor technology on the head-mounted display itself.
  • a control module for a computer entertainment system including a unit for executing and running a computer game and causing game footage to be generated, said unit being configured to receive, from a controller, control signals representative of manipulation of said game and dynamically adjust said game footage accordingly; said control module comprising a processor, a user interface, a plurality of inputs and at least one output, one or more of said plurality of inputs being configured to receive control data from one or more respective control input devices of a controller (e.g.
  • said user interface being configured to receive a user input to select a control input device communicably coupled to an input to be associated with said inertial sensor
  • said processor being configured to perform a calibration function by: receiving control signals from said selected control input device, generated in response to user manipulation thereof, to generate control input manipulation data; and mapping inertial sensor data onto said control input manipulation data to generate respective calibration data; the processor further comprising a conversion module for receiving motion signals representative of movement of said inertial sensor and converting, using said calibration data, said signals into control signals for manipulating said computer game, said control signals being of the same format as control signals otherwise generated by said selected control input device in response to user manipulation thereof.
  • the selected control input device may be an analog control input device configured to generate analog control signals representative of user manipulation thereof.
  • the control module may include an analog switch for receiving said analog control signals and converting them to corresponding digital control signals.
  • the processor may receive said digital control signals, generate therefrom said control input manipulation data and map said inertial sensor data onto said control input manipulation data to generate digital calibration data, further comprising a digital to analog conversion module for receiving control digital control signals from said conversion module, and converting said control signals to corresponding analog control signals for manipulating said computer game.
  • the analog control signals obtained from said control input device may be any one of the analog control signals obtained from said control input device.
  • the processor may be configured to derive data representative of one or more upper limits of movement of said selected control input device and calculate therefrom data
  • the processor may be configured to map data representative of one or more upper limits of movement of said inertial sensor onto said data representative of one or more upper limits of movement of said selected control input device to generate said calibration data.
  • the processor may be configured to map data representative of a central or neutral position of said inertial sensor onto said data representative of said central or neutral position of said selected control input device to generate said calibration data.
  • control module nay be configured to operate in a head tracking mode, wherein movement of said inertial sensor is converted, using said calibration data, into control signals representative of corresponding movement of said selected control input device.
  • control module may be configured to operate in a fixed body head tracking mode, wherein a velocity and direction of movement of said inertial sensor is determined and converted, using said calibration data, into a brief movement of said selected control input device, wherein an extent of said brief movement is dependent on said velocity.
  • the control module may include a memory configured to store a plurality of game profiles, each game profile comprising respective calibration data.
  • the control module may include a graphical user interface configured to receive user input defining a user-defined game profile, said memory being configured to store, for subsequent user selection, said user-defined game profile.
  • This allows each user of a hand-held controller (including a control module of an exemplary embodiment of the invention) to define their own customised settings for each game.
  • the user can modify existing game profiles or create new ones via the above-mentioned graphical user interface, which provides for enhanced game manipulation.
  • Each game profile may further comprise a respective mode of tracking to define a manner of converting said motion signals into control signals for manipulating said computer game.
  • a display may be included for displaying a current game profile.
  • the processor may be configured to generate display data configured to display on said display said user interface.
  • the display may include touch sensitive user input means.
  • the processor may be configured to receive, wirelessly or otherwise, data representative of settings or configurations of a control input device and/or mode of operation thereof in respect of a game, to enable said control module to generate said calibration data in respect thereof.
  • a handheld gamepad for a computer entertainment system including a control module substantially as described above.
  • the control module may be removably mounted and communicably coupled thereto via a communications interface.
  • Figure 1 is a plan view of a hand-held game controller according to the prior art
  • Figure 2 is a plan view of a hand-held game controller having mounted thereon, and communicably coupled therewith, a control module according to an exemplary embodiment of the present invention
  • Figure 2A is a perspective view of a hand-held game controller, having an integral control module according to another exemplary embodiment of the present invention
  • Figure 3 is a schematic block diagram of principal aspects of a computer
  • control module according to an exemplary embodiment of the present invention
  • Figure 4 is a schematic perspective view of a head-mounted display device for use with the computer entertainment of Figure 3;
  • FIG. 5 is a schematic diagram illustrating the principal components of a control module according to an exemplary embodiment of the present invention.
  • Figure 6A is a schematic diagram illustrating the principal aspects of a control system including a control module according to an exemplary embodiment of the present invention
  • Figure 6B is a schematic diagram illustrating the principal aspects of another control system including a control module according to an exemplary embodiment of the present invention.
  • Figure 7 is a schematic illustration of the range and axes of head movement for which a head-mounted sensor for use in an exemplary embodiment of the present invention is configured.
  • a hand-held gamepad 10 of a known type on which is mounted a control module 12 according to an exemplary embodiment of the present invention.
  • the gamepad 10 itself includes conventional control input devices, such as right and left thumb sticks 14 and buttons 16.
  • the gamepad 10 would typically also comprise an internal inertial sensor (not shown), which is typically an accelerometer and gyroscope, that produces signals in response to the motion, position, orientation or change in orientation of the gamepad 10, as previously described.
  • the control module 12 is mounted on the gamepad 10 via a socket (not shown) that provides a communications interface between the control module 12 and the control circuitry within the gamepad 10.
  • the control module 12 may be mounted on the gamepad 10, dependent (at least partly) on the configuration of the specific game pad.
  • the control module 12 may be built or integrated into the gamepad 10, as illustrated in Figure 2A of the drawings, wherein the control module 12 (depicted in terms of the display screen 514 and the buttons 516) is integrated into the rear surface of the gamepad 10, within the central body portion 10a.
  • the gamepad 10 has a central body portion 10a, flanked by a pair of opposing handle portions 10b, and the socket for
  • receiving/mounting the control module 12 thereon is located on a lower side wall of the central body portion 10a (i.e. a side wall nearest the user, when in use), generally centrally between the handle portions 10b.
  • a computer entertainment system of the type in which an exemplary embodiment of the present invention may be used comprises a head- mounted display (HMD) 100, a system control unit 104 and a hand-held controller 10, for example of the type described above.
  • the system control unit 104 may be provided in a conventional manner (i.e. as a games console or PC for example), with game footage being transposed or streamed, wirelessly or otherwise, onto a screen, portable (i.e. removable) or otherwise, within the HMD 100.
  • gaming systems exist wherein game footage etc.
  • a compatible portable device such as a mobile phone or hand-held gaming console, including an integrated screen
  • the HMD may be configured such that the portable device can be mounted therein, for use.
  • the screen within the HMD 100 has associated therewith a mobile application, herein after referred to as a 'smartphone remote display app' 103 (see Figures 6A and 6B hereinafter).
  • a mobile application herein after referred to as a 'smartphone remote display app' 103 (see Figures 6A and 6B hereinafter).
  • the screen is provided in the form of a mobile computing device, such as a smartphone, tablet or smart games console, the app may be provided within the device itself. However, if the screen is a passive device, the app may be running on a separate device, such as a smartphone, PC/console or any other device communicably coupled (wired or wirelessly) to the screen.
  • the remote display app 103 is a smartphone application configured to connect (wirelessly) to a console/PC control box, and cause graphics from the console/PC control box to be displayed on a mobile computing device, such as a smartphone or tablet display. Examples of such apps will be known to a person skilled in the art, and it will be appreciated that the remote display app offers, wirelessly, the equivalent functionality of a hard wired connection (HDMI or USB) between the console/PC control box and the mobile computing device.
  • HDMI hard wired connection
  • an exemplary HMD 100 comprises a main housing 212, rigid side members 214, speakers 216 and an adjustable/flexible band 218.
  • the housing 212 has a rear open end 220 for fitting over the eyes of a wearer, a front end 222, a top 224, a bottom 226 and two lateral sides 228, 230. In use, the housing 212 extends outwardly from the front of the wearer's face.
  • Rigid side members 214 are attached to the housing 212, one side member being attached to each lateral side 228, 230, and each side member extending rearwardly, that is, in the direction of the open end 220 and substantially parallel with the lateral sides 228, 230.
  • the rigid side members 214 pass either side of the wearer's head, so that the device fits onto the wearer's face in a similar manner to a pair of spectacles.
  • the extent of side members between the speakers 216 and the main housing 212 may be adjustable for fitting to differently-sized heads, and the flexible band 218 may be shortened to secure the device once it has been fitted over a wearer's head.
  • the main housing 212 contains a removable cassette 246, which is received within slot 248 in the top 224 of the main housing.
  • Slot 248 extends across the entire width of the housing 212, from the lateral side 228 to the other 230.
  • the edges of the main housing 212 are curved, so the slot in the top 224 of the housing also extends some distance down the lateral sides 228, 230 of the main housing 212.
  • WO2014/108693 describes in detail the configuration of one suitable removable cassette of this type, although others are envisaged, and specific features thereof will not be described further herein. It will be understood by a person skilled in the art that any HMD configured to receive a portable screen or device including an integrated screen is suitable for use in various aspects of the present invention.
  • the portable screen or device is secured, in use, within the removable cassette 246 and an audio cable (not shown) may be provided for connecting the electronic audio source of the portable device, which feeds the audio signal to the speakers 216 for reproduction.
  • the cassette 246 carrying the portable device 610 may be inserted into the slot 224 of the main housing 212 such that, when the HMD 100 is secured on the user's head, over their eyes, the images on the screen of the portable device 610 are viewable.
  • a control module 12 comprises a housing 510 defining a communications interface or 'plug' (not shown) to communicably couple (removably, in this case) the control module 12 to a hand-held controller or gamepad, via a socket provided thereon.
  • the control module 12 comprises, within the housing a microprocessor 512, an OLED display 514, and one or more push buttons 516 (in this exemplary embodiment two push buttons 516 are provided just below the display 514 - see Figure 2 - but the present invention is not necessarily intended to be limited in this regard).
  • the control module further comprises an analog switch 518 and a digital-to-analog conversion (DAC) module 520.
  • DAC digital-to-analog conversion
  • the microprocessor 512 receives as inputs (via the communications interface with the hand-held controller to which it is coupled), signals (522) from the left and right trigger control input devices, signals (524) from the left and right bumper control input devices, a USB connection 528 and one or more head mounted sensors 530.
  • the head mounted sensors may be one or more of an accelerometer or gyroscope, housed within a module configured to mounted at the rear of the user's head.
  • the head mounted sensors 530 may be connected to the microprocessor 512 in the control module 12 by a hard wired or wireless connection, and the present invention is not necessarily intended to be limited in this regard.
  • the analog switch 518 has, as an input, signals 532 from the analog control input devices on the hand-held controller, namely the joysticks or thumb sticks, and acts to convert the analog signals therefrom into corresponding digital signals for input to the microprocessor 512. Similarly, digital control signals generated by the microprocessor (derived from the head-sensor signals) are converted by the DAC module 520 into corresponding analog signals and output, via the analog switch 518 as "analog stick outputs" 534.
  • game footage is streamed to a smartphone or tablet mounted in a head mounted display of the type described above.
  • the head mounted display may also include means for enabling the head-mounted sensor module to be mounted thereon, at the rear of the user's head, or the head-mounted sensor module may even be integrally provided therein, although the present invention is not necessarily intended to be limited in this regard, and the head-mounted sensor module may, instead, have a separate mounting means for enabling it to be mounted on the user's head, at the rear or otherwise.
  • the head-mounted sensor module may be connected by a wire (for power and communication) to the control module 12, but it may alternatively be internally powered and then communicably coupled wirelessly to the control module in alternative exemplary embodiments.
  • the display 514 may be configured to display to a user which game profile is active, and touch- sensitive control means, buttons, visual/audio/physical or any other means may be provided to facilitate a user interface for selecting and/or reconfiguring a control profile, depending on the user's preference and/or the specific game that is to be played.
  • touch- sensitive control means, buttons, visual/audio/physical or any other means may be provided to facilitate a user interface for selecting and/or reconfiguring a control profile, depending on the user's preference and/or the specific game that is to be played.
  • Different computer games utilise the control input devices in different respective ways, depending on the nature of the game, and the game software itself determines how the control inputs of the hand-held controller will be interested and actioned within the game footage.
  • the analog control input devices i.e. the joysticks thumb sticks
  • thumbstick If the thumbstick is pushed in a particular direction, the avatar moves in that direction, until the thumbstick is moved in another direction.
  • This type of control will be referred to hereinafter as "head tracking".
  • the thumbstick In other games, such as driving games, the thumbstick is used for brief changes of the player's field of view, with the game footage view returning to centre quickly after the avatar has "looked" to one side or the other, for example, and the thumb stick has been released.
  • 'fixed body tracking' This type of control will be referred to hereinafter as 'fixed body tracking'.
  • control module 12 that enables the head mounted sensor(s) to be used as a control input instead of one of the physical control input devices on the hand-held controller for a specific computer entertainment system and in respect of a specific game or game type.
  • the control module 12 includes a programmable microchip for receiving and saving control input 'profiles' selected and saved for a specific user and/or for specific games or game types.
  • control module (which may be mounted on or in, or provided integrally within) a hand-held controller for a computer entertainment system provides a calibration function, for calibrating the head-mounted sensor signals with the specific control input device they are required to replace for a game and the display 514 referenced above provides the user interface for facilitating this functionality.
  • the user interface displayed may be as follows:
  • the calibration function can be seen on the left hand side of the interface.
  • the right hand side there are a plurality of tabs, each specifying one of the games a user plays, and each page corresponding to a tab defining the specific game-defined controller profiles.
  • the user first clears any current or residual calibration data by selecting "Clear Stick Cal” and then physically operates the control input device (e.g. the right thumb stick) on the hand-held controller.
  • this may require the user to operate the thumb stick in circles (defining the extent of its radius in all directions about its centre point) for a period of time, e.g. 5 seconds. This enables the maximum analog values to be obtained from the control input device and saved for that specific control input device.
  • the calibration interface also provides a "Re-centre Head Track” button, which, when pressed, causes the control module to determine the analog centre value for the control input device movement and maps it to a central position value for the head-mounted sensor.
  • the range of control provided by the head-mounted sensor(s) is known to the control module, and is illustrated schematically in Figure 7 of the drawings, by a range X of head movement about a first axis and a range Y of head movement in an orthogonal axis.
  • the range of control values associated with the head-mounted sensor(s) are superimposed onto the control input device data to provide so-called 'calibration data', which essentially maps movement data derived from the head-mounted sensor signals onto the equivalent or corresponding 'movement' of the control input device.
  • two modes of control are provided, namely "head tracking" and "fixed body head tracking".
  • a head tracking mode movement of the user's head (and the resultant head- mounted sensor signal values) are mapped, via the calibration data) onto control input device position values and digital signals representative of such control input device
  • the digital signals are converted, by the above- mentioned DAC module, into corresponding analog signals and output to the games console/PC control box (via the hand-held controller), such that the games console/PC control box 'reads' the analog signals as movement of the respective control input device and adjusts the game footage accordingly.
  • a head tracking mode flag can be set in the profile page for that game, such that whenever the user selects that profile, the head-mounted sensor will operate that game in the head tracking mode.
  • the control module uses the velocity of user head movements to generate respective control signals.
  • velocity changes in any axis (of head movement) are mapped to brief movements of the control input device in that direction.
  • the control module needs a value for the user's centre head position.
  • the user carrying the head-mounted sensor module, selects the 'Re-Centre Head Track' function on the interface to indicate to the control module that their head is centred relative to their gaming position.
  • the flag can be set in the profile page for that game, such that whenever the user selects that profile, the head-mounted sensor will operate that game in the fixed body head tracking mode.
  • the control module operates to map movement of the head- mounted sensor to brief movements of the control input device in the same direction, with the velocity of the head movement determining the extent of the corresponding control input device movement.
  • the view snaps back to centre, in the manner that it would if the control input device was being used and it had been released after a brief 'look' in a certain direction relative to the game footage.
  • the control module may be configured to ignore head rotations below a predetermined minimum velocity to avoid 'camera shake' with very small (unintentional) movements.
  • buttons 516 provided on the control module 12, just below the display, may be used to perform the above-described head re-centre process (for fixed body head tracking mode) and to switch between various profiles respectively.
  • four buttons may be provided, as follows:
  • Button 1 configured to enable a user to cycle around the profiles stored on the control module memory, each game profile being displayed showing a title graphic for the game.
  • Headtracker Disable a further selectable option, referred to herein as Headtracker Disable, to allow the user to have full controller control (without the intertial sensor).
  • Button 2 may be used for fixed body games, and will (when selected) cause the
  • Button 3 for selectively enabling/disabling ADS/sniper trigger.
  • Button 4 may be configured to cycle around the bumper buttons and triggers for use in triggering the ADS/sniper mode, and the current ADS/sniper mode trigger will be displayed on the screen. By default, each time a profile is selected using button 1, the profile defined trigger will be used unless button 4 is operated.
  • buttons may be provided, depending on the number and types of functions to be provided, and the present invention is not necessarily intended to be limited in this regard.
  • the interface may provide the facility for disabling head tracking in one or other of the axes of head movement.
  • the thumb stick may be used to control Y axis manipulation within the game footage, whilst the head-mounted sensor signals continue to control the X axis manipulation.
  • other control input device settings are required for a specific game, i.e. other than fixed body head tracking or just head tracking, then such settings can be provided to the control module via an OTA wireless update or via an SD card or other external memory chip to transfer the relevant settings and configure the manner in which the head-mounted sensor data is mapped onto the 'virtual' control input device operation data.
  • the user interface provided by the control module may also enable a user to selectively disable any external sensor that may be coupled to the hand-held controller (wirelessly or otherwise), as required, and this function, if selected, may be saved as part of a specific game profile configured by the user.
  • a third button (as described above) may be provided on the control module 12 to provide the function to disable the external sensors for aim down sight (ADS)/sniper mode used in first person shooting (FPS) games and reallocating the normal functions of the gamepad 10.
  • the microprocessor receives signals from the head-mounted sensor (in response to user head movement) and converts them into corresponding signals representative of movement of a selected control input device (by mapping the head-mounted sensor signals onto the range/bound data obtained for that control input device using the calibration data referenced above).
  • the signals, thus generated, are (where required) converted to analog format and transmitted to the games console or PC control box for use thereby in manipulating the game as it is being played.
  • the gamepad 10 (including the control module 12) is directly connected (wired or wirelessly) to the game control box 104 via, for example, USB, HDMI, Bluetooth® or WiFi (103a).
  • the control signals thus generated, are transmitted directly to the control box 104 from the gamepad 10, and used by the control box 104 to manipulate/update game play, and updated game data is then streamed, via the smartphone remote display app 103, to the screen 610.
  • control signals thus generated are transmitted, via the smartphone remote display appl03, to the control box 104.
  • the control box 104 uses the control signals to update/manipulate game play accordingly, and updated game data is streamed, via the smartphone remote display app 103, back to the screen 610.
  • element 103 is depicted as a smartphone display app (wireless connection between the console 104 and the smartphone/tablet/screen 610) or, as an alternative, HDMI or USB (hard wired connection) which provides the same functionality as that of the smartphone remote display app. It is to be understood that the present invention is not necessarily intended to be limited in this regard. It will be appreciated by a person skilled in the art, from the foregoing description, that modifications and variations can be made without departing from the scope of the invention as defined by the appended claims.

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Human Computer Interaction (AREA)
  • Health & Medical Sciences (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Biophysics (AREA)
  • Cardiology (AREA)
  • General Health & Medical Sciences (AREA)
  • Heart & Thoracic Surgery (AREA)
  • User Interface Of Digital Computer (AREA)

Abstract

A control module for a computer entertainment system including a unit for executing and running a computer game and causing game footage to be generated, said unit being configured to receive control signals representative of manipulation of said game and dynamically adjust said game footage accordingly; said control module comprising a processor (512), a user interface, a plurality of inputs and at least one output, one or more of said plurality of inputs being configured to receive control data from one or more respective control input devices of a controller communicably coupled thereto, and at least one of said plurality of inputs being configured to receive signals from at least one respective inertial sensor (530) communicably coupled thereto, said user interface being configured to receive a user input to select a control input device communicably coupled to an input to be associated with said inertial sensor, said processor being configured to perform a calibration function by: - receiving control signals from said selected control input device, generated in response to user manipulation thereof, to generate control input manipulation data; and - mapping inertial sensor data onto said control input manipulation data to generate respective calibration data; the processor (512) further comprising a conversion module for receiving motion signals representative of movement of said inertial sensor and converting, using said calibration data, said signals into control signals for manipulating said computer game, said control signals being of the same format as control signals otherwise generated by said selected control input device in response to user manipulation thereof.

Description

CONTROL MODULE FOR COMPUTER ENTERTAINMENT SYSTEM
This invention relates generally to a control module for use with a computer entertainment system for enhancing compatibility thereof with a head-mounted display.
Head-mounted displays of various types are known, and typically comprise a video display screen and means of mounting the display screen in front of a wearer's eyes. In recent years, increasing development within the gaming industry has resulted in systems which provide a user with a virtual reality experience by including a head-mounted display wherein the game footage is displayed on the display screen in front of, and close to, the wearer's eyes, with the object of fully immersing the user in the virtual reality world generated as the game is being played.
Fully integrated virtual reality gaming systems have been developed, such as Oculus Rift, wherein the video display screen is built into the headset, and a separate control box is provided for control of bespoke games. Such integrated systems are costly, and do not provide a user with the ability to obtain a virtual reality experience in respect of existing computer games.
In contrast, International Patent Application No. WO2014/108693 describes a more cost-effective and flexible solution comprising a head-mounted display including attachment means for removably securing a display screen therein such that it is located in front of the user's eyes, in use; and, optionally, speakers located in the headset and located near the wearer's ears, in use, for outputting game sounds. The video display screen may, for example, be provided in the form of a stand-alone mobile phone or portable gaming device. However, in alternative embodiments, the video display screen may be configured to receive (wirelessly or otherwise) and display video data representative of game progression from the main game control box. In all cases, however, a separate, hand-held controller is required to be provided to enable the user to manipulate all aspects of the game. A typical controller for this purpose is illustrated in Figure 1 of the drawings, and comprises a gamepad 110 including conventional control input devices, such as joysticks or thumb sticks 111 and buttons 113. The gamepad 110 further comprises an inertial sensor 112, which is typically an accelerometer and gyroscope, that produces signals in response to the position, motion, orientation or change in orientation of the gamepad 110. In general, signals from the inertial sensor 112 are used to generate position and orientation data for the gamepad 110, and such data may be used to calculate many physical aspects of the gamepad 110, such as for example, its acceleration and velocity, along any axis, its tilt, pitch, yaw, roll, as well as any telemetry points of the gamepad 110. Thus, the manner in which a user physically moves the gamepad 110 can be used as another input for controlling the game. For example, one of the joysticks 111 may be used to move the player's avatar through the game, whilst movement of the gamepad 110 (i.e. data from the inertial sensor 112) may be used to selectively alter the player's field of view within the game footage (e.g. 'looking' left and right within a scene). In some gaming systems, the user is able to select, within the computer game setup, which aspects of the game are controlled by each of the control input devices, in accordance with personal preference.
In a virtual reality gaming environment, the separation of the control inputs from the game footage in this manner can detract from the user's overall virtual reality experience, and it would be desirable, therefore, to provide a system of this type in which the control inputs of the game are more intuitive from the user's perspective. Systems exist in which an inertial sensor is provided on, for example, the head-mounted display and configured to transmit signals representative of a user's head movement to the control box as an alternative control input for manipulating an aspect of the game. For example, US 2014/0364209 describes a virtual reality game system having a head-mounted display and a hand-held gamepad includes at least one control input device, manipulation of which causes corresponding control signals to be generated and transmitted to the game control box, for example, to cause the player's avatar to move around within the game scene and/or effect operations such as shooting. An inertial sensor is provided on the head-mounted display for generating signals corresponding to movement of the user's head, and such signals are transmitted to the game control box and converted into control signals to change the player' s field of view of the game scene. By way of example, the player may turn their head to the left, causing a corresponding signals to be sent from the inertial sensor to the game control box. The processor in the control box converts the movement signal to a control signal and causes the game player's field of view, as displayed on the screen, to change as if their avatar was looking to its left. However, in order for such systems to work, the processor in the control box itself, i.e. the main game control unit, must be configured to receive and process the inertial sensor signals in order to cause associated manipulation of the game. Thus, the resultant system is an integrated system, pre-programmed to include all control features. On the other hand, if a user wishes to employ a head-mounted display with an existing system, configured only to respond to a hand-held gamepad control input, there is currently no facility to enable them to experience the full virtual reality game experience offered by inertial sensor technology on the head-mounted display itself.
Furthermore, and more generally, there is currently no facility to enable a user to select what aspects of a particular game are controlled, and in what manner, by internal or external sensor inputs. Such aspects tend to be selectable and programmable within the game set up itself, if at all and it would, therefore, be desirable to provide a control module that enables a user to select what conventional gamepad control inputs are replaced by alternative sensors (whether internal to the gamepad or external) and provides a programmable interface between the sensor(s) and the main game control box such that the resultant control signals generated from the sensor signals mimic the 'normal' control signals that would be generated by corresponding operation of the manual control input devices in relation to a specific game, thereby enabling a user to selectively program and optimise the control input configuration for each different game they may wish to play.
Aspects of the present invention seek to address at least some of these issues and, in accordance with a first aspect of the present invention, there is provided a control module for a computer entertainment system including a unit for executing and running a computer game and causing game footage to be generated, said unit being configured to receive, from a controller, control signals representative of manipulation of said game and dynamically adjust said game footage accordingly; said control module comprising a processor, a user interface, a plurality of inputs and at least one output, one or more of said plurality of inputs being configured to receive control data from one or more respective control input devices of a controller (e.g. hand-held gamepad) communicably coupled thereto, and at least one of said plurality of inputs being configured to receive signals from at least one respective inertial sensor communicably coupled thereto, said user interface being configured to receive a user input to select a control input device communicably coupled to an input to be associated with said inertial sensor, said processor being configured to perform a calibration function by: receiving control signals from said selected control input device, generated in response to user manipulation thereof, to generate control input manipulation data; and mapping inertial sensor data onto said control input manipulation data to generate respective calibration data; the processor further comprising a conversion module for receiving motion signals representative of movement of said inertial sensor and converting, using said calibration data, said signals into control signals for manipulating said computer game, said control signals being of the same format as control signals otherwise generated by said selected control input device in response to user manipulation thereof.
The selected control input device may be an analog control input device configured to generate analog control signals representative of user manipulation thereof. In this case, the control module may include an analog switch for receiving said analog control signals and converting them to corresponding digital control signals. The processor may receive said digital control signals, generate therefrom said control input manipulation data and map said inertial sensor data onto said control input manipulation data to generate digital calibration data, further comprising a digital to analog conversion module for receiving control digital control signals from said conversion module, and converting said control signals to corresponding analog control signals for manipulating said computer game.
The analog control signals obtained from said control input device may be
representative of a full range of movement of said control input device. In this case, the processor may be configured to derive data representative of one or more upper limits of movement of said selected control input device and calculate therefrom data
representative of a central or neutral position of said control input device. The processor may be configured to map data representative of one or more upper limits of movement of said inertial sensor onto said data representative of one or more upper limits of movement of said selected control input device to generate said calibration data.
In an exemplary embodiment, the processor may be configured to map data representative of a central or neutral position of said inertial sensor onto said data representative of said central or neutral position of said selected control input device to generate said calibration data.
Optionally, the control module nay be configured to operate in a head tracking mode, wherein movement of said inertial sensor is converted, using said calibration data, into control signals representative of corresponding movement of said selected control input device. Alternatively or in addition, the control module may be configured to operate in a fixed body head tracking mode, wherein a velocity and direction of movement of said inertial sensor is determined and converted, using said calibration data, into a brief movement of said selected control input device, wherein an extent of said brief movement is dependent on said velocity.
The control module may include a memory configured to store a plurality of game profiles, each game profile comprising respective calibration data. In an exemplary embodiment, the control module may include a graphical user interface configured to receive user input defining a user-defined game profile, said memory being configured to store, for subsequent user selection, said user-defined game profile. This allows each user of a hand-held controller (including a control module of an exemplary embodiment of the invention) to define their own customised settings for each game. The user can modify existing game profiles or create new ones via the above-mentioned graphical user interface, which provides for enhanced game manipulation. Each game profile may further comprise a respective mode of tracking to define a manner of converting said motion signals into control signals for manipulating said computer game. A display may be included for displaying a current game profile. The processor may be configured to generate display data configured to display on said display said user interface. The display may include touch sensitive user input means.
In an exemplary embodiment, the processor may be configured to receive, wirelessly or otherwise, data representative of settings or configurations of a control input device and/or mode of operation thereof in respect of a game, to enable said control module to generate said calibration data in respect thereof.
In accordance with another aspect of the present invention, there is provided a handheld gamepad for a computer entertainment system, including a control module substantially as described above. The control module may be removably mounted and communicably coupled thereto via a communications interface.
These and other aspects of the present invention will be apparent from the following specific description, in which embodiments of the present invention are described, by way of examples only, and with reference to the accompanying drawings, in which:
Figure 1 is a plan view of a hand-held game controller according to the prior art; Figure 2 is a plan view of a hand-held game controller having mounted thereon, and communicably coupled therewith, a control module according to an exemplary embodiment of the present invention;
Figure 2A is a perspective view of a hand-held game controller, having an integral control module according to another exemplary embodiment of the present invention;
Figure 3 is a schematic block diagram of principal aspects of a computer
entertainment system including a control module according to an exemplary embodiment of the present invention;
Figure 4 is a schematic perspective view of a head-mounted display device for use with the computer entertainment of Figure 3;
Figure 5 is a schematic diagram illustrating the principal components of a control module according to an exemplary embodiment of the present invention;
Figure 6A is a schematic diagram illustrating the principal aspects of a control system including a control module according to an exemplary embodiment of the present invention;
Figure 6B is a schematic diagram illustrating the principal aspects of another control system including a control module according to an exemplary embodiment of the present invention; and
Figure 7 is a schematic illustration of the range and axes of head movement for which a head-mounted sensor for use in an exemplary embodiment of the present invention is configured.
Referring to Figure 2 of the drawings, there is shown a hand-held gamepad 10 of a known type, on which is mounted a control module 12 according to an exemplary embodiment of the present invention. Thus, the gamepad 10 itself includes conventional control input devices, such as right and left thumb sticks 14 and buttons 16. The gamepad 10 would typically also comprise an internal inertial sensor (not shown), which is typically an accelerometer and gyroscope, that produces signals in response to the motion, position, orientation or change in orientation of the gamepad 10, as previously described.
The control module 12 is mounted on the gamepad 10 via a socket (not shown) that provides a communications interface between the control module 12 and the control circuitry within the gamepad 10. The control module 12 may be mounted on the gamepad 10, dependent (at least partly) on the configuration of the specific game pad. In other exemplary embodiments, the control module 12 may be built or integrated into the gamepad 10, as illustrated in Figure 2A of the drawings, wherein the control module 12 (depicted in terms of the display screen 514 and the buttons 516) is integrated into the rear surface of the gamepad 10, within the central body portion 10a. Thus, in this case, the gamepad 10 has a central body portion 10a, flanked by a pair of opposing handle portions 10b, and the socket for
receiving/mounting the control module 12 thereon is located on a lower side wall of the central body portion 10a (i.e. a side wall nearest the user, when in use), generally centrally between the handle portions 10b.
Referring to Figure 3 of the drawings, a computer entertainment system of the type in which an exemplary embodiment of the present invention may be used, comprises a head- mounted display (HMD) 100, a system control unit 104 and a hand-held controller 10, for example of the type described above. In some exemplary aspects, the system control unit 104 may be provided in a conventional manner (i.e. as a games console or PC for example), with game footage being transposed or streamed, wirelessly or otherwise, onto a screen, portable (i.e. removable) or otherwise, within the HMD 100. For example, gaming systems exist wherein game footage etc. can be streamed to a compatible portable device, such as a mobile phone or hand-held gaming console, including an integrated screen, and the HMD may be configured such that the portable device can be mounted therein, for use. The screen within the HMD 100 has associated therewith a mobile application, herein after referred to as a 'smartphone remote display app' 103 (see Figures 6A and 6B hereinafter). If the screen is provided in the form of a mobile computing device, such as a smartphone, tablet or smart games console, the app may be provided within the device itself. However, if the screen is a passive device, the app may be running on a separate device, such as a smartphone, PC/console or any other device communicably coupled (wired or wirelessly) to the screen. The remote display app 103 is a smartphone application configured to connect (wirelessly) to a console/PC control box, and cause graphics from the console/PC control box to be displayed on a mobile computing device, such as a smartphone or tablet display. Examples of such apps will be known to a person skilled in the art, and it will be appreciated that the remote display app offers, wirelessly, the equivalent functionality of a hard wired connection (HDMI or USB) between the console/PC control box and the mobile computing device.
Referring to Figure 4 of the drawings, an exemplary HMD 100 comprises a main housing 212, rigid side members 214, speakers 216 and an adjustable/flexible band 218.
The housing 212 has a rear open end 220 for fitting over the eyes of a wearer, a front end 222, a top 224, a bottom 226 and two lateral sides 228, 230. In use, the housing 212 extends outwardly from the front of the wearer's face. Rigid side members 214 are attached to the housing 212, one side member being attached to each lateral side 228, 230, and each side member extending rearwardly, that is, in the direction of the open end 220 and substantially parallel with the lateral sides 228, 230. In use, the rigid side members 214 pass either side of the wearer's head, so that the device fits onto the wearer's face in a similar manner to a pair of spectacles. The extent of side members between the speakers 216 and the main housing 212 may be adjustable for fitting to differently-sized heads, and the flexible band 218 may be shortened to secure the device once it has been fitted over a wearer's head.
The main housing 212 contains a removable cassette 246, which is received within slot 248 in the top 224 of the main housing. Slot 248 extends across the entire width of the housing 212, from the lateral side 228 to the other 230. The edges of the main housing 212 are curved, so the slot in the top 224 of the housing also extends some distance down the lateral sides 228, 230 of the main housing 212. WO2014/108693 describes in detail the configuration of one suitable removable cassette of this type, although others are envisaged, and specific features thereof will not be described further herein. It will be understood by a person skilled in the art that any HMD configured to receive a portable screen or device including an integrated screen is suitable for use in various aspects of the present invention.
The portable screen or device is secured, in use, within the removable cassette 246 and an audio cable (not shown) may be provided for connecting the electronic audio source of the portable device, which feeds the audio signal to the speakers 216 for reproduction. The cassette 246 carrying the portable device 610 may be inserted into the slot 224 of the main housing 212 such that, when the HMD 100 is secured on the user's head, over their eyes, the images on the screen of the portable device 610 are viewable.
Referring now to Figure 5 of the drawings, a control module 12 according to an exemplary embodiment of the present invention, comprises a housing 510 defining a communications interface or 'plug' (not shown) to communicably couple (removably, in this case) the control module 12 to a hand-held controller or gamepad, via a socket provided thereon.
The control module 12 comprises, within the housing a microprocessor 512, an OLED display 514, and one or more push buttons 516 (in this exemplary embodiment two push buttons 516 are provided just below the display 514 - see Figure 2 - but the present invention is not necessarily intended to be limited in this regard). The control module further comprises an analog switch 518 and a digital-to-analog conversion (DAC) module 520.
The microprocessor 512 receives as inputs (via the communications interface with the hand-held controller to which it is coupled), signals (522) from the left and right trigger control input devices, signals (524) from the left and right bumper control input devices, a USB connection 528 and one or more head mounted sensors 530. The head mounted sensors may be one or more of an accelerometer or gyroscope, housed within a module configured to mounted at the rear of the user's head. The head mounted sensors 530 may be connected to the microprocessor 512 in the control module 12 by a hard wired or wireless connection, and the present invention is not necessarily intended to be limited in this regard.
The analog switch 518 has, as an input, signals 532 from the analog control input devices on the hand-held controller, namely the joysticks or thumb sticks, and acts to convert the analog signals therefrom into corresponding digital signals for input to the microprocessor 512. Similarly, digital control signals generated by the microprocessor (derived from the head-sensor signals) are converted by the DAC module 520 into corresponding analog signals and output, via the analog switch 518 as "analog stick outputs" 534.
In an exemplary embodiment, game footage is streamed to a smartphone or tablet mounted in a head mounted display of the type described above. The head mounted display may also include means for enabling the head-mounted sensor module to be mounted thereon, at the rear of the user's head, or the head-mounted sensor module may even be integrally provided therein, although the present invention is not necessarily intended to be limited in this regard, and the head-mounted sensor module may, instead, have a separate mounting means for enabling it to be mounted on the user's head, at the rear or otherwise. Furthermore, and as explained above, the head-mounted sensor module may be connected by a wire (for power and communication) to the control module 12, but it may alternatively be internally powered and then communicably coupled wirelessly to the control module in alternative exemplary embodiments. The display 514 may be configured to display to a user which game profile is active, and touch- sensitive control means, buttons, visual/audio/physical or any other means may be provided to facilitate a user interface for selecting and/or reconfiguring a control profile, depending on the user's preference and/or the specific game that is to be played. Different computer games utilise the control input devices in different respective ways, depending on the nature of the game, and the game software itself determines how the control inputs of the hand-held controller will be interested and actioned within the game footage. Thus, for example, in some games, the analog control input devices (i.e. the joysticks thumb sticks) are configured to continuous control of, say, movement of an avatar through the game. If the thumbstick is pushed in a particular direction, the avatar moves in that direction, until the thumbstick is moved in another direction. This type of control will be referred to hereinafter as "head tracking". In other games, such as driving games, the thumbstick is used for brief changes of the player's field of view, with the game footage view returning to centre quickly after the avatar has "looked" to one side or the other, for example, and the thumb stick has been released. This type of control will be referred to hereinafter as 'fixed body tracking'.
Aspects of the present invention, provide a control module that enables the head mounted sensor(s) to be used as a control input instead of one of the physical control input devices on the hand-held controller for a specific computer entertainment system and in respect of a specific game or game type. The control module 12 includes a programmable microchip for receiving and saving control input 'profiles' selected and saved for a specific user and/or for specific games or game types.
Thus, the control module (which may be mounted on or in, or provided integrally within) a hand-held controller for a computer entertainment system provides a calibration function, for calibrating the head-mounted sensor signals with the specific control input device they are required to replace for a game and the display 514 referenced above provides the user interface for facilitating this functionality. Thus, for the purposes of calibrating (or re-calibrating) the head-mounted sensor(s), and defining specific user profiles for respective games, the user interface displayed may be as follows:
Figure imgf000013_0001
On the left hand side of the interface, the calibration function can be seen. On the right hand side, there are a plurality of tabs, each specifying one of the games a user plays, and each page corresponding to a tab defining the specific game-defined controller profiles. In order to set a game-defined controller profile to map the head-mounted sensor signals onto the relevant control input device signal pattern, the user first clears any current or residual calibration data by selecting "Clear Stick Cal" and then physically operates the control input device (e.g. the right thumb stick) on the hand-held controller. In this specific exemplary embodiment, this may require the user to operate the thumb stick in circles (defining the extent of its radius in all directions about its centre point) for a period of time, e.g. 5 seconds. This enables the maximum analog values to be obtained from the control input device and saved for that specific control input device.
The calibration interface also provides a "Re-centre Head Track" button, which, when pressed, causes the control module to determine the analog centre value for the control input device movement and maps it to a central position value for the head-mounted sensor.
The range of control provided by the head-mounted sensor(s) is known to the control module, and is illustrated schematically in Figure 7 of the drawings, by a range X of head movement about a first axis and a range Y of head movement in an orthogonal axis. Thus, once the bounds and ranges of movement of the control input device have been determined, the range of control values associated with the head-mounted sensor(s) are superimposed onto the control input device data to provide so-called 'calibration data', which essentially maps movement data derived from the head-mounted sensor signals onto the equivalent or corresponding 'movement' of the control input device. In this exemplary embodiment of the invention, two modes of control are provided, namely "head tracking" and "fixed body head tracking". In general, and as briefly described above, in a head tracking mode, movement of the user's head (and the resultant head- mounted sensor signal values) are mapped, via the calibration data) onto control input device position values and digital signals representative of such control input device
movement/position data are generated. The digital signals are converted, by the above- mentioned DAC module, into corresponding analog signals and output to the games console/PC control box (via the hand-held controller), such that the games console/PC control box 'reads' the analog signals as movement of the respective control input device and adjusts the game footage accordingly. If head tracking mode is required for a specific game, a head tracking mode flag can be set in the profile page for that game, such that whenever the user selects that profile, the head-mounted sensor will operate that game in the head tracking mode.
In the fixed body tracking mode, the control module uses the velocity of user head movements to generate respective control signals. In general, velocity changes in any axis (of head movement) are mapped to brief movements of the control input device in that direction. In this case, and as explained above, the control module needs a value for the user's centre head position. Thus, the user, carrying the head-mounted sensor module, selects the 'Re-Centre Head Track' function on the interface to indicate to the control module that their head is centred relative to their gaming position. Once again, if, for a particular game, the fixed body head tracking mode is required, the flag can be set in the profile page for that game, such that whenever the user selects that profile, the head-mounted sensor will operate that game in the fixed body head tracking mode.
Once the control input device has been calibrated, the centre position set and the fixed body head tracking mode flag set, the control module operates to map movement of the head- mounted sensor to brief movements of the control input device in the same direction, with the velocity of the head movement determining the extent of the corresponding control input device movement. Once the movement has been used within the game footage, the view snaps back to centre, in the manner that it would if the control input device was being used and it had been released after a brief 'look' in a certain direction relative to the game footage. In this case, the control module may be configured to ignore head rotations below a predetermined minimum velocity to avoid 'camera shake' with very small (unintentional) movements.
In practice, the two buttons 516 provided on the control module 12, just below the display, may be used to perform the above-described head re-centre process (for fixed body head tracking mode) and to switch between various profiles respectively. In other exemplary embodiments, four buttons may be provided, as follows:
• Button 1: configured to enable a user to cycle around the profiles stored on the control module memory, each game profile being displayed showing a title graphic for the game. At the end of the game profile list, there may be provided a further selectable option, referred to herein as Headtracker Disable, to allow the user to have full controller control (without the intertial sensor).
• Button 2:may be used for fixed body games, and will (when selected) cause the
headtracker to re-centre the control stick using the head tracker's current heading. This function would not normally be used for velocity controlled games.
• Button 3: for selectively enabling/disabling ADS/sniper trigger.
• Button 4: may be configured to cycle around the bumper buttons and triggers for use in triggering the ADS/sniper mode, and the current ADS/sniper mode trigger will be displayed on the screen. By default, each time a profile is selected using button 1, the profile defined trigger will be used unless button 4 is operated.
However, it will be appreciated that more or less buttons may be provided, depending on the number and types of functions to be provided, and the present invention is not necessarily intended to be limited in this regard.
In some exemplary embodiments, the interface may provide the facility for disabling head tracking in one or other of the axes of head movement. Thus, for example, if Y axis tracking is disabled, the thumb stick may be used to control Y axis manipulation within the game footage, whilst the head-mounted sensor signals continue to control the X axis manipulation. If other control input device settings are required for a specific game, i.e. other than fixed body head tracking or just head tracking, then such settings can be provided to the control module via an OTA wireless update or via an SD card or other external memory chip to transfer the relevant settings and configure the manner in which the head-mounted sensor data is mapped onto the 'virtual' control input device operation data.
The user interface provided by the control module may also enable a user to selectively disable any external sensor that may be coupled to the hand-held controller (wirelessly or otherwise), as required, and this function, if selected, may be saved as part of a specific game profile configured by the user. Hence a third button (as described above) may be provided on the control module 12 to provide the function to disable the external sensors for aim down sight (ADS)/sniper mode used in first person shooting (FPS) games and reallocating the normal functions of the gamepad 10.
Thus, once a tracking profile has been configured and saved for a specific game, and when that game is loaded and selected on the games console or PC control box, the microprocessor receives signals from the head-mounted sensor (in response to user head movement) and converts them into corresponding signals representative of movement of a selected control input device (by mapping the head-mounted sensor signals onto the range/bound data obtained for that control input device using the calibration data referenced above). The signals, thus generated, are (where required) converted to analog format and transmitted to the games console or PC control box for use thereby in manipulating the game as it is being played. In a first exemplary embodiment, as illustrated in Figure 6A of the drawings, the gamepad 10 (including the control module 12) is directly connected (wired or wirelessly) to the game control box 104 via, for example, USB, HDMI, Bluetooth® or WiFi (103a). In this case, the control signals, thus generated, are transmitted directly to the control box 104 from the gamepad 10, and used by the control box 104 to manipulate/update game play, and updated game data is then streamed, via the smartphone remote display app 103, to the screen 610. In an alternative exemplary embodiment, there may be no direct connection between the gamepad 10 (including the control module 12) and the control box 104. Instead, and referring to Figure 6B of the drawings, control signals thus generated are transmitted, via the smartphone remote display appl03, to the control box 104. The control box 104 uses the control signals to update/manipulate game play accordingly, and updated game data is streamed, via the smartphone remote display app 103, back to the screen 610. In both Figures 6A and 6B of the drawings, element 103 is depicted as a smartphone display app (wireless connection between the console 104 and the smartphone/tablet/screen 610) or, as an alternative, HDMI or USB (hard wired connection) which provides the same functionality as that of the smartphone remote display app. It is to be understood that the present invention is not necessarily intended to be limited in this regard. It will be appreciated by a person skilled in the art, from the foregoing description, that modifications and variations can be made without departing from the scope of the invention as defined by the appended claims.

Claims

1. A control module for a computer entertainment system including a unit for executing and running a computer game and causing game footage to be generated, said unit being configured to receive control signals representative of manipulation of said game and dynamically adjust said game footage accordingly; said control module comprising a processor, a user interface, a plurality of inputs and at least one output, one or more of said plurality of inputs being configured to receive control data from one or more respective control input devices of a controller communicably coupled thereto, and at least one of said plurality of inputs being configured to receive signals from at least one respective inertial sensor communicably coupled thereto, said user interface being configured to receive a user input to select a control input device communicably coupled to an input to be associated with said inertial sensor, said processor being configured to perform a calibration function by: receiving control signals from said selected control input device, generated in response to user manipulation thereof, to generate control input manipulation data; and mapping inertial sensor data onto said control input manipulation data to generate respective calibration data; the processor further comprising a conversion module for receiving motion signals representative of movement of said inertial sensor and converting, using said calibration data, said signals into control signals for manipulating said computer game, said control signals being of the same format as control signals otherwise generated by said selected control input device in response to user manipulation thereof.
2. A control module according to claim 1, wherein said controller is a hand -held
gamepad.
3. A control module according to claim 1 or claim 2, wherein said selected control input device is an analog control input device configured to generate analog control signals representative of user manipulation thereof.
4. A control module according to claim 3, further including an analog switch for
receiving said analog control signals and converting them to corresponding digital control signals.
5. A control module according to claim 4, wherein said processor receives said digital control signals, generates therefrom said control input manipulation data and maps said inertial sensor data onto said control input manipulation data to generate digital calibration data.
6. A control module according to claim 5, further comprising a digital to analog
conversion module for receiving control digital control signals from said conversion module, and converting said control signals to corresponding analog control signals for manipulating said computer game.
7. A control module according to any of claims 2 to 6, wherein said analog control signals obtained from said control input device are representative of a full range of movement of said control input device.
8. A control module according to claim 7, wherein said processor is configured to derive data representative of one or more upper limits of movement of said selected control input device and calculate therefrom data representative of a central or neutral position of said control input device.
9. A control module according to claim 8, wherein said processor is configured to map data representative of one or more upper limits of movement of said inertial sensor onto said data representative of one or more upper limits of movement of said selected control input device to generate said calibration data.
10. A control module according to claim 8 or claim 9, wherein said processor is
configured to map data representative of a central or neutral position of said inertial sensor onto said data representative of said central or neutral position of said selected control input device to generate said calibration data.
11. A control module according to any of the preceding claims, configured to operate in a head tracking mode, wherein movement of said inertial sensor is converted, using said calibration data, into control signals representative of corresponding movement of said selected control input device.
12. A control module according to any of the preceding claims, configured to operate in a fixed body head tracking mode, wherein a velocity and direction of movement of said inertial sensor is determined and converted, using said calibration data, into a brief movement of said selected control input device, wherein an extent of said brief movement is dependent on said velocity.
13. A control module according to any of the preceding claims, including a memory configured to store a plurality of game profiles, each game profile comprising respective calibration data.
14. A control module according to claim 13, comprising a graphical user interface
configured to receive user input defining a user-defined game profile, said memory being configured to store, for subsequent user selection, said user-defined game profile.
15. A control module according to claim 13 or claim 14, wherein each game profile
further comprises a respective mode of tracking to define a manner of converting said motion signals into control signals for manipulating said computer game.
16. A control module according to any of claims 13 to 15, including a display for
displaying a current game profile.
17. A control module according to claim 16, wherein said processor is configured to
generate display data configured to display on said display said user interface.
18. A control module according to claim 17, wherein said display includes touch sensitive or other user input means.
19. A control module according to any of the preceding claims, wherein said processor is configured to receive, wirelessly or otherwise, data representative of settings or configurations of a control input device and/or mode of operation thereof in respect of a game, to enable said control module to generate said calibration data in respect thereof.
20. A control module substantially as herein described and/or with reference to Figures 2 to 7 of the accompanying drawings.
21. A hand-held gamepad for a computer entertainment system, including a control
module according to any of the preceding claims.
22. A gamepad according to claim 21, wherein said control module is removably
mounted and communicably coupled thereto via a communications interface.
PCT/GB2017/052050 2016-07-27 2017-07-12 Control module for computer entertainment system WO2018020212A1 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
GB1613001.5A GB2552520A (en) 2016-07-27 2016-07-27 Control module for computer entertainment system
GB1613001.5 2016-07-27

Publications (1)

Publication Number Publication Date
WO2018020212A1 true WO2018020212A1 (en) 2018-02-01

Family

ID=56894399

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/GB2017/052050 WO2018020212A1 (en) 2016-07-27 2017-07-12 Control module for computer entertainment system

Country Status (2)

Country Link
GB (1) GB2552520A (en)
WO (1) WO2018020212A1 (en)

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2023043984A1 (en) * 2021-09-16 2023-03-23 Voyetra Turtle Beach Inc. Video game controller with customizable response
WO2023185618A1 (en) * 2022-03-31 2023-10-05 周海涛 Game controller having displacement detection apparatus, and displacement detection apparatus thereof

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN116585696B (en) * 2023-05-26 2024-01-30 衡阳鸿运电子有限公司 Game paddle maintenance calibration system

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP1637984A2 (en) * 2004-09-21 2006-03-22 Guillemot Corporation Gamepad controller mapping
US20110012827A1 (en) * 2009-07-14 2011-01-20 Zhou Ye Motion Mapping System
US8251821B1 (en) * 2007-06-18 2012-08-28 Ailive, Inc. Method and system for interactive control using movable controllers
WO2016113540A1 (en) * 2015-01-14 2016-07-21 Mvr Global Limited Controller for computer entertainment system

Family Cites Families (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
GB816378A (en) * 1956-05-17 1959-07-15 Alice Gertrude Brimmer Improvements in or relating to exercising devices
CN2379184Y (en) * 1999-06-24 2000-05-24 刘凤林 Animal organ movable artistic toy
DE20102267U1 (en) * 2001-02-09 2001-10-04 Fischer Max Exercise bike system
CN2547371Y (en) * 2002-02-23 2003-04-30 青岛达生运动器材有限公司 Fan Wheel reverse turning system for fan vehicle
US20080129695A1 (en) * 2006-12-01 2008-06-05 Tianhou Li Foot-operated electronic mouse
WO2009066191A1 (en) * 2007-11-19 2009-05-28 Discovery Health (Proprietary) Limited An exercise system
JP6184658B2 (en) * 2010-08-20 2017-08-23 任天堂株式会社 GAME SYSTEM, GAME DEVICE, GAME PROGRAM, AND GAME PROCESSING METHOD
TW201216123A (en) * 2010-10-08 2012-04-16 Primax Electronics Ltd Separatable game controller
CN205073661U (en) * 2015-11-03 2016-03-09 云和县汇丰工艺品有限公司 Handcart toy

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP1637984A2 (en) * 2004-09-21 2006-03-22 Guillemot Corporation Gamepad controller mapping
US8251821B1 (en) * 2007-06-18 2012-08-28 Ailive, Inc. Method and system for interactive control using movable controllers
US20110012827A1 (en) * 2009-07-14 2011-01-20 Zhou Ye Motion Mapping System
WO2016113540A1 (en) * 2015-01-14 2016-07-21 Mvr Global Limited Controller for computer entertainment system

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2023043984A1 (en) * 2021-09-16 2023-03-23 Voyetra Turtle Beach Inc. Video game controller with customizable response
WO2023185618A1 (en) * 2022-03-31 2023-10-05 周海涛 Game controller having displacement detection apparatus, and displacement detection apparatus thereof

Also Published As

Publication number Publication date
GB201613001D0 (en) 2016-09-07
GB2552520A (en) 2018-01-31

Similar Documents

Publication Publication Date Title
US20190265488A1 (en) Remote control augmented motion capture
US9733702B2 (en) Video game using dual motion sensing controllers
US20180001188A1 (en) Controller for computer entertainment system
US9533220B2 (en) Game controller and game system
US7831064B2 (en) Position calculation apparatus, storage medium storing position calculation program, game apparatus, and storage medium storing game program
US8753205B2 (en) Computer-readable storage medium having game program stored therein and game apparatus for generating a two-dimensional game image representing a three-dimensional game space
JP6877893B2 (en) Game device, game system, game program, and swing input judgment method
US9808717B2 (en) Game system, game device, storage medium storing game program, and game process method
JP4986279B2 (en) GAME PROGRAM AND GAME DEVICE
WO2015154627A1 (en) Virtual reality component system
US20090017907A1 (en) Storage medium having image processing program stored thereon and image processing apparatus
WO2018020212A1 (en) Control module for computer entertainment system
US20170087455A1 (en) Filtering controller input mode
US20160107080A1 (en) Information processing apparatus, computer-readable non-transitory storage medium having stored therein information processing program, information processing method, and information processing system
US8913010B2 (en) Pointing system, information processing system, method for setting coordinate system, etc., information processing device, and storage medium storing information processing program
US20180059788A1 (en) Method for providing virtual reality, program for executing the method on computer, and information processing apparatus
JPWO2021059359A1 (en) Animation production system
JP2021184272A (en) Information processing method, program, and computer
JP7344716B2 (en) Information processing system, information processing program, information processing device, and information processing method
JP6263292B1 (en) Information processing method, computer, and program for causing computer to execute information processing method
US8753207B2 (en) Game system, game processing method, recording medium storing game program, and game device
JP2019207714A (en) Information processing method, computer and program
WO2023021757A1 (en) Information processing device, information processing method, and program
JP6262563B2 (en) Information processing program, information processing apparatus, information processing system, and information processing method
KR20240031770A (en) Method for performing vignetting function and wearable electronic device supporting the same

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 17742516

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 17742516

Country of ref document: EP

Kind code of ref document: A1