EP1912714A2 - Object detection for an interactive human interface - Google Patents
Object detection for an interactive human interfaceInfo
- Publication number
- EP1912714A2 EP1912714A2 EP06789270A EP06789270A EP1912714A2 EP 1912714 A2 EP1912714 A2 EP 1912714A2 EP 06789270 A EP06789270 A EP 06789270A EP 06789270 A EP06789270 A EP 06789270A EP 1912714 A2 EP1912714 A2 EP 1912714A2
- Authority
- EP
- European Patent Office
- Prior art keywords
- sensing device
- radiation
- sensors
- sensor
- zones
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Withdrawn
Links
Classifications
-
- A—HUMAN NECESSITIES
- A63—SPORTS; GAMES; AMUSEMENTS
- A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
- A63F13/00—Video games, i.e. games using an electronically generated display having two or more dimensions
- A63F13/20—Input arrangements for video game devices
- A63F13/21—Input arrangements for video game devices characterised by their sensors, purposes or types
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
- G06F3/0304—Detection arrangements using opto-electronic means
-
- A—HUMAN NECESSITIES
- A63—SPORTS; GAMES; AMUSEMENTS
- A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
- A63F13/00—Video games, i.e. games using an electronically generated display having two or more dimensions
- A63F13/20—Input arrangements for video game devices
- A63F13/21—Input arrangements for video game devices characterised by their sensors, purposes or types
- A63F13/214—Input arrangements for video game devices characterised by their sensors, purposes or types for locating contacts on a surface, e.g. floor mats or touch pads
-
- A—HUMAN NECESSITIES
- A63—SPORTS; GAMES; AMUSEMENTS
- A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
- A63F13/00—Video games, i.e. games using an electronically generated display having two or more dimensions
- A63F13/20—Input arrangements for video game devices
- A63F13/24—Constructional details thereof, e.g. game controllers with detachable joystick handles
-
- A—HUMAN NECESSITIES
- A63—SPORTS; GAMES; AMUSEMENTS
- A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
- A63F13/00—Video games, i.e. games using an electronically generated display having two or more dimensions
- A63F13/25—Output arrangements for video game devices
- A63F13/28—Output arrangements for video game devices responding to control signals received from the game device for affecting ambient conditions, e.g. for vibrating players' seats, activating scent dispensers or affecting temperature or light
-
- A—HUMAN NECESSITIES
- A63—SPORTS; GAMES; AMUSEMENTS
- A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
- A63F13/00—Video games, i.e. games using an electronically generated display having two or more dimensions
- A63F13/20—Input arrangements for video game devices
- A63F13/23—Input arrangements for video game devices for interfacing with the game device, e.g. specific interfaces between game controller and console
-
- A—HUMAN NECESSITIES
- A63—SPORTS; GAMES; AMUSEMENTS
- A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
- A63F13/00—Video games, i.e. games using an electronically generated display having two or more dimensions
- A63F13/20—Input arrangements for video game devices
- A63F13/23—Input arrangements for video game devices for interfacing with the game device, e.g. specific interfaces between game controller and console
- A63F13/235—Input arrangements for video game devices for interfacing with the game device, e.g. specific interfaces between game controller and console using a wireless connection, e.g. infrared or piconet
-
- A—HUMAN NECESSITIES
- A63—SPORTS; GAMES; AMUSEMENTS
- A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
- A63F13/00—Video games, i.e. games using an electronically generated display having two or more dimensions
- A63F13/80—Special adaptations for executing a specific game genre or game mode
- A63F13/814—Musical performances, e.g. by evaluating the player's ability to follow a notation
-
- A—HUMAN NECESSITIES
- A63—SPORTS; GAMES; AMUSEMENTS
- A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
- A63F2300/00—Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game
- A63F2300/10—Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game characterized by input arrangements for converting player-generated signals into game device control signals
- A63F2300/1025—Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game characterized by input arrangements for converting player-generated signals into game device control signals details of the interface with the game device, e.g. USB version detection
-
- A—HUMAN NECESSITIES
- A63—SPORTS; GAMES; AMUSEMENTS
- A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
- A63F2300/00—Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game
- A63F2300/10—Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game characterized by input arrangements for converting player-generated signals into game device control signals
- A63F2300/1025—Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game characterized by input arrangements for converting player-generated signals into game device control signals details of the interface with the game device, e.g. USB version detection
- A63F2300/1031—Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game characterized by input arrangements for converting player-generated signals into game device control signals details of the interface with the game device, e.g. USB version detection using a wireless connection, e.g. Bluetooth, infrared connections
-
- A—HUMAN NECESSITIES
- A63—SPORTS; GAMES; AMUSEMENTS
- A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
- A63F2300/00—Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game
- A63F2300/80—Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game specially adapted for executing a specific type of game
- A63F2300/8047—Music games
Definitions
- Video games generally involve a user (or multiple users) interacting with a game console, whether the console be a personal computer, a stand-alone machine (such as in an arcade) or a dedicated hardware device. These interactions are typically captured and communicated through controllers, such as joysticks, knobs, buttons, a keyboard, or a mouse. Such controllers are particularly suited for games in which complex actions within the game (running, jumping, flying an airplane, etc.) are predicated on relatively simple user commands such as clicking a mouse, hitting a spacebar, moving a joystick or pulling a trigger.
- controllers such as joysticks, knobs, buttons, a keyboard, or a mouse.
- Such controllers are particularly suited for games in which complex actions within the game (running, jumping, flying an airplane, etc.) are predicated on relatively simple user commands such as clicking a mouse, hitting a spacebar, moving a joystick or pulling a trigger.
- DDR "Dance Dance Revolution”
- the user positions herself on a "dance-pad” in front of a video screen.
- the game displays various "dance moves” on the screen, and the user imitates the moves on the dance-pad.
- the system physically senses each movement of the user and compares it to the move displayed on the screen. As the game progresses, the moves become more difficult and are presented to the user in more rapid succession.
- the invention takes advantage of optical, capacitive, ultrasonic, audio, electric field or other sensing modalities to detect both temporal and spatial object placement in one or more segments surrounding a central point or area. This obviates the need for physical contact to be made with a switch in order to detect the presence and/or location of an object about the center area.
- non-physical detection modes e.g., modes in which the object does not need to physically touch the device in order for detection to occur
- the device suffers significantly less trauma during use, is not subject to movement based on contact with the user, and can be manufactured smaller and lighter than conventional controllers.
- the invention provides an electronic sensing device that includes sensors placed along an envelope or edge about a central location. Each sensor provides both a source of radiation and a detector for the radiation within a radial zone that originates at the sensor.
- the device includes circuitry that, based on the radiation detected by the sensors in each respective zone, generates a control signal.
- the control signal may, for example, indicate the location and/or presence of an object about the device, and in some embodiments in which the device also includes a signal emitter, may transmit the signal (using, for example, wireless protocols) to another device, such as a receiver.
- the wireless protocols by which the emitter transmits the signals may use one of any frequency and modulation transmission techniques, including, for example, the IEEE 802 family of protocols, such as the 802.11 and/or 802.15 (Bluetooth) protocols.
- the term 802 protocol refers generally to any of these IEEE protocols, whether in use now or in the future.
- a current listing of 802 protocols is given at http://standards.ieee.org/wireless/. '
- the radiation may comprise, for example, infrared radiation, ultrasonic radiation, sound radiation, and/or radio-frequency radiation.
- the device also detects variations in an electric field about the device.
- the sensors may be placed at any location about the device; however, in certain embodiments, the sensors are spaced about the perimeter of the device in such a manner that the zones are substantially triangular.
- the apparatus in which the device is generally octagonally shaped includes eight sensors placed about the device such that each sensor is associated with one edge of the device.
- the zones may be of any shape and size; however, in certain embodiments, each zone is configured to accommodate (and thus the sensors detect) the presence of a human body part such as a human foot.
- control signals may, for example, represent an interaction of a human with the device, such as the placement, removal, or movement of a body part within and/or among the zones.
- the device also includes a substantially horizontal platform disposed above the central location.
- a method for detecting the position of an object includes defining a plurality of radial zones about a central location, periodically introducing radiation into the zones, using radiation within a zone to detect the presence of an object in that zone, and upon detection of an object within an irradiated zone, generating a control signal indicative of the detection.
- the method may also include transmitting the control signal to a video game receiver at a console, thus allowing the console to display images and/or instructions indicative of or in response to the presence of the detected object.
- An indication e.g., a visual and/or audio signal
- the invention provides a video game system that includes a console for providing user instructions (which may in some cases be based on a signal received from a video game controller) via a display device, sensors placed about a central location, where each sensor includes a source of radiation and a detector for detecting reflected radiation within a radial zone originating at the sensor, and circuitry responsive to the sensors for generating a control signal upon detection of the reflected radiation within the zones.
- the control signal is conformed to a video game controller signal, and the video game controller signal is transmitted to the video game console.
- FIG. 1 is a perspective view of one embodiment of the present invention.
- FIG. 2 plan view of one embodiment of the present invention and the environment in which the invention generally operates.
- FIGS. 3a - 3f are plan-view illustrations of user interaction with the device according to various embodiments of the invention.
- FIGS. 4a - 4c are elevational views of user interaction with the device according to various embodiments of the invention.
- FIG. 5 is a schematic illustration of one electronic circuit for implementing one embodiment of the invention.
- FIG. 6 is a schematic illustration of an alternate electronic circuit for implementing one embodiment of the invention.
- FIG. 7 is a schematic illustration of one electronic circuit for implementing embodiments of the invention with various video game consoles.
- FIGS. 1 and 2 illustrate one embodiment 100 of the present invention, the operation of which is best understood from FIG. 2, which illustrates the general form-factor and optical characteristics thereof.
- the device 100 is surrounded by numerous sensing modules 210, each of which has an operational area 230 throughout which the sensing module 210 can detect the presence, removal and/or movement of an object within a zone 240 that roughly equates to the operational area 230.
- These zones 240 may then be attributed to a particular function or operation of a game - such as steps on a dance-pad wherein the zones 240 correspond to a segment of a dance floor.
- the device may also include an arrow 220 or some similar indication that a particular side represents the "front" of the unit for implementations in which the orientation of the device is germane to the operation of the game.
- proper orientation of the device 100 may be necessary for the zones 240 to correspond to the correct segments of a virtual dance floor as displayed on a television, computer screen, or other video display device connected to a game console, as described in greater detail below and illustrated in FIG. 7.
- the number of sensors 210 active at any time may be manipulated (either manually by the user or automatically by a game console) to alter the difficulty of the game.
- the game may use only four sensors 210 - front, back, left and right.
- additional sensors 210 may be activated such that six, and then possibly eight sensors 210 are active.
- multiple sensors 210 may be assigned to one zone 240. For example, a simpler version of the game may only detect whether a user has placed her foot in front of the pad or in back of the pad.
- the device 100 is octagonally shaped with sensing circuitry placed along each edge, which allows for the sensing of eight discrete zones 240 surrounding the device 100.
- any number of zones 240 and corresponding sensors 210 are possible, the number and configuration of which depend on the function and difficultly of the game and the required detection accuracy of a user's movements about the device 100.
- Infrared transmitting and receiving elements may be incorporated within each of the eight sensor modules 210 placed about the device 100.
- the sensor modules 210 include infrared light-emitting diodes (IR LEDs)
- each transmitter emits radiation in a pattern that defines its operational area 230.
- An object within the operational area 230 of any sensor 210 will reflect some of the optical transmission back to the sensor's receiving element, thus indicating the presence of an object within the zone 240 attributed to the area 230.
- Each of the zones 240 may, for example, represent a virtual spatial segment corresponding to a region in which an object can be detected by the nearest sensor 210.
- the object to be sensed (e.g., a foot) reflects the IR light transmitted by the sensor's IR LED and the reflection is received by the sensor's IR receiver module.
- These zones 240 may represent, in using the dance-pad game as an example, virtual counterparts to the physical dance-pad squares used in conventional systems.
- the sensors 210 are used to determine if a user's actions are consistent with instructions from the game, and the signals generated by the sensors correspond to detection of objects in each zone 240 - effectively emulating conventional dance-pad controllers used in dance-pad video games. For example, if the front sensor 210 detects an object, the invention will send an "up" signal to the connected video game console or computer. If the left sensor 210 detects an object, the invention will send a "left" signal to the connected video game console or computer, and so on.
- FIGS. 3a - 3f provide exemplary illustrations of object placement configurations and resultant sensor detections using the device 100 techniques described herein.
- an object may be placed within one or more of the sensed zones 240, thus triggering the sensor element(s) 210 associated with that zone 240.
- sensor elements that do not detect the presence of an object within its detection area are not triggered.
- FIG. 3a the user has not placed her foot in any of the zones 240, and therefore each of the sensors 210 is shown as unshaded (i.e., not activated).
- FIG. 3a the user has not placed her foot in any of the zones 240, and therefore each of the sensors 210 is shown as unshaded (i.e., not activated).
- FIG. 3a the user has not placed her foot in any of the zones 240, and therefore each of the sensors 210 is shown as unshaded (i.e., not activated).
- FIG. 3a the user has not placed her foot in any of the zones 240, and therefore each of the sensors
- FIGS. 3c though 3f illustrate other placements of the user's feet and the associated activation status of the sensors 210 for each zone 240.
- FIG. 4a illustrates a user's initial position standing atop a horizontal platform.
- the sensors 210 periodically (e.g., multiple times per second) emit radiation 405 into their effective area, but because the user has not placed either of her feet 410 in the zones corresponding to these areas, no signal is detected at the sensors 210.
- FIG. 4b the user has placed her foot 410 in one of the zones, and as such a portion of the emitted ray is reflected back to the sensor, thus activating the sensor 210'.
- FIG. 4c the user has placed both feet 410 into on or more zones, again reflecting radiation back to the activated sensors 210'.
- the device may, in this and other embodiments, use paired IR transmitters and receivers to optically detect object placement within one of the surrounding segments.
- the sensors may radiate pulsed IR light at 38 KHz from IR LEDs with a 20-degree beam width, and detect reflections from objects placed within the path of the IR light using corresponding (and conventional) IR receivers.
- the IR bursts commutate from position 1 to position 8, accounting for the eight sections surrounding the central unit. The bursts occur at approximately 10 millisecond intervals and each lasts for approximately one millisecond.
- each pulse burst approximately 38 cycles of a 38 kHz signal are radiated in each pulse burst, which is more than adequate to provide the three to ten 38 IcHz cycles necessary to initialize the IR sensors.
- the length of the pulse burst may be altered as necessary to balance the power consumption of the device and the visibility of the LED indicators (described below).
- the location and enclosure of the IR LEDs and the IR receiver circuitry may be altered according to various implementations; however, certain arrangements are more effective than others.
- the IR LEDs and receivers may be tilted slightly upwards, i.e., away from the floor.
- the output of each of the eight IR detectors may be connected to a visible red LED by using, for example, the negative-going outputs of the IR receivers to cause corresponding red LEDs to blink (at a 10 Hz rate, for example) when a reflection is received. This visual indication may be used to confirm proper circuit functions, but is not necessary for the proper operation of the device.
- FIG. 5 schematically illustrates one implementation of the invention.
- the device includes a 100 Hz oscillator circuit 505, which determines a time between pulse groups (10 milliseconds).
- the oscillator 505 drives a clock-driven CD4022 shift register 510 that cycles through eight outputs such that each output is polled every 12.5 milliseconds (100 Hz/8 outputs) and commutates through the outputs at the 100 Hz clock rate (since its CLK input is driven by the 100 Hz oscillator).
- Each of the outputs is provided as one of two inputs into an AND gate 515 (e.g., CD4081 devices).
- the output terminal of each AND gate is connected to an IR LED, which is only turned on when both inputs of the AND gate register HIGH.
- the IR LEDs require approximately 10 mA peak for proper range and avoidance of undesired feedback. Because the AND gates 515 are typically incapable of supplying more than 3 to 5 mA peak current pulses at 38 IcHz (for one millisecond per burst), eight PNP transistors 520 drive the IR LEDs 525.
- the oscillator 505 also drives a one-shot timer 530 that produces a one-millisecond, positive-going output. When that output is HIGH, the diode Dl is back-biased, allowing an R-C oscillator 535 to operate at approximately 38 IcHz. Because the one-shot timer 530 pulses HIGH for one millisecond every 10 milliseconds, the R-C oscillator 535 is only activated for the same one millisecond, thus producing a one millisecond long signal of a 38 IcHz square wave every 10 milliseconds. The 38 IcHz signal serves as the carrier for the IR transmission later in the circuit.
- oscillator 535 The output of oscillator 535 is isolated and inverted through a 74C14 hex inverter Schmitt trigger 545, which delivers a positive-going 38 IcHz burst to the second of the two inputs of the eight dual AND gates 515, providing the second trigger signal.
- an AND gate registers HIGH from the shift register 510 at the 100 Hz rate, it also registers HIGH from the R- C oscillator 535 at a rate of 38 kHz.
- each LED 525 is effectively turned on for a brief period, during which it strobes on and off at the faster 38 kHz rate.
- the power supply may be regulated to +5V by a 78L05 linear regulator fed by a 9V battery 540. This regulator may be included because the output frequency of the 38 kHz R-C oscillator 535 is voltage-dependent and should operate on a clean, noise- and jitter-free 5 V supply.
- FIG. 6 shows an alternate embodiment of the device, in which a general-purpose microcontroller 600 replaces some or all of the many discrete components illustrated in FIG. 5.
- the microcontroller 600 has adequate clock-requency stability over normal voltage and temperature ranges when operated using its internal or external clock. Therefore, the 9V battery and the regulator of FIG. 5 may be replaced by any suitable power source.
- the general-purpose microcontroller 600 supplies peak currents from its output ports (which are fed to the IR LEDs 525 sequentially and have a low duty cycle), and therefore transistors may not be required.
- the resulting peak current of the transmitting IR LEDs 525 is subject to variance depending on the type, brand, and tolerance of the employed IR LED 525 and the desired detection range of each sensing module. Although 10 mA is the approximate peak current contemplated for this embodiment, other peak currents are possible.
- the output of each of the IR receiver modules may, in some embodiments, be connected to a red LED for testing purposes and to provide the user with visible feedback as to the functionality of one or more of the sensing modules.
- the IR receivers generally require 4.5 to 5 volts to operate properly.
- the supply line may be decoupled from the rest of the circuitry by a 20-ohm (minimum) resistor bypassed with a 100 ⁇ F electrolytic capacitor to account for the fact that the IR receivers are susceptible to small levels of 38 IdHz signal on their supply terminals.
- the visible red LED anodes are tied together and connected to +5V via a common 300-ohm resistor.
- the outputs of the IR receiver modules are connected to eight inputs of a general-purpose microcontroller 600.
- the microcontroller converts the signals into a form that may be processed by a video game console, personal computer, or toy.
- the device may be used to replace a standard video game controller such as a dance-pad.
- Data may be communicated by a cable via any currently-known or future wired or wireless networking protocols or, alternatively, by a wireless transmitter module (including, but not limited to, radio frequency (RF), infrared, and other wireless data transmission methods if a wire-free device is desired.
- RF radio frequency
- the wireless transmission may employ one or more 802 protocols, e.g., 802. Hg, 802.11n, 802.1 Ix and/or 802.15 (i.e., Bluetooth).
- the wireless receiver may be connected directly to the videogame console, television-based videogame, toy, or other product which interfaces with the present invention.
- the device may also be directly integrated into a toy or game product.
- FIG. 7 shows exemplary circuitry 700 that may be used to convert the signals received by the device into a form that may be processed by a video game console 710 or personal computer. It should be understood that this circuitry is just one of the many possibilities, options, and methodologies of such interfacing.
- the inputs from the IR receivers are each input into a microcontroller.
- the input signal normally HIGH, pulses LOW for 1 millisecond every approximately 80 milliseconds.
- the input signal remains HIGH.
- the microcontroller examines each of the eight input signals in turn, and can continue to do so iteratively. If a low pulse is detected, the microcontroller outputs, on one of eight output pins corresponding to a matched input, a logic HIGH level.
- each of the eight outputs from the microcontroller is connected to an input of an array of analog switches 720 (e.g., CD4066BE switches), the outputs of which are correspondingly connected to a modified wireless video game controller 730.
- analog switches 720 e.g., CD4066BE switches
- Each analog switch emulates a physical button press on the modified wireless video game controller 730.
- this circuitry allows the device to be used as a video game controller attached to a video game console.
- Suitable source code in the C programming language to the firmware residing on the microcontroller for this example is as follows: void main (void) unsigned long right_count; unsigned long left_count; unsigned long up_count; unsigned long down_count; unsigned long a_count; unsigned long b_count; unsigned long start_count; unsigned long back_count; hardware initO; while (1)
- One alternative embodiment varies the carrier frequency from each of the eight IR LEDs and matched IR receiver.
- the device may use multiple carrier frequencies (including, but not limited to, 30 kHz, 33 IcHz, 36 kHz, 36.7 kHz, 38
- One effective approach is to alternate the frequency of adjacent IRLEDs and receivers between widely separated frequencies, for example, 30 IcHz and 56 IcHz.
- the invention may, in certain instances, use multiple sensors (in this example, IR LEDs and IR receivers) for each virtual zone in order to obtain a more accurate representation of a user's body part placement within a given zone around the center unit.
- sensors in this example, IR LEDs and IR receivers
- any number of IR LEDs and IR receivers may be used and will help to increase the accuracy of object placement within a particular zone.
- Software-based techniques may also be employed on the microcontroller to aid in the accurate detection of an object within a particular zone surrounding the device. Such techniques may comprise, as examples, modifying the IR transmitting and IR receiving order of the sensors surrounding the sensor unit (for example, activating the sensors in an order different from a sequential clockwise or counter-clockwise motion around the central unit), or the use of signal processing to aid in filtering the signal received from any sensor to help ensure that the reflected signal received is the proper signal destined for that particular sensor (for example, to prevent the sensor from receiving a signal intended for another, possibly nearby, sensor).
- Another embodiment of the present invention replaces the multiple IR LEDs and IR receivers with a single IR LED and receiver unit mounted onto a rotating arm or disc inside of the central unit.
- a motor drives the arm or disc in a clockwise or counterclockwise direction in an orientation parallel to the floor, commutating through the eight different positions.
- All of the necessary sensor electronics may be mounted onto the arm and the power input from the stationary base may be supplied via contacts to slip rings, also called rotary electrical joints.
- one or more patterns are projected onto the floor, each pattern (or segment thereof) corresponding to each of the segments surrounding the device.
- An optical detector co-located with the LED transmitting light sources normally receives light reflected from the floor when illuminated by these sequentially activated LEDs.
- the pattern comprises individual spots generated from a colored LED (for example, red to denote up/front, green to denote left, yellow to denote right, blue to denote down/back, and orange to denote the four corner locations). Adding such a visual indication of object detection can enhance the user experience; for example, the invention may blink or turn off the single spot generated from the LED corresponding to the segment that has detected an object, so the player knows the object was correctly sensed by the sensor. If the player puts a foot into the left position, for example, the green LED used to illuminate that particular area will be turned off to signify that the foot was correctly sensed.
- the LEDs may be used as status indicators which can be controlled by the video game console or other device or product in communication with the device.
- the LEDs may be used as a training aid or as additional instructional elements.
- a DDR-type game may include a "beginner mode" in which flashing LEDs denote the zone into which the user should next step.
- the LEDs may also be used for numerous other interactive experiences, and the illumination of the LEDs may be controlled either by the device, a game console, or an external product interfacing thereto.
- a delay may be added to the confirmed detection of an object by the sensing module. Since each of the sensing modules (comprising an IR LED and IR receiver module in this example) is, in certain embodiments, mounted slightly above the ground and angled upwards in order to prevent optical reflections from the floor, the object may be detected before it actually reaches the ground or floor. Thus, where the device is being used as a virtual dance pad or video game controller, a discrepancy can exist between the actual physical action and detection.
- Adding a small time delay between when the object is detected and when the object may be presumed to have reached the ground provides the user with feedback consistent with conventional controllers, in which the object must make physical contact with the controller's matrix switch connection located on the floor.
- This time delay can be added, for example, using a timer module internal to a general-purpose microcontroller, with a standard 555 timer module IC, or through software implemented on the microcontroller or other circuitry within the device.
- the IR receivers may be replaced by optical fibers, each of which guides one of the received reflected IR beams to a central location in the device. There, the IR light beam leaving each fiber is directed at a single, horizontally disposed IR receiver that is irradiated by reflected IR light picked up by the fiber and emitted at its opposite end. Additionally, each fiber's entry and exit geometry may be lensatic or supplemented by external lenses to increase the efficiency of light collection and delivery. [0046] Another embodiment of the present invention uses optical lenses and/or light guides (fabricated, for example, of plastic) to control the optical emissions transmitted from the IR transmitter and/or to control the optical emissions being received by the IR receiver.
- Such optical lenses may be placed between the sensors and the exterior of the device to help guide the direction of the transmitting and receiving energy, to reduce interference with other nearby sensors and/or to provide a more accurate sensing of an object that reflects the transmitter's energy.
- IR LED its transmitting half-angle (for example, 20 degrees)
- IR receiver its reception half- angle
- further exterior lenses may be used to help guide the light even more accurately.
- the sensors may sense an object as low to the floor as possible, which is particularly important when the device replaces the conventional dance-mats that sense a foot-strike at floor level.
- a capacitive or electric field sensor for example, the Freescale MC34940 or MC33794 sensors
- a capacitive or electric field sensor may be used to detect object positioning around the central unit.
- each electrode can detect a change in capacitance or electric field to determine if an object is in its detection range and, if so, the distance/proximity of the object and possibly the type of object (for example, distinguishing a human object from a nonliving material such as a carpet or plastic toy).
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Human Computer Interaction (AREA)
- General Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Computer Networks & Wireless Communication (AREA)
- Position Input By Displaying (AREA)
- Geophysics And Detection Of Objects (AREA)
Abstract
Description
Claims
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US70462305P | 2005-08-02 | 2005-08-02 | |
PCT/US2006/030213 WO2007016647A2 (en) | 2005-08-02 | 2006-08-02 | Object detection for an interactive human interface |
Publications (1)
Publication Number | Publication Date |
---|---|
EP1912714A2 true EP1912714A2 (en) | 2008-04-23 |
Family
ID=37651103
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
EP06789270A Withdrawn EP1912714A2 (en) | 2005-08-02 | 2006-08-02 | Object detection for an interactive human interface |
Country Status (3)
Country | Link |
---|---|
EP (1) | EP1912714A2 (en) |
JP (1) | JP2009502437A (en) |
WO (1) | WO2007016647A2 (en) |
Cited By (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US9849377B2 (en) | 2014-04-21 | 2017-12-26 | Qatar University | Plug and play tangible user interface system |
Families Citing this family (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
WO2009135964A1 (en) | 2008-05-09 | 2009-11-12 | Virtual Toys S.L. | Device and method for emulating a virtual musical instrument |
FR3095957A1 (en) | 2019-05-15 | 2020-11-20 | The Cube Company | Electronic device for interactive control of a software application installed on a communication terminal |
Family Cites Families (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US5139261A (en) * | 1989-09-15 | 1992-08-18 | Openiano Renato M | Foot-actuated computer game controller serving as a joystick |
US5442168A (en) * | 1991-10-15 | 1995-08-15 | Interactive Light, Inc. | Dynamically-activated optical instrument for producing control signals having a self-calibration means |
-
2006
- 2006-08-02 WO PCT/US2006/030213 patent/WO2007016647A2/en active Application Filing
- 2006-08-02 JP JP2008525174A patent/JP2009502437A/en active Pending
- 2006-08-02 EP EP06789270A patent/EP1912714A2/en not_active Withdrawn
Non-Patent Citations (1)
Title |
---|
See references of WO2007016647A2 * |
Cited By (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US9849377B2 (en) | 2014-04-21 | 2017-12-26 | Qatar University | Plug and play tangible user interface system |
Also Published As
Publication number | Publication date |
---|---|
WO2007016647A3 (en) | 2007-03-29 |
JP2009502437A (en) | 2009-01-29 |
WO2007016647A2 (en) | 2007-02-08 |
WO2007016647A9 (en) | 2007-05-10 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US20080039199A1 (en) | Object detection for an interactive human interface device | |
US20230208420A1 (en) | Method and apparatus for ranging finding, orienting and/or positioning of single and/or multiple devices and/or device and method for orientation and positioning | |
CN110152322B (en) | Toy building system with function building elements | |
US9555338B2 (en) | Baseplate assembly for use with toy pieces | |
EP2486964B1 (en) | Information processing system, information processing program, information processing apparatus, input device, and information processing method | |
US8058975B2 (en) | Remote control device, in particular a wand having motion detection | |
US8298084B2 (en) | Multi-player game controller system with combinable hand-held game controllers | |
US20080004111A1 (en) | Non Impact Video Game Controller for Dancing Games | |
WO2003100568A2 (en) | Interactive modular system | |
US11047949B2 (en) | Infrared sensor assembly and positioning system | |
WO2007016647A2 (en) | Object detection for an interactive human interface | |
US20100309154A1 (en) | Two-dimensional input device, control device and interactive game system | |
US20190105579A1 (en) | Baseplate assembly for use with toy pieces | |
US20100309155A1 (en) | Two-dimensional input device, control device and interactive game system | |
KR20190029297A (en) | An exercise gaming system based on signaling means for triggering action responses and monitoring sensors for the responses | |
JP7137285B2 (en) | game controller | |
US9461644B2 (en) | Method and apparatus for tap-sensing electronic switch to trigger a function in an electronic equipment | |
CN112631417B (en) | Immersive multimedia system, immersive interaction method and movable interaction unit | |
US20140327377A1 (en) | System and a method for emitting an ultrasonic signal | |
KR101694281B1 (en) | Multi direction input device | |
CN112558756A (en) | Control input device | |
JP2021103511A5 (en) |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
PUAI | Public reference made under article 153(3) epc to a published international application that has entered the european phase |
Free format text: ORIGINAL CODE: 0009012 |
|
17P | Request for examination filed |
Effective date: 20080220 |
|
AK | Designated contracting states |
Kind code of ref document: A2 Designated state(s): AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HU IE IS IT LI LT LU LV MC NL PL PT RO SE SI SK TR |
|
17Q | First examination report despatched |
Effective date: 20080516 |
|
REG | Reference to a national code |
Ref country code: HK Ref legal event code: DE Ref document number: 1110541 Country of ref document: HK |
|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: THE APPLICATION IS DEEMED TO BE WITHDRAWN |
|
18D | Application deemed to be withdrawn |
Effective date: 20081127 |
|
REG | Reference to a national code |
Ref country code: HK Ref legal event code: WD Ref document number: 1110541 Country of ref document: HK |