WO2023044154A2 - Suivi et déclenchement basés sur thérémine - Google Patents

Suivi et déclenchement basés sur thérémine Download PDF

Info

Publication number
WO2023044154A2
WO2023044154A2 PCT/US2022/044121 US2022044121W WO2023044154A2 WO 2023044154 A2 WO2023044154 A2 WO 2023044154A2 US 2022044121 W US2022044121 W US 2022044121W WO 2023044154 A2 WO2023044154 A2 WO 2023044154A2
Authority
WO
WIPO (PCT)
Prior art keywords
theremin
antenna
tracking system
signal processor
body part
Prior art date
Application number
PCT/US2022/044121
Other languages
English (en)
Other versions
WO2023044154A3 (fr
Inventor
Thomas Owen WILLIAMS
Brandon David BURNETTE
Patrick John GOERGEN
Original Assignee
Universal City Studios Llc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Priority claimed from US17/947,488 external-priority patent/US20230090805A1/en
Application filed by Universal City Studios Llc filed Critical Universal City Studios Llc
Priority to EP22792956.9A priority Critical patent/EP4405789A2/fr
Priority to CA3231107A priority patent/CA3231107A1/fr
Priority to KR1020247012649A priority patent/KR20240056625A/ko
Priority to CN202280063611.3A priority patent/CN117980868A/zh
Publication of WO2023044154A2 publication Critical patent/WO2023044154A2/fr
Publication of WO2023044154A3 publication Critical patent/WO2023044154A3/fr

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/017—Gesture based interaction, e.g. based on a set of recognized hand gestures
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
    • G06F3/041—Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means
    • G06F3/044—Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means by capacitive means
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
    • G06F3/041—Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means
    • G06F3/046—Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means by electromagnetic means
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F2203/00—Indexing scheme relating to G06F3/00 - G06F3/048
    • G06F2203/041—Indexing scheme relating to G06F3/041 - G06F3/045
    • G06F2203/04101—2.5D-digitiser, i.e. digitiser detecting the X/Y position of the input means, finger or stylus, also when it does not touch, but is proximate to the digitiser's interaction surface and also measures the distance of the input means within a short range in the Z direction, possibly with a separate measurement setup

Definitions

  • the present disclosure generally relates to systems for sensing a presence/motion of a body part (e.g., person’ s hand), and more particularly, to tracking the presence/motion of the body part via a theremin-based sensor and outputting a usable signal.
  • a body part e.g., person’ s hand
  • the present disclosure is directed to a system for tracking a presence or motion of a person’s hand (and/or body) using a theremin-based sensing device.
  • the theremin-based sensing device allows the system to sense hand presence/motion without requiring a direct line of sight with the person’s hand.
  • aspects of the disclosure relate to methods, apparatus, and systems for tracking a presence of a body part via a theremin-based sensor and outputting a usable signal. Other aspects, embodiments, and features are also claimed and described.
  • a theremin-based tracking system includes a signal processor and a theremin circuit including at least one antenna.
  • the theremin circuit is configured to detect a varying position of a body part relative to the at least one antenna, and output to the signal processor an analog signal having a varying frequency or amplitude based on the varying position of the body part relative to the at least one antenna.
  • the signal processor is configured to determine a rate of change of the varying frequency or amplitude of the analog signal, determine at least a velocity of the body part based on the rate of change, and output a digital signal corresponding to at least the velocity to another system or device coupled to the signal processor.
  • the system may further include a cable made of a conductive material and positioned in parallel to the at least one antenna, wherein the cable is insulated from the theremin circuit, the signal processor, and the at least one antenna, and wherein the at least one antenna wirelessly attenuates to the cable.
  • the system may also include a water medium filled with water, wherein the cable is inserted in the water medium, and the at least one antenna wirelessly attenuates to the cable inserted in the water medium.
  • a method of tracking a body part includes detecting, via a theremin circuit, a varying position of a body part relative to at least one antenna, outputting, from the theremin circuit to a signal processor, an analog signal having a varying frequency or amplitude based on the varying position of the body part relative to the at least one antenna, determining, via the signal processor, a rate of change of the varying frequency or amplitude of the analog signal, determining, via the signal processor, at least a velocity of the body part based on the rate of change, and outputting, from the signal processor, a digital signal corresponding to at least the velocity to another system or device coupled to the signal processor.
  • FIG. 1 is a block diagram of an example theremin circuit.
  • FIG. 2 illustrates an example ride vehicle implementing a theremin-based tracking system according to an aspect of the present disclosure.
  • FIG. 3 is a diagram illustrating a virtual reality (VR)/augmented reality (AR) headset utilized by a person in connection with a theremin-based tracking system according to an aspect of the present disclosure.
  • VR virtual reality
  • AR augmented reality
  • FIG. 4 illustrates a theremin-based tracking system implementing wireless triggering according to an aspect of the present disclosure.
  • FIG. 5 is a block diagram illustrating an example theremin-based tracking system for tracking a presence and/or motion of a body part according to an aspect of the present disclosure.
  • FIG. 6 is a flow chart illustrating an exemplary process for tracking a presence and/or motion of a body part using a theremin-based tracking system according to an aspect of the present disclosure.
  • the present disclosure relates to tracking hand (or body) presence/motion via a theremin-based sensing device and outputting a usable signal (e.g., used for an amusement park game or interactive attraction).
  • Theremin technology may operate based on changes in frequency and/or amplitude of frequency that may be induced in a signal when a certain object (e.g., a person's hand) is proximate to a capacitive electrode.
  • a theremin is an electronic musical instrument controlled without physical contact by a person operating the theremin.
  • the theremin may include two metal antennas that sense the relative position of the person’s hands and control oscillators for varying the frequency (pitch) of a signal via one hand and the amplitude of the frequency (volume) via the other hand.
  • the theremin uses electromagnetic fields to output analog signals of varying frequency (pitch) and amplitude (volume) depending on where the person’s hands are placed relative to the two antennas on the theremin.
  • Electric analog signals from the theremin may be processed (e.g., amplified) and sent to a loudspeaker to output an audible signal.
  • the electric analog signals of varying frequency and/or amplitude output from the theremin may be processed into digital data usable for other applications.
  • a processor may process the analog signals from the theremin and output digital data that may be provided to an electronic game played by the person controlling the theremin or used to trigger an interactive attraction.
  • the digital data may be positioning data of the person’s hand relative to one or more of the theremin antennas for tracking hand movement (e.g., X and Y coordinates), which may then be output to the electronic game or interactive attraction.
  • a theremin-based tracking system including a theremin circuit and a signal processor (which may be part of the theremin circuit) may be built into an amusement park ride vehicle lap bar and themed accordingly.
  • the theremin-based tracking system may be a standalone device within an attraction or interactive area of the amusement park.
  • the theremin-based tracking system allows for the tracking of a person’s hand (or body) using electromagnetics without using a camera-based system.
  • the theremin-based tracking system may perform the hand (or body) tracking without requiring a direct line of sight with the person’s hand (or body), as required by the camera-based system.
  • signals from the theremin-based tracking system may wirelessly attenuate to a cable not physically connected to the signal processor, the theremin circuit and/or the antennas. Accordingly, the theremin-based tracking system may wirelessly attenuate from an antenna coupled to the theremin circuit (e.g., circuit board) to a cable (e.g., HDMI cable, Ethernet cable, or any other cable made of conductive material). Through the cable, the theremin-based tracking system may be triggered to output a usable signal, such as to move a virtual element in a video game (e.g., throw a virtual ball) via software, trigger/enable an effect of an interactive attraction (e.g., shoot water cannon), or trigger an alarm or safety system.
  • a usable signal such as to move a virtual element in a video game (e.g., throw a virtual ball) via software, trigger/enable an effect of an interactive attraction (e.g., shoot water cannon), or trigger an alarm or safety system.
  • the cable may interact with a water medium to facilitate triggering of the tracking system.
  • the cable e.g., HDMI cable
  • the theremin-based tracking system wirelessly attenuates to the cable inserted in the bucket of water, a person may physically put his/her hand in the bucket of water, or near the water, to cause the theremin-based tracking system to be triggered.
  • FIG. 1 is a block diagram of an example theremin circuit 100.
  • Volume i.e., amplitude of frequency
  • Pitch i.e., frequency
  • Audio output is controlled via an output control circuit 106.
  • the theremin circuit 100 may be operated by a person without physical contract.
  • the person near the theremin circuit 100 may move his/her hands in the proximity of two metal antennas 110, 120.
  • the distance from a pitch antenna 120 (or frequency antenna 120) controls pitch (frequency), and the distance from a volume antenna 110 (or amplitude antenna 110) controls volume (amplitude).
  • Narrower frequency waves (higher notes) may be generated when the person’s hand moves closer to the pitch antenna 120.
  • Taller amplitude waves (louder notes) may be generated when the person’s hand moves away from the volume antenna 110.
  • the theremin circuit 100 may use the heterodyne principle to generate an audio signal.
  • the frequency control circuit 104 may include includes two radio frequency oscillators 122, 124 set below 500 kHz to minimize radio interference.
  • a reference oscillator 122 operates at a fixed frequency.
  • the frequency of a pitch oscillator 124 is almost identical, and is controlled by the person’s distance from the pitch antenna 120.
  • the person’s hand acts as the grounded plate (the person's body being the connection to ground) of a variable capacitor in an L-C (inductance-capacitance) circuit, which is part of the pitch oscillator 124 and determines its frequency.
  • the pitch antenna 120 is directly coupled to the tuned circuit of the pitch oscillator 124 and the “pitch field”, that is the change of note with distance, is highly nonlinear, as the capacitance change with distance is far greater near the pitch antenna 120. In such implementations, when the pitch antenna 120 is removed, the pitch oscillator 124 moves up in frequency.
  • the pitch antenna 120 may be wired in series with an inductor to form a series tuned circuit, resonating with the parallel combination of the antenna's intrinsic capacitance and the capacitance of the person’s hand in proximity to the pitch antenna 120.
  • This series tuned circuit is then connected in parallel with the parallel tuned circuit of the variable pitch oscillator 124.
  • the pitch oscillator 124 With the antenna circuit disconnected, the pitch oscillator 124 is tuned to a frequency slightly higher than the standalone resonant frequency of the antenna circuit. At that frequency, the pitch antenna 120 and its linearization coil present an inductive impedance; and when connected, behaves as an inductor in parallel with the pitch oscillator 124.
  • connecting the pitch antenna 120 and linearizing coil raises the oscillation frequency. Close to the resonant frequency of the antenna circuit, the effective inductance is small, and the effect on the pitch oscillator 124 is greatest; farther from it, the effective inductance is larger, and fractional change on the pitch oscillator 124 is reduced.
  • the resonant frequency of the antenna series circuit is at its highest; i.e., it is closest to the free running frequency of the pitch oscillator 124, and small changes in antenna capacitance have greatest effect.
  • the effective inductance in the tank circuit is at its minimum and the oscillation frequency is at its maximum.
  • the steepening rate of change of shunt impedance with hand position compensates for the reduced influence of the hand being further away.
  • a near linear region of pitch field can be created over the central 2 or 3 octaves of operation.
  • circuits can be made where a change in capacitance between the person and the theremin circuit in the order of 0.01 picofarads produces a full octave of frequency shift.
  • a mixer 126 produces the audio-range difference between the frequencies of the two oscillators 122, 124 at each moment, which is the tone that is then wave shaped (via a low-pass filter 128), and amplified (via an amplifier 130) and sent to a loudspeaker 132 of the output control circuit 106.
  • the person’s other hand acts as the grounded plate of another variable capacitor.
  • the distance between the person’s hand and the volume antenna 110 determines the capacitance and hence natural resonant frequency of an LC circuit inductively coupled to another fixed LC oscillator circuit operating at a slightly higher resonant frequency.
  • the natural frequency of that circuit is lowered by the extra capacitance, which detunes a volume oscillator 112 and lowers its resonant plate current.
  • the RF plate current of the volume oscillator 112 may be picked up by another winding and used to power the filament of another diode- connected triode, which thus acts as a variable conductance element changing the output amplitude.
  • a signal output from the volume oscillator 112 may be passed through a bandpass filter 114 and an envelope detector 116 prior to being forwarded to the amplifier 130.
  • the output control circuit 106 receives signals from the amplitude control circuit 102 and the frequency control circuit 104 to output an audible signal.
  • the output control circuit 106 may also be configured to process the signals received from the amplitude control circuit 102 and/or the frequency control circuit 104 to output digital data usable for other applications (e.g., amusement park game, interactive attraction, safety system, etc.).
  • applications e.g., amusement park game, interactive attraction, safety system, etc.
  • FIG. 2 illustrates an example ride vehicle 200 implementing a theremin-based tracking system according to an aspect of the present disclosure.
  • the ride vehicle 200 may include a seat 202 in which a person operating the ride vehicle 200 may sit.
  • the ride vehicle 200 may further include a frame 204 for supporting the seat 202, as well as front wheels 206 and rear wheels 208 for facilitating movement of the ride vehicle 200.
  • the ride vehicle 200 may also include lap bars 210 extending from a lower surface of the ride vehicle 200 below the seat 202.
  • the lap bars 210 may be movably positioned to rest above the person’s lap when the person is sitting in the seat 210.
  • the lap bars 210 may serve to safely restrain the person from falling out of the seat 202 when the ride vehicle 200 is moving.
  • the lap bars 210 may serve as mechanisms to control movement of the ride vehicle 200 or any other effect associated with the ride vehicle 200. As shown in FIG. 2, the lap bars 210 are two separate elements. However, in some aspects, a single lap bar 210 extending from a lower surface of the ride vehicle 200 below the seat 202, or from a higher surface, may be implemented to be movably positioned above the lap of the person sitting in the seat 202.
  • a way in which antennas of a theremin-based tracking system are used may depend on the number of antennas enabled in the system. For example, if both a frequency antenna (for sensing frequency changes) and an amplitude antenna (for sensing amplitude changes) are enabled, then either one of the antennas can be used to determine how fast a signal is changing. If the amplitude antenna is enabled, then the theremin-based tracking system can determine how short or tall a wave (signal) becomes and the rate at which the wave changes (becomes shorter or taller). If the frequency antenna is enabled, then the theremin-based tracking system can determine how narrow or wide the wave (signal) becomes and the rate at which the wave changes (narrows or widens).
  • a frequency antenna (e.g., frequency antenna 120) and/or an amplitude antenna (e.g., amplitude antenna 110) of the theremin-based tracking system may be implemented in the lap bar 210 of the ride vehicle 200. Accordingly, hand motion can be sensed based on how the person in the seat 202 moves his/her hand while he/she is sitting in the seat 202.
  • the theremin circuit (via the antennas) can sense where the hand is in space and output a corresponding signal to a signal processor (e.g., digital processor) coupled to, or part of, the theremin circuit.
  • the signal processor may then process the corresponding signal to output digital data usable for different applications.
  • the digital data may be used to trigger a safety system if the theremin-based tracking system is used to detect whether the person remains seated in the seat 202.
  • the digital data may be used in a game being displayed on a screen, to activate an interactive element of the ride vehicle 200 or other attraction, or to trigger an effect from an effects engine.
  • the input for the theremin circuit may be interference from any conductive material.
  • the lap bar 210 itself may serve as an antenna or “tracker” of the theremin circuit.
  • Other objects made of conductive material, such as door handles, doorways, etc. may also be used as an antenna.
  • the theremin-based tracking system may not only be used to track hand gestures, but also to track gestures from any body part in general. For example, any body part (e.g., leg, thigh, head, arm, etc.) that interacts with the theremin-based tracking system may cause the system to be triggered. Accordingly, the theremin-based tracking system may be used to track a person walking through a doorway or sitting in a seat without needing a camera or other optical-based sensor.
  • the signal processor may be an iOS or any other type of processing circuit.
  • the signal processor includes code or instructions configured to receive data from the theremin circuit (e.g., changes in the attenuation of a signal; changes in the frequency or amplitude of a wave, etc.) and converts the theremin circuit data into data (e.g., digital data) usable for other applications.
  • the signal processor may send the usable data over a transport medium (e.g., USB, Ethernet, etc.) to a system or device for use in an application (e.g., video game, interactive attraction, etc.) being executed thereon.
  • the theremin circuit generates a signal and determines the manipulation of the signal.
  • the signal processor is configured to digitize signals from the theremin circuit and send the digitized signals to a game or other system (e.g., interactive attraction) that the signal processor interfaces with.
  • FIG. 3 is a diagram 300 illustrating a virtual reality (VR)/augmented reality (AR) headset 304 utilized by a person 302 in connection with a theremin-based tracking system according to an aspect of the present disclosure.
  • the person 302 is sitting in the seat 202 of the ride vehicle 200 of FIG. 2.
  • the headset 304 includes an inertial measurement unit (IMU) facilitating directional positioning based on where the person’s head is pointed (where the person is looking).
  • IMU inertial measurement unit
  • the theremin-based tracking system may be used as a velocity trigger system.
  • the theremin-based hand tracking system (e.g., using a theremin circuit and a signal processor) may determine a velocity of the person’s hand movement from point A to point B.
  • the signal processor coupled to the theremin circuit may calculate how fast to move an object appearing on a screen of the headset 304.
  • the determined hand velocity information may also trigger other effects displayed on the headset 304, e.g., a laser beam, a ball throw, an element to move on the screen at a certain speed, etc.
  • the person 302 wears the headset 304 and observes a video game displayed on the screen of the headset 304.
  • the person 302 is to throw a virtual ball by physically moving an arm/hand in a throwing motion.
  • the theremin-based tracking system coupled to the headset 304 may determine how hard the person 302 throws the ball to create a velocity arc (the display of how the virtual ball travels) in the video game.
  • the theremin-based tracking system may also determine if the throw was a short throw or a long throw.
  • the theremin- based tracking system may determine how fast an object (e.g., person’s hand) moves through the theremin field.
  • the ability to determine the velocity of the object allows the system to gather information about how a person moves through the theremin field (not only the position of the person’s hand in the theremin field) to, e.g., trigger the virtual ball throw.
  • the gathered information may be fed into the game, which is then used to generate the virtual ball onto the screen of the headset 304, and further used to eventually throw the virtual ball in the virtual world.
  • either one of the frequency antenna or the amplitude antenna of the theremin-based tracking system may be used to determine a velocity of the person’s hand movement.
  • the frequency antenna as an example, if the person 302 performs a chopping hand motion over the top of the frequency antenna, the frequency will increase as the person’s hand moves closer to the frequency antenna, thus creating narrower waves. The frequency will decrease as the person’s hand moves farther away from the frequency antenna, thus creating wider waves.
  • a rate of change from a narrow wave to a wide wave is the velocity at which the person’s hand moves through the field. So as the person’s hand chops down toward the frequency antenna, the rate of change from the narrow wave to the wide wave (or vice versa) may determine the velocity of the hand movement.
  • the amplitude antenna As an example, if the person 302 performs the chopping hand motion over the top of the amplitude antenna, the amplitude will increase as the person’s hand moves closer to the amplitude antenna, thus creating taller waves. The amplitude will decrease as the person’s hand moves farther away from the amplitude antenna, thus creating shorter waves.
  • a rate of change from a tall wave to a short wave is the velocity at which the person’s hand moves through the field. So as the person’s hand chops down toward the amplitude antenna, the rate of change from the tall wave to the short wave (or vice versa) may determine the velocity of the hand movement.
  • one antenna of the theremin-based tracking system may track one hand of the person 302 and the other antenna of the tracking system may track the other hand of the person 302.
  • the lap bar 210 of the ride vehicle 200 may be implemented with the theremin-based tracking system, wherein one antenna may extend to the left side of the lap bar 210 to track the left-hand movement of the person sitting in the seat 202 and another antenna may extend to the right side of the lap bar 210 to track the right-hand movement of the person.
  • the antenna tracking the left-hand movement may determine left-hand velocity via changes in amplitude and the antenna tracking the right-hand movement may determine right-hand velocity via changes in frequency, or vice versa.
  • the two antennas of the theremin-based tracking system operate independently of each other. Manipulation of the frequency antenna does not affect the amplitude antenna, and vice versa.
  • one antenna can track changes in the wave for one hand (e.g., track changes in the amplitude of the wave based on left-hand movement) and the other antenna can track changes in the wave for the other hand (e.g., track changes in frequency of the wave based on right-hand movement).
  • the theremin-based tracking system may determine velocity from both hands independently of each other.
  • the person 302 may perform a throw with the right hand and the theremin-based tracking system will read the change in frequency to determine the velocity of the right-hand throw.
  • the person 302 may perform a throw with the left hand and the theremin-based tracking system will read the change in amplitude to determine the velocity of the left-hand throw.
  • the two antennas are independent of each other, the person 302 can perform both the left-hand throw and the right-hand throw at the same time, or at different rates, and the theremin-based tracking system will be able to determine the velocities of the throws from one hand independent from the throws of the other hand.
  • the lap bar 210 may be implemented with one theremin-based tracking system having two antennas that operate independently of each other.
  • the lap bar 210 may be implemented with multiple theremin-based tracking systems that operate independently of each other.
  • the multiple theremin-based tracking systems may work separately to track multiple larger areas.
  • one theremin- based tracking system may track hand movement on the left side of the lap bar 210 and another theremin-based tracking system may track hand movement on the right side of the lap bar 210.
  • Antennas of one tracking system may be separated from antennas of the other tracking system by a grounding barrier (e.g., wire mesh pulled to ground) to isolate signals emanating from a respective tracking system. Accordingly, both left-hand movements and right-hand movements of the person may be tracked by either of the two tracking systems implemented in the lap bar 210.
  • a grounding barrier e.g., wire mesh pulled to ground
  • the person 302 wears the headset 304 and observes a video game displayed on a screen of the headset 304.
  • the person 302 rides a virtual motorcycle (or other object).
  • the person 302 may hold a physical stick with a handle made of metal or any other conductive material.
  • the physical stick handle may be configured to be an antenna of a theremin-based tracking system. Accordingly, as the person’s hands get closer to or farther from the physical stick handle, the tracking system can distinguish a direction of hand movement, and further output signals (via a signal processor) to the video game to show the person’s hands in game getting closer to or farther from the virtual motorcycle based on the position of the person’s hands on the physical stick handle.
  • gestures may be realized.
  • the theremin-based tracking system may detect a swipe gesture or any number of movements from the person 302 to enable an effect.
  • the theremin-based tracking system may detect where the person 302 is grabbing the physical stick handle and output signals (via the signal processor) to the video game to show the person’s hands in game grabbing the virtual motorcycle in the same position where the person 302 grabs the physical stick handle.
  • the theremin-based tracking system may detect how far forward the person’s hands are on the physical stick handle, and consequently, determine how far forward the person is physically leaning (via the change in frequency or amplitude of a wave).
  • the tracking system may include additional sensor circuitry to determine how far forward the person is physically leaning based on the height of the person. The tracking system may then output corresponding signals (via the signal processor) to the video game to control the speed of the virtual motorcycle in game.
  • how far forward the person 302 places his/her hand on the physical stick handle impacts how fast the person 302 travels on the virtual motorcycle in game.
  • the theremin-based tracking system is implemented on the lap bar 210 of the ride vehicle 200.
  • the person’s hands are generally on top of the lap bar 210. If the person lifts his/her hand up and performs a throwing motion over the top of the lap bar 210, the tracking system can measure how fast the hand travels through the theremin field via the change (delta) in the frequency of the wave (or the amplitude of the wave). Using the measurements, the tracking system (via the signal processor) can then generate a ball throw velocity for use in a game being observed through the headset 304.
  • the headset 304 is used as a separate tracking system to determine a direction of the ball throw, not the velocity at which the ball is thrown.
  • the theremin-based tracking system tracks the person’s hand, which controls the velocity of the ball throw. The direction of the ball throw is tracked by the headset 304 depending on where the person’s head is pointed (or where the person’s eyes are looking).
  • the theremin-based tracking system (e.g., antennas, theremin circuit, and signal processor) is implemented on the lap bar 210 of the ride vehicle 200.
  • the theremin-based tracking system may also be implemented in the headset 304. Accordingly, the velocity of hand movement may also be determined based on the person moving his/her hands in proximity to the headset 304.
  • the theremin-based tracking system (e.g., theremin circuit and signal processor) may approximately have a length of 100-200 mm, a width of 50-100 mm, and a thickness of 2-20 mm.
  • the size of the antennas of the tracking system may depend on the type of conductive material used (e.g., copper tape may be used as an antenna).
  • an entire theremin-based tracking system may be made of just a circuit board and an antenna, wherein the antenna may be the lap bar 210 of the ride vehicle 200.
  • the hand tracking system may be a combination of the circuit board coupled to the lap bar 210 and changes in frequency or amplitude of a wave may be measured relative to the lap bar 210.
  • the theremin-based tracking system may include a calibration sequence where the system detects an environment the device is currently in and filters all frequencies that currently interfere with the system. Accordingly, the system only senses new medium or motion that is added to (or interfering with) the field.
  • a calibration sequence ensures that the environment does not interfere with the theremin- based tracking system. That is, the theremin-based tracking system ensures that changes sensed by the system are due to the person and not the environment.
  • FIG. 4 illustrates a theremin-based tracking system 400 implementing wireless triggering according to an aspect of the present disclosure.
  • the system 400 may include a theremin circuit 402 (including a signal processor) coupled to a lap bar 404 of a ride vehicle.
  • the lap bar 404 may extend from a ride vehicle floor 406 via support bars 408.
  • the ride vehicle and a seat of the ride vehicle are not shown.
  • the system 400 may also include a first antenna 410 extending vertically from the theremin circuit 402 and a second antenna 412 extending horizontally from the theremin circuit 402 within the lap bar 404.
  • the system 400 may further include a wire or cable 414 made of a conductive material (e.g., HDMI cable, Ethernet cable, etc.) running in parallel to the first antenna 410 and the second antenna 412.
  • the wire or cable 414 may or may not be housed within the lap bar 404. Attenuation from the first antenna 410 or the second antenna 412 allows the wire or cable 414 in parallel to act as an extension of an antenna.
  • the wire or cable 414 used as the antenna extension is not directly (or electrically) coupled to an electronic portion of the system 400 (i.e., the wire or cable 414 is not directly attached to either of the antennas 410, 412 or the theremin circuit 402)
  • the wire or cable 414 may perform as a wireless trigger of the system 400. Accordingly, a person touching or moving his/her hand near the wire or cable 414 will trigger the theremin circuit 402 to output a signal having a varying frequency or amplitude.
  • the wire or cable 414 may be placed in a water medium 416 (e.g., bucket, bowl, or any other container capable of holding water) filled with water.
  • the water medium 416 may also perform as a wireless trigger of the system 400 via the cable 414.
  • a person touching, or moving his/her hand near, the water medium 416 will trigger the theremin circuit 402 to output a signal having a varying frequency or amplitude.
  • the system 400 may output digital data usable for different applications, such as data used to trigger a safety system, output game movement on a screen, activate an interactive element of a ride vehicle or other attraction, or trigger and effect from an effects engine.
  • both the first antenna 410 and the second antenna 412 are separated/insulated from the wire or cable 414 by an insulative material.
  • the insulative material prevents electricity from conducting through the wire or cable 414.
  • the lap bar 404 may be made of an insulative material (e.g., plastic). Accordingly, if the wire or cable 414 is housed in the lap bar 404, then the first antenna 410 is insulated from the wire or cable 414 via an outer wall (e.g., plastic wall) of the lap bar 404.
  • the second antenna 412 and the wire or cable 414 may be separated within the lap bar 404 by an inner wall 418 made of an insulative material (e.g., plastic).
  • the wire or cable 414 being insulated from both of the antennas 410, 412 and the theremin circuit 402 (including the signal processor) creates a wireless button (or trigger) having a negligible amount of electricity running through it.
  • a wireless button or trigger
  • the wire or cable 414 when the wire or cable 414 is inserted into the water medium 414 filled with water, and a person touches, or moves his/her hand near, the water medium 414, the water medium 414 manipulates the frequency (or amplitude) of a wave, thus becoming a wireless button (or trigger) having no measurable electricity running through the water medium 416 or the wire or cable 414.
  • the wireless button only changes the attenuation of the system 400.
  • the provision of wireless triggering in the system 400 is desirable since it does not require the introduction of electricity into a body of water.
  • the theremin-based tracking system can monitor the body of water without having to send a voltage through it, thus creating a safer system.
  • the water medium 416 is not necessary to create the wireless button/enable wireless triggering of the tracking system.
  • a person touching, or moving his/hand near, the wire or cable 414 alone is sufficient to manipulate the frequency (or amplitude) of the wave, and thus, create the wireless button/enable wireless triggering of the tracking system.
  • the wireless button may be used in an interactive attraction (e.g., a water-based interactive, such as shooting a water cannon).
  • an interactive attraction e.g., a water-based interactive, such as shooting a water cannon
  • the wireless trigger may be implemented in a pool (e.g., for a water park) to make the pool interactive.
  • the wireless trigger may activate a special effect (e.g., water cannon shooting).
  • the water in the pool may act as the antenna of the wireless trigger.
  • the rate (velocity) at which a person jumping from a diving board and entering the pool may be detected based on the person’s movement respective to the water. Accordingly, different types of effects may be activated based on the person’s velocity.
  • the wireless trigger via the theremin-based tracking system
  • the wireless trigger via the theremin-based tracking system
  • touching the wireless trigger is not necessary to activate an effect.
  • any of the effects described above may be activated by a person placing his/her hand near (but not touching) the wireless trigger.
  • a wireless trigger (utilizing a theremin-based tracking system) may be implemented as a musical instrument using a water medium (e.g., water drum).
  • a theremin-based tracking system may be configured to operate with a bucket of water as a wireless trigger. Accordingly, when a person smacks, hits, or touches the water within the bucket, the theremin-based tracking system will be triggered to output a signal to a loudspeaker or some other type of audio processing circuit/device to generate a sound or musical note. A velocity at which the person’s hand touches the water may determine a volume of the generated sound or musical note.
  • the theremin-based tracking system may be implemented in various types of safety systems. For example, when the theremin-based tracking system is triggered (detects hand or body movement), the tracking system may output a signal to enable a safety system. In some aspects, the tracking system may output an analog signal (e.g., voltage) to an analog-based safety system.
  • an analog signal e.g., voltage
  • the safety system may be a detection system. For example, if a person riding in a seat of a ride vehicle is ejected from, or somehow leaves the seat during the ride, the safety system (via the theremin circuit) may detect that the person is out of the seat and output a signal to stop the ride.
  • the safety system may detect a physical presence of any body part, or an entire body, depending on how the system is implemented.
  • the theremin-based tracking system may be implemented as a person tracker.
  • the tracking system may track if a person is sitting in a ride seat or if a person is walking through a doorway and output a corresponding signal to another system.
  • the tracking system may be triggered to output a response to another system or device to enable, e.g., an animated figure, a light emitting diode (LED), a safety system, an alarm, etc.
  • a person tracker may track if a person is sitting in a ride seat or if a person is walking through a doorway and output a corresponding signal to another system.
  • the tracking system may be triggered to output a response to another system or device to enable, e.g., an animated figure, a light emitting diode (LED), a safety system, an alarm, etc.
  • LED light emitting diode
  • the theremin-based tracking system may be implemented in a safety system or alarm system for a pool. For example, if a person falls into the pool, the tracking system may be triggered to output an emergency notification signal to a safety system.
  • a pool may be closed to the public during certain hours (e.g., during the evening). Accordingly, detection of an unauthorized person in the pool may trigger the tracking system to output an alarm signal to an alarm system.
  • FIG. 5 is a block diagram illustrating an example theremin-based tracking system 500 for tracking a presence and/or motion of a body part (e.g., person’s hand) according to an aspect of the present disclosure.
  • the tracking system 500 includes a signal processor 502 and a theremin circuit 504 including at least one antenna 506 (e.g., frequency antenna and/or amplitude antenna).
  • antenna 506 e.g., frequency antenna and/or amplitude antenna
  • the theremin circuit 504 detects a varying position of a body part (e.g., person’s hand or other body part) relative to the at least one antenna 506. Moreover, the theremin circuit 504 outputs to the signal processor 502 an analog signal having a varying frequency or amplitude based on the varying position of the body part relative to the at least one antenna 506.
  • a body part e.g., person’s hand or other body part
  • the signal processor 502 determines a rate of change of the varying frequency or amplitude of the analog signal and determines at least a velocity of the body part (e.g., velocity of the person’s hand movement) based on the rate of change. The signal processor 502 then outputs a digital signal corresponding to at least the velocity to another system or device 508 coupled to the signal processor.
  • a rate of change of the varying frequency or amplitude of the analog signal determines at least a velocity of the body part (e.g., velocity of the person’s hand movement) based on the rate of change.
  • the signal processor 502 then outputs a digital signal corresponding to at least the velocity to another system or device 508 coupled to the signal processor.
  • the signal processor 502 determines an accretion of the body part based on the rate of change. Accordingly, the digital signal output from the signal processor 502 may further correspond to the accretion.
  • the signal processor 502 may determine an acceleration, a jerk, and/or a jounce of the body part based on the velocity. Accordingly, the digital signal output from the signal processor 502 may also correspond to the acceleration, the jerk, or the jounce.
  • the digital signal is output to the system or device 508 to control a moving element of a video game, trigger an interactive element of an attraction, and/or trigger an alarm or safety system.
  • the signal processor 502 and the theremin circuit 504 are coupled to a lap bar (e.g., lap bar 210) of a ride vehicle, and the at least one antenna is housed within the lap bar. Accordingly, the theremin circuit 504 may detect the varying position of the body part relative to the lap bar.
  • the at least one antenna 506 is housed within a headset (e.g., headset 304) configured to be worn by a person operating the tracking system 500. Accordingly, the theremin circuit 504 may detect the varying position of the body part relative to the headset.
  • the tracking system 500 may further include a cable 510 (e.g., wire or cable 414) made of a conductive material and positioned in parallel to the at least one antenna 506.
  • the cable 506 is insulated from the signal processor 502, the theremin circuit 504, and the at least one antenna 506 via an insulative material.
  • the at least one antenna 506 wirelessly attenuates to the cable 510. Accordingly, the theremin circuit 504 may detect the varying position of the body part relative to the cable 510.
  • the tracking system 500 may also include a water medium 512 (e.g., water medium 416) filled with water, wherein the cable 510 is inserted in the water medium 512 and the at least one antenna 506 wirelessly attenuates to the cable 510 inserted in the water medium 512. Accordingly, the theremin circuit 504 may detect the varying position of the body part relative to the water medium 512.
  • a water medium 512 e.g., water medium 416) filled with water
  • the tracking system 500 may also include a headset 514 configured to be worn by a person operating the tracking system 500.
  • the headset 514 may detect spatial coordinates corresponding to a field of view of the person.
  • the headset 514 may further output the spatial coordinates to the other system or device 508 coupled to the signal processor 502.
  • the spatial coordinates may be used in connection with the digital signal output from the signal processor 502 (e.g., the digital signal and the spatial coordinates are output to a video game and jointly used to determine a velocity and direction/location of a ball throw).
  • FIG. 6 is a flow chart illustrating an exemplary process 600 for tracking a presence and/or motion of a body part (e.g., person’s hand) using a theremin-based tracking system according to an aspect of the present disclosure.
  • the process 600 may be carried out by the theremin-based tracking system 500 or any suitable apparatus or means for carrying out the functions or algorithm described below.
  • the system may detect, via a theremin circuit (e.g., theremin circuit 504), a varying position of a body part relative to at least one antenna (e.g., antenna(s) 506).
  • the body part may be a person’s hand or any other body part of the person.
  • the system may output, from the theremin circuit, an analog signal to a signal processor (e.g., signal processor 502).
  • the analog signal has a varying frequency or amplitude based on the varying position of the body part relative to the at least one antenna.
  • the system may determine, via the signal processor, a rate of change of the varying frequency or amplitude of the analog signal.
  • the system may determine, via the signal processor, at least a velocity of the body part based on the rate of change.
  • the system may output, from the signal processor, a digital signal corresponding to at least the velocity to another system or device (e.g., system or device 508) coupled to the signal processor.
  • the system may also determine, via the signal processor, an accretion of the body part based on the rate of change. Accordingly, at 610, the digital signal output from the signal processor may further correspond to the accretion.
  • the system may determine, via the signal processor, an acceleration, a jerk, and/or a jounce of the body part based on the velocity. Accordingly, at 610, the digital signal output from the signal processor may also correspond to the acceleration, the jerk, or the jounce.
  • the system may optionally detect, via a headset (e.g., headset 514) configured to be worn by a person operating the system, spatial coordinates corresponding to a field of view of the person.
  • the system may further output the spatial coordinates from the headset to the other system or device coupled to the signal processor, wherein the spatial coordinates are used in connection with the digital signal output from the signal processor (e.g., the digital signal and the spatial coordinates are output to a video game and jointly used to determine a velocity and direction/location of a ball throw).
  • the digital signal is output to control a moving element of a video game, trigger an interactive element of an attraction, and/or trigger an alarm or safety system.
  • the signal processor and the theremin circuit are coupled to a lap bar (e.g., lap bar 210) of a ride vehicle, wherein the at least one antenna is housed within the lap bar. Accordingly, the theremin circuit may perform detection by detecting the varying position of the body part relative to the lap bar.
  • the at least one antenna is housed within a headset (e.g., headset 304) configured to be worn by a person operating the system. Accordingly, the theremin circuit may perform detection by detecting the varying position of the body part relative to the headset.
  • a cable (e.g., cable 414 or 510) made of a conductive material is positioned in parallel to the at least one antenna. Moreover, the cable is insulated from the theremin circuit, the signal processor, and the at least one antenna, and the at least one antenna wirelessly attenuates to the cable. Accordingly, the theremin circuit may perform detection by detecting the varying position of the body part relative to the cable.
  • the cable is inserted in a water medium (e.g., water medium 416 or 512) filled with water and the at least one antenna wirelessly attenuates to the cable inserted in the water.
  • the theremin circuit may perform detection by detecting the varying position of the body part relative to the water medium.
  • the word “exemplary” is used to mean “serving as an example, instance, or illustration.” Any implementation or aspect described herein as “exemplary” is not necessarily to be construed as preferred or advantageous over other aspects of the disclosure. Likewise, the term “aspects” does not require that all aspects of the disclosure include the discussed feature, advantage, or mode of operation.
  • the term “coupled” is used herein to refer to the direct or indirect coupling between two objects. For example, if object A physically touches object B, and object B touches object C, then objects A and C may still be considered coupled to one another — even if they do not directly physically touch each other. For instance, a first object may be coupled to a second object even though the first object is never directly physically in contact with the second object.
  • FIGs. 1-6 One or more of the components, steps, features and/or functions illustrated in FIGs. 1-6 may be rearranged and/or combined into a single component, step, feature, or function or embodied in several components, steps, or functions. Additional elements, components, steps, and/or functions may also be added without departing from novel features disclosed herein.
  • the apparatus, devices, and/or components illustrated in FIGs. 1-6 may be configured to perform one or more of the methods, features, or steps described herein.
  • the novel algorithms described herein may also be efficiently implemented in software and/or embedded in hardware.
  • “at least one of: a, b, or c” is intended to cover: a; b; c; a and b; a and c; b and c; and a, b, and c.
  • All structural and functional equivalents to the elements of the various aspects described throughout this disclosure that are known or later come to be known to those of ordinary skill in the art are expressly incorporated herein by reference and are intended to be encompassed by the claims.
  • nothing disclosed herein is intended to be dedicated to the public regardless of whether such disclosure is explicitly recited in the claims. No claim element is to be construed under the provisions of 35 U.S.C. ⁇ 112(f) unless the element is expressly recited using the phrase “means for” or, in the case of a method claim, the element is recited using the phrase “step for.”

Landscapes

  • Engineering & Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • Human Computer Interaction (AREA)
  • General Physics & Mathematics (AREA)
  • Electromagnetism (AREA)
  • Radar Systems Or Details Thereof (AREA)
  • Measurement Of Length, Angles, Or The Like Using Electric Or Magnetic Means (AREA)

Abstract

Selon des aspects, la divulgation concerne des procédés, un appareil et des systèmes permettant de suivre la présence d'une partie corporelle par l'intermédiaire d'un capteur basé sur thérémine et de produire un signal utilisable. Par exemple, un système de suivi comprend un processeur de signal et un circuit de thérémine comprenant au moins une antenne. Le circuit de thérémine détecte une position variable d'une partie de corps par rapport à ladite au moins une antenne et produit un signal analogique vers le processeur de signal ayant une fréquence ou une amplitude variable sur la base de la position variable de la partie de corps par rapport à ladite au moins une antenne. Le processeur numérique détermine un taux de variation de la fréquence ou de l'amplitude variable du signal analogique, détermine au moins une vitesse de la partie de corps sur la base de la vitesse de changement, et produit un signal numérique correspondant à au moins la vitesse à un système ou un dispositif couplé au système de suivi basé sur thérémine.
PCT/US2022/044121 2021-09-20 2022-09-20 Suivi et déclenchement basés sur thérémine WO2023044154A2 (fr)

Priority Applications (4)

Application Number Priority Date Filing Date Title
EP22792956.9A EP4405789A2 (fr) 2021-09-20 2022-09-20 Suivi et déclenchement basés sur thérémine
CA3231107A CA3231107A1 (fr) 2021-09-20 2022-09-20 Suivi et declenchement bases sur theremine
KR1020247012649A KR20240056625A (ko) 2021-09-20 2022-09-20 테레민 기반 추적 및 트리거링
CN202280063611.3A CN117980868A (zh) 2021-09-20 2022-09-20 基于特雷门琴的跟踪和触发

Applications Claiming Priority (4)

Application Number Priority Date Filing Date Title
US202163246206P 2021-09-20 2021-09-20
US63/246,206 2021-09-20
US17/947,488 2022-09-19
US17/947,488 US20230090805A1 (en) 2021-09-20 2022-09-19 Theremin-based tracking and triggering

Publications (2)

Publication Number Publication Date
WO2023044154A2 true WO2023044154A2 (fr) 2023-03-23
WO2023044154A3 WO2023044154A3 (fr) 2023-04-20

Family

ID=83899709

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/US2022/044121 WO2023044154A2 (fr) 2021-09-20 2022-09-20 Suivi et déclenchement basés sur thérémine

Country Status (1)

Country Link
WO (1) WO2023044154A2 (fr)

Family Cites Families (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2009118183A2 (fr) * 2008-03-26 2009-10-01 Ident Technology Ag Système et procédé d'analyse multidimensionnelle de gestes
EP2503436A1 (fr) * 2011-03-21 2012-09-26 Research In Motion Limited Dispositif mobile de communication doté d'une navigation utilisateur au moyen d'une antenne et procédés apparentés
US9804712B2 (en) * 2013-08-23 2017-10-31 Blackberry Limited Contact-free interaction with an electronic device

Also Published As

Publication number Publication date
WO2023044154A3 (fr) 2023-04-20

Similar Documents

Publication Publication Date Title
US8568216B2 (en) Pawn with triggerable sub parts
US4855711A (en) Impact detection apparatus
KR102637506B1 (ko) 근접에 의해 활성화되는 제스처
CN108351728A (zh) 感测在电极之间局部空间中的阻抗改变
GB2279750A (en) Capacitive proximity sensor
US20140240298A1 (en) Stylus for a digitizer system
US20180091001A1 (en) Mitigating False Detection of Foreign Objects in Wireless Power Systems
CN102763143B (zh) 用于使用相干传输信号进行接收器清空的方法和系统
CA2646353C (fr) Systeme de poupee a reconnaissance sonore
JP2016531681A (ja) 転倒検出方法及び転倒検出システム
WO2008082898A1 (fr) Système de détection d'emplacement et procédé utilisant le réglage adaptatif de signal d'entraînement
WO2005073834A3 (fr) Ecrans tactiles
WO1995020205A1 (fr) Systeme de detection de metaux
US10678421B2 (en) Control of a host station through movement of a moving device
CN104813379A (zh) 检测设备在水平或垂直方向的位置的变化
CN110082838A (zh) 用于检测受保护门口组件处铁磁性物体的装置
WO2008059795A1 (fr) Appareil de détection de direction de fonctionnement
US20230090805A1 (en) Theremin-based tracking and triggering
WO2023044154A2 (fr) Suivi et déclenchement basés sur thérémine
CN108140295A (zh) 运动检测设备以及对应的方法
US8816854B2 (en) System and method for reducing cart alarms and increasing sensitivity in an EAS system with metal shielding detection
WO1997042527A1 (fr) Systeme de detecteur de metaux
JP2002510818A (ja) コンピュータの表示スクリーン上のカーソルの位置決め
US20110057669A1 (en) Capacitive Sensor
CN101376057B (zh) 在交互式游戏中产生警示功能的方法与系统

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 22792956

Country of ref document: EP

Kind code of ref document: A2

WWE Wipo information: entry into national phase

Ref document number: 3231107

Country of ref document: CA

ENP Entry into the national phase

Ref document number: 2024516915

Country of ref document: JP

Kind code of ref document: A

WWE Wipo information: entry into national phase

Ref document number: 202280063611.3

Country of ref document: CN

ENP Entry into the national phase

Ref document number: 20247012649

Country of ref document: KR

Kind code of ref document: A

WWE Wipo information: entry into national phase

Ref document number: 2022792956

Country of ref document: EP

NENP Non-entry into the national phase

Ref country code: DE

ENP Entry into the national phase

Ref document number: 2022792956

Country of ref document: EP

Effective date: 20240422

WWE Wipo information: entry into national phase

Ref document number: 11202401229R

Country of ref document: SG