US11150324B2 - Displacement sensing to localize movement - Google Patents
Displacement sensing to localize movement Download PDFInfo
- Publication number
- US11150324B2 US11150324B2 US16/383,996 US201916383996A US11150324B2 US 11150324 B2 US11150324 B2 US 11150324B2 US 201916383996 A US201916383996 A US 201916383996A US 11150324 B2 US11150324 B2 US 11150324B2
- Authority
- US
- United States
- Prior art keywords
- wearer
- multiple antennas
- movement
- skin surface
- value
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active, expires
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
- G06F3/014—Hand-worn input/output arrangements, e.g. data gloves
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01S—RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
- G01S5/00—Position-fixing by co-ordinating two or more direction or position line determinations; Position-fixing by co-ordinating two or more distance determinations
- G01S5/02—Position-fixing by co-ordinating two or more direction or position line determinations; Position-fixing by co-ordinating two or more distance determinations using radio waves
- G01S5/0205—Details
- G01S5/0221—Receivers
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01S—RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
- G01S5/00—Position-fixing by co-ordinating two or more direction or position line determinations; Position-fixing by co-ordinating two or more distance determinations
- G01S5/02—Position-fixing by co-ordinating two or more direction or position line determinations; Position-fixing by co-ordinating two or more distance determinations using radio waves
- G01S5/0205—Details
- G01S5/0226—Transmitters
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01S—RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
- G01S5/00—Position-fixing by co-ordinating two or more direction or position line determinations; Position-fixing by co-ordinating two or more distance determinations
- G01S5/02—Position-fixing by co-ordinating two or more direction or position line determinations; Position-fixing by co-ordinating two or more distance determinations using radio waves
- G01S5/0269—Inferred or constrained positioning, e.g. employing knowledge of the physical or electromagnetic environment, state of motion or other contextual information to infer or constrain a position
- G01S5/02695—Constraining the position to lie on a curve or surface
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01S—RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
- G01S5/00—Position-fixing by co-ordinating two or more direction or position line determinations; Position-fixing by co-ordinating two or more distance determinations
- G01S5/02—Position-fixing by co-ordinating two or more direction or position line determinations; Position-fixing by co-ordinating two or more distance determinations using radio waves
- G01S5/0284—Relative positioning
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
-
- H—ELECTRICITY
- H01—ELECTRIC ELEMENTS
- H01Q—ANTENNAS, i.e. RADIO AERIALS
- H01Q1/00—Details of, or arrangements associated with, antennas
- H01Q1/27—Adaptation for use in or on movable bodies
- H01Q1/273—Adaptation for carrying or wearing by persons or animals
-
- H—ELECTRICITY
- H01—ELECTRIC ELEMENTS
- H01Q—ANTENNAS, i.e. RADIO AERIALS
- H01Q21/00—Antenna arrays or systems
- H01Q21/06—Arrays of individually energised antenna units similarly polarised and spaced apart
- H01Q21/061—Two dimensional planar arrays
-
- H—ELECTRICITY
- H01—ELECTRIC ELEMENTS
- H01Q—ANTENNAS, i.e. RADIO AERIALS
- H01Q21/00—Antenna arrays or systems
- H01Q21/06—Arrays of individually energised antenna units similarly polarised and spaced apart
- H01Q21/061—Two dimensional planar arrays
- H01Q21/065—Patch antenna array
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04B—TRANSMISSION
- H04B1/00—Details of transmission systems, not covered by a single one of groups H04B3/00 - H04B13/00; Details of transmission systems not characterised by the medium used for transmission
- H04B1/38—Transceivers, i.e. devices in which transmitter and receiver form a structural unit and in which at least one part is used for functions of transmitting and receiving
- H04B1/3827—Portable transceivers
- H04B1/385—Transceivers carried on the body, e.g. in helmets
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01S—RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
- G01S2205/00—Position-fixing by co-ordinating two or more direction or position line determinations; Position-fixing by co-ordinating two or more distance determinations
- G01S2205/01—Position-fixing by co-ordinating two or more direction or position line determinations; Position-fixing by co-ordinating two or more distance determinations specially adapted for specific applications
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01S—RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
- G01S2205/00—Position-fixing by co-ordinating two or more direction or position line determinations; Position-fixing by co-ordinating two or more distance determinations
- G01S2205/01—Position-fixing by co-ordinating two or more direction or position line determinations; Position-fixing by co-ordinating two or more distance determinations specially adapted for specific applications
- G01S2205/09—Position-fixing by co-ordinating two or more direction or position line determinations; Position-fixing by co-ordinating two or more distance determinations specially adapted for specific applications for tracking people
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04B—TRANSMISSION
- H04B1/00—Details of transmission systems, not covered by a single one of groups H04B3/00 - H04B13/00; Details of transmission systems not characterised by the medium used for transmission
- H04B1/38—Transceivers, i.e. devices in which transmitter and receiver form a structural unit and in which at least one part is used for functions of transmitting and receiving
- H04B1/3827—Portable transceivers
- H04B1/385—Transceivers carried on the body, e.g. in helmets
- H04B2001/3861—Transceivers carried on the body, e.g. in helmets carried in a hand or on fingers
Definitions
- the disclosed apparatus and methods relate in general to the field of human-machine interface controllers, and in particular to a human-machine interface controller that is sensitive to deformation.
- VR virtual reality
- AR augmented reality
- controllers that provide detailed information relative to a user's gestures and other interactions without detracting from the immersiveness of the overall system.
- FIG. 1 shows a diagram illustrating the interaction of components of an embodiment of a controller.
- FIG. 2 shows an embodiment of a controller located on a wrist of a user.
- FIG. 3 shows an embodiment of a controller located on a wrist of a user.
- FIG. 4 shows an embodiment of a controller located on a wrist of a user.
- the present disclosure is directed to motion sensing controllers, and methods for designing, manufacturing and operating motion controllers (e.g., hand movement controllers), and in particular controllers using signals to determine an amount of deformation of a surface in order to model motion of a body part.
- motion controllers e.g., hand movement controllers
- controllers using signals to determine an amount of deformation of a surface in order to model motion of a body part.
- controller shapes and sensor patterns are used for illustrative purposes.
- example compositions and/or geometries are disclosed for the purpose of illustrating the invention, other compositions and geometries will be apparent to a person of skill in the art, in view of this disclosure, without departing from the scope and spirit of the disclosure herein.
- deformation may be used to describe events or periods of time in which a human-machine interaction is taking place, e.g., a user's deformation of skin surface in the wrist area. Detections of deformation may be processed and supplied to downstream computational processes with very low latency, e.g., on the order of ten milliseconds or less, or on the order of less than one millisecond.
- first and second are not intended, in and of themselves, to imply sequence, time or uniqueness, but rather, are used to distinguish one claimed construct from another. In some uses where the context dictates, these terms may imply that the first and second are unique. For example, where an event occurs at a first time, and another event occurs at a second time, there is no intended implication that the first time occurs before the second time. However, where the further limitation that the second time is after the first time is presented in the claim, the context would require reading the first time and the second time to be unique times.
- first and a second frequency could be the same frequency, e.g., the first frequency being 10 Mhz and the second frequency being 10 Mhz; or could be different frequencies, e.g., the first frequency being 10 Mhz and the second frequency being 11 Mhz.
- Context may dictate otherwise, for example, where a first and a second frequency are further limited to being orthogonal to each other in frequency, in which case, they could not be the same frequency.
- controller as used herein is intended to refer to a physical object that provides the function of human-machine interface.
- the controller is a wristband.
- the controller is able to detect the movements of a hand through detection of the deformation of surface areas of the wrist area.
- the controller is able to detect the movements of a hand through detection of the movement of the wrist area.
- the controller is able to detect the movements of a hand by sensing such movements directly.
- the controller may provide the position of a hand through the determination of deformation of surface areas in the wrist area.
- the controller may provide position and/or movement of other body parts through the determination of deformation of surface areas proximate to and/or associated with the body part and/or function, e.g., the articulation of the bones, joints and muscles of the wrist area and how it translates into the position and/or movement of the hand; the articulation of the bones, joints and muscles of the ankle area and how it translates into position and/or movement of the foot; the vibration and movement of the vocal cords and how it translates into speech.
- the controller may provide position and/or movement of other body parts through the determination of deformation of surface areas proximate to and/or associated with the body part and/or function, e.g., the articulation of the bones, joints and muscles of the wrist area and how it translates into the position and/or movement of the hand; the articulation of the bones, joints and muscles of the ankle area and how it translates into position and/or movement of the foot; the vibration and movement of the vocal cords and how it translates into speech.
- the controllers discussed herein use antennas that function as transmitting antennas and receiving antennas. However, it should be understood that whether the antennas are transmitting, receiving, or both depends on context and the embodiment.
- the conductor When used for transmitting, the conductor is operatively connected to a signal generator.
- the conductor When used for receiving, the conductor is operatively connected to a signal receiver.
- the transmitting antennas and receiving antennas for all or any combination of the patterns are operatively connected to a single integrated circuit capable of transmitting and receiving the required signals.
- the transmitting antennas and receiving antennas are each operatively connected to a different integrated circuit capable of transmitting and receiving the required signals, respectively.
- the transmitting antennas and receiving antennas for all or any combination of the patterns may be operatively connected to a group of integrated circuits, each capable of transmitting and receiving the required signals, and together sharing information necessary to such multiple IC configuration.
- the capacity of the integrated circuit i.e., the number of transmit and receive channels
- the requirements of the patterns i.e., the number of transmit and receive channels
- all of the transmitting antennas and receiving antennas for all of the multiple patterns used by a controller are operated by a common integrated circuit, or by a group of integrated circuits that have communications therebetween.
- the information from each circuit is combined in a separate system.
- the separate system comprises a GPU and software for signal processing.
- antenna is often used interchangeably with the term conductor (or electrode) when referring to the interacting pairs.
- a field is created between that conductor/antenna and one or more other conductors/antennas (e.g., at least one receiver conductor—but there can be many).
- the field created can be disturbed by certain kinds of interactions, e.g., the presence of human body parts or other objects.
- Sensing is accomplished by measuring small changes in the field. In an embodiment, changes in the magnitude of a signal received at the receiver are measured and used to derive sensing information. In an embodiment, changes in the phase of a signal received at the receiver are measured and used to derive sensing information.
- sensing relies on fusion of multiple measurements (e.g., magnitude and phase), including measurements made by other sensors.
- the driving or receiving circuitry e.g., signal generators or signal receivers
- the driving or receiving circuitry may be conductive, may be flexible, and may even be referred to as a conductor, it does not refer to the conductor/antenna for sensing interactions.
- a mixed signal integrated circuit 100 with signal processing capabilities comprises a transmitter 110 , and a receiver 120 .
- an analog front end comprising a transmitter (or multiple transmitters) and a receiver (or multiple receivers) is used to send and receive signals instead of the mixed signal integrated circuit 100 .
- the analog front end provides a digital interface to signal generating and signal processing circuits and/or software.
- the transmitter 110 is conductively coupled to a transmitting antenna 130 via transmit lead 115
- the receiver 120 is conductively coupled to a receiving antenna 140 via receive lead 125 .
- the transmitting antenna 130 is supported on a first structure 150 that is worn on body part 160 .
- the first structure 150 is worn on or about the body part 160 such that it will move, generally, with the body part 160 .
- the receiving antenna 140 comprises a support 190 , that may be separately affixed to the skin of the body part 160 , for example, by using tape 180 .
- receiving antenna 140 is affixed to a second structure (not shown) that is adapted to move with the movement of the skin of the body part 160 , rather than the more gross movements of the body part 160 .
- the second structure comprises a more flexible material than the first structure.
- a layer of material 170 separates the transmitting antenna 130 and the receiving antenna 140 .
- the transmitter and receivers are arbitrarily assigned, and the transmitter 110 , transmit lead 115 and transmitting antenna 130 can be used on the receive side, while the receiver 120 , receive lead 125 and the receiving antenna 140 can be used as the transmit side.
- the signal processor, transmitter and receiver may be implemented on separate circuits.
- the transmitter and receivers may support more than one antenna.
- a plurality of transmitting antennas 130 and/or a plurality of receiving antennas 140 are employed.
- multiple transmitting antennas are supported on the first structure.
- multiple receiving antenna are supported on a second structure.
- both transmitting and receiving antennas are supported on the first structure.
- both transmit and receiving antennas are supported on a second structure.
- the mixed signal integrated circuit 100 is adapted to generate one or more signals and send the signals to the transmitting antenna 130 via the transmitter 110 . In an embodiment, the mixed signal integrated circuit 100 is adapted to generate a plurality of frequency-orthogonal signals and send the plurality of frequency-orthogonal signals to the transmitting antennas 130 . In an embodiment, the mixed signal integrated circuit 100 is adapted to generate a plurality of frequency-orthogonal signals and one or more of the plurality of frequency-orthogonal signals to each of a plurality of transmitting antennas. In an embodiment, the frequency-orthogonal signals are in the range from DC up to about 2.5 GHz. In an embodiment, the frequency-orthogonal signals are in the range from DC up to about 1.6 MHz. In an embodiment, the frequency-orthogonal signals are in the range from 50 KHz to 200 KHz. The frequency spacing between the frequency-orthogonal signals should be greater than or equal to the reciprocal of the integration period (i.e., the sampling period).
- the mixed signal integrated circuit 100 (or a downstream component or software) is adapted to determine at least one value representing each frequency orthogonal signal transmitted by a transmitting antenna 130 .
- the mixed signal integrated circuit 100 (or a downstream component or software) performs a Fourier transform to received signals.
- the mixed signal integrated circuit 100 is adapted to digitize received signals.
- the mixed signal integrated circuit 100 (or a downstream component or software) is adapted to digitize received signals and perform a discrete Fourier transform (DFT) on the digitized information.
- DFT discrete Fourier transform
- the mixed signal integrated circuit 100 (or a downstream component or software) is adapted to digitize received signals and perform a Fast Fourier transform (FFT) on the digitized information.
- FFT Fast Fourier transform
- received signals are sampled at at least 1 MHz. In an embodiment, received signals are sampled at at least 2 MHz. In an embodiment, received signals are sampled at 4 Mhz. In an embodiment, received signals are sampled at more than 4 MHz.
- the integration period is 1 millisecond, which per the constraint that the frequency spacing should be greater than or equal to the reciprocal of the integration period provides a minimum frequency spacing of 1 KHz.
- the frequency spacing is equal to the reciprocal of the integration period. (It will be apparent to one of skill in the art in view of this disclosure that taking 4096 samples at, e.g., 4 MHz would yield an integration period slightly longer than a millisecond, and not achieving kHz sampling, and a minimum frequency spacing of 976.5625 Hz.)
- the maximum frequency of a frequency-orthogonal signal range should be less than 2 MHz.
- the practical maximum frequency of a frequency-orthogonal signal range should be less than about 40% of the sampling rate, or about 1.6 MHz.
- an FFT is used to transform the digitized received signals into bins of information, each reflecting the frequency of a frequency-orthogonal signal transmitted which may have been transmitted by the transmit antenna 130 .
- 4096 bins correspond to frequencies from 1 KHz to about 4 MHz. It will be apparent to a person of skill in the art in view of this disclosure that these examples are simply that, exemplary.
- the sample rate may be increased or decrease, the integration period may be adjusted, the frequency range may be adjusted, etc.
- quantified changes measured from the signals received by the receiving antennas can be used to determine a position or motion of a body part such as wrist body part. In an embodiment, quantified changes can be used to determine a position or motion of a body part such as the articulation of the bones, joints, tendons and muscles. In an embodiment, quantified changes can be used to determine a position or motion of a body part such as the articulation of the bones, joints and muscles of the wrist area. In an embodiment, quantified changes can be used to determine the position and/or movement of a hand, wrist, foot, ankle, head, neck, torso, arm, shoulder, or any other body part, or a portion of a body part.
- quantified changes can be used to determine elastic movement of skin in relation to a body or body part. In an embodiment, quantified changes can be used to determine the vibration and movement of vocal cords. In an embodiment, quantified changes can be used to deduce sounds or speech from the vibration and movement of vocal cords. In an embodiment, quantified changes can be used to determine respiration, heart activity, pulse or other biomechanical changes.
- antennas are formed as three-dimensional objects (or the faces of such three-dimensional objects), examples of which include: cubes, rectangular prisms, triangular prisms, octagonal prisms, tetrahedrons, square pyramids, cylinders and cones.
- interleaving in two or more dimensions is possible.
- 2 mm cubes could be placed e.g., 2 mms apart in a two dimensional grid on a skin-tracking second structure that is, e.g.
- each transmitting antenna can be used to transmit a plurality of frequency-orthogonal signals.
- the location of transmitting antenna and receiving antenna can be dynamically re-configured, allowing each antenna to operate as either a transmitter or a receiver during any integration period.
- an antenna can be used as both a transmitter and a receiver (albeit of different frequency-orthogonal signals) during a single integration period.
- two groups of antenna are used as both transmitters and receivers during the same integration period; the first group of antenna has its received signals passed through a high pass filter and are used to transmit only low frequencies, while the second group of antenna has its received signals passed through a low pass filter and transmit only high frequencies.
- FIGS. 2-4 shown are combinations of transmitting antennas 10 and receiving antennas 11 that are located in the wrist area.
- the placement of transmitting antennas 10 and receiving antennas 11 are such that they are also located above and below the wrist.
- the transmitting antennas 10 and the receiving antennas 11 are located within 5 centimeters of the wrist, either above or below.
- the transmitting antennas 10 and the receiving antennas 11 are located within 3 centimeters of the wrist, either above or below.
- the transmitting antennas 10 and the receiving antennas 11 are located within 1 cm of the wrist, either above or below.
- FIG. 2 shows a matrix view of the position of transmitting antennas 10 and receiving antennas 11 positioned on skin of a user.
- the transmitting antennas 10 and the receiving antennas 11 may be arranged in a variety of patterns. In an embodiment, the transmitting antennas 10 and receiving antennas 11 are arranged in an alternating pattern. In an embodiment, the transmitting antennas 10 and receiving antennas 11 are arranged so that one row is transmitting antennas 10 and one row is receiving antennas 11 . In an embodiment, the transmitting antennas 10 and receiving antennas 11 may be arranged in a random distribution. In an embodiment, the transmitting antennas 10 and receiving antennas 11 are arranged so that there are more transmitting antennas 10 than there are receiving antennas 11 .
- the transmitting antennas 10 and receiving antennas 11 are arranged so that there are more receiving antennas 11 than there are transmitting antennas 10 .
- the transmitting antennas 10 and receiving antennas 11 alternate their respective roles so that during one frame all the transmitting antennas 10 transmit signals while the receiving antennas 11 adapted to receive signals and in the next frame that receiving antennas 11 transmit signals and vice versa.
- Measurements determined by the interaction of the transmitting antennas 10 and receiving antennas 11 are processed in order to determine movement, position and poses of the hand. Very slight movements by the digits of the hand can be detected by the movement and elasticity of the skin and the movement of the antennas attached thereto. The expansion, contraction and shifting of skin in the wrist area may be caused by, e.g., muscle, ligament or bone movement in the wrist area, articulation of joints in the hand, wrist or arm and blood flow in the wrist area. The very slight movement of one transmitting antenna 10 with respect to a receiving antenna 11 can be measured. The measurements (e.g., magnitude and/or phase) can be processed and used to form a model of the hand. Each of the transmitting antennas 10 may transmit a unique frequency orthogonal signal. Each of the receiving antennas 11 receiving the signals from the transmitting antennas 10 are able identify the transmitting antennas 10 and thus use its respective movement to determine information about the motion and pose of the hand.
- FIGS. 3 and 4 illustrate embodiments of a controller using various sensor arrays.
- the transmitting antennas 10 and the receiving antennas 11 are attached to a substrate 12 , which may be adhered to the surface of the skin. Similar to the array of transmitting antennas and receiving antennas discussed above the arrangement of the substrates 12 may best be placed in order to detect the movement and poses of the hand.
- the substrate 12 is formed as one entire integrated piece that is attached to the skin of a user.
- the substrate 12 is adapted to flex and move in conjunction with the movement of the skin of the user.
- the substrate 12 forms multiple strips that are placed on the user's skin. The strips for the substrates 12 are attached to a user's skin.
- the substrate 12 is adapted to flex and move in conjunction with the movement of the skin of the user.
- the substrate 12 may be made of any type of material that is able to flex and move in conjunction with the movement of a user's skin.
- the material may be a polymer or type of fabric that is attached to the surface of a user's skin.
- the transmitting antennas 10 and receiving antennas 11 can be arranged and formed as part of an antenna array including one or more transmitting antenna and one or more receiving antenna.
- antennas are placed in key locations on or proximate to a body part in order to determine deformation.
- proximate it is generally meant close enough that the antennas are able to provide information regarding the movement of the body part, for example on the wrist area to provide information regarding a hand posture or position.
- antennas of an array are placed at specific locations on the wrist area where articulation occurs.
- transmitting and receiving antennas are placed on the skin (with no first material), and the stretching of the skin and movement of subdermal structures causes the relative orientation of the antennas to shift, and the consequential signal changes can be used to understand the stretching and movement.
- machine learning algorithms are used to associate movement with consequential signal changes, and then to model movement based on such consequential signal changes.
- very small transmit and receive antenna are positioned directly on a variety of nearby locations on the body, and can detect relative movement to one another—and that relative movement can be used to infer movement or positions of nearby body parts.
- antenna are affixed to the hair, hair follicles or skin using small amounts of adhesive.
- antenna are affixed to a thin structure that is a layer of flexible elastic material that is then secured to the body to act like a second skin, i.e., to move with the skin.
- thin layer of flexible elastic material would not interfere with the natural motion of the skin in response to body movement.
- An embodiment of the disclosure is an apparatus comprising a plurality of transmitting antennas adapted to be placed on a body part, wherein each of the plurality of transmitting antennas generates a unique frequency orthogonal signal; a plurality of receiving antennas adapted to placed on the body part, wherein the plurality of receiving antennas are adapted to receive the unique frequency orthogonal signals, wherein when the plurality of transmitting antennas and the plurality of receiving antennas are placed on the body part movement of skin of the body part causes the plurality of transmitting antennas and the plurality of receiving antennas to move with respect to each other; and wherein measurements of the unique frequency orthogonal signals received by at least one of the plurality of receiving antennas are used to provide measurements regarding movement of the skin of the body part.
- Another embodiment of the disclosure is an apparatus comprising: a substrate; a transmitting antenna adapted to placed on the substrate, a plurality of receiving antennas adapted to placed on the substrate, wherein the receiving antennas are adapted to receive signals transmitted from the transmitting antenna, wherein when the substrate is placed on a body part movement of skin of the body part causes the transmitting antenna and the plurality of receiving antennas to move with respect to each other; and wherein measurements of signals received by at least one of the plurality of receiving antennas are used to provide measurements regarding movement of the skin of the body part.
Abstract
Description
Claims (20)
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US16/383,996 US11150324B2 (en) | 2018-04-13 | 2019-04-15 | Displacement sensing to localize movement |
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US201862657270P | 2018-04-13 | 2018-04-13 | |
US16/383,996 US11150324B2 (en) | 2018-04-13 | 2019-04-15 | Displacement sensing to localize movement |
Publications (2)
Publication Number | Publication Date |
---|---|
US20190317180A1 US20190317180A1 (en) | 2019-10-17 |
US11150324B2 true US11150324B2 (en) | 2021-10-19 |
Family
ID=68161502
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US16/383,996 Active 2039-10-12 US11150324B2 (en) | 2018-04-13 | 2019-04-15 | Displacement sensing to localize movement |
Country Status (3)
Country | Link |
---|---|
US (1) | US11150324B2 (en) |
TW (1) | TWI724409B (en) |
WO (1) | WO2019200375A1 (en) |
Citations (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20020145563A1 (en) * | 2001-01-26 | 2002-10-10 | Kane Ronald J. | Body motion tracking system |
CN206270483U (en) * | 2016-12-12 | 2017-06-20 | 潍坊歌尔电子有限公司 | A kind of VR gloves space positioning apparatus |
US20190044549A1 (en) * | 2017-08-03 | 2019-02-07 | Intel Corporation | Overhead communications with wireless wearable devices |
Family Cites Families (11)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20080077015A1 (en) * | 2006-05-17 | 2008-03-27 | Olga Boric-Lubecke | Determining presence and/or physiological motion of one or more subjects with multiple receiver Doppler radar systems |
US9024865B2 (en) * | 2009-07-23 | 2015-05-05 | Qualcomm Incorporated | Method and apparatus for controlling mobile and consumer electronic devices |
WO2013109947A1 (en) * | 2012-01-19 | 2013-07-25 | Nike International Ltd. | Wearable device assembly having solder mask |
CN104768455B (en) * | 2012-09-11 | 2018-01-02 | L.I.F.E.公司 | Wearable communications platform |
SG11201606010TA (en) * | 2014-01-22 | 2016-08-30 | Tactual Labs Co | Dynamic assignment of possible channels in a touch sensor |
US20160015299A1 (en) * | 2014-07-17 | 2016-01-21 | Elwha Llc | Use of epidermal electronic devices to measure orientation |
US20160174842A1 (en) * | 2014-12-17 | 2016-06-23 | Elwha Llc | Epidermal electronics systems having radio frequency antennas systems and methods |
US10201295B2 (en) * | 2015-03-13 | 2019-02-12 | Verily Life Sciences Llc | User interactions for a bandage type monitoring device |
US10182728B2 (en) * | 2016-06-22 | 2019-01-22 | Qualcomm Incorporated | Multi-sensor device and method of using multi-sensor device for determining biometric properties of a subject |
US10019859B2 (en) * | 2016-08-10 | 2018-07-10 | Elwha Llc | Systems and methods for individual identification and authorization utilizing conformable electronics |
TWI613621B (en) * | 2016-12-08 | 2018-02-01 | 財團法人工業技術研究院 | Posture sensing apparatus and method thereof |
-
2019
- 2019-04-15 TW TW108113111A patent/TWI724409B/en active
- 2019-04-15 WO PCT/US2019/027448 patent/WO2019200375A1/en active Application Filing
- 2019-04-15 US US16/383,996 patent/US11150324B2/en active Active
Patent Citations (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20020145563A1 (en) * | 2001-01-26 | 2002-10-10 | Kane Ronald J. | Body motion tracking system |
CN206270483U (en) * | 2016-12-12 | 2017-06-20 | 潍坊歌尔电子有限公司 | A kind of VR gloves space positioning apparatus |
US20190044549A1 (en) * | 2017-08-03 | 2019-02-07 | Intel Corporation | Overhead communications with wireless wearable devices |
Also Published As
Publication number | Publication date |
---|---|
TWI724409B (en) | 2021-04-11 |
WO2019200375A1 (en) | 2019-10-17 |
US20190317180A1 (en) | 2019-10-17 |
TW202004423A (en) | 2020-01-16 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US11829520B2 (en) | Apparatus and method for sensing deformation | |
US11083390B2 (en) | Biometric sensor | |
US10928180B2 (en) | Flexible deformation sensor | |
US11086440B2 (en) | Matrix sensors | |
US10671169B2 (en) | Tactile feedback generating apparatus and system for virtual object manipulation | |
US10817106B2 (en) | Matrix sensor with receive isolation | |
US11150324B2 (en) | Displacement sensing to localize movement | |
US10795437B2 (en) | Matrix sensors for use with a controller | |
US20180364814A1 (en) | Six degrees of freedom tracking of objects using sensors | |
US11287254B2 (en) | Localized deformation sensor | |
EP4175534B1 (en) | Wearable tags | |
US11686835B2 (en) | Positioned enhanced sensor detection | |
US20200408592A1 (en) | Mems sensing system | |
CN111417336B (en) | biometric sensor | |
US11073909B2 (en) | Interior sensing | |
US20210100482A1 (en) | Capactive based mechanomyography | |
WO2021087187A1 (en) | Arm rotation | |
WO2021207174A1 (en) | Grip sensing |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
FEPP | Fee payment procedure |
Free format text: ENTITY STATUS SET TO UNDISCOUNTED (ORIGINAL EVENT CODE: BIG.); ENTITY STATUS OF PATENT OWNER: LARGE ENTITY |
|
AS | Assignment |
Owner name: FACEBOOK TECHNOLOGIES, LLC, CALIFORNIA Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:TACTUAL LABS CO.;REEL/FRAME:053543/0464 Effective date: 20190905 |
|
AS | Assignment |
Owner name: TACTUAL LABS CO., NEW YORK Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:HOLMAN, DAVID;REEL/FRAME:054450/0345 Effective date: 20201123 |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: NON FINAL ACTION MAILED |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: RESPONSE TO NON-FINAL OFFICE ACTION ENTERED AND FORWARDED TO EXAMINER |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: NOTICE OF ALLOWANCE MAILED -- APPLICATION RECEIVED IN OFFICE OF PUBLICATIONS |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: PUBLICATIONS -- ISSUE FEE PAYMENT VERIFIED |
|
STCF | Information on status: patent grant |
Free format text: PATENTED CASE |
|
AS | Assignment |
Owner name: FACEBOOK TECHNOLOGIES, LLC, CALIFORNIA Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:TACTUAL LABS CO.;REEL/FRAME:057840/0479 Effective date: 20210120 |
|
AS | Assignment |
Owner name: META PLATFORMS TECHNOLOGIES, LLC, CALIFORNIA Free format text: CHANGE OF NAME;ASSIGNOR:FACEBOOK TECHNOLOGIES, LLC;REEL/FRAME:060199/0876 Effective date: 20220318 |