Classifications

• • G—PHYSICS
  • G06—COMPUTING; CALCULATING OR COUNTING
  • G06F—ELECTRIC DIGITAL DATA PROCESSING
  • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
  • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
  • G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
• • G—PHYSICS
  • G06—COMPUTING; CALCULATING OR COUNTING
  • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
  • G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
  • G06V40/20—Movements or behaviour, e.g. gesture recognition
  • G06V40/28—Recognition of hand or arm movements, e.g. recognition of deaf sign language
• • G—PHYSICS
  • G06—COMPUTING; CALCULATING OR COUNTING
  • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
  • G06V10/00—Arrangements for image or video recognition or understanding
  • G06V10/10—Image acquisition
  • G06V10/12—Details of acquisition arrangements; Constructional details thereof
  • G06V10/14—Optical characteristics of the device performing the acquisition or on the illumination arrangements
  • G06V10/147—Details of sensors, e.g. sensor lenses

Definitions

• This disclosure relates to systems and methods for generating an image of an object within a region. Specifically, this disclosure provides systems and methods for using a dual modality sensor (e.g., ultrasound and electromagnetic radiation) in combination with, for example, entertainment devices.
• a dual modality sensor e.g., ultrasound and electromagnetic radiation
• a system may utilize a dual modality sensor to generate image data.
• the system may use a first modality to generate coarse image data of an object.
• the system may then use this coarse image data to identify portions of interest of the object.
• the system may use a second modality to generate fine image data of the identified portions of interest.
• a system may include one or more ultrasonic transmitters and/or receivers to implement a first modality.
• the transmitter(s) and/or receiver(s) may be embodied as one or more transceivers.
• An ultrasonic transmitter may be configured to transmit ultrasound into a region bounded by one or more surfaces.
• the ultrasonic receiver may receive direct ultrasonic reflections from one or more objects within the region.
• the system may use the ultrasonic transmitters and/or receivers to generate coarse image data of an object and identify, based on the coarse image data, portions of interest of the object.
• a system may also be configured to receive, via an electromagnetic receiver, an electromagnetic reflection from an object within a region.
• the system may generate fine image data of identified portions of interest using the received electromagnetic reflection. For example, after a portion of interest has been identified via coarse image data, the system may receive
• fine image data electromagnetic radiation from the identified portion of interest and generate image data with greater resolution than available in the coarse image data (referred to herein as fine image data).
• the dual modalities may be used to resolve at least one ambiguity.
• image data received from a first modality may include an ambiguity, such as a ghost image.
• a second modality may be utilized by the system to resolve the ambiguity introduced by the first modality, e.g., the ghost image in the image data generated using the first modality.
• received electromagnetic radiation can be utilized by a system to correct a ghost image introduced by received ultrasound reflections.
• Either of the two modalities discussed above can be utilized by the system to generate either the fine image data or the coarse image data.
• a first embodiment may utilize ultrasound to generate coarse image data and electromagnetic imaging to generate fine image data
• a second embodiment may utilize electromagnetic imaging to generate coarse image data and ultrasound to generate fine image data.
• FIG. 1A illustrates a positioning system transmitting ultrasound toward three persons within a bounded region.
• FIG. 1 B illustrates a direct ultrasonic reflection received by the positioning system and the resulting "image" generated by the positioning system.
• FIG. 2A illustrates a positioning system rebounding ultrasound off the wall and then toward the three persons.
• FIG, 2B illustrates a side view of the positioning system rebounding the ultrasound off the wall and then toward the three persons.
• FIG, 3A illustrates a plurality of ultrasonic reflectors configured to facilitate the transmission, reflection, and/or reception of rebounded ultrasound by the positioning system.
• FIG. 3B illustrates a plurality of active ultrasonic reflectors configured to facilitate the transmission, reflection, and/or reception of rebounded ultrasound by the positioning system.
• FIG. 4A illustrates an actively controlled ultrasonic reflector in a first position configured to pivot with respect to the wail on which it is mounted to facilitate the transmission, reflection, and/or reception of rebounded ultrasound by the positioning system.
• FIG. 4B illustrates the actively controlled ultrasonic reflector in a second position.
• FIG. 5 illustrates a block diagram of a positioning system, according to one embodiment.
• FIG. 6 illustrates a flow chart of a method for generating positional data describing a relative position of one or more objects within a region.
• FIG. 7A illustrates an ultrasonic system transmitting and receiving reflected ultrasound from a stationary object.
• FIG. 7B illustrates an ultrasonic system transmitting ultrasound at a first frequency and receiving reflected ultrasound at a second frequency from an object moving away from the ultrasound system.
• FIG, 7C illustrates an ultrasound system transmitting ultrasound at a first frequency and receiving reflected ultrasound at a second frequency from an object moving toward the ultrasound system.
• FIG. 7D illustrates an ultrasonic system transmitting and receiving reflected ultrasound from a stationary object, similar to FIG. 7A.
• FIG. 7E illustrates a timing delay in a reflected ultrasound from the object as it moves away from the ultrasound system.
• FIG, 8 illustrates ultrasound rebounded off of a reflector prior to being reflected by an object moving away from an ultrasound receiver.
• Fig. 9. Illustrates an electromagnetic position detection system used in conjunction with an ultrasound velocity and/or acceleration detection system.
• FIG. 10 illustrates uitrasound reflected and/or rebounded from one or more auxiliary reflectors.
• FIG. 1 1 illustrates a plurality of ultrasonic systems for determining velocity and/or acceleration information from multiple directions.
• FIG. 12 illustrates a method for determining velocity and/or acceleration information associated with a moving object.
• FIG. 13A illustrates a dual modality system transmitting and receiving ultrasound reflected off a person standing within a bounded region.
• FIG. 13B illustrates a dual modality system generating coarse image data of an object based on received ultrasonic reflections.
• FIG. 13C illustrates a dual modality system identifying several portions of interest on an object based on coarse image data generated from ultrasonic reflections.
• FIG. 14 illustrates a dual modality system using electromagnetic reflections in conjunction with ultrasound to receive additional image information from identified portion of interests.
• FIG. 15 illustrates a dual modality system generating fine image data of portions of interest on a person.
• FIG. 18 illustrates a method for generating an image using ultrasound and electromagnetic radiation.
• FIG. 17 illustrates another method for generating an image using ultrasound and electromagnetic radiation.
• FIG. 18 illustrates a method for resolving ambiguities in an image using ultrasound and electromagnetic radiation.
• a system may utilize a dual modality sensor system to generate image data.
• a system may utilize two imaging modalities for imaging an object at two different resolutions. That is, the system may utilize a first modality (e.g., either ultrasound or electromagnetic radiation) to generate image data of an object at a first resolution. The system may then utilize the other modality to generate image data of portions of interest on the object (not necessarily the entire object) at a second resolution, where the second resolution is higher than the first resolution.
• a first modality e.g., either ultrasound or electromagnetic radiation
• the dual modalities may be used to generate a coarse (i.e., lower resolution) image of the entire object using a first modality, identify portions of interest on the object, and then generate a fine (i.e., higher resolution) image of the portions of interest using a second modality.
• a system may transmit ultrasound, via a first ultrasonic transmitter, into the region.
• An ultrasonic receiver may receive ultrasonic reflections of the transmitted ultrasound from a plurality of sites on the object within the region.
• a processor may generate coarse image data of the object at a first resolution based on the received ultrasonic reflections.
• the system may then identify a portion of interest on the object based on the coarse image data.
• Electromagnetic radiation may be received from the identified portion of interest on the object.
• Fine image data of the portion of interest on the object may be generated at a second resolution based on the received electromagnetic radiation.
• the second resolution may be greater than the first resolution.
• the first resolution may be greater than the second resolution.
• a kinematic value may be determined that is associated with the portion of interest on the object based on at least one of the received electromagnetic radiation and the received ultrasonic reflections.
• the state of an entertainment device may be modified based on the determined kinematic value associated with the portion of interest on the object.
• the coarse image data described above may be generated based on the received electromagnetic reflections and the fine image data may be generated based on the received ultrasonic reflections.
• the received electromagnetic radiation may be generated by the system, by another system, by an auxiliary electromagnetic radiation source, and/or comprise ambient electromagnetic radiation, such as light,
• one imaging modality may be used to resolve an ambiguity, such as ghost images, in image data generated using another imaging modality.
• an image generated using ultrasound imaging technologies may have an ghosting image ambiguity that can be resolved using an electromagnetic imaging technology (or even just an electromagnetic position/distance detection technology).
• a system may include one or more ultrasonic transmitters and/or receivers, as well as one or more electromagnetic transmitters and/or receivers. Each of these different modalities may capture image data at different resolutions.
• the system may generate non- or less-important image data at a lower resolution while capturing important image data at a higher resolution. In some embodiments, generating only a portion of the image at a higher resolution may allow the system to process the image data faster and in a more compressed manner while still providing high resolution of portions of interest.
• the transmitter(s) and/or receiver(s) may be embodied as one or more transceivers.
• the ultrasonic transmitter(s) and/or receiver(s) may be operated by the system concurrently with the electromagnetic receiver(s) or in sequential order before or after the electromagnetic receiver(s).
• the ultrasonic transmitter(s) and receiver(s) may be used in combination with the electromagnetic receiver to generate image data.
• One or more of the electromagnetic and/or ultrasonic transmitters, receivers, and/or transceivers may comprise a piezoelectric transducer that may be part of a single transducer system or an array of transducers.
• the transducers may comprise or be made from metamaterials.
• a flat sub-wavelength array of ultrasonic transducers may be used in conjunction with the embodiments described herein, such as those utilizing arrays of metamaterials.
• the dual modality sensor system may be configured to utilize different frequency spectrums.
• An ultrasonic transmitter used on such a system may be configured to transmit uitrasound into a region bounded by one or more surfaces.
• the ultrasound may be between 20 kHz and 250 kHz. In one embodiment, the ultrasound is specifically between 35 kHz and 45 kHz.
• An electromagnetic transmitter and/or receiver may also be used on such a system to transmit and/or receive a range of electromagnetic radiation frequencies.
• a system may be configured to use electromagnetic microwave, terahertz, infrared, visible, and/or ultraviolet radiation.
• a dual modality sensor system may use the two modalities to produce more detailed image data and/or to correct ambiguities introduced by one of the modalities.
• the system may use a first modality to generate coarse image data of an object, and, to get more detailed data about an identified portion of interest, the system may use a second modality to generate fine image data of the identified portion of the object.
• the first modality produces an image with a low resolution of an object
• the second modality may be used to provide a higher resolution of portions of interest on the object.
• Another embodiment may include a first modality that introduces an ambiguity into the image data. To correct the ambiguity, the system may use a second modality that isn't susceptible to the same type of ambiguity.
• the system may include one or more ultrasonic transmitters and/or receivers.
• the system may use the ultrasonic receivers and/or transmitters to generate coarse image data.
• an ultrasonic transmitter may be configured to transmit ultrasound into a region.
• An ultrasonic receiver may receive ultrasonic reflections from one or more objects within the region. Based on these received ultrasonic reflections, the system may generate coarse image data of the one or more objects via a processor.
• the system may identify portions of interest on the object using the coarse image data. For example, the system may identify a person's hand, finger, arm, leg foot, toe, torso, neck, head, mouth, lip, and/or eye. The portion of interest identified may be based on a state of an entertainment device. Once one or more portions of interest have been identified, the system may use a second modality (e.g.,
• electromagnetic radiation to gather further details about the portion of interest.
• the system may also electromagnetic receiver(s) and/or transmitter(s).
• the system may generate fine image data of the identified portions of interest using received electromagnetic reflections. For example, after a portion of interest has been identified using the coarse image data, the system may receive electromagnetic radiation from the identified portion of interest and generate higher resolution image of the identified portions of interest.
• a second modality may be used to resolve at least one ambiguity inherent in or caused by the usage of the first modality.
• image data generated using the first modality may include an ambiguity.
• image data generated via ultrasound may have ghost images inherent in the image data.
• a second modality e.g., electromagnetic radiation
• received electromagnetic radiation can be utilized by the system to remove ghost images in the image data generated using the ultrasound reflections.
• Either of the two modalities discussed above may be utilized by the system to generate either fine image data or coarse image data.
• a first embodiment may utilize ultrasound to generate coarse image data and electromagnetic imaging to generate fine image data
• a second embodiment may utilize electromagnetic imaging to generate coarse image data and ultrasound to generate fine image data.
• a kinematic value associated with the object or a specific portion of interest on the object may be determined.
• the kinematic value of an object may comprise the position, velocity, and/or acceleration of the object.
• the kinematic values may be based on the received electromagnetic radiation and/or the received ultrasonic reflections.
• the direct ultrasound may be reflected from a first portion of an object and the rebounded ultrasound may be reflected from a second, different portion of the object.
• Positional data may be determined using the received ultrasonic reflections.
• Direct positional data may correspond to a first directional component of the position of the object and the rebounded positional data may correspond to a second directional component of the position of the object.
• one or more direct and/or rebounded ultrasonic reflections may be used to determine velocity and/or acceleration.
• velocity and/or acceleration information may be determined using a Doppler shift that corresponds to a motion of the reflecting object.
• received ultrasonic reflections directly or
• Positional data sampled at various times may be used to determine and/or estimate current and/or future velocity and/or acceleration information associated with an object.
• velocity and/or acceleration information may be calculated based on a detected shift in uitrasound reflected by an object. For example, a system may detect a Doppler shift in uitrasound reflected by an object relative to the transmitted
• a shift to a longer wavelength may indicate that the object is moving away from the ultrasonic receiver.
• a shift to a shorter wavelength may indicate that the object is moving toward the ultrasonic receiver.
• the defected shift may be related to a frequency shift, a wavelength shift, a phase shift, a time-shifted reflection, and/or other ultrasonic shift.
• Any number of direct and/or rebounded ultrasonic reflections may be obtained from one or more objects within a region to obtain velocity and/or acceleration data over a period of time and/or to obtain more accurate velocity and/or acceleration data with multiple data points.
• the transmitted uitrasound may be transmitted as directional or non-directional ultrasonic pulses, continuously, in a modulated
• the ultrasonic transmissions may be spaced at regular intervals, on demand, and/or based on the reception of a previously transmitted ultrasonic transmission.
• Direct and rebounded uitrasound pulses may be transmitted at the same time, or either one can be
• Rebounded ultrasonic reflections may be defined as ultrasonic reflections that, in any order, reflect off at least one surface in addition to the object.
• the rebounded ultrasonic reflections may be reflected off any number of surfaces and/or objects (in any order) prior to being received by the ultrasonic receiver.
• a mapping or positioning system may generate positional data associated with one or more of the object(s) based on the direct ultrasonic reflecfion(s) and/or the rebounded ultrasonic reflection(s).
• the positional data may comprise a centroid of the objects, a two-dimensional mapping of the object, an image of the object, a false-color representation of the object, an information representation (blocks, squares, shadows, etc.) of the object, a three-dimensional mapping of the object, one or more features of the object, and/or other information.
• the velocity and/or acceleration data may be defined with respect to one or more surfaces of the region, the ultrasonic velocity/acceleration system, a receiver of the system, and/or a transmitter of the system.
• the one or more objects within the region may comprise machinery, robots, furniture, household property, people in general, gamers, human controllers of electronic devices, electronic devices, fixtures, and/or other human or non-human objects.
• the object may comprise a specific portion of a person, such as a hand, finger, arm, leg, foot, toe, torso, neck, head, mouth, lip, or eye.
• rebounded ultrasonic transmissions may be reflected off an ultrasonic reflector disposed within the room.
• the ultrasonic reflectors may be mounted and/or otherwise positioned within the region.
• the ultrasonic reflectors may be held, worn, and/or otherwise in the position of the user or operator of the ultrasonic positioning system.
• the ultrasonic reflectors may modify a characteristic of the reflected ultrasound, facilitating the identification of the received rebounded ultrasonic reflections.
• Ultrasonic reflectors may comprise passive, active, and/or actively moved/pivoted ultrasonic reflectors for controlling the direction in which ultrasound rebounds and/or otherwise travels within the region.
• the ultrasonic reflector may be configured to modify one or more of the frequency, phase, and/or amplitude of the rebounded ultrasound.
• the modified characteristic may facilitate the differentiation of the direct ultrasonic reflections and the rebounded ultrasonic reflections.
• the direct and rebounded signals can be
• the direct and rebounded signals can be differentiated using knowledge of the time-of-f!ight of the respective beams.
• the direction of a reflected beam (and hence directional characteristics of its delivered positional information) can be determined by knowledge of the orientation of the reflecting surface and its reflective characteristics. For example, ultrasonic reflection from a surface may be dominated by specular reflection, thereby allowing straightforward determination of the rebound geometry,
• the mapping or positioning system may also generate velocity and/or acceleration data using the rebounded ultrasonic reflection of the object(s) from the one or more surfaces. It will be appreciated that a rebounded ultrasonic reflection from a surface may be rebounded off the surface first and then the object, or off the object first and then the surface,
• the system may then generate enhanced velocity and/or acceleration data by combining the direct velocity and/or acceleration data and the rebounded velocity and/or acceleration data.
• the enhanced velocity and/or acceleration data may be a concatenation of the direct and rebounded velocity and/or acceleration data or a simple or complex function of the direct and rebounded velocity and/or acceleration data.
• the direct and rebounded velocity and/or acceleration data may comprise only time-of-flight information, which, based upon air sound-speed, can be converted to transit distance information for each beam.
• the direct velocity and/or acceleration data provides a range from the transceiver to the object, i.e., leaving the velocity and/or acceleration undefined along a two-dimensional spherical surface.
• Each potential object position along this spherical surface leads, e.g., assuming specular reflections, to a distinct time-of -flight for the rebounded beam from one surface (wail, ceiling, floor); this restricts the locus of possible velocities and/or accelerations of the object to a one- dimensional arc along the spherical surface, thereby improving the velocity and/or acceleration estimate(s).
• the system can further refine the velocity and/or acceleration data by analyzing rebound data from a second surface.
• each potential object position along the spherical surface (obtained by the time-of-flight of the direct beam) defines a first time-of-flight for ultrasound rebounded from the first surface and a second time-of-flight for ultrasound rebounded from the second surface; knowledge of both times-of-f light determines the object's position.
• time-of-flight data from other surfaces can, by "over defining" the problem, improve the positional estimate, e.g., by reducing sensitivity to measurement errors, to the effects of diffuse reflections, etc.
• the direct and rebounded velocity and/or acceleration data may comprise directional information
• directional information for direct ultrasound can identify that the object (or a specified portion of it) lies along a known ray, thereby providing two components of its velocity and/or acceleration.
• Information from rebounded ultrasound can then provide additional acceleration and/or velocity data sufficient to identify the third component of the object's velocity and/or acceleration, i.e., along the ray.
• the rebounded ultrasound may provide time-of-fiight information; each object velocity and/or acceleration along the ray corresponds to a different time-of-flight for rebounded ultrasound from a surface, so the measured time-of-flight identifies the object's location, velocity, and/or acceleration.
• the rebounded ultrasound may provide directional information (for either transmission or reception); the intersection of this rebound ray with the direct ray serves to identify the object's location, velocity, and/or acceleration.
• the enhanced velocity and/or acceleration data may be further enhanced or augmented using additional velocity and/or acceleration data obtained via direct or rebounded ultrasonic reflections and/or other velocity and/or acceleration data, such as velocity and/or acceleration data obtained via other means/systems/methods (e.g., laser detection, cameras, etc.).
• the direct and the rebounded velocity and/or acceleration data may provide velocity and/or acceleration data for the object at the same or different times, depending on the time at which they are reflected from the object.
• the enhanced positional data may be analyzed using a dynamical model, e.g., a Kaiman filter, designed to combine velocity and/or acceleration data corresponding to different times or directional components, using them together with, and to improve, estimates of the object's present and/or future motion.
• a dynamical model e.g., a Kaiman filter
• direct ultrasonic reflections may not be used. Rather, a first rebounded ultrasonic reflection and a second rebounded ultrasonic reflection may be used to generate velocity and/or acceleration data. It is appreciated that any number of direct or rebounded ultrasonic reflections may be used to identify a position, veiociiy, acceieraiion, and/or other movement information of an object within a region.
• the velocity and/or acceleration data gathered using ultrasonic reflections may be combined with other velocity and/or acceleration data, such as infrared, velocity and/or acceleration data provided by manual input, echo location, sonar techniques, laser, and/or the like.
• one or more local, remote, or distributed systems and/or system components may transmit ultrasound via an ultrasonic transmitter into a region.
• the received ultrasound may include both direct reflections and rebounded reflections.
• Velocity and/or acceleration data from both the direct reflections and the rebounded reflections may be used to obtain velocity and/or acceleration data that more accurately and/or more quickly describes the relative velocity and/or acceleration data of one or more objects within the region.
• Embodiments may include various steps, which may be embodied in machine-executable instructions to be executed by a computer system.
• a computer system includes one or more general-purpose or special-purpose computers (or other electronic devices).
• the computer system may include hardware components that include specific logic for performing the steps or may include a combination of hardware, software, and/or firmware.
• Embodiments may also be provided as a computer program product including a computer-readable medium having stored thereon instructions that may be used to program a computer system or other electronic device to perform the processes described herein.
• the computer-readable medium may include, but is not limited to: hard drives, floppy diskettes, optical disks, CD-ROMs, DVD-ROMs, ROMs, RAMs, EPROMs, EEPROMs, magnetic or optical cards, solid-state memory devices, or other types of media/computer-readable media suitable for storing electronic
• Suitable networks for configuration and/or use as described herein include one or more local area networks, wide area networks, metropolitan area networks, and/or Internet or IP networks, such as the World Wide Web, a private Internet, a secure Internet, a value-added network, a virtual private network, an extranet, an intranet, or even standalone machines which communicate with other machines by physical transport of media.
• a suitable network may be formed from parts or entireties of two or more other networks, including networks using disparate hardware and network communication technologies.
• One suitable network includes a server and several clients; other suitable networks may contain other combinations of servers, clients, and/or peer-to-peer nodes, and a given computer system may function both as a client and as a server.
• Each network includes at least tvvo computers or computer systems, such as the server and/or clients.
• a computer system may include a workstation, laptop computer, disconnectabie mobile computer, server, mainframe, duster, so-called "network computer or "thin client,” tablet, smart phone, personal digital assistant or other handheld computing device, "smart” consumer electronics device or appliance, medical device, or a combination thereof.
• the network may include communications or networking software, such as the software available from Novell, Microsoft, Artisoft, and other vendors, and may operate using TCP/IP, SPX, IPX, and other protocols over twisted pair, coaxial, or optical fiber cables, telephone lines, radio waves, satellites, microwave relays, modulated AC power lines, physical media transfer, and/or other data transmission "wires" known to those of skill in the art.
• the network may encompass smaller networks and/or be connectable to other networks through a gateway or similar mechanism.
• Each computer system includes at least a processor and a memory
• the processor may include a general purpose device, such as an Intel®, AMD®, or other "off-the-shelf microprocessor.
• the processor may include a special purpose processing device, such as an ASIC, SoC, SiP, FPGA, PAL, PLA, FPLA, PLD, or other customized or programmable device.
• the memory may include static RAM, dynamic RAM, flash memory, one or more flip-flops, ROM, CD-ROM, disk, tape, magnetic, optical, or other computer storage medium.
• the input device(s) may include a keyboard, mouse, touch screen, light pen, tablet, microphone, sensor, or other hardware with accompanying firmware and/or software.
• the output device(s) may include a monitor or other display, printer, speech or text synthesizer, switch, signal line, or other hardware with accompanying firmware and/or software.
• the computer systems may be capable of using a floppy drive, tape drive, optical drive, magneto-optical drive, or other means to read a storage medium.
• a suitable storage medium includes a magnetic, optical, or other computer-readable storage device having a specific physical configuration.
• Suitable storage devices include floppy disks, hard disks, tape, CD-ROMs, DVDs, PROMs, RAM, flash memory, and other computer system storage devices.
• the physical configuration represents data and instructions which cause the computer system to operate in a specific and predefined manner as described herein.
• Suitable software to assist in implementing the invention is readily provided by those of skill in the pertinent art(s) using the teachings presented here and programming languages and tools, such as Java, Pascal, C++, C, database
• Suitable signal formats may be embodied in analog or digital form, with or without error detection and/or correction bits, packet headers, network addresses in a specific format, and/or other supporting data readily provided by those of skill in the pertinent art(s).
• a software module or component may include any type of computer instruction or computer executable code located within a memory device.
• a software module may, for instance, include one or more physical or logical blocks of computer instructions, which may be organized as a routine, program, object, component, data structure, etc., that performs one or more tasks or implements particular abstract data types.
• a particular software module may include disparate instructions stored in different locations of a memory device, different memory devices, or different computers, which together implement the described functionality of the module.
• a module may include a single instruction or many instructions, and may be distributed over several different code segments, among different programs, and across several memory devices.
• Some embodiments may be practiced in a distributed computing environment where tasks are performed by a remote processing device linked through a communications network.
• software modules may be located in local and/or remote memory storage devices.
• data being tied or rendered together in a database record may be resident in the same memory device, or across several memory devices, and may be linked together in fields of a record in a database across a network.
• FIG. 1A illustrates a dual modality positioning system 1 10 transmitting ultrasound 120 toward three persons 151 , 152, and 153 in a group 150 within a bounded region 100.
• the bounded region 100 is bounded by a floor 141 , a left wall 142, a back wall 143, a right wall 144, and a ceiling 145.
• a front wall (not shown), may also bound the region 100.
• the dual modality positioning system 1 10 may transmit the ultrasound 120 as directional ultrasonic pulses, continuously, in a modulated fashion (frequency, amplitude, phase, etc), and/or in another format.
• the ultrasound 120 may be transmitted directly toward the persons 151 , 152, and 153.
• the ultrasound 120 may be transmitted indirectly toward the persons 151 , 152, and 153.
• the dual modality positioning system 1 10 may be any shape or size and/or may comprise a plurality of distributed components.
• the illustrated embodiment is merely an example and is not intended to convey any information regarding shape, size, configuration, or functionality.
• the dual modality positioning system 1 10 may include an array of transducers, such as piezoelectric transducers, configured to transmit and/or receive ultrasound and/or electromagnetic radiation.
• the dual modality positioning system 1 10 may be configured with a first plurality of transducers 1 12 (or a single transducer) for transmitting ultrasound and/or electromagnetic radiation and a second plurality of transducers 1 13 (or a single transducer) for receiving ultrasound.
• FIG. 1 B illustrates a direct ultrasonic reflection 121 received by the dual modality positioning system 1 10.
• the direct ultrasonic reflection 121 may convey coarse image information in a relatively two-dimensional fashion in which the three persons 151 , 152, and 153 are viewed as a single object 160, or as three distinct objects (161 , 162, and 163) in substantially the same plane.
• FIG. 1 B illustrates a visual representation of the received direct reflection of ultrasound 121.
• the actual positional data received may be at a higher or lower resolution depending on the sampling rates, accuracy, processing bit depth, frequency(ies) of ultrasound used, etc.
• FIG. 2A illustrates a dual modality positioning system 210, similar to that described in conjunction with FIGS. 1A and 1 B, in which ultrasound 225 is transmitted toward a surface bounding the region 200.
• the rebounding surface is left wail 242. It is appreciated that ultrasound may be rebounded off one or more of left wall 242, floor 241 , back wall 243, right wall 244, and/or ceiling 245. Similarly, electromagnetic radiation may be rebounded off one or more of left wall 242, floor 241 , back wail 243, right wall 244, and/or ceiling 245.
• the system may receive electromagnetic radiation from other sources (e.g., ambient light in the region).
• rebound and rebounding may include any type of reflection, refraction, and/or repeating that may or may not include a phase, frequency, modulation, and/or amplitude change. Rebounding may be performed by the outer surface of the surface, an inner portion of the surface, or an object disposed on, in, or behind the surface (e.g., exterior paint, drywal!, internal metal, studs, interior coatings, mounted panels, etc.).
• the ultrasound may ultimately be rebounded 227 to reflect off persons 251 , 252, and 253 at a different angle than that obtained in F!GS. 1A and 1 B.
• the illustrated embodiment shows the rebounded ultrasound 227 reflecting off the left wall 242 prior to the persons 251 -253.
• the ultrasound may reflect off persons 251 -253 prior to the left wail 242 instead.
• ultrasound 225 may be rebounded and/or reflected by persons 251 -253 and one or more of surfaces/walls 241 -245 in any order and then be received by positioning system 210.
• FIG. 2B illustrates a side view of the dual modality positioning system 210 described in conjunction with FIG. 2A with the rebounded ultrasound 226 being received after reflecting off persons 251 -253, at location 228, and rebounding off left wail 242.
• FIG. 2B also shows a front wail 246.
• all of the ultrasound may be transmitted against a front wall 246 to more evenly distribute ultrasound throughout the region (i.e., a wider effective beam width).
• the positional data obtained by the rebounded ultrasound 226 may provide coarse image information not available via the direct reflections shown in FIGS. 1A and 1 B, e.g., due to one object preventing direct ultrasound from reaching a second object (or another portion of the first object).
• the visual representation of the positional data obtained illustrates three distinct objects 261 , 262, and 263 that are clearly in distinct planes relative to the dual modality positioning system 210.
• the positional data generated based on the rebounded ultrasound in FIG. 2B shows a distance D between object 262 and objects 261 and 263. Such a distance D may be difficult to determine or determined differently if only direct reflections were available (as in FIGS. 1A and 1 B).
• FIG, 3A illustrates a plurality of ultrasonic and/or electromagnetic radiation reflectors 371 , 372, 373, and 374 secured to, mounted to, positioned within, and/or integrally formed with one or more of the surfaces 341 , 342, 343, 345, and 348,
• a user/subject may hold or otherwise control a portable ultrasonic and/or electromagnetic radiation reflector 375
• the ultrasonic reflectors 371 -375 may facilitate the transmission, reflection, and/or reception of rebounded ultrasound by the dual modality positioning system 310,
• the ultrasonic and/or electromagnetic radiation reflectors may comprise passive, active, and/or actively moved/pivoted ultrasonic reflectors for controlling the direction in which ultrasound rebounds and/or otherwise travels within the region.
• the ultrasonic and/or electromagnetic radiation reflector may be configured to modify one or more of the frequency, phase, and/or amplitude of the rebounded ultrasound and/or electromagnetic radiation.
• the modified characteristic may facilitate the differentiation of the direct ultrasonic and/or electromagnetic radiation reflections and the rebounded ultrasonic and/or electromagnetic radiation reflections.
• the dual modality mapping or positing system 310 may generate positional data associated with one or more of the object(s) based on the direct ultrasonic and/or electromagnetic radiation reflection(s) (e.g., FIGS. 1A and 1 B) and/or the rebounded ultrasonic and/or electromagnetic radiation reflection(s) (e.g., FIGS. 2A and 2B).
• the positional data may comprise a centroid of the objects, a
• the positional data generated via one modality may be at a higher or lower resolution that the positional data generated by the other modality,
• the positional data may be defined with respect to one or more surfaces of the region, the dual modality positioning system 310, a receiver of the positioning system 312, and/or a transmitter 313 of the positioning system.
• the one or more objects within the region may comprise machinery, robots, furniture, household property, people in general, gamers, human controllers of electronic devices, electronic devices, fixtures, and/or other human or non-human objects.
• the object may comprise a specific portion of a person, such as a hand, finger, arm, leg, foot, toe, torso, neck, head, mouth, lip, and/or eye.
• a specific portion of a person such as a hand, finger, arm, leg, foot, toe, torso, neck, head, mouth, lip, and/or eye.
• rebounded ultrasonic transmissions may be reflected off an ultrasonic reflector 371 -375 disposed within the room.
• the ultrasonic reflectors may modify a characteristic of the reflected ultrasound, facilitating the identification of the received rounded ultrasonic reflections.
• FIG. 3B illustrates a plurality of active ultrasonic reflectors 391 -394 configured to facilitate the transmission, reflection, and/or reception of rebounded ultrasound by the positioning system.
• active ultrasonic reflectors 391 - 394 may be connected to a power source, such as batteries, solar cells, heat converts, outlets 380, and/or other suitable power source.
• the ultrasound itself may provide the power source.
• FIG. 4A illustrates an actively controlled ultrasonic reflector 472 in a first position.
• a dual modality positioning system 410 may be in communication with the ultrasonic reflector 472, or the ultrasonic reflector 472 may be autonomous.
• the positioning system 410 may transmit ultrasound 425 toward the persons 451 , 452, and 453 or toward the wail 442, as illustrated. The ultrasound 425 may then be rebounded off the wail 442 or reflected by the persons 451 -453, respectively.
• FIG. 4B illustrates the actively controlled ultrasonic reflector 472 in a second position.
• the ultrasonic reflector 472 may be pivoted and/or controlled by a pivot control 495.
• pivot control 495 may change other reflective, absorptive, and/or refractive properties of the ultrasonic reflector 472, in addition to its direction.
• an ultrasonic reflector 472 may have specific ultrasonic or other acoustic absorptive properties.
• a pivot control 495 may adjust the pivoting and/or acoustic and/or electrical properties.
• FIG. 5 illustrates a block diagram of a positioning system 500, according to one embodiment.
• a positioning system 500 may include a processor 530, a memory 540, and possibly a network 550 or other data transfer interface.
• a bus 520 may interconnect various integrated and/or discrete components.
• Various modules may be implemented in hardware, software, firmware, and/or a combination thereof.
• An ultrasonic transmitter module 580 may be configured to transmit ultrasound in any of the various forms and/or methods described herein.
• An ultrasonic receiver module 582 may be configured to receive a direct ultrasonic reflection from an object within a region. Additionally, the ultrasonic receiver module 582 may be configured to receive rebounded ultrasonic reflection from the object.
• direct reflections and rebounded reflections refer to the various descriptions provided herein as well as the generally understood and variations of these terms.
• a mapping system module 584 generates direct positional data associated with the object based on one or more direct ultrasonic reflections.
• the mapping system module 584 may also generate direct positional data associated with the object based on one or more indirect ultrasonic reflections, as may be understood in the art.
• the mapping system module 584 may also generate rebounded positional data associated with the object based on one or more indirect ultrasonic reflections, as may be understood in the art.
• a direct reflection module 588 may be configured to facilitate, manage, and/or monitor the transmission and/or reception of direct reflections.
• the rebounded reflection module 588 may be configured to facilitate, manage, and/or monitor the transmission and/or reception of rebounded reflections.
• the positional data calculation module 589 may generate direct positional data associated with the object based on one or more direct ultrasonic reflections.
• the positional data calculation module 589 may also generate rebounded positional data associated with the object based on one or more rebounded ultrasonic reflections.
• the positional data calculation module 589 may also generate enhanced positional data by combining the direct positional data and the rebounded positional data.
• FIG. 8 illustrates a flow chart of method 600 for generating positional data describing a relative position and/or movement of one or more objects within a region.
• the method steps are provided in no particular order and may be rearranged as would be technically feasible,
• a positioning system may transmit 605 ultrasound into a region bounded by at least one surface.
• the positioning system may receive 810 direct ultrasonic reflections from at least one object within the region,
• the positioning system may receive 812 rebounded ultrasonic reflections from at least one object within the region.
• the rebounded ultrasonic reflections may reflect off the wall(s) first and/or off the object(s) first,
• the positioning system may generate 814 positional data based on the direct reflections from the object,
• the positioning system may generate 816 positional data based on the rebounded reflections from the object.
• the positioning system may generate 618 enhanced positional data by combining the direct positional data and the rebounded positional data.
• the positioning system may transmit the direct positional data and the rebounded positional data to another electronic or other processing device for usage.
• any of the various configurations of ultrasonic transmitters, receivers, reflectors, and/or other components described in conjunction with the detection of the position of an object may also be applied to the embodiments described herein with respect to the detection and/or calculation of velocity and/or acceleration data associated with an object or objects, including those embodiments described below with reference to FIGS. 7A-12.
• direct and rebounded reflections, multiple reflectors and/or ultrasonic paths may be used to calculate velocity and/or acceleration data associated with an object within a region.
• FIG. 7A illustrates an ultrasonic system 710, which can be used as part of a dual modality system, transmitting 720 and receiving 740 reflected ultrasound from a stationary object 730.
• the spacing between the arcs representing the ultrasound 720 and 740 is representative of the wavelength and/or frequency of the ultrasound. With the object 730 in a stationary position, the reflected ultrasound 740 is not shifted with respect to the transmitted ultrasound 720.
• FIG, 7B illustrates the ultrasonic system 710 transmitting ultrasound 720 at a first frequency and receiving reflected ultrasound 741 at a second frequency from an object moving away from the ultrasound system 710.
• the frequency shift can be detected and used to determine the velocity of the reverse motion of the object 730.
• the velocity of the object 730, V 0 is equal to the change in frequency, Af, multiplied by the velocity of the ultrasound, V us , divided by the frequency of the transmitted ultrasound, ftrans, relative to the ultrasonic receiver.
• Any of a wide variety Doppler shift velocity and/or acceleration calculation and/or estimation algorithms may be utilized,
• FIG. 7C illustrates an ultrasound system 710 transmitting ultrasound 720 at a first frequency and receiving reflected ultrasound 742 at a second frequency from an object 730 moving toward the ultrasound system 710.
• Doppler shift algorithms for calculating, determining, and/or estimating the relative velocity of the object 730 with respect to the ultrasonic system 710 may be used.
• the Doppler equation :
• Equation 1 it is assumed that a transmission medium (e.g., air) is relatively stationary, f r is the frequency of the received ultrasound, C is the velocity of the ultrasound in the medium (e.g., air), V r is the velocity of the ultrasonic receiver relative to the medium, V 0 is the velocity of the object relative to the medium, and ft is the frequency of the transmitted ultrasound.
• An acceleration of the object may be determined using velocity calculations at multiple discrete time periods and/or by detecting a change in in the frequency of the received ultrasound, f r , over time.
• the ultrasonic system 710 may include one or more ultrasonic transmitters and/or ultrasonic receivers and the transmitters and receivers may be physically joined (as illustrated in FIG. 7C) or they may be separated and even possible positioned in disparate locations within the region.
• the transmitters and receivers may be embodied in a single transducer.
• each transducer may act as both an ultrasound transmitter and an ultrasound receiver.
• each transducer may be used in conjunction with an electromagnetic position detection system and/or receiver system as a dual modality system.
• FIG. 7D illustrates an ultrasonic system 710 transmitting and receiving reflected ultrasound 720 and 743 from a stationary object 730, similar to FIG. 7A.
• FIG. 7D provides a representative context for FIG. 7E.
• FIG, 7E illustrates a timing delay and/or phase shift, illustrated as missing wave arc 757, in reflected ultrasound 743 from the object 730 as it moves away from the ultrasound system 710,
• Doppler shifts may be used to determine acceleration and/or velocity information associated with a moving object. If is, however, recognized the various methods of velocity measurement may be utilized. Including, for example, phase shift (i.e., when received signals arrive) measurements, similar to those used in Doppler echocardiography.
• FIG. 8 illustrates ultrasound 820 rebounded, at 821 , off of a reflector 850 (e.g., an auxiliary reflector) prior to being reflected by an object 830 moving away from an ultrasound receiver 810.
• a reflector 850 e.g., an auxiliary reflector
• a shift in the received ultrasound 840 relative to the transmitted ultrasound 820 can be used to determine a velocity of the object 830 relative to the ultrasonic receiver 810.
• the ultrasound may first be reflected by the object 830, and then rebounded by the reflector 850. In such an embodiment, it may be possible to determine velocity and/or acceleration information of the object 830 relative to the reflector 850.
• FIG. 9 Illustrates an electromagnetic position detection system 913 used in conjunction with an ultrasound velocity and/or acceleration detection system 910 as a dual modality system.
• the ultrasonic velocity and/or acceleration detection system 910 may operate and/or be configured in conjunction with any of the various
• the electromagnetic position detection system 913 may detect a position of the object 930 using time-of-flight. For example, a laser or other electromagnetic radiation source may be used to measure a time-of-flight between the system 913 and the object 930.
• the position information obtained via an electromagnetic system 913 may be used in conjunction with velocity and/or acceleration data obtained using the ultrasonic system 910 described herein,
• FIG, 10 illustrates ultrasound 1020 reflected and/or rebounded from one or more auxiliary reflectors 1030 and 1040.
• an ultrasound receiver/transmitter 1010 may utilize direct reflections from an object within a region to determine velocity and/or acceleration information based on a detected frequency shift and/or phase shift.
• rebounded ultrasonic reflections may be utilized in addition to or instead of direct ultrasonic reflections.
• Ultrasound reflectors 1030 and 1040 may be active or passive and may be integrated into one or more appliances, walls, or other features of the region. In some embodiments,
• existing wails, room features, furniture, people, objects, or the like may be identified and/or specified as reflectors 1030 and 1040.
• FIG. 1 1 illustrates a plurality of ultrasonic systems 1 120, 1 121 , 1 122, and 1 123 for determining velocity and/or acceleration information from multiple directions relative to the object 1 1 10 or a site on object 1 1 10 within a region 1 100.
• each ultrasonic system 1 120-1 123 may include one or more ultrasonic transmitters and one or more ultrasonic receivers.
• one or more of the ultrasonic systems 1 120-1 123 may include one or more ultrasonic transmitters or one or more ultrasonic receivers.
• the ultrasonic transmitters and ultrasonic receivers may be separate components spaced apart from one another. As illustrated, the ultrasound may be rebounded off of one or more auxiliary reflectors 141 , 142, 143, and 144.
• FIG. 12 illustrates a method 1200 for determining velocity and/or acceleration information associated with a moving object.
• Ultrasound may be transmitted 1205 into a region bounded by at least one surface. Some embodiments may utilize direct reflections from the object to determine velocity and/or acceleration data based on a detected shift in the ultrasound, as provided in block 1240.
• a receiver may receive 1210 direct ultrasound reflections from at least one object or a site on an object within the region.
• a shift such as a wavelength shift, frequency shift, or phase shift, may be determined 121 1 between the transmitted ultrasound and the received ultrasound.
• the system may then generate 1214 velocity and/or acceleration data based on the detected shift.
• determining a shift may not necessarily require an actual determination of the difference between the, e.g., frequency, of the transmitted and received ultrasound. That is, "detecting a shift” and similar phrases may be constructively performed during a Doppler calculation of velocity and/or acceleration. For example, "detecting a shift” may be constructively performed if a velocity of an object is determined using (1 ) a known/measured frequency of transmitted ultrasound and (2) a known/measured frequency of ultrasound reflected by the object. The system may or may not actually calculate the frequency difference between the transmitted and received ultrasound, as various derivative and equal algorithms for Doppler-based velocity calculations may be utilized.
• rebounded reflections from the object may be used to determine velocity and/or acceleration data based on a detected shift in the ultrasound, as provided in block 1250.
• Ultrasound may be transmitted 1205 into a region bounded by at least one surface.
• a receiver may receive 1212 rebounded ultrasound reflections from at least one object or a site on an object within the region.
• a shift such as a wavelength shift, frequency shift, or phase shift, may be determined 1213 between the transmitted ultrasound and the received ultrasound.
• the system may then generate 1218 velocity and/or acceleration data based on the detected shift.
• velocity and/or acceleration data from direct reflections and rebounded reflections may be optionally combined 1218.
• Velocity and/or acceleration data from direct reflections and rebounded reflections may be used to determine two- dimensional vectors of velocity and/or acceleration information related to the object or a site on the object.
• FIG. 13A illustrates a dual modality system 1310a transmitting ultrasound 1325a and receiving ultrasound 1327 reflected off a person 1382a standing within a bounded region 1300a.
• the bounded region 1300a is bounded by a floor 1341 a, a left wall 1342a, a back wall 1343a, a right wall 1344a, and a ceiling 1345a.
• a front wall (not shown), may also bound the region 1300a.
• the dual modality system 1310a may utilize its ultrasound modality similar to that discussed in relation to the previous figures.
• the dual modality system 1310a may transmit the ultrasound 1325a as directional ultrasonic pulses, continuously, in a modulated fashion (frequency, amplitude, phase, etc.), and/or in another format.
• the ultrasound 1325a may be transmitted directly toward the person 1362a and/or the ultrasound 1325a may be transmitted indirectly toward the person 1362a.
• FIG. 13B illustrates a dual modality system 1310b generating coarse image data of an object based on received ultrasonic reflections.
• the direct ultrasonic reflection 1327b may convey coarse image information in a relatively two-dimensional fashion.
• Dual modality system 1310b may use a processor to generate coarse image data of a person 1362b or other object.
• the actual image data received may be at a higher or lower resolution depending on the sampling rates, accuracy, processing bit depth, frequency(ies) of ultrasound used, etc.
• the dual modality system 1310b may use a low resolution to track the object as a whole. If a low resolution is used, portions of interest may be identified for which more detailed information is desirable, useful, and/or necessary for a particular application.
• FIG. 13C illustrates a dual modality system 1310c identifying several portions of interest on an object using on coarse image data generated from ultrasonic reflections 1327c (or alternatively using received electromagnetic radiation).
• Portions of interest on a person 1382c may include a hand, finger, arm, leg, foot, toe, torso, neck, head, mouth, lip, and eye.
• dual modality system 1310c has identified the hands, feet, and head as portions of interest on person 1362c.
• the portion of interest may be identified based partly on the state of an associated entertainment device. For example, a state of the associated entertainment device may utilize a hand movement for a particular action that cannot be determined using coarse image data. In that situation, the dual modality system 1310c may identify the hands of a person 1362c as a portion of interest for which fine image data (i.e., higher resolution images) are desired. Whatever portions of interest are identified, the dual modality system 1310c may use a second modality to receive additional and more detailed image information.
• FIG. 14 illustrates a dual modality system 1410 using electromagnetic imaging in conjunction with ultrasound 1425 to receive additional image information from identified portion of interests.
• the dual modality system 1410 may use electromagnetic transmitters and/or receivers to receive/determine electromagnetic image information.
• a laser or other electromagnetic radiation source may be used to receive image data of an object, !n certain examples, the dual modality system 1410 may use a receiver such as an infrared receiver to gather image data from ambient radiation sources.
• electromagnetic radiation received may include microwave, terahertz, infrared, visible, and/or ultraviolet radiation.
• a system may use electromagnetic imaging capabilities to either receive coarse image data at a low-resolution or fine image data at a higher, more detailed resolution.
• FIG. 14 illustrates a dual modality system 1410 receiving electromagnetic radiation from an identified portion of interest on a two-dimensional coarse image generated using received ultrasound reflections 1427.
• electromagnetic radiation received may be used to generate a higher resolution image than the image generated using the received ultrasound reflections 1427.
• FIG. 15 illustrates a dual modality system 1510 generating fine image data of portions of interest on a person 1562.
• One modality such as ultrasound 1525
• a second modality such as electromagnetic radiation
• ultrasound or electromagnetic radiation may be utilized to gather the low-resolution image or the higher resolution image.
• FIG. 18 illustrates a method for generating an image using ultrasound and electromagnetic radiation.
• the method steps are provided in no particular order and may be rearranged as would be technically feasible.
• a dual modality system may transmit 1805 ultrasound into a region bounded by at least one surface.
• the dual modality system may receive 1807 direct or rebounded ultrasonic reflections from at least one object within the region. Using the received ultrasonic reflection, the dual modality system may generate 1809 coarse image data of the object.
• the dual modality system may identify 161 1 one or more portions of interest on an object.
• the dual modality system may receive 1613 electromagnetic radiation from the portionfs) of interest, and using the electromagnetic radiation, generate 1615 fine image data of the object.
• the fine image data may be of a higher resolution than the coarse image data.
• the system may also determine 1617 a kinematic value associated with the portion of interest, and modify 1619 the state of an entertainment device based on the kinematic value.
• FIG. 17 illustrates a method for generating an image using ultrasound and electromagnetic radiation.
• the method steps are provided in no particular order and may be rearranged as would be technically feasible.
• the dual modality system may receive 1702 electromagnetic radiation from a plurality of sites within a region. In some embodiments, the received electromagnetic radiation may be used to generate a coarse image of an object or site on an object with the region.
• the dual modality system may identify 1704 one or more portions of interest on an object.
• the dual modality system may transmit 1706 ultrasound into the region, and receive 1708 direct or rebounded ultrasonic reflections from the portion of interest. From the received ultrasonic reflection, the dual modality system may generate 1710 fine (higher resolution) image data of the object and/or portions of interest on the object.
• the system may also determine 1712 a kinematic value associated with the portion of interest, and modify 1714 the state of an entertainment device based on the kinematic value.
• FIG. 18 illustrates a method for resolving ambiguities in an image using ultrasound and electromagnetic radiation.
• the method steps are provided in no particular order and may be rearranged as would be technically feasible.
• a dual modality system may transmit 1805 ultrasound into a region bounded by at least one surface.
• the dual modality system may receive 1807 direct or rebounded ultrasonic reflections from at least one object within the region.
• the dual modality system may generate 1809 image data of the object.
• the image data generated using the received ultrasonic reflection may include at least one ambiguity, such as a ghost image.
• the dual modality system may receive 181 1 electromagnetic radiation from the object that is sufficient to resolve the ambiguity.
• the dual modality system may generate 1813 enhanced image data that resolves the ambiguity based on the received electromagnetic radiation.
• the system may also determine 1815 a kinematic value associated with the portion of interest and/or modify 1817 the state of an entertainment device based on the kinematic value.

Landscapes

• Engineering & Computer Science (AREA)
• Theoretical Computer Science (AREA)
• General Engineering & Computer Science (AREA)
• Human Computer Interaction (AREA)
• Physics & Mathematics (AREA)
• General Physics & Mathematics (AREA)
• Health & Medical Sciences (AREA)
• Computer Vision & Pattern Recognition (AREA)
• General Health & Medical Sciences (AREA)
• Psychiatry (AREA)
• Social Psychology (AREA)
• Multimedia (AREA)
• Ultra Sonic Daignosis Equipment (AREA)
• Measurement Of Velocity Or Position Using Acoustic Or Ultrasonic Waves (AREA)

Priority Applications (1)

Applications Claiming Priority (6)

Publications (1)

Family

ID=54072311

Family Applications (1)

Country Status (2)

Cited By (1)

Families Citing this family (1)

Citations (5)

Family Cites Families (3)

• 2015
  • 2015-03-10 CN CN201580013521.3A patent/CN106662913A/zh active Pending
  • 2015-03-10 WO PCT/US2015/019614 patent/WO2015138396A1/en active Application Filing

Patent Citations (5)

Also Published As

Similar Documents

Legal Events