KR20220066156A - Systems and methods for determining a projection target position of a portable object - Google Patents

Abstract

The projected target location of a handheld object is based on translation factors, scaling factors and offsets to the reference element location of the handheld object detected by the camera on a two-dimensional plane. is determined by applying The conversion factor is determined based on the difference between the calibration position on the plane and the initial position of the reference element corresponding to the calibration position, and serves to move the position of the reference element to generate the projection target position. The scaling factor is determined based on the estimated length of the user's arm holding the portable object, and serves to scale the position of the reference element to generate the projected target position. The offset is determined based on the polynomial and serves to extend the distance between the projection target position and the calibration position.

Description

Systems and methods for determining a projection target position of a portable object

CROSS-REFERENCE TO RELATED APPLICATIONS

This application is entitled "Systems and Methods for Determining Projected Target Location of a Handheld Object", filed September 25, 2019, U.S. Provisional Application No. 62/ 905,901, which is incorporated by reference in its entirety for all purposes.

BACKGROUND This disclosure relates generally to handheld objects used for pointing, and more particularly, to determining a projected target location of a handheld object.

This section is intended to introduce the reader to various aspects of the technology that may relate to various aspects of the present disclosure described and claimed below. It is believed that this discussion will provide the reader with background information to aid the reader in understanding various aspects of the present disclosure. Accordingly, the statements in this section should be construed in this light and not as an admission of prior art.

A portable object may be used to point or select a target. For example, in a theme park environment, a customer may use a portable object to point to an animated figure of an attraction, and in response to sensing this, the system causes the animated figure to appear in a user interaction experience. (e.g., wags tail) can be output. However, it is recognized that it may be difficult to accurately determine when the user points to a target due to certain physical characteristics related to the user's body.

BRIEF DESCRIPTION OF THE DRAWINGS The foregoing and other features, aspects and advantages of the present disclosure may be better understood upon reading the detailed description set forth below with reference to the accompanying drawings, wherein like reference numerals refer to like elements throughout.
1 is a diagram illustrating a user pointing a target with a portable object, according to an embodiment of the present disclosure.
2 is a block diagram of a theme park attraction system, according to an embodiment of the present disclosure.
3 is a diagram illustrating a user pointing to a calibration location with a portable object, according to an embodiment of the present disclosure.
FIG. 4 is a diagram illustrating an example of applying one or more translation factors to a subsequently detected position of a reference element of the portable object of FIG. 3 , in accordance with an embodiment of the present disclosure;
5 is a diagram illustrating an example of applying scaling factors to a subsequently detected position of a reference element of the portable object of FIG. 3 according to an embodiment of the present disclosure;
6 is a diagram illustrating a user pointing a portable object to another target of the system, in accordance with an embodiment of the present disclosure.
7 is a diagram illustrating a number of different sized reference element regions and a plurality of uniformly sized projection target regions, in accordance with an embodiment of the present disclosure.
8 is a diagram illustrating a number of uniformly sized reference element regions and a number of different sized projection target regions, in accordance with an embodiment of the present disclosure.
9 is a flow diagram of a process for determining a projection target position of the portable object of FIG. 3 , in accordance with an embodiment of the present disclosure;
10 is a flowchart of a process for compensating for distortion due to a shape difference between a two-dimensional plane and an arcuate characteristic of a user's arm movement, according to an embodiment of the present invention.

One or more specific embodiments are described below. For a brief description of such an embodiment, not all features of an actual implementation may be described herein. Developing an actual implementation, such as an engineering or design project, requires a number of implementation-related decisions to be made to achieve the developer's specific goals (which may be different for each implementation), such as complying with system and business-related constraints. It is also important to note that such development efforts can be complex and time consuming, but can be routine design, assembly and manufacturing activities for those skilled in the art having the benefit of this disclosure.

When introducing components of various embodiments of the present disclosure, the use of the words “a”, “the”, and “the” means that one or more components are present. The term has an inclusive meaning, and means that there may be additional elements other than the listed elements.In addition, the reference to “one embodiment” of the present disclosure indicates the existence of additional embodiments including the listed features. It should not be construed as an exclusion.

BACKGROUND This disclosure relates generally to handheld objects used for pointing, and more particularly, to determining a projected target location of a handheld object. In particular, the reference element may provide an indication of where the portable object is pointing. For example, in a theme park environment, a customer may use a portable object to point to an animated object (eg, a robot or otherwise animated figure) of an attraction, and to detect the position of a reference element. In response, the animated object may output a user-interactive experience (eg, wag its tail). As another example, the user may point to a word on the poster, and in response to detecting the location of the reference element, a nearby speaker may output a voice speaking the word. As another example, the user may point to an image of a person on the electronic display, and in response to detecting the position of the reference element, the display may play a video showing the person moving in the image.

The systems and methods disclosed herein include using a camera to determine the position of a reference element on a two-dimensional plane perpendicular to the direction of the camera. The camera may detect a reference element of the portable object, which may be made of a material that can be more easily detected by the camera (eg, a retroreflective material). The position of the reference element may be used to determine the target position at which the user points with the portable object. However, in some systems, the user's perception of where he is pointing with the portable object may not match the projected position of where the user is pointing, which is determined based on the camera's view. This can be due to a variety of factors, for example, one eye predominates over the other (e.g. right eye or left eye predominates), tilting the head, shifting weight, or leaning body to one side or the other. This may include tilting, etc. Due to the combination of these factors, even if the user's hand is pointing at the portable object at the same location, the user's perception of the location at which he is pointing may change. It should be noted that the camera is an example of various light detectors that can be used according to the present embodiment. Thus, reference to a camera is representative of other photodetectors that may be used by embodiments of the present disclosure.

The systems and methods disclosed herein include providing a calibration point on a two-dimensional plane, which a user can point to with a portable object. The position of the reference element with respect to the two-dimensional plane may be determined as an initial position, and one or more translation factors may be determined based on a difference between the initial position and the calibration point. That is, the calibration point may have a correlation with the position at which the user perceives that he or she is pointing with a portable object, whereas the initial position of the reference element may have correlation with the position of the reference element on the two-dimensional plane from the viewpoint of the camera. there is. The difference between the two is that, from the camera's point of view, the subsequently detected reference element position on the two-dimensional plane will be used to translate into a projected target position (e.g., corresponding to a position the user perceives he is pointing to or intends to point to). can That is, the one or more conversion factors may compensate for a difference between the user's perception of the location at which he is pointing with the portable object and the camera's determination of where the reference element is located on the two-dimensional plane.

In addition, the user uses his/her arm to move the portable object and point to the portable object. The user's arm acts as a sphere or radius of a spherical segment in the interaction model, and the user's shoulder is treated as the center of the sphere. can be As the user moves the portable object or points at a different target, the respective positions of the reference elements of the portable object may differ from user to user despite pointing to the same target. This may be because each user has a different arm length.

Accordingly, the systems and methods disclosed herein determine the height of a reference element (eg, from the ground) based on the initial position of the reference element, and estimate the height of the user based on the height of the reference element. The user's arm length may be estimated from the user's height, which may be used to determine one or more scaling factors. The one or more scaling factors may be used to determine a subsequently detected reference element position on a two-dimensional plane from the point of view of the camera to more accurately determine a projection target position (eg, corresponding to a position the user perceives he is pointing at or intends to point to). can be scaled or multiplied. In this way, one or more scaling factors may compensate for differences between user arm lengths.

Upon detection of a subsequent reference element position by the camera, one or more conversion factors and one or more scaling factors may be applied to the subsequent reference element position to determine a projection target position relative to a two-dimensional plane. Embodiments may include a processor operative to analyze data captured and communicated by the camera to provide relevant data, such as a conversion factor, a scaling factor, a projected target position relative to a two-dimensional plane, and the like.

Additionally, since the user's arm acts as a radius of a sphere or spherical segment about the user's shoulder, the user can move the portable object in an arcuate or circular nature. However, a camera that determines the position of a reference element of a portable object on a flat two-dimensional plane may not be able to determine the reference element due to the arcuate motion of the portable object in space and a shape difference between a flat two-dimensional plane that can be detected by the camera. position may be distorted.

Accordingly, the systems and methods disclosed herein can determine one or more offsets to apply to the projection target position that compensate for such distortion. The one or more offsets may increase or extend the distance between the projection target position and the initial position by shifting the projection target position to compensate for a shape difference between the arcuate nature of the user's arm movement and a flat two-dimensional plane. For example, the one or more offsets may be determined using polynomial regression that fits the test data to one or more polynomials (eg, cubic polynomials).

In some embodiments, there are multiple reference element regions (eg, wherein the reference element is located along an arc based on the user's arm) that correspond to multiple projection target regions (eg, projected onto a two-dimensional plane). can be decided. Each projection target area may correspond to a respective set of polynomials capable of accurately compensating for the distortion applicable to that projection target area. As such, the camera can detect the reference element in the reference element region, each projection target region corresponding to the reference element region can be determined, and each set of polynomials corresponding to each projection target region compensate for this distortion may be used to determine one or more offsets to be applied to the position of the reference element in order to In such an embodiment, when a plurality of reference element regions are of different sizes (eg, the size of the reference element regions decreases as the reference element regions move away from the two-dimensional plane), the plurality of projection target regions are the same size, or The plurality of projection target areas may be of different sizes when the reference element areas are the same size (eg, the projection target area increases in size as the projection target area moves away from the reference element).

As an introduction, FIG. 1 is a diagram illustrating a user 10 pointing a target 14 at a portable object 12 , according to an embodiment of the present disclosure. The target 14 may be a physical object, a drawing, a photograph, a graphic, or the like. Optionally, the target 14 may be an image output by a display. Target 14 may be printed, etched, recorded, projected, affixed, or otherwise marked on structure 15 . The user's recognition is indicated by a first dotted line 16 . That is, the user 10 recognizes that he is pointing the portable object 12 at the target 14 , in particular the target location 17 . However, due to certain human factors (e.g., dominance of one eye over the other, tilting the head, shifting weight, leaning the body to one side or the other, etc.), users (10) despite the user's awareness or intention is actually pointing to the actual target position 18 indicated by the dashed line 19 with the portable object 12 .

Portable object 12 may represent or include any suitable object that user 10 may use to point or refer to target 14 , such as a stick, pencil, toy, or model gun or weapon, cane, or the like. The portable object 12 may include a reference element 20 that may facilitate determining where the user 10 is pointing. In particular, the camera 22 is capable of detecting the position of the reference element 20 , the reference element 20 being made of a material or device that allows the camera 22 to more readily detect the reference element 20 . can For example, the reference element 20 may be made of a retroreflective material (eg, retroreflective glass beads, microprisms, or an encapsulated lens sealed on a textile or plastic substrate), metal tape, or the like. In another example, the fiducial element 20 may include an identifier (eg, a unique graphic design, barcode, Quick Response (QR) code, etc.) that enables the camera 22 to identify the fiducial element 20 . there is. As shown, the reference element 20 may be positioned at an end 24 opposite the end 26 of the portable object 12 at which the user's hand 28 is holding the portable object 12 . While this arrangement may facilitate determining the direction the user is pointing at the portable object 12 , the reference element 20 may be placed on any part of the portable object 12 or even at the user 10 . may be placed.

The camera 22 can detect the position 30 of the reference element 20 with respect to the two-dimensional plane 32 . The location 30 may be used to apply one or more conversion factors to determine the target location 17 that the user 10 perceives to be pointing to or intended to point to. As shown, the two-dimensional plane 32 may share the same plane as the structure 15 , but in some embodiments the two-dimensional plane 32 and the structure 15 may not share the same plane. For example, the two-dimensional plane 32 and the structure 15 may be parallel to each other. Moreover, in order to enable the camera 22 to detect the position 30 of the reference element 20 , the structure 15 is made translucent or transparent, or allows the camera 22 to detect the position 30 of the reference element 20 . ) may include any other suitable attribute that makes it detectable.

In particular, one or more conversion factors are applied to the position 30 of the reference element 20 so that the user's perception of the position at which he is pointing with the portable object 12 and the reference element 20 are in a two-dimensional plane 32 . It can compensate for the difference between the camera's determination of where the image is located. One or more conversion factors may be determined during the calibration process in which the user 10 points a calibration point to the portable object 12 and the camera 22 detects this initial position of the reference element 20 on the two-dimensional plane 32 . there is. The one or more conversion factors may indicate one or more distances at which the initial position moves (eg, with respect to the two-dimensional plane 32 ) resulting in a calibration point. Additionally, the one or more conversion factors may alleviate predominance of one eye over the other (eg, predominance of right eye or predominance of left eye), tilt of the head, shift of weight, tilt of body to one side or the other. or you can compensate.

Moreover, one or more scaling factors may be applied to the position 30 of the reference element 20 to account for or compensate for differences between user arm lengths. That is, the user moves or points to the portable object 12 using his/her arm, which may act as a radius of a sphere or spherical segment, with his shoulder as the center of the sphere. As the user moves the portable object 12 or points at a different target, the respective positions of the reference elements 20 of the portable object 12 may differ from user to user due to different arm lengths between the users despite pointing at the same target. there is.

Accordingly, the height of the reference element 20 may be determined (eg, from the ground) based on the initial position of the reference element 20 , and the height of the user may be estimated based on the height of the reference element 20 . . The user's arm length may be estimated from the user's height, which may be used to determine one or more scaling factors. The one or more scaling factors may scale or multiply the position 30 of the reference element 20 detected by the camera 22 on the two-dimensional plane 32 .

Additionally, one or more offsets may be applied to the position 30 of the reference element 20 to create a projected target position of the portable object 12 to compensate for distortion due to arcuate or circular motion of the user's arm. That is, the distortion may be caused by the shape difference between the arcuate movement and the detection of the camera with respect to the position 30 of the reference element 20 on the flat two-dimensional plane 32 . The one or more offsets may increase or extend the distance between the projection target position and the initial position by shifting the projection target position to compensate for a shape difference between the arcuate nature of the user's arm movement and a flat two-dimensional plane. For example, one or more offsets may be determined using polynomial regression that fits the test data to a polynomial, such as a cubic polynomial.

In this way, a projected target position of the portable object 12 may be created, which may closely coincide with the target position 17 that the user 10 perceives as pointing at the portable object 12 . Advantageously, unlike certain other systems, only one calibration point is used to determine the conversion factor, scaling factor and offset and to accurately determine the projection target position of the portable object 12 . On the other hand, in other applications (eg pointing devices used for presentations), reducing the calibration time may not be important because the calibration may occur before actual performance (eg during the preparation phase) and will not be visible to the audience or customer. However, in the case of the present invention (eg, at an attraction in a theme park), it can be important to create an immersive user experience by hiding that a calibration is being performed or preventing the user 10 from noticing it. As such, reducing the calibration process to a single point (eg, pointing a single calibration point with a portable object 12) may enhance or augment the user experience.

With this in mind, FIG. 2 is a block diagram of a theme park attraction system 40 according to an embodiment of the present invention. The theme park attraction system 40 may cause the user 10 to point the portable object 12 to various targets 14 , and to determine that the user 10 has pointed the portable object 12 at the target 14 . Based on the user interaction experience may be output. For example, the attraction system 40 may include a setting with characters popular with children, a television or movie themed setting, a shooting gallery, a collection of targets, and the like.

The theme park attraction system 40 may include a portable object 12 having a reference element 20 that is gripped and manipulated by the user 10 . The theme park attraction system 40 may also include a user interaction system 42 , which includes a camera 22 that detects the position of a reference element on a two-dimensional plane 32 . . The theme park attraction system 40 may further include a projection positioning system 44 for determining a projection target position of the portable object 12 . In particular, the projected target location may represent a location on the two-dimensional plane 32 that the user 10 perceives to be pointing to or intended to point to. In practice, the closer the projection target position to the target position 17 the more accurate the projection target position.

The projection positioning system 44 may include a controller 46 having one or more processors (shown as a single processor 48 ) and one or more memory or storage devices (shown as a single memory device 50 ). . The processor 48 may execute software programs and/or instructions stored in the memory device 50 that facilitate determining the projection target position of the portable object 12 . Moreover, processor 48 may include multiple microprocessors, one or more “general purpose” microprocessors, one or more special purpose microprocessors, and/or one or more application specific integrated circuits (ASICS). For example, processor 48 may include one or more reduced instruction set (RISC) processors. The memory device 50 may store information such as control software, lookup tables, configuration data, and the like. Memory device 50 may include volatile memory (eg, random access memory (RAM)), non-volatile memory (eg, read-only memory (ROM)), flash memory, one or more hard drives, and/or any other suitable optical; tangible, non-transitory machine readable media such as magnetic or solid state storage media. Memory device 50 may store a variety of information and may be used for a variety of purposes, such as instructions to facilitate projection target positioning of portable object 12 .

The projection positioning system 44 may also include reference element position detection logic 52 to determine the position of the reference element 20 on the two-dimensional plane 32 . In particular, the projection positioning system 44 may be configured, for example, via wired communication or via a wireless communication protocol or technology (eg, radio, Bluetooth, WiFi, infrared, Ethernet, Thread, ZigBee, Z-Wave, KNX). , mobile, and/or microwave) may be communicatively coupled to the user interaction system 42 by any suitable means. The reference element position detection logic 52 may thus receive from the camera 22 a captured image (eg, an image) showing the reference element 20 on the two-dimensional plane 32 . The reference element position detection logic 52 may determine the position of the reference element 20 on a two-dimensional plane 32 represented, for example, in a two-dimensional coordinate (eg, x and y) system.

Projection positioning system 44 provides transformation logic 54 ( transformation logic) may be further included. Transformation logic 54 calculates the difference between the user's perception of where it is pointing with portable object 12 and the camera's determination of where on the two-dimensional plane 32 the reference element 20 is located. and transition logic 56 for determining one or more conversion factors to compensate.

In particular, the conversion logic 56 may determine one or more conversion factors by performing a single point calibration process. The process includes receiving a calibration location on the two-dimensional plane 32 , a reference element on the two-dimensional plane 32 (eg, corresponding to the point in time when the user 10 points the calibration location to the portable object 12 ) receiving the position of 20 ), and determining one or more conversion factors based on a position difference between the calibration position and the position of the reference element 20 .

3 is a diagram illustrating a user 10 pointing to a calibration location 80 with a portable object 12 , in accordance with one embodiment of the present disclosure. The calibration location 80 may correspond to a physical object, a picture, a photograph, a graphic, or the like. In some cases, the calibration position 80 may correspond to an image output by the display. User 10 may be guided by instructions provided in any suitable format (eg, written, etched, printed, affixed, or marked on structure 15 ). Calibration position 80 allows the user to similarly position his or her arm to enable a controlled manner of detecting the user's height, while allowing the projection positioning system 44 of FIG. (12) can be provided to determine the difference between the user's perception of the location at which he is pointing and the location at which the user 10 is actually pointing with the portable object (12). For example, the corrective position 80 may cause the user 10 to extend his or her arm 82 as close as possible parallel to the ground 84, at a particular angle to a plane parallel to the ground, etc. can be located In some embodiments, the corrective position 80 may be customized to a user's height. That is, in some embodiments the corrective position 80 may be located lower on the structure 15 for a user sitting in a vehicle such as a wheelchair, personal electric vehicle, stroller, or the like. As another example, the corrective position 80 may be located higher on the structure 15 for an adult relative to a child, and the corrective position 80 is located higher on the structure 15 for a male user as compared to a female user. that's what you can do

As such, the calibration location 80 is predetermined and the projection positioning system 44 knows this calibration location 80 . When guided, the user 10 can extend his or her arm 82 and point the handheld object 12 to the calibration position 80 . However, one eye predominates over the other, tilts the head, shifts weight, leans to one side or the other, the user's choice of hand holding the portable object 12 (eg right versus left hand); Due to distortion effects caused by the body, such as physical constraints (e.g. affecting range of motion), whether obstacles (e.g. backpacks or holding a child) may alter the user's movements, the Notwithstanding the user's perception that the handheld object 12 is pointing to the calibration location 80 as indicated or the user's intention to point the calibration location 80 with the handheld object 12, the Likewise, the user 10 can actually point the portable object 12 to another location, such as the actual calibration location 86 .

The camera 22 detects the position 90 of the reference element 20 on the two-dimensional plane 32 , and transmits an indication of the position 90 to the projection positioning system 44 . The conversion logic 56 , which may be part of the model of human interaction , then generates a position 90 of the reference element 20 and a predetermined calibration position, which may be expressed in two-dimensional (eg x and y) coordinates ( 80) can be determined. The transition logic 56 uses this difference to generate one or more transition factors that can be applied to the subsequently detected position of the reference element 20 to move the subsequently detected position of the reference element 20 and A subsequent projection target position of the portable object 12 may be determined that corresponds to a position that the user 10 wishes to point to with the portable object 12 . The transformation factor may be provided in the form of a transformation matrix, which may be applied to subsequently detected positions of the reference element 20 to produce a projected target position of the reference element 20 as indicated below. .

where x = the horizontal component of the position 90 of the reference element 20 on the two-dimensional plane 32 ,

y = the vertical component of the position 90 of the reference element 20 on the two-dimensional plane 32 ,

X = the horizontal difference between the calibration position 80 and the reference element 20 on the two-dimensional plane 32 ,

Y = the vertical difference between the calibration position 80 and the reference element 20 on the two-dimensional plane 32 ,

x' = the horizontal component of the projection target position of the portable object 12 on the two-dimensional plane 32 , and

y' = the vertical component of the projection target position of the portable object 12 on the two-dimensional plane 32 .

For example, FIG. 4 is a diagram illustrating an example of applying one or more conversion factors to a subsequently detected position 120 of a reference element 20 , in accordance with an embodiment of the present disclosure. As shown, during calibration, the position 90 of the reference element 20 is 2 units (eg centimeters) to the right of the calibration position 80 and 1 unit (eg centimeters) above the calibration position 80 . there is. Accordingly, the conversion factor may include +2 in the horizontal direction and +1 in the vertical direction. Accordingly, in the transformation matrix, X may be set to +2 and Y may be set to +1. The transformation logic 56 applies the transformation matrix to the subsequently detected positions 120 of the reference element 20 (eg, [4, 2]), shifting the subsequently detected positions 120 to the right by 2 A unit and shifted one unit upward can create a projection target position 122 that is 6 units to the right of the calibration position 80 and 3 units upward (eg, [6, 3]). Thus, the transition logic 56 is responsible for the difference between the user's perception of the location at which it is pointing with the portable object 12 and the camera's determination of where the reference element 20 is located on the two-dimensional plane 32 . difference can be compensated.

2, the transformation logic 54 may also include scaling logic 58 that determines one or more scaling factors that compensate for differences between the user's arm lengths. That is, as shown in FIG. 3 , the user 10 uses his or her arm 82 to act as a radius of a sphere or spherical segment 92 with his shoulder as the center 94 of the sphere to carry the portable object. Move (12) or point to a portable object (12). As the user 10 moves the portable object 12 to point at a different target, the respective positions of the reference elements 20 of the portable object 12 are at different arm lengths between the users 10 despite pointing at the same target. Due to this, it may be different for each user 10 .

In particular, the scaling logic 58 may determine one or more scaling factors based on the position 90 of the reference element 20 detected by the camera 22 during the calibration process. The height 96 of the camera 22 from the ground 84 is predetermined and the scaling logic 58 knows the height 96 of this camera 22 . Accordingly, the scaling logic 58 may determine the height 98 of the reference element 20 from the ground 84 based on the predetermined height 96 and the position 90 of the reference element 20 . Based on the height 98 of the reference element 20 , the user height estimation logic 60 of the scaling logic 58 may determine the height 100 of the user. In particular, test or sample data may be collected for the height 90 of the reference element 20 and the height of such user 10 when the user 10 points the calibration position 80 with the portable object 12 . there is. The height 102 of the position 90 of the reference element 20 may be correlated with the height of the user 10 , and the scaling logic 58 uses this predetermined correlation and the height 98 of the reference element 20 . Based on the , the height 100 of the user may be estimated. Models for identifying correlations can be populated with tables of standard correlations between height and reach (eg, the ratio between height and arm length for various body types in the population).

The user arm length estimation logic 62 of the scaling logic 58 may then estimate the user's arm length 104 based on the user's height 100 . This estimate may be made based on a predetermined correlation (eg, an algorithm or table based on empirical data) between the arm length 104 and the height 100 of the user. This predetermined correlation may be determined based on test or sample data, scientific data relating to body proportions, and/or any other suitable data.

The scaling logic 58 may determine one or more scaling factors based on the user's arm length 104 . For example, when pointing away from the initial position (eg, the calibration position 80 ), the camera 22 may detect a user with a shorter arm length 104 as compared to a user 10 with a longer arm length ( In case 10), it can be detected that the position of the reference element 20 is closer to the initial position. As such, the scaling logic 58 may determine a larger scaling factor for the user 10 having the longer arm length 104 compared to the user 10 having the shorter arm length 104 . The scaling logic 58 applies one or more scaling factors to the subsequently detected position of the reference element 20 to scale (eg, reduce or expand) the position to the projected target position of the reference element 20 . can create The scaling factor includes horizontal and vertical components, is provided in the form of a transformation matrix, and may be inserted into a transformation matrix including the transformation factor of Equation 1, as indicated below.

where k ₁ = a horizontal scaling factor generated based on the user's arm length 104, and

k ₂ = a vertical scaling factor generated based on the user's arm length 104 .

The values of the scaling factors k ₁ and k ₂ depend on the user 10 pointing at various targets with the portable object 12 and correlating test or sample data collected from the arm length 104 of the user 10 . can be determined based on For example, the scaling logic 58 may determine that the height 98 of the reference element 20 from the ground 84 is 1.25 based on image data received from the camera 22 (eg, a first or calibration image of the image). meter can be determined. The user height estimation logic 60 may determine that the user's height 100 is about 1.8 meters based on the height 98 of the reference element 20 . User arm length estimation logic 62 may determine that the user's arm length 104 is 0.6 meters based on the user's height 100 . The scaling logic 58 may then determine based on the user's arm length 104 that the horizontal scaling factor k ₁ is 1.5 and the vertical scaling factor k ₂ is 1.75. Accordingly, the scaling logic 58 generates the transformation matrix of equation (2) with k ₁ =1.5 and k ₂ =1.75, and the projection positioning system 44 transforms the subsequently detected position of the reference element 20 into The matrix may be applied to create a projected target position of the position that the user 10 wishes to point to the portable object 12 , which compensates for differences between the user arm lengths 104 .

For example, FIG. 5 is a diagram illustrating an example of applying a scaling factor to a subsequently detected position 120 of the reference element 20 according to an embodiment of the present disclosure. As shown, the subsequently detected position 120 of the reference element 20 is located 4 units (eg centimeters) to the right from the calibration position 80 and 4 units (eg centimeters) from the calibration position 80 . ) as much as above (eg [4, 4]). If the transformation matrix of Equation 2 having a horizontal scaling factor k ₁ =1.5 and a vertical scaling factor k ₂ =1.75 is applied to the subsequently detected positions 120, the subsequently detected positions 120 are horizontally 1.5 creates a projected target position 130 located 6 units to the right of the calibration position 80 by scaling by Create a projection target position 130 located at (eg [6,7]). Accordingly, the scaling logic 58 may compensate for differences in the user's arm length 104 .

2 , the projection positioning system 44 may include arc distortion compensation logic 64 that compensates for shape differences between the arcuate characteristic 92 of the user's arm movement and the flat two-dimensional plane 32 . there is. For example, FIG. 6 is a diagram illustrating a user 10 pointing a different target with a portable object 12 . As shown, the angle θ between the first position 140 of the user's arm 82 and the second position 142 of the user's arm 82 is the third position 144 of the user's arm 82 . and the fourth position 146 of the user's arm 82 is equal to the angle formed. However, the first reference element position 148 corresponding to the first position 140 of the user's arm 82 and the user's arm as observed and captured by the camera 22 on the two-dimensional plane 32 . The distance h ₀ between the second reference element location 150 corresponding to the second location 142 of 82 is the third reference element location 152 corresponding to the third location 144 of the user's arm 82 . ) and the distance h ₁ between the fourth reference element position 154 corresponding to the fourth position 146 of the user's arm 82 , is different (eg, greater than).

Accordingly, arc distortion compensation logic 64 may determine one or more offsets to apply to the projection target position to compensate for this distortion. The one or more offsets move the projection target position to increase or extend the distance between the projection target position and the initial position (eg, the correction position 80 ), so that the arcuate nature of the user's arm movement 92 and a flat two-dimensional plane 32 ) can compensate for the shape difference between For example, the one or more offsets may include test or sample data from a user 10 pointing various targets to a portable object 12 (eg, to a reference element 20 along an arc 92 ) into the equation. It can be determined using a regression analysis to fit. Although any suitable order or type of equation may be used, in some embodiments, the arc distortion compensation logic 64 may fit the test data to a polynomial (eg, a cubic polynomial). For example, a first cubic polynomial (Equations 3 and 4 below) can be used to determine a horizontal offset to apply to a projected target position that compensates for this distortion in the horizontal direction, and a second third order polynomial A polynomial (Equations 5 and 6 below) can be used to determine a vertical offset to be applied to the projection target position that compensates for distortion in the vertical direction.

(Additionally or alternatively, it may be represented as:

(Additionally or alternatively, it may be represented as:

where x _offset = horizontal offset to be applied to the projection target position,

y _offset = vertical offset to be applied to the projection target position,

x = horizontal component of the projection target position,

y = the vertical component of the projection target position, and

a _i , b _i , c _i , a, b, c, d, e, f, g, h, k and l = constants determined using regression analysis, where each constant can be different for each expression ( Example: The constant a in Equation 4 may be different from the constant a in Equation 6).

The horizontal component of the projection target position is measured as the horizontal distance away from the initial position (eg, corresponding to the calibration position 80 and/or the point at which the user 10 points the camera 22 directly at the portable object 12 ). Whereas the vertical component of the projection target position can be measured as the vertical distance away from the initial position. As noted above, the constants a _i , b _i , c _i , a, b, c, d, e, f, g, h, k and l for any of Equations 3 to 6 of the polynomial are: It can be determined by fitting test or sample data to a polynomial using polynomial regression analysis (and such constants may differ from equation to equation). As such, one or more offsets may be determined for each projection target position as the user 10 moves and points at the portable object 12 .

However, apply any of Equations 3 to 6 to determine the horizontal and vertical offsets for each projection target position as the user 10 moves and points at the portable object 12 . Doing so can be time consuming and use excessive computing resources (eg, processing, memory, storage, or networking resources). Accordingly, to more efficiently compensate for shape differences between the arcuate characteristic 92 of the user's arm movement and the flat two-dimensional plane 32 , in some embodiments, the arc distortion compensation logic 64 may ) may be divided into multiple reference element regions, each reference element region may correspond to a respective projection target region (eg, projected onto a two-dimensional plane). Each projection target area may correspond to a respective set of polynomials capable of accurately compensating for the distortion applicable to that projection target area. As such, the camera 22 may detect the reference element 20 in the reference element region, and the arc distortion compensation logic 64 may determine each projection target region corresponding to the reference element region, and arc distortion compensation Logic 64 may apply each set of polynomials corresponding to each projection target area to the location of the reference element to determine one or more offsets to be applied to the location of the reference element to compensate for such distortion. In such an embodiment, when multiple reference element regions are of different sizes (eg, the size of the reference element regions decreases as the reference element regions move away from the two-dimensional plane 32 ), the multiple projection target regions are the same size or , the plurality of projection target areas may be of different sizes when the plurality of reference element areas are the same size (eg, the size of the projection target area increases as the projection target area moves away from the reference element 20 ).

7 is a diagram illustrating a number of different sized reference element regions 170 and a number of uniformly sized projection target regions 172 , in accordance with an embodiment of the present disclosure. As shown, the size of the first reference element region 174 closest to the two-dimensional plane 32 is largest, followed by the size of the second reference element region 176 closest to the two-dimensional plane 32 . The next largest (smaller than the first reference element region 174), and then the third closest reference element region 178 close to the two-dimensional plane 32, is the next largest (second reference element region 174) 176 ), and the fourth reference element region 180 , which is next closest to the two-dimensional plane 32 , is next in size (smaller than the third reference element region 178 ). Although four reference element regions 170 are shown in FIG. 7 , any suitable number of reference element regions 170 are contemplated in any suitable size, wherein reference element region 170 is a two-dimensional plane ( 32), the size of the reference element region 170 decreases. Further, each projection target area 172 is the same size as the other projection target areas 172 , and corresponds to each reference element area 170 , and each offset to be applied to the position of the reference element 20 (eg: each corresponding to a set of polynomials generating horizontal and vertical offsets). In particular, each set of polynomials corresponding to each projection target area 172 is, as provided in any of Equations 3-6, the constants a _i , b _i , c _i , a, b, c , d, e, f, g, h, k, and l may have different sets of values (and these constants may be different from each other). The arc distortion compensation logic 64 reduces the size of the reference element region 170 as it moves away from the two-dimensional plane 32 while maintaining the same size of the projection target region 172 . to compensate for the shape difference between the arcuate characteristic 92 of the user's arm movement and the flat two-dimensional plane 32 in an efficient and resource-saving manner.

8 is a diagram illustrating a number of uniformly sized reference element regions 190 and a number of different sized projection target regions 192 , in accordance with an embodiment of the present disclosure. As shown, each reference element region 190 is the same size. However, the size of the first projection target area 194 closest to the reference element 20 is the smallest, and the size of the second projection target area 196 closest to the reference element 20 is next smaller ( Larger than the first projection target area 194 ), then the third projection target area 198 close to the reference element 20 is the next smaller in size (greater than the second projection target area 196 ) , then the fourth projection target area 200 close to the reference element 20 has the next smallest size (greater than the third projection target area 198 ). Although four projection target areas 192 are shown in FIG. 8 , any suitable number of projection target areas 192 are contemplated in any suitable size, wherein the projection target area 192 is the reference element 20 . ), the size of the projection target area 192 increases. Each projection target area 192 corresponds to a respective reference element area 190 , in a respective set of polynomials that produce respective offsets (eg, horizontal and vertical offsets) to be applied to the position of the reference element 20 . respond In particular, each set of polynomials corresponding to each projection target area 192 is, as provided in any of Equations 3-6, the constants a _i , b _i , c _i , a, b, c , d, e, f, g, h, k, and l may have different sets of values (and these constants may be different from each other). Increasing the size of the projection target area 192 as the projection target area 192 moves away from the reference element 20 while maintaining the same size of the reference element area 190 is performed by arc distortion compensation logic 64 . compensating for shape differences between the arcuate nature 92 of the user's arm movement and the flat two-dimensional plane 32 in an efficient and resource-saving manner.

For simplicity, FIGS. 6-8 show the distortion caused by the shape difference between the arcuate nature 92 of the user's arm movement and the flat two-dimensional plane 32 only in the vertical (eg, y) direction. However, the systems and methods disclosed herein contemplate compensating for distortion in any suitable direction, which is demonstrated by equations 3 and 4 providing a horizontal offset to compensate for distortion in the horizontal direction. The horizontal (eg x) direction as shown, and the vertical (eg y) direction as evidenced by equations (5) and (6) providing a vertical offset to compensate for distortion in the vertical direction are included.

2 , when the projection positioning system 44 determines that the projection target position corresponds to a target 14 printed, etched, recorded, affixed, or otherwise displayed on the structure 15 , The output device 66 of the user interaction system 42 may output a user interaction experience. The output device 66 may output a desired user interactive experience, such as an electronic display, speaker, virtual reality device, augmented reality device, actuator, and/or animated device (eg, a robot figure). It may be any suitable device capable of being The target 14 may be part of, fixed to, attached to, or include an output device 66 , or the target 14 may be separate from the output device 66 . For example, in the environment of a theme park, target 14 and output device 66 can both be animated objects of an attraction, which are animated in response to determining that the projected target position corresponds to the animated object. Objects may output user interaction experiences (eg, wag their tails). As another example, target 14 may be a word printed on a poster and output device 66 may be a nearby speaker, responsive to determining that the projected target location corresponds to a word printed on the poster, a nearby speaker may output a voice speaking the corresponding word. As another example, target 14 may be an image of a person on an electronic display and output device 66 may be an electronic display, and in response to determining that the projected target location corresponds to an image of a person, the electronic display may display a unique You can play a video showing the person in the image performing the action.

With this in mind, FIG. 9 is a flow diagram of a process 210 for determining a projection target position of a portable object 12, according to an embodiment of the present disclosure. Process 210 may be performed by any suitable device capable of determining a projection target position of portable object 12, such as any component of projection positioning system 44, such Optional components of 44 include controller 46 , processor 48 , reference element position detection logic 52 , transformation logic 54 , transition logic 56 , scaling logic 58 , user height estimation logic ( 60 ), and/or user arm length logic 62 . Although process 210 is described using a specific order of steps, it is contemplated in this disclosure that the steps described may be performed in an order other than the order described and specific steps described may be omitted or not performed at all. In some embodiments, process 210 may be implemented by using a processor, such as processor 48 , to execute instructions stored in a tangible, non-transitory computer-readable medium, such as memory device 50 .

As shown, at process block 212 , processor 48 receives an indication to calibrate portable object 12 . The indication may be in the form of an image captured by the camera 22 (eg, a first or calibration image of a picture), including the presence of the reference element 20 of the portable object 12 . In some embodiments, a motion sensor or other suitable sensor capable of indicating that the user 10 has entered the viewing area of the camera 22 with the portable object 12 having the reference element 20 may provide an indication. can

At process block 214 , the processor 48 receives a calibration location 80 . In particular, since the calibration location 80 may be fixed on the structure 15 or displayed on the structure 15 by the processor 48 , the calibration location 80 is predetermined and the processor 48 determines such calibration. The location 80 may be known.

At process block 216 , the processor 48 receives the position of the reference element 20 of the portable object 12 . For example, camera 22 may provide an image of reference element 20 (eg, a second or subsequent image of an image captured by camera 22 ). The processor 48 may then instruct the reference element position detection logic 52 to determine the position of the reference element 20 on the two-dimensional plane 32 .

At process block 218 , the processor 48 instructs the transition logic 56 to determine one or more conversion factors based on the position of the reference element 20 and the calibration position 80 . The one or more conversion factors compensate for the difference between the user's perception of the location at which it is pointing with the portable object 12 and the camera's determination of where the reference element 20 is located on the two-dimensional plane 32 . can do. In particular, the conversion logic 56 may determine one or more conversion factors by performing a single point calibration process. The process includes receiving a calibration location on the two-dimensional plane 32 , a reference element on the two-dimensional plane 32 (eg, corresponding to the point in time when the user 10 points the calibration location to the portable object 12 ) receiving the position of 20 ), and determining one or more conversion factors based on a position difference between the calibration position and the position of the reference element 20 .

The transition logic 56 uses this difference to generate one or more transition factors that can be applied to the subsequently detected position of the reference element 20 to move the subsequently detected position of the reference element 20 and A subsequent projection target position of the portable object 12 may be determined that corresponds to a position that the user 10 wishes to point to with the portable object 12 . The transformation factor may be provided in the form of a transformation matrix, which transformation matrix is to be applied to the subsequently detected position of the reference element 20 to generate the projected target position of the reference element 20 as indicated in equation (1). can

At process block 220 , processor 48 instructs user height estimation logic 60 to determine height 100 of user 10 based on the location of reference element 20 . At process block 222 , processor 48 instructs user arm length estimation logic 62 to determine arm length 104 of user 10 based on height 100 of user 10 .

At process block 224 , the processor 48 instructs the scaling logic 58 to determine one or more scaling factors based on the arm length 104 of the user 10 . Scaling logic 58 may provide a scaling factor in the transformation matrix of Equation 2 shown above. The scaling factor may compensate for differences in the user's arm length 104 by scaling (eg, multiplying) the position of the reference element 20 with respect to an initial position (eg, the calibration position 80 ).

At process block 226 , the processor 48 generates transformation logic 54 to determine a projection target position of the portable object 12 based on the position of the reference element 20 , one or more transformation factors, and one or more scaling factors. instruct to In particular, the transformation logic 54 may apply a transformation matrix of Equation (2), including one or more transformation factors and one or more scaling factors, to the position of the reference element 20 to generate the projected target position. That is, the projected target position may correspond to a position that the user 10 recognizes as pointing to or intending to point to.

At decision block 228 , the processor 48 determines whether the projected target position correlates with a user interaction element. The user interaction element may be any suitable target that serves as a trigger for performing a user interaction experience. For example, the user interaction element may include any characteristic of interest that the user 10 may expect to result in a user interactive experience being performed when the user 10 points to the portable object 12 . .

If the processor 48 determines that the projected target position is correlated with the user-interactive element, then at process block 230 the processor 48 performs a respective user-interactive experience using the appropriate output device 66 . instruct the user interaction system 42 to do so. For example, the output device 66 may be an animated object of an attraction, and the user interaction system 42 may cause the animated object to bark, meow, speak, move, blink, etc. can do it As another example, the output device 66 may be a speaker, and the user interaction system 42 may cause the speaker to output sound, voice, music, and the like. As another example, the output device 66 may be an electronic display, and the user interaction system 42 may cause the electronic display to display images, play videos, and the like.

If the processor 48 determines that the projection target position does not correlate with the user-interactive element, then at decision block 232 the processor 48 determines whether a next position of the reference element 20 has been received. Upon determining that the next position of the reference element 20 has been received, the processor 48 repeats the process block 226, the next position of the reference element 20 and the transition factors already determined from the process blocks 218, 224; Determine the projection target position of the portable object 12 based on the scaling factor.

If the processor 48 determines that a next position of the reference element 20 has not been received, then the processor 48 (eg, from the next user 10 ) is configured to receive a next indication to calibrate the portable object 12 . Repeat process block 212 . In this way, the process 210 is between the user's perception of the location at which it is pointing with the portable object 12 and the camera's determination of where on the two-dimensional plane 32 the reference element 20 is located. Using a single point calibration that compensates not only for differences in user arm length 104 , but also for differences in user arm length 104 (e.g., allows user 10 to calibrate projection positioning system 44 to more than one point with portable object 12 ). to determine the projection target position of the portable object 12 ).

Moreover, the projection positioning system 44 can also compensate for distortion caused by the shape difference between the arcuate characteristic 92 of the user's arm movement and the flat two-dimensional plane 32 , as shown in FIG. 6 . can 10 is a flow diagram of a process 240 for compensating for such distortion, in accordance with an embodiment of the present disclosure. Process 240 may compensate for such distortion, such as controller 46 , processor 48 , and/or any component of projection positioning system 44 including arc distortion compensation logic 64 . It can be carried out by any suitable device. Although process 240 is described using a specific order of steps, it is contemplated in this disclosure that the steps described may be performed in an order other than the order described and specific steps described may be omitted or not performed at all. In some embodiments, process 240 may be implemented by using a processor, such as processor 48 , to execute instructions stored in a tangible, non-transitory computer-readable medium, such as memory device 50 .

As shown, at process block 242 , the processor 48 receives the position of the reference element 20 of the portable object 12 . In some embodiments, the processor 48 may receive a projected target position of the portable object 12 .

At process block 244 , processor 48 determines a horizontal offset based on the position of reference element 20 and the first polynomial. In particular, the processor 48 may receive the projection target position of the portable object 12 , or may determine the projection target position using the process 210 of FIG. 9 . Processor 48 may then instruct arc distortion compensation logic 64 to apply polynomial Equation 3 or Equation 4 to the projected target position of portable object 12 to determine a horizontal offset.

At process block 246 , the processor 48 determines a vertical offset based on the position of the reference element 20 and the second polynomial. In particular, the processor 48 may instruct the arc distortion compensation logic 64 to apply the polynomial equation (5) or equation (6) to the projected target position of the portable object 12 to determine the vertical offset.

At process block 248 , the processor 48 determines a projection target position of the portable object 12 based on the position of the reference element 20 , the horizontal offset, and the vertical offset. In particular, the processor 48 applies (eg, adds) a horizontal offset to a horizontal component (eg, an x-coordinate) of the projection target position to produce a projection target position, and a vertical component (eg, a y-coordinate) of the projection target position. ) to apply (eg, add) a vertical offset to the arc distortion compensation logic 64 .

In some embodiments, to more efficiently compensate for shape differences between the arcuate characteristic 92 of the user's arm movement and the flat two-dimensional plane 32 , the arc distortion compensation logic 64 determines where the reference element 20 is positioned. The arc 92 may be divided into multiple reference element regions, each reference element region corresponding to a respective projection target region (eg, projected onto a two-dimensional plane). Each projection target area may correspond to a respective set of polynomials capable of accurately compensating for the distortion applicable to that projection target area. As such, the camera 22 may detect the reference element 20 in the reference element region, and the arc distortion compensation logic 64 may determine each projection target region corresponding to the reference element region, and arc distortion compensation Logic 64 may apply each set of polynomials corresponding to each projection target area to the location of the reference element to determine one or more offsets to be applied to the location of the reference element to compensate for such distortion. In this embodiment, as shown in FIG. 7 , when a plurality of reference element regions are of different sizes (eg, the size of the reference element regions decreases as the reference element regions move away from the two-dimensional plane 32 ). The projection target areas of may be of the same size, or, as shown in FIG. 8 , the plurality of projection target areas may be of different sizes when the plurality of reference element areas are of the same size (eg, the projection target areas of the reference element 20 ) The size of the projected target area increases with distance from it).

In this way, process 240 can compensate for the arcuate nature 92 and flat two-dimensional plane 32 of the user's arm movement. Also, the difference between the user's perception of the location at which he is pointing with the portable object 12 and the camera's determination of where the reference element 20 is located on the two-dimensional plane 32, the user's arm length 104 ), and to compensate for the difference in shape between the arcuate characteristic 92 and the flat two-dimensional plane 32 of the user's arm movement, the process 240 of FIG. Thereafter, or as part of it.

While various modifications and alternative forms of the embodiments described in this disclosure are permitted, specific embodiments have been illustrated by way of example in the drawings and have been described in detail herein. It needs to be clear that this is not intended to limit the present disclosure to a particular form. This disclosure is intended to cover all modifications, equivalents and alternatives falling within the spirit and scope of the disclosure as defined by the appended claims.

The technology described and claimed herein refers to and applies to specific examples of practical nature and material objects that clearly improve the present technical field, and thus is not merely abstract, intangible, or purely theoretical. Also, one or more elements in which the claims appended to the last part of this specification are designated as "means for [performing] [function]..." or "steps for [performing] [function]..." If it contains an element, that element must be construed in accordance with 35 U.S.C. it shouldn't be

Claims (23)

A theme park attraction system comprising:
a user interaction system;
a projected location determination system communicatively coupled to the user interaction system;
The user interaction system,
a camera configured to capture an imagery of a reference element of a handheld object on a two-dimensional plane, and
an output device configured to output a user interactive experience;
The projection positioning system comprises:
translation logic configured to determine one or more translation factors indicative of a difference in position between an initial position and a calibration position of the reference element on the two-dimensional plane captured in the image;
scaling logic configured to determine one or more scaling factors that correlate with the user's arm length based on the image, and
A controller comprising: a processor and a controller having a memory, the memory storing machine readable instructions, the machine readable instructions causing the processor to:
determining the position of the reference element on the two-dimensional plane captured in the image;
determine a projection target position of the portable object based on the position of the reference element, the one or more conversion factors, and the one or more scaling factors;
and instruct the output device to output the user-interactive experience in response to determining that the projected target location corresponds to a target location;
Theme park attraction system. According to claim 1,
the conversion logic is configured to determine the one or more conversion factors and the one or more scaling factors based on a first image of the picture;
Theme park attraction system. 3. The method of claim 2,
wherein the machine readable instructions are configured to cause the processor to determine the position of the reference element based on a second image of the image.
Theme park attraction system. According to claim 1,
wherein the one or more conversion factors are configured to compensate for a difference between a user's perception of a position at which the portable object is pointing in three-dimensional space and a corresponding position of the reference element in the two-dimensional plane;
Theme park attraction system. According to claim 1,
wherein the one or more scaling factors are configured to compensate for differences in user arm length;
Theme park attraction system. According to claim 1,
the scaling logic is configured to determine the one or more scaling factors based on the position of the reference element on the two-dimensional plane;
Theme park attraction system. not disclosed According to claim 1,
the scaling logic determines a user height based on the position of the reference element on the two-dimensional plane;
configured to determine the user arm length based on the user height;
Theme park attraction system. According to claim 1,
determine one or more offsets based on the projection target position and one or more polynomials;
configured to apply the one or more offsets to the projection target location.
arc distortion compensation logic;
The machine-readable instructions cause the processor to: in response to determining that the projection target position corresponds to a target position on the two-dimensional plane after applying the one or more offsets to the projection target position, the user-interactive experience configured to instruct the output device to output
Theme park attraction system. 10. The method of claim 9,
wherein the one or more offsets are configured to compensate for a shape difference between an arcuate characteristic of a user's arm movement and the two-dimensional plane;
Theme park attraction system. 10. The method of claim 9,
One or more polynomials are of degree 3,
Theme park attraction system. A target tracking system for an interactive experience, the target tracking system comprising:
one or more translation factors indicative of a positional difference between a calibration position displayed on a two-dimensional plane and an initial position of a reference element of a handheld object of a first image when pointing to the calibration location on the two-dimensional plane translation logic configured to determine
scaling logic configured to determine one or more scaling factors that correlate with a user arm length based on the first image, and
A controller comprising a processor and a memory storing machine readable instructions, the machine readable instructions causing the processor to:
determining the position of the reference element of a second image on the two-dimensional plane;
determine a projection target position of the portable object based on the position of the reference element, the one or more conversion factors, and the one or more scaling factors;
and output a user-interactive experience in response to determining that the projected target location corresponds to the target location;
Target tracking system for an interactive experience. 13. The method of claim 12,
wherein the machine readable instructions are configured to cause the processor to determine a transformation matrix comprising the one or more transformation factors and the one or more scaling factors;
Target tracking system for an interactive experience. 14. The method of claim 13,
The machine readable instructions are configured to cause the processor to determine the projection target position of the portable object by applying the transformation matrix to the position of the reference element.
Target tracking system for an interactive experience. 13. The method of claim 12,
wherein the one or more conversion factors include a horizontal component, and the machine readable instructions are configured to cause the processor to determine the horizontal component based on a horizontal difference between the calibration position and the initial position of the reference element.
Target tracking system for an interactive experience. 16. The method of claim 15,
wherein the one or more conversion factors include a vertical component, and the machine readable instructions are configured to cause the processor to determine the vertical component based on a vertical difference between the calibration position and the initial position of the reference element.
Target tracking system for an interactive experience. 13. The method of claim 12,
wherein the one or more scaling factors include a horizontal component, and the machine readable instructions are configured to cause the processor to determine the horizontal component based on the user arm length.
Target tracking system for an interactive experience. 18. The method of claim 17,
wherein the one or more scaling factors include a vertical component, and the machine readable instructions are configured to cause the processor to determine the vertical component based on the user arm length.
Target tracking system for an interactive experience. A method of providing an interactive experience, comprising:
receiving a calibration position on a two-dimensional plane;
receiving an initial position of a reference element of a handheld object on the two-dimensional plane captured in imagery;
determining one or more translation factors based on the calibration position and the initial position of the reference element;
determining one or more scaling factors based on the initial position of the reference element;
determining the position of the reference element on the two-dimensional plane captured in the image;
determining a projected target location of the portable object based on the location of the reference element, the one or more conversion factors, and the one or more scaling factors; and
outputting a user-interactive experience in response to determining that the projected target location corresponds to the target location;
How to provide an interactive experience. 20. The method of claim 19,
wherein determining the one or more conversion factors is based on a difference between the calibration position and the initial position of the reference element on the two-dimensional plane;
How to provide an interactive experience. 20. The method of claim 19,
determining a user height based on the initial position of the reference element;
How to provide an interactive experience. 22. The method of claim 21,
determining a user arm length based on the user height;
How to provide an interactive experience. 23. The method of claim 22,
wherein determining the one or more scaling factors is based on the user height;
How to provide an interactive experience.

Images