JP2010511221A - Three-dimensional control of data processing via a handheld pointing device - Google Patents

Abstract

  A hand-held pointing device imparts a radiation pattern having directional characteristics to the main axis of the pointing device. This radiation is detected by at least two detectors located at different locations. This makes it possible to specify the orientation of the main axis and the displacement of the pointing device along the main axis for three-dimensional control of the object rendered on the screen of the display monitor.

Description

  The present invention relates to a data processing system that includes a handheld pointing device that imparts radiation having a directional characteristic and generates an input signal corresponding to the directional characteristic of the system. The invention further relates to a user control method of data processing via a pointing device.

  US Pat. No. 5,949,402 discloses a pointing device with four LEDs (light emitting diodes) in a particular spatial arrangement. The lens of the pointing device refracts light emitted from each specific LED in a specific direction, and each of the refraction directions is different from the refraction direction of the light of the other LEDs. A photodetector receives the light beam emitted from the pointing device. The pointing angle of the device, i.e. the relative orientation of the device with respect to the receiver, can be calculated by taking the ratio of the LED pulse amplitude. Then, these pointing angles can be used for the arrangement of the cursor on the display screen.

  U.S. Pat. No. 5,023,943 discloses a pointing device with three LEDs having different radiation patterns. The LED arranged in the center is a reference LED. This reference LED is unshielded and has a relatively flat light intensity profile. Of the remaining two LEDs, the first LED is partially shielded in the first direction. As a result, the LED has a radiation pattern that is different from the pattern of the reference LED and the second of the remaining two LEDs in this first direction. The second LED is partially shielded in a second direction perpendicular to the first direction. As a result, the LED has a radiation pattern that is different from the pattern of the reference LED and the first LED in this second direction. The light receiver that receives light from the pointing device is based on the difference in intensity of light received from the reference LED and the first LED and the difference in intensity of light received from the reference LED and the second LED. Specify the orientation of.

  U.S. Pat. No. 5,627,565 is provided with a detection unit for detecting light emitted from a light source, thereby enabling detection of a relative angle between the light emitting unit and the detection unit, thereby applying the detection device to an input device. Disclosed is a spatial coordinate detection device that makes it possible. The detection unit is provided with a light detection element having a light detection unit divided into four parts. In the light emitting unit, distinguishable light is emitted from the two light sources. The two lights emitted in this way are narrowed down through the opening and applied to the light detection surface of the light detection element as separate rectangular light spots. It is possible to specify the center of the rectangular light spot by calculating the difference between the output signals detected between the light detectors divided into four. The relative rotation angle of the light emitting unit and the detection unit with respect to the Z axis can be specified by calculating the inclination angle of the line connecting both centers on the XY orthogonal coordinates. The light emitting unit and the detecting unit may be provided in a hand-held operating member and a stationary device, respectively, or vice versa. It is also possible to specify the distance L between the light emitting unit and the detection unit in the Z-axis direction. This information is used to prevent the operator from feeling a difference in touch of the operation feeling between when the operation member is near the screen and when the operation member is arranged far from the screen. That is, if the cursor mark can be moved on the screen based only on the tilt angle of the operation member in the x direction and the y direction, the operation member is tilted in the x direction at a position near the screen, and the operation There is no difference in the displacement of the cursor when the member is inclined by the same angle in the x direction at a position sufficiently separated from the screen. Therefore, when the operation member is tilted at a position away from the screen, a feeling that the cursor mark does not move much on the screen is caused. In view of this point, taking the calculated distance L into account, when the distance L between the light emitting unit and the detecting unit increases, the cursor mark moves on the screen in response to the operation member being tilted in the x or y direction. When correction is performed so as to increase the distance, it is possible to compensate for the difference in touch of the operational feeling between when the operation member is near the screen and when the operation member is away from the screen.

  Known systems control two-dimensional user input depending on the orientation of the pointing device relative to the screen to control the cursor position on the screen of the display monitor. These known systems add to the degrees of freedom in the screen plane of the display monitor and control the degree of displacement along the principal axis of the pointing device to control the degree of freedom of the object being rendered on the screen. As a result of the displacement of the pointing device in a direction toward or away from the screen, user input is not possible.

  For this reason, the present invention is a hand-held pointing device, a pointing device for giving a radiation pattern having a directional characteristic to the main axis of the pointing device, a detecting means for detecting such radiation, and the detecting means And a data processing system including a computing means connected to the computer. The calculation means includes an index representing the displacement of the pointing device along the principal axis of the pointing device, a first curve indicating a possible position of the pointing device, and other possible pointing devices. Based on the second curve indicating the position, the index is used as a user input signal for user control of data processing.

  Based on the detected directional characteristics of the radiation, the orientation of the pointing device can be determined. Since a plurality of positions that may correspond to this orientation are arranged on one curve, the position of the pointing device cannot be reliably specified without further information. When the pointing device is moved in a direction parallel to the main axis of the pointing device, one or more other curves of the new position are generated. In practice, the pointing device will be in a relatively small sector of the half space defined by the plane of the screen. By using this assumption, it is possible to calculate the displacement and use this displacement amount as a user input signal. Here, the term “curve” in the original text (English) means the concept of a line deviating from a straight line state in a smooth and continuous manner, and deviating from a planar state in a smooth and continuous manner. Note that it covers both the concept of surface.

  The present invention further includes detection means for detecting radiation from a hand-held pointing device having a radiation pattern having a directional characteristic with respect to the principal axis of the pointing device, and calculation means connected to the detection means. It also relates to the device. The calculation means includes an index representing the displacement of the pointing device along the principal axis of the pointing device, a first curve indicating a possible position of the pointing device, and other possible pointing devices. Based on the second curve indicating the position, the indicator is operated to be used as a user input signal for user control of data processing. Such a device is a product that can be developed separately from a pointing device that imparts radiation having directional characteristics.

  The present invention also includes an input unit for receiving information representing radiation from a hand-held pointing device having a radiation pattern having a directional characteristic with respect to a main axis of the pointing device, and an output unit. It also relates to calculation means. The calculation means includes an index representing the displacement of the pointing device along the principal axis of the pointing device, a first curve indicating a possible position of the pointing device, and other possible pointing devices. The above-mentioned index indicating the user input signal is given to the output unit for user control of data processing. This calculation means can be developed as a product independently of the detection means and the pointing device, for example, as an additional device after sales. This computing means may be implemented as an electronic device embedded in, for example, a PC, set-top box or television set, for example to facilitate user interaction with a virtual object being rendered on a display monitor, You may implement | achieve as an electronic device integrated in the information processing system for business. Also, this calculation means can be realized as software for downloading to a PC, for example.

  Further features are defined in the dependent claims.

  For completeness, reference is made to the following publications, the contents of which are incorporated herein by reference:

  U.S. Pat. No. 7,102,616 allowed the user to select the position and movement of the cursor on the display screen, or other selection function, by rotating or translating the input device in three-dimensional space. A handheld remote control device is disclosed. A signal is emitted by a stationary beacon disposed at the first position, and this signal is received by a remote control device disposed at the second position. The remote control device detects the component of angular displacement between the direction of incidence of the signal and the selected axis of the remote control device for two non-parallel axes. To measure this angular displacement, each portion of the signal may be projected onto a detector using an optical structure such as a cylindrical lens. Information corresponding to the detected angular displacement is transmitted to the control box, and the control box controls the position and movement of the cursor on the display screen in response to the transmitted information. Here, the remote controller is a detector and must be equipped with a data processing mechanism in order to generate data to be transmitted as a user input signal to a stationary part of the system.

  US Pat. No. 6,724,368 (Phillips Electronics) discloses a method and system for controlling cursor movement on a monitor screen. This system has at least one remote control unit having a plurality of push buttons for remotely controlling the moving direction of the cursor on the monitor screen. The system also includes at least one light emitting element that emits light indicative of a signal generated by the remote control unit, a photodetector for extracting the movement of light continuously transmitted from the remote control unit, and a remote A control unit for displaying the movement position of the cursor on the monitor screen in correspondence with the extracted movement of light from the control unit. This system is configured to stop the movement of the cursor position when the push button of the remote control unit is released. The movement of the cursor on the monitor screen can also be stopped if the movement of the light transmitted from the remote control unit changes in the opposite direction.

The figure which showed one data processing system which concerns on this invention A diagram illustrating a method for specifying the orientation of a pointing device in the system of the present invention. The figure which illustrated the identification method of the displacement of the same apparatus along the main axis | shaft of a pointing device in the system of this invention The figure which illustrated the identification method of the displacement of the same apparatus along the main axis | shaft of a pointing device in the system of this invention Table showing mathematical formulas used in the situation of FIG. 3 and FIG.

  Hereinafter, the present invention will be described in more detail by way of example with reference to the accompanying drawings. Throughout the drawings, similar or corresponding features are indicated by the same reference numerals.

  FIG. 1 shows a system 100 according to the present invention. The system 100 includes a pointing device 102 that applies radiation (eg, visible light, infrared light, radio waves, sound waves). This radiation has a directional characteristic 104 with respect to a coordinate system fixed to the device 102. That is, radiation received at a particular location indicates the orientation of device 102 relative to that location (eg, the orientation of the principal axis of device 102).

  Examples of such pointing devices are described in, for example, US Pat. No. 5,949,402 and unpublished European Patent Application No. 6111205 (Attorney Docket No. PH004968EP1) filed on March 15, 2006. The contents of both documents are incorporated herein by reference. The pointing device of European Patent Application No. 6111205 comprises two light sources arranged along a first axis and another two light sources arranged along a second axis perpendicular to the first axis. including. Preferably, the light source transmits a modulated signal. This modulated signal transmission can be frequency multiplexed (eg, using different blinking frequencies for each light source), code multiplexed (eg, used with different orthogonal codes), wavelength multiplexed (eg, used with different wavelengths), or time division multiplexed. This can be achieved by using technology (eg, using different blink times). The pointing device is used with a photodetector arranged near the screen. In order to identify in which direction the user is pointing the pointing device with respect to the screen, a calculation means is provided. All light sources are oriented in substantially the same direction along a third axis perpendicular to the first and second axes. The pointing device includes shielding means for partially shielding light emitted by the light source. The shielding action acts so that the light received by the detector is different when the direction of the principal axis of the pointing device deviates from the shortest linear distance between the pointing device and the detector. These differences indicate this deviation so that the pointing direction can be specified. Then, using this direction and the change in direction, it is possible to control the movement of the cursor on the screen of the display monitor or to make a selection from a menu of a graphic user interface. The system of European Patent Application No. 6111205 can determine the pointing direction using only one detector by cooperating with the pointing device as described above.

  The system 100 of the present invention includes detection means (in this example detectors 106 and 108) operable to detect radiation. Due to the directional characteristics 104 of the radiation, the detector 106 may be relatively simple and the system 100 is suitable for either one of the detectors 106 and 108 as described in European Patent Application No. 6111205, The orientation of the device 102 can be specified. Detector 106 receives radiation 104 that depends on the orientation of device 102 relative to that detector 106, and detector 108 receives radiation 104 that depends on the orientation of device 102 relative to that detector 108. Then, using this orientation information, the position on the screen 110 of the display monitor pointed to by the device 102 being used for the operation can be specified. In addition, the change in orientation can be used to position an object (eg, a cursor) on the screen. The system 100 further includes computing means 111 for processing information from the detectors 106 and 108 and controlling the objects rendered on the display monitor 110. The computing means may include, for example, a dedicated electronic circuit for use in a PC, set-top box, display monitor, and the like. Thus, the system 100 operates to allow position control on the plane of the screen 110 according to the orientation of the device 102 during operation by the user. The orientation and the change in orientation at that time serve as a data input signal. In addition, in the present invention, due to the presence of the second detector, the system 100 is in a direction substantially along the main axis 112 of the device 102 as described below during operation of the present invention. The user can also enter data in response to a change in the position of the device 102 or a change in the position of the device 102 in a direction substantially perpendicular to the screen 110 of the display monitor.

  FIG. 2 is a diagram illustrating the geometry of the system 100 configuration. The detector 106 receives radiation emitted from the device 102 at an angle β relative to the main axis 112 of the device 102. The detector 108 receives radiation emitted from the device 102 at an angle α with respect to the axis 112. Thus, the orientation of the major axis 112 of the device 102 relative to the detectors 106 and 108 can be determined. However, the position of the device 102 relative to the detectors 106 and 108 cannot be determined. In order to understand this, consider the theorem concerning the locus of equiangular points (the conclusion of Proposition 20 of the Euclidean original theory volume 3). This theorem is that when a certain line segment AB is given, the trajectory of the point P where the angle APB has a constant value is an arc passing through the points A and B. In general, when AB is a circular chord, the angle APB is constant for any point P on the circle excluding points A and B itself. Note that if this string is not the diameter of a circle, this constant angle will be different on each side of the string. Thus, the curve 114 defined by the detectors 106 and 108 and the position of the device 102 indicates a possible position of the device 102 where an orientation with a constant angle α value and a constant angle β value can be assumed. . Here, it should be noted that the curve 114 is drawn as an arc. This circular arc represents a line of intersection between the curved surface (curved surface) of these possible positions and a plane defined by the positions of the detectors 106 and 108 and the device 102. Device 102, each associated with a different detector pair, using a third detector (not shown) located outside the plane defined by detectors 106 and 108 and the position of device 102. It is also possible to construct three curved surfaces representing the possible positions. The intersection of these three curved surfaces gives two positions as the position of the device 102. The position behind the screen 110 can be discarded due to the limitation of the line of sight. In the following text, the term “curve” and the term “arc” will be used interchangeably.

  Under practical circumstances where the screen 110 is a display monitor and the device 102 is used to position a cursor being rendered on the display monitor 110, the user is typically far away from the monitor 110. In position (multiple times the characteristic dimensions of the monitor 110), the main axis 112 of the device 102 can be said to intersect the screen 110 at a right angle in the center of the screen 110. Therefore, it is reasonable to assume that the device 102 is kept in a position such that the main axis 112 coincides with the optical axis of the system 100 during operation. As a result, the difference between the angles α and β and the polarity of such difference can be used to identify a change in the distance between the device 102 and the screen 110. Note that this requires at least two detectors. With only one detector, the change in the received light may be interpreted by the system 100 as a change in the orientation of the device 102. This change in distance while maintaining the orientation of the device 102 as a result of pushing the device 102 towards the screen 110 or retracting the device 102 away from the screen 110 is shown in FIG. As described below, it is used as a data input signal. Thus, in addition to one-dimensional or two-dimensional position control in the plane of the screen 110, select a particular one of a plurality of overlapping windows being rendered on the screen 110, for example, a further degree of freedom of control. Freedom to do so is provided. For an example of an input device that provides three-dimensional control, see, for example, US Pat. No. 5,784,052 by Philips Electronics, the contents of which are incorporated herein by reference.

  FIG. 3 shows an arc 114 of a possible position of the device 102 when the detectors 106 and 108 record a certain orientation of the device 102 defined by a constant value of angle α and a constant value of angle β. It is a figure. Here, it is assumed that the device is displaced toward the screen 110, ie substantially along the direction of the main axis 112, over a relatively small distance compared to the distance between the device 102 and the screen 110. . The detectors 106 and 108 then record small changes that occurred in the orientation of the main axis 112 of the device 102. A possible new set of positions is indicated by arc 116, and the radius and center of arc 116 has changed relative to the radius and center of arc 114. The circle defining the arc 116 is shown with a broken line in the lower part of the circle to more clearly distinguish it from the circle defining the arc 114. Here, compared to a typical position that may be within the sector defined by lines 118 and 120, ie, the distance to screen 110, compared to an axis perpendicular to screen 110 through the center of screen 110. Think of a close position. Note that within this sector, the distance between arcs 114 and 116 is constant in a first order approximation. Within another sector that defines a similar angle to the sector between lines 118 and 120, but does not overlap the first mentioned sector, the change in distance between arcs 114 and 116 is more significant. To change. Given the orientation of the principal axis of the device 102 relative to either of the detectors 106 and 108, the system 100 can determine the radius and center of the arc 114. Even at the new location, the system 100 can determine the radius and center of the arc 116. These radial differences represent the change in distance and thus represent the input signal to the system 100 generated by pushing or retracting the device 102 relative to the screen 110.

  4 and 5 illustrate one embodiment of the present invention. FIG. 4 shows an arc 122 defined by the position of the detectors 106 and 108 and the possible position of the device 102 as being given the recorded orientation angle. These positions and angles completely define the arc 122. The figure shows the following features. The distance between the device 102 and the screen 110 is indicated by “d”. For positions considered to be within the sector defined by lines 118 and 120 as described above, a fixed value “d” is assumed to be sufficiently accurate. The radius of the arc 122 is indicated by “R”. The fixed distance between detectors 106 and 108 is indicated by “2s”. The distance between the center “C” of the arc 122 and the screen 110 is indicated by “p”. FIG. 5 shows mathematical formulas for deriving the relationship between the change in radius “R” and the change in distance “d”. Equation (1) represents that “d” is equal to the sum of “R” and “p”. Equation (2) shows the relationship between “s”, “R”, and “p” according to Pythagorean theorem. Combining Equation (1) and Equation (2) leads to Equation (3), which represents how “R” depends on “s” and “d”. Assuming that the value of “d” is changed to “d−ε” (“ε” is much smaller than “d”) and substituting this into equation (3), the change in radius is Follow the equation (4) with order accuracy.

  As an example, consider a case where the value of “s” is 0.35 m and the value of “d” is greater than 1.5 m. In that case, the proportionality factor between the change in radius “ΔR” (ie, the difference in radius specified by the system 100 upon the displacement “ε”) and the displacement “ε” is about 0.5. Thus, measuring the change in radius provides an indication of the magnitude of displacement of the device 102.

Claims (15)

A hand-held pointing device, which gives a radiation pattern having a directional characteristic to the main axis of the pointing device;
Detection means for detecting the radiation;
Calculation means connected to the detection means,
The calculating means is
An index representing the displacement of the pointing device along the principal axis of the pointing device, a first curve indicating a possible position of the pointing device, and a second indicating a possible other position of the pointing device. Based on the curve and
A data processing system operable to use the indicator as a user input signal for user control of data processing.   The system according to claim 1, characterized in that the calculating means is operable to identify the orientation of the main axis relative to the detecting means as a further user input signal for further user control of the data processing. The calculating means has an output for connecting to a display monitor;
3. The system according to claim 1, wherein the data processing includes a process of moving an object being rendered on a screen of the display monitor. Detecting means for detecting radiation from a hand-held pointing device having a radiation pattern having a directional characteristic with respect to the main axis of the pointing device;
Calculation means connected to the detection means,
The calculating means is
An index representing the displacement of the pointing device along the principal axis of the pointing device, a first curve indicating a possible position of the pointing device, and a second indicating a possible other position of the pointing device. Based on the curve and
An apparatus operative to use the indicator as a user input signal for user control of data processing.   5. The apparatus according to claim 4, wherein the calculating means is operative to determine the orientation of the principal axis relative to the detecting means as a further user input signal for further user control of the data processing. The calculating means has an output for connecting to a display monitor;
6. The apparatus according to claim 4, wherein the data processing includes a process of moving an object being rendered on a screen of the display monitor. An input for receiving information representing radiation from a handheld pointing device, the radiation having a directional characteristic relative to a main axis of the pointing device;
A calculation means having an output unit,
An index representing the displacement of the pointing device along the principal axis of the pointing device, a first curve indicating a possible position of the pointing device, and a second indicating a possible other position of the pointing device. Based on the curve and
The calculation means, which operates to give the index representing a user input signal in the output unit for user control of data processing.   8. Calculation means according to claim 7, characterized in that it operates to determine the orientation of the principal axis as a further user input signal for further user control of the data processing.   9. The calculation means according to claim 7, wherein the data processing includes processing for moving an object rendered on a screen of a display monitor. An input for receiving information representing radiation from a handheld pointing device, the radiation having a directional characteristic relative to a main axis of the pointing device;
Software including computer-readable instructions for implementing a computing means having an output unit,
The calculation means includes an index representing the displacement of the pointing device along the principal axis of the pointing device, a first curve indicating a possible position of the pointing device, and another possible position of the pointing device. Based on the second curve indicating
Software that operates so as to give the index representing a user input signal in the output unit for user control of data processing.   11. The software of claim 10, wherein the calculating means is operable to identify the orientation of the principal axis as a further user input signal for further user control of the data processing.   12. The software according to claim 10, wherein the data processing includes a process of moving an object being rendered on a screen of a display monitor. A hand-held pointing device, which allows user control of data processing through operation of a pointing device that imparts a radiation pattern having a directional characteristic to the main axis of the pointing device,
Detecting the radiation;
An index representing the displacement of the pointing device along the principal axis of the pointing device, a first curve indicating a possible position of the pointing device, and a second indicating a possible other position of the pointing device. A step of identifying based on the curve of
Using the indicator as a user input signal for the user control of the data processing.   14. The method of claim 13, comprising identifying the orientation of the major axis as a further user input signal for further user control of the data processing.   15. The method according to claim 13 or 14, wherein the data processing includes a process of moving an object being rendered on a display monitor screen.

Images