KR20100128750A - Pointing device and system using optical reflection - Google Patents

Pointing device and system using optical reflection Download PDF

Info

Publication number
KR20100128750A
KR20100128750A KR1020090047339A KR20090047339A KR20100128750A KR 20100128750 A KR20100128750 A KR 20100128750A KR 1020090047339 A KR1020090047339 A KR 1020090047339A KR 20090047339 A KR20090047339 A KR 20090047339A KR 20100128750 A KR20100128750 A KR 20100128750A
Authority
KR
South Korea
Prior art keywords
light
client device
unit
pointing
coordinate system
Prior art date
Application number
KR1020090047339A
Other languages
Korean (ko)
Inventor
심재용
Original Assignee
심재용
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 심재용 filed Critical 심재용
Priority to KR1020090047339A priority Critical patent/KR20100128750A/en
Publication of KR20100128750A publication Critical patent/KR20100128750A/en

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/002—Specific input/output arrangements not covered by G06F3/01 - G06F3/16
    • G06F3/005—Input arrangements through a video camera
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
    • G06F3/0304—Detection arrangements using opto-electronic means
    • G06F3/0308—Detection arrangements using opto-electronic means comprising a plurality of distinctive and separately oriented light emitters or reflectors associated to the pointing device, e.g. remote cursor controller with distinct and separately oriented LEDs at the tip whose radiations are captured by a photo-detector associated to the screen
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
    • G06F3/033—Pointing devices displaced or positioned by the user, e.g. mice, trackballs, pens or joysticks; Accessories therefor
    • G06F3/0346—Pointing devices displaced or positioned by the user, e.g. mice, trackballs, pens or joysticks; Accessories therefor with detection of the device orientation or free movement in a 3D space, e.g. 3D mice, 6-DOF [six degrees of freedom] pointers using gyroscopes, accelerometers or tilt-sensors
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
    • G06F3/033—Pointing devices displaced or positioned by the user, e.g. mice, trackballs, pens or joysticks; Accessories therefor
    • G06F3/038—Control and interface arrangements therefor, e.g. drivers or device-embedded control circuitry
    • G06F3/0383—Signal control means within the pointing device

Abstract

PURPOSE: A pointing device and a system using the reflection of the light are provided to accurately decide a pointing position on a display screen without using gyro sensor or acceleration sensor. CONSTITUTION: A sensor unit(120) senses the light emitted from one or more points of a client device. A photometric analysis unit(130) analyzes the detected light and produces a position or direction in the reference coordinate of the client device. The photometric analysis unit decides the pointing position on the display screen. The point is optical reflection point.

Description

POINTING DEVICE AND SYSTEM USING OPTICAL REFLECTION}

The present invention relates to a pointing device and system using light reflection. More specifically, the present invention includes a pointing device and a host device, wherein the host device emits a predetermined light with respect to the pointing device, and detects that the emitted light is reflected by the pointing device and returned. The present invention relates to a pointing system for effectively determining a pointing position on a predetermined display screen by calculating a position and a direction of a pointing device based on the detected light.

With the wide variety of information provided through display means such as computer monitors, TV receivers, etc., the user can effectively determine the pointing position (e.g., the position of the pointer) on the display screen and the various selection means on the display screen ( For example, the importance of pointing techniques to allow the selection of graphical buttons, hyperlinks, etc. has emerged. In addition, in recent years, with the introduction of two-way broadcasting technology such as IPTV (Internet Protocol TeleVision) technology, a user on a display screen in which a variety of information is provided only by a conventional remote controller (so-called remote controller) including only a standard input key is provided. As it becomes difficult to perform effective manipulations, the need for more advanced pointing techniques becomes greater.

On the other hand, with respect to the pointing technology, in the case of the conventional representative pointing device (mouse), since the mouse must be operated on the two-dimensional plane in order to control the pointer on the display screen, the free operation of the user is difficult There was this.

In order to overcome the problems of the conventional two-dimensional pointing device and to implement a pointing device that can be freely manipulated in three-dimensional space, six degrees of freedom (DOF) of the pointing device manipulated in three-dimensional space by a user It is known that must be specified. Here, 6 degrees of freedom is the X-axis coordinates, Y-axis coordinates, Z-axis coordinates, X-axis center roll (roll), Y-axis center rotation (pitch) and Z-axis center rotation (yaw) of the object in the three-dimensional space ). Accordingly, various techniques for determining the pointing position on the display screen by introducing six degrees of freedom of the pointing device existing in the three-dimensional space have been introduced.

First, as an example of a three-dimensional pointing technique introduced in the related art, a pointing technique using a three-dimensional mouse including an acceleration sensor and a gyro sensor may be mentioned. According to this, the six degrees of freedom value of the three-dimensional mouse operated by the user is specified by using three-axis (X-axis, Y-axis and Z-axis) acceleration sensor and three-axis gyro sensor. The pointing position on the display screen may be determined with reference to the six degrees of freedom value. However, the pointing technology using a three-dimensional mouse has a high power consumption due to the acceleration sensor and the gyro sensor, the price of the acceleration sensor and the gyro sensor is still high, and a large amount of computation is required to correct the error of the gyro sensor. There is a problem that involves an additional operation process.

In addition, as another example of a three-dimensional pointing technique introduced in the related art, there is a technology related to a pointing device including an acceleration sensor and an infrared sensor, and accordingly, information obtained from the acceleration sensor and the infrared sensor replaces the information obtained from the gyro sensor. You can do it. However, according to the pointing technology, a high resolution infrared camera must be used as the infrared sensor, and when the distance between the pointing device and the display screen is far, it is difficult to accurately specify the six degrees of freedom of the pointing device.

It is an object of the present invention to solve all the problems described above.

In addition, the present invention accurately calculates the position and direction of the pointing device using the light reflected from the pointing device present in the three-dimensional space, so that the pointing position on the display screen can be accurately determined without using an acceleration sensor or a gyro sensor. For other purposes.

In addition, another object of the present invention is to reduce the complexity of the pointing device by allowing the pointing device existing in the three-dimensional space to perform the function of reflecting light.

Representative configuration of the present invention for achieving the above object is as follows.

According to an aspect of the present invention, there is provided a host device for realizing pointing using light reflection, comprising: a sensor unit configured to sense light emitted from at least one point of a client device, and the detected light to analyze the client device; An optical analysis unit is provided that calculates at least one of a position and a direction in the sensor unit reference coordinate system, and determines a pointing position on a display screen with reference to at least one of the calculated positions and directions.

According to another aspect of the present invention, there is provided a client device for realizing pointing using light reflection, comprising: a light splitter for splitting light incident from a host device into at least two paths, and a light reflection for reflecting the split light; A client device is provided that includes a portion.

According to another aspect of the invention, a pointing system using light reflection, comprising: a host device, and a client device, the host device comprising: a light emitter for emitting light to the client device; A sensor unit for detecting the light to be detected, and the detected light, and calculating at least one of a position and a direction in the sensor unit reference coordinate system of the client device, and referring to at least one of the calculated positions and directions. And a light analyzer configured to determine a pointing position on a display screen, wherein the client device comprises: a light splitter configured to split light incident from the light emitter into at least two paths, and the split light to the sensor unit; A pointing system is provided that includes a light reflecting portion for reflecting.

According to the present invention, it is possible to accurately determine the pointing position on the display screen without using an acceleration sensor or a gyro sensor.

According to the present invention, since the pointing device existing in the three-dimensional space is performed mainly for the function of reflecting light, the complexity of the pointing device is lowered, and thus, the pointing device can be provided at low cost. In addition, the power consumption in the pointing device can also be significantly reduced.

DETAILED DESCRIPTION The following detailed description of the invention refers to the accompanying drawings that show, by way of illustration, specific embodiments in which the invention may be practiced. These embodiments are described in sufficient detail to enable those skilled in the art to practice the invention. It should be understood that the various embodiments of the present invention are different but need not be mutually exclusive. For example, certain features, structures, and characteristics described herein may be implemented in other embodiments without departing from the spirit and scope of the invention in connection with an embodiment. It is also to be understood that the position or arrangement of the individual components within each disclosed embodiment may be varied without departing from the spirit and scope of the invention. The following detailed description, therefore, is not to be taken in a limiting sense, and the scope of the present invention, if properly described, is defined only by the appended claims, along with the full range of equivalents to which such claims are entitled. Like reference numerals in the drawings refer to the same or similar functions throughout the several aspects.

Hereinafter, preferred embodiments of the present invention will be described in detail with reference to the accompanying drawings so that those skilled in the art can easily implement the present invention.

[Preferred Embodiments of the Invention]

Configuration of the entire system

1 is a view schematically showing the configuration of an entire system according to an embodiment of the present invention.

As shown in FIG. 1, the entire system according to an embodiment of the present invention may include a display device 10, a host device 100, and a client device 200 (ie, a pointing device). have.

First, according to an embodiment of the present invention, the display device 10 is a display means for displaying an image by emitting light, for example, a cathode-ray tube (CRT), a liquid crystal display (Liquid) Crystal Display (LCD), Organic Light Emitting Diode Display (OLED), and Plasma Display Panel (PDP) may include any one or more, but is not necessarily limited thereto. The device 10 may include a screen for reflecting and displaying an image output from a projector or the like instead of directly emitting light.

On the other hand, the display of the image on the display device 10 may be controlled by a drive driver, a timing controller, etc., although not shown, which can be easily configured by a known technique.

According to an embodiment of the present invention, the host device 100 emits a predetermined light to the client device 200 through the light emitting unit 110, the light emitted through the sensor unit 120 is the client A function of determining a pointing position on the display screen of the display apparatus 10 by detecting the return by being reflected by the apparatus 200 and calculating the position and the orientation of the client apparatus 200 based on the detected light. Do this. According to an embodiment of the present invention, the host device 100 may be located near the display device 10 to more accurately calculate the position and direction of the client device 200.

In addition, according to an embodiment of the present invention, the host device 100 may be configured as a digital device including a function for communicating with the display device 10 and / or the client device 200. As a host device 100 according to the present invention, any digital device having a computing capability by mounting a microprocessor such as a desktop computer, a notebook computer, a workstation, a PDA, a web pad, a mobile phone, or the like can be used. Can be adopted.

Meanwhile, although FIG. 1 illustrates that the display apparatus 10 and the host apparatus 100 are separately configured, the host apparatus 100 is included in the display apparatus 10 as needed by those skilled in the art for implementing the present invention. It may be configured. A detailed internal configuration of the host device 100 will be described later.

Client device 200 according to an embodiment of the present invention, in order to enable the host device 100 to calculate the position and direction of the client device 200, a plurality of light emitted from the host device 100 A function of dividing the path into the paths of the path and reflecting the reflection back to the host device 100 is performed. Accordingly, the client device 200 may have a plurality of light reflection points corresponding to a plurality of paths of the split and reflected light. A detailed internal configuration of the client device 200 will be described later.

Configuration of the host device

Hereinafter, the internal structure of the host device 100 performing important functions for the implementation of the present invention and the functions of each component will be described.

2 is a diagram illustrating an internal configuration of the host apparatus 100 according to an exemplary embodiment of the present invention in detail. Referring to FIG. 2, the host device 100 according to an exemplary embodiment of the present invention may include a light emitting unit 110, a sensor unit 120, an optical analyzer 130, a communication unit 140, and a controller 150. It can be seen that it may include. According to an embodiment of the present invention, the sensor unit 120, the optical analyzer 130, the communication unit 140 and the control unit 150 is at least a portion of the display device 10 and / or the client device 200 And program modules in communication with the. Such program modules may be included in the host device 100 in the form of an operating system, an application program module, and other program modules, and may be physically stored in various known storage devices. In addition, such program modules may be stored in a remote storage device that can communicate with the host device 100. On the other hand, such program modules include, but are not limited to, routines, subroutines, programs, objects, components, data structures, etc. that perform particular tasks or execute particular abstract data types, described below, in accordance with the present invention.

3 is a diagram illustrating a configuration of the host device 100 according to an embodiment of the present invention.

First, the light emitting unit 110 according to an embodiment of the present invention may perform a function of emitting light to the client device 200 using a predetermined light source. Here, the emitted light may include infrared rays, visible rays, ultraviolet rays, and the like, but the present invention is not limited thereto and may be reflected by the client device 200 and may be detected by the host device 100 again. It can be used as the light of the present invention.

The light emitting unit 110 according to the preferred embodiment of the present invention includes a plurality of infrared light emitting diodes (LEDs) emitting infrared rays in order to reduce interference with other signals and not prevent a user from staring at a display screen. It can be configured as.

Next, the sensor unit 120 according to an embodiment of the present invention has a function of detecting that the light emitted from the light emitting unit 110 is reflected by the client device 200 and returned to the host device 100. The sensor unit 120 may be configured of an infrared sensor, a visible light sensor, an ultraviolet sensor, or the like according to light used in the present invention. The sensor unit 120 according to a preferred embodiment of the present invention may be configured as an infrared camera equipped with a predetermined infrared filter, and expresses the pattern of infrared rays detected by the sensor unit 120 on a two-dimensional image plane. Can be.

Next, according to an embodiment of the present invention, the optical analysis unit 130 calculates the position and direction of the client device 200 in the three-dimensional space by analyzing the reflected light sensed by the sensor unit 120 Function can be performed. Hereinafter, a detailed method of calculating the position and direction of the client device 200 in the 3D space by the optical analyzer 130 will be described.

4 is a diagram conceptually illustrating a geometric relationship between a camera and an object when photographing an object existing in a three-dimensional space using a camera, which is a kind of the sensor unit 120.

As shown in FIG. 4, it is assumed that an object including a point P 0 , P 1 , ..., P i is photographed using a camera having a center of projection point O and a focal length f. can do. According to an embodiment of the present invention, the object may correspond to the client device 200, and the points P 0 , P 1 ,..., P i are located at a plurality of light reflection points present in the client device 200. Each may correspond.

And, FIG. 4, the point included in the object P 0, P 1, ..., P i is the coordinate value of the object reference coordinate system centered on the point P 0 (i.e., u, v and w the unit vector In this case, since these coordinate values are specified based on one point included in the rigid object, the points P 0 , P 1 , ..., The coordinate values in the object reference coordinate system of P i are not changed. Similarly, according to one embodiment of the present invention, the coordinate values of the plurality of light reflection points of the client device 200 may be specified in the client device 200 reference coordinate system centered on any light reflection point of the client device 200. Can be.

4, the points p 0 , p 1 ,..., And p i on the two-dimensional image plane are projection points corresponding to the points P 0 , P 1 , ..., P i , respectively. Indicates. According to an embodiment of the present invention, the points p 0 , p 1 , ..., p i are a plurality of light reflection points of the client device 200 photographed by the camera, which are shown by projecting on the image plane of the camera, respectively. It may correspond to the projection point of.

On the other hand, According to fig. 4, three-dimensional in that the camera reference coordinate system of the three-dimensional coordinates of the object based on the coordinate system of the P i P W i and point P i (i.e., the coordinate system of the i, j and k as a unit vector) A relationship such as the following equation (1) can be established between the coordinates P C i .

Figure 112009032495073-PAT00001

Further, when referring to the rotation matrix R the vector T represents as [R 1, R 2, R 3] T of the equation (1), such as [T x, T y, T z] T, of the point P i Between the three-dimensional coordinates P W i in the object reference coordinate system and (x i , y i ), which are two-dimensional coordinates on the image plane of the projection point p i corresponding to the point P i , Relationships can be established.

Figure 112009032495073-PAT00002

In Equations (1) and (2), the motion vector T is a vector from point O , which is the center of the camera reference coordinate system (i.e., projection center), to point P O , which is the center of the object reference coordinate system.

Figure 112009032495073-PAT00003
This indicates the position of the object in the camera reference coordinate system. That is, according to an embodiment of the present invention, the motion vector T may indicate the position of the client device 200 with respect to the camera.

Further, in the equations (1) and (2), the rotation matrix R has information regarding the direction of the object in the camera reference coordinate system. That is, according to an embodiment of the present invention, the rotation matrix R may indicate the direction of the client device 200 with respect to the camera.

Thus, the object's rotation matrix By calculating R and the motion vector T , it is possible to accurately specify the position and direction of the object in the camera reference coordinate system. Similarly, according to one embodiment of the invention, the rotation matrix of the client device 200 By calculating R and the motion vector T , it is possible to accurately specify the position and direction of the client device 200 with respect to the camera.

Hereinafter, the optical analysis unit 130 according to an embodiment of the present invention the rotation matrix of the client device 200 A method of calculating R and a motion vector T will be described in detail.

5 is a diagram illustrating a configuration of photographing a plurality of light reflection points of the client device 200 through the sensor unit 120 of the host device 100 according to an embodiment of the present invention.

Referring to FIG. 5, the client device 200 according to an embodiment of the present invention may include three light reflection points (points P 0 , P 1, and P 2 ), and the coordinate values of the three light reflection points are It can be specified in the coordinate system centering on the point P 0 (that is, the coordinate system in which u , v, and w are unit vectors). As described above, the coordinate values in the client device 200 reference coordinate system of the specified points P 0 , P 1, and P 2 are kept constant regardless of the movement of the client device 200. Information about the coordinate value may be stored in advance in the host device 100 or at least known to the host device 100. Here, the unit vectors u , w, and v may correspond to the coordinate axes of the client device 200 in the horizontal, vertical, and height directions, respectively, and the rotation angles φ, ψ, and θ are the horizontal, vertical, and It may correspond to the rotation about the coordinate axis in the height direction, respectively.

In addition, referring to FIG. 5, the optical analyzer 130 according to an exemplary embodiment of the present invention may include a reference coordinate system of the client device 200 of three light reflection points (points P 0 , P 1, and P 2 ) previously identified. On the basis of the coordinate values in and information about the two-dimensional coordinate values of the three projection points p 0 , p 1 , p 2 on the image plane obtained from the sensor unit 120, i.e., i , the rotation matrix of the client device 200 in the coordinate system having j and k as unit vectors R and the motion vector T can be calculated. As described above, the rotation matrix of the client device 200 in the camera reference coordinate system Since R and the motion vector T indicate the position and direction of the client device 200 with respect to the sensor unit 120, the rotation matrix of the client device 200. By calculating R and the motion vector T , the position and direction of the client device 200 with respect to the sensor unit 120 can be calculated.

In this regard, one of ordinary skill in the art to which the present invention pertains, "Simultaneous Pose and Correspondence Determination using Line" by Philip David et al. "Pose from the Orthography and Scaling with ITeration" (POSIT) algorithm disclosed in "Features". According to the POSIT algorithm disclosed in the above paper, the rotation matrix R and the motion vector T can be calculated quickly and accurately. Of course, those who intend to practice the present invention is not limited thereto, and may employ various known techniques to implement the present invention.

As described above, the rotation matrix of the client device 200 in the camera reference coordinate system In order to fully calculate R and the motion vector T , information about at least three light reflection points (two-dimensional coordinate values on the image plane for each light reflection point and three-dimensional coordinate values in the client device 200 reference coordinate system) is required. It can be seen.

However, according to another embodiment of the present invention, the rotation matrix of the client device 200 in the camera reference coordinate system You can control the pointing position on the display screen without completely calculating R and the motion vector T. Specifically, referring to FIG. 5, the position and rotation of the client device 200 with respect to the coordinate axis in the front and rear direction of the camera reference coordinate system (that is, the coordinate axis using k as the unit vector) may be used to control the pointing position. Since the correlation with the manipulation intention is low, the computational burden can be reduced by omitting the process of calculating this. In this case, the left and right sides of the camera reference coordinate system are based only on information on the two light reflection points (two-dimensional coordinate values on the image plane for each light reflection point and three-dimensional coordinate values in the client device 200 reference coordinate system). And the position and the degree of rotation of the client device 200 with respect to the coordinate axis in the up and down direction (that is, the coordinate axis having i and j as the unit vectors).

On the other hand, the optical analysis unit 130 according to an embodiment of the present invention, the value corresponding to the x-axis coordinates ( T x ) and y-axis coordinates ( T y ) of the calculated motion vector T of the client device 200. With reference to, the function of determining the pointing position on the display screen may be further performed. (i) Specifically, the coordinates of the pointing position may be specified by referring to the movement vector T of the client device 200 absolutely, for example, the x-axis coordinate and the y-axis coordinate of the pointing position on the display screen. As it is, it can correspond to the x-axis coordinate T x and the y-axis coordinate T y of the movement vector T of the client apparatus 200, respectively. (ii) On the other hand, the pointing position coordinates may be specified by referring to the position and direction of the client device 200 relatively, for example, as the user manipulates the client device 200. The x coordinate of the pointing position on the display screen may be increased in correspondence to the increase in the x-axis coordinate T x of the movement vector T of.

In addition, the optical analysis unit 130 according to another embodiment of the present invention, the coordinate axis in the left and right and up and down directions in the camera reference coordinate system of the client device 200 (that is, i and j as a unit vector) The pointing position on the display screen may be determined with reference to the coordinate value for the coordinate axis).

Meanwhile, the communication unit 140 according to an embodiment of the present invention performs a function of enabling data transmission / reception from / to the host device 100. In particular, a function of receiving information such as coordinate values in the reference coordinate system of the client device 200 of the plurality of light reflection points of the client device 200, key input data input to the client device 200 by a user's operation, and the like. Can be done.

The controller 150 according to an embodiment of the present invention performs a function of controlling the flow of data between the light emitting unit 110, the sensor unit 120, the light analyzing unit 130, and the communication unit 140. That is, the controller 150 according to the present invention controls the flow of data from / to the outside or between each component of the host device 100, thereby providing the light emitting unit 110, the sensor unit 120, and the light analyzing unit. The control unit 130 and the communication unit 140 each perform a unique function.

Configuration of Client Devices

Hereinafter, the internal structure of the client device 200 performing important functions for the implementation of the present invention and the function of each component will be described.

6 is a diagram illustrating in detail the internal configuration of the client device 200 according to an embodiment of the present invention. Referring to FIG. 6, it may be understood that the client device 200 according to an embodiment of the present invention may include a light reflection unit 210, a communication unit 220, and a control unit 230. According to an embodiment of the present disclosure, the communication unit 220 and the control unit 230 may be program modules in which at least some of them communicate with the display device 10 and / or the host device 100. Such program modules may be included in the client device 200 in the form of an operating system, an application module, and other program modules, and may be physically stored in various known storage devices. On the other hand, such program modules include, but are not limited to, routines, subroutines, programs, objects, components, data structures, etc. that perform particular tasks or execute particular abstract data types, described below, in accordance with the present invention.

According to an embodiment of the present invention, the light reflector 210 performs a function of dividing and reflecting the light emitted from the host device 100 into a plurality of paths. The light split and reflected by the light reflection unit 210 into a plurality of paths may be returned to the host device 100. For example, the light reflector 210 may include a plurality of light reflection points that emit reflected light divided into the plurality of paths.

On the other hand, as described above, the host device 100 according to an embodiment of the present invention can calculate the position and the direction of the client device 200 by detecting the reflected light emitted from the plurality of light reflection points.

7 and 8 are views exemplarily showing the configuration of the light reflecting unit 210 according to an embodiment of the present invention.

First, referring to FIG. 7, the light reflecting unit 210 according to an embodiment of the present invention includes a condenser lens 211, an imaging lens 212, a spherical reflecting mirror 213, a first reflecting mirror 214, and It may be configured to include a second reflecting mirror 215. According to the exemplary embodiment of the present invention, the light emitted from the light emitter 110 of the host device 100 is first incident on the condenser lens 211 of the light reflector 210 to pass through the imaging lens 212. The light passing through the imaging lens 212 may be divided into a first path and a second path. Next, light corresponding to the first path and the second path may be reflected by the spherical reflection mirror 213 and incident to the first reflection mirror 214 and the second reflection mirror 215, respectively. Finally, the light corresponding to the first path and the second path incident to the first reflection mirror 214 and the second reflection mirror 215 may be directed toward the sensor unit 120 of the host device 100. have. That is, the first reflection mirror 214 and the second reflection mirror 215 respectively correspond to the light reflection points (eg, points P 0 , P 1 , P 2, etc. in FIG. 5) of the client device 200. It can be seen as.

Next, referring to FIG. 8, the light reflecting unit 210 according to the exemplary embodiment of the present invention includes a condenser lens 211, an imaging lens 212, a spherical reflecting mirror 213, and a first reflecting mirror 214. And a second reflection mirror 215, a first additional imaging lens 216, a second additional imaging lens 217, a first diffraction grating 218, and a second diffraction grating 219. According to the exemplary embodiment of the present invention, the light emitted from the light emitter 110 of the host device 100 is first incident on the condenser lens 211 of the light reflector 210 to pass through the imaging lens 212. The light passing through the imaging lens 212 may be divided into a first path and a second path. Next, light corresponding to the first path and the second path may be reflected by the spherical reflection mirror 213 and incident to the first reflection mirror 214 and the second reflection mirror 215, respectively. Next, the light corresponding to the first path and the second path incident to the first reflecting mirror 214 and the second reflecting mirror 215, respectively, is the first additional imaging lens 216 and the first additional imaging lens ( 217). Finally, the light corresponding to the first path and the second path may be diffracted by the first diffraction grating 218 and the second diffraction grating 219 and split into a plurality of paths, respectively. The corresponding light may travel toward the sensor unit 120 of the host device 100. At this time, by adjusting the diffraction angle it is possible to control the direction of the diffracted light.

Meanwhile, the light reflecting unit 210 according to the exemplary embodiment of the present invention may include a Fresnel lens as the condenser lens 211. Here, the Fresnel lens refers to a lens in which a plurality of band structures that serve as prisms are formed on at least part of its surface. By employing such a Fresnel lens, it is possible to reduce the thickness of the condenser lens 211 and to increase the productivity of the client device 200.

The configuration of the light reflecting unit 210 mentioned above is merely an example for explaining the configuration of the light reflecting unit 210 according to various embodiments of the present invention, the light reflecting unit 210 of the present invention The configuration and the light reflection method are not necessarily limited thereto. In particular, the number of the reflecting mirrors included in the light reflecting unit 210 is not necessarily limited to two, and the light reflecting unit 210 according to various methods of calculating the position and the direction of the client device 200 described above may be used. Note that it may include more than two reflective mirrors.

Meanwhile, the communication unit 220 according to an embodiment of the present invention performs a function of enabling data transmission / reception from / to the client device 200. Particularly, the host device 100 receives information such as coordinate values in the reference coordinate system of the client device 200 of the plurality of light reflection points of the client device 200, key input data input to the client device 200 by a user's operation, and the like. It can perform the function of transmitting to.

The controller 230 according to an embodiment of the present invention controls the client device 200 to perform a unique function by controlling the flow of data from / to or from each component of the client device 200.

Embodiments according to the present invention described above may be implemented in the form of program instructions that may be executed by various computer components, and may be recorded in a computer-readable recording medium. The computer-readable recording medium may include program instructions, data files, data structures, etc. alone or in combination. Program instructions recorded on the computer-readable recording medium may be those specially designed and configured for the present invention, or may be known and available to those skilled in the computer software arts. Examples of computer-readable recording media include magnetic media such as hard disks, floppy disks and magnetic tape, optical recording media such as CD-ROMs, DVDs, and magneto-optical media such as floptical disks. media), and hardware devices specifically configured to store and execute program instructions, such as ROM, RAM, flash memory, and the like. Examples of program instructions include not only machine code generated by a compiler, but also high-level language code that can be executed by a computer using an interpreter or the like. The hardware device may be configured to operate as one or more software modules to perform the process according to the invention, and vice versa.

Although the present invention has been described by specific embodiments such as specific components and the like, but the embodiments and the drawings are provided to assist in a more general understanding of the present invention, the present invention is not limited to the above embodiments. For those skilled in the art, various modifications and variations can be made from these descriptions.

Therefore, the spirit of the present invention should not be construed as being limited to the above-described embodiments, and all of the equivalents or equivalents of the claims, as well as the following claims, I will say.

1 is a view schematically showing the configuration of an entire system according to an embodiment of the present invention.

2 is a diagram illustrating an internal configuration of the host apparatus 100 according to an exemplary embodiment of the present invention in detail.

3 is a diagram illustrating a configuration of a host device 100 according to an embodiment of the present invention.

4 is a diagram conceptually illustrating a geometric relationship between a camera and an object when photographing an object existing in a three-dimensional space using a camera, which is a kind of the sensor unit 120.

5 is a diagram illustrating a configuration of photographing a plurality of light reflection points of the client device 200 through the sensor unit 120 of the host device 100 according to an embodiment of the present invention.

6 is a diagram illustrating in detail the internal configuration of the client device 200 according to an embodiment of the present invention.

7 and 8 are views exemplarily showing the configuration of the light reflecting unit 210 according to an embodiment of the present invention.

<Brief description of the major reference numerals>

100: host device

110: light emitting portion

120: sensor

130: optical analyzer

140: communication unit

150: control unit

200: client device

210: light reflecting portion

211 condensing lens

212: imaging lens

213: Spherical Reflective Mirror

214: first reflective mirror

215: second reflecting mirror

216: first additional imaging lens

217: second additional imaging lens

218: first diffraction grating

219: second diffraction grating

220: communication unit

230: control unit

Claims (13)

A host device for realizing pointing using light reflection, A sensor unit for sensing light emitted from at least one point of the client device, and Analyzing the detected light, calculating at least one of a position and a direction in the sensor unit reference coordinate system of the client device, and referring to at least one of the calculated position and the direction, determines a pointing position on a display screen. Optical analyzer / RTI &gt; The method of claim 1, The sensor unit is a host device for detecting the infrared. The method of claim 1, And the at least one point is at least one light reflection point. The method of claim 1, The position of the client device is specified by a motion vector from the center of the sensor unit reference coordinate system to the center of the client device reference coordinate system in the sensor unit reference coordinate system, the direction of the client device relative to the sensor unit reference coordinate system. A host device specified by a rotation vector representing a direction of the client device reference coordinate system. The method of claim 4, wherein The motion vector and the rotation vector are calculated based on a POSIT algorithm. The method of claim 4, wherein The pointing position is determined with reference to at least one of an X axis component, a Y axis component and a Z axis component of the movement vector, and an X axis center rotation, a Y axis center rotation, and a Z axis center rotation obtained from the rotation vector. Host device. The method of claim 4, wherein The pointing position is based on a change in the value of at least one of an X axis component, a Y axis component and a Z axis component of the movement vector, and an X axis center rotation, a Y axis center rotation, and a Z axis center rotation obtained from the rotation vector. The host device is determined by. The method of claim 1, And a light emitting portion for emitting light to the client device. The method of claim 1, And a communication unit configured to receive information regarding a position of the at least one point in the client device reference coordinate system. A client device for realizing pointing using light reflection, An optical splitter dividing the light incident from the host device into at least two paths, and A light reflector reflecting the divided light Client device comprising a. The method of claim 10, The light splitting unit includes a condensing lens unit for condensing light incident from the host device and an imaging lens unit for forming the condensed light, The light reflecting unit may include: a main reflection mirror unit for reflecting light split into at least two paths by the imaging lens unit in the opposite direction; and a plurality of light reflection units reflecting the light reflected by the main reflection mirror unit to control a propagation path thereof A client device comprising an auxiliary reflective mirror of the. The method of claim 11, The light reflecting unit, And an additional imaging lens unit for reimaging the light reflected by the plurality of auxiliary reflection mirrors and an optical diffraction unit for diffracting the light again imaged by the additional imaging lens unit. Pointing system using light reflection, A host device, and Client device Including, The host device, A light emitting unit for emitting light to the client device; A sensor unit for detecting light reflected from the client device; Analyzing the detected light, calculating at least one of a position and a direction in the sensor unit reference coordinate system of the client device, and referring to at least one of the calculated position and the direction, determines a pointing position on a display screen. Optical analyzer Including; The client device, A light splitter dividing light incident from the light emitter into at least two paths, and A light reflecting unit reflecting the divided light to the sensor unit Containing Pointing system.
KR1020090047339A 2009-05-29 2009-05-29 Pointing device and system using optical reflection KR20100128750A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
KR1020090047339A KR20100128750A (en) 2009-05-29 2009-05-29 Pointing device and system using optical reflection

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
KR1020090047339A KR20100128750A (en) 2009-05-29 2009-05-29 Pointing device and system using optical reflection

Publications (1)

Publication Number Publication Date
KR20100128750A true KR20100128750A (en) 2010-12-08

Family

ID=43505595

Family Applications (1)

Application Number Title Priority Date Filing Date
KR1020090047339A KR20100128750A (en) 2009-05-29 2009-05-29 Pointing device and system using optical reflection

Country Status (1)

Country Link
KR (1) KR20100128750A (en)

Similar Documents

Publication Publication Date Title
US10970425B2 (en) Object detection and tracking
US10621751B2 (en) Information processing device and computer program
US9846968B2 (en) Holographic bird&#39;s eye view camera
US10311833B1 (en) Head-mounted display device and method of operating a display apparatus tracking an object
EP2834723B1 (en) Touch sensitive user interface
CN110362193B (en) Target tracking method and system assisted by hand or eye tracking
US9207773B1 (en) Two-dimensional method and system enabling three-dimensional user interaction with a device
US20140168261A1 (en) Direct interaction system mixed reality environments
US10996744B2 (en) NTE display systems and methods with optical trackers
US20180063390A1 (en) Spatially tiled structured light projector
US11102467B2 (en) Array detector for depth mapping
US20170115488A1 (en) Remote rendering for virtual images
US11734876B2 (en) Synthesizing an image from a virtual perspective using pixels from a physical imager array weighted based on depth error sensitivity
US20150043770A1 (en) Speckle sensing for motion tracking
US20020085097A1 (en) Computer vision-based wireless pointing system
KR102436730B1 (en) Method and apparatus for estimating parameter of virtual screen
US10809429B1 (en) Angle selective filter having curved surface for near eye displays
US10748344B2 (en) Methods and devices for user interaction in augmented reality
CN111309141A (en) Screen estimation
JPWO2014076993A1 (en) Interface device and input receiving method
KR101900475B1 (en) Calibration method for matching of augmented reality object and head mounted display for executing the method
CN109660731B (en) Electronic equipment and mobile platform
KR20100128750A (en) Pointing device and system using optical reflection
US9239635B2 (en) Method and apparatus for graphical user interface interaction on a domed display
KR102595778B1 (en) System for detecting six degrees of freedom of movement by tracking optical flow of backscattered laser speckle patterns

Legal Events

Date Code Title Description
A201 Request for examination
N231 Notification of change of applicant
E902 Notification of reason for refusal
E601 Decision to refuse application