KR101185594B1 - Method for double click of pointing device - Google Patents

Abstract

The present invention is to enable the user to double-click the object in the three-dimensional pointer quickly and precisely, and to prevent wrist distortion caused by parallax in the movement of the pointer and the user's movement, A method of performing a double click of a pointing device according to the present invention includes detecting a user's movement, moving a pointer on an object on a display screen according to the detected movement, first clicking the object, Moving the position of the pointer when the position of the pointer exceeds a predetermined amount of displacement after the first click; and under a condition that the positional movement of the pointer is less than or equal to the predetermined amount of displacement within a predetermined waiting time. Running the object when a click is performed.

Description

How to double-click a pointing device {METHOD FOR DOUBLE CLICK OF POINTING DEVICE}

The present invention relates to a method of performing a double click of a pointing device, and more particularly, to a method of performing a double click of a three-dimensional pointing device used for inputting a command in an image display apparatus.

As the field of computer science has developed, a variety of devices have been developed that allow users to enter information into computer devices. One group of such devices is called a pointing device. As the user manipulates the components of this device, position data corresponding to the movement of the pointing device is generated. This position data is then converted into movement of the pointer image appearing on the display. Thus, by moving the pointing device, the user can associate the pointer image with the objects displayed on the display. The object refers to a user interface that performs a specific operation when a menu, a button, an image, or the like is selected. Thereafter, the user may perform a specific command related to the object through a selection operation such as pressing a specific button of the pointing device.

Users of general personal computers use Microsoft's Windows as an operating system (OS) to run their own computers. This is due to convenient mouse functions and various graphic functions that are not supported by the existing DOS (Disk Operating System) system. When a user enters a specific command through a window, the user can drag, scroll, or click the mouse without typing a keyboard. You can easily enter a command by, for example.

On the other hand, in a video display device in which a keyboard or a mouse used in a personal computer such as a digital TV or a set-top box cannot be used, various commands are input using a keypad provided on a remote control device called a remote controller. have. The reason why the keypad press input method is mainly used is that, unlike a personal computer, such a device is not fixed to a specific location for the user to operate the device, and because the device requires manipulation in an open space such as a living room, This is because it is difficult to use an input means mainly fixed to a plane such as a mouse.

For this reason, the input means in the image display device as described above is preferred to the input means easy to operate in a space such as a remote control having a keypad. However, since the keypad input method uses a method of moving only one space when the keypad is pressed in character input or menu selection, there is a limitation in the user's command input.

In view of these problems, recently, three-dimensional pointing devices equipped with motion sensors such as gyroscopes (hereinafter, referred to as gyroscopes) and accelerometers have been developed. By moving the three-dimensional pointing device, the user can move the pointer image on the display corresponding to the desired direction and speed, and select and execute a desired object by pressing a specific button provided on the pointing device.

In order to execute the command related to a specific object by operating the mouse used in a general PC, the user places the pointer on the object and double-clicks it. This double click is based on whether the second click after the first click is within a predetermined waiting time (0.2 seconds).

However, in the case of a 3D pointing device, since the user grips it in a space, unlike a general mouse, fine hand shake may occur, and in particular, in case of a button click, the hand shake may be increased. Therefore, if the control is performed according to the double click condition such as a mouse used in a general PC, it is difficult to obtain a desired result. In other words, once the user places the pointer on a specific object and tries to double-click, the second click may cause the point to escape the object so that the command by double-clicking may not be executed. The user is forced to work with considerable stress.

In order to solve this problem, the conventional double-click method of the three-dimensional pointer is that once the first click is made, the pointer stops within a predetermined waiting time to determine whether the user intends to make a simple click or a first click for a double click. Wait for the second click. If there is a second click within this waiting time, it is recognized as a double click, otherwise the pointer is moved again. However, according to this prior art, it causes considerable inconvenience when the user moves the pointer without a double click intention after the first click. That is, when the user sees it, the pointer stops for a certain amount of time, which is why the user feels frustrated. In addition, when the user moves the pointing device considerably in one direction, the wrist may be distorted by a late moving pointer, for example, the hand may be directed toward the end of the screen even when the pointer is at the center.

The present invention has been conceived based on these points, and the problem to be solved by the present invention is to enable the user to double-click the object in the three-dimensional pointer quickly and precisely.

Another object of the present invention is to prevent wrist distortion caused by parallax in the movement of the pointer and the user's movement.

The problems of the present invention are not limited to the above-mentioned problems, and other problems not mentioned can be clearly understood by those skilled in the art from the following description.

In order to solve this problem, a method of performing double-clicking of a pointing device according to the present invention includes detecting a user's movement, moving a pointer on an object on a display screen according to the detected movement, and firstly clicking the object. And when the position of the pointer moves beyond the predetermined amount of displacement after the first click, determining that the user does not intend to double-click and moving the position of the pointer within a predetermined waiting time. And executing the object when the second click is performed under the condition that the positional movement of the pointer is equal to or less than the predetermined displacement amount.

A more detailed example of the double-click performing method of the pointing device according to the present invention will be described later in the embodiments with reference to the drawings.

Since the user can double-click the object more precisely and quickly by the double-click performing method of the pointing device according to the present invention, the efficiency of the work through the presentation or other pointing device is improved.

In addition, it is possible to prevent wrist distortion caused by parallax between the movement of the pointer and the movement of the user.

The effects according to the present invention are not limited by the contents exemplified above, and more various effects are included in the present specification.

1 is a diagram illustrating a configuration of a pointing device and an image display device according to an exemplary embodiment of the present invention.
2 is a diagram illustrating an object click performing method of a pointing device according to an exemplary embodiment of the present invention.
3 is a diagram illustrating a method of performing an object double click of a pointing device according to an embodiment of the present invention.
4 is a diagram illustrating a state in which a double click of a pointing device is not performed according to an embodiment of the present invention.
5 is a flowchart illustrating a method of performing a double click of a pointing device according to an embodiment of the present invention.

Advantages and features of the present invention and methods for achieving them will be apparent with reference to the embodiments described below in detail with the accompanying drawings. However, the present invention is not limited to the embodiments disclosed below, but will be implemented in various forms, and only the present embodiments are intended to complete the disclosure of the present invention, and the general knowledge in the art to which the present invention pertains. It is provided to fully convey the scope of the invention to those skilled in the art, and the present invention is defined only by the scope of the claims.

DETAILED DESCRIPTION Hereinafter, exemplary embodiments of the present invention will be described in detail with reference to the accompanying drawings. &Quot; and / or "include each and every combination of one or more of the mentioned items. ≪ RTI ID = 0.0 >

Although the first, second, etc. are used to describe various components, it goes without saying that these components are not limited by these terms. These terms are used only to distinguish one component from another. Therefore, it goes without saying that the first component mentioned below may be the second component within the technical scope of the present invention.

The terminology used herein is for the purpose of describing particular embodiments only and is not intended to be limiting of the invention. In the present specification, the singular form includes plural forms unless otherwise specified in the specification. The terms " comprises "and / or" comprising "used in the specification do not exclude the presence or addition of one or more other elements in addition to the stated element.

Unless otherwise defined, all terms (including technical and scientific terms) used in the present specification may be used in a sense that can be commonly understood by those skilled in the art. Also, commonly used predefined terms are not ideally or excessively interpreted unless explicitly defined otherwise.

The terms spatially relative, "below", "beneath", "lower", "above", "upper" And can be used to easily describe a correlation between an element and other elements. Spatially relative terms should be understood in terms of the directions shown in the drawings, including the different directions of components at the time of use or operation. For example, when inverting an element shown in the figures, an element described as "below" or "beneath" of another element may be placed "above" another element . Thus, the exemplary term "below" can include both downward and upward directions. The components can also be oriented in different directions, so that spatially relative terms can be interpreted according to orientation.

Hereinafter, with reference to the accompanying drawings will be described embodiments of the present invention.

1 is a diagram illustrating the configuration of a pointing device 100 and an image display apparatus 200 according to an exemplary embodiment of the present invention. The pointing device 100 may be configured to include a motion sensor unit 110, a controller 120, a trigger detector 130, a coordinate calculator 140, and a transmitter 150.

The motion sensor 110 detects the direction of movement of the pointing device 100 held by the user and provides a sampled digital output value. In detail, the motion sensor unit 110 may include at least one gyroscope or at least one accelerometer or a combination of a gyroscope and an accelerometer. The gyroscope may be used regardless of mechanical, fluid, optical, or piezoelectric type, and the accelerometer may be used regardless of a piezodlectric type or a moving coil type.

The coordinate calculator 140 calculates the horizontal movement value (x displacement) and the longitudinal movement value (y displacement) on the display screen from the output value provided from the motion sensor unit 110.

For example, when the motion sensor unit 110 uses a gyroscope, the motion sensor unit 110 generates angular velocity information (Wbx, Wby, Wbz) corresponding to a user's movement and transmits the same to the coordinate calculator 140. to provide. The subscript b means acceleration information in the body frame, and the subscripts x, y, and z mean information about the x-axis, the y-axis, and the z-axis. The coordinate calculator 140 converts the input angular velocity information into rotation angle information through a predetermined calculation process. The rotation angle information includes at least one of pitch φ, roll θ, and yaw ψ. Criteria for determining positive and negative for these rotations may follow a right-handed coordinate. Since a calculation process for converting the rotation angle information belongs to a known technique, a detailed description thereof will be omitted herein. Here, the yaw corresponds to the lateral displacement on the display screen, and the pitch corresponds to the longitudinal displacement.

On the other hand, when the motion sensor unit 110 uses an accelerometer, the motion sensor unit 110 generates acceleration information (Abx, Aby, Abz) corresponding to the user's movement and provides it to the coordinate calculator 140. The coordinate calculator 140 double-integrates the acceleration information and converts the displacement information into respective displacement information about the x, y, and z axes. If a gyroscope and an accelerometer are used together, it is possible to calibrate the other based on the result of one of these calculations.

Regardless of the posture of the pointing device 100, the movement on the body frame may be matched to the movement on the display, and the movement on the navigation frame fixed in space may be matched to the movement on the display. . In the latter case, a process of measuring the posture of the pointing device 100 and converting the rotation by a wrong angle may be further required.

The coordinate calculating unit 140 calculates the horizontal displacement and the vertical displacement (hereinafter referred to as displacement information) on the display through the above process and provides the same to the controller 120. As such, providing the coordinate calculating unit 140 in the pointing device 100 is one example, and the pointing device 100 simply provides the image display apparatus 200 with raw data relating to a sensor output relating to movement in space. It is also possible to provide an embodiment in which a coordinate calculation unit provided in the image display apparatus 200 calculates a horizontal displacement and a longitudinal displacement from the raw data.

The trigger detector 130 detects a selection command from the user and transmits the selection command to the controller 120. The selection command may be detected by simply pressing a specific button provided in the pointing device 100, but may also be detected by determining whether a predetermined specific gesture has occurred. Such a specific gesture may be detected by an accelerometer (built in the motion sensor unit 110) of the pointing device 100.

The controller 120 controls the overall operation of the other components of the pointing device 100, and provides displacement information (lateral displacement and longitudinal displacement) provided from the coordinate calculating unit 140 and provided from the trigger detecting unit 130. The selection command is provided to the transmitter 150.

The transmitter 150 converts the displacement information and the selection command provided from the controller 120 into a wireless signal that conforms to a predetermined wireless communication protocol and transmits the converted signal to the image display apparatus 200.

The image display apparatus 200 may include a receiver 210, a controller 220, a memory 240, and an image processor 250.

The receiver 210 receives a radio signal transmitted from the pointing device 100 and restores displacement information and a selection command from the received radio signal.

The controller 220 controls overall operations of the other components of the image display apparatus 200, controls the movement of the pointer on the display of the image display apparatus 200 by appropriately scaling the displacement information or the displacement amount. According to the selection command, objects belonging to a lower layer of the object (current object) where the current pointer is located are displayed around the current object, or the image display apparatus 200 corresponding to the object where the current point is located is performed.

The memory 240 may store the plurality of objects for each layer and may provide the objects for each layer at the request of the image processor 250.

The image processor 250 displays objects belonging to one layer on the display, and if a specific object is selected under the control of the controller 220, the image processor 250 may additionally display objects belonging to a lower layer of the object around the specific object. It may be. In addition, the image processor 250 moves the pointer on the display under the control of the controller 220.

The interaction structure of the pointing device 100 and the image display apparatus 200 is illustrated in FIGS. 2 to 4. FIG. 2 illustrates the position of the pointing device 100 in order to click the object 201 desired by the user who holds the pointing device 100, and correspondingly, the position of the pointer 101 of the image display apparatus 200 is changed. Is determined and the position of the pointer 101 is displayed on the screen. When the user performs the simple click operation through the pointing device 100 as shown in FIG. 2, it is sufficient to perform the operation corresponding to the object 201 existing at the position of the pointer 101 at the moment of clicking, but double-clicking. When the operation is performed, the position of the pointing device 100 at the first click and the position of the pointing device 100 at the second click may be changed. This is in accordance with the characteristics of the three-dimensional pointing device that must be pointing in space despite the user's intention. To solve this problem, the pointing device according to the embodiment of the present invention allows a double click to be performed when a second click is made within a predetermined waiting time within the predetermined displacement amount range 102 after the first click as shown in FIG. 3. As in the conventional case, the method of fixing the position of the pointer 101 unconditionally for a predetermined time after the first click is not used. That is, in the method of performing double-clicking of the pointing device according to an embodiment of the present invention, even when the user wants to perform a simple click operation, the pointer 101 is fixed and does not move for a predetermined waiting time, so that each time a simple click is performed. It does not cause the problem of having to interrupt work for a predetermined waiting time and wait.

According to a specific embodiment of the present invention, a method of performing double-clicking of a pointing device includes detecting a movement of a user and moving the pointer 101 on the object 201 on the display screen 200 according to the detected movement. A step of first clicking the object 201, and a position of the pointer 101 when the position of the pointer 101 moves beyond a predetermined displacement amount range 102 after the first click. And performing a task or operation assigned to the object 201 when the second click is performed under the condition that the position movement of the pointer 101 is less than or equal to the predetermined displacement amount 102 within a predetermined waiting time. It comprises the step of.

That is, as shown in FIG. 3, when the second click is performed within the predetermined displacement amount range 102 within the predetermined waiting time based on the pointer position 101 according to the first click, the double click is recognized as a double click. 4, the position of the pointer 101 without the second click after the first click or when the second click is performed outside the predetermined displacement amount range 102 as shown in FIG. 4. Is out of the predetermined displacement amount range 102, the double-click operation is not performed. Therefore, unlike the conventional method, if the pointer 101 is moved out of the predetermined displacement amount range 102 even after the first click within the predetermined waiting time, the position of the pointer 101 can be moved without waiting for the predetermined waiting time. have.

The specific order in which the operation of the pointer 101 is performed is shown in FIG. 5. First, a movement of a user who holds the pointing device 100 is detected (S10). This process, as described above, based on the position information of the pointing device 100 obtained from the motion sensor unit 110, the image display through the transmitter 150 through the coordinate calculation unit 140 and the control unit 120 The location information of the pointer 101 is sent to the device 200. Based on this, the controller 220 of the image display apparatus 200 issues a command to the image processor 250 to move the pointer 101 (S20). The user can freely move the pointer 101, and can perform a click operation on the area where the object 201 is not present. However, since there is no task assigned to the click / double click, no operation is performed. On the other hand, when the user detects a click operation through the trigger detecting unit 130 of the pointing device 100 when the object 201 exists on the moving position of the pointer 101, the image display apparatus 200 clicks. The object operation assigned to the job is performed (S30).

In this case, it is determined whether a displacement of the pointer 101 exists after performing the first click (S40). If the displacement of the pointer 101 exists, it is again determined whether the displacement of the pointer 101 is within a predetermined range 102 (S50). If the displacement of the pointer 101 is out of the predetermined displacement amount range 102 as shown in FIG. 4, the step of detecting the user's movement again is performed because the user may not be determined to double-click. (S10). On the other hand, as shown in FIG. 3, when the displacement of the pointer 101 is within a predetermined range 102, the displacement of the pointer 101 may correspond to a case where the user performs a double-click operation. do.

If there is no displacement of the pointer 101 after the first click or is within the predetermined range 102, it is determined whether a second click exists for a predetermined waiting time (S60). When the second click is performed for a predetermined waiting time, an operation corresponding to the double click of the selected object 201 is executed (S70).

Through the above process, the double-click of the three-dimensional pointing device is performed. Although not shown in FIG. 5, when a task corresponding to a simple click is assigned to the object 201, the task may be performed.

Optionally, the method may further include presetting a predetermined waiting time, or may further include presetting a predetermined displacement amount. That is, since the double click waiting time or the degree of hand shake is different for each user, the pointing device 100 may be used for each individual by setting this in advance. To this end, the user may receive a user's double-click pattern several times in advance in a separately provided setting mode, and determine a predetermined waiting time and a predetermined displacement amount based on this value.

The predetermined amount of displacement 102 may be calculated based on the position of the pointer 101 at the first click, and the predetermined amount of displacement 102 is an area occupied by the object 201 on the image display apparatus 200 according to a selection. It can be set to be the value in. That is, when the first click position is a boundary or corner end of the object 201, the second click position may limit the range of the predetermined amount of displacement 102 so as to be included in the range of the predetermined amount of displacement 102. If it does, you can block the double-click to prevent it from malfunctioning.

In addition, the predetermined displacement amount range 102 may be calculated based on the positions of the object 201 and the neighboring object 201 'at the first click. That is, if a click is made twice within a predetermined waiting time, but it is not intended to be recognized as a double click when it is intended to click on different objects 201 and 201 ', the predetermined displacement amount range 102 is the first click. The calculated object 201 may be calculated not to overlap the area of the neighboring object 201 ′ with respect to the object 201. As a result, it may be calculated in consideration of the position 201 of the pointer 101 at the first click and the position of the neighboring object 201 '.

Although the embodiments of the present invention have been described with reference to the accompanying drawings, the present invention is not limited to the above embodiments, and may be manufactured in various forms within the scope of the present invention, and the present invention Those skilled in the art will understand that it can be implemented in other specific forms without changing the technical spirit or essential features of the present invention, the embodiments described above are exemplary in all respects and limited It is not limited to form.

100: pointing device 101: pointer
102: predetermined displacement range 110: motion sensor unit
120: control unit 130: trigger detection unit
140: coordinate calculation unit 150: transmitter
200: video display device 201: object
210: receiver 220: controller
240: memory 250: image processing unit

Claims (5)

Detecting a user's movement,
Moving the pointer on an object in a display screen according to the detected movement;
First clicking the object;
Moving the position of the pointer when the position of the pointer moves beyond a predetermined displacement amount range after the first click;
Executing a operation corresponding to the object when the second click is performed under a condition that the position movement of the pointer is within the predetermined displacement amount range within a predetermined waiting time,
And the predetermined displacement amount range is set independently of the boundary of the object. The method of claim 1,
And setting the predetermined waiting time in advance. The method of claim 1,
And setting a predetermined range of displacement amounts in advance. The method of claim 1,
And the predetermined displacement amount range is calculated based on the position of the pointer at the first click. The method of claim 1,
And the predetermined displacement amount range is calculated based on the position of the pointer at the first click and the position of a neighboring object.

Images