KR100868175B1 - Mobil phone having optical pointing device and thereof method - Google Patents

Abstract

The present invention relates to a portable terminal equipped with an optical pointing device installed in a portable terminal and an optical pointing device for conveniently selecting and utilizing various contents provided on a display screen, and a pointing method using the optical pointing device.

The present invention provides a portable terminal comprising: light emitting means for emitting light to a user's finger surface in contact with a specific surface in a portable terminal; Condensing means for condensing light reflected from the finger surface; An image sensor for capturing light provided through the light collecting means and detecting a movement, a speed, and a direction of a finger based on the captured information and calculating the coordinates into coordinate values; A microcomputer that receives information calculated using coordinates of the image sensor; A display unit which displays a pointer according to the coordinate value received by the microcomputer; Including, but the image sensor is to set the X, Y displacement value step by step, multiply the displacement value of the step corresponding to the finger movement speed by a preset multiple to calculate the accelerated coordinate value, and then calculate the calculated coordinate value It characterized in that the pointer is moved through the display unit by transmitting to.

Handheld Terminal, Optical Pointing, Scrolling, Acceleration Zone

Description

Mobile terminal with optical pointing device and pointing method using optical pointing device {MOBIL PHONE HAVING OPTICAL POINTING DEVICE AND THEREOF METHOD}

1 is a schematic cross-sectional view showing an optical pointing device of a mobile terminal according to the present invention.

Figure 2a is a block diagram showing the operation principle of the pointer using the optical pointing device of a mobile terminal according to the present invention.

2B is a block diagram of an acceleration portion of the optical pointing device.

3A and 3B are exemplary views illustrating a process of scrolling a display screen using an optical pointing device of a mobile terminal according to the present invention.

4A and 4B are exemplary views illustrating a process of displaying a list list by selecting a menu bar using an optical pointing device of a mobile terminal according to the present invention.

FIG. 5 is a flowchart illustrating a process of pointing content using an optical pointing device of a mobile terminal according to the present invention. FIG.

<Explanation of symbols for each major part of drawing>

5: cover 10: light emitting means

20: light collecting means 22: first waveguide

24: second waveguide 30: image sensor

40: micom 45: memory unit

50: display unit 60: menu

70: text list

The present invention relates to a portable terminal equipped with an optical pointing device installed in a portable terminal and an optical pointing device for conveniently selecting and utilizing various contents provided on a display screen, and a pointing method using the optical pointing device.

In general, personal mobile terminals such as mobile phones and PDAs (Personal Digital Assistants) employ a user interface using a keypad. In more detail, the conventional personal portable terminal is capable of inputting a telephone number or a sentence through a button input of a keypad composed of a plurality of buttons for inputting numbers and letters.

In recent years, as wireless Internet services such as WIBRO (Wireless Broadband) service have been commercialized, a Windows operating system supporting a Graphical User Interface (GUI) has been adopted for personal portable devices.

In addition, with the development of technology, personal portable terminals have various additional services, and a Windows operating system supporting a GUI is also adopted for convenient operation of the various additional services.

As described above, as the operating system of the GUI is adopted as the user interface of the personal portable terminal, the development of a pointing device suitable for the personal portable terminal is urgently required.

In general, pointing devices for a GUI include a ball mouse, an optical mouse, a laser mouse, a touch pad, and a tablet. Such a pointing device is employed in a computer, and in theory, it may be employed as a pointing device of a personal portable terminal.

However, since the personal portable terminal is intended to be portable, it is difficult to employ a separate pointing device separated from the main body as a pointing device of the personal portable terminal.

In addition, since a track ball-type or joy stick-type pointing device physically occupies a predetermined space or more, there is a problem of greatly damaging the aesthetics of a personal portable terminal.

Recently, various types of devices have been developed to increase the portability of a mobile terminal while not damaging the aesthetics and to select a list of text displayed on a screen.

The device applied to the mobile terminal may be a touch screen type in which a user may directly touch the display screen to select a list, or a type in which a jog shuttle is installed to select a list displayed on the screen.

The track ball type or the joy stick type can be selected from the list of texts installed on the mobile terminal and displayed on the display screen. However, as described above, the track ball type or the joy stick type has been damaged. .

In addition, both the track ball type and the joy stick type have a structure in which a pointer is displayed on the display screen and a list can be selected using the pointer. However, these are difficult to be mounted in a very small size and shape in the standard of the portable terminal in consideration of the convenience of use, and even when mounted has a problem that it is difficult to conveniently adjust the movement of the pointer.

On the other hand, currently released mobile terminals can be provided with a variety of content through the Internet connection. Most of the content is a form in which a plurality of icons are arranged consecutively according to the type, and the icons are clicked using the direction keys and the selection keys.

Of course, a number or the like is described in each icon so that the content can be easily selected, and the icon can be clicked by the number key selection of the mobile terminal.

However, when the user selects an icon, if the icon position is not a continuous arrangement or if the user needs to select one of a large number of icons even in a continuous arrangement, the user must press the select key after clicking the direction key several times. Discomfort will occur.

This inconvenience may be similar to, for example, selecting one of the displayed lists by using a direction key of a computer before the Internet is commercialized.

In addition, it is necessary to bear some inconvenience to press the number key without selecting the direction key and the selection key of the portable terminal.

That is, in the process of selecting an icon, the position of the user's finger is placed on the direction key and the selection key, and after checking the number of the icon to be selected by the user, the position of the finger must be moved with the number key. There is considerable inconvenience.

In this case, in the case of a mobile terminal equipped with a jog shuttle, the icons arranged in a vertical structure may be selected by deforming the rotation of the jog shuttle linearly, but the movement of the points using the jog shuttle may be moved only in the X-axis direction. There is a problem that can not quickly select the icon located in the direction or Y-axis direction.

In addition, when the movement of the point using the jog shuttle starts to rotate over a certain speed, the movement speed is set to be rapidly increased, but this has a limitation that can be used only in the form of icons arranged in a vertical structure.

Accordingly, there is a need for a portable terminal that can freely and quickly select various types of contents arranged on a display screen of the portable terminal and does not impair the aesthetics of the entire portable terminal.

SUMMARY OF THE INVENTION The present invention has been made in view of the above problems, and can freely select various contents provided on a display screen using a surface of a finger as a subject by using a pointer, and can minimize the thickness and size of an optical system. It is a main object to provide a mobile terminal with an optical pointing device and a pointing method using the optical pointing device.

In order to achieve the above object effectively, the present invention provides a portable terminal, comprising: light emitting means for emitting light to a user's finger surface in contact with a specific surface in a portable terminal; Condensing means for condensing light reflected from the finger surface; An image sensor for capturing light provided through the light collecting means and detecting a movement, a speed, and a direction of a finger based on the captured information and calculating the coordinates into coordinate values; A microcomputer that receives information calculated using coordinates of the image sensor; A display unit which displays a pointer according to the coordinate value received by the microcomputer; Including, but the image sensor is to set the X, Y displacement value step by step, multiply the displacement value of the step corresponding to the finger movement speed by a preset multiple to calculate the accelerated coordinate value, and then calculate the calculated coordinate value It characterized in that the pointer is moved through the display unit by transmitting to.

In this case, the light collecting means may be arranged to refract the light reflected from the finger from the vertical direction to the horizontal direction. More specifically, the light collecting means may be configured to reflect the light reflected through the finger in the horizontal direction. And a second waveguide that refracts the waveguide and the image sensor that collects light refracted through the first waveguide.

The light reflected by the light collecting means is calculated as coordinates by the image sensor and transmitted to the microcomputer. The microcomputer includes a displayed scroll area, and when the pointer is located in the scroll area, an icon and a list may be scrolled.

In addition, the microcomputer includes a memory unit and sets a unique data value for each icon and stores the data in the memory unit. When the icon is clicked on the button, the micom recognizes the signal of the button as the coordinate value of the pointer and moves the icon together with the pointer. When the icon is clicked on the button again, the pointer signal can be controlled to receive the signal of the button.

In addition, the displacement value transmitted to the microcomputer multiplies the displacement value by 1 when the captured image displacement value output from the image sensor is less than 20 according to the finger movement speed, and the displacement value by 3 when the captured image displacement value is 20-80. It is possible to multiply by and set all the integers when the captured image displacement value exceeds 80 to the displacement value 255.

Thus, the portable terminal using the optical pointing device includes the following operation steps.

The light emitted from the light emitting means is reflected on the surface of the finger and then transmitted to the image sensor; Calculating the transmitted light as a displacement coordinate value in the image sensor; Determining whether the output displacement value is accelerated according to the movement of the finger, and transmitting data obtained by multiplying the displacement value by a step number to the microcomputer of the mobile terminal; displaying the coordinate value transmitted to the microcomputer of the mobile terminal with a pointer; ; And accelerating and displaying the pointer by the microcomputer so that the moving speed of the surface of the finger transferred to the image sensor corresponds to the set speed range. Characterized in that comprises a.

Wherein the step-by-step speed range is when the displacement value is less than 20, when 20-80, exceeds 80, by multiplying the preset multiple in each case or by defining the speed limit value to display the pointer, the flow of the finger is small Even if it is fast, the movement and control of the pointer can be made smoothly.

Hereinafter, preferred embodiments of the present invention will be described in detail with reference to the accompanying drawings.

1 is a schematic cross-sectional view showing an optical pointing device of a portable terminal according to the present invention, Figure 2a is a block diagram showing the operation principle of the pointer using the optical pointing device of the portable terminal according to the present invention, Figure 2b is an optical 3A and 3B are block diagrams illustrating an acceleration portion of a pointing device, and FIGS. 3A and 3B are diagrams illustrating a process of scrolling a display screen using an optical pointing device of a portable terminal according to the present invention, and FIGS. FIG. 5 is a view illustrating a process of displaying a list list by selecting a menu bar using an optical pointing device of a mobile terminal, and FIG. 5 is a flowchart illustrating a process of pointing content using the optical pointing device of a mobile terminal according to the present invention. to be.

A portable terminal equipped with an optical pointing device according to the present invention includes a light emitting means 10 for emitting illumination and a light collecting means 20 for condensing the light reflected from the light emitting means 10 and the light collecting means 20. The image sensor 30, the light emitting means 10, the light collecting means 20, and a button including the image sensor 30 and the image sensor 30 for photographing the transmitted light and calculating the coordinates, and the information sent from the image sensor 30. It may be provided, including a display unit 50 for displaying the received microcomputer 40 and the information transmitted to the microcomputer 40 on the screen.

In addition, the light emitting means 10, the light collecting means 20, and the image sensor 30 are accommodated in the button having a space formed therein, although not shown in the drawing. A cover 5 is placed on the upper side of the button, and a dome switch for selecting an icon or the like with a pointer is formed on the bottom.

The light emitting means 10 is installed under a cover 5 in which a specific part of the portable terminal, that is, the user's finger surface is in close contact, emits light toward the finger. At this time, the light used as the light emitting means 10 may be used as a small size and excellent radiation of light, such as LED, it is not necessary to use the LED as an illumination.

Light reflected from the surface of the finger is directed to the image sensor 30 through the light collecting means 20. The role of the light collecting means 20 in this process is to refract the light reflected from the surface of the finger in the horizontal direction.

This is because the optical pointing device is installed in a slim state in a confined space when installed in the portable terminal. For this purpose, the light collecting means 20 of the present invention is the first waveguide 22 and the second waveguide 24. It may be made, including.

The first waveguide 22 is installed in the vertical lower direction of the cover 5. The first waveguide 22 has a first inclined surface 22a formed on one side and a convex first lens portion 22b formed on the other side. The inclined surface 22a of the first waveguide 22 maintains a 45 ° inclination angle for refracting the angle of light flowing in the vertical direction in the horizontal direction.

Light refracted through the first inclined surface 22a is collected while passing through the first lens portion 22b and provided to the second waveguide 24.

The second waveguide 24 has the same shape as the first waveguide 22 and is installed facing the first waveguide 22 while being spaced apart from the first waveguide 22 by a predetermined distance.

That is, the second waveguide 24 has a second inclined surface 24a formed on the opposite surface of the second lens portion 24b and the second lens portion 24b facing the first lens portion 22a of the first waveguide. Include.

After the light passes through the first lens portion 24b of the first waveguide, the light passes through the second lens portion 24b of the second waveguide, and becomes a more collected state, and the light in the collected state passes through the second inclined surface 24a. It is supplied to the image sensor 30 through. The image sensor 30 is installed above or below the second waveguide 24 to capture light that is refracted through the second waveguide 24 and flows in 1/1300 to 1/1500 times per second.

The image sensor 30 detects a user's finger movement, speed, and direction through light imaging, and calculates a coordinate value of the pointer based on the detected contents.

The coordinate values calculated by the image sensor 30 are transmitted to the microcomputer 40. The microcomputer 40 causes the transmitted coordinate value signal to appear as a pointer on the display screen.

Accordingly, the user can watch the movement of the pointer displayed on the display screen and move the pointer to the desired position.

However, when the user moves the finger while looking at the display screen, the movement of the finger may be the same speed within a certain range of the movement of the pointer, but if the movement of the finger is very fast, the movement of the pointer may be set faster and farther than the finger. Should be.

To this end, in the image sensor 30 of the present invention, the movement of the finger is set to the displacement value of the multi-stage, and when the finger moves within the set range, the pointer and the finger are set to move at the same speed.

On the contrary, when the finger moves out of the setting range, the pointer is displayed on the display screen by multiplying the set displacement value by a preset multiple.

That is, when the coordinate value calculation of the image sensor 30 is described as an example, the imaging of the light generated by the image sensor 30 compares the movement of a finger with an image by photographing thousands of times per second, and compares the motion of the finger by an image. Will be calculated as the coordinate value.

 When calculating the coordinate value, it is determined in which step the output value in which the X and Y displacement values output from the image sensor 30 are set.

In other words, the image sensor of the present invention calculates how much the movement of the pointer moves per unit time by using the X, Y displacement output value, determines which step the calculated output value is included in, and then multiplies the pointer by multiplying the speed multiple set in the included step. Can be accelerated while moving in the desired direction.

The acceleration stage of the present invention is largely set in three stages, and when the acceleration is required, the displacement value is multiplied by the set multiple according to the corresponding stage.

In addition, the predetermined displacement value is transmitted to the microcomputer 40 so as to appear through the display unit 50.

That is, the X and Y displacement values are shown while the image movement (finger movement direction) moves in one of the negative direction (-) and the positive direction (+). It contains the sign of. The X value may be negative and the Y value may be positive, or the X and Y values may have opposite signs.

Therefore, when the output value from the image sensor according to the movement of the finger is multiplied by a multiple belonging to the set step, the pointer can be moved more quickly and in the same direction as the movement direction of the finger.

For each step, multiple finger movements and pointer movements were applied 1: 1 when the X and Y displacements were less than 20. That is, if the displacement value is less than 20, it is determined that the acceleration is not required, and the movement of the finger and the movement of the pointer are set equally.

In addition, when the displacement value is 20-80, the pointer moves by multiplying the pointer movement speed by three times.

In addition, when the displacement value is more than 81, the pointer can be moved the fastest by setting the displacement larger than 3 times, that is, the displacement larger than 240 to 255. Here, the displacement value 255 is a limit value of the pointer speed.

In more detail, for example, when the X-axis displacement value is -5 and the Y-axis displacement value is 21 days, the movement of the pointer through the displacement values of the X-axis and the Y-axis moves on the upper left side of the screen.

The image sensor moves in the same speed and direction as the movement of the finger to the left on the screen because the displacement value of X corresponds to less than 20 of each step.

However, since the displacement value of the Y axis is 21 and is located between 20 and 80, it is recognized that acceleration is required, and the triplex is multiplied by the Y axis displacement value and is output as the Y axis displacement value.

Therefore, the displacement values of X and Y are actually output as -5 and 63 from the image sensor and transmitted to the microcomputer. Accordingly, the pointer appears to move quickly in the Y-axis direction as the finger moves.

As another example, when the finger movement is a displacement value of 100 on the X axis and a displacement value of 30 on the Y axis, the movement direction of the pointer displayed on the screen is upward.

Since the X-axis displacement value exceeds 80 of the set steps, apply the pointer movement limit value to 255, and the Y-axis displacement value is 20-80 of the set steps, so that the Y-axis displacement value is multiplied by three times. do.

In this case, the image sensor outputs displacement values of the X and Y axes as 255 and 90. Therefore, as the microcomputer receives the displacement value faster than the actual finger movement, the microcomputer moves the pointer on the display screen quickly.

In addition, the microcomputer 40 of the portable terminal includes a scroll area for quickly selecting and inquiring a text list 70 of various displayed contents.

The scroll area is for scrolling the text list 70 when the pointer is positioned on the upper or lower part of the display screen.

That is, when the pointer is positioned at the upper scroll region, the text list 70 may scroll downward so that lists that did not appear on the display unit 50 may appear on the screen.

By the way, although the moving speed of the scrolled text list 70 may be set in advance, a faster acceleration function may be required because the viewpoint of the moving speed is different for each user who observes the moving speed.

The pointer acceleration function described above has been described so that the pointer can be quickly moved by multiplying any number when the movement of the pointer on the screen exceeds the set value. This acceleration can be applied to speed up the list retrieval due to faster scrolling with the pointer in the scroll zone.

That is, when the position of the pointer is located in the scroll area on the display screen and the user's finger is moved quickly in the cover area, the image sensor 30 calculates the movement of the finger as a coordinate value and transmits it to the microcomputer 40.

Then, the microcomputer 40 determines that the position of the pointer is located in an acceleration area that can no longer be moved on the screen, and thus scrolls the text list 70 faster in the acceleration area instead of moving the pointer.

Meanwhile, in the case of using the optical pointing device of the present invention, although not shown in the drawing, a drag function such as an icon displayed on the display screen is possible.

For the drag function, a unique data value is set for each icon and stored in the memory unit 45. The memory unit 45 is connected to the microcomputer 40 and transmits the coordinate value of the icon to the microcomputer 40 when the icon is clicked, and recognizes the transmitted information in the same manner as the displacement value transmitted from the image sensor 30. Control to move the pointer and icon together.

At this time, the icon is clicked through the connection of the dome switch provided at the bottom of the button.

In addition, when the user clicks the icon again by pressing a button, a signal of the dome switch is transmitted to the microcomputer 40 to release the drag function of the icon, and the icon stops at the spot, and only the pointer is moved to the desired position and direction. Will move.

In other words, the electrical signal transmitted through the dome switch is set in the microcomputer 40 so that the icon moves and is separated with the pointer according to the number of clicks by the user.

This drag function is suitable for dressing avatars or volume up / down of media files.

In addition, when the drag function is used, the drag function made through the mouse on the computer screen can be reproduced in the mobile terminal as it is, and thus the selection and adjustment of the contents can be easily performed, thereby providing convenience in use.

In addition, when the optical pointing device of the present invention is used, the menu 60 selection function and the like displayed on the display screen can be conveniently performed, and the menu 60 selection can be performed by clicking a button to select an electrical signal of the dome switch. The microcomputer 40 is received and made.

As such, the optical pointing device of the present invention can be conveniently clicked and dragged on various icons and the inquiry and confirmation of the text list 70 due to the excellent compatibility of the microcomputer 40 and the display unit 50 of the portable terminal. Therefore, it is possible to greatly improve the utilization of content desired by the user in the Internet environment.

The portable terminal equipped with the optical pointing device of the present invention and the pointing method using the same can freely select and control various contents provided on the display screen using the surface of a finger as a subject, thereby greatly improving the usability of the portable terminal. It can be effective.

In addition, when the optical pointing device of the present invention is installed in the portable terminal, the thickness and size of the optical system can be minimized, and thus the product quality can be increased.

The portable terminal and the pointing method using the optical pointing device according to the embodiment of the present invention have been described above, but the present invention is not limited thereto, and those skilled in the art can of course apply and modify the same.

Claims (8)

In a mobile terminal, Light emitting means for emitting light from the portable terminal to the surface of the user's finger in contact with a specific surface; Condensing means for condensing light reflected from the finger surface; An image sensor for capturing light provided through the light collecting means and detecting a movement, a speed, and a direction of a finger based on the captured information and calculating the coordinates into coordinate values; A microcomputer that receives information calculated using coordinates of the image sensor; A display unit which displays a pointer according to the coordinate value received by the microcomputer; Including but not limited to: The image sensor sets the X, Y displacement value step by step, multiplies the displacement value of the step corresponding to the finger movement speed by a preset multiple to calculate the accelerated coordinate value, and then transmits the calculated coordinate value to the microcomputer for display. Portable terminal equipped with an optical pointing device characterized in that the pointer is moved through the unit. The method of claim 1, The condensing means is a portable terminal provided with an optical pointing device, characterized in that arranged to bend the light reflected from the finger in the horizontal direction in the vertical direction. The method according to claim 1 or 2, The light collecting device includes a first waveguide for reflecting light reflected through a finger in a horizontal direction and a second waveguide for refracting the light refracted through the first waveguide with an image sensor for condensing light. The mobile terminal is provided. The method of claim 1, The microcomputer includes a displayed scroll area, and when the pointer is located in the scroll area, an icon and a list are scrolled. The method of claim 1, The microcomputer includes a memory unit and sets a unique data value for each icon and stores the data in the memory unit. When the icon is clicked on the button, the micom recognizes the signal of the button as the coordinate value of the pointer so that the icon moves with the pointer. And, when the icon is clicked on the button again, receiving the signal of the button to control only the pointer to move. The method of claim 1, The displacement value transmitted to the microcomputer When the image displacement value output from the image sensor is less than 20 according to the finger movement speed, the displacement value is multiplied by 1, When the captured image displacement value is 20-80, the displacement value is multiplied by 3, And all of the constants when the captured image displacement value exceeds 80 are set to a displacement value of 255. A portable terminal having an optical pointing device, characterized in that: The light emitted from the light emitting means is reflected on the surface of the finger and then transferred to the image sensor (S1); Calculating the transmitted light as a displacement coordinate value in the image sensor (S2); Determining whether the output displacement value is accelerated according to the finger movement, and transmitting data obtained by multiplying the displacement value by a multiple of the step number to the microcomputer of the portable terminal (S3); Displaying the coordinate values transmitted to the microcomputer of the portable terminal as a pointer (S4); And Displaying the movement speed of the finger surface transmitted to the image sensor by accelerating the pointer so as to correspond to the set step speed range (S5); Pointing method using an optical pointing device in a portable terminal comprising a. The method of claim 7, wherein The step-by-step speed range is when the displacement value is less than 20, when it is 20-80, when it exceeds 80, and the pointer is displayed through the microcomputer by multiplying the preset multiple in each case or by defining the speed limit value. Pointing method using an optical pointing device in a portable terminal.

Images