KR101371614B1 - User interface for handy terminal - Google Patents

Abstract

The present invention relates to a motion recognition user interface for a portable terminal that can be easily and simply manipulate the input to the terminal by recognizing the motion in the space as well as mounting the bezel portion applied to the portable terminal. .
The motion recognition user interface for a portable terminal according to the present invention uses a rotation of a bezel frame in which a bezel portion designed in a conventional portable terminal in a tablet form is applied, and a sensing means mounted on the bezel frame is a virtual interface space. By providing a sensing area, the user can operate the portable terminal through the user's hand motion taken in the space, can be used as a mounting means of the portable terminal, and can adjust the position of the sensing area that the sensing means can sense. have.

Description

Motion recognition user interface for portable terminals {USER INTERFACE FOR HANDY TERMINAL}

The present invention relates to a motion recognition user interface for a portable terminal. More specifically, the application of the bezel portion applied to the portable terminal in the form of a tablet, which not only mounts the portable terminal but also recognizes the motion in the space and can easily and simply manipulate the input to the terminal. It's about the interface.

Today, with the development of information technology (IT) technology, portable terminals are equipped with many functions such as calling, playing music files, playing video, scheduling, and the Internet.

However, since the portable terminal is manufactured to be small in order to have mobility, there is a limit to having an input / output device that effectively provides the above multi-functions, and the recently emerged tablet-type medium-sized portable terminal or portable computer also has a virtual display on a wide screen. Although an input means such as a keyboard is provided, there are limitations in terms of size and convenience.

In the related art, a touch screen capable of simultaneously inputting and displaying an output on a screen is used. In this case, a touch panel is attached to a screen on which the screen is displayed, and the touch screen may be touched by capacitive or static pressure to operate the input. have.

However, the touch screen is used in direct contact with a finger, etc. on the screen, it is inconvenient to put your hand on the image keyboard displayed on the screen when the portable terminal is mounted, and to look at the screen when the portable terminal is placed on the floor. It's very burdensome to lean over your head and take a long position.

In addition, since the hand placed on the screen covers a part of the screen, it is cumbersome to remove the hand and look at the screen to check the keys or buttons of the keyboard displayed as an image.

In addition, conventionally, a so-called optical keyboard has been introduced to receive an input by providing a frame image of the keyboard on an arbitrary plane out of the limited area of the portable terminal through a laser or the like.

Such an optical keyboard projects a frame image of the keyboard output from the optical device on an arbitrary plane and recognizes an input action of a finger located thereon.

Therefore, using the optical keyboard widely displayed on any plane, it is possible to freely input using all of the fingers as in the conventional computer keyboard.

However, since the optical keyboard is projected on an arbitrary plane, that is, a desk or a hard table, the fingertips cause pain at the fingertips.

In addition, similar to the touch screen, when the user puts his or her hand on the frame image of the optical keyboard, part of the image is hidden and cannot be projected.

Recently, a user interface in a three-dimensional virtual space has been introduced to apply this to the development of computer graphics, virtual reality, and augmented reality technologies.

Here, the three-dimensional virtual space is a three-dimensional space with depth information added in the concept of a two-dimensional plane, and the user interface required for this senses three-dimensional manipulations having six degrees of freedom and interacts with the virtual input device to perform input manipulations.

However, in order to support this, it is inconvenient to carry a separate, expensive and bulky interface means, and even if the motion recognition technology through the camera is used, it is impossible to provide a camera embedded in the current flat terminal at an appropriate orientation angle. Situation.

Therefore, there is a need for an alternative that can provide an interface of a three-dimensional virtual space to a recent portable terminal equipped with a variety of functions and require a more effective interface.

Korean Patent Publication No. 10-2011-0026960

The present invention has been made in view of the above circumstances, and the sensing means for utilizing the bezel area of the conventional portable terminal in the form of a tablet and recognizing the motion in space is provided to adjust the orientation angle so that the front is separated from the portable terminal. An object of the present invention is to provide an operation recognition user interface for a portable terminal capable of performing an intuitive operation on the portable terminal by the two-handed operation of the user.

In order to achieve the above object, the present invention is a pair of bezel frames which are disposed along the longitudinal direction of both sides of the portable terminal and rotate relative to the portable terminal, respectively; And sensing means mounted to the pair of bezel frames, respectively, and electrically connected to the portable terminal.

In addition, the sensing means is mounted to each of the bezel frame between the rotating shaft and one end, characterized in that arranged to have a sensing area in front of the portable terminal.

The apparatus may further include a detent interposed between the bezel frame and the portable terminal to fix relative rotation of each of the pair of bezel frames.

The motion recognition user interface for a portable terminal according to the present invention uses a rotation of a bezel frame in which a bezel portion designed in a conventional portable terminal in a tablet form is applied, and a sensing means mounted on the bezel frame is a virtual interface space. By providing a sensing area, the user can operate the portable terminal through the two-hand operation of the user.

In addition, the bezel frame equipped with the sensing means may be used as a mounting means of the portable terminal, and by adjusting the rotation angle of the bezel frame, it is possible to adjust the position of the sensing area that the sensing means can sense.

In addition, a user may input a keyboard by typing in a virtual interface space as if a user is typing a general keyboard, and further, intuitively check the input status of the keyboard through a virtual hand displayed on the screen.

In addition, the operation operation taken in the virtual interface space can be interpreted in three dimensions to intuitively operate and realistically play games that require three-dimensional manipulation.

1 is a front view showing a conventional portable terminal in the form of a tablet.
2 is a perspective view showing a gesture recognition user interface for a portable terminal according to an embodiment of the present invention.
3 is an exploded perspective view showing a detent related to a gesture recognition user interface for a portable terminal according to an embodiment of the present invention.
4 and 5 is a schematic diagram showing a sensing area for the motion recognition user interface for a portable terminal according to an embodiment of the present invention.
6 is a perspective view showing a motion recognition user interface for a portable terminal according to another embodiment of the present invention.
7 to 11 is a schematic diagram showing a use state of the motion recognition user interface for a portable terminal according to an embodiment of the present invention.
12 to 14 is a conceptual diagram showing a motion recognition user interface according to another embodiment of the present invention.

Hereinafter, the configuration and operation of an operation recognition user interface for a portable terminal according to an embodiment of the present invention will be described in detail.

In the case of a tablet-type portable terminal, which is currently increasing in interest, the reason for the interest is that the size of the portable and dramatically improved screen quality and intuitive and direct responsiveness by touch are the main reasons. Accordingly, when the user is satisfied with the feeling of the operation of holding the portable terminal in the hand and moving the screen around, the inconvenience of halting the attractiveness when inputting a character using the portable terminal is the attractiveness of the portable terminal. Will occur. In other words, the virtual keypad that appears while covering a large part of the wide screen must be operated with the hand obstructing the field of view. In addition, for many tasks, it is necessary to mount the tablet to secure the gaze, and in such an arrangement, input through the hand itself is impossible and a situation in which a separate keyboard is required occurs.

Accordingly, an embodiment of the present invention provides a new type of user interface that can simultaneously solve the mounting problem and the input problem of the portable terminal.

In addition, the gesture recognition user interface for a portable terminal according to an embodiment of the present invention uses a bezel frame 120 (see FIG. 2) applying a portion of the bezel 12 provided in the existing portable terminal 10 as shown in FIG. 1. By mounting the portable terminal at the same time, according to the natural structural arrangement according to the mounting operation, the sensing means 130 (see FIG. 2) can maintain an optimal angle to fully recognize both hands of the user.

Here, the bezel (bezel) refers to the edge portion for fixing the transparent cover such as glass in the watch in a dictionary meaning, such bezel 12 can be found in the conventional portable terminal 10 in the form of a tablet.

That is, the bezel 12 prevents the touch operation on the screen 11 from being inadvertently caused by the finger held in the tablet-type conventional portable terminal 10 having the screen 11 operated by touch. It is an area for That is, when gripping the conventional portable terminal 10 in the form of a tablet, both sides are mainly wrapped by hand, and the bezel 12 becomes a space to be picked up by a finger regardless of the touch manipulation of the screen 11.

Such, the bezel 12 is a design that is felt to be considerably thick, but it is true, but to avoid the interference of the touch screen 11 to the finger, such as the thumb that is gripped in actual use to enable a stable lifting of the terminal, In a tablet-type portable terminal, a mandatory configuration of UX (User eXperience) design is required, and a motion recognition user interface for a portable terminal according to the present invention actively utilizes it.

In particular, it is possible to obtain an angle at which the optimal finger recognition can be obtained when the hands arranged for the manipulation of the tablet-type portable terminal are similar to those for general keyboard input, that is, the familiar arrangement. It can be carried out.

To this end, the gesture recognition user interface for the portable terminal according to the present invention is a pair of bezel frames arranged along the longitudinal direction of both sides of the portable terminal 100 and rotating relative to the portable terminal 100, respectively ( 120, a sensing unit 130 mounted on each of the bezel frames 120 and electrically connected to the portable terminal 100.

Here, the portable terminal 100 is provided with a separate bezel frame 120 does not need the same border space as the conventional bezel 12 (see Fig. 1), and the screen 11 is arranged on both sides of the front is tightly Prepared.

Both side ends of the portable terminal 100 is preferably provided with a rotating shaft 110 for rotatably connecting a pair of bezel frames 120.

However, as described below, when the pair of bezel frames 120 are provided in a separate case 160 (refer to FIG. 5) from which the portable terminal 100 is detached, the rotation shaft 110 is omitted from the portable terminal 100. Of course.

Next, the pair of bezel frames 120 is preferably of a similar size and shape in order to maintain the grip provided by the bezel 12 included in the conventional portable terminal 10 (see FIG. 1) in tablet form. Prepared.

To this end, the bezel frame 120 extends in the same length as the longitudinal length of the portable terminal 100 and takes the same shape as both ends of the portable terminal 100.

As a result, the bezel frame 120 can be folded to coincide with both ends of the portable terminal 100 and provide an area where the portable terminal 100 can be easily gripped so that the conventional portable terminal 10 in tablet form (see FIG. 1). ) To achieve the same grip.

In addition, the bezel frame 120 may be provided so that the length in the longitudinal direction is adjusted.

At this time, preferably between the bezel frame 120 and the rotating shaft 110 further includes a detent 140 for fixing the relative rotation of the bezel frame 120 with respect to the portable terminal 100 separately.

Here, the detent 140 is preferably placed on the rotary shaft 110 between the portable terminal 100 and the bezel frame 120 as shown in FIG. , 143, and the first detent 141 is fixed to the bezel frame 120, and the second detent 143 is fixed to the side end of the portable terminal 100.

At this time, the first detent 141 is fixed to the bezel frame 120 to be pushed toward the portable terminal 100 by the elasticity of the spring 150, so that the first and second detents 141, 143 are engaged with the surface of the tooth The opposite rotations of each other are fixed separately.

As a result, the bezel frame 120 which rotates relative to the portable terminal 100 is also fixedly rotated.

Accordingly, the bezel frame 120 may be fixed to rotate at various angles to set the portable terminal 100 at a desired angle and adjust a sensing area described later of the sensing means 130 to a predetermined position.

The motion recognition user interface for a portable terminal according to the present invention uses an image-based 3D interface system that recognizes operations performed in a three-dimensional space as six-dimensional coordinates and intuitively manipulates the GUI of the terminal. The sensing means 130 may preferably be a 3D camera.

In addition, the sensing means 130 may include an infrared camera that distinguishes both hands and other objects of the user disposed in the sensing area and detects the actual movement only with respect to both hands of the user for manipulation, and may also include a projection display device. Can be.

In this case, the projection display device refers to a projector in other words, and may use a pico projector 131 (see FIG. 11) that has been developed in a very small size and mounted as an image projection device in a mobile phone, a notebook computer, a PMP, and the like.

Accordingly, by forming a separate display area outside the screen 11 and recognizing user's hand gestures, the UI can be further expanded and provide various UIs.

The sensing means 130 is mounted between the rotary shaft 110 and one end of each of the pair of bezel frames 120 and is disposed to have a sensing area toward the front of the portable terminal 100.

That is, as shown in FIGS. 4 and 5, the sensing means 130 mounted on each bezel frame 120 faces the front side of the portable terminal 100 and the photographing area is spaced apart from the portable terminal 100 at predetermined intervals. Form a sensing area that can detect a three-dimensional motion in any one of the spaces.

Such a sensing area becomes a kind of virtual interface space, and the hand operation and the like, which are taken here, are regarded as the operation operation, and the actual operation on the portable terminal 100 is performed. As a result, since the operation is performed in a predetermined sensing area spaced apart from the portable terminal 100, the screen 11 of the portable terminal 100 is not covered.

In addition, unlike the fixed camera installed in the conventional portable terminal, the sensing means 130 can take a position that is easy for the user to operate by adjusting the position of the sensing area by the position adjustment by the rotation of the bezel frame 120. A constant sensing area may be provided regardless of the mounting angle of (100).

Unlike the embodiments described so far, the gesture recognition user interface for the portable terminal according to the present invention is possible in another embodiment as shown in FIG.

That is, the portable terminal 100 can be attached to and detached from the case 160 having the rotation shaft 110 at both sides, and the bezel frame 120 is connected to the case 160 relative to the rotation via the rotation shaft 110.

In addition, a connection terminal 170 is provided at an inner lower end of the case 160 to couple with the input / output terminal 17 of the portable terminal 100 and electrically connect the sensing means 130 and the portable terminal 100.

Such a motion recognition user interface for a portable terminal according to the present invention can be utilized as follows.

As shown in FIG. 7, a virtual hand 20 is displayed on the screen 11 of the portable terminal 100 to match the two-hand operation of the user typing in the sensing area on the image keyboard 13 to intuitively display the input state of the keyboard. You can check it.

That is, since the movement of the finger can be projected on the screen, continuous and smooth keyboard work is possible without the user having to see his or her own hand.

In addition, the displayed image keyboard 13 is for showing only the state of the input, and may be expressed in a small size unlike the keyboard on the existing touch screen for receiving the input. Therefore, it can be expressed while occupying at least the screen 11 of the portable terminal 100.

In addition, typing can be performed in the space, so that no pain occurs at the tip of the finger, and the keyboard can be easily entered using all the fingers as if the actual keyboard is hit.

In addition, when viewing a book using an e-Book as shown in FIG. 8, an operation of turning over the bookshelf 15 displayed on the screen 11 of the portable terminal 100 may be intuitively performed as an operation operation in a space.

In addition, when playing a cubic or car game as shown in FIGS. 9 and 10, the cubic 17 to the steering wheel 19 of the car may be intuitively used by the virtual hand 20 displayed on the screen 11 corresponding to the motion of the hand in space. I can operate it and can enjoy a more realistic game.

In addition, as illustrated in FIG. 11, various manipulations may be performed through another manipulation image 133 projected from the pico projector 131 separately from the screen 11.

In addition, it can be seen that the configuration of the bezel frame may be configured only on one side of the portable terminal, as shown in FIGS. 12 to 14.

FIG. 11 illustrates a case in which the bezel frame 210 is configured at one side and a lower end of the body 200 shown in the example in which the bezel frame is configured on only one side. The bezel frame 210 is composed of a rotating body and a support extending to the lower end. The illustrated body 200 may be the portable terminal described above, or may be an accessory type detachable frame (case, cover, dedicated frame, etc.) on which the portable terminal can be mounted.

The detent described above may be configured between the bezel frame 210 and the body 200. Sensing means may also be configured on the bezel frame 210 to read a user's movement through image analysis. Can provide. When the body 200 is a detachable frame to which the portable terminal can be mounted, a universal interface connected to the portable terminal for supplying power to the sensing means of the bezel frame 210 and receiving an image signal may be further provided. Of course.

12 and 13 illustrate an example in which the bezel frame 210 can be moved to support the body 200. In addition to the illustrated configuration, the lower support portion of the bezel frame 210 can be made thinner or narrower or wired. It is possible to modify the configuration, such as, it may be configured similar support to the upper end instead of the lower end. Through this configuration, the support and stable sensing of the stable body 200 is possible. In particular, due to the recent development of the wide-angle sensing means or the directivity control technology of the sensing means, it is possible to fully utilize the user interface even if a single sensing means is used, and if necessary, by configuring a plurality of sensing means Three-dimensional recognition can also be expected.

Meanwhile, the movement of the bezel frame 210 may be used as a kind of switch. In this case, the bezel frame 210 is automatically driven when the bezel frame 210 is changed from the state of FIG. 11 to the state of FIG. You can let it stop. For example, when the bezel frame 210 is rotated, the sensing means (for example, a camera) is in a state of waiting for user input, and when the bezel frame 210 is returned to its original state, the operation of the sensing means is stopped and the input standby state is released. Can be.

Although the above-mentioned portable terminal has been described based on the tablet, it can be extended to various types of portable terminals.

The above description is only a preferred embodiment of the present invention, and there may be various modifications. However, if these modifications are included in the technical spirit of the present invention will be within the scope of the present invention, the scope of the present invention can be easily understood by those skilled in the art through the following claims.

10: conventional portable terminal 11: screen
12: Bezel 13: Image Keyboard
15: Bookshelf 17: I / O terminal
18: cubic 19: handle
20: virtual hand 100: portable terminal
110: rotation axis 120: bezel frame
130: sensing means 131: pico projector
140: detent 141: first detent
143: second detent 150: spring
160: case 170: connection terminal
200: body 210: single bezel

Claims (3)

A body which is disposed in a longitudinal direction on one side of the portable terminal or one side of the body on which the portable terminal is mounted and rotated and fixed based on a point of the portable terminal or the body on which the portable terminal is mounted; A bezel frame having a support portion in which the body extends upward or downward; And
A sensing means mounted to the bezel frame and electrically connected to the portable terminal;
The sensing unit is mounted between the bezel frame rotation axis and one end and the motion recognition user interface for a portable terminal arranged to have a sensing area in front of the portable terminal.
delete The method according to claim 1,
And a detent interposed between the bezel frame and the portable terminal or the body to fix the relative rotation of the bezel frame.

Images