KR101598579B1 - User interface and method for providing guidance information - Google Patents

Abstract

A user interface apparatus and a guidance information providing method for providing guidance information are disclosed. The user interface device according to an embodiment of the present invention detects a touch signal to set a coordinate system in which a touch operation is to be performed and sets guide information for guiding the touch operation according to the number of touch points and the type of touch movement on the basis of the set coordinate system Lt; / RTI >

Touch, guide information, guide information, virtual object

Description

[0001] The present invention relates to a user interface apparatus and a guidance information providing method,

One aspect of the present invention relates to a user interface, and more particularly, to a user interface using a touch screen.

2. Description of the Related Art [0002] In recent years, as functions available to terminals such as mobile phones have increased, user interfaces corresponding to corresponding functions, such as menu keys or buttons, have increased. However, due to the increased complexity of the user interface, the user of the terminal may find it difficult to quickly select or set a user interface having a specific function.

Accordingly, for the convenience of the user, an apparatus or method using a touch interface that is out of the physical system has been proposed. The touch interface approach is the simplest way to interact directly with people.

According to one aspect, a user interface device and method for easily, intuitively and precisely controlling coordinate transformation in a two-dimensional or three-dimensional space are proposed.

A user interface device according to one aspect includes a touch recognition unit for sensing a touch signal, a coordinate system determination unit for setting a coordinate system in which a touch operation is to be performed by analyzing the sensed touch signal, And a guide information output unit for providing guide information for guiding the touch operation based on the coordinate system.

According to another aspect of the present invention, there is provided a guidance information providing method comprising: sensing a touch signal; analyzing a sensed touch signal to set a coordinate system in which a touch operation is to be performed; setting a coordinate system set according to the number of touch points of the touch signal, And providing guide information for guiding the touch operation as a basis.

According to an embodiment of the present invention, it is possible to easily, intuitively and precisely control the coordinate transformation in a two-dimensional or three-dimensional space. Especially, it provides intuitive and precise control of 3D manipulation by providing guidance information to a virtual world including a 3D object displayed on a 2D screen. In addition, by recognizing multi-touch input at the same time and providing guidance information, convenient and intuitive coordinate transformation is possible.

Hereinafter, embodiments of the present invention will be described in detail with reference to the accompanying drawings. In the following description of the present invention, a detailed description of known functions and configurations incorporated herein will be omitted when it may make the subject matter of the present invention rather unclear. In addition, the terms described below are defined in consideration of the functions of the present invention, which may vary depending on the intention of the user, the operator, or the custom. Therefore, the definition should be based on the contents throughout this specification.

1 is a configuration diagram of a user interface device 1 according to an embodiment of the present invention. Referring to FIG. 1, a user interface device according to an embodiment includes a touch recognition unit 10, a coordinate system determination unit 20, and a guidance information output unit 30.

According to one embodiment, the user interface device 1 is a terminal having a touch screen. The terminal can be, but not limited to, a cellular phone, a personal digital assistant (PDA), an MP3 player, a portable multimedia player (PMP), navigation, an electronic dictionary,

The user interface device 1 according to an embodiment provides guidance information for guiding a touch operation so that a user can perform coordinate transformation easily, intuitively and precisely through a touch method.

The touch recognition unit 10 of the user interface device 1 senses a touch signal input through the touch screen 2. [ In order to detect a touch signal, the surface of the touch screen 2 may be a display screen such as a liquid crystal display (LCD), and a touch sensor is disposed on the display screen. The touch sensor may be contact or non-contact. For example, the touch sensor may be a pressure touch sensor that senses a pressure that is changed in accordance with a touch of a pointing device for a finger or a finger, and a capacitive touch sensor that senses a capacitance that changes in accordance with a touch. But is not limited to, a non-contact type touch sensor using a camera, an optical sensor, a light blocking, an electric field, a heat sensing, a sound sensing, Furthermore, the touch sensor can have a multi-touch function that recognizes multiple touches at the same time.

On the other hand, the coordinate system determination unit 20 analyzes the touch signal sensed by the touch recognition unit 10 and sets a coordinate system in which the touch operation is to be performed. At this time, the touch recognition unit 10 can set a coordinate system in which the touch operation is to be performed according to the selection target and the touch area. The coordinate system may be a local coordinate system, a world coordinate system, or a view coordinate system. The world coordinate system is a coordinate system that is set with respect to the surrounding environment of the object. The view coordinate system is a coordinate system that shows an object that appears differently according to the viewpoint of the user. The coordinate system determination unit A detailed description of the coordinate setting process of the display unit 20 will be described later with reference to FIG. 3 to FIG. 5F.

The guide information output unit 30 provides guidance information for guiding the touch operation to the touch screen 2 according to the number of touch points of the touch signal and the type of touch movement based on the coordinate system set through the coordinate system determination unit 20 . Details of the guide information providing process of the guide information outputting unit 30 will be described later with reference to FIGS. 6 to 9E.

At this time, the guide information output unit 30 may provide at least one of rectangular coordinate guidance or spherical coordinate guidance to the touch screen 2. The Cartesian coordinate guidance is a coordinate form intersecting at a right angle, and the spherical coordinate guidance is a coordinate form composed of a meridian and a hypocrite.

Furthermore, the user interface device 1 may further include an operation execution unit (not shown). The operation executing unit executes a movement, rotation, or expansion / contraction operation on the object based on the touch signal input from the user based on the guidance information provided through the guide information output unit 30. [

Meanwhile, the user interface device 1 according to an exemplary embodiment may provide guidance information to a virtual world including a three-dimensional object displayed on a two-dimensional screen. The virtual world can display a three-dimensional object through the screen of the user interface device 1, so that the user can feel as if he is in the real world. For example, a certain environment or situation can be created on a computer so that the person using the environment can interact with the surrounding environment.

Here, the object may be an avatar or an object. Particularly, users of virtual reality world can move and communicate through avatar which is graphic icon, and avatar can be displayed on the screen in texture, 2D and 3D form. The virtual world described above can be utilized in a virtual reality game, but the virtual world can be applied not only to a game but also to various other fields.

2 is a flowchart illustrating a guidance information providing method according to an embodiment of the present invention.

Referring to FIG. 2, a user interface device according to an exemplary embodiment senses a touch signal input from a user (S200). Then, the coordinate system in which the touch operation is to be performed is set by analyzing the sensed touch signal (S210). Then, the user interface device provides guidance information for guiding the touch operation based on the set coordinate system according to the touch point position of the touch signal and the touch movement type (S220). Further, the user interface apparatus may further include a step S230 of performing a movement, rotation, or stretching operation.

3 is a flowchart illustrating a method of setting a coordinate system according to an embodiment of the present invention.

Referring to FIG. 3, a user interface device according to an embodiment sets a coordinate system in which a touch operation is performed according to a touch target of a sensed touch signal and a touch area. At this time, the user interface device can recognize the selection target of the touch signal and the touch area using the position information corresponding to the coordinate of the point where the touch is sensed.

First, the user interface device according to an embodiment analyzes the sensed touch signal to determine whether the selection object includes an object (S300). If the selection object is out of the object (S300), the coordinate system is set to the view coordinate system (S310) in which the touch operation is to be performed when the user views the coordinate system. The view coordinate system is a coordinate system for representing an object that looks different depending on the height and direction of the camera when the user views the object through the camera, and can convert the view using the camera's plane movement and rotation conversion method.

If it is determined in operation S300 that the sensed target of the touch signal is an object, the user interface device determines whether the touch region of the touch signal is an object other than the selection signal for selecting the object in operation S320. If the touch area of the touch signal other than the selection signal for selecting the object is within the object (S320), the user interface device sets the coordinate system to the local coordinate system in which the touch operation for the object is to be performed (S330) . The local coordinate system can be used to specify the position, orientation, or transformation of the object (e.g., avatar) of the object. At this time, the touch signal different from the selection signal and the selection signal may be a multi-touch signal which is simultaneously touched by the user.

If the touch area of the touch signal other than the selection signal is out of the object as a result of the determination (S320), the user interface device sets the coordinate system to the world coordinate system in which the touch operation to the surrounding environment of the object is to be performed (World Coordinate system) ). The world coordinate system is a coordinate system that performs a touch operation on the object's surrounding environment and can be useful for locating or using objects relative to each other in the world in which they are located. At this time, the touch signal different from the selection signal and the selection signal may be a multi-touch signal which is simultaneously touched by the user.

4A and 4B are reference views showing a coordinate system set according to an embodiment of the present invention.

Referring to FIGS. 4A and 4B, since the local coordinate system and the world coordinate system are coordinate systems formed around the object, an object selection process is required and is distinguished from the view coordinate system. FIG. 4A shows a local coordinate system, and FIG. 4B shows a world coordinate system. As shown in FIG. 4A, after an object is selected (e.g., a point in FIG. 4A) by a touch from a user, the object is moved through another touch gesture of the user (for example, When a touch is detected in the area, the coordinate system on which the touch operation is to be performed is set to the local coordinate system. On the other hand, as shown in FIG. 4B, after the object is selected (for example, the point of FIG. 4B) by the touch from the user, another touch gesture of the user (for example, If you are outside the object area, set the coordinate system to the world coordinate system.

5A to 5F are reference views for explaining a touch operation execution process according to a coordinate system setting according to an embodiment of the present invention.

Figures 5A and 5B show an embodiment of a view coordinate system. 5A and 5B, when a selection target through a touch operation of a user moves out of an object (a bulletin board or a box in FIG. 5A) and a touch operation different from the selection signal moves upward in a clockwise direction , The user interface device according to an embodiment sets a coordinate system to a view coordinate system corresponding to a view when the user looks at an upper angle.

5C and 5D show an embodiment of the local coordinate system. 5C and 5D, when the touch region of the touch signal different from the selection signal for selecting the object is within the object (box in FIG. 5C) and the touch operation is directed to the right (arrow direction in FIG. 5C) The user interface device according to one embodiment sets the coordinate system to the local coordinate system when the object is rotated to the right.

5E and 5F show an embodiment of the world coordinate system. 5E and 5F, when the touch region of the touch signal other than the selection signal for selecting the object is out of the object (the box in Fig. 5E) and the touch operation is upwardly curved in the clockwise direction ), The user interface device according to one embodiment sets the coordinate system to the corresponding world coordinate system when the environment around the object is rotated upward.

6 is a detailed flowchart illustrating a method for providing guidance information according to an exemplary embodiment of the present invention.

Referring to FIG. 6, the user interface apparatus according to an embodiment analyzes the sensed number of touch points (S600) to determine a touch operation of the user. That is, the user interface device determines that the touch operation is a move operation when the sensed touch point S600 is one (S605).

If there is a plurality of touch points, it is analyzed whether the touch movement is a curve or a straight line (S610). If the touch movement is a curved line, the touch operation is determined as a rotation operation (S615) The touch operation is determined as a scaling operation (S620). The stretching action refers to the action of increasing or decreasing the selection target.

Next, if the touch operation is determined to be a movement operation (S605), a rectangular coordinate guidance is provided (S625). If the touch operation is determined as the rotation operation (S615), the spherical coordinate guidance is provided (S630). If it is determined that the touch operation is a stretching operation (S620), a spherical coordinate guidance is provided (S640) in accordance with whether the stretching operation is balanced (S635) or a balanced stretching operation (S640) (S645). The balanced expansion and contraction operation refers to the case where the expansion and contraction operation is performed in the opposite directions in the same way and the partial expansion and contraction operation refers to the case where the expansion and contraction operation is performed not in the opposite directions.

7A and 7B are reference views for explaining a coordinate guidance according to a movement operation according to an embodiment of the present invention.

7A and 7B, the coordinate guidance according to the movement operation is a coordinate form intersecting at right angles. At this time, the rectangular coordinate guidance may be in the form of a grid of a mesh as shown in FIGS. 8A and 8B. Cartesian coordinate guidance can be used in a two-dimensional or three-dimensional space, but it can also be used in a space of four or more dimensions.

8A and 8B are reference views for explaining coordinate guidance according to a rotation operation according to an embodiment of the present invention.

Referring to FIGS. 8A and 8B, the spherical coordinate guidance is a coordinate system in which points on a three-dimensional space are expressed in the form of latitude or longitude, and may be output as normal (r,?,?). The distance r from the origin may be limited to 0, the angle θ in the z-axis from 0 to π, and the angle φ from the x-axis along the z-axis to values from 0 to 2π. ? is latitude and? is sometimes expressed in longitude. Furthermore, the spherical coordinate guidance can be output as an identification point providing a rotation angle.

9A to 9E are reference views for explaining coordinate guidance according to a scaling operation according to an embodiment of the present invention.

Referring to FIG. 9A, when the object is a fully balanced stretching operation, the user interface device provides the spherical coordinate guidance to the screen. In contrast, referring to FIG. 9B, a rectangular stretching operation provides a rectangular coordinate guidance. Or as shown in Fig. 9C, the user interface device can provide both the Cartesian coordinate guidance and the spherical coordinate guidance on the screen during the stretching operation.

10A to 10E are reference views for explaining a touch operation determining process according to an embodiment of the present invention. 10A to 10E, movement, rotation, and stretching operations are determined according to a touch gesture sensed by a user. The movement operation is performed by a one-point touch operation. For example, as shown in FIG. 10A, an object may be selected and then pulled through a point touch operation from the user.

On the other hand, the rotation operation and the stretching operation are performed by a two-point touch operation. At this time, the stretching and shrinking motion is formed in a linear motion. For example, as shown in Figs. 10B and 10C, when two pointers are placed on an object and one or two points are dragged in a linear direction, it can be determined as a stretching operation. On the other hand, the rotation operation is formed as a movement in the curved direction. For example, FIG. 10D shows a rotation operation around a reference point, and FIG. 10E shows a rotation operation with the centers of two points as reference points. The movement, rotation, and stretching operations described above can be implemented in both 2D and 3D.

The embodiments of the present invention have been described above. It will be understood by those skilled in the art that various changes in form and details may be made therein without departing from the spirit and scope of the invention as defined by the appended claims. Therefore, the disclosed embodiments should be considered in an illustrative rather than a restrictive sense. The scope of the present invention is defined by the appended claims rather than by the foregoing description, and all differences within the scope of equivalents thereof should be construed as being included in the present invention.

1 is a configuration diagram of a user interface device according to an embodiment of the present invention;

FIG. 2 is a flowchart illustrating a guide information providing method according to an embodiment of the present invention;

3 is a flowchart illustrating a method of setting a coordinate system according to an embodiment of the present invention.

4 is a reference diagram showing a coordinate system set in accordance with an embodiment of the present invention;

5A to 5F are views for explaining a touch operation execution process according to a coordinate system setting according to an embodiment of the present invention.

6 is a detailed flowchart illustrating a method for providing guidance information according to an exemplary embodiment of the present invention.

7A and 7B are views for explaining the coordinate guidance according to the movement operation according to the embodiment of the present invention,

8A and 8B are views for explaining coordinate guidance according to a rotation operation according to an embodiment of the present invention;

9A to 9E are reference views for explaining coordinate guidance according to an expansion and contraction operation according to an embodiment of the present invention,

10A to 10E are reference views for explaining a touch operation determining process according to an embodiment of the present invention.

Description of the Related Art

1: User interface device 2: Touch screen

10: Touch recognition unit 20: Coordinate system determination unit

30: Guide information output section

Claims (15)

A touch recognition unit for sensing a touch signal; A coordinate system determination unit for analyzing the sensed touch signal to set a coordinate system in which a touch operation is to be performed; And And a guide information output unit for providing guide information for guiding the touch operation based on the set coordinate system according to the number of touch points of the touch signal and the type of touch movement, The guide information output unit may output, Determines that the touch operation is a movement operation when the touch point is one, If the touch movement is in a curved shape, the touch operation is determined as a rotation operation, Wherein the controller determines that the touch operation is a stretching operation when the touch points are plural and the touch movement is a straight line. The information processing apparatus according to claim 1, A user interface apparatus for providing the guidance information to a virtual world including a three-dimensional object displayed on a two-dimensional screen. The information processing apparatus according to claim 1, Wherein the guiding information is at least one of a rectangular coordinate guidance intersecting at a right angle or a spherical coordinate guidance composed of a meridian and a hypocrisy. delete The information processing apparatus according to claim 3, The spherical coordinate guidance in the case of the rotation operation, the spherical coordinate guidance in the case of a balanced expansion and contraction operation, and the rectangular coordinate guidance in the case of the partial expansion and contraction operation, respectively Providing user interface device. The information processing apparatus according to claim 3, And provides an identification point that provides a rotation angle to the spherical coordinate guidance. The apparatus according to claim 1, And sets the coordinate system according to a touch object and a selection target of the sensed touch signal. 8. The apparatus according to claim 7, If the object of selection of the sensed touch signal is an object and a touch region of a touch signal different from a select signal for selecting the object is within the object, the coordinate system is a local coordinate system, And a touch operation to the surrounding environment of the object is performed when the touch target of the sensed touch signal is an object and the touch region of the touch signal different from the select signal is out of the object, And sets the view coordinate system in which the touch operation is to be performed, when the object of selection of the sensed touch signal is out of the object, to the viewpoint of the user. The method according to claim 1, And an operation executing unit for executing a movement, rotation, or stretching operation with respect to the object in accordance with the touch signal input from the user based on the guide information provided through the guide information output unit. Sensing a touch signal; Analyzing the sensed touch signal to set a coordinate system in which a touch operation is to be performed; And Providing guiding information for guiding the touch operation based on the set coordinate system according to the number of touch points of the touch signal and the type of touch movement, Wherein the step of providing the guide information comprises: Determines that the touch operation is a movement operation when the touch point is one, If the touch movement is in a curved shape, the touch operation is determined as a rotation operation, Determining that the touch operation is a stretching operation when the touch points are plural and the touch movement is a straight line, A spherical coordinate guidance when the determined touch operation is the movement operation, a spherical coordinate guidance when the rotation operation is a balanced operation, a spherical coordinate guidance when the operation is a balanced expansion operation, and a rectangular coordinate guidance when the determined touch operation is the movement operation, Delivery method. 11. The method of claim 10, wherein providing the guide information comprises: A guidance information providing method for providing guidance information to a virtual world including a three-dimensional object displayed on a two-dimensional screen. 11. The method of claim 10, Wherein the rectangular coordinate guidance is a coordinate form intersecting at right angles, and the spherical coordinate guidance is a coordinate form composed of a meridian and a hypocrisy. delete The method of claim 10, wherein the step of setting the coordinate system comprises: And setting the coordinate system according to the touch target and the touch area of the sensed touch signal. 11. The method of claim 10, Further comprising the step of performing a movement, rotation, or stretching operation on the object in accordance with the touch signal input from the user based on the provided guidance information.

Images