JP2012043248A - Operation input device, program and method - Google Patents

Abstract

PROBLEM TO BE SOLVED: To improve operability in image operation input processing.SOLUTION: An operation input device includes: angle detection means for measuring a relative angle between a face without a display surface and a face including a top face of a body part of first display means for outputting a signal according to a touch on the display surface; space control means for showing an image according to the relative angle on a first display part; input detection means for obtaining a movement direction of the touch from a start position and an end position of the touch on the display surface by inputting the signal from the display means; operation control means for determining operation content on the basis of the relative angle and the movement direction; and display control means for generating drawing content on the basis of the operation content and showing the drawing content on the first display means.

Description

  The present invention relates to an operation input device, a program, and a method.

  In recent years, an increasing number of computing devices have a GUI (Graphical User Interface) system capable of touch panel operation. These computing devices can give a more intuitive operational feeling to the user by accepting touch input or flick input on the screen instead of computer operation by buttons or text input. A flick is an operation of sliding a pen or finger that touches the screen slightly.

  For example, Non-Patent Document 1 discloses a display method in which a target information object is moved in a flicked direction by a flick operation starting from an information object displayed on the screen on the premise of touch input. Non-Patent Document 1 discloses cut-and-paste, image storage, and the like by long-pressing information objects such as text and images. Further, Non-Patent Document 1 includes a context menu display method that can select an arbitrary operation for an information object as a user's guide.

  On the other hand, there is provided a computing device having a GUI system that has a device for changing a display method of an information object to be displayed on a screen in conjunction with a movement, an angle, and the like of a housing. For example, Patent Document 1 discloses a display method in an apparatus having two display devices, each of which is connected by a rotatable hinge component. In the invention disclosed in Patent Document 1, the angle of a three-dimensional display (hereinafter, three-dimensional is also referred to as 3D) of an information object displayed in one screen in accordance with the relative angle between two display devices. A display processing device to be changed.

  Patent Document 2 discloses an information processing apparatus that seamlessly displays 3D objects in a virtual three-dimensional space across a plurality of displays. This document discloses that the displayed object is instructed by an operation of sliding the mouse that is in contact with the touch panel included in the display while keeping the mouse in contact.

  As described above, the GUI system having the touch panel device and the 3D display mechanism provides a mechanism for improving the operability and intuitiveness in the operation input from the user and the display output to the user.

JP 2010-3260 JP2009-193471A

iPhone User's Guide http: // manuals. info. apple. com / ja_JP

  When an information object is expressed by the screen display method disclosed in Patent Document 1 above, even if an operation having the same meaning is attempted, the image for the flick input direction intuitively held by the user differs depending on the angle of 3D display. The phenomenon that occurs. FIG. 12 specifically shows this phenomenon. FIGS. 12A and 12B show an example of an operation of “sliding a document upward” at two different 3D display angles. When this operation is performed in (a), the image of the direction of the flick that the user intuitively holds is an arrow 61. However, in the case of (b), the image in the flick direction intuitively held by the user changes from the arrow 61 to the arrow 62.

  Japanese Patent Application Laid-Open No. 2005-228561 discloses the point of moving the position of an object being displayed by a mouse operation, but does not mention a flick operation. Therefore, even the method according to Patent Document 2 cannot solve this problem.

  Further, in the context menu display method by long press shown in Non-Patent Document 1, it may be difficult to distinguish the operation contents depending on the time for which the pointing device is in contact with the touch panel. In this case, the pointing device means a finger or a pen. The operation content refers to “selection”, “display context menu”, and the like. In particular, if the touch time on the touch panel until it is determined to be a long press is set to be short, there is a possibility that an operation that the user touches with the intention of “selection” will be mistaken as “display context menu”.

  As described above, an operation by a touch panel for an information object displayed in 3D may be different from an image of an operation that the user intuitively has. Such a deviation between the actually required operation and the intuition impairs the operability of the touch panel. Therefore, a technique for preventing a decrease in operability is necessary, but this cannot be realized with any of the above technical documents.

  An object of the present invention is to provide an image operation input processing device that solves the problem of improving operability.

  According to the present invention, the angle detection means for measuring the relative angle between the surface without the display surface and the surface including the upper surface of the main body of the first display means for outputting a signal corresponding to the contact with the display surface. Space control means for displaying an image corresponding to the relative angle on the first display unit, and the signal is input from the display means, and from the start position and the end position of the contact to the display surface, Input detection means for acquiring a movement direction, operation control means for determining operation contents based on the relative angle and the movement direction, drawing contents based on the operation contents, and the first display means An operation input device comprising: display control means for displaying on the display. Is obtained.

  According to the present invention, an angle detection process for measuring a relative angle between a surface having no display surface and a surface including the upper surface of the main body of the first display means for outputting a signal corresponding to contact with the display surface. , A space control process for displaying an image corresponding to the relative angle on the first display unit, and the signal is input from the display means, and the contact position is determined from the start position and the end position of the contact on the display surface An input detection process for acquiring a movement direction, an operation control process for determining an operation content based on the relative angle and the movement direction, a drawing content is created based on the operation content, and the first display means An operation input program characterized by causing a computer to execute display control processing to be displayed on the computer is obtained.

  According to the present invention, the first display means for outputting a signal corresponding to the contact with the display surface measures the relative angle formed by the surface without the display surface and the surface including the upper surface of the main body, and the relative angle is measured. According to the first display unit, input the signal from the display means, obtain the moving direction of the contact from the start position and the end position of the contact to the display surface, the relative Based on the angle and the moving direction, an operation content is determined, and an operation input method is provided in which drawing content is created based on the operation content and displayed on the first display means.

  The present invention improves the operability of the display device.

FIG. 1 is a diagram showing an appearance of a terminal device according to the first embodiment of the present invention. FIG. 2 is a block diagram showing a main part configuration of the terminal device according to the first embodiment of the present invention. FIG. 3 is a diagram showing a configuration example of an information object handled in the present invention. FIG. 4 is a diagram showing a display configuration example of the information object in the present invention. FIG. 5 is a flowchart showing the flow of the information object display processing operation according to the hinge angle in the embodiment of the present invention. FIG. 6 is a flowchart showing the flow of the information object display processing operation according to the flick input operation according to the first embodiment of the present invention. FIG. 7 is a diagram showing a relative angle between the main body and the lid in the terminal device of the present invention. FIG. 8 is a diagram showing the concept of various parameters representing the pseudo 3D space calculated by the terminal device of the present invention. FIG. 9 is a diagram showing the concept of the flick input determination process in the present invention. FIG. 10 is a correspondence table for determining processing contents according to the contents of flick input in the present invention. FIG. 11 is a diagram showing an example of a drawing process for flick input according to the present invention. FIG. 12 is a diagram illustrating an image in a flick direction that a user intuitively holds for a 3D image having a depth. FIG. 13 is a block diagram showing a main part configuration of a terminal apparatus according to the second embodiment of the present invention.

(First embodiment)
Next, a first embodiment for carrying out the present invention will be described in detail with reference to the drawings. FIGS. 1A and 1B are views showing the appearance of the operation input device 10 according to the embodiment of the present invention. The operation input device 10 in this embodiment includes a main body 101, a lid 102, a first display device 103, a second display device 104, and a hinge 105. The hinge is also called a hinge. In addition, the mechanism unit that connects the main body unit 101 and the lid unit 102 is not necessarily limited to the hinge, and a deformable metal plate or the like may be used, or the same structure may be used with a material other than metal such as plastic. It may be configured and used.

  The main body 101 is a housing component that comes into contact with the horizontal plane when the operation input device 10 is placed on the horizontal plane. The lid 102 is connected to the main body 101 by a hinge 105 described later, and is a casing component that can rotate 180 degrees starting from the hinge 105 as shown in FIG. The second display device 104 is a screen display component included in the main body unit 101, and can operate software executed in the operation input device 10 by contact with a user's finger or pen. Equipped with functions. The first display device 103 is a screen display component included in the lid 102, and is equipped with a touch panel function in the same manner as the second display device 104. The hinge part 105 is a part that connects the main body part 101 and the lid part 102 and provides a structure that allows these two casing parts to freely rotate from a folded state to a 180 degree opened state.

  FIG. 2 is a functional block diagram showing a software structure of the screen operation input processing device operation input device 10 according to the embodiment of the present invention. The operation input device 10 according to the embodiment of the present invention includes a hinge angle detection unit 201, a pseudo 3D space control unit 202, an operation content control unit 203, and a flick input detection unit 204. In addition to these, the operation input device 10 includes an operation content information storage unit 205, an information object drawing control unit 206, a screen display control unit 207, a first screen device control unit 208, and a second screen device control unit 209. And have.

  The hinge angle detector 201 detects a relative angle formed by the main body 101 and the lid 102 as a signal value from the state of the hinge 105. A method for calculating the relative angle will be described later.

  The pseudo 3D space control unit 202 determines some parameters related to a virtual 3D space using the surface of the main body 101 as a horizontal reference plane based on the signal value obtained from the hinge angle detection unit 201. A specific calculation method will be described later.

  The operation content control unit 203 uses the flick input content that the user has made via the touch panel based on the virtual 3D space parameters obtained from the pseudo 3D space control unit 202 and the flick input information obtained from the flick input detection unit 204 described later. To determine. When the operation content control unit 203 determines the flick input content, it is specified what operation the user is instructing. In this specification, the operation content control unit 203 refers to correspondence table data in the operation content information storage unit 205 described later, and determines an operation instructed by the user.

  The operation content information storage unit 205 stores a correspondence table between the flick input determination result and the operation content for the operation content control unit 203 to determine specific operation content from the determination result of the flick input content. Details of the correspondence table will be described later.

  The information object drawing control unit 206 calculates three-dimensional coordinate data in the pseudo 3D space of the information object to be displayed based on the parameters of the pseudo 3D space obtained from the pseudo 3D space control unit 202. After that, the information object drawing control unit 206 generates drawing data of the information object that is plane-projected to be displayed on each of the first display device 103 and the second display device 104. Furthermore, the information object drawing control unit 206 also generates information object slide movement and context menu image drawing data based on the operation content information obtained from the operation content control unit 203.

  The screen display control unit 207 distributes drawing contents to be output to each of the first display device 103 and the second display device 104 based on the drawing data obtained from the information object drawing control unit 206. . Further, the screen display control unit 207 outputs a display command to a first screen device control unit 208 and a second screen device control unit 209 described later. As shown in FIG. 4, this distribution functions when one information object is displayed across the first display device 103 and the second display device 104.

  The first screen device control unit 208 converts the display command obtained from the screen display control unit 207 into signal data that can be interpreted by the first display device 103.

  Similar to the first screen device control unit 208, the second screen device control unit 209 converts the display command obtained from the screen display control unit 207 into signal data that can be interpreted by the second display device 104.

  FIG. 3 shows an example of an information object displayed by the operation input device 10. The information object 300 is expressed as a collection of sub-objects 301 and 302. In the example of FIG. 3, the sub-object includes a sub-object 301 related to an image and a sub-object 302 related to text.

  FIG. 4 shows an example in which the information object 300 is displayed across the first display device 103 and the second display device 104 which are two display devices of the operation input device 10. When the lid 102 is completely opened with respect to the main body 101 as shown in (a), both display devices display the information object 300 in a form that the user can look down from directly above. On the other hand, as shown in FIG. 4B, when the lid 102 is raised with respect to the main body 101, both display devices display the information object 300 with a depth. .

  Next, the overall operation of the present embodiment will be described in detail with reference to the flowcharts of FIGS. FIG. 5 explains the display control operation of the information object 300 in accordance with the hinge angle. First, this flowchart starts from detecting a relative angle between the main body 101 and the lid 102 (step S101). The relative angle detected here includes the surface of the lid 102 opposite to the surface having the first display device 103 and the display surface of the second display device, as indicated by θ in FIG. The angle formed by the surface. This value is obtained from the hinge angle detection unit 201 based on the physical shape of the hinge unit 105. Next, based on the relative angle θ obtained by the hinge angle detection unit 201, the pseudo 3D space control unit 202 obtains the vanishing point ν and the pseudo Z-axis projection angle Φ as parameters related to the pseudo 3D space ( Step S102).

  The vanishing point is an intersection point of a set of straight lines that are displayed in the perspective obtained by the perspective method used for conversion to 3D display and that are parallel before conversion but no longer parallel after conversion. In other words, the vanishing point here has the same meaning as the vanishing point generally used in the one-point perspective method.

  The pseudo Z axis is an axis representing the depth of the 3D space obtained by the perspective method. If the axis parallel to the horizontal side of the first display device 103 (side where the hinge portion 105 is located) is x, and the axis parallel to the vertical side orthogonal to the horizontal side is y, this pseudo-Z axis is the xy plane. The relative angle between the straight line L projected above and the y-axis is the pseudo Z-axis projection angle Φ. Since the straight line L passes through the vanishing point and the origin, Φ can be calculated from the vanishing point.

  FIG. 8 shows an image of the vanishing point ν and the pseudo Z-axis projection angle Φ. Assuming that the width of the screen is W and the natural numbers given to the device 10 are α and β, the pseudo 3D space control unit 202 obtains the x coordinate ν_x and y coordinate ν_y of ν by the following equations.

ν_x = W / 2
ν_y = α + β ((1 / sin θ) −1)
Based on the above formula, when the lid 102 is completely opened (showing a state where the dotted line in FIG. 7 is fully opened), the value of θ becomes 0, so the value of ν_y becomes infinite. . That is, the coordinate of ν is infinite at the y-axis coordinate, and as a result, the information object 300 displayed on the first display device 103 is displayed as viewed from directly above as shown in FIG.

  On the other hand, since the value of sin θ is 1 when the lid portion 102 is set perpendicular to the main body 101, the value of ν_y is α. As shown in FIG. 8, in this case, the vanishing point ν (W / 2, α) exists in the screen. Further, the pseudo Z-axis projection angle Φ calculated from this vanishing point is arctan (2α / W). That is, the information object 300 expressed in depth by the one-point perspective method is displayed on the first display device 103 at the vanishing point ν (W / 2, α) and the pseudo Z-axis projection angle Φ = arctan (2α / W). The

  Next, using the vanishing point coordinate ν obtained in step S102, the information object drawing control unit 206 calculates drawing data of the information object to be displayed. At this time, the drawing data is calculated by a one-point perspective method using the coordinate ν as a vanishing point (step S103).

The drawing data calculated in step S103 is transferred to the screen display control unit 207 and converted into a display command. At this time, the display command is divided into a command set for the first display device 103 and a command set for the second display device 104 (step S104).
Incidentally, this display instruction can be specifically performed using a machine instruction word that can be understood by a graphic control chip such as GPU (Graphics Processing Unit).

  Finally, this display command is input to the first screen device control unit 208 and the second screen device control unit 209, and the information object corresponding to the relative angle θ is applied to the first display device 103 and the second display device 104. Is displayed and output (step S105).

  FIG. 6 is a flowchart illustrating an operation in the operation input device 10 when a flick input operation is performed on the first display device 103. When the second screen device control unit 209 receives, as an electrical signal, that the user has performed some operation via the touch panel included in the first display device 103, the second screen device control unit 209 converts the electrical signal into touch panel operation information (Step S110). S201).

  Next, the touch panel operation information is passed to the flick input detection unit 204, and it is determined whether the touch panel operation information is a flick input. When it is not a flick input (in the case of No), the flick input detection unit 204 performs another process or ends the process. When it is a flick input (in the case of Yes), the flick input detection part 204 converts into flick input information (step S202). This flick input information includes a flick input start point and a flick direction. These values are expressed as, for example, xy planar two-dimensional coordinates with the first display device 103 as a reference plane and normalized vector data.

  Next, the operation content control unit 203 determines the content of the flick input based on the flick input information converted in step 202 and the pseudo Z-axis projection angle Φ obtained in step S102 (step S203). There are two purposes for determining the flick input in step S203. One is to determine whether or not a flick input is input in a direction perpendicular to the horizontal plane in the pseudo 3D space when a horizontal plane with the main body 101 is a reference horizontal plane. The other is to determine what sub-object is the operation target according to the starting point coordinates of the flick input. When there is one target object, the start point coordinates may be ignored.

  FIG. 9 illustrates information (flick input start point coordinates, flick vector D, relative angle ψ, relative angle Φ with respect to the y-axis) necessary for the flick input determination process. In FIG. 9, flick input information 401 expressed by a bar arrow is an image of flick input. The flick input information 401 has a flick input start point coordinate B (x, y) and a normalized flick direction vector D (x_v, y_v). The operation content control unit 203 uses the flick direction vector D to obtain the relative angle Ψ between the flick input and the y axis.

  The determination that the flick input is input in a direction perpendicular to the pseudo 3D space is made when the relative angle Ψ with the y-axis satisfies the following condition.

−nθ <Ψ <nθ (0 <n <1)
If it is determined by this determination method that an input in a vertical direction starting from a specific sub-object is made, it is determined that the input is a display of a context menu. Then, the operation content corresponding to the target sub-object is allocated between the first display device 103 and the second display device 104 (step S204). The operation content is allocated by the operation content control unit 203 based on the operation content correspondence table indicating the correspondence between the flick input content stored in the operation content information storage unit 205 and the operation content.

  FIG. 10 illustrates this operation content correspondence table. In FIG. 10, when it is determined that the flick input is not in the vertical direction, the slide processing of the information object is allocated, and when it is determined that the flick input is in the vertical direction, it further depends on the type of the sub-object corresponding to the flick start point coordinate B. This is an example of an operation content correspondence table allocated by an operation. In this example, “copy image”, “save image”, and “print image” are allocated in the case of an image object, “text range specification” in the case of a text object, and “ This is an example of assigning “return one level up”.

  When the operation content for the flick input is determined in step S204, it is sent to the information object drawing control unit 206 as operation content information, and a drawing process corresponding to the operation content information is performed (step S205).

  FIG. 11 shows an example of the drawing process performed in step S205. FIG. 11A illustrates a drawing process when the flick input direction is recognized as “vertical” and the start point of the flick input is the sub-object 301 related to this image. In this case, a front-view image 501 of the sub-object related to the image of the sub-object 301 is displayed so as to appear at the tip of the flick direction, and a context menu 502 related to an image indicating an operation related to the sub-object 301 is displayed beside it. Is done.

FIG. 11B illustrates a drawing process when the flick input direction is not vertical, that is, “other than that” is recognized. In this case, the information object 300 slides according to the flick direction. In the example of FIG. 11B, the flick input is regarded as the Z-axis (depth) direction in the pseudo 3D space, and sliding movement in that direction occurs.
As a result of the drawing process in step S205, the information object drawing control unit 206 outputs drawing data. Upon receiving this drawing data, the screen display control unit 207 outputs a display command set to the first screen device control unit 208 and the second screen device control unit 209. In response to this instruction set, the first screen device control unit 208 and the second screen device control unit 209 display information objects on the first display device 103 and the second display device 104, respectively. As a result, the information object 300 is displayed so as to move across the first display device and the second display device.

  The effect of the present embodiment is to improve the operability of the screen operation input process. The reason is that flick input can be performed on the 3D-displayed information object 300 that dynamically changes depending on the angle of the hinge as the flick input operation image intuitively held by the user. Specifically, in the present embodiment, all flicks that are not regarded as vertical are regarded as image movement commands. Therefore, the user can move the desired image by flicking in a direction that is intuitively correct as judged by the display on the screen. This is because the operation content control unit 203 dynamically changes the operation content for the information object 300 determined by the flick input according to the virtual viewpoint coordinates in the pseudo 3D space that changes according to the hinge angle and the content of the flick input. This is possible.

  The second effect of the present embodiment is that a context menu can be displayed for a specific information object without long-pressing the touch panel. The reason is explained below. The pseudo 3D space control unit 202 makes it appear to the user's eyes that the information object is virtually projected on the pseudo 3D display space. As a result, the user can add a new flick input operation that cannot be recognized in the two-dimensional (2D) display space, that is, flick input in the pseudo Z-axis direction. The operation content control unit 203 can allocate a context menu display for this new flick input operation, so that the user does not need a long press operation.

  Note that the information object 300 in this embodiment is expressed as an aggregate of the sub-objects 301 and 302, but may be an aggregate of three or more sub-objects.

  In the present embodiment, the drawing contents are distributed to both the first display device 103 and the second display device 104. However, it is not always necessary to distribute the drawing contents. Good.

In this embodiment, in order to determine whether or not a flick input is input in a vertical direction in the pseudo 3D space, the operation content control unit 203 determines that −nθ <Ψ <nθ (0 <n Although the condition <1) is used, it is not always necessary. The operation content control unit 203 may use a stricter condition 0 <n <0.5 or may use a more lenient condition 0 <n <2. In addition, when the difference between the angle formed by the flick direction and the y-axis and the pseudo Z-axis projection angle Φ is 0.1XΦ or less, the operation content control unit 203 is assumed to be parallel to the pseudo Z-axis. The parallelism with the pseudo Z axis may be determined.
(Second Embodiment)
In the second embodiment of the present invention, as shown in FIG. 13, the first display means for outputting a signal corresponding to the contact with the display surface, the surface having no display surface and the surface including the upper surface of the main body unit, A hinge angle detection unit 201 that measures a relative angle formed by; a pseudo 3D space control unit 202 that displays an image corresponding to the relative angle on the first display unit; and the signal input from the display unit, A flick input detection unit 204 that acquires a moving direction of the contact from a start position and an end position of the contact with the display surface, and an operation content control unit 203 that determines an operation content based on the relative angle and the moving direction. And a screen display control unit 207 for creating drawing contents based on the operation contents and displaying the drawing contents on the first display means.

  The effect of the second embodiment is to improve the operability of the screen operation input process. The reason is that flick input can be performed on the information object displayed in 3D that dynamically changes depending on the angle of the hinge, as the image of the flick input operation intuitively held by the user. This is because the operation content control unit 203 dynamically changes the operation content for the information object determined by the flick input according to the virtual viewpoint coordinates in the pseudo 3D space that changes according to the hinge angle and the content of the flick input. Is possible.

  Although the present invention has been described with reference to the first and second embodiments, the present invention is not limited to the above embodiments. Various changes that can be understood by those skilled in the art can be made to the configuration and details of the present invention within the scope of the present invention.

  The present invention can be applied to the use of a mobile terminal device having a foldable touch panel type screen device.

DESCRIPTION OF SYMBOLS 10 Operation input apparatus 101 Main body part 102 Cover part 103 1st display device 104 2nd display device 105 Hinge part 201 Hinge angle detection part 202 Pseudo 3D space control part 203 Operation content control part 204 Flick input detection part 205 Operation content Information storage unit 206 Information object drawing control unit 207 Screen display control unit 208 First screen device control unit 209 Second screen device control unit 300 Information object 301 Sub-object related to image 302 Sub-object related to text 401 Flick input information 501 Front-view image of sub-object 502 Context menu related to image 61 Arrow 62 Arrow

Claims (10)

Angle detection means for measuring a relative angle between a surface having no display surface and a surface including the upper surface of the main body, of the first display means for outputting a signal corresponding to contact with the display surface;
Space control means for displaying an image corresponding to the relative angle on the first display unit;
Input detection means for inputting the signal from the display means, and obtaining a moving direction of the contact from a start position and an end position of the contact with the display surface;
Operation control means for determining operation content based on the relative angle and the moving direction;
Display control means for creating drawing contents based on the operation contents and displaying the drawing contents on the first display means;
An operation input device comprising:   The space control means calculates a projection angle that increases / decreases according to the increase / decrease of the relative angle, and displays an object in a three-dimensional space with the vertical axis of the first display means as the height axis and the horizontal axis as the width axis. 2. The operation input according to claim 1, wherein the pseudo input is converted into a pseudo three-dimensional space image having a depth axis as a pseudo axis forming the projection angle in an inner direction of the first screen with respect to the vertical axis. apparatus.   The operation control means moves in the depth axis direction in the three-dimensional space when an angle formed by the moving direction and the extension direction of the pseudo axis is equal to or less than a tolerance calculated according to the relative angle. The same first operation content as that in the case where is input is selected, and if the angle formed is larger than the predetermined allowable value, the same second operation as in the case where the movement in the height axis direction is input in the three-dimensional space. 3. The operation input device according to claim 2, wherein an operation content is selected. The main body includes a second display unit on an upper surface,
The operation control means selects, as the first operation content, an operation of translating the object in the pseudo three-dimensional space in the pseudo axis direction,
The operation input device according to claim 3, wherein the display control unit moves the object across the first and second display units.   The operation input device according to claim 3 or 4, wherein the operation control means selects a context menu display of the object as the second operation content. An angle detection process for measuring a relative angle between a surface having no display surface and a surface including the upper surface of the main body of the first display means for outputting a signal corresponding to contact with the display surface;
A space control process for displaying an image corresponding to the relative angle on the first display unit;
An input detection process for inputting the signal and obtaining a moving direction of the contact from a start position and an end position of the contact with the display surface;
An operation control process for determining an operation content based on the relative angle and the moving direction;
A display control process for creating drawing content based on the operation content and displaying the drawing content on the first display means;
An operation input program for causing a computer to execute.   A projection angle that increases or decreases in accordance with the increase or decrease of the relative angle is calculated, and an object in a three-dimensional space is defined with respect to the vertical axis of the first display means, the horizontal axis as the horizontal axis, and the vertical axis. The computer is configured to cause the computer to execute the spatial control process of converting and displaying a pseudo three-dimensional spatial image having a pseudo axis that forms the projection angle in the inner direction of the first screen as a depth axis. 6. Operation input program.   When an angle between the moving direction and the extension direction of the pseudo axis is equal to or less than an allowable value calculated according to the relative angle, a motion in the depth axis direction is input in the three-dimensional space; When the same first operation content is selected and the angle formed is larger than the allowable value calculated according to the relative angle, the same second as when the motion in the height axis direction is input in the three-dimensional space. The operation input program according to claim 7, wherein the operation control process for selecting the operation content is executed by a computer. Measuring a relative angle between a surface having no display surface and a surface including the upper surface of the main body of the first display means for outputting a signal corresponding to contact with the display surface;
Displaying an image corresponding to the relative angle on the first display unit;
Input the signal from the display means, obtain the moving direction of the contact from the start position and the end position of the contact to the display surface,
Based on the relative angle and the movement direction, determine the operation content,
An operation input method characterized in that a drawing content is created based on the operation content and displayed on the first display means.   When an image corresponding to the relative angle is displayed on the first display unit, a projection angle that increases or decreases according to the increase or decrease of the relative angle is calculated, and an object in a three-dimensional space is displayed on the first display. The vertical axis of the means is converted into a pseudo three-dimensional space image in which the vertical axis is the height axis, the horizontal axis is the width axis, and the pseudo axis that forms the projection angle in the inner direction of the first screen with respect to the vertical axis. The operation input method according to claim 9, wherein the operation input method is displayed.

Images