WO2013157663A1

WO2013157663A1 - Input control method, computer, and program

Info

Publication number: WO2013157663A1
Application number: PCT/JP2013/062153
Authority: WO
Inventors: 太郎諌山
Original assignee: Isayama Taro
Priority date: 2012-04-18
Filing date: 2013-04-18
Publication date: 2013-10-24
Also published as: JP2016006685A; JPWO2013157663A1; JP2019023849A; JP5935081B2

Abstract

An input control method for a computer, for improving the diversity of operational inputs in the computer, characterized by including: a friction input detection step for either directly or indirectly detecting an input resulting from a frictional force of an object that has made contact with a display screen; and a change step for either changing a target data or changing an output mode in accordance with the frictional force-based input detected in the friction input detection step.

Description

INPUT CONTROL METHOD, COMPUTER, AND PROGRAM

The present invention relates to an input control method, a computer, and a program.

In recent years, various forms of computers such as smartphones, lithographic (slab) computers, and handheld devices such as tablet terminals have been developed. These handheld devices often include a touch panel in place of operation buttons, input means such as a mouse and a keyboard, which are provided in a conventional mobile phone, a notebook computer, and the like.

For example, in the apparatus described in Patent Document 1, the touch panel is operated with two fingers to determine the upward direction on the display screen using operations such as image enlargement / reduction and a gravitational acceleration sensor.

Patent No. 4892061

However, in conventional handheld devices, instead of omitting input means such as a mouse, a keyboard, and operation buttons, input operations such as a touch panel are used to supplement the input operation. There was a limit to sex.

The present invention has been made in view of the above, and an object of the present invention is to provide an input control method, a computer, and a program that can increase the diversity of operation inputs in a computer.

In order to achieve such an object, the present invention is an input control method in a computer, wherein a friction input detection step for directly or indirectly detecting an input caused by a friction force of an object in contact with a display screen; And changing the target data or changing the output mode in accordance with the input by the frictional force detected in the friction input detecting step.

The information processing apparatus (computer) according to the present invention includes a friction input detection unit that directly or indirectly detects an input caused by a frictional force of an object that contacts the display screen, and the friction input detection unit that detects the input. And changing means for changing the target data or changing the output mode in accordance with the input by the frictional force.

Further, the present invention is a program for causing a computer to execute a friction input detection step for directly or indirectly detecting an input caused by a friction force of an object touching a display screen, and the friction input detection step. And changing the target data or changing the output mode according to the input by the frictional force detected.

Further, the present invention is a recording medium storing the above program in a computer-readable manner.

According to the present invention, it is possible to provide an input control method, an information processing apparatus, and a program that can increase the variety of operation inputs in a conventional computer.

FIG. 1 is a principle configuration diagram showing a basic principle of an embodiment of the present invention. FIG. 2 is a block diagram showing an example of the configuration of the information processing apparatus 100 to which this exemplary embodiment is applied. FIG. 3 is an example of the configuration of the information processing apparatus 100 as viewed from the side surface of the touch panel 114. FIG. 4 is a diagram illustrating a transition example of the shape of the contact surface with respect to the touch panel 114. FIG. 5 is a diagram illustrating a transition example of the pressure distribution (isobar) on the contact surface with respect to the touch panel 114. FIG. 6 is a flowchart illustrating an example of display information processing of the information processing apparatus 100 according to the present embodiment. FIG. 7 is a diagram illustrating an example of an appearance of the information processing apparatus 100 including a display screen of the touch panel 114 controlled by the display control unit 102a. It is a figure which shows an example of operation and screen transition for demonstrating the display area transition process by the display mode change part 102b. FIG. 9 is a diagram illustrating an example of a display screen at a stage in the middle of the transition of the display area from WINDOW1 to WINDOW2 by the display area transition process. FIG. 10 is a diagram illustrating an example of a display screen at the end stage of the display area transition process. FIG. 11 is a diagram illustrating an example of a display screen updated from the display screen of FIG. 10 by the touch input process of the display control unit 102a. FIG. 12 is a diagram for explaining the meaning of a diagram (circular graph) used for explaining the transition of the frictional force direction in FIGS. 14 and 15. FIG. 13 is a diagram illustrating an example of input based on the transition of the frictional force direction. FIG. 14 is a diagram illustrating an example in which characters are input by transition of the frictional force direction. FIG. 15 is a diagram illustrating an example in which letters and numbers are input by the transition of the frictional force direction.

Hereinafter, embodiments of an input control method, an information processing apparatus, a program, and a recording medium according to the present embodiment of the present invention will be described in detail with reference to the drawings. Note that the present invention is not limited to the embodiments.

[Outline of this embodiment]
In this embodiment, an input control method in a computer, a computer (information processing apparatus) that executes the input control method, a program for executing the input control method, and the program are recorded in a computer-readable manner The present invention relates to a recording medium.

In the present embodiment, the computer directly or indirectly detects the input due to the frictional force of the object touching the display screen. And the computer of this embodiment changes object data or changes an output mode according to the input by the detected frictional force.

Here, the object is an object that can be operated by being brought into contact with a display screen such as a touch panel, and may be, for example, a part of a user's body (such as a hand or a finger), a stylus pen, or the like. Changing the target data means increasing or decreasing the numerical value of the target data, adding characters to the target data (character string, etc.), duplicating (copying) the target data, information associated with the target data ( It is characterized in that the data itself is changed, such as changing link information, storage destination, etc.). On the other hand, changing the output mode is characterized by changing the output mode without changing the data itself, such as operations such as enlargement / reduction of the display screen, increase / decrease in output audio, playback / pause, etc. . However, it is not necessary to categorize strictly whether the target data is changed or the output mode is changed. Both may be performed simultaneously as a unit, or only one process may be performed.

Here, in the computer according to the present embodiment, the direction of the frictional force may be detected directly or indirectly when detecting the input due to the frictional force. In that case, this computer may change object data or an output mode according to the direction of frictional force.

Note that the target data to be changed may be arbitrary predetermined data or data designated by the user. For example, the computer according to the present embodiment further includes position input means (such as a touch panel) for detecting the position where the object touches the display screen, and the display target and display element corresponding to the position detected by the position input means are The data to be changed may be used. Similarly, the output for which the output mode is to be changed may be any predetermined output (audio output or display output), or may be an output designated by the user. For example, the computer according to the present embodiment further includes voice detection means (such as a microphone) for detecting voice, and an output designated by the user by voice (output of a display element for designating a date and time for calling a schedule) The volume of the playback music may be changed or the playback music may be changed. Thus, according to this embodiment, the diversity of operation input can be improved. In particular, in the conventional touch panel, the user needs to input while looking at the display screen, such as the input of the locus based on the position history, but according to the present embodiment, the user can By inputting a physical sense based on the direction of the character, it is possible to perform character input, increase / decrease of the reproduction volume, designation of date and time, etc. without paying attention to the display screen. Details of the present embodiment (hardware configuration, details of processing, etc.) will be described in detail below.

[Embodiment]
Hereinafter, an outline of an embodiment of an input operation similar to a mouse action according to the present invention will be described, and then the configuration, processing, and the like of the present embodiment will be described in detail.

This embodiment generally has the following basic features. Here, FIG. 1 is a principle configuration diagram showing the basic principle of the embodiment of the present invention.

First, as shown in FIG. 1, the computer according to the present embodiment includes display means and position input means for the display means. The user can specify the position of the display means on the display screen via the position input means. By specifying the position on the display screen, the user can specify the display element displayed on the display means. Note that the number of display elements displayed on the display screen is not limited to one, and includes a plurality of elements including a display target such as an icon and a background. In the example of FIG. 1, the display screen includes a display element A and a display element B.

As an example, as shown in FIG. 1, when the user designates a position using a hand or a finger on the display screen, the position input means detects the designated position. In the example of FIG. 1, the position input means is an image pickup means such as a camera and directly detects a user's hand or finger to detect the indicated position. However, the position input means is not limited to this, You may comprise as a touchscreen etc. with a display means. In the example of FIG. 1, the user designates the position using a hand or a finger, but the present invention is not limited to this. The user designates the position using a tool such as a stylus. The position specified by the tool may be detected. In the example of FIG. 1, the display screen is a two-dimensional plane. However, the display screen is not limited thereto, and may be a three-dimensional solid such as a curved surface or a sphere.

The computer according to the present embodiment detects the predetermined frictional force or pressing force directly or indirectly when the position is continuously input via the position input means and when the display means is detected. The change mode with respect to the display element displayed on the display means is different from the case where the display is made. That is, the computer according to the present embodiment changes the change mode of the corresponding display element between when the position is input and when the force such as the frictional force or the pressing force is input. For example, the display element concerning position input and the display element concerning force input are changed in another mode. The change mode may be, for example, enlargement, reduction, movement (including moving to a folder in an upper layer, lower layer, or peer layer of a folder), rotation, and the like.

As an example, the computer according to the present embodiment moves, enlarges, reduces, or moves a display element on the display unit when a predetermined frictional force or pressing force is detected directly or indirectly on the display unit. The step of rotating and the step of holding the display element corresponding to the position input via the position input means at the position of continuous input are executed simultaneously, in parallel, or repeatedly with each other. Further, the computer according to the present embodiment moves the display element relative to the display unit when a predetermined frictional force or pressing force is detected directly or indirectly with respect to the display unit. The display element corresponding to the position input via the position input means is continuously held at the position input continuously.

For example, in the screen example of FIG. 1, if the user uses the hand, finger, stylus pen or the like to indicate the position of the display element A, the computer uses the position input means to display the display element A. While it is continuously input, it keeps holding at the indicated position. That is, when the indicated position moves from the position input start to the position input end, the display element A is moved along the indicated position, and conversely, from the position input start to the position input end. Meanwhile, when the designated position is the same position, the display element A is fixed at the same position according to the designated position. In addition, the computer according to the present embodiment moves each display element relative to the display unit when a predetermined frictional force or pressing force is detected directly or indirectly with respect to the display unit. Let At that time, the display element corresponding to the position continuously input via the position input means is an exception of the relative movement target. That is, in the example of FIG. 1, when the user inputs a predetermined force while indicating the position of the display element A, the computer displays a display element other than the display element A (that is, the display element B) relative to the display means. Move to. In the meantime, the display element A is placed under a position where it is continuously input.

The above is the outline of the present embodiment. According to the present embodiment, the user can simultaneously perform force input in addition to position input to the display means. Therefore, complicated input linked to position input (for example, input similar to mouse action) can be performed. It can be done with a simple input operation. For example, a display element related to position input and a display element not related to position input can be controlled in different changes.

More specifically, in a conventional computer (such as a desktop personal computer) provided with a large-screen display means and a pointing device such as a mouse, a display target is dragged and dropped between the windows while displaying a plurality of windows. It was possible to perform input operations using mouse actions. In recent years, a computer having a relatively small screen display unit and a pointing device such as a touch panel, such as a handheld device, does not have a screen area enough to display a plurality of windows. For this reason, it is conceivable that the screen is changed by continuous position input (flick operation, slide operation, etc.), or an application or a window is switched using a button or a switch. However, in order to perform an operation corresponding to a mouse action such as drag and drop, the above-described operation for switching or screen transition and the display target specifying operation must be performed at the same time, and the operation is complicated. There's a problem. More specifically, the present inventor analyzed the problem as follows.

-In a computer with a relatively large display screen and a mouse, a plurality of windows can be displayed on the display screen, so there is no need to change the display area when dragging and dropping. However, since a computer having a relatively small display screen and a touch panel does not have a display area that can display a plurality of windows in parallel, it is difficult to perform a drag-and-drop operation by sliding the touch panel. Therefore, during the drag and drop operation, it is conceivable to change the display area, switch from the currently displayed window to the non-displayed window, and drop the display target in the former window onto the latter window. However, even in that case, a button (for example, a window changeover switch) for changing the display area is required, and the user must press the button together with an operation for specifying a display target, and the operation is complicated. There is a problem of becoming.

In view of this problem, the inventor of the present application considered that input operations such as screen transition and window switching and input operations for moving display objects such as icons and character strings need to be integrated into one. As a result of intensive studies, the inventor of the present application has found that both can be integrated if configured so that force input can be performed simultaneously with position input in a position input operation such as contact. That is, according to the present invention, the user can freely adjust the input force when designating the position. Therefore, in one input operation, the two of force and position (coordinates) can be selected. Input can be made. For example, while performing operations such as screen transition and window switching by force input on the one hand, operations such as movement of a display target can be performed simultaneously by position input on the other hand.

In the force input, directionality and directionality may be detected, and the computer according to the present embodiment moves and rotates the display element according to the directionality and directionality (for example, right direction). Change to the right and left to rotate to the left), or enlargement / reduction (for example, enlargement to the bottom and reduction to the top).

This completes the description of the outline of the present embodiment of the present invention. In the above description, there has been a case where the display element other than the display element related to the position input is displayed according to a predetermined force input. However, the display element related to the position input is not limited thereto. The display may be changed according to a predetermined force input. For example, on the one hand, operations such as screen transition and window switching may be performed by position input, while on the other hand, operations such as movement of a display target may be performed simultaneously by force input.

[Configuration of Information Processing Apparatus 100]
First, the configuration of the information processing apparatus 100 that is an example of a computer according to the present embodiment will be described. FIG. 2 is a block diagram illustrating an example of a configuration of the information processing apparatus 100 to which the present embodiment is applied, and conceptually illustrates only a portion related to the present embodiment in the configuration.

In FIG. 2, the information processing apparatus 100 is roughly connected to a control unit 102 such as a CPU that controls the entire information processing apparatus 100 and a communication apparatus (not shown) such as a router connected to a communication line or the like. The communication control interface unit 104 to be connected, the input / output control interface unit 108 connected to the detection device 112, the touch panel 114, and the like, and the storage unit 106 for storing various databases and tables are configured. Each unit is communicably connected via an arbitrary communication path.

Various databases and tables (element file 106a, etc.) stored in the storage unit 106 are storage means such as a fixed disk device, and store various programs, tables, files, databases, web pages, etc. used for various processes. .

Among the components of the storage unit 106, the element file 106a is an element data storage unit that stores data that can be displayed as display elements on the display screen. For example, the element file 106a may store data to be displayed such as icons, characters, symbols, graphics, and stereoscopic display objects. The element file 106a may store background data. In the present embodiment, the background is positioned as a lower layer compared to the display target. That is, the display target is displayed in a superimposed manner on the background. In the present embodiment, the display element may constitute one of a plurality of windows. The background may be, for example, a desktop background or may define a window background. Note that the data format of the data serving as the display elements is not limited to image data, character data, or the like, and may be any data format. Further, the result of movement, rotation, enlargement / reduction by the processing of the control unit 102 described later may be reflected in the element file 106a. For example, when the display target A stored in the folder X of the element file 106a is moved to the folder Y by display control, the element file 106a transfers the data of the display target A from the folder X under the control of the control unit 102. Move to folder Y and save.

In FIG. 2, the input / output control interface unit 108 controls the detection device 112 and the touch panel 114. Here, the touch panel 114 includes display means and position input means for inputting a position with respect to the display means. More specifically, the touch panel 114 is input / output means that combines a display device such as a liquid crystal panel and a position input device such as a touch pad. The touch panel 114 may detect a pressure or a change in electrical resistance in order to detect a designated position or region on the display screen. Examples of the touch panel 114 include a resistance film method, a matrix method, A touch panel such as a pressure-sensitive type, an electromagnetic induction type, and a capacitance type may be used. In addition, the touch panel 114 may be a touch panel with a floating touch function that can detect a position both in contact and in non-contact. In this case, the force determination unit 102d described later may determine a predetermined force at the time of contact and may not determine the predetermined force at the time of non-contact. Note that the touch panel 114 is an embodiment in which display means and position input means are integrated, and the display means and position input means according to the present invention are not limited to this, and may have different configurations. As a display means of the touch panel 114, a monitor (including a home television, a touch screen monitor, or the like) can be used.

The detection device 112 is detection means for detecting a force such as a frictional force or a pressing force. The detection device 112 may detect the presence or absence of a predetermined force, or may detect a scalar amount or vector amount of force. In the former case, as an example, the detection device 112 may be configured to be switched on / off depending on the presence or absence of a force equal to or greater than a predetermined value, such as a mechanical switch, and to generate a predetermined electrical signal accordingly. . As an example, in the latter case, the detection device 112 may be configured to generate a current, an electric signal, or the like corresponding to a predetermined force, such as a pressure sensor such as a piezo element.

For example, the detection device 112 may detect a predetermined pressing force when the user presses the display screen of the touch panel 114 in a substantially vertical direction. In addition, the detection device 112 may detect a predetermined frictional force by causing the user to slide with contact friction in a substantially horizontal direction with respect to the display screen of the touch panel 114. Note that the pressing and sliding of the display screen may be configured hapticly so that the user feels a click. For example, the touch panel 114 may be configured to be movable with respect to the main body (housing) of the information processing apparatus 100. For example, the touch panel 114 may be physically configured to be pressed, translated, slid, and rotated. Good (for example, refer to Japanese translations of PCT publication No. 2008-532115). The information processing apparatus 100 may output a click sound from an audio output device (not shown) when a predetermined force is detected.

Note that, as described above, the detection device 112 is not limited to mechanically directly detecting the frictional force or the pressing force, but may indirectly detect the frictional force or the pressing force. For example, the control unit 102, which will be described later, may detect a predetermined frictional force when an area occupied by an input position by touching the touch panel changes from a predetermined shape. Further, when the touch panel 114 is a pressure-sensitive touch panel, the control unit 102 described later may detect a predetermined frictional force when the pressure distribution due to contact with the touch panel changes from the predetermined pressure distribution. In such a case, since the detection device 112 can be replaced by the touch panel 114 and the control unit 102 (force determination unit 102d and the like), the detection device 112 may not be provided as a detection unit individually. The detection device 112 is not limited to detecting the strength of the force due to the contact with the display screen, and may detect the presence or absence of the force due to the contact with the display screen. In this case, the predetermined pressing force or friction force is not detected when there is no contact with the display screen, and the predetermined pressing force or friction force is detected when there is contact with the display screen. You may detect as. When the touch panel 114 is a touch panel with a floating touch function, the touch panel 114 can detect the contact state / non-contact state together with the position on the display screen. It is not necessary to provide it. The detection device 112 may be a fingerprint reader, and may detect a frictional force by detecting a fine twist of the fingerprint pattern that occurs when the fingertip is moved from a previously registered fingerprint pattern. . In the present embodiment, for convenience of explanation, the detection device 112 may be described as detecting force. However, as described above, when the detection device 112 is not individually configured, detection for explanation is provided. The device 112 is assumed to be the touch panel 114 and / or the control unit 102 functioning as detection means.

In addition, as the detection device 112, an ultrasonic or electromagnetic distance measuring device, a proximity sensor, a known force detection device, or the like can be used. Further, in the following embodiments, the detection device 112 may describe an embodiment that can detect the orientation of the frictional force with respect to the display plane. For example, a user physically touches the display screen toward the detection device 112 and physically slides the touch panel 114 upward, downward, rightward, or leftward. You may comprise so that it can do. Here, FIG. 3 is an example of a configuration in which the information processing apparatus 100 is viewed from the side surface of the touch panel 114.

As shown in FIG. 3, as an example of the configuration of the information processing apparatus 100, the touch panel 114 is configured to be physically slidable with respect to the housing. Note that the casing restricts the touch panel 114 to move within a predetermined range. Also, as shown in the figure, a metal spring member is attached between the touch panel 114 and the housing, and the spring force is stable so that it is stable at any one of the three positions P1 / P2 / P3. It is energized. Then, as shown in the upper diagram of FIG. 3, when the user slides the touch panel 114 with the force F enough to overcome the spring peak at the position P2, the user touches the finger on the screen of the touch panel 114. As shown, the position can be switched from the position P2 to the position P1. The detection device 112 is configured to be able to detect any of the three positions P1 / P2 / P3 by a position sensor or the like. Thereby, the detection apparatus 112 can detect the force which the user applied to the touch panel indirectly. In the example of FIG. 3, an example in which only one side surface is presented and the detection device 112 reads a force in one direction has been described. However, the present invention is not limited to this, and may be four directions, top, bottom, left, and right. 360 degrees in all directions or hemispherical orientations including pressing force.

In FIG. 2, the control unit 102 has a control program such as an OS (Operating System), a program defining various processing procedures, and an internal memory for storing necessary data. Information processing for executing various processes is performed. The control unit 102 includes a display control unit 102a, a display mode change unit 102b, a position determination unit 102c, and a force determination unit 102d in terms of functional concept.

Among these, the display control unit 102a is display control means for controlling the display screen including a plurality of display elements to be displayed on the touch panel 114 based on the element data stored in the element file 102a. Here, as shown in FIG. 2, the display control unit 102a includes a display mode changing unit 102b. The element data is not limited to being read by controlling the element file 106a, but may be taken in by downloading from the storage unit (element database or the like) of the external system 200 via the network 300. You may acquire by receiving an electromagnetic wave etc. via the apparatus 118. FIG.

Further, the display mode changing unit 102b is a specific form of changing means for changing the target data or changing the output mode in accordance with the input by the detected frictional force or the like. For example, the display mode changing unit 102b changes the corresponding display element between when the position determining unit 102c determines continuous position input and when the force determining unit 102d detects a predetermined force. It is a display mode change means which controls to change a mode. In the present embodiment, the display mode changing unit 102b moves a display element other than the display element corresponding to the input position determined by the position determining unit 102c when a predetermined force is determined by the force determining unit 102d. (Scrolling, screen transition, etc.), control to be rotated or enlarged / reduced. More specifically, the display mode changing unit 102b displays display elements other than the display elements corresponding to the input positions determined by the position determining unit 102c when the force determining unit 102d determines a force in a predetermined direction. Move, rotate, or enlarge / reduce to correspond to the direction (orientation). Note that the display mode changing unit 102b holds the display elements corresponding to the input positions determined by the position determining unit 102c at the continuously input positions. For example, when the position moves from the position input start to the position input end, the display mode changing unit 102b moves the display element along the designated position. On the other hand, when the position is the same position from the start of position input to the end of position input, the display mode changing unit 102b keeps the display element at the same position according to the indicated position. If there is no display element corresponding to the input position determined by the position determination unit 102c, the display mode changing unit 102b moves, rotates, or enlarges / reduces the entire display element. The display element is not limited to the element being displayed. That is, when it is necessary to display elements outside the display area by changing the display mode such as movement, rotation, enlargement / reduction, etc., these elements are also included in the display elements.

Here, as an example, when the change of the display mode is “move”, the display mode changing unit 102b determines the display element other than the display element corresponding to the input position, and the force determining unit 102d determines the rightward force. Moved to the right when the force is determined, moved to the left when the left force is determined, moved upward when the upward force is determined, and determined to be the downward force. In some cases, it may be moved downward. For the user, the display element at the input position (for example, the display element at the touch point on the touch panel 114) seems to move along the intended direction relative to the other display elements. The movement may be controlled in the opposite direction to the above. That is, the display mode changing unit 102b moves the display elements other than the display element corresponding to the input position to the left when the force determining unit 102d determines the right force, and the left force is determined. In this case, it may be moved to the right, moved downward when an upward force is determined, and moved upward when a downward force is determined. In the above description, the directions are four directions (up, down, left, and right). However, the directions are not limited to this. For example, according to detection of all directions of 360 degrees in the display plane direction by the detection device 112, Movement control may be performed. In addition to the orientation in the display plane direction detected with the frictional force, a spherical vector may be detected from the contact point in combination with the pressing direction (depth direction) with respect to the display screen by the pressing force. . In this case, for example, the information processing apparatus 100 can perform movement control not only in the movement direction of the upper, lower, left, and right two-dimensional planes but also in the three-dimensional direction in conjunction with the depth dimension.

When the display mode change is “enlargement / reduction”, the display mode change unit 102b determines the upward force of the display element other than the display element corresponding to the input position by the force determination unit 102d. In such a case, the image may be displayed in a reduced size, and may be displayed in an enlarged size when a downward force is determined. When the display mode change is “rotation”, the display mode change unit 102b selects a display element other than the display element corresponding to the input position when the force determination unit 102d determines the rightward force. Display control may be performed so as to rotate clockwise, and display control may be performed so as to rotate counterclockwise when a leftward force is determined. Even in the case of rotation, the direction opposite to the above is displayed so that the display element at the input position appears to move along the intended rotation direction relative to the other display elements. The rotation may be controlled.

The position determination unit 102c is a position determination unit that detects a position on the display unit of the touch panel 114, which is input via the position input unit of the touch panel 114. For example, the position determination unit 102 c acquires the coordinates (X, Y) of the contact point on the display screen via the touch panel 114. In this way, the position determination unit 102c acquires the position so that the displayed element and the contact point can be associated with each other. In addition, the position determination unit 102c may detect the position on the display screen using a known touch panel technology.

Further, the force determination unit 102d applies a predetermined force due to contact with the display unit of the touch panel 114 indirectly through the position input unit of the touch panel 114 or directly by an arbitrary detection unit (such as the detection device 112). Further, it is a force determining means for determining. Here, the predetermined force may be a force equal to or greater than a predetermined threshold, and when configured to mechanically switch as shown in FIG. 3 described above, the force (force exceeding the spring peak). It may be. In the latter case, the force determination unit 102d may determine a predetermined force by detecting switching itself. For example, the force determination unit 102d may detect a predetermined frictional force when an area occupied by an input position due to contact with the touch panel 114 changes from a predetermined shape. More specifically, the force determination unit 102d detects a predetermined frictional force when the area occupied by the input position by touching the touch panel 114 changes from the shape of the contact surface of the finger pressed vertically. Also good. Here, FIG. 4 is a diagram illustrating a transition example of the shape of the contact surface with respect to the touch panel 114.

As shown in FIG. 4 <MA-0>, when the user performs a normal slide operation or touch operation with his / her finger, the shape of the area indicated by hatching is assumed. Next, when the user presses back in the direction perpendicular to the display screen (toward the back side of the display screen), as shown in <MA-1>, the entire periphery of the area of the contact surface is expanded. (Note that the dashed area is the initial area). Accordingly, the force determination unit 102d can determine the pressing force F. Further, when the user applies a force in the right direction in the figure using friction with respect to the display screen, the right side of the initial contact area expands as shown in <MA-2>. Accordingly, the force determination unit 102d can determine the frictional force F in the right direction. Further, when the user applies a force to the left side of the drawing using friction with respect to the display screen, the left side of the initial contact surface area is expanded as shown in <MA-3>. Thereby, the force determination unit 102d can determine the frictional force F in the left direction. As an example, the force determination unit 102d determines that a predetermined force has been input when the input force F exceeds a predetermined threshold. The force determination unit 102d is not limited to detecting the force F from the shape transition, and may detect the force F based on the shape itself.

As another example, when the touch panel 114 is a pressure-sensitive touch panel, the force determination unit 102d may detect a predetermined force when the pressure distribution due to contact with the touch panel 114 changes from the predetermined pressure distribution. Good. More specifically, the force determination unit 102d may detect a predetermined force when the pressure distribution due to contact with the touch panel 114 changes from the pressure distribution due to contact with a vertically pressed finger. Here, FIG. 5 is a diagram illustrating a transition example of the pressure distribution (isobar) on the contact surface with respect to the touch panel 114.

As shown in FIG. 5 <MB-0>, when the user performs a normal slide operation or touch operation with his / her finger, the shape of the area indicated by hatching is assumed. Next, when the user presses back in the direction perpendicular to the display screen (toward the back side of the display screen), as shown in <MB-1>, it is relatively uniform over the entire area of the contact surface area. The pressure distribution will spread. Accordingly, the force determination unit 102d can determine the pressing force F. Further, when the user applies a force to the right side of the figure using friction with respect to the display screen, as shown in <MB-2>, the pressure on the right side of the initial contact area increases. Accordingly, the force determination unit 102d can determine the frictional force F in the right direction. Further, when the user applies a force to the left side of the figure using friction with respect to the display screen, as shown in <MB-3>, the pressure on the left side of the area of the initial contact surface increases. Thereby, the force determination unit 102d can determine the frictional force F in the left direction. As an example, the force determination unit 102d determines that a predetermined force has been input when the input force F exceeds a predetermined threshold. The force determination unit 102d is not limited to detecting the force F based on the transition of the pressure distribution, and may detect the force F based on the pressure distribution itself.

In FIG. 2, the communication control interface unit 104 performs communication control between the information processing apparatus 100 and the network 300 (or a communication apparatus such as a router) and communication control between the information processing apparatus 100 and the reception apparatus 118. It is a device that performs. That is, the communication control interface unit 104 has a function of communicating data with other terminals or stations via a communication line (whether wired or wireless). In FIG. 2, the receiving device 118 is a receiving means for receiving radio waves from a broadcasting station or the like, and is, for example, an antenna.

That is, the information processing apparatus 100 may be configured to be communicably connected via the network 300 to an external system 200 that provides an external database related to image data, an external program such as the program according to the present invention, and the like. In addition, the information processing apparatus 100 may be configured to be connected to a broadcasting station or the like that transmits image data or the like via the receiving apparatus 118. The information processing apparatus 100 may be communicably connected to the network 300 via a communication device such as a router and a wired or wireless communication line such as a dedicated line.

Here, in FIG. 2, the network 300 has a function of connecting the information processing apparatus 100 and the external system 200 to each other, such as the Internet.

In FIG. 2, an external system 200 is connected to the information processing apparatus 100 via a network 300, and a website for executing external programs such as an external database and programs related to image data to a user. Has the function to provide.

Here, the external system 200 may be configured as a WEB server, an ASP server, or the like, and its hardware configuration is configured by an information processing apparatus such as a commercially available workstation or a personal computer and its attached devices. May be. Each function of the external system 200 is realized by a CPU, a disk device, a memory device, an input device, an output device, a communication control device, and the like in the hardware configuration of the external system 200 and a program for controlling them.

[Display Information Processing]
Next, an example of display information processing of the information processing apparatus 100 according to the present embodiment configured as described above will be described in detail below with reference to FIG. FIG. 6 is a flowchart illustrating an example of display information processing of the information processing apparatus 100 according to the present embodiment.

In starting the following processing, it is assumed that some display elements are displayed on the touch panel 114 under the control of the display control unit 102a. Here, FIG. 7 is a diagram illustrating an example of the appearance of the information processing apparatus 100 including the display screen of the touch panel 114 under the control of the display control unit 102a. As illustrated in FIG. 7, the information processing apparatus 100 includes a touch panel 114 having a display screen having a rectangular area. As shown in FIG. 7, in this example, the display control unit 102a associates the display element “WINDOW1” of the area indicated by the diagonal line of the rectangle on the display screen with the position on the background, The display element “A”, the display element “B”, and the display element “C” are displayed in a superimposed manner. As an example, the display elements “A”, “B”, and “C” may be characters, symbols, or icons.

As shown in FIG. 6, first, the position determination unit 102c detects contact with the touch panel 114 (step SA-1). In addition, when the position determination part 102c does not detect the contact to the touch panel 114 (step SA-1, NO), it repeatedly performs the said process until a contact is detected.

When contact with touch panel 114 is detected by position determination unit 102c (step SA-1, YES), force determination unit 102d determines whether force F is input to touch panel 114 (step SA-2). ). Here, in the display information processing of this embodiment, the force F means a force equal to or greater than a predetermined threshold input by the user due to friction caused by contact. This does not mean that the force determination unit 102d directly measures the amount of force itself. That is, as described above with reference to FIG. 3, when the touch panel 114 is mechanically configured to move discontinuously with respect to the housing, the force determination unit 102 d reads the position of the touch panel 114 with respect to the housing. Therefore, when the position is moved, it may be assumed that there is a predetermined force F input defined by the configuration.

When the force determination unit 102d determines that the force F with respect to the touch panel 114 has been input (step SA-2, YES), the display mode changing unit 102b of the display control unit 102a changes the display area being displayed on the touch panel 114. Processing is performed (step SA-3). When there is a display element corresponding to the contact position detected by the position determination unit 102c, the display body table changing unit 102b detects and updates the contact detected and updated by the position determination unit 102c during the display area transition process. Continue to hold the display element in position. Here, FIGS. 8 to 10 are a series of diagrams showing an example of operations and screen transitions in time series for explaining the display area transition process by the display mode changing unit 102b.

As shown in FIG. 8, when the user applies force F in the left direction at the contact position on the display element “B”, the display mode changing unit 102 b starts display area transition processing. FIG. 9 is a diagram illustrating an example of a display screen at a stage in the middle of the transition of the display area from WINDOW1 to WINDOW2 by the display area transition process. As shown in FIG. 9, the display mode changing unit 102b displays the display area (background display element “WINDOW1” and display elements “A”, “A”, which are being displayed by the display control unit 102a when the force F is detected. B "," C ") are moved relative to the display screen, and another display element" WINDOW2 "is displayed in conjunction with this movement. At this time, as shown in FIG. 9, the display mode changing unit 102 b determines the position of the display element “B” corresponding to the contact position at the time when the force F is detected during the display area transition process. The contact position determined to be updated by the unit 102d is continuously held. Here, FIG. 10 is a diagram illustrating an example of a display screen at the end stage of the display area transition process.

As shown in FIG. 10, at the stage where the transition from WINDOW1 to WINDOW2 is completed, the display mode changing unit 102b displays the background display element “WINDOW2” after the transition, and the position determination unit 102c determines the update. The display element “B” is superimposed and displayed under the contact position. In the example of FIG. 10, there is no display element that should be superimposed and displayed on the background display element “WINDOW2”. However, the display element is not limited to this, and the display element that is superimposed and displayed (for example, display element “D” or the like). ) May be present.

Returning to the description of FIG. 6, when the input of the force F is continued (step SA-4, YES), the force determination unit 102d continuously performs the display area transition process described above to input the force F. If it is determined that the process has been completed (step SA-4, NO), the display area transition process is terminated, and the process proceeds to the following touch input process.

That is, when the input of the force F is not detected by the force determination unit 102d (step SA-2, NO, or step SA-4, NO), the display control unit 102a is determined to be updated by the position determination unit 102c. The process according to the above (touch input process) is executed. This touch input process may be known information processing that is executed when a touch input (slide operation, tap operation, flick operation) is performed on the touch panel. Here, FIG. 11 is a diagram illustrating an example of a display screen updated from the display screen of FIG. 10 by the touch input process of the display control unit 102a. 11 indicates the locus of the display element “B” moved from the display stage of FIG. 10, and is not displayed on the display screen.

As shown in FIG. 11, when the user finishes inputting the force F, the user can continue to input by touch even when the display area transition process is completed. That is, the user can shift to normal operation of the touch panel while maintaining the contact by loosening the frictional force (force F) generated by the contact while pressing. As shown in FIG. 11, the user can place the display element “B” at a desired position on the WINDOW 2 by performing a slide input on the display element “B” after transitioning to the WINDOW 2. . By performing the above display information processing, it is possible to cause the display element to perform a drag-and-drop-like operation between a plurality of windows from the viewpoint of the user.

This is the end of the description of the example of display information processing of the information processing apparatus 100 in the present embodiment. Note that the above-described processing may be repeatedly executed until an end instruction is issued (step SA-6, NO). As an example, when touch processing is performed (step SA-5), if there is an input of force F, the processing may be returned to the display region transition processing (step SA-3).

In the above-described display information processing example, the example of relatively moving the display area has been described as a change in the display mode. However, the present embodiment is not limited to this, and the display mode such as enlargement / reduction is displayed. A change may be generated. For example, when the display control unit 102a displays a map as a background display element and displays an icon display element as a POI on the map in a superimposed manner, the display mode is displayed while the user touches the POI display element. The change unit 102b may display a relatively small scale map when the force F is applied upward, and may display a relatively large scale map when the force F is applied downward.

Further, in the above-described example, the description has been made on the assumption that the display element corresponding to the contact position is displayed in advance before the contact, but the present invention is not limited to this, and even if the display element is not displayed before the contact, A display element may be displayed with the contact. For example, in the map display example, a display element as a departure point appears by touching an arbitrary point, and a link to that point (destination, etc.) is created by dragging it to another point. May be formed. In other words, this embodiment is not limited to use for moving display elements from one place to another, but may be used for associating one place with another place (for example, forming a link). . For example, depending on the direction of the force F (upward, downward, or left-right direction), moving to an upper layer, lower layer, or peer layer folder is executed, and after the input of the initial folder and the force F is completed. You may associate (link) between the folders of a folder. As described above, according to the present embodiment, the conventional handheld device has solved the problem that it is difficult to perform input and editing work corresponding to a mouse action such as a drag-and-drop operation between windows. Action input can be easily performed without using input means such as a mouse or a keyboard.

(Appendix 1)
In a computer comprising display means and position input means for the display means,
Between the case where position input is continuously performed via the position input means and the case where a predetermined frictional force or pressing force is detected directly or indirectly with respect to the display means, the display Different change modes for the display elements displayed on the means,
A computer characterized by

(Appendix 2)
In the computer according to appendix 1,
When a predetermined frictional force or pressing force is detected directly or indirectly with respect to the display means, the display element in the display means is moved, enlarged, reduced, or rotated, and the position input means Holding the display element corresponding to the position input via the position continuously input,
A computer characterized by

(Appendix 3)
The computer according to

appendix

1 or 2 includes a storage unit and a control unit,
The storage unit
As the display element, a background to be displayed on the display means and a display target to be superimposed on the background are stored in an arbitrary data format,
The controller is
Display control means for controlling the background and the display object to be superimposed and displayed on the display means;
Position determination means for detecting a position on the display means, which is input via the position input means;
Force judging means for judging a predetermined frictional force or pressing force by contact with the display means indirectly through the position input means or directly by any detecting means;
With
The display control means includes
The display object at the position determined by the position determination means is held at a position that is continuously input, and the background is displayed when the frictional force or the pressing force is detected by the force determination means. Moving and displaying relative to the display means;
A computer characterized by

(Appendix 4)
In the computer according to attachment 3,
The display means and the position input means are touch panels,
The force determination means includes
Detecting the predetermined frictional force when the area occupied by the input position by touching the touch panel changes from a predetermined shape;
A computer characterized by

(Appendix 5)
In the computer according to appendix 4,
The predetermined shape is a shape of a contact surface of a finger pressed vertically;
A computer characterized by

(Appendix 6)
In the computer according to attachment 3,
The display means and the position input means are pressure-sensitive touch panels,
The force determination means includes
Detecting the predetermined frictional force when the pressure distribution due to contact with the touch panel changes from the predetermined pressure distribution;
A computer characterized by

(Appendix 7)
In the computer according to appendix 6,
The predetermined pressure distribution is a pressure distribution caused by contact of a vertically pressed finger;
A computer characterized by

(Appendix 8)
In the computer according to attachment 3,
The display means and the position input means are touch panels with a floating touch function,
The force determination means includes
When the contact input to the display means is detected, the predetermined frictional force or pressing force is detected;
A computer characterized by

(Appendix 9)
An information processing method executed in a computer having a display means and a position input means for the display means,
When a predetermined frictional force or pressing force is detected directly or indirectly with respect to the display means, the display element on the display means is moved, enlarged, reduced, or rotated, and the position input means is The display element corresponding to the position input via the display element is held at the position continuously input,
An information processing method characterized by the above.

(Appendix 10)
A program for causing a computer having a display means and a position input means for the display means to execute the program,
When a predetermined frictional force or pressing force is detected directly or indirectly with respect to the display means, the display element on the display means is moved, enlarged, reduced, or rotated, and the position input means is The display element corresponding to the position input via the display element is held at the position continuously input,
A program characterized by

As described above in detail, according to the present embodiment, a computer, an information processing apparatus, a display processing method, and an action input operation that can be easily performed without using an input unit such as a mouse or a keyboard, and A program and a recording medium can be provided.

[Input by transition of friction force direction]
Embodiments of the input method based on changes in the direction of friction force will be described below with reference to FIGS.

Conventionally, various input methods for a touch panel, a touch pad and the like have been developed. For example, various input methods such as flick input, pinch-in input, and pinch-out input have been developed in addition to tap input in which a point on the screen is pressed and released. However, in conventional input methods such as touch panels, there was no input method other than position input to the touch panel surface, such as position input on the touch panel plane, input by transition of the input position (trajectory), or relationship between multiple positions, etc. There was a problem that various inputs could not be performed.

For example, an Apple iPod has a physical ring-shaped wheel configuration and allows a slide operation input in accordance with a physical failure in the horizontal direction of the screen. However, in the method described in Patent Document 1, the displayed virtual There is a demerit that it is difficult for the user to perform an operation while driving or walking while looking at the scroll wheel in accordance with the shape of the scroll wheel.

On touch panels, etc., analog input operations that increase or decrease the volume by sliding on the screen can be easily performed, but tap input is possible because there is no physical obstacle other than in the vertical direction. In addition to this, there is a problem that there is no means for reliably increasing / decreasing the incremented input.

The present embodiment has been made in view of the above, and realizes a reliable operation input that can obtain an operation feeling while using a physical failure in the horizontal direction of the screen even in an operation input to a screen such as a touch panel or a touch pad. It is a main object to provide a computer, an information processing apparatus, a display processing method, and a program that can be used. As for a specific hardware configuration, the information processing apparatus 100 as described above can be used.

Here, FIG. 12 is a diagram for explaining the meaning of a diagram (circular graph) used for explaining the transition of the frictional force direction in FIGS. 14 and 15. In FIG. 12, as illustrated in FIG. 4, the frictional force direction is detected by an example of detecting the frictional force direction based on the transition of the shape of the contact surface with respect to the touch panel 114. The method for detecting the direction of the frictional force is not limited to this.

As shown in FIG. 12, the center of the circle indicates that there is no frictional force direction and that it is d toward the back in the vertical direction (toward the back side of the display screen). Moreover, each direction in the outer periphery of the circle | round | yen of FIG. 12 has shown that the frictional force direction has headed with respect to each direction. Here, FIG. 13 is a diagram illustrating an example of input based on the transition of the frictional force direction. In FIG. 13, the “DAY” column indicates the numerical value of the date, the “HR” column indicates the numerical value at the time of 24 hours a day, and the “MIN.” Column indicates the numerical value for the hour and minute. Indicates.

As illustrated in FIG. 13, when the user moves his / her finger clockwise while pressing a part of the touch panel 114 of the information processing apparatus 100 (“+” direction in the figure), the position of the information processing apparatus 100 The determination unit 102c identifies the display element (the numerical value at the time in the example of the figure) at the position of the touch point on the touch panel 114 as the target data, and the display mode changing unit 102b selects the display element according to the change in the direction of the frictional force. Change it. For example, the display mode changing unit 102b may increment the numerical value by one each time the frictional force direction makes one round clockwise.

On the contrary, as shown in FIG. 13, when the user moves his / her finger counterclockwise (“−” direction in the figure) while pressing a part of the touch panel 114 of the information processing apparatus 100 with the finger. The position determination unit 102c of the information processing device 100 identifies the display element (the numerical value of the hour in the example in the figure) at the position of the touch point on the touch panel 114 as the target data, and the display mode change unit 102b uses the friction as an example. Each time the force direction goes around counterclockwise, the numerical value may be decremented by one. In this way, the date and time can be designated for calling up a schedule or the like.

Other examples of input by transition of friction force direction will be described. Here, FIG. 14 and FIG. 15 are diagrams illustrating an example in which letters and numbers are input by transition of the frictional force direction. The pie chart at the upper left of FIG. 14 is illustrated for reference to the pie chart described in FIG. In the upper left of the other columns, examples of letters and numbers identified by each input according to the transition of the frictional force direction are shown. In the pie chart of FIG. 12, black circles indicate the initial position of the transition of the friction force direction.

As shown in FIG. 14 and FIG. 15, according to the input by the change of the direction of the frictional force, the user can input characters, numbers, figures, etc. without looking at the display screen while having a physical feeling due to friction. Can do.

It should be noted that the input characters, numbers, figures, symbols, etc. are not limited to being used for directly inputting into a character string or the like, but may be used for calling a predetermined algorithm. For example, the position determination unit 102c of the information processing apparatus 100 identifies the display element (the numerical value in the example in the figure) at the position of the touch point on the touch panel 114 as target data, and the control unit 102 such as the display mode changing unit 102b. May copy the target data when “C” is input by input due to the transition of the frictional force direction, and may cut the target data when “X” is input. ”May be pasted, the target data may be pasted.

Thus, according to the present embodiment, it is possible to increase the diversity of operation inputs. In particular, in the conventional touch panel, the user needs to input while looking at the display screen, such as the input of the locus based on the position history, but according to the present embodiment, the user can By inputting a physical sense based on the direction of the character, it is possible to perform character input, increase / decrease of the reproduction volume, designation of date and time, etc. without paying attention to the display screen.

[Appendix 1] (Main claim)
Detection means for detecting the pressure distribution and / or contact area of the operating body pressing on the screen;
Based on the pressure distribution and / or the contact area detected by the detection means, a movement direction determination means for determining a movement direction of the operating body that has moved in a contact state without slipping on the screen;
Function control means for performing function control according to the input, using the movement direction determined by the movement direction determination means as an input,
An information processing apparatus comprising:

[Appendix 2] (Transition shape)
In the information processing apparatus according to attachment 1,
The function control means includes
An information processing apparatus that performs control to realize a function corresponding to a shape when the shape corresponding to the transition of the movement direction determined by the movement direction determination unit is a predetermined shape.

[Appendix 3] (Counter)
In the information processing apparatus according to attachment 1,
The function control means includes
Counting means for incrementing a counter according to the transition of the moving direction determined by the moving direction determining means;
Further comprising
An information processing apparatus that performs function control according to the counter.

[Appendix 4] (Decrement)
In the information processing apparatus according to attachment 3,
The function control means includes
The information processing apparatus, wherein the counter is decremented when the transition of the movement direction determined by the movement direction determination means returns to the previous state.
An information processing apparatus characterized by:

[Appendix 5] (Increment / Decrement)
In the information processing apparatus according to

attachment

3 or 4,
The function control means includes
An information processing apparatus, comprising: incrementing the counter when the movement direction determined by the movement direction determination unit is clockwise, and decrementing the counter when counterclockwise.

[Appendix 6] (Character conversion)
In the information processing apparatus according to attachment 3,
The function control means includes
The displayed information candidate is changed according to the counter counted by the counting means.

[Appendix 7] (Enlargement and reduction)
In the information processing apparatus according to attachment 3,
The function control means includes
An information processing apparatus characterized by changing an enlargement / reduction ratio according to the counter counted by the counting means.

[Appendix 8] (Increase / decrease numerical values)
In the information processing apparatus according to attachment 3,
The function control means includes
An information processing apparatus, wherein a displayed numerical value is increased or decreased according to the counter counted by the counting means.

[Supplementary Note 9] (Transform shape of operating body: 1 round, half circle, rectangle, star)
In the information processing apparatus according to any one of attachments 3 to 4,
The control means includes
When the trajectory of the operating body corresponding to the transition of the moving direction determined by the moving direction determining means is a circular trajectory, it is incremented by one or a half circle, and when the trajectory of the operating body is a figure with a corner, the corner is An information processing apparatus that is incremented each time it is drawn.

This completes the description of the embodiment.

[Other embodiments]
Although the embodiments of the present invention have been described so far, the present invention is not limited to the above-described embodiments, but can be applied to various different embodiments within the scope of the technical idea described in the claims. It may be implemented.

In the above-described embodiment, the cursor changes from the mouse over state to the pressed state by the force of pressing the screen. That is, it may change to a click or drag drop state when it is strong, and may change to a mouse over or cursor movement state when it is weak.

For example, although the case where the information processing apparatus 100 performs processing in a stand-alone form has been described as an example, the information processing apparatus 100 responds to a request from a client terminal (which is a separate casing from the information processing apparatus 100). Processing may be performed, and the processing result may be returned to the client terminal.

In addition, among the processes described in the embodiment, all or part of the processes described as being automatically performed can be manually performed, or the processes described as being performed manually can be performed. All or a part can be automatically performed by a known method.

In addition, unless otherwise specified, the processing procedures, control procedures, specific names, information including registration data for each processing, parameters such as search conditions, screen examples, and database configurations shown in the above documents and drawings Can be changed arbitrarily.

Further, regarding the information processing apparatus 100, each illustrated component is functionally conceptual and does not necessarily need to be physically configured as illustrated.

For example, the processing functions provided in each device of the information processing apparatus 100, in particular, the processing functions performed by the control unit 102, all or any part thereof are interpreted and executed by a CPU (Central Processing Unit) and the CPU. It may be realized by a program to be executed, or may be realized as hardware by wired logic. The program is recorded on a non-transitory computer-readable recording medium including a programmed instruction for causing a computer to execute the method according to the present invention, which will be described later. Can be read. That is, in the storage unit 106 such as a ROM or an HDD (Hard Disk Drive), a computer program for giving instructions to the CPU in cooperation with an OS (Operating System) and performing various processes is recorded. This computer program is executed by being loaded into the RAM, and constitutes a control unit in cooperation with the CPU.

Further, this computer program may be stored in an application program server connected to 100 via an arbitrary 300, and may be downloaded in whole or in part as necessary.

Further, the program according to the present invention may be stored in a computer-readable recording medium, or may be configured as a program product. Here, the “recording medium” may be any memory card, USB memory, SD card, flexible disk, magneto-optical disk, ROM, EPROM, EEPROM, CD-ROM, MO, DVD, Blu-ray Disc, etc. Of “portable physical media”.

In addition, “program” is a data processing method described in an arbitrary language or description method, and may be in any form such as source code or binary code. Note that the “program” is not necessarily limited to a single configuration, but is distributed in the form of a plurality of modules and libraries, or in cooperation with a separate program typified by an OS (Operating System). Including those that achieve the function. Note that a well-known configuration and procedure can be used for a specific configuration for reading a recording medium, a reading procedure, an installation procedure after reading, and the like in each device described in the embodiment. The present invention may be configured as a program product in which a program is recorded on a computer-readable recording medium that is not temporary.

Various databases and the like (element file 106a) stored in the storage unit 106 are storage means such as a memory device such as RAM and ROM, a fixed disk device such as a hard disk, a flexible disk, and an optical disk. Stores various programs, tables, databases, web page files, etc. used for providing sites.

Further, the information processing apparatus 100 may be configured as an information processing apparatus such as a known personal computer or workstation, or may be configured by connecting an arbitrary peripheral device to the information processing apparatus. The information processing apparatus 100 may be realized by installing software (including programs, data, and the like) that causes the information processing apparatus to implement the method of the present invention.

Furthermore, the specific form of the distribution / integration of the devices is not limited to that shown in the figure, and all or a part of them may be functionally or physically in arbitrary units according to various additions or according to functional loads. Can be distributed and integrated. That is, the above-described embodiments may be arbitrarily combined and may be selectively implemented. In the following, other examples of claims according to the present invention will be listed.

(Claim A)
In electronic devices equipped with touch panel displays,
When the frictional force on the touch panel display is detected, the display area being displayed is transitioned, and if there is a display target corresponding to the contact point that generated the frictional force in the display area before the transition, the display screen An electronic apparatus characterized by holding the display object at a display position corresponding to the contact point at the time of transition.

(Claim B)
In a computer equipped with touch panel type input / output means,
It further comprises a friction force detection means capable of detecting a friction force against the surface of the touch panel,
The computer
When the frictional force is detected by the frictional force detecting means, the display content being displayed on the display surface is moved relative to the display surface, and the display content that can be selected at the contact point where the frictional force is generated on the touch panel A computer characterized by maintaining a display object inside as a contact point.

(Claim C)
In electronic devices equipped with touch panel displays,
When the frictional force on the touch panel display is detected, the displayed window is switched to another window, and the display target that can be selected in the window before switching is at the contact point that generated the frictional force. An electronic apparatus, wherein the display object is moved to a display position corresponding to the contact point in the window after switching.

(Claim D)
A display unit, an input unit that receives input of coordinates on the display surface of the display unit, a frictional force detection unit that directly or indirectly detects a frictional force on the display surface of the display unit, a control unit, An electronic device comprising at least
The control unit
When coordinates are input via the input unit and there is a display target corresponding to the coordinates in the display area displayed on the display unit, a display corresponding to the coordinates that are continuously input Display object control means for holding the display object at a position;
Display region transition means for transitioning the display region displayed on the display unit when a predetermined frictional force is detected via the frictional force detection unit;
With
The display object control means is
Continuously holding the display object at a display position corresponding to the coordinates that are continuously input before and after the display area is changed by the display area changing means;
An electronic device characterized by

(Claim E)
A display unit, an input unit that receives input of coordinates on the display surface of the display unit, a frictional force detection unit that directly or indirectly detects a frictional force on the display surface of the display unit, a control unit, An electronic device comprising at least
The control unit
Display target control means for selecting the display target when coordinates are input via the input unit and there is a display target corresponding to the coordinate in the display area displayed on the display unit; ,
Display region transition means for transitioning the display region displayed on the display unit when a predetermined frictional force is detected via the frictional force detection unit;
With
The display object control means is
When the display area is changed by the display area changing means while the display object is selected, the display object is continuously selected before and after the display area transition.
An electronic device characterized by

(Claim F)
In the electronic device described in claim E,
The display object control means is
When the display area is changed by the display area changing means while the display object is selected, the display object is continuously selected before and after the display area transition.
After the transition of the display area, when the coordinates input via the input unit transition, moving the display target being selected relative to the display area according to the transitioned coordinates,
An electronic device characterized by

(Claim G)
In a computer equipped with touch panel type input means and display means,
Furthermore, a detection means for detecting friction on the touch panel directly or indirectly,
The change mode with respect to the display element represented on the display means is different between a case where a slide operation is detected on the touch panel via the input means and a case where the friction is detected via the detection means. Making
A computer characterized by

(Claim H)
An information processing method executed in a computer including an input / output unit in which an input unit and a display unit are integrated, a storage unit, and a control unit,
The storage unit
A background to be displayed on the touch panel and a display target to be superimposed on the background are stored in an arbitrary data format,
Executed in the control unit,
A display control step for controlling the background and the display object to be superimposed and displayed on the touch panel;
A coordinate detection step of detecting coordinates input by touching the touch panel;
A friction detection step for directly or indirectly detecting predetermined friction due to contact with the touch panel;
Including
In the display control step,
The display object corresponding to the coordinates detected in the coordinate detection step is moved with respect to the background according to the change of the coordinates that are continuously input, and the friction is detected in the friction detection step. Moving the background relative to the touch panel in some cases,
An information processing method characterized by the above.

(Claim I)
A touch panel in which an input unit and a display unit are integrated; a storage unit that stores a background to be displayed on the touch panel and a display target to be superimposed on the background in an arbitrary data format; and a control unit; In a program for causing a computer equipped with
In the control unit,
A display control step for controlling the background and the display object to be superimposed and displayed on the touch panel;
A coordinate detection step of detecting coordinates input by touching the touch panel;
A friction detection step for directly or indirectly detecting predetermined friction due to contact with the touch panel;
A program for executing
In the display control step,
The display object corresponding to the coordinates detected in the coordinate detection step is moved with respect to the background according to the change of the coordinates that are continuously input, and the friction is detected in the friction detection step. Moving the background relative to the touch panel in some cases,
A program characterized by

DESCRIPTION OF SYMBOLS 100 Information processing apparatus 102 Control part 102a Display control part 102b Display mode change part 102c Position determination part 102d Force determination part 104 Communication control interface part 106 Storage part 106a Element file 108 Input / output control interface part 112 Detection apparatus 114 Touch panel 200 External system 300 network

Claims

An input control method in a computer,
A friction input detection step for directly or indirectly detecting an input caused by a friction force of an object touching the display screen;
A change step of changing the target data or changing the output mode according to the input by the friction force detected in the friction input detection step;
An input control method comprising:
The input control method according to claim 1,
The friction input detection step
Detecting the direction of the frictional force directly or indirectly;
The changing step includes
The input control method, wherein the target data or the output mode is changed according to the direction of the frictional force.
The input control method according to claim 1 or 2,
A position input step of detecting a position where the object touches the display screen;
The changing step includes
For the display target corresponding to the position detected in the position input step, the display target target data or the display target output mode is selected according to the input of the frictional force detected in the friction input detection step. An input control method characterized by performing a change.
The input control method according to any one of claims 1 to 3,
The changing step includes
As the change of the output mode, changing the display mode of the display screen or changing the voice output mode,
An input control method characterized by the above.
Friction input detection means for directly or indirectly detecting input due to the frictional force of an object that has touched the display screen;
Change means for changing the target data or changing the output mode according to the input by the friction force detected by the friction input detection means;
An information processing apparatus comprising:
The information processing apparatus according to claim 5,
The friction input detection means
Detecting the direction of the frictional force directly or indirectly;
The changing means is
The target data or the output mode is changed according to the direction of the frictional force.
The information processing apparatus according to claim 5 or 6,
A position input means for detecting a position where the object touches the display screen;
The changing means is
For the display object corresponding to the position detected by the position input means, according to the input of the frictional force detected in the friction input detection step, the display target object data or the display object output mode An information processing apparatus characterized by performing a change.
The information processing apparatus according to any one of claims 5 to 7,
The changing means is
As the change of the output mode, changing the display mode of the display screen or changing the voice output mode,
An information processing apparatus characterized by the above.
A program for causing a computer to execute,
A friction input detection step for directly or indirectly detecting an input caused by a friction force of an object touching the display screen;
A change step of changing the target data or changing the output mode according to the input by the friction force detected in the friction input detection step;
A program characterized by having executed.
The program according to claim 9,
The friction input detection step
Detecting the direction of the frictional force directly or indirectly;
The changing step includes
The target data or the output mode is changed according to the direction of the frictional force.
The program according to claim 9 or 10,
A position input step of detecting a position where the object touches the display screen;
The changing step includes
For the display target corresponding to the position detected in the position input step, the display target target data or the display target output mode is selected according to the input of the frictional force detected in the friction input detection step. A program characterized by making changes.
The program according to any one of claims 9 to 11,
The changing step includes
As the change of the output mode, changing the display mode of the display screen or changing the voice output mode,
A program characterized by