JP5661056B2 - Information processing apparatus and program - Google Patents

Description

  The present invention relates to an information processing apparatus and a program for displaying various types of information on a display screen, and in particular, a technique for enabling the position of display information displayed on the display screen to be indicated by a touch operation (touch operation). About.

  There are various technologies in which a display item displayed at the touch position can be selected by touching a display screen with a finger instead of a pen. In this technique, when the display screen is touched with a finger, the display position and the touch position are often shifted as compared with the case of touching with a pen. Therefore, there are various technologies that detect such a shift and perform automatic adjustment (see, for example, Patent Document 1).

  Such a shift detection technique is effective when the size of the display target (link destination or icon) that the user wants to touch is large to some extent and the target is clear.

JP 2005-196248 A

  However, a full browser screen (screen displayed on a web browser of a personal computer (hereinafter referred to as a PC)) is reduced and displayed on a display screen of a mobile phone (currently about 3 inches at most). In many cases, multiple link destination character strings are displayed at a position hidden by a finger, and the user tried to touch the link destination, but touched another link destination next to it, and that There is a high possibility of jumping to the landing page.

  Then, the user who notices that he jumped to another link destination performs an operation to return to the previous page, performs a touch operation again, and this time carefully (do not use a finger) If the operation is difficult, take out the pen, etc.).

  However, even if careful re-operation is performed, unless the user performs a setting operation that causes the terminal device to properly learn that such misalignment has occurred, the next link destination will be displayed on a different display screen. When a touch operation is performed, there is a high possibility that the same misalignment will occur, which gives stress to the user.

  The present invention has been made in view of such circumstances, and it is an object of the present invention to enable an appropriate instruction to be made without making a mistake with a display selection item even when the display selection item to be an operation instruction target is small.

The invention according to claim 1 of the present invention is an information processing apparatus that displays various types of information on a display screen, and detects a position indicated by contact on the display screen, which is a first operation by a user. Means, selection means for selecting a display selection item displayed at the position indicated by the detected indication position, display means for displaying information specified by the display selection item selected by the selection means, When the second operation by the user after the information designated by the display selection item is displayed by the display means is an operation to display the previous screen, the display selection item selected by the selection means is the user's desired A discriminating unit for discriminating that it is not the correct selection destination, and another display selection item displayed in the vicinity of the indicated position when the discriminating unit discriminates that the correct selection destination is not Auxiliary displayed, the user selects operation on the display choices to be the candidate display, characterized by comprising an execution means for executing the selection process with respect to the selected display selected items.

The invention according to claim 2 of the present invention is an information processing apparatus that displays various types of information on a display screen, and detects an indication position by contact on the display screen, which is a first operation by a user. The display selection item displayed at the position indicated by the detected indication position is selected, the information specified by the selected display selection item is displayed, and the information specified by the display selection item is displayed. In the case where the second operation by the user after being performed is an operation for displaying the previous screen, it is determined that the selected display selection item is not the correct selection destination desired by the user, and is not the correct selection destination by the determination. If it is determined, other display selection items displayed near the indicated position are displayed as candidates, and the selected display selection is performed by a user selection operation on the display selection items displayed as candidates. And executes the selection process to the eye.

According to a third aspect of the present invention, the computer is indicated by the detection means for detecting the indicated position by the touch on the display screen as the first operation by the user, and the detected indicated position. selection means for selecting a display selection items displayed on the position display means for displaying the information specified by the display selection item selected by said selection means, information specified by the display selection items by the display means is displayed A discriminating unit for discriminating that the display selection item selected by the selection unit is not a correct selection destination desired by the user when the second operation by the user after that is an operation for displaying the previous screen; When it is determined that it is not the correct selection destination, other display selection items displayed near the indicated position are displayed as candidates, and the display selection items displayed as candidates are displayed. In the user selection operation for a program for causing to function selection processing for the selected display choices executing means for executing the.

According to the fourth aspect of the present invention, the computer detects a position indicated by contact on the display screen, which is the first operation by the user, and sets the position indicated by the detected instruction position. A display selection item to be displayed is selected, information specified by the selected display selection item is displayed, and the second operation by the user after the information specified by the display selection item is displayed is the previous screen. If the selected display selection item is not the correct selection destination desired by the user, and if it is determined that the selection selection item is not the correct selection destination, it is displayed near the indicated position. The other display selection items are displayed as candidates, and a selection process for the selected display selection item is executed by a user selection operation on the display selection items displayed as candidates. A program for causing revealed.

  According to the present invention, even when the display selection item to be an operation instruction target is small, it is possible to appropriately instruct the display selection item without any error.

1 is a configuration diagram of a system described as an embodiment. It is a block diagram of information processor 1 explained as an embodiment. It is a figure which shows the relationship between the display part 16 and touch panel 171 demonstrated as embodiment. It is a flowchart explaining operation | movement of the information processing apparatus 2 demonstrated as embodiment. It is a flowchart explaining operation | movement of the information processing apparatus 2 demonstrated as embodiment. It is an example of the display screen demonstrated as embodiment. It is an example of the display screen demonstrated as embodiment. It is an example of the display screen demonstrated as embodiment.

(1) Hereinafter, embodiments will be described.
(1-1) System configuration example

  FIG. 1 shows a configuration diagram of a system described as an embodiment. An information processing apparatus 1 shown in FIG. 1 is a computer including an operation unit (touch panel, operation buttons, etc.) and a display unit (display). The information processing apparatus 1 is connected to the mobile communication network 3 and provides a voice call function via the telephone network 4 (or IP telephone network).

  The information processing apparatus 1 is connected to the Internet 5 via the mobile communication network 3, and can send and receive e-mails via the Internet 5 and access websites on the Internet 5. Specific examples of the information processing apparatus 1 include a mobile phone, a PDA (Personal Digital Assistance) with a call function, an electronic camera, an electronic wristwatch, a music player, a notebook computer, or a desktop computer.

  FIG. 2A shows a block diagram of the information processing apparatus 1. The information processing apparatus 1 includes a central control unit 11, a ROM 12 (ROM: Read Only Memory), a RAM 13 (RAM: Random Access Memory), a wireless communication unit 14, an audio signal processing unit 15, a microphone 151, a speaker 152, a display unit 16, An operation unit 17 and an RTC 18 (RTC: Real Time Clock) are provided.

  The central control unit 11 is configured using a CPU (Central Processing Unit), an MPU (Micro Processing Unit), or the like. The central control unit 11 performs overall control of the information processing apparatus 1 by executing / processing a program or data stored in the ROM 12 or the RAM 13, and performs information processing apparatus 1 such as a voice call and access to the Internet 5. Realize various functions.

  The RAM 13 has programs for realizing a Web browser and a mailer (Web browser 131 and mailer 132), and a position correction program which is an application program for realizing a function of automatically correcting the touch position of the user's touch panel described later. 133 is stored. The RAM 13 stores an error position 134 and correction data 135, which will be described later.

  The wireless communication unit 14 performs wireless communication with a base station of the mobile communication network 3 when making a voice call or accessing the Internet 5.

  The audio signal processing unit 15 outputs a digital audio signal based on an analog audio signal input from the microphone 151. The audio signal processing unit 15 converts various audio signals such as a call audio, a ring tone, and an operation sound into an analog audio signal and outputs the analog audio signal to the speaker 152.

  The display unit 16 is a liquid crystal panel, an organic EL panel, a cathode ray tube monitor, or the like, and is a device that visually displays information. The display unit 16 displays various information according to the video signal input from the central control unit 11.

  The operation unit 17 converts user operation input performed on the user interface (touch panel 171, operation button 172, operation dial, keyboard, mouse, and the like) into an electrical signal and transmits the electrical signal to the central control unit 11. The touch panel 171 of the operation unit 17 is made of a transparent or translucent material. For example, as illustrated in FIG. 2B, the touch panel 171 is superimposed on the video display surface of the display unit 16 so that each position in the XY coordinate system and each position in the XY coordinate system of the display unit 16 correspond one-to-one. It is provided as such.

  The RTC 18 outputs current time information such as date and time.

(1-2) Operation Example Next, the operation of the information processing apparatus 1 will be described. 3A and 3B are flowcharts for explaining processing performed by the position correction program 133 when accessing a Web page on the Internet 5. Hereinafter, processing performed by the position correction program 133 will be described with reference to these drawings.

  When the user performs some instruction operation, the information processing apparatus 1 touches the touch panel on the display screen of the display unit 16 with a finger or a pen (touch operation), and the touch position (hereinafter referred to as “actual instruction position”). ) Is acquired (S311).

  Next, the information processing apparatus 1 checks whether the correction data 135 is stored in the RAM 13 (S312). Here, the correction data 135 is data that is added in a vector manner to the actual designated position that is the position acquired when the user performs a touch operation, and is data that corrects the actual designated position. When the correction data 135 is stored in the RAM 13 (S312: YES), the process proceeds to S313. If not stored (S312: NO), the process proceeds to S314.

  In S313, the information processing apparatus 1 corrects the actual designated position by adding the correction data 135 to the actual designated position acquired in S311. Hereinafter, the designated position after addition is referred to as a “correction designated position”.

  In S314, the information processing apparatus 1 determines whether or not a selected object (hereinafter referred to as a display selection item) such as a link character string or an icon exists around the correction instruction position on the screen being displayed. Note that “periphery” means, for example, a region where a finger 411 (or pen) is in contact with the touch panel as shown in FIG. 4 (a region indicated by hatching; hereinafter referred to as a contact region 412). .

  If a display selection item exists around the correction instruction position (in the contact area) (S314: YES), the process proceeds to S316. If it does not exist (S314: NO), for example, the process branches to another process (S315) different from the process prepared for the display selection item.

  In S316, the information processing apparatus 1 determines whether one display selection item can be specified by the touch operation performed by the user (whether it can be narrowed down to one). For example, in the case of FIG. 4, since there are a plurality of display selection items 413 (“DEF” and “MNO”) in the contact area, the display selection item 413 cannot be specified.

  If one display selection item cannot be specified (S316: NO), the process proceeds to S317, and if one display selection item can be specified (S316: YES), the process proceeds to S321. If one display selection item cannot be specified (S316: NO), a confirmation sound may be output from the speaker 152 in order to notify the user of that fact.

  In step S317, the information processing apparatus 1 displays display selection item candidates in a list format to prompt the user to select. For example, in FIG. 4, display selection items 413 (“DEF” and “MNO”) are displayed in a list format to prompt the user to select. An example of a screen displayed on the display unit 16 by the information processing apparatus 1 at this time is shown in FIG.

  In S318, the information processing apparatus 1 waits for a user's selection operation. When the display selection item is selected (S318: YES), the process proceeds to S321. At this time, on the other hand, the information processing apparatus 1 monitors in real time whether or not the user has performed a release operation for the touch operation performed in S311 (S318: NO, S319). If the release operation has been performed (S319: YES), the process proceeds to S320. The release operation is performed, for example, when a desired item is not included in the display selection items displayed as candidates.

  For example, in FIG. 5, the operation button 172 is operated to move the cursor and specify one of the candidates 511 (or directly specify the number using the numeric keypad), and then select the candidate by instructing the selection button 512. it can. Further, a release operation can be performed by instructing a release button 513.

  In S320, the information processing apparatus 1 stores the actual designated position in the RAM 13 as the error position 134. Thereafter, the process proceeds to S351 in FIG. 3B.

  In S321 of FIG. 3A, the information processing apparatus 1 accesses the URL (Uniform Resource Locator) of the link destination described for the display selection item specified (S316: YES) or selected by the user (S318: YES). The web page is acquired, and the acquired web page is displayed (S322).

  In S323, the information processing apparatus 1 determines whether a predetermined time has elapsed since the Web page was displayed in S322. When the predetermined time has elapsed (S323: YES), the process proceeds to S324, and when it has not elapsed (S323: NO), the process proceeds to S326.

  In S324, the information processing apparatus 1 checks whether or not the error position 134 is stored in the RAM 13. If stored (S324: YES), the process proceeds to S325. If not stored (S324: NO), the process is terminated.

  In S325, the information processing apparatus 1 calculates the difference between the actual designated position and the error position 134, and stores the calculated value in the RAM 13 as the correction data 135.

  In S <b> 326, the information processing apparatus 1 determines in real time (S <b> 326: NO) whether or not the user has performed an operation for displaying a previous screen (such as a previous page return operation) such as operating the “return” button of the Web browser. . When the previous page return operation is performed (S326: YES), the information processing apparatus 1 displays the previous screen (S327). After S327, the process proceeds to S320.

  In S351 of FIG. 3B, the information processing apparatus 1 determines whether a display selection item exists in the vicinity of the correction instruction position on the currently displayed screen. Here, “vicinity” means, for example, a peripheral area (area indicated by a broken line frame, hereinafter referred to as a proximity area 611) including a contact area (area indicated by oblique lines) as shown in FIG. . The neighborhood area 611 is set, for example, as an area similar to the contact area obtained by enlarging the contact area 412 at a predetermined magnification.

  If a display selection item exists in the vicinity of the correction instruction position (S351: YES), the process proceeds to S352, and if it does not exist (S351: NO), the process ends.

  In S352, the information processing apparatus 1 extracts other display selection item candidates. For example, in FIG. 6, “MNO” present in the neighborhood area 611 is extracted as a display selection item candidate. In S353, the information processing apparatus 1 displays the extracted candidates for other display selection items in a list format and prompts the user to select. If the user selects a display selection item (S354: YES), the process proceeds to S355. When the display selection item is not selected (S354: NO), the process ends.

  Note that a user interface for setting the neighborhood area 611 may be provided in the information processing apparatus 1 so that the user can arbitrarily set the extraction range of display selection items.

  In S355, the information processing apparatus 1 acquires the display position of the selected display selection item. In S356, the information processing apparatus 1 calculates the difference between the acquired display position and the stored error position 134, and stores the calculated value in the RAM 13 as the correction data 135.

  According to the above, when a position indication operation is performed on an arbitrary display selection item displayed on the display screen, it is confirmed that the display selection item selected by the position indication operation is not the correct display selection item desired by the user. When discriminated from the operation status, the position and difference of the erroneously designated position and the correct display selection item are learned (stored), and the designated position is corrected with the learned content during a new operation. Even if the actual indication position by the user is different from the display position of the display selection item that the user is trying to select, the user performs an operation to express that the user has not selected correctly, and then the correct display selection is performed. By simply selecting an item, the indicated position can be automatically corrected thereafter.

  In addition, since the determination of the user's operation status is performed according to the presence or absence of the previous page return operation by the user within a predetermined time after accessing the link information selected and specified, whether or not the user has instructed erroneously Can be reliably determined.

  In addition, since the determination of the user's operation status is performed according to the presence / absence of the release operation during the confirmation display of the display selection item, it is possible to reliably determine whether or not the user has instructed erroneously.

  In addition, the correct selection destination display selection item is specified by the user operation situation when the selection execution process is performed by the instruction operation for the other display selection item after determining that it is not the correct selection destination. It is possible to reliably specify the display selection item of the selection destination.

  In addition, since the display selection item of the correct selection destination is identified by selecting the display selection item on the list display of the display selection item after determining that it is not the correct selection destination, the display selection of the correct selection destination is selected. The item can be reliably identified.

  Further, when a position indicating operation is performed on an arbitrary display selection item displayed on the display screen, it is determined from the user operation situation that the display selection item selected by the position indicating operation is not the correct display selection item desired by the user. Since the selection operation for other display selection items displayed in the vicinity of the designated position can be easily performed, it is assumed that the designated position by the user and the display position of the display selection item actually selected are shifted. In addition, the user can easily reselect a correct display selection item that is likely to exist in the vicinity of the designated position by performing an operation to express that the selection has not been performed correctly.

  In addition, when a plurality of display selection items are specified where one display selection item should originally be specified at the indicated position indicated on the display screen, this is notified. When there is a possibility that an incorrect display selection item is selected, it is possible to prevent the selection process for the incorrect display selection item from being executed.

  In the notification, a plurality of specified display selection items are displayed, and selection processing corresponding to the selected display selection item is executed by selecting any display selection item among them. When there is a possibility that an unselected display selection item is selected, it is possible to prevent the selection process for the incorrect display selection item from being executed.

  A part or all of the above-described embodiment can be described as in the following supplementary notes, but is not limited thereto.

(Appendix 1)
An information processing apparatus that displays various types of information on a display screen,
Detecting means for detecting an indicated position by contact on the display screen;
A discriminating means for discriminating whether or not the selection with respect to the display selection item displayed at the position indicated by the detected indication position is a correct selection destination desired by the user based on the operation status of the user after the selection;
If it is not the correct selection destination, storage means for storing the indicated position as an incorrect designated position;
Storage means for storing the difference between the position where the display selection item of the correct selection destination is displayed and the display position stored as the erroneous pointing position as the information for pointing position correction;
An information processing apparatus comprising: a correcting unit that corrects a specified position based on the stored correction information when a new specified position operation is performed on a display screen.

(Appendix 2)
An information processing apparatus according to attachment 1, wherein
The display selection item is link information to a web page,
The information processing apparatus according to claim 1, wherein the operation status determination of the user is performed according to whether or not a previous page return operation is performed by the user within a predetermined time after accessing the link information selected and designated.

(Appendix 3)
An information processing apparatus according to attachment 1, wherein
Display means for displaying the display selection item at another display position for confirmation prior to the selection execution processing of the indicated display selection item;
Execution means for executing a selection execution process based on the display selection item in a selection execution instruction after the confirmation display;
An information processing apparatus comprising: a determination unit configured to perform the user operation status determination in accordance with presence / absence of a release operation during confirmation display of the display selection item.

(Appendix 4)
An information processing apparatus according to attachment 1, wherein
The display selection item of the correct selection destination is specified by a user operation situation when selection execution processing is performed by an instruction operation on another display selection item after determining that the display is not the correct selection destination. Information processing device.

(Appendix 5)
An information processing apparatus according to attachment 1, wherein
The information processing apparatus characterized in that the display selection item of the correct selection destination is specified by selecting a display selection item on a list display of display selection items after determining that the display selection item is not the correct selection destination.

(Appendix 6)
An information display device for displaying various information on a display screen,
Detecting means for detecting an indicated position by contact on the display screen;
A discriminating means for discriminating whether or not the selection with respect to the display selection item displayed at the position indicated by the detected indication position is a correct selection destination desired by the user from the user operation status after the selection;
If it is not the correct selection destination, other display selection items displayed in the vicinity of the indicated position are displayed as candidates, and selection processing for the selected display selection items is performed by a user selection operation on the display selection items displayed as candidates. An information processing apparatus comprising: execution means for executing

(Appendix 7)
An information display device for displaying various information on a display screen,
A discriminating means for detecting an indication position by contact on the display screen and discriminating whether or not the display selection item can be specified at the detected indication position;
Execution means for executing a selection process for the display selection item if one display selection item can be specified;
If it is possible to specify a plurality of display selection items, the information processing system includes an informing means for informing that a plurality of display selection items exist as selection target candidates prior to the execution of the selection process. apparatus.

(Appendix 8)
An information processing apparatus according to appendix 7,
In the notification, the display unit includes a plurality of specified display selection items, and an execution unit that executes a selection process corresponding to the selected display selection item by selecting an arbitrary display selection item among them. An information processing apparatus characterized by that.

(Appendix 9)
On the computer,
A function for detecting the indicated position by contact on the display screen;
A function for determining whether or not the selection with respect to the display selection item displayed at the position indicated by the detected indication position is a correct selection destination desired by the user based on the operation status of the user after the selection;
If it is not the correct selection destination, the function of storing the indicated position as an incorrect indicated position;
A function of storing the difference between the position where the display selection item of the correct selection destination is displayed and the display position stored as the erroneous pointing position as information for pointing position correction;
A program for realizing a function of performing a designated position correction based on the stored correction information in a new designated position operation on the display screen.

(Appendix 10)
On the computer,
A function for detecting the indicated position by contact on the display screen;
A function for determining whether or not the selection with respect to the display selection item displayed at the position indicated by the detected indication position is a correct selection destination desired by the user based on the operation status of the user after the selection;
If it is not the correct selection destination, other display selection items displayed in the vicinity of the indicated position are displayed as candidates, and selection processing for the selected display selection items is performed by a user selection operation on the display selection items displayed as candidates. A program to realize the function to execute

(Appendix 11)
On the computer,
A function of detecting an indication position by contact on the display screen and determining whether or not a display selection item can be specified at the detected indication position;
A function for executing a selection process for the display selection item if one display selection item can be specified;
If a plurality of display selection items can be specified, a program for realizing a function of notifying that a plurality of display selection items exist as selection target candidates prior to execution of the selection process.

1 Information processing device 5 Internet 13 RAM
131 Web browser 132 Mailer 133 Position correction program 134 Error position 135 Correction data 16 Display unit 17 Operation unit 171 Touch panel 172 Operation button 412 Contact area 511 Candidate 512 Select button 513 Release button 611 Neighborhood area

Claims (4)

An information processing apparatus that displays various types of information on a display screen,
Detecting means for detecting an indication position by contact on a display screen as a first operation by a user;
A selection means for selecting a display selection item displayed at a position indicated by the detected indication position;
Display means for displaying information specified by the display selection item selected by the selection means;
When the second operation by the user after the information designated by the display selection item is displayed by the display means is an operation to display the previous screen, the display selection item selected by the selection means is the user's desired Discriminating means for discriminating that it is not the correct selection destination,
When it is determined by the determination means that the selection destination is not correct, other display selection items displayed near the indicated position are displayed as candidates, and the selection is performed by a user selection operation for the display selection items displayed as candidates. An information processing apparatus comprising: an execution unit that executes a selection process for the displayed selection item. An information processing apparatus that displays various types of information on a display screen,
Detecting a position indicated by contact on the display screen as a first operation by the user;
Select the display selection item displayed at the position indicated by the detected indicated position,
Displays the information specified by the selected display selection item,
When the second operation by the user after the information specified by the display selection item is displayed is an operation for displaying the previous screen, the selected display selection item is not the correct selection destination desired by the user. Discriminate,
When it is determined that the selection destination is not correct by the determination, other display selection items displayed in the vicinity of the indicated position are displayed as candidates, and the selection is performed by a user selection operation for the display selection items displayed as candidates. An information processing apparatus that performs a selection process on a display selection item. Computer
Detecting means for detecting a position indicated by contact on a display screen as a first operation by a user;
A selection means for selecting a display selection item displayed at a position indicated by the detected indication position;
Display means for displaying information specified by the display selection item selected by the selection means;
When the second operation by the user after the information designated by the display selection item is displayed by the display means is an operation to display the previous screen, the display selection item selected by the selection means is the user's desired Discriminating means for discriminating that it is not the correct selection destination,
When it is determined by the determination means that the selection destination is not correct, other display selection items displayed near the indicated position are displayed as candidates, and the selection is performed by a user selection operation for the display selection items displayed as candidates. Execution means for executing a selection process for the selected display selection item,
A program characterized by functioning as On the computer,
Detecting a position indicated by contact on the display screen as a first operation by the user;
Select the display selection item displayed at the position indicated by the detected indicated position,
Displays the information specified by the selected display selection item,
When the second operation by the user after the information specified by the display selection item is displayed is an operation for displaying the previous screen, the selected display selection item is not the correct selection destination desired by the user. Discriminate,
When it is determined that the selection destination is not correct by the determination, other display selection items displayed in the vicinity of the indicated position are displayed as candidates, and the selection is performed by a user selection operation for the display selection items displayed as candidates. A program for realizing the selection process for display selection items.

Images