JP2016004288A - Information processor and program - Google Patents

Abstract

PROBLEM TO BE SOLVED: To accurately prevent any unintended processing from being performed even when there is any unintended change in an item as the target of an execution processing on a touch panel.SOLUTION: An arithmetic processor 3 of an information processor 1 is configured to, when the detection of position information is started by a position detection device 13, allow a storage device 5 to store a selection history 27 in which a selection item indicated by an operation position is associated with a continuous time when the selection item is continuously indicated by the operation position. The position detection device 13 is configured to detect the position information indicating the operation position on a display device for displaying the selection item corresponding to selectable processing. The arithmetic processor 3 is configured to, when a pressing operation on the display device is detected during the continuous detection of the position information, determine the selection item as the target of execution on the basis of the continuous time in the selection history, and to perform processing corresponding to the selection item as the target of execution.

Description

  The present invention relates to an information processing apparatus and a program.

  In an information processing apparatus that uses a touch panel for input / output, an operation position such as contact, pressing, or placement of a finger or a touch pen on a display surface of the touch panel is detected as an input from the touch panel. For example, an input to the information processing apparatus may be performed by a selection operation for selecting an item displayed on the display surface and an execution operation for executing a process associated with the selected item. At this time, for example, the information processing apparatus detects the operation position of the execution operation on the display surface and executes a process associated with the detected operation position.

  However, when moving from the selection operation to the execution operation, an unintended change may occur in the operation position. For example, when the selection operation is performed by contact and the execution operation is performed by pressing, there may be a case where the contact position of the fingertip is different from the pressure position at which the pressure due to the belly of the finger is detected. In such a case, even if the user who performs the operation intends to select an item corresponding to the contact position of the fingertip, the operation position of the execution operation becomes a pressure position of the belly of the finger different from the contact position of the fingertip, An operation position indicating a different item may be detected. Thereby, an operation position corresponding to an item that the user does not intend to select is detected as an operation position of the execution operation, and unintended processing may be performed.

  The following techniques for dealing with the above problems are known. For example, while the output of the pressing pressure detection means for detecting pressure or load is within a predetermined range, the change in the selection of the operation item is suppressed against the change in the detection result of the two-dimensional coordinates of the finger contact point in the operation surface A vehicular operating device is known (see, for example, Patent Document 1).

JP 2013-88912 A

  The conventional techniques as described above have the following problems. For example, when pressing on the display surface is used as an execution operation, in the above conventional technique, the change in selection of the operation item is suppressed while the output of the pressing force detection means is within a predetermined range. For this reason, when the output of the pressing force detection means is not within a predetermined range, for example, an unintended operation such as an unintended press by the finger pad is detected, and an unintended process may be performed. As described above, in the case of performing input using the touch panel, it is difficult to accurately determine whether or not the detected operation position of the execution operation is an operation position indicating an unintended item. . Therefore, it is difficult to accurately prevent an unintended process from being performed.

  According to one aspect, an object of the present invention is to accurately prevent an unintended process from being performed even when there is an unintended change in an item to be executed on the touch panel. is there.

  An information processing apparatus according to one aspect includes a storage device and an arithmetic processing device. When detection of position information is started by the position detection device, the arithmetic processing unit stores a selection history in which the selection item indicated by the operation position and the duration in which the operation position continuously indicates the selection item are associated with each other. Store in the device. Here, the position detection device detects position information indicating an operation position on the display device that displays a selection item corresponding to a selectable process. When the pressing operation on the display device is detected while the detection of the position information is continued, the arithmetic processing unit determines the execution target selection item based on the duration in the selection history, and the execution target selection item Process corresponding to.

  According to one embodiment, even when there is an unintended change in an item to be executed on the touch panel, an unintended process can be accurately prevented.

It is a figure which shows an example of the hardware constitutions of the information processing apparatus by 1st Embodiment. It is a figure which shows the example of the change of the selection item in execution operation by 1st Embodiment. It is a figure which shows an example of the determination method of the selection item of the execution object by 1st Embodiment. It is a figure which shows an example of the positional information by 1st Embodiment. It is a figure which shows an example of the item table by 1st Embodiment. It is a figure which shows an example of the threshold value data by 1st Embodiment. It is a figure which shows an example of the selection log | history by 1st Embodiment. It is a figure which shows an example of the operation history by 1st Embodiment. It is a flowchart which shows an example of operation | movement of the information processing apparatus by 1st Embodiment. It is a flowchart which shows an example of operation | movement of the information processing apparatus by 1st Embodiment. It is a figure which shows an example of execution operation by a modification. It is a figure which shows an example of the operation history by 2nd Embodiment. It is a figure explaining an example of the correction process by the detection order of the selection item by 2nd Embodiment. It is a flowchart which shows a part of basic operation example of the information processing apparatus by 2nd Embodiment. It is a flowchart which shows an example of the correction process of the coordinate by 2nd Embodiment. It is a flowchart which shows an example of the correction process by the continuation time by 2nd Embodiment. It is a flowchart which shows an example of the correction process by the detection order of the selection item by 2nd Embodiment. It is a figure which shows an example of the hardware constitutions of the information processing apparatus by 3rd Embodiment. It is a figure which shows the example of the validity determination of the correction | amendment by the inclination angle by 3rd Embodiment. It is a flowchart which shows an example of the correction process of the coordinate by the information processing apparatus by 3rd Embodiment. It is a flowchart which shows an example of the validity determination process of the correction | amendment by 3rd Embodiment. It is a figure which shows an example of the hardware constitutions of the information processing apparatus by 4th Embodiment. It is a figure explaining an example of the reading-out process by 4th Embodiment. It is a figure which shows an example of the reading-out state by 4th Embodiment. It is a figure which shows an example of the selection log | history by 4th Embodiment. It is a figure which shows an example of the operation history by 4th Embodiment. It is a figure which shows an example of the threshold value setting data by 4th Embodiment. It is a figure which shows an example of the reading-out information by 4th Embodiment. It is a flowchart which shows an example of the correction process of the coordinate in the information processing apparatus by 4th Embodiment. It is a flowchart which shows an example of the correction process by the reading-out phrase by 4th Embodiment. It is a flowchart which shows an example of the process at the time of reading by 4th Embodiment. It is a block diagram which shows an example of the hardware constitutions of a standard computer.

(First embodiment)
The information processing apparatus according to the first embodiment will be described below with reference to the drawings. FIG. 1 is a diagram illustrating an example of a hardware configuration of the information processing apparatus according to the first embodiment. As shown in FIG. 1, the information processing apparatus 1 according to the first embodiment includes an arithmetic processing device 3 and a storage device 5. The arithmetic processing device 3 and the storage device 5 are connected by a bus 7 and can exchange information with each other. The information processing apparatus 1 is connected to the touch panel 9 so as to be able to exchange information with, for example, a wired or wireless communication path. The touch panel 9 may be connected to the arithmetic processing device 3 and the storage device 5 of the information processing device 1 via the bus 7 and may be integrally formed. The information processing apparatus 1 is, for example, a multi-function mobile phone, a tablet computer, a notebook computer, a desktop computer, an automatic teller machine, or the like.

  The arithmetic processing device 3 is an arithmetic processing device that performs processing for controlling the operation of the information processing device 1. The arithmetic processing device 3 controls the operation of the information processing device 1 by reading and executing an operation control program stored in advance in the storage device 5. The storage device 5 is a device that stores information, such as a random access memory (RAM), a read only memory (ROM), or the like. For example, the storage device 5 stores in advance information such as a program for controlling the operation of the information processing device 1 and parameters necessary for the operation of the information processing device 1. The storage device 5 appropriately stores information generated during the operation of the information processing device 1. For example, the storage device 5 stores a program 21 that controls the operation of the information processing apparatus 1 according to the first embodiment, an item table 23, threshold data 25, a selection history 27, an operation history 29, and the like, which will be described later.

  The touch panel 9 is an input / output device that performs display based on control from the information processing apparatus 1, detects an operation position on the display surface, and outputs the detected result to the information processing apparatus 1. The touch panel 9 includes, for example, a display device 11 and a position detection device 13 that are connected to each other via a bus 15. The display device 11 has a display surface, and displays, for example, selection items corresponding to selectable processes on the display surface based on control from the information processing apparatus 1. The display device 11 may include, for example, a display panel such as a liquid crystal display device or a control circuit that controls a display operation on the display device 11 based on information input from the information processing apparatus 1. Note that the operation accepted by the touch panel 9 is not limited to an operation involving contact.

  For example, the position detection device 13 is provided on the display surface of the display device 11 so as to be integrated with the display device 11, and detects the operation position of the operation on the display surface. The position detection device 13 may be provided near the display surface of the display device 11. The position detection device 13 of the display device 11 outputs position information including the detected operation position to the information processing apparatus 1. For example, the position detection device 13 detects an operation such as contact, pressing, or placement of a finger or a touch pen on the display surface of the display device 11 and outputs position information indicating the operation position of the operation to the information processing apparatus 1. To do. The position detection device 13 may detect the type of operation on the display surface and include it in the position information. At this time, the position detection device 13 outputs, for example, position information 19 described later.

  The position detection device 13 may include a contact surface that senses contact or pressure on the display surface of the display device 11. At this time, the contact surface is preferably provided with an electrostatic sensor, a pressure sensor or the like. The position detection device 13 may be configured to optically detect the position. When the position is detected optically, the light source and the light receiving element may be arranged so as to surround the periphery of the display surface. The position detection device 13 may include a control circuit that controls operations such as detecting position information and outputting the position information to the information processing apparatus 1.

  The arithmetic processing device 3 stores a selection history 27 in which the selection item indicated by the operation position and the duration of the operation position continuously indicating the selection item are associated with each other in the order of detection of the operation position on the display device 11. It is stored in the device 5. The processing to be stored is performed by the arithmetic processing device 3 after the position detection device 13 starts detecting the position information until the position information detection ends, or after the position information detection starts. This is executed for a shorter period of time until a predetermined operation is detected. The predetermined operation is an operation performed when it is intended to execute a process corresponding to the selection item displayed on the display surface, and may be referred to as an execution operation hereinafter. The execution operation is an operation predetermined according to the touch panel 9, for example. For example, the arithmetic processing device 3 performs, for each selection item indicated by the operation position, while the detection of the position information from when the position detection device 13 starts detecting the position information until the position information is not detected. The duration is stored in the storage device 5 as the selection history 27. Note that the position detection device 13 may detect position information at regular intervals.

  The storage of the selection history 27 is ended as the operation is ended, for example, when the operation position detected every predetermined time is not detected or when a predetermined operation is detected. The end of the operation may be detected when the arithmetic processing device 3 detects that the type of operation indicating the end of the operation is detected on the touch panel 9 side. Hereinafter, the operation from the start of detection of position information to the end of detection of position information, or from the start of detection of position information to the detection of a predetermined operation may be described as one operation. The period from the start to the end of one operation may be described as one operation period.

  When detecting a predetermined operation based on the position information, the arithmetic processing device 3 searches the storage device 5 for a duration exceeding the predetermined value in an order reverse to the detection order of the position information. The predetermined value can be, for example, a time estimated to be sufficient for the user to recognize the selection item indicated by the operation position. When searching for the duration, the arithmetic processing device 3 refers to the threshold data 25 and the selection history 27, for example. The predetermined value is read from the threshold data 25 and set, for example.

  The execution operation can be an operation such as a pressing operation. The pressing operation can be detected by, for example, an increase in the area indicated by the detected operation position. When the position detection device 13 includes a pressure detection device, the pressing operation is detected by detecting, for example, a predetermined pressure or more. When detecting the predetermined operation, the arithmetic processing device 3 may store information indicating the operation position of the predetermined operation and information corresponding to the selected item associated with the searched duration in the operation history 29.

  The arithmetic processing device 3 determines the selection item to be executed based on the selection item stored in association with the searched duration. For example, in the present embodiment, a selection item stored in association with the searched duration is determined as a selection item to be executed. Further, the arithmetic processing device 3 performs processing corresponding to the selection item to be executed. The selection item to be executed means a selection item to be executed by the corresponding process. Confirming a selection item as a selection item to be executed is sometimes referred to as confirming the selection item.

  For example, the arithmetic processing device 3 can perform a process having a process content described in an item table 23 described later as a process corresponding to a selection item to be executed. Further, the arithmetic processing device 3 can include a process for determining predetermined information for starting the process as a process corresponding to the selection item to be executed. The arithmetic processing device 3 may use the coordinates corresponding to the display area of the selection item to be executed as information for starting the corresponding processing. The coordinates used as information for starting the corresponding process may be referred to as execution coordinates. The execution coordinates can be coordinates representing the display area associated with the selection item to be executed, for example, central coordinates indicating the center point of the display area. When determining the selection item, the arithmetic processing device 3 may set the execution coordinates corresponding to the selection item in the operation history 29 described later. Further, the arithmetic processing device 3 may output information indicating a selection item to be executed and a processing result of the executed process. That is, the arithmetic processing unit 3 performs information on the process to be executed, display on the touch panel 9 indicating the result of the process, output of sound indicating that the process corresponding to the selected item is being performed, and the like. Also good.

  FIG. 2 is a diagram illustrating an example of changing a selection item in the execution operation according to the first embodiment. FIG. 2 shows that items 31 and 33 are displayed on the display surface of the touch panel 9. The item 31 is a selection item corresponding to the process α. Item 33 is a selection item corresponding to process β. The object 35 is an object to be operated.

  The operation position 37 is an operation position of a selection operation by the object 35. The selection operation means that the operation position of the object 35 on the touch panel 9 is included in the display area on the display surface of any item. A movement 39 indicates a movement from the operation position 37 to the operation position of the execution operation by the object 35. At this time, the operation position 37 indicates the item 31. The operation position of the execution operation is assumed to indicate an item 33. Similarly, the operation position 41 is an operation position of a selection operation by the object 35. A movement 43 indicates a movement from the operation position 41 to the operation position of the execution operation by the object 35. At this time, the operation position 41 indicates the item 31, and the operation position of the execution operation indicates the item 33.

  As in the example of FIG. 2, when the operation position of the selection operation and the operation position of the execution operation indicate different items in one operation period, it is determined whether or not the movement 39 and the movement 43 are due to the user's intention. Judgment is required to execute processing corresponding to the selection item intended by the user.

  FIG. 3 is a diagram illustrating an example of a method for determining a selection item to be executed according to the first embodiment. The example of FIG. 3 shows a state in which items 51 to 55 are displayed on the display surface of the touch panel 9. An item 51 is a selection item corresponding to the process α. An item 53 is a selection item corresponding to the process β. An item 55 is a selection item corresponding to the process γ. The movement 57 indicates the movement of the object 35 from when the detection of the operation position indicating the item 53 is started until the execution operation is detected.

  The example of FIG. 3 first shows that the operation position indicating the item 53 is continuously detected for the duration Tn−1. The example of FIG. 3 indicates that the operation position indicating the item 55 is continuously detected for the duration Tn, and further, the execution operation corresponding to the item 55 is detected.

  When the duration Tn in FIG. 3 exceeds a predetermined threshold time Tth (Tn> Tth) as the predetermined value (Tn> Tth), the arithmetic processing unit 3 sets the item 55 as a selection item to be executed and sets the corresponding process γ to Run. If the duration Tn is equal to or shorter than the threshold time Tth and the duration Tn-1 corresponding to the item 53 detected immediately before exceeds the threshold time Tth (Tn-1> Tth ≧ Tn), The arithmetic processing unit 3 uses the item 53 as a selection item to be executed and executes the process β. As described above, when an execution operation is detected, the information processing apparatus 1 executes a process corresponding to the most recent selection item having a duration exceeding the threshold time Tth.

  FIG. 4 is a diagram illustrating an example of position information according to the first embodiment. The position information 19 includes information indicating the operation position detected by the position detection device 13 and is information output from the touch panel 9 to the information processing apparatus 1. The operation position can be, for example, two-dimensional coordinates on the display surface indicating the operation position of the operation detected by the position detection device 13. The operation position may be an identification code indicating an area obtained by dividing the display surface into a plurality of parts.

  In FIG. 4, a form in which operation related information is included is exemplified as the position information 19, but the operation related information does not necessarily have to be included. Note that the operation-related information can include, for example, information indicating the type of operation indicating whether the operation position corresponds to contact, press, placement, start of operation, end of operation, or the like. The position information 19 is a case where the pressing operation is detected by a change in the area indicated by the contact point on the display surface, or a case where the execution operation includes a plurality of operation positions. When performing the determination, a form including a plurality of operation positions detected at the same time is also conceivable.

  FIG. 5 is a diagram illustrating an example of an item table according to the first embodiment. The item table 23 is data in which the name of the process corresponding to the selection item displayed on the touch panel 9, the coordinate area on the display surface associated with the selection item, and the processing content are stored in association with each other. The item table 23 may include execution coordinates corresponding to each selection item. The item table 23 is stored in the storage device 5, for example. When the operation position is detected on the touch panel 9, the item table 23 is referred to by the arithmetic processing device 3 when determining which selection item the operation position indicates. In addition, when the process corresponding to the selected item is executed, the item table 23 is referred to by the arithmetic processing device 3 in order to set the execution coordinates in the coordinate area corresponding to the selected item.

  FIG. 6 is a diagram illustrating an example of threshold data according to the first embodiment. The threshold data 25 includes a threshold time Tth. The threshold time Tth is an example of a predetermined value. The threshold data 25 is stored in advance in the storage device 5, for example. The threshold data 25 is referred to when an execution target selection item is confirmed after an execution operation is detected. Although the threshold data 25 is an example including one threshold time Tth, it includes a plurality of threshold times and can be modified, for example, to be set when processing is performed.

  FIG. 7 is a diagram illustrating an example of the selection history according to the first embodiment. The selection history 27 is information stored on the touch panel 9 in the order of detection of the operation position in association with the selection item in which the selection operation is detected in one operation period and the duration in which the operation position continuously indicates the selection item. is there. The selection history 27 includes selection item identification information and duration. The selection history 27 is stored in the storage device 5, for example. The identification information of the selection item can be the name of the process corresponding to the selection item, the coordinates of the display area associated with the selection item in the item table 23, and the like. The continuation time is a time during which the operation position continuously indicates the selection item. Instead of the duration time, the time when the operation position entered the display area corresponding to the selected item and the time when the operation position was escaped are stored, so that other forms of information that can obtain information having the same meaning are stored. Also good.

  For example, when the selection item identification number ID = n (n is an integer equal to or greater than zero), the selection item Sn and the duration Tn are stored. n indicates the detection order of selection items in one operation period. Note that the selection history 27 does not need to hold all information from ID = 0 to ID = n, and includes several of the latest identification numbers ID = n, such as the latest two. It is only necessary to retain a history corresponding to consecutive identification numbers ID.

  FIG. 8 is a diagram illustrating an example of an operation history according to the first embodiment. The operation history 29 has fixed coordinates (xf, yf), execution coordinates (xp, yp), and the latest identification number ID. The fixed coordinates (xf, yf) are coordinates representing the display area of the selection item indicated by the execution operation detected by the arithmetic processing device 3. The execution coordinates (xp, yp) are coordinates representing the display area of the selection item to be executed. The operation history 29 is generated for each operation and stored in the storage device 5, for example.

  Hereinafter, the operation of the information processing apparatus 1 according to the first embodiment will be further described with reference to a flowchart. 9 and 10 are flowcharts illustrating an example of the operation of the information processing apparatus according to the first embodiment.

  As shown in FIG. 9, the arithmetic processing unit 3 stands by until it is determined that the operation position is detected (S81: NO). For example, when the arithmetic processing device 3 determines that the operation position has been detected by inputting the position information 19 from the touch panel 9 (S81: YES), the arithmetic processing device 3 initializes data such as the selection history 27 and the operation history 29 ( S82). The arithmetic processing unit 3 sets the detection order n = 0 of the selection items in the selection history 27 (S83). The detection order n is used as an identification number ID for each selection item in the selection history 27.

  The arithmetic processing unit 3 stores the selection item with the identification number ID = n of the selection item and the entry time in, for example, the selection history 27 of the storage device 5 (S84). The entry time is the time when the operation position is not detected in the display area associated with the selection item, and the state is detected. At this time, the arithmetic processing device 3 acquires, for example, coordinates indicating the operation position on the touch panel 9 from the position information 19 and refers to the item table 23 to specify a selection item corresponding to the coordinates of the operation position. In addition, the arithmetic processing device 3 stores the identification information of the specified selection item in the corresponding selection item of the selection history 27.

  The arithmetic processing unit 3 determines whether or not a predetermined operation has been detected based on the position information 19 (S85). The predetermined operation is, for example, a pressing operation, and is an operation determined in advance as an execution operation for executing a process corresponding to the selection item. When the predetermined operation is detected, the arithmetic processing device 3 advances the process to S91 of FIG. 10 (S85: YES). At this time, the arithmetic processing device 3 refers to, for example, the item table 23, and coordinates corresponding to the selected position indicated by the operation position indicated by the predetermined operation or the operation position indicated by the predetermined operation in the confirmed coordinates of the operation history 29 Remember. When the predetermined operation is not detected (S85: NO), the arithmetic processing unit 3 advances the process to S86.

  In S86, the arithmetic processing unit 3 determines whether or not the selection item has been changed. That is, the arithmetic processing device 3 refers to the coordinates of the operation position extracted from the position information 19 in the item table 23, acquires the selection item indicated by the operation position, and the selection item stored in the current identification number ID = n. It is determined whether or not.

  If the arithmetic processing unit 3 determines that the selection item has been changed (S86: YES), it stores the duration of the selection item before the change in the selection history 27 (S87). For example, the arithmetic processing device 3 measures the current time, and stores the elapsed time from the entry time stored in S84 in the selection history 27 as the duration. The arithmetic processing unit 3 sets n = n + 1 (S88), and repeats the processing from S84. When the change of the selection item is not detected in S86 (S86: NO), the arithmetic processing device 3 repeats the processing from S85.

  When a predetermined operation is detected in S85 (S85: YES), as shown in FIG. 10, the arithmetic processing device 3 stores the duration of the selection item indicated by the operation position of the predetermined operation in the selection history 27 ( S91). At this time, similarly to S87, the arithmetic processing device 3 can measure the current time and use the elapsed time stored in S84 as the duration. Note that the selection item indicated by the operation position of the predetermined operation may be simply referred to as the selection item indicated by the predetermined operation.

  The arithmetic processing unit 3 determines whether or not n = 0 (S92). When n = 0 (S92: YES), the arithmetic processing unit 3 determines the selection item with the identification number ID = n = 0 because there is no history of other selection items in the selection history 27. That is, the arithmetic processing unit 3 determines the selection item to be executed based on the selection history 27 (S93). At this time, for example, the arithmetic processing device 3 refers to the selection item to be executed in the item table 23 and sets the corresponding execution coordinate in, for example, the operation history 29. Further, the arithmetic processing device 3 determines the execution coordinates set in the operation history 29, thereby performing processing associated with the selection item to be executed (S94). The determination of the execution coordinates means that, for example, the execution coordinates set in the operation history 29 are used for the next process for performing the process associated with the selection item to be executed. The arithmetic processing device 3 executes a process associated with the selection item to be executed using the determined execution coordinates. At this time, the arithmetic processing device 3 can also indicate the selection item to be executed by outputting information indicating the processing to be executed, the result of the processing, or the like to the touch panel 9 or other output device (not shown). .

  If n = 0 is not satisfied (S92: NO), the arithmetic processing device 3 sets i = n (S95). The arithmetic processing unit 3 determines whether the duration of the identification number ID = i exceeds a predetermined value (S96). When it is below the predetermined value (S96: NO), the arithmetic processing unit 3 sets i = i−1 (S97). Furthermore, when i ≧ 0 (S98: YES), the arithmetic processing unit 3 repeats the processing from S96. If i <0 in S98 (S98: NO), the arithmetic processing unit 3 advances the process to S93. If the duration time exceeds the predetermined value in S96 (S96: YES), the arithmetic processing unit 3 determines the selection item of ID = i. That is, the arithmetic processing unit 3 determines the selection item with ID = i as the selection item to be executed (S99). In addition, the arithmetic processing device 3 advances the process to S94 and performs a process corresponding to the selection item to be executed.

  As described above in detail, the information processing apparatus 1 according to the first embodiment includes the arithmetic processing device 3 and the storage device 5. The information processing apparatus 1 is connected to the touch panel 9 and exchanges information with each other. The arithmetic processing device 3, for example, displays the selection item indicated by the operation position on the display device 11 detected by the position detection device 13 during one operation period, and the duration indicated by the operation position continuously indicating the selection item. The data is stored in the storage device 5 in association with each other. At this time, the arithmetic processing device 3 stores the selection item and the duration in the storage device 5 in association with each other in the order of detection of the operation position as in the selection history 27, for example. When a predetermined operation is detected based on the position information while the detection of the position information on the touch panel 9 is continued, the arithmetic processing device 3 causes the storage device 5 to set the duration exceeding the predetermined value in the reverse order of detection. Search in order. The arithmetic processing device 3 determines the selection item to be executed based on the selection item stored in association with the searched duration. For example, the arithmetic processing device 3 determines a selection item stored in association with the searched duration as an execution target. Further, the arithmetic processing device 3 performs processing corresponding to the selection item to be executed. As the processing corresponding to the selection item, the arithmetic processing device 3 sets, for example, information for starting the processing associated with the selection item to be executed, and outputs information indicating the selection item to be executed, a processing result, and the like. Etc. may be performed.

  As described above, in the information processing apparatus 1, when the process to be executed is selected using the touch panel 9, if an unintended change occurs in the selection item, the operation time indicating the operation position indicating the selection item different from the intention is detected. Is used as being likely to be less than or equal to a predetermined value. Therefore, when the duration of the selection item indicated by the predetermined operation is equal to or less than the predetermined value, it is interpreted that the selection item intended by the user is not likely to be the selection item indicated by the predetermined operation.

  Therefore, after detecting a predetermined operation on the touch panel 9, the information processing apparatus 1 searches the selection history 27 for the latest selection item having a duration exceeding a predetermined value, determines the execution target, and performs corresponding processing. Thereby, for example, in the case of a predetermined operation, when the operation position is unintentionally deviated from the previous operation position on the display surface, the information processing apparatus 1 changes the detected operation position to the previous operation position. It becomes possible to correct to. Therefore, it is possible to prevent unintended processing from being executed. The process corresponding to the selection item may include, for example, a process of determining execution coordinates corresponding to the selection item. Further, the process corresponding to the selection item can include information indicating the process to be executed and output of the process result. As a result, it is possible to confirm whether or not the processing intended is executed.

  As described above, according to the information processing apparatus 1 according to the first embodiment, there is a high possibility that an unrecognized situation can be avoided even though an unintended selection item is changed. Conversely, there is an increased possibility of avoiding a situation in which processing corresponding to a selection item different from the selection item indicated by the execution operation is performed even though there is no unintended change of the selection item in the execution operation.

  As an example, in the conventional technology that employs the selection item at the start of pressing as the selection item to be executed, depending on the setting of the threshold for detecting the start of pressing, another selection item is already touched at the time of actually detecting the pressing. There is a possibility. For example, there is a possibility that the user intends to select the item 31 in FIG. 2 but is in contact with the item 33 when the pressing is detected. In this case, although the user originally intends to select the process α, the process β is selected.

  However, the information processing apparatus 1 according to the first embodiment, for example, determines selection of a selection item in which the contact operation has remained for a predetermined time before pressing is determined, and thus avoids the above-described erroneous detection. Is possible.

  According to the information processing apparatus 1, processing such as determining the operation position first detected by the execution operation as the intended operation position, or determining only a change in a specific direction in the display of the selection item as an unintended change. Is not used. For this reason, according to the information processing apparatus 1, even when there is an unintended change in the selection item indicated by the execution operation on the touch panel 9, it is possible to accurately prevent an unintended process from being performed.

  Note that the hardware configuration of the information processing apparatus 1 is merely an example, and modifications such as providing a plurality of storage devices or connecting other devices such as an output device other than the display device are possible. The configuration of various data stored in the storage device 5 is an example, and is not limited to the above. For example, in the selection history 27, an example is described in which all histories in one operation period are retained. However, only a predetermined number from the latest history can be retained. In the operation history 29, the fixed coordinates are held, but it is not always necessary to hold them. The contents shown in the data table such as the item table 23 are only examples, and other forms such as collecting a plurality of data tables into one, or using the data contents as information indicating a storage area to be referred to next, etc. Is also interpreted as being within the scope of the deformation.

(Modification)
Hereinafter, modified examples will be described. This modification is a modification of the execution operation. In the first embodiment, as the execution operation, the pressing operation is given as an example. However, the present modification is an example in which the execution operation is a simultaneous operation on two different points on the display surface. In this modification, the same number is attached | subjected about the structure and operation | movement similar to 1st Embodiment, and duplication description is abbreviate | omitted.

  In the present modification, there is no need to detect a press, and therefore a configuration for detecting a change in contact area and an arrangement of a pressure sensor are unnecessary. Further, the program stored in the storage device 5 is different from the program 21 according to the first embodiment in the part relating to the detection of the execution operation. Other configurations of the information processing apparatus, data structures, and the like are the same as those in the first embodiment.

  FIG. 11 is a diagram illustrating an example of the execution operation according to the modification. FIG. 11 shows a state where items 31 and 33 are displayed as selection items. The selection operation according to this modification is the same as the selection operation according to the first embodiment. The first operation position 101 is an operation position for a selection operation by the first object 105. The first operation position 101 indicates the item 31.

  The second operation position 103 is an operation position of an operation by a second object 107 different from the first object 105. The second operation position 103 can be an arbitrary position where the operation position can be detected. For example, the second operation position 103 may be an operation position that does not indicate any selection item. It is assumed that the execution operation according to the present modification is an operation performed while the operation using the second object 107 is continued while the operation using the first object 105 is continued. That is, when the operation using the second object 107 is performed while the operation using the first object 105 is continued, the selection item indicated by the operation using the first object 105 is set as the execution target. .

  For example, when such an execution operation is performed using different fingers of the same hand, the first object 105 becomes the second object 107 with the first finger serving as the first object 105 placed on the display surface. It is necessary to move another finger and place it on the display surface. For this reason, the position at which the first finger is arranged may be deviated against the intention, and in this modification as well, the selection of the selection item different from the intention is confirmed as in the first embodiment. As a result, unintended processing may be performed. In the example of FIG. 11, the intention is to select the item 31, but there is a possibility that the first object 105 is in contact with the item 33 when the execution operation is detected. In this case, although the user originally intends to select the process α, the process β may be selected.

  Therefore, as in the first embodiment, a selection item having a duration exceeding the most recent predetermined value is confirmed as a selection item to be executed, and a corresponding process is performed to perform an unintended process. Can be prevented. Further, since the position detection device 13 does not need to detect pressing, it is not necessary to arrange at least a pressure sensor, and there is an effect that a small touch panel can be used rather than a touch panel equipped with the pressure sensor. Therefore, when the touch panel and the information processing apparatus 1 are integrally formed, the apparatus can be reduced in size.

(Second Embodiment)
Hereinafter, an information processing apparatus according to the second embodiment will be described. In the second embodiment, the same configurations and operations as those of the first embodiment or the modified example are denoted by the same reference numerals, and redundant description is omitted.

  In the second embodiment, the program for controlling the operation of the information processing apparatus stored in the storage device 5 is different from the program 21 according to the first embodiment in the part of the coordinate correction processing described later. It becomes. Further, an operation history 111 is used instead of the operation history 29. Other configurations of the information processing apparatus, data structures, and the like are the same as those in the first embodiment. Therefore, hereinafter, the processing according to the second embodiment will be described as being performed by the information processing apparatus 1.

  In the second embodiment, in addition to the process of determining the selection item to be executed according to the first embodiment, the process of determining the selection item to be executed is performed based on the detection order of the selection item in the selection history. In the second embodiment, when correction is not performed in the selection item determination process according to the first embodiment, the selection item determination process is performed based on the selection item detection order. A flag is used. The correction means that a selection item different from the selection item indicated by the operation position of the execution operation is determined as a selection item to be executed.

  FIG. 12 is a diagram illustrating an example of an operation history according to the second embodiment. The operation history 111 has a corrected flag in addition to each data of the operation history 29. The corrected flag is information indicating “completed” when the correction is performed, and “not yet” when the correction is not performed.

  FIG. 13 is a diagram illustrating an example of correction processing according to the detection order of selection items according to the second embodiment. FIG. 13 shows an example in which a selection item 113 in which the items α, β, and γ are arranged adjacent to each other is displayed. An arrow 115 indicates the transition of the operation position. That is, the arrow 15 indicates that the selection item indicated by the selection operation is detected in the order of item α → item β → item γ → item β → item γ, and the execution operation is detected in accordance with the selection operation of the last item γ. Show. In this example, the item γ is selected once, but the execution operation is not performed, the selection operation of the item β is detected, and the execution operation of the item γ is further performed. In such a case, it is difficult to consider that the user intends the process corresponding to the item γ for which it has been decided not to perform the execution operation once. That is, it is estimated that the selection item intended by the user is highly likely to be the item β. Therefore, when the operation position of the execution operation and the operation position of the second selection operation indicate the same item, the selection item indicated by the operation position detected immediately before the execution operation is corrected as an execution target. To do.

  FIG. 14 is a flowchart illustrating a part of a basic operation example of the information processing apparatus according to the second embodiment. The flowchart of FIG. 14 shows processing performed instead of the processing according to the flowchart of FIG. 10 described in the first embodiment. That is, S121 in FIG. 14 is a process performed when a predetermined operation is detected in S85 in FIG.

  When a predetermined operation is detected in S85 of FIG. 9 (S85: YES), as shown in FIG. 14, the arithmetic processing unit 3 stores the duration of the selection item of the predetermined operation in the selection history 27 (S121). ). At this time, the arithmetic processing device 3 can set the elapsed time from the entry time of the selection item indicated by the predetermined operation as the duration.

  The arithmetic processing unit 3 determines whether n = 0 for the detection order n (S122). When n = 0 (S122: YES), the arithmetic processing unit 3 determines the selection item with the identification number ID = n = 0 as the execution target because there is no history of other selection items in the selection history 27. (S123). For example, the arithmetic processing device 3 refers to the selection item to be executed in the item table 23 and stores the corresponding execution coordinates in the operation history 111.

  For example, the arithmetic processing unit 3 determines the execution coordinates set in the operation history 111 as the process corresponding to the determined selection item (S124). At this time, for example, the arithmetic processing device 3 reads the execution coordinates set in the operation history 111, and executes a process associated with the selection item to be executed based on the read execution coordinates. For example, the arithmetic processing device 3 can output information indicating a selection item to be executed and a processing result. If n = 0 is not satisfied (S122: NO), the arithmetic processing unit 3 corrects the coordinates (S125), and advances the process to S124. The correction of coordinates can be performed by the processing shown in FIGS.

  FIG. 15 is a flowchart illustrating an example of coordinate correction processing according to the second embodiment. The process of FIG. 15 is a process performed in S125 of FIG. As shown in FIG. 15, the arithmetic processing unit 3 reads a threshold time Tth as a predetermined value from the threshold data 25 (S131). The arithmetic processing unit 3 performs correction based on the duration time (S132). The correction based on the duration includes processing similar to the processing performed in the case of NO in S92 in the first embodiment, and details of the processing will be described later.

  The arithmetic processing device 3 refers to the operation history 111 to determine whether the corrected flag is “not yet” or “completed” (S133). When it is determined that the corrected flag is “not yet” and correction has not been performed (S133: NO), the arithmetic processing device 3 performs correction according to the detection order of the selected items (S134). After S134 and when it is determined that the correction flag is “completed” and correction has been performed (S133: YES), the arithmetic processing unit 3 returns to the process of FIG. 14 and continues the process.

  FIG. 16 is a flowchart illustrating an example of the correction process based on the duration according to the second embodiment. The process of FIG. 16 is a detailed process of S132 of FIG. As illustrated in FIG. 16, the arithmetic processing device 3 refers to the selection history 27 and determines whether or not the duration of the selection item of the latest identification number ID exceeds a predetermined value (S141). The predetermined value is, for example, the threshold time Tth read in S131. When the duration exceeds the predetermined value (S141: YES), the arithmetic processing unit 3 determines the selected item with the latest ID = n as in the process of S123 of FIG. That is, the arithmetic processing device 3 confirms the selection item as an execution target selection item, and sets the execution coordinates corresponding to the confirmed selection item in the operation history 111 (S142).

  When the duration time is equal to or less than the predetermined value (S141: NO), the arithmetic processing unit 3 sets the variable i as i = n−1 (S143). When i ≧ 0 (S144: YES), the arithmetic processing unit 3 determines whether or not the duration of ID = i exceeds a predetermined value (S45). That is, the arithmetic processing device 3 refers to the duration of ID = i in the selection history 27 and performs the determination. When the duration time is equal to or less than the predetermined value (S145: NO), the arithmetic processing unit 3 sets i = i−1 (S146), and repeats the processing from S144. If i <0 in S144 (S144: NO), the arithmetic processing unit 3 returns to the process of FIG. 15 and continues the process.

  When the duration exceeds the predetermined value (S145: YES), the arithmetic processing unit 3 determines the selection item with ID = i as an execution target, and sets the execution coordinates in the operation history 111, for example (S147). The arithmetic processing unit 3 updates the corrected flag to “completed” in the operation history 111 (S148), returns to the process of FIG. 15, and continues the process.

  FIG. 17 is a flowchart illustrating an example of correction processing according to the detection order of selection items according to the second embodiment. In the present embodiment, the correction based on the detection order of selection items is the process of S134 in FIG. This process is executed in S132 when the selection item to be executed is the same as the selection item indicated by the execution operation as a result of the correction process based on the duration time. The correction according to the detection order of the selection items of the present embodiment is executed when the selection item indicated by the predetermined operation is the same as the selection item corresponding to the identification number ID two times before the predetermined operation in the selection history 27. .

  As described with reference to FIG. 13, the situation where the selection item indicated by the predetermined operation is the same as the previous selection item in the detection order is that the item that has been selected once but not executed is again displayed. Indicates that the execution operation has been selected. In such a situation, it is estimated that there is a high possibility that the execution operation is performed with the operation position shifted, despite the intention to select the selection item immediately before the selection item indicated by the predetermined operation. . Therefore, when the correction by the duration is not performed, the selection item immediately before the selection item of the predetermined operation is set as the execution target selection item by the correction according to the detection order of the selection items.

  As shown in FIG. 17, when n ≦ 2 is satisfied (S151: NO), the arithmetic processing unit 3 returns to the process of FIG. 14 and continues the process. If n> 2 (S151: YES), the arithmetic processing unit 3 sets the variable j to j = n−2 (S152). If the selection item of identification number ID = n does not match the selection item of identification number ID = j = n−2 in the selection history 27 (S153: NO), the arithmetic processing unit 3 performs FIG. Return to the process and continue the process.

  When the selection item of identification number ID = n matches the selection item of identification number ID = n−2 in the selection history 27 (S153: YES), the arithmetic processing unit 3 makes a variable j = n. −1 (S154). The arithmetic processing device 3 refers to, for example, the item table 23 to determine the selection item with the identification number ID = j as an execution target, and sets, for example, an execution coordinate corresponding to the selection item to be executed in the operation history 111 ( S155). The arithmetic processing unit 3 updates the corrected flag to “completed” in the operation history 111 (S156), returns to the process of FIG. 15, and continues the process.

  As described above, according to the information processing apparatus 1 according to the second embodiment, when a predetermined operation is detected, if a history other than the selection item indicated by the predetermined operation is in the selection history 27, the duration time Correction processing is performed. When the duration of the selection item indicated by the predetermined operation exceeds the predetermined value, it is determined that the selection item indicated by the operation position of the predetermined operation is the execution target selection item, and the corresponding processing is performed.

  When the duration of the selection item indicated by the predetermined operation is less than or equal to the predetermined value, the selection history 27 is searched for selection items having a duration exceeding the predetermined value in the reverse order of the position information detection order. If a search is made, the arithmetic processing unit 3 performs a process for executing the searched selection item, and updates the corrected flag of the operation history 111 to “completed”.

  The information processing apparatus 1 further performs correction according to the detection order of the selection items in the selection history with respect to the execution target selection item whose correction flag is “not yet”. With this correction, when the selection item indicated by the execution operation is the same as the second selection item in the position information detection order, the previous selection item is determined as the execution target.

  As described above, according to the information processing apparatus 1 according to the second embodiment, unintentional processing can be more accurately prevented with respect to an execution operation on a selection item that has been selected once but not executed. can do. In the example of FIG. 13, when the user once performs a selection operation corresponding to the item γ, but does not perform the execution operation, it is determined that it is difficult to think that the item γ is the intended process. In this case, it is determined that the item β corresponding to the selection item immediately before the item γ is the intended process. Therefore, according to the information processing apparatus 1 according to the second embodiment, in addition to the effects exhibited by the information processing apparatus 1 according to the first embodiment and the modifications thereof, it is possible to prevent unintended processing from being performed with higher accuracy. There is an effect.

  The correction process according to the detection order of the selection items according to the second embodiment is an example, and another interpretation may be applied to a selection history in a different order, and the correction process suitable for the interpretation may be performed. It is the range of the modification of this Embodiment. For example, the history to be referred to is two previous in the detection order of the position information, but the present invention is not limited to this.

(Third embodiment)
Hereinafter, an information processing apparatus 160 according to the third embodiment will be described. In the third embodiment, the same configurations and operations as those of the first embodiment, the modified example, or the second embodiment are denoted by the same reference numerals, and redundant description is omitted.

  FIG. 18 is a diagram illustrating an example of a hardware configuration of the information processing apparatus according to the third embodiment. As shown in FIG. 18, an information processing apparatus 160 according to the third embodiment includes an arithmetic processing unit 3, a storage device 165, and a touch panel 161, which are connected to each other via a bus 7 and can exchange information. ing. The touch panel 161 may be connected to an information processing apparatus including the arithmetic processing device 3 and the storage device 165 through a wired or wireless communication path.

  The arithmetic processing device 3 is an arithmetic processing device that performs processing for controlling the operation of the information processing device 160. The arithmetic processing device 3 controls the operation of the information processing device 160 by reading and executing an operation control program stored in advance in the storage device 165. The storage device 165 is a device that stores information, and is, for example, a RAM, a ROM, or the like. For example, the storage device 165 stores in advance information such as a program for controlling the operation of the information processing device 160 and parameters necessary for the operation of the information processing device 160. The storage device 165 appropriately stores information generated during operation of the information processing device 160. For example, the storage device 165 stores a program 167 that controls the operation of the information processing device 160 according to the third embodiment, an item table 23, threshold data 25, a selection history 27, an operation history 111, and the like.

  The touch panel 161 is an input / output device used for input / output of the information processing device 160. The touch panel 161 includes the display device 11 and the position detection device 13 like the touch panel 9. The touch panel 161 further includes an inclination detection device 163. The inclination detection device 163 is a detection device that detects an inclination angle between the display surface of the touch panel 161 and, for example, the vertical direction. The tilt detection device 163 can be, for example, an acceleration sensor. The tilt detection device 163 detects the tilt angle and outputs it to the arithmetic processing device 3.

  FIG. 19 is a diagram illustrating an example of determining validity of correction based on an inclination angle according to the third embodiment. FIG. 19 shows determination examples 173 to 179 for determining the validity of correction by dividing the inclination angle into four ranges. As illustrated in FIG. 19, the display surface 182 is a display surface of the touch panel 161. One point at the upper end of the display surface of the touch panel 161 is a point a, and one point at the lower end is a point b.

  The object 185 is an object that performs an operation on the touch panel 161. Items α, β, and γ are selection items indicating selectable processes. Although the items α, β, and γ are represented with a thickness, this thickness is for convenience and indicates that the items α, β, and γ are displayed on the display device 11 of the touch panel 161. Yes. The angle θ is, for example, an angle in the clockwise direction in the figure formed by the vertical direction 181 and the display surface 182 in FIG.

  In the determination example 173, the inclination angle θ is 0 ° ≦ θ <90 °. At this time, a right triangle abc1 formed by a back surface 183 of the display surface 182 and straight lines in the vertical and horizontal directions is shown. In the determination example 173, the state in which the shift in the direction 186 toward the horizontal side of the right triangle abc1 is corrected is determined as appropriate correction. For example, in the example of the determination example 173, if an execution operation intended for the process β is detected as an execution operation for the process γ, the execution target selection item is corrected to the selection item corresponding to the process β. Is determined to be correct. In this determination, for example, when the user faces the touch panel 161 in an upright state, it is estimated that the operation position of the execution operation by the object 185 is highly likely to move in the direction 186 against the intention. to cause.

  In the determination example 175, the inclination angle θ is 90 ° ≦ θ <180 °. At this time, a back surface 183 of the display surface 182 and a right triangle abc2 formed by straight lines in the vertical direction and the horizontal direction are shown. In the determination example 175, the state in which the shift in the direction 187 toward the horizontal side of the right triangle abc2 is corrected is determined to be appropriate correction. In this determination, for example, when the user is leaning forward and facing the touch panel 161 tilted to the above-described inclination angle, the operation position of the execution operation by the object 185 such as the thumb is a direction contrary to the intention. This is because the possibility of moving to 187 is estimated to be high.

  In the determination example 177, the inclination angle θ is 180 ° ≦ θ <270 °. At this time, a back surface 183 of the display surface 182 and a right triangle abc3 formed by straight lines in the vertical direction and the horizontal direction are shown. In the determination example 177, the state in which the shift in the direction 188 toward the horizontal side of the right triangle abc3 is corrected is determined as appropriate correction. In this determination, for example, when the user lies on his back in a state of being almost horizontal to the head and performs a thumb operation using only one hand facing the touch panel 161, the operation position of the execution operation is a direction contrary to the intention. This is because the possibility of moving to 188 is estimated to be high.

  In the determination example 179, the inclination angle θ is 270 ° ≦ θ <360 °. At this time, the back surface 183 of the display surface 182 and a right triangle abc4 formed by vertical and horizontal straight lines are shown. In the determination example 179, the state in which the shift in the direction 189 toward the horizontal side of the right triangle abc4 is corrected is determined as appropriate correction. This determination is made, for example, when the user lies on his back with his head raised and performs a thumb operation using only one hand facing the touch panel 161, the operation position of the execution operation is in the direction 189 against the intention. This is because it is estimated that there is a high possibility of moving to. As described above, in the validity determination of the correction according to the third embodiment, the back surface 183 of the display surface 182 of the touch panel 161 and the right triangle formed in the horizontal direction and the vertical direction are directed to the horizontal side. It is determined that the correction of the deviation is appropriate.

  As described above, the operation in the case of determining the validity of the correction based on the tilt angle of the touch panel 161 will be further described with reference to the flowchart. FIG. 20 is a flowchart illustrating an example of coordinate correction processing performed by the information processing apparatus according to the third embodiment. In the present embodiment, the basic operation is the same as the processing described with reference to FIGS.

  The process of FIG. 20 is a process performed in S125 of FIG. As shown in FIG. 20, the arithmetic processing unit 3 reads the threshold time Tth from the threshold data 25 (S191). The arithmetic processing unit 3 performs correction based on the duration time (S192). The details of the correction based on the duration time are the same as those described with reference to FIG.

  The arithmetic processing device 3 refers to the operation history 111 to determine whether the corrected flag is “not yet” or “completed” (S193). When it is determined that the corrected flag is “not yet” and correction is not performed (S193: NO), the arithmetic processing unit 3 performs correction according to the detection order of the selected items (S194). The details of the correction based on the detection order of the selection items are the same as the processing described with reference to FIG.

  When it is determined that the correction flag is “completed” and correction is being performed (S193: YES), the arithmetic processing unit 3 performs a correction validity determination process (S195), and returns to the process of FIG. And continue processing.

  FIG. 21 is a flowchart illustrating an example of a correction validity determination process according to the third embodiment. As illustrated in FIG. 21, the arithmetic processing device 3 refers to, for example, the operation history 111 and determines whether or not the correction has been made (S201). When the correction is not performed (S201: NO), the arithmetic processing device 3 returns to the process of FIG. 20 and continues the process.

When correction is performed (S201: YES), the arithmetic processing unit 3 determines whether or not the inclination angle θ is within a predetermined angle range (S202). For example, the arithmetic processing device 3 determines whether or not the inclination angle θ satisfies the following expression 1.
0 ° ≦ θ <90 ° or 180 ° ≦ θ <270 ° (Formula 1)

  When it is within the predetermined angle range (S202: YES), the arithmetic processing unit 3 determines whether the correction that has been made is a correction for a downward shift of the display surface 182 (S203). That is, it is determined whether the correction is for the deviation in the direction 186 or 188 shown in FIG. At this time, the arithmetic processing device 3 refers to the determined coordinates (xf, yf) and the execution coordinates (xp, yp) stored in the operation history 111 based on the item table 23, for example, on the display surface 182. Determine the direction of displacement. The direction of deviation is, for example, the direction from the execution coordinates (xp, yp) to the final coordinates (xf, yf). The direction of deviation can also be referred to as a direction from the display area of the selection item to be executed on the display surface to the display area of the selection item indicated by the execution operation. When it is correction | amendment with respect to the shift | offset | difference which makes the downward direction of the display surface 182 a shift | offset | difference direction (S203: YES), the arithmetic processing apparatus 3 returns to the process of FIG. When it is not correction of the shift in which the downward direction is the shift direction (S203: NO), the arithmetic processing unit 3 determines the selection item indicated by the execution operation and sets, for example, the execution coordinate corresponding to the operation history 111 (S204). Returning to the process of FIG. 20, the process is continued.

  When it is outside the predetermined angle range (S202: NO), the arithmetic processing unit 3 determines whether the correction that has been made is a correction for a shift with the upward direction of the display surface 182 as a shift direction (S205). That is, it is determined whether or not the correction is for the shift with the direction 187 or 189 as the shift direction shown in FIG. At this time, the arithmetic processing device 3 refers to the determined coordinates (xf, yf) and the execution coordinates (xp, yp) stored in the operation history 111 based on the item table 23, for example, on the display surface 182. Determine the direction of displacement. In the case of correction for a shift in which the upward direction of the display surface 182 is the shift direction (S205: YES), the arithmetic processing device 3 returns to the process of FIG. 20 and continues the process. When it is not correction of the shift in which the upward direction is the shift direction (S205: NO), the arithmetic processing unit 3 determines the selection item indicated by the execution operation and sets, for example, the execution coordinate corresponding to the operation history 111 (S204). Returning to the process of FIG. 20, the process is continued.

  As described above, according to the information processing apparatus 160 according to the third embodiment, the tilt angle θ of the display surface of the touch panel 161 is detected. In the information processing apparatus 160, it is determined whether or not the correction that has been performed is appropriate, according to the detected inclination angle θ and the direction of the deviation in the correction process that has already been performed. When it is determined that the correction is not appropriate, the arithmetic processing device 3 can set the selection item to be executed to the selection item indicated by the execution operation. That is, according to the determination result of the validity of the correction, one of the selection items indicated by the execution operation and the selection item that is the execution target in the correction process that has been performed previously is determined as the execution target and corresponds. Processing is performed.

  At this time, the arithmetic processing device 3 is based on the display information indicating the display position of the selection item indicated by the execution operation and the display information indicating the display position of the selection item to be executed in the correction processing performed previously. The direction of the corrected deviation is determined. For example, the arithmetic processing device 3 can determine the validity of the correction using the execution coordinates (xp, yp) and the confirmed coordinates (xf, yf) stored in the operation history 111 as display information. Further, the arithmetic processing device 3 uses, as display information, a display area in which the selection item to be executed and the selection item indicated by the execution operation among the selection items stored in the selection history 27 are associated with each other in the item table 23. The validity of the correction can be determined.

  In the example of FIG. 19, it is determined that correction of the deviation of the back surface 183 of the display surface 182 of the touch panel 161 and the right triangle formed in the horizontal direction and the vertical direction toward the horizontal side is appropriate.

  As described above, according to the information processing apparatus 160 according to the present embodiment, the correction performed based on the selection history 27 is further associated with the tilt angle θ of the display surface and the selection items stored in the selection history 27. Based on the displayed display information, the validity of the correction is determined. That is, the selection item to be executed is determined based on the selection history, the display information associated with the selection item stored in the selection history and stored in the storage device 5, and the tilt angle of the display surface. Thereby, in addition to the effect which the information processing apparatus 1 by 1st Embodiment, a modification, or 2nd Embodiment show | plays, it can prevent that the process which is not intended is performed more accurately.

  Note that the relationship between the inclination angle and the validity of the correction is an example, and a modification example in which a correction in a predetermined direction is appropriate for another inclination angle range is displayed in this embodiment. This is within the scope of the idea of determining the appropriateness of correction according to the inclination angle of the surface.

(Fourth embodiment)
The information processing apparatus 220 according to the fourth embodiment will be described below. In the fourth embodiment, the same configurations and operations as those in the first to third embodiments or the modified examples are denoted by the same reference numerals, and redundant description is omitted.

  FIG. 22 is a diagram illustrating an example of a hardware configuration of the information processing apparatus according to the fourth embodiment. As shown in FIG. 22, the information processing apparatus 220 according to the fourth embodiment includes an arithmetic processing device 3, a storage device 225, a touch panel 161, and a speaker 221 that are connected to each other via a bus 7 and can exchange information. doing. The touch panel 161 and the speaker 221 may be connected to an information processing apparatus including the arithmetic processing device 3 and the storage device 225 through a wired or wireless communication path.

  The arithmetic processing device 3 is an arithmetic processing device that performs processing for controlling the operation of the information processing device 220. The arithmetic processing device 3 controls the operation of the information processing device 1 by reading and executing an operation control program stored in advance in the storage device 225. The storage device 225 is a device that stores information, and is, for example, a RAM, a ROM, or the like. For example, the storage device 225 stores in advance information such as a program for controlling the operation of the information processing device 220 and parameters necessary for the operation of the information processing device 220. The storage device 225 appropriately stores information generated during operation of the information processing device 220. For example, the storage device 225 includes a program 227 that controls the operation of the information processing device 220 according to the fourth embodiment, an item table 23, threshold data 25, selection history 281, operation history 283, threshold setting data 285, and reading information 287. Etc. are remembered. The program 227 may include a program for executing reading. Note that reading out means that, for example, sound related to the selected item is reproduced via the speaker 221.

  FIG. 23 is a diagram for explaining an example of a reading process according to the fourth embodiment. FIG. 23 shows an example in which items 231 to 234 are displayed on the display screen of the touch panel 161. The object 240 is an object to be operated.

  The reading example 244 indicates that when the selection operation by the object 240 indicates the item 232 as indicated by the arrow 240, the character string “IN” indicated by the underline 246 is read out.

  The reading example 250 shows a state in which the object 240 has moved 248 following the reading example 244 and the selection operation indicating the item 231 has been detected. At this time, the arithmetic processing unit 3 reads out the character string “apply phone” indicated by the underline 252 as in the reading example 250.

  Furthermore, the reading example 256 indicates that, following the reading example 250, an execution operation by the object 240 is detected. As described with reference to the reading example 250, the arithmetic processing device 3 reads the character string “apply phone” indicated by the underlined part 252 while the operation position indicates the item 231. However, it is assumed that the operation position of the object 240 is moved as in the movement 254 during the execution operation. The reading example 256 indicates that, at this time, the arithmetic processing device 3 detects the selection operation indicating the item 232, for example, reads “I” in the underlined portion 258, but ends the reading when the execution operation is detected. ing.

  FIG. 24 is a diagram illustrating an example of a reading state according to the fourth embodiment. As illustrated in FIG. 24, the reading example 261 indicates that “I”, “Call phone”, and “I” are read out. The selection items 263 are “Internet” of item 232 and “telephone” of item 231. For example, the pressure device output 265 indicates that the execution operation 267 has been detected at the timing when “I” is read out according to the item 232.

  In the example of FIGS. 23 and 24, the selection item indicated by the execution operation is the item 232. However, the actual process is not limited to the process corresponding to the selection item indicated by the execution operation. For example, according to the selection item determined based on the selection history 281 described later, such as a selection item whose duration exceeds a predetermined value. Processing.

  FIG. 25 is a diagram illustrating an example of a selection history according to the fourth embodiment. The selection history 281 is information in which selection items for which a selection operation is detected in one operation period on the touch panel 9 are stored in the order of detection of operation positions. The selection history 281 includes selection item identification information, selection item entry time, duration, number of reading phrases, and reading flag. The selection history 281 is stored in the storage device 5, for example.

  The identification information of the selection item can be the name of the process corresponding to the selection item, the coordinates of the display area associated with the selection item, and the like. The selection item entry time indicates the time when the operation position has entered the display area corresponding to the selection item. The continuation time is a time during which the operation position continuously indicates the selection item. The number of phrases read out is the number of phrases that have been read out in the character string associated with the selected item. The reading flag is information indicating the reading status of the character string associated with the selected item.

  For example, when the selection item identification number ID = n (n is an integer greater than or equal to zero), the selection item Sn, the selection item entry time tn, the duration Tn, and the number of reading phrases kn (kn is an integer greater than or equal to zero) are It is remembered. Further, the reading flag may be information indicating “not yet” when reading is not performed, “start” when starting, “complete” when completing, or the like. The detection order n indicates the detection order of selection items in one operation period.

  FIG. 26 is a diagram illustrating an example of an operation history according to the fourth embodiment. The operation history 283 has fixed coordinates (xf, yf), execution coordinates (xp, yp), threshold time Tth, corrected flag, and latest identification number ID. The fixed coordinates (xf, yf) are coordinates representing the display area of the selection item indicated by the execution operation detected by the arithmetic processing device 3, for example. The execution coordinates (xp, yp) are, for example, coordinates representing the display area of the selection item to be executed. The threshold time Tth is a predetermined value determined according to the reproduction speed at the time of reading. The determination method will be described later. The corrected flag is information indicating whether correction has been performed when the selection item to be executed is determined. The latest ID is information indicating the newest detection order in one operation period. The operation history 283 is stored in the storage device 5, for example.

  FIG. 27 is a diagram illustrating an example of threshold setting data according to the fourth embodiment. As shown in FIG. 27, a threshold time Tth is set in the threshold setting data 285 according to the reading speed level. The threshold time Tth is an example of a predetermined value. The threshold time Tth is set longer as the reading speed is slower. The threshold time Tth is preferably set to a time at which the user can understand the meaning of the character string read out. For example, it may be the time required to read out the predetermined number of phrases. In addition, the numerical value described in the threshold setting data 285 is an example, and does not limit the threshold time according to the present embodiment.

  FIG. 28 is a diagram illustrating an example of read-out information according to the fourth embodiment. As shown in FIG. 28, a character string is stored in association with each selection item as read-out information. For example, the item “phone” is associated with a character string “call”. For example, when detecting a selection operation indicating the item “telephone”, the arithmetic processing device 3 refers to the reading information 287 to read a character string “call” and read it out.

  FIG. 29 is a flowchart illustrating an example of a coordinate correction process in the information processing apparatus according to the fourth embodiment. The basic operation of the information processing apparatus 220 according to the fourth embodiment is the same as the processing shown in FIGS. The coordinate correction process shown in FIG. 29 is the details of the process of S125 of FIG.

  As shown in FIG. 29, the arithmetic processing unit 3 determines whether or not the speech reading function is valid (S291). This determination can be made based on, for example, whether the speaker 221 is connected or a program for reading out is available.

  When the speech reading function is invalid (S291: NO), the arithmetic processing unit 3 performs the same coordinate correction processing as in the third embodiment. That is, the arithmetic processing device 3 reads the threshold time Tth from the threshold data 25 (S292). The arithmetic processing unit 3 performs correction based on the duration using, for example, the selection history 281 (S293). Details of the correction based on the duration time are the same as those described with reference to FIG.

  The arithmetic processing unit 3 refers to the operation history 283 and determines whether the corrected flag is “not yet” or “completed” (S294). When the corrected flag is “not yet” and it is determined that the correction is not performed (S294: NO), the arithmetic processing device 3 performs correction according to the detection order of the selection items using the selection history 281, for example (see FIG. S295). Correction according to the detection order of the selection items is the same as the processing described with reference to FIG.

  When it is determined that the correction flag is “completed” and correction has been performed (S294: YES), the arithmetic processing unit 3 performs a correction validity determination process, and returns to the process of FIG. Continue (S296).

  When it is determined in S291 that the speech reading function is valid (S291: YES), the threshold time Tth is specified by the threshold setting data 285 (S297). The arithmetic processing unit 3 sets the specified threshold time Tth in, for example, the operation history 283 (S298). The arithmetic processing unit 3 performs correction based on the duration using the set threshold time Tth (S299). For example, the correction process based on the duration time can be the same as the process described with reference to FIG. 16 in the second embodiment.

  The arithmetic processing unit 3 refers to the operation history 283 and determines whether or not the correction has been made (S300). If the correction has been made (S300: YES), the arithmetic processing unit 3 performs the processing from S294. If it has not been corrected (S300: NO), it is corrected by a reading phrase (S301). Details of the processing of S301 will be described with reference to FIG.

  FIG. 30 is a flowchart illustrating an example of correction processing using a reading phrase according to the fourth embodiment. As shown in FIG. 30, the arithmetic processing unit 3 refers to the operation history 283 to determine what state the reading flag is in (S311). When the reading flag is “not yet” (S311: “not”), the arithmetic processing device 3 returns to the processing of FIG. 29 and continues the processing. When the reading flag is “completed” (S311: “completed”), the arithmetic processing unit 3 determines the selection item indicated by the detected execution operation as an execution target (S312). At this time, the arithmetic processing device 3 extracts the coordinates associated with the selection item indicated by the execution operation with reference to, for example, the item table 23 and sets the coordinates in the operation history 283.

  When the reading flag is “start” (S311: “start”), the arithmetic processing device 3 sets the variable i = n−1 (S313). When i ≧ 0 (S314: YES), the arithmetic processing unit 3 refers to the number of reading phrases kn in the selected item in the selection history 281 (S315). If i <0 in S314 (S314: NO), the arithmetic processing unit 3 returns to the process of FIG. 29 and continues the process.

  The arithmetic processing unit 3 sets i = i−1 when the number of reading phrases kn ≦ 1 (S315: YES) (S316), and repeats the processing from S314. When the number of reading phrases kn> 1 (S315: NO), the arithmetic processing unit 3 determines the selection item with the identification number ID = i as an execution target. At this time, the arithmetic processing unit 3 sets the coordinates in the display area of the selection item determined as the execution target as the execution coordinates, and stores them in the operation history 283, for example (S317). The arithmetic processing unit 3 updates the corrected flag of the operation history 283 to “Done” (S318), returns to the process of FIG. 29, and continues the process. As a result of the correction processing using the above-mentioned reading phrase, the nearest selection item having the number of reading phrases kn of a predetermined number or more is set as an execution target. The correction process is not limited to the example executed after the correction by the duration based on the threshold setting data 285 described in the present embodiment, and is executed after the correction by the duration based on the threshold data 25, for example. Such modifications are possible.

  FIG. 31 is a flowchart illustrating an example of processing at the time of reading according to the fourth embodiment. The process of FIG. 31 is a process performed in parallel with other processes after the process of S81 described in FIG. 9 and after the process of S85 when the reading process is performed.

  As shown in FIG. 31, the arithmetic processing unit 3 waits until the start of reading is confirmed (S331: NO). When the start of reading is confirmed (S331: YES), the arithmetic processing unit 3 changes the reading flag of the selection history 281 to “start” (S332). The arithmetic processing unit 3 determines whether or not the reading has been completed. If not (S333: NO), the arithmetic processing unit 3 determines whether or not the reading target has been changed (S334).

  If there is no change in the reading target (S334: NO), the processing is repeated from S333. When there is a change in the reading target (S334: YES), the arithmetic processing unit 3 stores the number of reading phrases in the selection history 281 (S335), and ends the processing at the time of reading.

  If the end of reading is confirmed in S333 (S333: YES), the arithmetic processing unit 3 updates the reading flag of the selection history 281 to “completed” (S336). The arithmetic processing unit 3 ends the process at the time of reading. As described above, the selection history 281 is updated by the processing at the time of reading.

  As described above, according to the information processing apparatus 220 according to the fourth embodiment, when the reading function is not valid, the same processing as that of the information processing apparatus 160 according to the third embodiment is performed. When the reading function is valid, when a selection operation is performed, the information processing apparatus 220 reads a character string associated with the selection item indicated by the selection operation. The reproduction speed for reading is set in advance, for example. The arithmetic processing device 3 refers to the threshold setting data 285, for example, and sets a threshold time corresponding to the set reproduction speed. Therefore, according to the information processing apparatus 220 according to the fourth embodiment, the selection item in which the associated character string is read out for the length necessary to recognize the content is set as the selection item to be executed. The possibility of being able to be increased can be increased.

  In the example of FIGS. 23 and 24, the selection item indicated by the execution operation is the item 232. However, the actual process is not limited to the process corresponding to the selection item indicated by the execution operation. For example, according to the selection item determined based on the selection history 281 such as the selection item 231 whose duration exceeds a predetermined value. It becomes processing. Thereby, in addition to the effects of the first to third embodiments and modifications, it is possible to further enhance the effect of preventing processing unintended by the user.

  Furthermore, according to the information processing apparatus 220 according to the fourth embodiment, when the duration is not corrected, the correction by the reading phrase is performed. At this time, the latest selection item for which the preset number of phrases has been read out can be extracted from the selection history 281 and can be used as the execution target selection item. In other words, the information processing device 220 searches the storage device for selection items for which the reproduction of a predetermined number of clauses has been completed in the reverse order of detection of position information, and performs processing corresponding to the searched selection items.

  Therefore, the information processing device 220 according to the fourth embodiment can select the selection item indicated by the execution operation performed after understanding the meaning as the selection item to be executed, and execute the unintended process more reliably. Can be prevented. In addition, by performing processing corresponding to the selection item of the execution operation performed after the length of information that can be recognized is read out, for the user of the voice reading function, the determination accuracy of the operation position deviation is further increased. An improved information processing apparatus can be provided.

  The present invention is not limited to the embodiments described above, and various configurations or embodiments can be adopted without departing from the gist of the present invention. For example, the content of each data described above may be other data having the same meaning. The operation described in each flowchart is an example, and another processing procedure capable of performing the same processing may be employed.

  Here, an example of a computer that is commonly applied to cause a computer to perform the operations of the information processing apparatuses according to the first to fourth embodiments and modifications will be described. FIG. 32 is a block diagram illustrating an example of a hardware configuration of a standard computer. As shown in FIG. 32, a computer 400 includes a central processing unit (CPU) 402, a memory 404, an input device 406, an output device 408, an external storage device 412, a medium drive device 414, a network connection device 418, and the like via a bus 410. Connected.

  The CPU 402 is an arithmetic processing unit that controls the operation of the entire computer 400. The memory 404 is a storage device for storing a program for controlling the operation of the computer 400 in advance or using it as a work area as needed when executing the program. The memory 404 is, for example, a RAM or a ROM.

  The input device 406 is a device that, when operated by a computer user, acquires various information inputs from the user associated with the operation content, and sends the acquired input information to the CPU 402. Keyboard device, mouse device, etc. The output device 408 is a device that outputs a processing result by the computer 400, and includes an audio output device, a display device, and the like. For example, the display device displays text and images according to display data sent by the CPU 402.

  The external storage device 412 is, for example, a storage device such as a hard disk, and stores various control programs executed by the CPU 402, acquired data, and the like. The medium driving device 414 is a device for writing to and reading from the portable recording medium 416. The CPU 402 can perform various control processes by reading and executing a predetermined control program recorded on the portable recording medium 416 via the medium driving device 414. The portable recording medium 416 is, for example, a Compact Disc (CD) -ROM, a Digital Versatile Disc (DVD), a Universal Serial Bus (USB) memory, a memory card, or the like. The network connection device 418 is an interface device that manages transmission / reception of various data performed between the outside by wired or wireless. A bus 410 is a communication path for connecting the above devices and the like to exchange data.

  Programs 21, 167, 227, and the like that cause a computer to execute processing in the information processing apparatus according to the first to fourth embodiments and modifications are stored in, for example, the external storage device 412. The CPU 402 performs information processing by reading a program from the external storage device 412 and executing the program using the memory 404. At this time, first, a control program for causing the CPU 402 to perform information processing is created and stored in the external storage device 412. Then, a predetermined instruction is given from the input device 406 to the CPU 402 so that the control program is read from the external storage device 412 and executed. The computer 400 is connected to the touch panel 9 or the touch panel 161, for example, and executes the program 21, the program 167, or the program 227, thereby performing the operation of the information processing apparatus according to the first to fourth embodiments or modifications. . Further, this program may be stored in the portable recording medium 416.

DESCRIPTION OF SYMBOLS 1 Information processing apparatus 3 Arithmetic processing apparatus 5 Storage apparatus 7 Bus 9 Touch panel 11 Display device 13 Position detection device 19 Position information 21 Program 23 Item table 25 Threshold data 27 Selection history 29 Operation history

Claims (6)

A storage device;
When detection of the position information is started by a position detection device that detects position information indicating an operation position on a display device that displays a selection item corresponding to a selectable process, the selection item indicated by the operation position The selection history in which the operation position continuously indicates the selection item is stored in the storage device and pressed on the display device while the detection of the position information is continued. When an operation is detected, an arithmetic processing device that determines a selection item to be executed based on a duration in the selection history and performs processing corresponding to the selection item to be executed;
An information processing apparatus comprising: The arithmetic processing unit is a case where a selection item to be executed based on the duration is not confirmed, and there are a plurality of selection items in the selection history that are the same as the selection item indicated by the operation position of the pressing operation. 2. The information processing apparatus according to claim 1, wherein when the selection is performed, the selection item selected immediately before the selection item indicated by the operation position of the pressing operation is determined as the selection item to be executed. In the storage device, a selection item corresponding to the selectable process and a character string are stored in association with each other,
The arithmetic processing device further reads out a character string associated with the selection item indicated by the operation position from the storage device, converts the read character string into sound, outputs the sound from a speaker, and outputs the sound The selection item to be executed is searched based on the selection item stored in association with the searched continuation time by searching for a duration exceeding a predetermined value set according to the reproduction speed of the operation position in the reverse order of the detection of the operation position. The information processing apparatus according to claim 1, wherein: The arithmetic processing unit further extracts a phrase from the character string in the order of output from the speaker, and corresponds the number of phrases extracted from a portion where the output of the character string is completed to the selection item of the selection history In addition, when the selection item indicated by the operation position of the pressing operation and the selection item stored in association with the searched duration are the same, based on the number of clauses The information processing apparatus according to claim 3, wherein a selection item to be executed is determined. The storage device stores a selection item corresponding to the selectable process and display information indicating a display position of the selection item corresponding to the selectable process on the display device in association with each other.
The arithmetic processing unit detects an angle formed by a display surface of the display device with a predetermined direction, the selection history, display information stored in the storage device in association with a selection item stored in the selection history, The information processing apparatus according to claim 1, wherein the selection item to be executed is determined based on the angle. When detection of the position information is started by a position detection device that detects position information indicating an operation position on a display device that displays a selection item corresponding to a selectable process, the selection item indicated by the operation position , The selection history in which the operation position continuously associates with the duration time indicating the selection item is stored in the storage device,
When a pressing operation on the display device is detected while the detection of the position information is continued, the selection item to be executed is confirmed based on the duration in the selection history,
A program for causing a computer to execute a process for performing a process corresponding to the selection item to be executed.

Images