JP2014222379A - Information terminal, touch operation processing method, and program - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide an information terminal that can be easily and intuitively operated.SOLUTION: An information terminal comprises: a display unit 101; a first touch sensor 103 for detecting a touch operation; a second touch sensor 104 for detecting a touch operation; and a processing unit 114 for performing first processing when a touch operation to the first touch sensor 103 is detected, and for performing, instead of the first processing, second processing having relevance with the first processing when a touch operation to the first touch sensor 103 is detected and a touch operation to the second touch sensor 104 is detected. The processing unit 114 moves an object on the basis of the touch operation to the first touch sensor 103 for moving the object on the display unit 101 while specifying the object on the basis of the touch operation to the second touch sensor 104.

Description

  The present invention relates to an information terminal, a touch operation processing method, and a program.

  In recent years, portable information processing terminals such as mobile phones have become widespread.

  Various techniques related to such a background are known (see, for example, Patent Document 1).

  For example, Patent Document 1 describes an input reception method using a portable information processing terminal. More specifically, the portable information processing terminal places the index finger of the user on the operation key when the hand is held with the touch panel surface facing forward. The touch sensor detects a tap or a double tap. The operation key inputs vector information by performing a continuous contact operation, a continuous half-press operation, or a continuous full-press operation. Thus, operability can be improved depending on the portable information processing terminal.

  There is also a technique for operating a game machine with fingers of both hands.

  Various techniques relating to such a background are known (see, for example, Patent Document 2).

  For example, Patent Document 2 describes a video game terminal device including a touch panel disposed on the front surface of the main body and a touch pad disposed on the back surface of the main body. More specifically, the terminal device operates the touch panel on the front surface with the thumb and operates the touch pad on the back surface with the other fingers when the main body is held sideways. Thus, depending on the terminal device, the input operability is good and various operation inputs can be handled.

International Publication No. 2011/145304 JP 2012-003305 A

  Depending on the technologies described in Patent Documents 1 and 2, it is not possible to easily perform the object movement and the screen scrolling properly, or the full screen scroll and the partial screen scrolling properly. In order to perform these usages with a single touch sensor, it is necessary to determine the operation method for each usage. However, if the operation method is not intuitive, the user often cannot remember the method. Further, when the number of operation methods increases, the user tends to be difficult to operate, particularly in the case of a mobile device, and may be forced to use both hands. As described above, the techniques described in Patent Documents 1 and 2 cannot be operated easily and intuitively.

  The objective of this invention is providing the information terminal, the touch operation processing method, and program which solve the subject mentioned above.

  In order to solve the above-described problem, according to a first aspect of the present invention, an information terminal is a display unit, a first touch sensor that detects a touch operation, a second touch sensor that detects a touch operation, A first process is performed by detecting a touch operation on the first touch sensor, a touch operation on the first touch sensor is detected, and a touch operation on the second touch sensor is detected. A processing unit that performs a second process having relevance to the first process, and the processing unit specifies an object by a touch operation on the second touch sensor, and an object in the display unit by the first touch sensor. The object is moved based on the touch operation for moving.

  According to a second aspect of the present invention, there is provided a touch operation processing method, wherein the first process is performed by detecting a touch operation on the first touch sensor of the display unit included in the information terminal, and the first touch sensor is processed. By detecting the touch operation and detecting the touch operation to the second touch sensor included in the information terminal, the second process having the relevance to the first process is performed instead of the first process, and the second touch is performed. The method includes a processing stage of moving an object based on a touch operation of moving the object on the display unit by the first touch sensor while designating the object by a touch operation on the sensor.

  According to the 3rd form of this invention, it is a program, Comprising: A computer performs a 1st process by detecting the touch operation to the 1st touch sensor of the display part which has in an information terminal, By detecting the touch operation and detecting the touch operation to the second touch sensor included in the information terminal, the second process having the relevance to the first process is performed instead of the first process, and the second touch is performed. While the object is designated by the touch operation on the sensor, the object is moved as a processing unit that moves the object based on the touch operation of moving the object on the display unit by the first touch sensor.

  It should be noted that the above summary of the invention does not enumerate all the necessary features of the present invention. Also, a sub-combination of these feature groups can also be an invention.

  As is clear from the above description, the present invention can be operated simply and intuitively.

It is a figure which shows an example of the block configuration of the information terminal 100 which concerns on one Embodiment. It is a perspective view showing the outline of the outline which looked at information terminal 100 from the surface side. It is a perspective view showing the outline of the outline which looked at information terminal 100 from the back side. 4 is a perspective view of the state in which the information terminal 100 is gripped with the right hand as viewed from the front side of the information terminal 100. FIG. 4 is a perspective view of the back side of the information terminal 100 viewed from the front side of the information terminal 100 in a state where the information terminal 100 is held with the right hand. FIG. It is a flowchart explaining control operation. It is explanatory drawing which shows the example of the telephone directory information which the memory | storage part 109 of the information terminal 100 memorize | stores. It is explanatory drawing which shows the example of a display image when the information terminal 100 performs the telephone directory display function in normal mode. It is explanatory drawing which shows the example of a display screen when the information terminal 100 performs the telephone directory display function in secret mode. 4 is an explanatory diagram illustrating an example of a screen image when performing user authentication displayed on the first display unit 101 in the information terminal 100. FIG. It is explanatory drawing which shows the example of the screen image at the time of displacing the position of an image component in the information terminal 100, (a) shows the screen image of the 1st display part 101 before displacing the position of an image component, (B) shows the screen image of the 1st display part 101 after displacing the position of an image component. It is explanatory drawing which shows the example of the screen image at the time of scrolling a screen image in the information terminal 100, (a) shows the screen image of the 1st display part 101 before displacing the position of an image component, (b) ) Shows a screen image of the first display unit 101 after the position of the image component is displaced. It is explanatory drawing which shows the example of the screen image before and behind scrolling in the information terminal 100, (a) shows the screen image of the 1st display part 101 before scrolling, (b) is the 1st display part after scrolling. 101 shows a screen image. It is explanatory drawing which shows the other example of the screen image before and behind scrolling in the information terminal 100, (a) shows the screen image of the 1st display part 101 before scrolling, (b) is the 1st display part after scrolling. 101 shows a screen image. It is explanatory drawing which shows the other example of the screen image before and behind scrolling in the information terminal 100, (a) shows the screen image of the 1st display part 101 before scrolling, (b) is the 1st display part after scrolling. 101 shows a screen image 101, and (c) shows the position of another finger before scrolling. It is explanatory drawing which shows the other example of the screen image before and behind scrolling in the information terminal 100, (a) shows the screen image of the 1st display part 101 before scrolling, (b) is the 1st display part after scrolling. 101 shows a screen image.

  Hereinafter, the present invention will be described through embodiments of the invention. However, the following embodiments do not limit the claimed invention, and all combinations of features described in the embodiments are described below. However, this is not always essential for the solution of the invention.

  FIG. 1 shows an example of a block configuration of an information terminal 100 according to an embodiment. As shown in FIG. 1, the information terminal 100 includes a first display unit 101, a second display unit 102, a first touch sensor 103, a second touch sensor 104, a voice input unit 105, a voice output unit 106, and a wireless communication unit 107. A control unit 108 and a storage unit 109. The control unit 108 includes a display control unit 110, an input processing unit 111, a voice processing unit 112, a communication control unit 113, a processing unit 114, and an application processing unit 115.

  The information terminal 100 is a smartphone, and provides various functions such as an Internet browsing function and an electronic mail function according to a user operation. The first display unit 101 has a display screen such as a liquid crystal display or an organic EL (Organic Electro-Luminescence) display, for example, and displays various images such as moving images, still images, and text (characters) according to the control of the display control unit 110. indicate. The display screen here is a device that displays an image. In the following, in order to distinguish between a screen as a device that displays an image and a screen as an image displayed on the device, the device that displays an image is referred to as a “display screen” and is displayed on the display screen. The image is referred to as a “screen image”. The first display unit 101 is an example of the “display unit” in the present invention.

  The second display unit 102 has a display screen such as a liquid crystal display or an organic EL (Organic Electro-Luminescence) display, and displays various images such as moving images, still images, and text (characters) according to the control of the display control unit 110. indicate.

  The first touch sensor 103 is provided on the display screen of the first display unit 101 and accepts a user's touch operation. That is, the first touch sensor 103 constitutes a touch panel together with the display screen of the first display unit 101. The first touch sensor 103 detects a touch operation on the display screen of the first display unit 101. Then, the first touch sensor 103 outputs a signal indicating a touch position (a touched position on the display screen) to the input processing unit 111.

  The second touch sensor 104 is provided on the display screen of the second display unit 102 and accepts a user's touch operation. That is, the second touch sensor 104 constitutes a touch panel together with the display screen of the second display unit 102. The second touch sensor 104 is a touch sensor of a touch pad provided on the back surface of the housing 120 shown in FIG. The second touch sensor 104 detects a touch operation on the display screen of the second display unit 102. Then, the second touch sensor 104 outputs a signal indicating the touch position to the input processing unit 111.

  The audio input unit 105 has a microphone, collects ambient sounds, converts them into audio signals, and outputs them to the audio processing unit 112. The audio output unit 106 includes a speaker, converts the audio signal output from the audio processing unit 112 as an analog electric signal into audio, and outputs the audio.

  The wireless communication unit 107 communicates with a wireless base station to connect to a mobile phone communication network (a mobile phone wireless communication network provided by a communication carrier). Specifically, the wireless communication unit 107 performs modulation processing on the signal output from the communication control unit 113 and transmits the signal as a wireless signal, and performs demodulation processing on the received wireless signal to perform communication. Output to the control unit 113. For example, the wireless communication unit 107 transmits and receives e-mail data using a wireless signal.

  The control unit 108 controls each unit of the information terminal 100 to execute various functions. The control unit 108 is realized by, for example, a CPU (Central Processing Unit, central processing unit) included in the information terminal 100 reading out and executing programs from various memories (not illustrated) included in the information terminal 100.

  The display control unit 110 controls the first display unit 101 and the second display unit 102 to display various images. Specifically, the display control unit 110 generates a screen display signal based on moving image data, still image data, text data, or the like output from the application processing unit 115 and outputs the screen display signal to the first display unit 101. As a result, the screen image is displayed on the first display unit 101. In addition, the display control unit 110 displays a screen image on the second display unit 102 by generating a signal for screen display and outputting the signal to the second display unit 102.

  The input processing unit 111 outputs a detection signal corresponding to an operation on the first touch sensor 103 or the second touch sensor 104 to the application processing unit 115. For example, the input processing unit 111 outputs a signal indicating the touch position on the display screen of the first display unit 101 from the first touch sensor 103 in a state where the image component is displayed on the first display unit 101. It is determined whether or not the image component has been touched. When the input processing unit 111 determines that the image component has been touched, the input processing unit 111 outputs information indicating the touched image component to the processing unit 114. Note that the image part here is a partial image as a part constituting the screen image. The image component corresponds to, for example, an icon (icon), a moving image or a still image displayed in the screen image, and the like. The icon here is an image symbolizing an object to be selected or designated, such as a file, folder, application program or function.

  The audio processing unit 112 converts the audio data output from the processing unit 114 into an electrical signal and outputs the electric signal to the audio output unit 106, thereby causing the audio output unit 106 to output audio. In addition, the voice processing unit 112 converts the electrical signal output by the voice input unit 105 by collecting and outputting the voice into voice data and outputs the voice data to the processing unit 114.

  The communication control unit 113 performs processing such as encoding on the data output from the processing unit 114, outputs the data to the wireless communication unit 107, modulates the data, and transmits the data as a wireless signal. In addition, the communication control unit 113 performs processing such as decoding on the signal received and demodulated by the wireless communication unit 107 to extract data, and outputs the data to the processing unit 114. For example, the communication control unit 113 performs processing such as encoding on the e-mail data output from the processing unit 114 and outputs it to the wireless communication unit 107, and decodes the signal received and demodulated by the wireless communication unit 107. The data such as e-mail data is extracted and output to the processing unit 114.

  The processing unit 114 executes application programs and provides various functions such as an Internet browsing function and an electronic mail function. The processing unit 114 performs the first process when the first touch sensor 103 detects the touch operation, the first touch sensor 103 detects the touch operation, and the second touch sensor 104 detects the touch operation. Thus, instead of the first process, a second process having relevance to the first process is performed.

  When the screen image displayed on the first display unit 101 includes an image component, the processing unit 114 detects a touch operation as an operation for displacing the position of the image component. A process of displacing the position of the image component in the screen image is performed as the first process. In addition, when the image part is included in the screen image, the processing unit 114 detects the touch operation as an operation for displacing the position of the image part, and the second touch sensor. When 104 detects a touch operation, a process of scrolling the screen image is performed as a second process.

  Further, the processing unit 114 performs user authentication when the first touch sensor 103 detects a touch operation as a user authentication request operation, and when the authentication is successful, as a first process, access to first data from a predetermined program is performed. Process to allow Then, the processing unit 114 detects the touch operation as the user authentication request operation by the first touch sensor 103 and performs user authentication when the second touch sensor 104 detects the touch operation. As processing, processing for permitting access to the second data from a predetermined program is performed.

  Furthermore, when the first touch sensor 103 detects a touch operation as a scroll operation, the processing unit 114 performs a process of scrolling the screen image by a set scroll amount as the first process. In addition, the processing unit 114 performs processing for changing the setting of the scroll amount when the first touch sensor 103 detects a touch operation as a scroll operation and the second touch sensor 104 detects a touch operation. And the process of scrolling the screen image by the scroll amount set by the second process is performed as the first process.

  In addition, the processing unit 114 performs a first process when the first touch sensor 103 detects a touch operation, the first touch sensor 103 detects the touch operation, and the second touch sensor 104 detects the touch operation. When at least one of the first touch sensor 103 or the second touch sensor 104 detects a touch operation at a plurality of locations, the third process is performed instead of the second process. The third process is to change the scroll amount up to the scroll end or to display special secret data.

  In addition, the processing unit 114 moves the object based on the touch operation for moving the object on the first display unit 101 by the first touch sensor 103 while designating the object by the touch operation on the second touch sensor 104. Process.

  In addition, the processing unit 114 performs a process of scrolling in the specific region by scrolling the first touch sensor 103 in the first display unit 101 while designating the specific region by the second touch sensor 104.

  Then, the processing unit 114 performs a process of scrolling to the position designated by the second touch sensor 104 by scrolling the first touch sensor 103 while designating the position of the scroll bar by the second touch sensor 104.

  The storage unit 109 is realized by, for example, storage areas of various memories included in the information terminal 100 and stores various data. The storage unit 109 stores phone book information. The storage unit 109 stores in advance various programs executed by the CPU included in the information terminal 100.

  FIG. 2 is a perspective view showing an outline of the outer shape of the information terminal 100 as viewed from the front side. As shown in FIG. 2, the information terminal 100 includes a housing 120. On the surface of the housing 120, a display screen of the first display unit 101 and a touch panel display screen corresponding to the first touch sensor 103, a microphone of the audio input unit 105, and a speaker of the audio output unit 106 are provided. ing.

  FIG. 3 is a perspective view showing an outline of the outer shape of the information terminal 100 as viewed from the back side. As shown in FIG. 3, a touch screen display screen corresponding to the display screen of the second display unit 102 and the second touch sensor 104 is provided on the back surface of the housing 120 of the information terminal 100.

  FIG. 4 is a perspective view of the state in which the information terminal 100 is held with the right hand as viewed from the front side of the information terminal 100. As shown in FIG. 4, when the user touches a point P101 on the display screen of the first display unit 101 with the right thumb, the information terminal 100 detects the touch operation, and the coordinates of the point P101 are displayed. Is output as the touch position. Regarding the point P101, a region having a small area is referred to as a “point”. For example, the first touch sensor 103 has mesh detection points, and outputs the coordinates of the detection points included in the point P101 as a region. Similarly, a point P102 and a second touch sensor 104, which will be described later, have mesh-like detection points, and output the coordinates of those detection points included in the point P102 as a region.

  FIG. 5 is a perspective view of the back side of the information terminal 100 viewed from the front side of the information terminal 100 in a state where the information terminal 100 is held with the right hand. As shown in FIG. 5, when the user touches a point P102 on the display screen of the second display unit 102 with the right index finger, the information terminal 100 detects the touch operation, and the coordinates of the point P102 are detected. Is output as the touch position.

  In this way, the user can hold the information terminal 100 with one hand and touch the display screen of the first display unit 101 and the display screen of the second display unit 102, and the first touch sensor 103. The second touch sensor 104 detects these touch operations. Note that the point P101 in FIG. 4 and the point P102 in FIG. 5 may be positions facing each other or may be shifted. However, the first touch sensor 103 and the second touch sensor 104 are not limited to the touch operation described above, and are applied to the display screen of the first display unit 101 and the display screen of the second display unit 102 which are performed in various forms. A touch operation can be detected. For example, the user holds the information terminal 100 with the left hand, performs a touch operation on the display screen of the first display unit 101 with the right hand index finger, and moves to the display screen of the second display unit 102 with the left hand index finger. The touch operation is performed. Also in this case, the first touch sensor 103 and the second touch sensor 104 detect these touch operations. Alternatively, in the information terminal 100, the casing can be folded, and the display screen of the first display unit 101 and the display screen of the second display unit 102 are arranged vertically on the front side with the casing open. You may be made to do. In this case, the user performs a touch operation on the display screen of the first display unit 101 with the right hand index finger, and the user holds the information terminal 100 with the left hand and the display screen of the second display unit 102 with the left thumb. Touch operation can be performed. Also in this case, the first touch sensor 103 and the second touch sensor 104 detect these touch operations.

  FIG. 6 is a flowchart for explaining a basic control operation of the information terminal 100. As illustrated in FIG. 6, when starting the control, the processing unit 114 determines whether or not the first touch sensor 103 has detected a predetermined touch operation on the display screen of the first display unit 101 (step S101). The process part 114 complete | finishes a process, when the determination result of step S101 is "NO". When the determination result in step S101 is “YES”, the processing unit 114 determines whether or not the second touch sensor 104 has detected a touch operation on the display screen of the second display unit 102 (step S102). If the determination result in step S102 is “NO”, the processing unit 114 performs the first process (step S104). Then, the processing unit 114 ends the process. When the determination result in step S102 is “YES”, the processing unit 114 performs the second process (step S103). Alternatively, the processing unit 114 performs a third process. Then, the processing unit 114 ends the process.

  FIG. 7 is an explanatory diagram showing an example of phone book information stored in the storage unit 109 of the information terminal 100. This phone book information includes information such as a name and a phone number to be displayed in the phone book display function of the information terminal 100. Further, the phone book information is used as information for displaying the information by replacing the telephone number with the name when the information terminal 100 displays information such as an incoming call history.

  As shown in FIG. 7, the phone book information has a tabular data structure, and each row corresponds to data for one person. For example, the data of Mr. A, Mr. B, and Mr. C are stored in rows L101, L102, and L103, respectively. This telephone directory information includes a secret flag, which is a flag indicating whether or not a secret is designated, in addition to data such as a name and a telephone number. The value “YES” of the secret flag indicates that the secret is designated. On the other hand, the value “NO” of the secret flag indicates that the secret is not designated. For example, in the phone book information, Mr. B's data is designated as a secret in line L102. On the other hand, in the phone book information, the secrets of Mr. A's data and Mr. C's data are not designated in the rows L101 and L103, respectively. Whether or not these secrets are designated is set by the user.

  FIG. 8 is an explanatory diagram showing an example of a display image when the information terminal 100 executes the telephone directory display function in the normal mode. The normal mode is a mode that restricts access from the application program to data designated by the secret and permits access to data not designated by the secret.

  The processing unit 114 that executes the application program for displaying the phone book causes the first display unit 101 to display data that is permitted to be accessed in accordance with the access restriction. In the example illustrated in FIG. 8, the processing unit 114 permits access from the phone book display application program to the data of Mr. A and the data of Mr. C that are not designated as secrets in FIG. 7. And data of Mr. C are displayed in areas A111 and A112, respectively. On the other hand, the processing unit 114 restricts access to the data of Mr. B designated as the secret in FIG. 7 from the application program for displaying the phone book. Therefore, the processing unit 114 does not display Mr. B's data on the screen image shown in FIG.

  FIG. 9 is an explanatory diagram illustrating an example of a display screen when the information terminal 100 executes the telephone directory display function in the secret mode. The secret mode is a mode that permits both access to data designated by the secret and access to data not designated by the secret from the application program.

  As illustrated in FIG. 9, the processing unit 114 that executes the application program for displaying the phone book causes the first display unit 101 to display both the data designated as secret and the data not designated as secret. In the example shown in FIG. 9, the processing unit 114 permits access from the phone book display application program to the data of Mr. A and the data of Mr. C that are not designated as secrets in FIG. 7. At the same time, the processing unit 114 permits access to Mr. B's data designated as a secret in FIG. Then, the display control unit 110 displays the A's data, the B's data, and the C's data in the areas A121, A122, and A123, respectively.

  At this time, when the user performs a touch operation on the second touch sensor 104 of the second display unit 102 at a plurality of locations, the processing unit 114 designates a secret according to the number of touch operations on the second touch sensor 104. Process with high confidentiality. That is, when the number of touch operations on the second touch sensor 104 is increased, the processing unit 114 sets the secret level for specifying the secret to be high. As a result, the processing unit 114 does not display the data of Mr. B and Mr. C who have performed the touch operation on the second touch sensor 104 once and designated the secret. Then, the processing unit 114 displays other data designated by the super secret on the first display unit 101 by a plurality of touch operations on the second touch sensor 104.

  FIG. 10 is an explanatory diagram illustrating an example of a screen image when user authentication displayed on the first display unit 101 in the information terminal 100 is performed. The user sets in advance whether or not to perform user authentication when using the information terminal 100, and the storage unit 109 stores the setting contents in advance. When the setting for performing the user authentication is made, the processing unit 114 is used again when the power supply is connected (ON) to start up, or after being in a sleep mode without being used for a certain period of time (for example, 10 minutes). When doing so, a process of displaying a user authentication screen on the first display unit 101 and receiving a password input is performed.

  As illustrated in FIG. 10, the input processing unit 111 performs a touch operation on an icon such as “0” to “9” (a push-button pressing operation) while the user authentication screen is displayed on the first display unit 101. ) To detect the touched icon. Then, the processing unit 114 detects the input password based on the detected icon. After that, when the user performs a touch operation on the icon C101 of the “confirmed” push button (hereinafter referred to as “confirmed icon” C101), the processing unit 114 stores the input password and the storage unit 109 in advance. User authentication is performed by determining whether or not the stored password is the same.

  If the processing unit 114 determines that the input password is the same as the password stored in advance in the storage unit 109 and succeeds in user authentication, the processing unit 114 transitions to the execution mode and performs the above-described telephone call according to the user operation. Perform various functions such as a book display function. The processing unit 114 has the normal mode and the secret mode as the execution mode, and when the user authentication is successful, the processing unit 114 shifts to one of the modes depending on whether the second touch sensor 104 detects a touch operation. To do. Specifically, the processing unit 114 detects the touch operation on the display screen of the second display unit 102 when the first touch sensor 103 detects the touch operation on the confirmation icon C201. If so, transition to the secret mode. On the other hand, when the first touch sensor 103 detects the touch operation on the confirmed icon C201, the processing unit 114 detects the touch operation on the display screen of the second display unit 102 when the first touch sensor 103 detects the touch operation on the confirmation icon C201. If not, transition to normal mode.

  On the other hand, when the user authentication fails, that is, when it is determined that the input password is different from the password stored in advance in the storage unit 109, the processing unit 114 shifts to the sleep mode and waits for password input again. .

  Here, the processing unit 114 is an example of two processing modes when executing various functions, transition to the normal mode and transition to the secret mode. In other words, the transition to the normal mode and the transition to the secret mode allow access to data that is not secret-set from the application program of the function by setting various functions to accept execution requests. Common in terms of processing. On the other hand, the transition to the normal mode and the transition to the secret mode differ depending on whether or not a process (setting) for permitting access to the data set with the secret is performed. The data that is not set with the secret corresponds to the first data, and the data that includes both the data that is not set with the secret and the data that is set with the secret corresponds to the second data. Further, the process for permitting access to the first data from the application program corresponds to the first process, and the process for permitting access to the second data from the application program corresponds to the second process. The first process and the second process are related in that access to the data from the application program is permitted, and are different from each other in the data that permits access.

  FIG. 11 is an explanatory diagram illustrating an example of a screen image when the position of the image component is displaced in the information terminal 100. FIG. 11A illustrates the first display unit 101 before the position of the image component is displaced. FIG. 11B shows the screen image of the first display unit 101 after the position of the image component is displaced. The screen image of FIG. 11A is an example of the “scroll bar” of the present invention indicating the icon C201 which is an example of an image component and the scroll position of the screen image (the position of the screen image in the entire image to be displayed). A slide bar G101 is shown. Further, the screen image of FIG. 11B is displaced in the position of the icon C201 in the screen image as compared with the screen image of FIG. On the other hand, the scroll position of the screen image in FIG. 11B is the same as the scroll position in FIG. Therefore, the display position of the icon C201 is displaced, while the position of the slide bar G101 in FIG. 11B is the same as the position of the slide bar G101 in FIG.

  The processing unit 114 performs processing when the first touch sensor 103 detects a touch operation as an operation for displacing the position of the image component C201 and the second touch sensor 104 does not detect the touch operation. More specifically, when the drag and drop (Drag And Drop) of the image component C201 is performed as an operation for displacing the position of the image component C201, the input processing unit 111 causes the first touch sensor 103 to move to the touch position. Are sequentially detected at predetermined time intervals. Then, the input processing unit 111 sequentially outputs information indicating that the image component C201 has been dragged and dropped and information indicating the touch position to the processing unit 114. Then, the processing unit 114 sequentially outputs an indication of the position of the image component C201 in the screen image to the display control unit 110 based on the information output from the input processing unit 111. Then, the display control unit 110 sequentially displaces the position of the image component C201 in the screen image of the first display unit 101 according to the instruction output from the processing unit 114.

  Here, the information terminal 100 can use various operations as operations for displacing the position of the image component C201. For example, as described above, the information terminal 100 performs an operation of dragging and dropping the image component C201, that is, in the screen image of FIG. 11A, touches the image component C201 with a finger and places the finger on the display screen. An operation of moving the finger to the position of the image part C201 (position to be moved) in the screen image of FIG. Alternatively, the information terminal 100 flicks the image component, that is, in the screen image of FIG. 11A, touches the image component C201 with a finger and repels the image component C201 with the finger. Operations other than drag-and-drop, such as an operation of rubbing the display screen with the finger toward the position of the image component C201 in the screen image 11 (b) (toward the direction of movement), may be used. .

  FIG. 12 is an explanatory diagram illustrating an example of a screen image when the screen image is scrolled in the information terminal 100. FIG. 12A illustrates the screen of the first display unit 101 before the position of the image component is displaced. FIG. 12B shows a screen image of the first display unit 101 after the position of the image component is displaced. In the screen image in FIG. 12B, the scroll position is displaced from the scroll position in FIG. 12A, which is different from the case of FIG. 11B. For this reason, the position of the slide bar G101 in FIG. 12B is displaced from the position of the slide bar in FIG. That is, the icon moving process shown in FIG. 11 and the scrolling process shown in FIG. 12 are related to each other in that the icon display position is moved. On the other hand, the icon moving process shown in FIG. 11 and the scrolling process shown in FIG. 12 differ from each other in whether only the icon is moved or the entire image displayed on the display screen is moved.

  The processing unit 114 performs a process when the first touch sensor 103 detects a touch operation as an operation for displacing the position of the image component C201 and the second touch sensor 104 detects a touch operation. More specifically, the input processing unit 111 detects that the touch position is sequentially detected by the first touch sensor 103 when the image component C201 is dragged and dropped, and the image component C201 is dragged and dropped. And information indicating the touch position are sequentially output to the processing unit 114. The input processing unit 111 is touched on the display screen of the second display unit 102 while the image component C201 is being dragged and dropped, and the second touch sensor 104 sequentially detects the touch position, and the touch is performed. Information indicating the position is sequentially output to the processing unit 114.

  Based on the information output from the input processing unit 111, the processing unit 114 displays an instruction to scroll the screen image (information indicating the position of the portion of the display target image to be displayed as the screen image). Sequentially output to the unit 110. Then, the display control unit 110 scrolls the screen image of the first display unit 101 according to the instruction output from the processing unit 114.

  At this time, when the input processing unit 111 performs touch operations on the second touch sensor 104 of the second display unit 102 at a plurality of places, the processing unit 114 performs the third process to perform the second touch sensor 104. By emphasizing the touch operation at one place, the screen image of the first display unit 101 is displaced to the scroll end.

  Here, the processing in FIG. 11 and the processing in FIG. 12 are examples of two processing modes in the processing for displacing the position of the image component C201. That is, the process in FIG. 11 and the process in FIG. 12 are related in that the process of displacing the display position of the image component C201 is performed, and only the image component C201 is moved or the display screen is displayed. It differs from each other in whether the entire image is moved. In the two processing modes, the process of displacing the display position of the image component C201 corresponds to the first process, and the process of scrolling the screen image corresponds to the second process.

  FIG. 13 is an explanatory diagram illustrating an example of screen images before and after scrolling in the information terminal 100. FIG. 13A shows a screen image of the first display unit 101 before scrolling, and FIG. 13B shows a screen image of the first display unit 101 after scrolling. In FIG. 13, the display screen of the first display unit 101 displays a web page, and a slide bar G301 indicating a scroll position is displayed on the right side of the display screen. FIG. 13A and FIG. 13B show screen images when the first display unit 101 displays the same web page, but the scroll position (screen image in the web page to be displayed). Is different). FIG. 13B shows a screen image when the screen is scrolled down one display screen from the scroll position in FIG. For this reason, the position of the slide bar G301 in FIG. 13B is a position that is lowered according to the scroll amount from the position of the slide bar G301 in FIG.

  The processing unit 114 performs processing when the first touch sensor 103 detects a touch operation as a scroll operation and the second touch sensor 104 does not detect the touch operation. As shown in FIGS. 13A and 13B, more specifically, when the input processing unit 111 performs a touch operation (tap) on the lower region F301 of the slide bar G301 as a scroll operation. The touch position is detected by the first touch sensor 103, and information indicating that the touch operation on the region F301 has been performed and information indicating the touch position are output to the processing unit 114. Then, based on the information output from the input processing unit 111, the processing unit 114 outputs an instruction to the display control unit 110 to lower the scroll position of the screen image by one display screen. Then, according to the instruction output from the processing unit 114, the display control unit 110 lowers the scroll position of the screen image of the first display unit 101 by one display screen.

  Here, the information terminal 100 can use various operations as a scroll operation. For example, as described above, the information terminal 100 can use an operation of tapping an area above or below the slide bar G301. Alternatively, in the information terminal 100, the first display unit 101 may display the icon of the up scroll button and the icon of the down scroll button, and use a touch operation on these icons as the scroll operation.

  FIG. 14 is an explanatory diagram showing another example of the screen image before and after scrolling in the information terminal 100, FIG. 14 (a) shows the screen image of the first display unit 101 before scrolling, and FIG. The screen image of the 1st display part 101 after a scroll is shown. In this case, as in the case of FIG. 13, the information terminal 100 displays a web page on the display screen of the first display unit 101, and a slide bar G301 indicating the scroll position is displayed on the right side of the display screen. it's shown. 14 (a) and 14 (b), the first display unit 101 shows a screen image when the same web page is displayed, and the scroll position (web page to be displayed). The position of the screen image is different from that in FIG. However, in FIG. 14, the scroll amount is different from that in FIG. FIG. 14B shows a screen image when the screen is scrolled five times below the display screen from the scroll position in FIG. For this reason, the position of the slide bar G301 in FIG. 14B is a position that is lowered according to the scroll amount from the position of the slide bar G301 in FIG. In FIG. 14, the scroll amount is larger than that in FIG. 13, and the amount by which the slide bar G301 is lowered is larger.

  The processing unit 114 performs processing when the first touch sensor 103 detects a touch operation as a scroll operation and the second touch sensor 104 detects a touch operation. More specifically, when a touch operation (tap) on the lower region F301 of the slide bar G301 is performed as the scroll operation, the input processing unit 111 detects the touch position by the first touch sensor 103, and the region Information indicating that the touch operation on F301 has been performed and information indicating the touch position are output to the processing unit 114. Further, when a touch operation is performed on the region F301, the input processing unit 111 is touching the display screen of the second display unit 102, detects the touch position by the second touch sensor 104, and indicates the touch position. Information is output to the processing unit 114. Then, based on the information output from the input processing unit 111, the processing unit 114 outputs an instruction to the display control unit 110 to lower the screen image scroll position by five positions below the display screen. Then, in accordance with the instruction output from the processing unit 114, the display control unit 110 lowers the scroll position of the screen image on the first display unit 101 by five positions below the display screen.

  Here, the process in FIG. 13 and the process in FIG. 14 are examples of two processing modes in the process of scrolling the screen image of the first display unit 101. That is, the process in FIG. 13 and the process in FIG. 14 are related in that the process of scrolling the screen image of the first display unit 101 is performed and the scroll amount is different. And the process part 114 makes the process which scrolls the screen image of the 1st display part 101 one display screen below as a 1st process, and sets the screen image of the 1st display part 101 as a scroll amount different from a 1st process. A process of scrolling down the display screen by five is processed as the second process.

  FIG. 15 is an explanatory view showing another example of the screen image before and after scrolling in the information terminal 100, FIG. 15 (a) shows the screen image of the first display unit 101 before scrolling, and FIG. FIG. 15C shows the screen image of the first display unit 101 after scrolling, and FIG. 15C shows the position of another finger before scrolling. In this case, the information terminal 100 displays a map, which is an example of the “object” in the present invention, on the display screen of the first display unit 101, as in FIG.

  The processing unit 114 performs processing when the first touch sensor 103 detects a touch operation as a scroll operation and the second touch sensor 104 detects a touch operation. As shown in FIG. 15A, more specifically, the processing unit 114 performs a specific region P202 corresponding to the map in the first display unit 101 by a touch operation on the second touch sensor 104 of the second display unit 102. Is specified. As illustrated in FIG. 15B, the processing unit 114 sets the scroll amount of the map according to the movement amount of the first touch sensor 103 of the first display unit 101. As illustrated in FIG. 15C, the processing unit 114 does not have to perform the touch operation on the first touch sensor 103 of the first display unit 101 on the map, but on an arbitrary position on the first display unit 101. It's okay. At this time, when there is no touch operation on the second touch sensor 104 of the second display unit 102, the processing unit 114 corresponds to the scroll amount of the first touch sensor 103 of the first display unit 101. Scroll through the map.

  FIG. 16 is an explanatory view showing another example of the screen image before and after scrolling in the information terminal 100, FIG. 16 (a) shows the screen image of the first display unit 101 before scrolling, and FIG. The screen image of the 1st display part 101 after a scroll is shown. In this case, in the information terminal 100, the display screen of the first display unit 101 displays a map which is an example of the “object” in the present invention.

  The processing unit 114 performs processing when the first touch sensor 103 detects a touch operation as a scroll operation and the second touch sensor 104 detects a touch operation. More specifically, as illustrated in FIGS. 16A and 16B, the processing unit 114 performs a slide bar G <b> 401 on the first display unit 101 by a touch operation on the second touch sensor 104 of the second display unit 102. When the position corresponding to G402 is designated, the processing is performed by setting the scroll amount of the map by the first touch sensor 103 of the first display unit 101 within the range of the slide bars G401 and G402. In this case, the processing unit 114 can perform a process of moving the map directly from the slide bar G401 to the slide bar G402 instead of scrolling the map. Note that the slide bars G401 and 402 are not always necessary, and the processing unit 114 can directly move the map by designating the second touch sensor 104 of the second display unit 102 to a predetermined position.

  As described above, according to the information terminal 100, the processing unit 114 can easily and intuitively operate the movement of an object such as a map and the use of screen scrolling, and the use of full screen scrolling and partial screen scrolling. can do.

  Further, according to the information terminal 100, the processing unit 114 can easily process a plurality of usages by performing the third process by a specific touch operation on the second touch sensor 104.

  And according to the information terminal 100, the process part 114 displaces the screen image of the 1st display part 101 to a scroll end by 3rd process, and performs the touch operation to the 2nd touch sensor 104 in one place. Can be emphasized.

  Further, according to the information terminal 100, the processing unit 114 increases the secret designation level to the super-secret level by a plurality of touch operations on the second touch sensor 104 by the third process, thereby enhancing privacy. Can do.

  Furthermore, according to the information terminal 100, the processing unit 114 scrolls within the specific area by scrolling the first touch sensor 103 on the first display unit 101 while specifying the specific area by the second touch sensor 104. , Easy to scroll.

  In addition, according to the information terminal 100, the processing unit 114 specifies the position of the second touch sensor 104 by scrolling the first touch sensor 103 while specifying the position of the slide bars G401 and G402 by the second touch sensor 104. Scrolling up to the user can improve user handling.

  According to the touch operation processing method, the processing unit 114 can easily and intuitively operate the movement of an object such as a map and the use of a screen scroll, and the use of a full screen scroll and a partial screen scroll.

  According to the program, the processing unit 114 can easily and intuitively operate the movement of an object such as a map and the use of a screen scroll, and the use of a full screen scroll and a partial screen scroll.

  The information terminal, the touch operation processing method, and the program are not limited to the first embodiment described above, and appropriate modifications and improvements can be made.

100 information terminal 101 first display unit 102 second display unit 103 first touch sensor 104 second touch sensor 105 voice input unit 106 voice output unit 107 wireless communication unit 108 control unit 109 storage unit 110 display control unit 111 input processing unit 112 Audio processing unit 113 Communication control unit 114 Processing unit 115 Application processing unit 120 Chassis A111, A112, A121, A122, A123, F301 Region C101 Confirmation icon C201 Confirmation icons G101, G301, G401, G402 Slide bars L101, L102, L103 rows P102 Point P202 Specific area

Claims (8)

A display unit;
A first touch sensor for detecting a touch operation;
A second touch sensor for detecting a touch operation;
By performing a first process by detecting a touch operation on the first touch sensor, detecting a touch operation on the first touch sensor, and detecting a touch operation on the second touch sensor, A processing unit that performs a second process having relevance to the first process instead of the first process,
The processing unit moves the object based on a touch operation of moving the object on the display unit by the first touch sensor while designating the object by a touch operation on the second touch sensor. Information terminal. The information terminal according to claim 1, wherein the processing unit performs a third process instead of the second process or in addition to the second process by a specific touch operation on the second touch sensor. . The information terminal according to claim 2, wherein the third process is a change in a scroll amount up to a scroll end. The information terminal according to claim 2, wherein the third process is a display of special secret data. The said processing part scrolls within the said specific area by the scroll of the said 1st touch sensor in the said display part, designating a specific area with the said 2nd touch sensor. Information terminal described in Crab. The said processing part is scrolled to the position designated by the said 2nd touch sensor by the scroll of the said 1st touch sensor, designating the position of a scroll bar by the said 2nd touch sensor. Information terminal in any one of. A first process is performed by detecting a touch operation on the first touch sensor of the display unit included in the information terminal, a touch operation on the first touch sensor is detected, and a second touch sensor included in the information terminal By detecting a touch operation to the second process, the second process having the relevance to the first process is performed instead of the first process, and the object is designated by the touch operation to the second touch sensor. A touch operation processing method comprising: a step of moving the object based on a touch operation of moving the object on the display unit by the first touch sensor. Computer
A first process is performed by detecting a touch operation on the first touch sensor of the display unit included in the information terminal, a touch operation on the first touch sensor is detected, and a second touch sensor included in the information terminal By detecting a touch operation to the second process, the second process having the relevance to the first process is performed instead of the first process, and the object is designated by the touch operation to the second touch sensor. A program that functions as a processing unit that moves the object based on a touch operation of moving the object on the display unit by a first touch sensor.

Images