JP6373722B2 - Portable terminal and control method - Google Patents

Description

  The present application relates to a mobile terminal and a control method.

  Conventionally, in an electronic device including a touch screen, a user may make an input error with respect to an interface displayed on the touch screen. In order to solve such a problem, a technique for improving the accuracy of data input by adjusting the position of a touch input point actually sensed with respect to the touch screen is known (see Patent Document 1). .

Japanese Patent Laid-Open No. 10-91318

  Since the technique disclosed in Patent Literature 1 adjusts the position of the touch input point according to a specific tendency related to user input, particularly when an erroneous input is not based on a specific tendency. When it is caused by vibration, there is a problem that it is difficult to adjust the position of the touch input point.

  From the above, it is necessary to provide a portable terminal and a control method that can adjust the position of user input more accurately.

  A portable terminal according to one aspect includes a display unit, a contact position detection unit that detects a contact position corresponding to the display unit, a line-of-sight position detection unit that detects a line-of-sight position with respect to the display unit, and a contact with the display unit When a difference occurs between the position and the line-of-sight position with respect to the display unit when the contact position is detected, based on the line-of-sight position with respect to the display unit when the contact position is detected And a control unit that corrects a contact position with respect to the display unit.

  A control method according to one aspect is a control method that is executed by a portable terminal having a display unit, the step of detecting a position of contact corresponding to the display unit, and the step of detecting the position of a line of sight with respect to the display unit. When a difference occurs between the contact position with respect to the display unit and the line-of-sight position with respect to the display unit when the contact position is detected, the display unit with respect to the display unit when the contact position is detected is detected. Correcting the contact position with respect to the display unit based on the line-of-sight position.

FIG. 1 is a block diagram illustrating a functional configuration of the smartphone according to the first embodiment. FIG. 2 is a diagram for explaining an example of processing executed by the smartphone according to the first embodiment. FIG. 3 is a diagram for explaining an example of processing executed by the smartphone according to the first embodiment. FIG. 4 is a diagram for explaining an example of processing executed by the smartphone according to the first embodiment. FIG. 5 is a flowchart illustrating a flow of processing by the smartphone according to the first embodiment. FIG. 6 is a flowchart illustrating a process flow of the smartphone according to the first embodiment. FIG. 7 is a flowchart illustrating a process flow by the smartphone according to the first embodiment. FIG. 8 is a flowchart showing a flow of processing by the smartphone according to the first embodiment. FIG. 9 is a block diagram illustrating a functional configuration of the smartphone according to the second embodiment. FIG. 10 is a flowchart illustrating a process flow of the smartphone according to the second embodiment.

  Embodiments for carrying out the present invention will be described in detail with reference to the drawings. Below, a smart phone is demonstrated as an example of the portable terminal which concerns on this invention.

(Embodiment 1)
An example of a functional configuration of the smartphone 1 according to the embodiment will be described with reference to FIG. FIG. 1 is a block diagram illustrating a functional configuration of the smartphone according to the first embodiment. In the following description, the same code | symbol may be attached | subjected to the same component. Furthermore, duplicate descriptions may be omitted.

  As shown in FIG. 1, the smartphone 1 includes a touch screen display 2, a button 3, an illuminance sensor 4, a proximity sensor 5, a communication unit 6, a receiver 7, a microphone 8, a storage 9, and a controller 10. A speaker 11, a camera 12, an infrared irradiation unit 13, a connector 14, an acceleration sensor 15, and an orientation sensor 16.

  The touch screen display 2 includes a display 2A and a touch screen 2B. The display 2 </ b> A and the touch screen 2 </ b> B may be arranged, for example, may be arranged side by side, or may be arranged apart from each other. When the display 2A and the touch screen 2B are arranged so as to overlap each other, for example, one or more sides of the display 2A may not be along any side of the touch screen 2B. The touch screen display 2 is an example of a display unit.

  The display 2A includes a liquid crystal display (LCD: Liquid Crystal Display), an organic EL display (OELD: Organic Electro-Luminescence Display), or an inorganic EL display (IELD: Inorganic Electro-Luminescence Display). The display 2A displays characters, images, symbols, graphics, and the like. The screen including characters, images, symbols, graphics, and the like displayed on the display 2A includes a screen called a lock screen, a screen called a home screen, and an application screen displayed during execution of the application. The home screen may be called a desktop, a standby screen, an idle screen, a standard screen, an application list screen, or a launcher screen.

  The touch screen 2B detects contact of a finger, a pen, a stylus pen, or the like with respect to the touch screen 2B. The touch screen 2B is a position (hereinafter referred to as a contact position) on the touch screen 2B when a plurality of fingers, a pen, a stylus pen or the like (hereinafter simply referred to as “finger”) contacts the touch screen 2B (touch screen display 2). Can be detected. The touch screen 2B notifies the controller 10 of the contact of the finger with the touch screen 2B together with the contact position. The touch screen 2B is an example of a contact position detection unit.

  The detection method of the touch screen 2B may be any method such as a capacitance method, a resistive film method, a surface acoustic wave method (or an ultrasonic method), an infrared method, an electromagnetic induction method, and a load detection method. In the following description, in order to simplify the description, it is assumed that the user uses the finger to touch the touch screen 2B in order to operate the smartphone 1.

  The controller 10 (smart phone 1) has at least one of the contact detected by the touch screen 2B, the position at which the contact is detected, the change in the position at which the contact is detected, the interval at which the contact is detected, and the number of times the contact is detected. The type of gesture is determined based on the one. The gesture is an operation performed on the touch screen 2B (touch screen display 2) using a finger. The gestures that the controller 10 (smart phone 1) determines via the touch screen 2B include, for example, touch, long touch, release, swipe, tap, double tap, long tap, drag, flick, pinch in, and pinch out. However, it is not limited to these.

  The button 3 receives an operation input from the user. The number of buttons 3 may be singular or plural.

  The illuminance sensor 4 detects illuminance. The illuminance is the value of the light beam incident on the unit area of the measurement surface of the illuminance sensor 4. The illuminance sensor 4 is used for adjusting the luminance of the display 2A, for example.

  The proximity sensor 5 detects the presence of a nearby object without contact. The proximity sensor 5 detects the presence of an object based on a change in a magnetic field or a change in a feedback time of an ultrasonic reflected wave. For example, the proximity sensor 5 detects that the display 2A is brought close to the face. The illuminance sensor 4 and the proximity sensor 5 may be configured as one sensor. The illuminance sensor 4 may be used as a proximity sensor.

  The communication unit 6 communicates wirelessly. The wireless communication standards supported by the communication unit 6 include, for example, cellular phone communication standards such as 2G, 3G, and 4G, and short-range wireless communication standards. Cellular phone communication standards include, for example, LTE (Long Term Evolution), W-CDMA (Wideband Code Division Multiple Access), WiMAX (Worldwide PDA), WiMAX (Worldwide Interoperability Pc). ) (Global System for Mobile Communications), PHS (Personal Handy-phone System), and the like. Examples of short-range wireless communication standards include IEEE 802.11, Bluetooth (registered trademark), IrDA (Infrared Data Association), NFC (Near Field Communication), and WPAN (Wireless Personal Area Network). As a communication standard of WPAN, for example, there is ZigBee (registered trademark). The communication unit 6 may support one or more of the communication standards described above.

  The receiver 7 is a sound output unit. The receiver 7 outputs the sound signal transmitted from the controller 10 as sound. The receiver 7 is used, for example, to output the other party's voice during a call. The microphone 8 is a sound input unit. The microphone 8 converts the user's voice or the like into a sound signal and transmits the sound signal to the controller 10.

  The storage 9 stores programs and data. The storage 9 is also used as a work area for temporarily storing the processing result of the controller 10. The storage 9 may include any non-transitory storage medium such as a semiconductor storage medium and a magnetic storage medium. The storage 9 may include a plurality of types of storage media. The storage 9 may include a combination of a storage medium such as a memory card, an optical disk, or a magneto-optical disk and a storage medium reader. The storage 9 may include a storage device used as a temporary storage area such as a RAM (Random Access Memory).

  The programs stored in the storage 9 include an application executed in the foreground or the background, and a control program (not shown) that supports the operation of the application. An application executed in the foreground displays a screen on the display 2A, for example. The control program includes an OS, for example. The application and the basic program may be installed in the storage 9 via wireless communication by the communication unit 6 or a non-transitory storage medium.

  The storage 9 stores a line-of-sight position detection program 9A, a contact position correction program 9B, a telephone application 9C, setting data 9Z, and the like.

  The line-of-sight position detection program 9A provides a function for detecting the line-of-sight position of the user with respect to the touch screen display 2. The line-of-sight position corresponds to a position on the touch screen display 2 when a line of sight extending linearly starting from the center position of the pupil in the user's eyeball intersects the touch screen display 2.

  The line-of-sight position detection program 9A detects the line-of-sight position, for example, by applying an algorithm based on the corneal reflection method to the user's image. Specifically, the line-of-sight position detection program 9 </ b> A irradiates infrared rays from the infrared irradiation unit 13 when acquiring a user image. The line-of-sight position detection program 9 </ b> A specifies the position of the pupil and the position of infrared corneal reflection from the acquired user image. The line-of-sight position detection program 9A specifies the direction of the line of sight of the user based on the positional relationship between the position of the pupil and the position of infrared corneal reflection. The line-of-sight position detection program 9A determines that the direction of the line of sight is closer to the corner of the eye if the position of the pupil is closer to the corner of the eye than the position of corneal reflection. The direction of the line of sight is determined to be the eye side. The line-of-sight position detection program 9A calculates the distance between the user's eyeball and the touch screen display 2 based on the size of the iris, for example. The gaze position detection program 9A starts from the pupil from the center position of the pupil in the user's eyeball based on the direction of the user's gaze and the distance between the user's eyeball and the touch screen display 2. A visual line position that is a position on the touch screen display 2 when the visual line intersects the touch screen display 2 is detected.

  In the above example, the case has been described in which the line-of-sight position detection program 9A detects the line-of-sight position of the user by executing processing using the cornea reflection method, but the present invention is not limited to this example. For example, the line-of-sight position detection program 9A may detect the line-of-sight position by executing an image recognition process on the user's image. For example, the line-of-sight position detection program 9A extracts a predetermined region including the user's eyeball from the user's image, specifies the line-of-sight direction based on the positional relationship between the eye and the iris, The line-of-sight position is detected based on the distance from the user's eyeball to the touch screen display 2. Alternatively, the line-of-sight position detection program 9A accumulates a plurality of eyeball images as a reference image when the user is browsing various display areas on the touch screen display 2, and the reference image and the determination target are stored. The line-of-sight position is detected by collating the acquired image of the user's eyeball. The line-of-sight position detection program 9A is an example of a contact position detection unit.

  The contact position correction program 9B detects the contact position when there is a difference between the contact position with respect to the touch screen display 2 and the line-of-sight position with respect to the touch screen display 2 when the contact position is detected. A function for correcting the contact position with respect to the touch screen display 2 based on the line-of-sight position with respect to the touch screen display 2 when broken.

  More specifically, the contact position correction program 9B indicates that when the contact position with respect to the touch screen display 2 and the line-of-sight position with respect to the touch screen display 2 do not completely match, a difference has occurred between the contact position and the line-of-sight position. judge. Alternatively, when the contact position with respect to the touch screen display 2 and the line-of-sight position with respect to the touch screen display 2 do not match, the contact position correction program 9B detects the distance between the contact position and the line-of-sight position, and the detected distance is a threshold value. When exceeding, you may determine with the difference having arisen between the contact position and the gaze position.

  When the contact position correction program 9B determines that a difference has occurred between the contact position and the line-of-sight position, the line-of-sight position with respect to the touch screen display 2 when the contact position is detected is determined as the corrected contact position. To do. Alternatively, when the contact position correction program 9B determines that a difference has occurred between the contact position and the line-of-sight position, the contact position with respect to the touch screen display 2 and the touch screen display 2 when the contact position is detected are described above. A predetermined position on a line connecting the line-of-sight position is determined as a corrected contact position. Alternatively, when the contact position correction program 9B determines that a difference has occurred between the contact position and the line-of-sight position, the contact position correction program 9B corresponds to the line-of-sight position among a plurality of operation targets included in the screen displayed on the touch screen display 2. One operation target is specified, and a position where the specified operation target is displayed on the touch screen display 2 is determined as the corrected contact position.

  The telephone application 9C provides a telephone call function for a telephone call by wireless communication. The functions provided by the telephone application 9C include a function for displaying a screen for executing a call on the touch screen display 2.

  The setting data 9Z includes various data used for processing executed based on the functions of the control program, the line-of-sight position detection program 9A, and the contact position correction program 9B. The setting data 9Z may include, for example, various data related to the user's eyeball. The setting data 9Z may include, for example, parameters used for determining the corrected contact position.

  The controller 10 is an arithmetic processing device. The arithmetic processing unit includes, for example, a CPU (Central Processing Unit), an SoC (System-on-a-Chip), an MCU (Micro Control Unit), an FPGA (Field-Programmable Gate Array), and a coprocessor. It is not limited. The controller 10 controls various operations of the smartphone 1 to realize various functions. The controller 10 is an example of a control unit.

  Specifically, the controller 10 executes instructions included in the program stored in the storage 9 while referring to the data stored in the storage 9 as necessary. And the controller 10 controls a function part according to data and a command, and implement | achieves various functions by it. The functional unit includes, for example, the display 2A, the communication unit 6, the microphone 8, the speaker 11, and the infrared irradiation unit 13, but is not limited thereto. The controller 10 may change the control according to the detection result of the detection unit. Examples of the detection unit include, but are not limited to, the touch screen 2B, the button 3, the illuminance sensor 4, the proximity sensor 5, the microphone 8, the camera 12, the acceleration sensor 15, and the azimuth sensor 16.

  The controller 10 executes the process of detecting the line-of-sight position by executing the line-of-sight position detection program 9A. The controller 10 executes the following process by executing the contact position correction program 9B. That is, the controller 10 detects the contact position when there is a difference between the contact position with respect to the touch screen display 2 and the line-of-sight position with respect to the touch screen display 2 when the contact position is detected. The contact position with respect to the touch screen display 2 is corrected based on the line-of-sight position with respect to the touch screen display 2 at the time.

  Hereinafter, the example of the process performed by the smart phone 1 which concerns on Embodiment 1 is demonstrated using FIGS. 2-4 is a figure for demonstrating the example of the process performed by the smart phone 1 which concerns on Embodiment 1. FIG. The eyes 100 shown in FIGS. 2 and 3 correspond to the eyes of the user who operates the smartphone 1. The finger 200 shown in FIGS. 2 and 3 corresponds to the finger of the user who operates the smartphone 1.

  As shown in FIG. 2, the smartphone 1 determines whether there is a difference between the contact position P1 with respect to the touch screen display 2 and the line-of-sight position P2 with respect to the touch screen display 2 (step S11). The line-of-sight position P2 corresponds to the line-of-sight position of the user when the contact position P1 is detected by the touch screen 2B.

  When the smartphone 1 determines that there is a difference between the contact position P1 and the line-of-sight position P2, as a result of the determination, the smartphone 1 detects the line-of-sight position P2 with respect to the touch screen display 2 when the contact position P1 is detected. P3 is determined (step S12). The smartphone 1 does not execute processing corresponding to the contact position P1 actually operated by the user, but executes processing corresponding to the corrected contact position P3.

  As illustrated in FIG. 3, the smartphone 1 determines whether there is a difference between the contact position P1 with respect to the touch screen display 2 and the line-of-sight position P2 with respect to the touch screen display 2 (step S21).

  If the smartphone 1 determines that there is a difference between the contact position P1 and the line-of-sight position P2, the touch position P1 with respect to the touch screen display 2 and the touch screen display 2 when the contact position P1 is detected are detected. A predetermined position on the line connecting the line-of-sight position P2 is determined as the corrected contact position P3 (step S22). In the example illustrated in FIG. 3, the smartphone 1 determines, for example, the midpoint of a line segment connecting the contact position P1 and the line-of-sight position P2 as the corrected contact position P3. The smartphone 1 does not execute processing corresponding to the contact position P1 actually operated by the user, but executes processing corresponding to the corrected contact position P3.

  As shown in FIG. 4, the smartphone 1 displays the screen 50 of the telephone application 9C on the touch screen display 2 (step S31). The plurality of keys included in the screen 50 is an example of an operation target.

  Subsequently, the smartphone 1 determines whether there is a difference between the contact position P1 with respect to the screen 50 displayed on the touch screen display 2 and the line-of-sight position P2 with respect to the touch screen display 2 (step S32).

  If there is a difference between the contact position P1 and the line-of-sight position P2 as a result of the determination, the smartphone 1 selects one key corresponding to the line-of-sight position P2 from among a plurality of keys included in the screen 50 as a plurality of operation targets. The position where the identified key is identified and displayed on the touch screen display 2 is determined as the corrected contact position P3 (step S33). In the example illustrated in FIG. 4, the smartphone 1 specifies the key 50k corresponding to the line-of-sight position P2, and determines the position where the specified key 50k is displayed as the corrected contact position P3. The smartphone 1 does not execute processing corresponding to the contact position P1 actually operated by the user, but executes processing corresponding to the corrected contact position P3. As a result, for example, the number “5” is displayed on the screen 50.

  The speaker 11 is a sound output unit. The speaker 11 outputs the sound signal transmitted from the controller 10 as sound. The speaker 11 is used for outputting a ring tone and music, for example. One of the receiver 7 and the speaker 11 may also function as the other.

  The camera 12 converts the captured image into an electrical signal. The camera 12 is an in camera that captures an object facing the display 2A. For example, the camera 12 captures an image of the eyeball of the user who turns his / her line of sight toward the touch screen display 2. The camera 12 may be mounted on the smartphone 1 as a camera unit that can be used by switching between the in-camera and the out-camera. The infrared irradiation unit 13 irradiates infrared rays in synchronization with photographing performed by the camera 12.

  The connector 14 is a terminal to which another device is connected. The connector 14 may be a general-purpose terminal such as USB (Universal Serial Bus), HDMI (registered trademark) (High-Definition Multimedia Interface), Light Peak (Thunderbolt (registered trademark)), and an earphone microphone connector. . The connector 14 may be a dedicated terminal such as a dock connector. Devices connected to the connector 14 include, but are not limited to, external storage, speakers, and communication devices, for example.

  The acceleration sensor 15 detects the direction and magnitude of acceleration acting on the smartphone 1. The direction sensor 16 detects, for example, the direction of geomagnetism, and detects the direction (azimuth) of the smartphone 1 based on the direction of geomagnetism.

  The smartphone 1 may include a GPS receiver and a vibrator in addition to the above functional units. The GPS receiver receives a radio signal in a predetermined frequency band from a GPS satellite, demodulates the received radio signal, and sends the processed signal to the controller 10. The vibrator vibrates a part or the whole of the smartphone 1. The vibrator includes, for example, a piezoelectric element or an eccentric motor in order to generate vibration. Although not shown in FIG. 1, functional units such as a battery that are naturally used to maintain the functions of the smartphone 1 are mounted on the smartphone 1.

  The flow of processing by the smartphone 1 according to the first embodiment will be described with reference to FIGS. 5-8 is a flowchart which shows the flow of the process by the smart phone 1 which concerns on Embodiment 1. FIG. The processing illustrated in FIGS. 5 to 8 is realized by the controller 10 executing the line-of-sight position detection program 9A, the contact position correction program 9B, and the like stored in the storage 9.

  A basic processing flow by the smartphone 1 according to the first embodiment will be described with reference to FIG. As illustrated in FIG. 5, the controller 10 determines whether a line-of-sight position with respect to the touch screen display 2 has been detected (step S <b> 101). As a result of the determination, if the line-of-sight position with respect to the touch screen display 2 is not detected (No at Step S101), the controller 10 repeats the processing procedure at Step S101.

  On the other hand, when the line-of-sight position with respect to the touch screen display 2 is detected as a result of the determination (step S101, Yes), the controller 10 determines whether the contact position with respect to the touch screen display 2 has been detected (step S102). When the contact position on the touch screen display 2 is not detected as a result of the determination (No at Step S102), the controller 10 repeats the processing procedure at Step S102.

  On the other hand, when the contact position on the touch screen display 2 is detected as a result of the determination (step S102, Yes), the controller 10 determines the line-of-sight position detected in step S101 and the contact position detected in step S102. It is determined whether there is a difference between them (step S103).

  As a result of the determination, if there is a difference between the line-of-sight position detected in step S101 and the contact position detected in step S102 (step S103, Yes), the controller 10 detects the line-of-sight detected in step S101. Based on the position, correction of the contact position detected in step S102 is executed (step S104).

  Subsequently, the controller 10 executes a process based on the corrected contact position in step S104 (step S105), and ends the process shown in FIG.

  In step S103, if there is no difference between the line-of-sight position detected in step S101 and the contact position detected in step S102 as a result of the determination (step S103, No), the controller 10 performs step S102. The process based on the contact position detected in step S106 is executed (step S106), and the process shown in FIG.

  In the processing shown in FIG. 5, the order of the processing procedure in step S101 and the processing procedure in step S102 may be reversed. Further, in the process shown in FIG. 5, when only the contact position is detected first without detecting the line-of-sight position with respect to the touch screen display 2, the setting is changed to execute the process based on the contact position. It may be possible.

  The flow of processing by the smartphone 1 corresponding to FIG. 2 will be described with reference to FIG. As illustrated in FIG. 6, the controller 10 determines whether a line-of-sight position with respect to the touch screen display 2 has been detected (step S201). As a result of the determination, when the line-of-sight position with respect to the touch screen display 2 is not detected (No at Step S201), the controller 10 repeats the processing procedure at Step S201.

  On the other hand, when the line-of-sight position with respect to the touch screen display 2 is detected as a result of the determination (step S201, Yes), the controller 10 determines whether the contact position with respect to the touch screen display 2 has been detected (step S202). When the contact position on the touch screen display 2 is not detected as a result of the determination (No at Step S202), the controller 10 repeats the processing procedure at Step S202.

  On the other hand, when the contact position on the touch screen display 2 is detected as a result of the determination (step S202, Yes), the controller 10 determines the line-of-sight position detected in step S201 and the contact position detected in step S202. It is determined whether there is a difference between (step S203).

  As a result of the determination, if there is a difference between the line-of-sight position detected in step S201 and the contact position detected in step S202 (step S203, Yes), the controller 10 detects the line-of-sight detected in step S201. The position is determined as the corrected contact position (step S204). Thereby, for example, a position away from the line-of-sight position can be set as the contact position so that the finger does not block the line-of-sight position on the keyboard.

  Subsequently, the controller 10 executes processing based on the corrected contact position in step S204 (step S205), and ends the processing shown in FIG.

  In step S203, if the controller 10 determines that there is no difference between the line-of-sight position detected in step S201 and the contact position detected in step S202 (No in step S203), the controller 10 determines in step S202. The process based on the contact position detected in step S206 is executed (step S206), and the process shown in FIG.

  The flow of processing by the smartphone 1 corresponding to FIG. 3 will be described with reference to FIG. As illustrated in FIG. 7, the controller 10 determines whether a line-of-sight position with respect to the touch screen display 2 has been detected (step S301). As a result of the determination, when the line-of-sight position with respect to the touch screen display 2 is not detected (No at Step S301), the controller 10 repeats the processing procedure at Step S301.

  On the other hand, when the line-of-sight position with respect to the touch screen display 2 is detected as a result of the determination (step S301, Yes), the controller 10 determines whether the contact position with respect to the touch screen display 2 has been detected (step S302). When the contact position on the touch screen display 2 is not detected as a result of the determination (No at Step S302), the controller 10 repeats the processing procedure at Step S302.

  On the other hand, when the contact position on the touch screen display 2 is detected as a result of the determination (step S302, Yes), the controller 10 determines the line-of-sight position detected in step S301 and the contact position detected in step S302. Whether there is a difference between them is determined (step S303).

  As a result of the determination, if there is a difference between the line-of-sight position detected in step S301 and the contact position detected in step S302 (step S303, Yes), the controller 10 detects the line-of-sight detected in step S301. A predetermined position on a line connecting the position and the contact position detected in step S302 is determined as a corrected contact position (step S304).

  Subsequently, the controller 10 executes a process based on the corrected contact position in step S304 (step S305), and ends the process shown in FIG.

  In step S303, if the controller 10 determines that there is no difference between the line-of-sight position detected in step S301 and the contact position detected in step S302 (step S303, No), step S302 is performed. The process based on the contact position detected in step S306 is executed (step S306), and the process shown in FIG.

  The flow of processing by the smartphone 1 corresponding to FIG. 4 will be described using FIG. As illustrated in FIG. 8, the controller 10 determines whether a line-of-sight position with respect to the touch screen display 2 has been detected (step S401). As a result of the determination, if the line-of-sight position with respect to the touch screen display 2 is not detected (No at Step S401), the controller 10 repeats the processing procedure at Step S401.

  On the other hand, when the line-of-sight position with respect to the touch screen display 2 is detected as a result of the determination (step S401, Yes), the controller 10 determines whether the contact position with respect to the touch screen display 2 has been detected (step S402). When the contact position on the touch screen display 2 is not detected as a result of the determination (No at Step S402), the controller 10 repeats the processing procedure at Step S402.

  On the other hand, when the contact position on the touch screen display 2 is detected as a result of the determination (step S402, Yes), the controller 10 determines the line-of-sight position detected in step S401 and the contact position detected in step S402. Whether there is a difference between them is determined (step S403).

  If there is a difference between the line-of-sight position detected in step S401 and the contact position detected in step S402 as a result of the determination (step S403, Yes), the controller 10 is displayed on the touch screen display 2. One operation target corresponding to the line-of-sight position is specified from the plurality of operation targets, and the display position of the specified operation target is determined as the corrected contact position (step S404).

  Subsequently, the controller 10 executes a process based on the corrected contact position in step S404 (step S405), and ends the process shown in FIG.

  In step S403, if there is no difference between the line-of-sight position detected in step S401 and the contact position detected in step S402 as a result of the determination (step S403, No), the controller 10 performs step S402. The process based on the contact position detected in step S406 is executed (step S406), and the process shown in FIG.

  In the first embodiment, when the smartphone 1 has a difference between the contact position on the touch screen display 2 and the line-of-sight position on the touch screen display 2 when the contact position is detected, the smartphone 1 The contact position with respect to the touch screen display 2 is corrected based on the line-of-sight position with respect to the touch screen display 2 when the detection is performed. For this reason, according to Embodiment 1, the position of the input by a user can be adjusted more correctly.

(Embodiment 2)
An example of a functional configuration of the smartphone 1 according to the second embodiment will be described with reference to FIG.
FIG. 9 is a block diagram illustrating a functional configuration of the smartphone 1 according to the second embodiment. The functional configuration of the smartphone 1 according to the second embodiment is different from that of the first embodiment in the points described below.

  The storage 9 further stores threshold data 9D. The threshold data is used for processing executed by the controller 10. The threshold data 9D is data for determining the magnitude of vibration that acts on the smartphone 1. Here, the magnitude of vibration is the maximum amplitude generated within a unit time.

  The contact position correction program 9B detects the contact position when a difference occurs between the contact position with respect to the touch screen display 2 and the line-of-sight position with respect to the touch screen display 2 when the contact position is detected. The function which determines whether the magnitude | size of the vibration which acts on the smart phone 1 at the time of being performed is more than a predetermined threshold value is further provided. As a result of the determination, the contact position correction program 9B corrects the contact position when the magnitude of vibration acting on the smartphone 1 is equal to or greater than a predetermined threshold, and the magnitude of vibration acting on the smartphone 1 is a predetermined threshold. If not, the function of not correcting the contact position is further provided.

  The controller 10 executes the following processing by executing the contact position correction program 9B. The controller 10 measures the magnitude of vibration acting on the smartphone 1 based on the detection result of the acceleration sensor 15. When a difference occurs between the touch position on the touch screen display 2 and the line-of-sight position on the touch screen display 2 when the touch position is detected, the controller 10 determines the magnitude of vibration acting on the smartphone 1. It is determined whether or not a predetermined threshold value is exceeded. If the magnitude of vibration acting on the smartphone 1 is equal to or greater than a predetermined threshold as a result of the determination, the controller 10 corrects the contact position, and the magnitude of vibration acting on the smartphone 1 is not equal to or greater than the predetermined threshold. In this case, the contact position is not corrected.

  The flow of processing by the smartphone 1 according to the second embodiment will be described with reference to FIG. FIG. 10 is a flowchart showing a flow of processing by the smartphone 1 according to the second embodiment. The processing shown in FIG. 10 is realized by the controller 10 executing a line-of-sight position detection program 9A, a contact position correction program 9B, and the like stored in the storage 9. The processing shown in FIG. 10 is different from the processing performed by the smartphone 1 according to the first embodiment (for example, the processing shown in FIG. 5) in the processing procedures of step S504 and step S507.

  As illustrated in FIG. 10, the controller 10 determines whether a line-of-sight position with respect to the touch screen display 2 has been detected (step S501). As a result of the determination, when the line-of-sight position with respect to the touch screen display 2 is not detected (step S501, No), the controller 10 repeats the processing procedure of step S501.

  On the other hand, when the line-of-sight position with respect to the touch screen display 2 is detected as a result of the determination (step S501, Yes), the controller 10 determines whether the contact position with respect to the touch screen display 2 has been detected (step S502). When the contact position on the touch screen display 2 is not detected as a result of the determination (No at Step S502), the controller 10 repeats the processing procedure at Step S502.

  On the other hand, when the contact position on the touch screen display 2 is detected as a result of the determination (step S502, Yes), the controller 10 determines the line-of-sight position detected in step S501 and the contact position detected in step S502. Whether there is a difference between them is determined (step S503).

  If there is a difference between the line-of-sight position detected in step S501 and the contact position detected in step S502 as a result of the determination (step S503, Yes), the controller 10 determines the vibration acting on the smartphone 1. It is determined whether the size is greater than or equal to a threshold value (step S504).

  As a result of the determination, if the magnitude of vibration acting on the smartphone 1 is equal to or greater than the threshold value (Yes in step S504), the controller 10 is detected in step S502 based on the line-of-sight position detected in step S501. The contact position is corrected (step S505).

  Subsequently, the controller 10 executes a process based on the corrected contact position in step S505 (step S506), and ends the process shown in FIG.

  In step S504, when the magnitude of vibration acting on the smartphone 1 is not equal to or greater than the threshold value as a result of the determination (step S504, No), the controller 10 executes processing based on the contact position detected in step S502. Without (step S507), the process shown in FIG. That is, the controller 10 determines that the deviation between the line-of-sight position and the contact position is due to an erroneous operation by the user when a predetermined magnitude of vibration is applied to the smartphone 1, and Do not perform processing based on.

  In step S503, if there is no difference between the line-of-sight position detected in step S501 and the contact position detected in step S502 as a result of the determination (step S503, No), the controller 10 performs step S502. The process based on the contact position detected in step S508 is executed (step S508), and the process shown in FIG.

  According to the second embodiment, the smartphone 1 performs a process based on the corrected contact position by correcting the contact position when vibration of a predetermined magnitude is acting on the own device. On the other hand, the smartphone 1 does not execute the process based on the contact position when the vibration of a predetermined magnitude is not acting on the own device. Therefore, according to the second embodiment, it is possible to distinguish the user's erroneous operation based on environmental factors such as vibration and the simple erroneous operation, and to perform the input position adjustment by the user according to the situation.

  In said embodiment, although the smart phone 1 was demonstrated as an example of the apparatus which concerns on an attached claim, the apparatus which concerns on an attached claim is not limited to the smart phone 1. FIG. The device according to the appended claims may be a device other than a smartphone as long as it is an electronic device having a touch screen.

  The characterizing embodiments have been described in order to fully and clearly disclose the technology according to the appended claims. However, the appended claims should not be limited to the above-described embodiments, but all modifications and alternatives that can be created by those skilled in the art within the scope of the basic matters shown in this specification. Should be embodied by a possible configuration.

DESCRIPTION OF SYMBOLS 1 Smart phone 2 Touch screen display 2A Display 2B Touch screen 3 Button 4 Illuminance sensor 5 Proximity sensor 6 Communication unit 7 Receiver 8 Microphone 9 Storage 9A Gaze position detection program 9B Contact position correction program 9C Telephone application 9D Threshold data 9Z Setting data 10 Controller 11 Speaker 12 Camera 13 Infrared irradiation unit 14 Connector 15 Acceleration sensor 16 Direction sensor

Claims (5)

A display unit;
An image acquisition unit for acquiring images;
A contact position detection unit for detecting a contact position corresponding to the display unit;
A line-of-sight position detection unit that detects a line-of-sight position with respect to the display unit based on the image acquired by the image acquisition unit;
When there is a difference between the contact position with respect to the display unit and the line-of-sight position with respect to the display unit when the contact position is detected, the line of sight with respect to the display unit when the contact position is detected have a control unit for correcting a contact position with respect to the display unit based on the position,
When the control unit detects the contact position when there is a difference between the contact position with respect to the display unit and the line-of-sight position with respect to the display unit when the contact position is detected Determine whether the magnitude of the vibration acting on the aircraft is greater than or equal to a predetermined threshold,
As a result of the determination, when the magnitude of vibration acting on the own machine is greater than or equal to a predetermined threshold, the position of contact with the display unit is corrected, and the magnitude of vibration acting on the own machine is not greater than or equal to the predetermined threshold The mobile terminal does not correct the contact position with respect to the display unit .   The mobile terminal according to claim 1, wherein the control unit determines a line-of-sight position with respect to the display unit when the contact position is detected as the corrected contact position.   The control unit determines a predetermined position on a line connecting a contact position with respect to the display unit and a line-of-sight position with respect to the display unit when the contact position is detected as the corrected contact position. The portable terminal as described in. The display unit displays a screen including a plurality of operation targets,
The control unit identifies one operation target corresponding to the line-of-sight position from the plurality of operation targets, and determines the position where the identified operation target is displayed on the display unit as the corrected contact position The mobile terminal according to claim 1. A control method to be executed by a mobile terminal having a display unit and an image acquisition unit,
Detecting a position of contact corresponding to the display unit;
Detecting the position of the line of sight with respect to the display unit based on the image acquired by the image acquisition unit;
When there is a difference between the contact position with respect to the display unit and the line-of-sight position with respect to the display unit when the contact position is detected, the line of sight with respect to the display unit when the contact position is detected look including a step of correcting the contact position of the display unit based on the position,
The step of correcting the contact position includes detecting the contact position when a difference occurs between the contact position with respect to the display unit and the line-of-sight position with respect to the display unit when the contact position is detected. Determine whether the magnitude of the vibration acting on the aircraft when it is performed is greater than or equal to a predetermined threshold,
As a result of the determination, when the magnitude of vibration acting on the own machine is greater than or equal to a predetermined threshold, the position of contact with the display unit is corrected, and the magnitude of vibration acting on the own machine is not greater than or equal to the predetermined threshold The control method which does not correct | amend the contact position with respect to the said display part .

Images