JP5998105B2 - Mobile device, control method and program for mobile device - Google Patents

Description

  The present invention relates to portable devices such as a mobile phone, a PDA (Personal Digital Assistant), a tablet PC (Tablet PC), an electronic book terminal, a portable music player, a portable TV, and a portable navigation system, and more particularly to a portable device having a touch panel. Furthermore, the present invention relates to a control method and program that can be used for such a portable device.

  2. Description of the Related Art Conventionally, a mobile phone having a display disposed on the front side of a housing is known (for example, see Patent Document 1). In such a mobile phone, for example, a substantially rectangular display slightly smaller than the casing is arranged on the front side of the casing having a substantially rectangular outline. Further, a touch panel is disposed so as to overlap the display, and various application programs (hereinafter simply referred to as “applications”) are executed based on a user's touch operation on the display.

JP 2012-203895 A

  FIG. 15 shows how the user operates the mobile phone. As shown in FIG. 15, an increasing number of users hold a slightly lower side of a mobile phone with one hand and operate a display, that is, a touch panel arranged on the display, with a thumb.

  In recent years, the display of a mobile phone has become larger, and when the operation is performed with the thumb as described above, from the upper part of the display to the side opposite to the base of the thumb as shown by a dashed line in FIG. The thumb is difficult to reach.

  In order to operate the operation objects (icons, soft keys, etc.) in the region where the thumb is difficult to reach in this way, the user must perform a complicated operation such as changing the mobile phone.

  In view of the above problems, an object of the present invention is to provide a portable device, a portable device control method, and a program that allow a user to perform a smooth operation.

The portable device according to the first aspect of the present invention includes a display unit, a detection unit that detects a touch position on the display unit that has been touched, and a control that controls the display unit based on a detection result by the detection unit. A section. Here, the control unit sets a first reference position related to the touch position and a second reference position related to the cursor position on the display unit before the touch position moves. Then, when the touch position is moved, the control unit moves from the second reference position by a second vector obtained by enlarging the first vector between the touch position detected by the detection unit and the first reference position. By moving the cursor position in a trajectory obtained by enlarging the trajectory of the touch position by determining the separated position as the cursor position, and for indicating the position to be operated on the cursor position on the display unit Display the cursor. Furthermore, the control unit can newly set the second reference position on the display unit and display the cursor when the cursor position is out of a range where the cursor can be displayed on the display unit. The touch position when the cursor position exists at a position outside the range is newly set as the first reference position.

  In the portable device according to this aspect, when the cursor position is out of a range where the cursor can be displayed on the display unit, another cursor position for displaying the cursor is provided on the display unit. Thus, the other cursor position can be set as the second reference position.

  In the mobile device according to this aspect, the control unit determines the touch position when the movement of the touch position is stopped in a state where the cursor position exists at a position outside the range where the cursor can be displayed. The configuration may be such that the position is set.

  In the portable device according to this aspect, the control unit determines the touch position at the time of elapse of the predetermined time every time a predetermined time elapses in a state where the cursor position exists at a position outside the range where the cursor can be displayed. The configuration may be such that one reference position is set.

  In the mobile device according to this aspect, when the control unit detects that the touch position is not detected by the detection unit in a state where the first screen is displayed on the display unit and the cursor position exists on the display unit, The configuration may be such that the process assigned to the cursor position is executed with respect to the first screen.

  In the case of the above configuration, the control unit further includes a second screen on the display unit based on the fact that the cursor position has moved out of the display unit before the detection unit no longer detects the touch position. And when the touch position is no longer detected by the detection unit in a state where the second screen is displayed on the display unit, the processing assigned to the cursor position is executed with respect to the second screen. Can be.

  In the case of the above configuration, the second screen may further include a notification information list screen. In this case, the control unit displays the application corresponding to the notification information when the touch position is not detected by the detection unit in a state where the cursor position exists in any of the notification information on the list screen. Run on the department.

  A second aspect of the present invention relates to a portable device control method for controlling the display unit by detecting a touch position on the touched display unit. The control method according to this aspect includes a step of setting a first reference position related to the touch position and a second reference position related to the cursor position on the display unit before the touch position moves; When the movement is performed, the touch position is determined by determining a position away from the second reference position by a second vector obtained by enlarging the first vector between the detected touch position and the first reference position as the cursor position. A step of moving the cursor position in a trajectory obtained by enlarging a position trajectory, and displaying a cursor for indicating a position to be operated on the cursor position on the display unit; and the cursor position on the display unit When the cursor is out of the range where the cursor can be displayed, the second reference position is newly set on the display unit, and the cursor is out of the range where the cursor can be displayed Including the step of setting the new first reference position the touch position when the cursor position is present in the position.

The program according to the third aspect of the present invention provides a computer of a portable device that controls the display unit by detecting a touch position on the display unit that has been touched, before the touch position moves to the touch position. A function of setting the first reference position and the second reference position related to the cursor position on the display unit, and a movement between the detected touch position and the first reference position when the touch position is moved. The cursor position is moved along a trajectory obtained by enlarging the trajectory of the touch position by determining a position away from the second reference position by the second vector obtained by enlarging one vector, and the position on the display unit A function for displaying a cursor for indicating a position to be operated at the cursor position, and whether the cursor position is within a range where the cursor can be displayed on the display unit. If the cursor position is off, the second reference position is newly set on the display unit, and the touch position when the cursor position is outside the range where the cursor can be displayed is newly set on the display unit. And a function for setting to one reference position.

  The words “touched” in claims 1, 8, and 9 include not only the concept “the display unit is touched by a finger” but also “the display unit has a finger etc. The concept of “close” is included.

  ADVANTAGE OF THE INVENTION According to this invention, the control method and program of a portable device with which a user can perform smooth operation, a portable device can be provided.

  The effects and significance of the present invention will become more apparent from the following description of embodiments. However, the following embodiment is merely an example when the present invention is implemented, and the present invention is not limited to what is described in the following embodiment.

It is a figure which shows the structure of the mobile telephone based on Embodiment. It is a block diagram which shows the whole structure of the mobile telephone based on Embodiment. It is a figure for demonstrating the screen displayed on a display by execution of an application based on Embodiment. It is a figure which shows the example of a screen display in case the process according to the touch operation with respect to a display is performed based on embodiment. It is a figure for demonstrating the notification list screen displayed on a display based on Embodiment. It is a flowchart which shows the control process of cursor mode based on embodiment. It is a flowchart which shows the control process of cursor mode based on embodiment. It is a flowchart which shows the control process of cursor mode based on embodiment. It is a figure which shows an example of a screen display when the control process of cursor mode based on embodiment is performed. It is a figure which shows an example of a screen display when the control process of cursor mode based on embodiment is performed. It is a figure which shows the structure compared with the structure of embodiment. It is a flowchart which shows the control process of cursor mode based on the example of a change. It is a figure for demonstrating the example in which an operation menu screen is displayed when the cursor position moves out of a display based on the other example of a change. It is a figure for demonstrating the example which an adjacent page is displayed when the cursor position moves out of a display based on the other example of a change. It is a figure which shows a mode that a user operates a mobile telephone.

  Hereinafter, embodiments of the present invention will be described with reference to the drawings.

FIGS. 1A, 1B, and 1C are a front view, a rear view, and a right side view of the mobile phone 1, respectively. Hereinafter, for convenience of explanation, as shown in FIGS. 1A to 1C, the longitudinal direction of the cabinet 2 is defined as the vertical direction, and the short direction of the cabinet 2 is defined as the horizontal direction.

  As shown in FIG. 1, the mobile phone 1 includes a cabinet 2, a display 3, a touch panel 4, a microphone 5, a call speaker 6, an external speaker 7, and a camera 8.

  The cabinet 2 has a substantially rectangular outline when viewed from the front. A display 3 is arranged on the front side of the cabinet 2. Various images (screens) are displayed in the display area R of the display 3. The display 3 is a liquid crystal display, for example. The display 3 may be another type of display such as an organic EL display. Further, a touch panel 4 is disposed so as to cover the display 3. The touch panel 4 is formed in a transparent sheet shape. As the touch panel 4, various types of touch panels such as a capacitance type, an ultrasonic type, a pressure sensitive type, a resistance film type, and a light detection type can be used.

  Inside the cabinet 2, a microphone 5 is arranged at the lower end. Further, inside the cabinet 2, a call speaker 6 is arranged at the upper end. The microphone 5 receives sound that has passed through a microphone hole 5 a formed in the front of the cabinet 2. The microphone 5 generates an electrical signal corresponding to the input sound. The call speaker 6 outputs sound. The output sound passes through an output hole 6 a formed in the front of the cabinet 2 and is emitted to the outside of the cabinet 2. During a call, the received voice received from the communication destination device (such as a mobile phone) is output from the call speaker 6, and the uttered voice uttered by the user is input to the microphone 5. Note that the sound includes various sounds such as sound and notification sound.

  An external speaker 7 is disposed inside the cabinet 2. On the back surface of the cabinet 2, an output hole 7 a is formed in a region facing the external speaker 7. The sound output from the external speaker 7 passes through the output hole 7a and is emitted to the outside of the cabinet 2.

  A camera 8 is disposed on the back side of the upper part of the cabinet 2. The camera 8 includes an image sensor such as a CCD or a CMOS sensor, and photographs a subject.

  FIG. 2 is a block diagram showing the overall configuration of the mobile phone 1.

  As shown in FIG. 2, the mobile phone 1 includes a control unit 11, a storage unit 12, an image output unit 13, a touch detection unit 14, a voice input unit 15, a voice output unit 16, and a voice processing unit. 17, a key input unit 18, a communication unit 19, and a photographing unit 20.

  The storage unit 12 includes a ROM, a RAM, and an external memory. The storage unit 12 stores various programs. The programs stored in the storage unit 12 include various applications (for example, home, telephone, e-mail, web browser, map, game, schedule management, etc.) in addition to a control program for controlling each unit of the mobile phone 1. Including. Further, the program stored in the storage unit 12 includes a program for executing a cursor mode control process, which will be described later. These programs are stored in the storage unit 12 by the manufacturer when the cellular phone 1 is manufactured, and are also stored in the storage unit 12 by a user via a storage medium such as a communication network, a memory card, or a CD-ROM.

  The storage unit 12 also includes a working area that stores data that is temporarily used or generated when the program is executed.

The control unit 11 includes a CPU. In accordance with the program stored in the storage unit 12, the control unit 11 includes each unit (storage unit 12, image output unit 13, touch detection unit 14,
A voice input unit 15, a voice output unit 16, a voice processing unit 17, a key input unit 18, a communication unit 19, a photographing unit 20, and the like.

  The image output unit 13 includes the display 3 shown in FIG. The image output unit 13 displays an image (screen) on the display 3 based on the control signal and the image signal from the control unit 11.

  The touch detection unit 14 includes the touch panel 4 shown in FIG. The touch detection unit 14 detects a touch operation by the user on the display 3 illustrated in FIG. That is, when the user touches the display area R of the display 3, the touch detection unit 14 uses the touch panel 4 to detect a position touched by the user (hereinafter referred to as “touch position”). The touch detection unit 14 outputs a position signal generated based on the detected touch position to the control unit 11. As shown in FIG. 1A, on the display 3, for example, an orthogonal coordinate system is set with the upper left corner of the display 3 as the origin, the left and right directions as the X axis, and the up and down directions as the Y axis. When a finger is touched on the display 3, the touch panel 4 outputs a coordinate value indicating a touch position on the display 3.

  The touch panel 4 may be configured to detect a position where the finger is approached as a touch position when the user's finger is close to the display 3.

  Since the mobile phone 1 is provided with the touch panel 4, the user can perform various touch operations by touching the display 3 with a finger. The touch operation includes, for example, a tap operation, a flick operation, a slide operation, a drag operation, a long touch operation, and the like. The tap operation is an operation of releasing the finger from the display 3 in a short time after the user touches the display 3 with the finger. The flick operation is an operation in which the user touches the display 3 with a finger and then flips the display 3 with the finger in an arbitrary direction. The slide operation is an operation in which the user moves the finger in an arbitrary direction while keeping the finger in contact with the display 3. The drag operation is an operation of releasing a finger from the display 3 after the user performs a slide operation on a moving object such as an icon. The long touch operation is an operation in which, after the user touches the display 3 with the finger, the finger is kept in contact with the display 3 for a long time without moving the finger.

  For example, when the touch detection unit 14 detects a touch position and the touch position is not detected within a predetermined first time after the touch position is detected, the control unit 11 determines that the touch operation is a tap operation. judge. When the touch position is no longer detected after the touch position has been moved within a predetermined second time after the touch position is detected and the touch position is not detected, the control unit 11 performs a flick operation on the touch operation. Is determined. After the touch position is detected, when the touch position moves by a predetermined second distance or more, the control unit 11 determines that the touch operation is a slide operation. After the touch position is detected, the control unit 11 determines that the touch operation is a long touch operation when the touch position continues to be detected for a third time or more without moving for a predetermined third distance or more. .

  The voice input unit 15 includes a microphone 5. The voice input unit 15 outputs an electrical signal from the microphone 5 to the voice processing unit 17.

  The audio output unit 16 includes a call speaker 6 and an external speaker 7. An electrical signal from the audio processing unit 17 is input to the audio output unit 16. The audio output unit 16 outputs sound from the call speaker 6 or the external speaker 7.

The audio processing unit 17 performs A / D conversion or the like on the electrical signal from the audio input unit 15 and outputs the converted digital audio signal to the control unit 11. The audio processing unit 17 performs decoding processing, D / A conversion, and the like on the digital audio signal from the control unit 11, and outputs the converted electric signal to the audio output unit 16.

  The key input unit 18 includes at least one hard key. For example, the key input unit 18 includes a power key for turning on the mobile phone 1. The key input unit 18 outputs a signal corresponding to the pressed hard key to the control unit 11 when at least one of the various hard keys (not shown) arranged on the mobile phone 1 is pressed. To do.

  The communication unit 19 includes a circuit for converting a signal, an antenna for transmitting and receiving radio waves, and the like for performing communication and communication. The communication unit 19 converts a call or communication signal input from the control unit 11 into a radio signal, and transmits the converted radio signal to a communication destination such as a base station or another communication device via an antenna. To do. Further, the communication unit 19 converts the radio signal received via the antenna into a signal in a format that can be used by the control unit 11, and outputs the converted signal to the control unit 11.

  The photographing unit 20 includes a camera 8 shown in FIG. The imaging unit 20 performs various types of image processing on the image data of the image captured by the camera 8 and outputs the image data after the image processing to the control unit 11.

  FIG. 3 is a diagram for explaining a screen displayed on the display 3 by executing the application. The control unit 11 executes various applications as described above. After the application is executed, the control unit 11 executes a process according to the touch operation on the display 3 by the user, and displays a screen based on the process on the display 3.

  As shown in FIG. 3, the screen displayed on the display 3 includes a pictogram area RP, a window area RW, and a key area RK. A notification bar 101 is displayed in the pictogram area RP. The notification bar 101 includes a current time 101a, an intensity meter 101b indicating the intensity of radio waves, a remaining amount meter 101c indicating the remaining battery level, and the like. Further, the notification bar 101 includes a notification icon 101d corresponding to other notification information to be notified to the user other than the current time 101a, the intensity meter 101b, and the remaining amount meter 101c. Other notification information includes, for example, information related to missed calls (phone number, caller name, etc.), information related to new incoming e-mails (mail address, sender name, etc.), alarm notification time, etc. Information indicating that the scheduled time of the schedule has passed, information regarding updating of the mobile phone 1, information indicating that an external memory is connected to the mobile phone 1, and the like. The user can check the notification information roughly by checking the notification bar 101.

  An operation key group 102 is displayed in the key area RK. The operation key group 102 includes a setting key 102a, a home key 102b, and a back key 102c. The setting key 102a is a key for mainly displaying a setting screen for performing various settings on the display 3. The home key 102b is a key for mainly shifting the display on the display 3 from another screen to the home screen. The back key 102c is a key for returning the executed process to the process one step before.

In the window area RW, an operation screen when the application is executed is displayed. For example, when a home application is executed, a home screen is displayed in the window area RW. On the home screen, activation icons for activating various applications such as telephone and e-mail on the display 3 (in the foreground) are arranged. When a telephone application is executed, a dial screen, an incoming call list screen, and the like are displayed in the window area RW. Furthermore, when a web browser application is executed, the window area RW is based on data acquired from an external server,
A web screen is displayed.

  Depending on the application to be executed, at least one of the pictogram area RP and the key area RK may not be displayed. In this case, the window area RW may extend to the picto area RP or the key area RK. That is, the entire screen may be configured by the window area RW. For example, when the pictogram area RP is not displayed, the operation screen when the application is executed may be displayed using the window area RW extending to the pictogram area RP. When the key area RK is not displayed, the operation screen when the application is executed may be displayed using the window area RW extending to the key area RK. When both the pictogram area RP and the key area RK are not displayed, the operation screen when the application is executed may be displayed using the window area RW expanded on the entire display 3.

  FIG. 4 is a diagram illustrating an example of a screen display when processing according to a touch operation on the display 3 is performed.

  When detecting a tap operation on the home key 102b, the control unit 11 executes the home application and causes the display 3 to display the home screen. On the home screen, activation icons 103 for activating various applications are arranged. For example, as shown in FIG. 4A, when the user performs a tap operation on the activation icon 103 of the telephone application, the telephone application is activated on the display 3 as shown in FIG. Then, a dial screen is displayed on the display 3. The dial screen is a screen for a user to enter a telephone number and make a call.

  As shown in FIG. 4C, the home screen is composed of a plurality of pages. For example, when a page continues in the left direction, if a flick operation in the right direction is performed with respect to an arbitrary position on the home screen, the home screen scrolls, and as shown in FIG. It is displayed on the display 3. Further, the plurality of pages may be ranked with respect to each other. For example, when the control unit 11 detects a flick operation when any screen is displayed, the control unit 11 is given to the screen on which the flick operation has been performed. One screen may be selected based on the flick operation from the screens associated with the ranks before and after the rank, and the selected screen may be displayed on the display 3.

  FIG. 5 is a diagram for explaining the notification list screen 104 displayed on the display 3.

  The notification bar 101 in the pictogram area RP of the display 3 functions as an object used for an operation for displaying the notification list screen 104 on the display 3. On the notification list screen 104, each notification information indicated by the notification icon 101d or the like on the notification bar 101 is displayed in more detail.

  As shown in FIG. 5A, when the user performs a downward sliding operation on the notification bar 101, as shown in FIG. 5B, the notification list screen 104 is displayed on the display 3 (window area RW). Is displayed. At this time, the notification list screen 104 may be displayed so as to descend from the lower end of the notification bar 101 so as to be pulled out from the notification bar 101 by a slide operation.

  Notification information is displayed in more detail in each display column 104a of the notification list screen 104 than the notification icon 101d. For example, when the notification information is missed call information, the number of missed calls and the latest missed call information (such as a telephone number) are displayed in the display column 104a.

  As shown in FIG. 5B, when the user responds to desired notification information, the user performs a tap operation on the display column 104a corresponding to the notification information. As a result, the application corresponding to the notification information that has been tapped is activated. For example, when the notification information is missed call information, a telephone application is started, and as shown in FIG. 5C, a missed call list screen 105 in which missed call information is displayed in each display column 105a is displayed. 3 is displayed.

  Now, when using the mobile phone 1, the user often holds the device body with one hand and touches the display 3 with the thumb. As described above with reference to FIG. 15, it is difficult for the thumb to reach the position of the display 3 far from the thumb. Therefore, there is an object to be operated such as the activation icon 103 at a position where the thumb is difficult to reach, and when the user performs a touch operation on the object, the user needs to change the mobile phone 1.

  Therefore, in order to allow the user to smoothly perform an operation with one hand, the mobile phone 1 according to the present embodiment will be described below in addition to the normal mode that accepts the tap operation and the flick operation described above as the operation mode. It has a cursor mode.

  Hereinafter, the cursor mode will be described with reference to FIGS.

  6 to 8 are flowcharts showing the control process in the cursor mode. 6 and 7 are flowcharts showing a main processing routine. FIG. 8 is a flowchart showing a processing routine for determining the cursor position. 9 and 10 are diagrams illustrating an example of a screen display when the cursor mode control process is performed. In FIG. 9, the home screen is displayed on the display 3.

  With reference to the flowcharts of FIGS. 6 and 7, the control unit 11 monitors whether or not a long touch operation has been performed on the display 3 (S101). In the present embodiment, the long touch operation is an operation for switching from the normal mode to the cursor mode.

  As shown in FIG. 9A, the user operating with one hand moves to the cursor mode when operating the activation icon 103 or the notification bar 101 located at the top of the display 3. Then, a long touch operation is performed with a thumb to an arbitrary position on the display 3.

  When the long touch operation is performed (S101: YES), the control unit 11 sets the current touch position acquired from the touch detection unit 14 as the reference touch position PA (S102). Next, the control unit 11 determines the reference cursor position QA (S103), and displays the cursor C at the determined reference cursor position QA (S104).

  By displaying the cursor C, the user can grasp that the cursor mode has been switched. When the reference cursor position QA is set to the same position as the reference touch position PA, the cursor C is hidden by the finger, and there is a possibility that the user cannot easily grasp the switching to the cursor mode. Therefore, as shown in FIG. 9A, the control unit 11 sets a position shifted by a predetermined vector from the reference touch position PA as the reference cursor position QA.

  In the present embodiment, for convenience, the cursor C has a circular shape, but the cursor C may have an arbitrary shape such as an arrow shape.

Next, the control unit 11 determines whether or not the next detection timing of the touch position by the touch detection unit 14 has arrived (S105). When the next detection timing comes (S105: YES), the control unit 11 determines whether or not the finger is released from the display 3 based on whether or not the touch position is detected by the touch detection unit 14 (S106). ). The control unit 11 determines that the finger has been released from the display 3 when the touch position that has been detected until the previous detection timing is no longer detected.

  As illustrated in FIG. 9B, when the user wants to operate the activation icon 103 located in the upper right part of the display 3, the user moves the finger to the target activation icon 103 while touching the display 3. As a result, the touch position moves on the display 3.

  If it is determined that the finger has not been released (S106: NO), the controller 11 determines the cursor position QB based on the touch position PB detected at the current detection timing (S107). The cursor position QB is a position where the cursor C is displayed. However, as described later, when the determined cursor position QB exists outside the displayable area RA (described later), the cursor C is not displayed at the cursor position QB.

  Referring to the flowchart of FIG. 8, the control unit 11 obtains a first vector VP between the touch position PB detected at the current detection timing and the reference touch position PA (S201). Next, the control unit 11 obtains a second vector VQ used for determining the cursor position QB by multiplying the first vector VP by a predetermined factor (for example, three times) (S202). Then, the control unit 11 determines a position away from the reference cursor position QA by the second vector VQ as the cursor position QB (S203).

  Returning to the flowcharts of FIGS. 6 and 7, when the cursor position QB is determined, the control unit 11 determines whether or not the determined cursor position QB is within the displayable area RA (S108). As shown in FIG. 9A, the control unit 11 provides a displayable area RA on the display 3. The displayable area RA is an area in which the cursor C can be displayed without the cursor C protruding from the display area R of the display 3 when the cursor C is displayed at the cursor position QB. Coordinate data indicating the displayable area RA is stored in the storage unit 12.

  If the determined cursor position QB is within the displayable area RA (S108: YES), the control unit 11 displays the cursor C at the determined cursor position QB (S109).

  In this way, when the user moves his / her finger while touching the display 3, the processing from step S105 to step S109 is repeated, and the cursor position QB, that is, the cursor is a trajectory obtained by enlarging the trajectory of the touch position by a predetermined time. C moves on the display 3. Eventually, the cursor C reaches the activation icon 103 in the upper right part.

  The user releases a finger from the display 3 in a state where the cursor C is positioned on the activation icon 103 in the upper right part. If it is determined that the finger has been released from the display 3 (S106: YES), the control unit 11 sets the cursor position QB at the time of release on the object to be operated such as the activation icon 103 and the display field 104a of the notification list screen 104. It is determined whether it is located in (S110). If the cursor position QB is positioned on the object (S110: YES), the control unit 11 executes the process assigned to the object (S111). For example, if the object is a phone application activation icon 103, the control unit 11 activates the phone application and displays a dial screen as shown in FIG.

When the user wants to operate the notification bar 101 located at the upper end of the display 3, as shown in FIG. 9C, the user touches the display 3 so that the cursor position QB exceeds the upper side of the display 3, Move it upwards.

  As shown in FIG. 9A, the control unit 11 provides an upper boundary line UL at a position away from the upper side of the display 3 by a predetermined distance Y1. The upper boundary line UL is a threshold for the cursor position QB, and is used to determine whether or not to display the notification list screen 104 on the display 3. Coordinate data indicating the upper boundary line UL is stored in the storage unit 12.

  When the user moves his / her finger upward, the processing from step S105 to step S109 described above is repeated until the cursor position QB deviates from the displayable area RA. Eventually, when the cursor position QB deviates from the displayable area RA, the control unit 11 determines in step S108 that the cursor position QB is not within the displayable area RA, that is, deviates from the displayable area RA (S108: NO). The control unit 11 sets a cursor position QC, which is different from the cursor position QB, to a position immediately before leaving the displayable area RA on the trajectory of the cursor position QB (S112), and displays the cursor C at the set cursor position QC. (S113). When the cursor position QB exceeds the upper side of the displayable area RA, the cursor C is displayed on the upper end portion of the display 3 as shown in FIG.

  The control unit 11 determines whether or not the movement of the touch position is stopped (S114). If the touch position is moving further upward and is not stopped (S114: NO), the control unit 11 determines whether or not the cursor position QB exceeds the upper boundary line UL (S115). . If the cursor position QB does not exceed the upper boundary line UL (S115: NO), the process returns to step S105.

  In this way, the processing from step S105 to step S108 and from step S112 to step S115 is repeated until the cursor position QB goes beyond the displayable area RA and exceeds the upper boundary line UL.

  Eventually, as shown in FIG. 9C, the cursor position QB exceeds the upper boundary line UL. Accordingly, when it is determined in step S115 that the cursor position QB exceeds the upper boundary line UL (S115: YES), the control unit 11 displays a notification list screen 104 on the display 3 as shown in FIG. Is displayed (S116). The notification list screen 104 is displayed so as to descend from the lower end of the notification bar 101.

  After the notification list screen 104 is displayed, even if it is determined in step S115 that the cursor position QB exceeds the upper boundary line UL, the processing in step S116 is not executed.

  When the user grasps that the notification list screen 104 is displayed, the user temporarily stops the finger. This stops the movement of the touch position. In step S114, it is determined that the movement of the touch position has stopped (S114: YES), and the control unit 11 newly sets the cursor position QC where the cursor C is currently displayed as shown in FIG. Is set to the reference cursor position QA (S117). Further, the control unit 11 newly sets the current touch position PB as the reference touch position PA (S118).

  When the user selects desired notification information from the notification list screen 104, the user moves the cursor C to the display column 104a of desired notification information while continuing to touch the display 3. Thereby, the processing from step S105 to S109 is repeated.

At this time, in the processing routine for determining the cursor position in FIG. 7, the reference touch position PA and the reference cursor position QA newly set in steps S117 and S118 are used. That is, the control unit 11 obtains the second vector VQ from the first vector VP between the touch position PB detected this time and the new reference touch position PA (S201, S202). Then, the control unit 11 determines a position away from the new reference cursor position QA by the second vector VQ as the cursor position QB (S203). Thus, as shown in FIG. 9B, when the user moves the finger so that the cursor C is directed to the desired notification information, the cursor C immediately moves in the same direction as the finger has moved.

  When the cursor C (cursor position QB) reaches the display field 104a for the desired notification information and the user releases the finger at that position, in step S106, the control unit 11 determines that the release has been made (S106: YES). ). Since the cursor position QB is positioned on the display field 104a which is an object (S110: YES), the control unit 11 selects an application corresponding to the process assigned to the object, that is, the notification information represented in the display field 104a. Execute (S111).

  When only viewing the notification information on the notification list screen 104 and closing the notification list screen 104, the user releases the finger in a state where the cursor position QB does not exist in the display column 104a.

  If it is determined in step S110 that the cursor position QB is not on the object (S110: NO), the control unit 11 determines whether the notification list screen 104 is displayed on the display 3 (S119). If the notification list screen 104 is displayed (S119: YES), the control unit 11 closes the notification list screen 104 (S120).

  As described above, not only when the user intentionally moves the cursor position QB to the outside of the display 3 in order to display the notification list screen 104, but also when the user moves the cursor C (cursor position QB on the display 3). ) Is moved, but the cursor position QB may deviate from the displayable area RA when the finger is moved too much by mistake.

  Also in this case, when the user temporarily stops his / her finger and the movement of the touch position is stopped, the processing of step S117 and step S118 is performed, and the cursor position QC where the cursor C is currently displayed becomes a new reference cursor position QA. The current touch position PB is newly set as the reference touch position PA. Therefore, after that, when the user moves the finger to the inside of the display 3, the cursor C immediately moves in the same direction as the direction of the moved finger.

  As described above, according to the present embodiment, when the user moves his / her finger while touching the display 3, the cursor C moves on the display 3 in a trajectory obtained by enlarging the trajectory of the finger. For example, when the user releases the finger while being moved to the position of the object to be operated, such as the activation icon 103, the process assigned to the object is executed. Therefore, when the user operates the mobile phone 1 while holding the mobile phone 1 with one hand, the user can operate the object or the like on the display 3 where the thumb cannot reach, and can smoothly operate the mobile phone 1. .

  Further, according to the present embodiment, when the user moves his / her finger on the display 3 so that the cursor position QB exceeds the upper side of the display 3, the notification list screen 104 is displayed on the display 3, and the user directly When the desired notification information is selected and the finger is released, an application corresponding to the notification information is executed. Further, when the user releases the finger without selecting the notification information, the notification list screen 104 is closed. Thus, the user operates from calling the notification list screen 104 to the display 3 until the application corresponding to the desired notification information is executed, and operation from calling the notification list screen 104 to closing the notification list screen 104. Can be realized by a series of operations of moving the finger on the display 3 and then releasing the finger, so that the mobile phone 1 can be operated more smoothly.

  Furthermore, according to the present embodiment, the notification list screen 104 is displayed when the cursor position QB exceeds the upper boundary line UL set outside the display 3. Therefore, the notification list screen 104 is not displayed even if the user accidentally moves his / her finger greatly to move the cursor position QB slightly off the display 3.

  Furthermore, according to the present embodiment, the reference touch position PA and the reference cursor position QA are set on the display 3 before the finger touched on the display 3 is moved, and the touch is performed after the finger movement is started. When the position PB is detected, a first vector VP between the detected touch position PB and the reference touch position PA is obtained. Then, a position separated from the reference cursor position QB by the second vector VQ obtained by enlarging the first vector VP by a predetermined multiple is determined as the cursor position QB. As a result, the cursor position QB is moved along a trajectory obtained by enlarging the trajectory of the touch position PB. That is, the reference touch position PA and the reference cursor position QA are fixed, and the reference touch position PA and the reference cursor position QA are not updated every time the touch position is detected. Therefore, an arithmetic process for determining the cursor position QB is performed. Difficult to get complicated.

  Unlike the above configuration, each time the touch position PB is detected, the detected touch position PB and the determined cursor position QB are set to the next reference touch position PA and the reference cursor position QA, respectively, and the next touch. When the position is detected, a first vector VP between the detected touch position PB and the new reference touch position PA and a value is obtained, the first vector VP is enlarged by a predetermined factor to obtain a second vector VQ, It can be considered that the cursor position QB is determined from the second vector VQ and the new reference cursor position QA. However, in this configuration, since the reference touch position PA and the reference cursor position QA are updated every time the touch position is detected, the arithmetic processing for determining the cursor position QB tends to be complicated.

  Furthermore, according to the present embodiment, when the cursor position QB deviates from the displayable area RA, another cursor position QC is set on the display 3, and the cursor C is displayed at this cursor position QC. . For this reason, even if the cursor position QB deviates from the displayable area RA, the cursor C remains on the display 3, so that the user is in the cursor mode and the cursor position QB can display the cursor C. It can be recognized that it is out of the range.

  Moreover, in the present embodiment, the touch position PB when the cursor position QB is out of the displayable area RA is newly set as the reference touch position PA, and another cursor position QC is newly set as the reference cursor position QA. It is set as the configuration set to. For this reason, when the user moves his / her finger to the inside of the display 3 from the state where the cursor position QB is out of the displayable area RA, the cursor C immediately moves. Also, the direction of movement of the cursor C is the same as the direction of finger movement.

  As shown in FIG. 11, when the reference touch position PA and the reference cursor position QA are not changed even after the cursor position QB deviates from the displayable area RA, the cursor position is moved by moving the finger to the inside of the display 3 to some extent. The cursor C does not start to move unless QB returns to the displayable area RA. That is, since the cursor C does not immediately move even when the user moves his / her finger, the user may feel poor followability (see FIG. 11A). In addition, since the direction in which the cursor C starts moving is different from the direction of the finger, the user may feel uncomfortable (see FIG. 11B). In this respect, in the configuration of the present embodiment, when the user moves the finger to the inside of the display 3, the cursor C immediately moves in the same movement direction as the finger, so that the user feels poor followability or feels uncomfortable. It is difficult to do.

Furthermore, in the present embodiment, the touch position PB when the movement of the touch position is stopped while the cursor position QB is out of the displayable area RA is set as the reference touch position PA,
Another cursor position QC is set as the reference cursor position QA. Normally, the user temporarily stops the finger that has moved the cursor position QB away from the display 3, and then moves the finger in a direction to return the cursor position QB to the display 3. Therefore, the reference touch position PA and the reference cursor position QA can be changed at an appropriate timing immediately before the user moves his / her finger to return the cursor position QB to the display 3.

  Although the embodiments of the present invention have been described above, the present invention is not limited to the above-described embodiments and the like, and various modifications can be made to the embodiments of the present invention in addition to the above. is there.

<Example of change>
In the above embodiment, the reference touch position PA and the reference cursor position QA are updated when the movement of the touch position stops in a state where the cursor position QB deviates from the displayable area RA. In the present modification example, while the cursor position QB is out of the displayable area RA, the update of the reference touch position PA and the reference cursor position QA is periodically repeated.

  FIG. 12 is a flowchart showing cursor mode control processing according to this modification. In FIG. 12, the process of step S114 is replaced with the process of step S121 with respect to the flowchart of FIG.

  In the present modification example, when the cursor position QB moves outside the displayable area RA, the control unit 11 initially has moved until the predetermined time has elapsed since the cursor position QB moved outside the displayable area RA. Once the reference touch position PA and the reference cursor position QA are updated, it is determined whether or not a predetermined time has elapsed since the reference update (S121). If it is determined that the predetermined time has elapsed (S121: YES), the control unit 11 newly sets another cursor position QC as the reference cursor position QA (S117) and newly sets the current touch position PB as the reference touch. The position PA is set (S118).

  It should be noted that the predetermined time is shorter than the time that is assumed to be required for the user who notices the cursor position QB to return the cursor position QB to the display 3 after the cursor position QB deviates from the displayable area RA. The predetermined time may be the same time as the touch position detection interval by the touch detection unit 14, or may be a longer time. The predetermined time can be set to a time of several ms to several tens of ms, for example.

  According to the configuration of this modified example, as in the above embodiment, when the user moves his / her finger to the inside of the display 3 when the cursor position QB deviates from the displayable area RA, the cursor C moves the same as the finger. Since it moves immediately in the direction, it can be made difficult for the user to feel poor followability or to feel uncomfortable.

<Other changes>
In the above embodiment, since the cursor C is drawn around the cursor position QB, the displayable area RA is set on the display 3. However, a configuration may be employed in which the displayable area RA is not set on the display 3 by drawing the cursor C inside the display 3 with respect to the cursor position QB. In this case, when the cursor position QB moves out of the display 3, the control unit 11 sets another cursor position QB on the display 3 and displays the cursor C.

Furthermore, in the above embodiment, when the cursor position QB moves outside the displayable area RA, another cursor position QC is set at the position immediately before the displayable area RA on the trajectory of the cursor position QB is set. The cursor C is displayed at the cursor position QC. However, a configuration may be adopted in which the cursor C is not displayed when the cursor position QB moves outside the displayable area RA. In this case, the processing in step S112 and step S113 is deleted in FIG. 7. In the processing in step S117, a predetermined position on the display 3, for example, a position immediately before leaving the displayable area RA on the trajectory of the cursor position QB. Is newly set to the reference cursor position QA.

  Furthermore, in the above embodiment, when the user moves his / her finger upward so that the cursor position QB exceeds the upper side of the display 3, the notification list screen 104 is displayed. However, as shown in FIG. 13, in addition to the above configuration, when the user moves his / her finger downward, left or right so that the cursor position QB exceeds the lower side, left side or right side of the display 3, the operation menu is displayed. A configuration in which the screen 106 is displayed may be adopted. The operation menu screen 106 is used for operating an application being executed on the display 3. On the operation menu screen 106, an operation button 106a for operating the application is arranged. For example, as shown in FIG. 13, when the executed application is an electronic book, a button for sending a page, a button for returning a page, and the like are arranged on the operation menu screen 106 as operation buttons 106a.

  In this example, the control unit 11 provides a lower boundary line BL at a position separated by a predetermined distance Y1 from the lower side of the display 3 and moves left and right by a predetermined distance X1 from the left side and the right side of the display 3, respectively. A left boundary line LL and a right boundary line RL are provided at positions separated from each other.

  When the user moves his / her finger downward, as shown in FIG. 13A, when the cursor position QB passes the lower side of the display 3 and crosses the lower boundary line BL, the control unit 11 moves the lower part of the display 3. The operation menu screen 106 is displayed. When the user moves his / her finger to the left and the cursor position QB passes the left side of the display 3 and exceeds the left boundary line LL as shown in FIG. The operation menu screen 106 is displayed on the left side of FIG. Furthermore, when the user moves his / her finger to the right and the cursor position QB passes the right side of the display 3 and exceeds the right boundary line RL as shown in FIG. 3, the operation menu screen 106 is displayed on the right side.

  When the cursor C is moved to the operation button 106a and the finger is released, processing related to the application being executed on the display 3 assigned to the operation button 106a is performed. For example, when an electronic book application is executed on the display 3, if the finger is released in a state where the cursor C is positioned on the page sending button, the next page of the book is displayed on the display 3. The

  Furthermore, as shown in FIG. 14, when the screen displayed on the display 3 includes a plurality of pages, the user moves his / her finger left or right so that the cursor position QB exceeds the left or right side of the display 3. A configuration may be adopted in which, when moved, a page adjacent to the currently displayed page is displayed. In FIG. 14, the home screen on which the activation icon 103 is arranged is displayed on the display 3.

In this example, when the user moves his / her finger to the left and the cursor position QB passes the left side of the display 3 and exceeds the left boundary line LL as shown in FIG. 14B, the page on the left is displayed on the display 3. Similarly, when the user moves his / her finger to the right and the cursor position QB passes the right side of the display 3 and exceeds the right boundary line RL, the control unit 11 displays the page on the right side on the display 3. .

  When the cursor C is moved to the activation icon 103 and the finger is released, the application corresponding to the activation icon 103 is activated on the display 3.

  Further, in the above embodiment, the upper boundary line UL is provided, and the control unit 11 displays the notification list screen 104 when the cursor position QB moves outside the upper boundary line UL. However, the upper boundary line UL may not be provided, and in this case, the control unit 11 displays the notification list screen 104 when the cursor position QB moves outside the upper side of the display 3 (display region R). Similarly, in the example of FIG. 13, the lower boundary line BL, the left boundary line LL, and the right boundary line RL are not provided, and the cursor position QB moves outside the lower side, the left side, or the right side of the display 3 (display area R). Sometimes, the control menu 11 may display the operation menu screen 106. Furthermore, in the example of FIG. 14, when the left boundary line LL and the right boundary line RL are not provided and the cursor position QB moves outside the left side or the right side of the display 3 (display region R), the control unit 11 Adjacent pages may be displayed.

  Furthermore, in the above embodiment, the reference cursor position QA is set to a position different from the reference touch position PA, but may be set to the same position.

  Furthermore, in the above-described embodiment, the cursor mode is shifted based on the long touch operation. However, the cursor mode may be shifted based on another operation, for example, a double tap operation or a hard key operation. In this case, the position on the display 3 where the finger is first touched after the transition to the cursor mode is set as the reference touch position PA.

  Furthermore, in the above embodiment, when the movement of the touch position is stopped in a state where the cursor position QB is out of the displayable area RA, the reference touch position PA and the reference cursor position QA are updated. However, the present invention is not limited to such a configuration, and in the configuration of the above embodiment, when it is determined that the notification list screen 104 is displayed when the cursor position QB exceeds the upper boundary line UL, the reference touch position PA and the reference cursor are displayed. The position QA may be updated. Similarly, in the configuration shown in FIG. 13, when it is determined that the notification list screen 104 is displayed when the cursor position QB exceeds the upper boundary line UL, and the cursor position QB is the lower boundary line BL, the left boundary line LL, or When it is determined that the operation menu screen 106 is displayed by crossing the right boundary line RL, the reference touch position PA and the reference cursor position QA may be updated. Further, in the configuration shown in FIG. 14, when it is determined that the notification list screen 104 is displayed when the cursor position QB exceeds the upper boundary line UL, and the cursor position QB exceeds the left boundary line LL or the right boundary line RL. Thus, when it is determined that an adjacent page is displayed, the reference touch position PA and the reference cursor position QA may be updated.

  Furthermore, in the above embodiment, the notification list screen 104 is the same size as the window area RW, but may be a small size. In this case, as in the example of FIG. 13, upper, lower, left, and right boundary lines UL, BL, LL, RL are provided, and the cursor position QB passes when any of the boundary lines UL, BL, LL, RL moves outside. The notification list screen 104 may be displayed at a position close to the side of the display 3 where the boundary lines UL, BL, LL, and RL exist.

  The present invention is not limited to a mobile phone, and can be applied to various portable devices such as a PDA (Personal Digital Assistant), a tablet PC (Tablet PC), an electronic book terminal, a portable music player, a portable TV, and a portable navigation system.

  In addition, the embodiment of the present invention can be variously modified as appropriate within the scope of the technical idea shown in the claims.

11 Control unit
13 Image output section
14 Touch detector
104 Notification list screen
PA reference touch position
PB touch position
QA reference cursor position
QB cursor position
C cursor
VP first vector
VQ second vector
RA displayable area

Claims (9)

A display unit;
A detection unit that detects a touch position on the display unit that has been touched;
A control unit for controlling the display unit based on a detection result by the detection unit,
The controller is
Before the touch position moves, a first reference position related to the touch position and a second reference position related to the cursor position are set on the display unit,
When the touch position moves, the cursor position is set to a position away from the second reference position by a second vector obtained by enlarging the first vector between the touch position detected by the detection unit and the first reference position. The cursor position is moved in a trajectory obtained by enlarging the trajectory of the touch position, and a cursor for indicating a position to be operated is displayed on the cursor position on the display unit,
When the cursor position deviates from the range where the cursor can be displayed on the display unit, the second reference position is newly set on the display unit, and the cursor is positioned outside the range where the cursor can be displayed. The touch position when the cursor position exists is newly set as the first reference position.
A portable device characterized by that. The mobile device according to claim 1,
When the cursor position is out of a range where the cursor can be displayed on the display unit, the control unit provides another cursor position on the display unit to display the cursor, and sets the another cursor position. Set to the second reference position;
A portable device characterized by that. The portable device according to claim 1 or 2,
The control unit sets the touch position when the movement of the touch position is stopped in a state where the cursor position exists at a position outside the range where the cursor can be displayed as the first reference position.
A portable device characterized by that. The portable device according to claim 1 or 2,
The control unit sets the touch position at the time of elapse to the first reference position every time a predetermined time elapses in a state where the cursor position exists at a position outside the range where the cursor can be displayed.
A portable device characterized by that. The portable device according to any one of claims 1 to 4,
When the first screen is displayed on the display unit and the touch position is not detected by the detection unit in a state where the cursor position exists on the display unit, the control unit moves the cursor to the cursor position with respect to the first screen. Execute the assigned process,
A portable device characterized by that. The mobile device according to claim 5,
The controller is
Based on the fact that the cursor position has moved out of the display unit before the touch position is no longer detected by the detection unit, a second screen is displayed on the display unit,
When the detection unit no longer detects the touch position in a state where the second screen is displayed on the display unit, the process assigned to the cursor position with respect to the second screen is performed.
A portable device characterized by that. The mobile device according to claim 6,
The second screen includes a list screen of notification information,
If the touch position is no longer detected by the detection unit in a state where the cursor position exists in any of the notification information on the list screen, the control unit displays an application corresponding to the notification information on the display unit. Run,
A portable device characterized by that. A method of controlling a portable device that controls the display unit by detecting a touch position on the touched display unit,
Setting a first reference position related to the touch position and a second reference position related to the cursor position on the display unit before the touch position moves;
When the touch position is moved, the cursor position is determined to be a position away from the second reference position by a second vector obtained by enlarging the first vector between the detected touch position and the first reference position. To move the cursor position in a trajectory obtained by enlarging the trajectory of the touch position, and to display a cursor for indicating the position to be operated on the cursor position on the display unit;
When the cursor position is out of the range where the cursor can be displayed on the display unit, the second reference position is newly set on the display unit, and the cursor is positioned outside the range where the cursor can be displayed. A step of newly setting the touch position when a position exists as the first reference position;
The control method characterized by including. In the computer of the portable device that controls the display unit by detecting the touch position on the touched display unit,
A function of setting a first reference position related to the touch position and a second reference position related to the cursor position on the display unit before the touch position moves;
When the touch position is moved, the cursor position is determined to be a position away from the second reference position by a second vector obtained by enlarging the first vector between the detected touch position and the first reference position. A function of displaying the cursor for indicating the position to be operated on the cursor position on the display unit, by moving the cursor position in a trajectory obtained by enlarging the trajectory of the touch position;
When the cursor position is out of the range where the cursor can be displayed on the display unit, the second reference position is newly set on the display unit, and the cursor is positioned outside the range where the cursor can be displayed. A function for newly setting the touch position when the position exists as the first reference position;
A program characterized by providing

Images