JP2016133828A - Information processing device, control method thereof, and control program - Google Patents

Abstract

PROBLEM TO BE SOLVED: To enable a user to easily perform an operation to a target object.SOLUTION: After one target object is selected from one or a plurality of objects displayed on a display (20), if a touch operation accompanied by movement is detected on a touch pad (30) a plurality of times, a main control unit (10) sequentially executes actions corresponding to movements to the identical target object.SELECTED DRAWING: Figure 1

Description

  The present invention relates to an information processing apparatus including a touch pad.

  2. Description of the Related Art Conventionally, an information processing apparatus that receives a touch operation performed by contacting an object with an object in a display unit is known. For example, the electronic device described in Patent Document 1 displays a seek bar in the display unit while playing back video content. The user can adjust the playback time of the video content by dragging the slider (object) in the seek bar with a finger.

JP 2012-114819 A (released on June 14, 2012)

  However, in the electronic device described in Patent Document 1, a user's finger touching the slider may cover the display of the slider. In this case, since the user cannot confirm where the slider (object) is displayed, there is a problem that it is difficult to adjust the reproduction position of the video content well.

  The present invention has been made in view of the above problems, and an object of the present invention is to make it easier for a user to perform an operation on a target object in an information processing apparatus that accepts a touch operation on an object in a display unit. It is to provide a processing apparatus.

  In order to solve the above problems, an information processing device according to one embodiment of the present invention includes a display unit, an object detection unit that includes a planar detection region that detects an object that approaches or touches, and the object detection unit includes: An information processing apparatus including a position information acquisition unit that acquires position information indicating a position where the object is detected, wherein one target object is selected from one or more objects displayed in the display area of the display unit. A target selection unit for selecting is further provided, and when a user operation instructing movement of the object is detected a plurality of times from the position information, an action corresponding to each user operation is sequentially executed on the same target object .

  In order to solve the above-described problem, a control method according to an aspect of the present invention includes a display unit, an object detection unit having a planar detection region for detecting an object that approaches or contacts, and the object detection unit. Is a control method of an information processing apparatus including a position information acquisition unit that acquires position information indicating a position where the object is detected, and is a method for controlling one of a plurality of objects displayed in a display area of the display unit. When a target selection step for selecting one target object and a user operation for instructing movement of the object from the position information are detected a plurality of times, actions corresponding to the user operations are sequentially performed on the same target object. And an operation control step to be executed.

  According to one aspect of the present invention, there is an effect that the user can more easily perform an operation on the target object.

1 is a block diagram illustrating a configuration of an information processing apparatus according to a first embodiment. 1 is an external view of an information processing apparatus according to a first embodiment. 6 is a diagram illustrating an example of image control executed by the information processing apparatus according to the first embodiment. FIG. 3 is a flowchart illustrating a flow of image control content determination processing executed by the information processing apparatus according to the first embodiment. 3 is a graph showing a touch position on a touch pad provided in the information processing apparatus according to the first embodiment and changes thereof. 10 is an explanatory diagram illustrating an example of image control executed by the information processing apparatus according to the second embodiment. FIG.

Embodiment 1
Hereinafter, embodiments of the present invention will be described in detail with reference to FIGS.

(Outline of the mobile terminal device 1)
The outline | summary of the portable terminal device 1 which concerns on this embodiment is demonstrated using FIG. FIG. 2 is an external view of the mobile terminal device 1.

  As shown in FIG. 2, the mobile terminal device 1 is a so-called foldable mobile phone. In the mobile terminal device 1, the first housing 1 </ b> A and the second housing 1 </ b> B are connected via the hinge 3, and can rotate around the axis of the hinge 3. The first housing 1A and the second housing 1B have, for example, a substantially flat plate shape. A display 20 (display unit) is disposed on one surface of the first housing 1A. A hard key 31 is arranged on one surface of the second housing 1B, and is placed under the hard key 31 (inside the second housing 1B) so as to overlap the hard key 31 for the touch pad 30 (object detection unit). Sensors are arranged.

  The mobile terminal device 1 has an open state (the form shown in FIG. 2) in which the first housing 1A and the second housing 1B are opened, and a surface (display surface) on which the display 20 of the first housing 1A is disposed. And a closed state (not shown) in which the surface (operation surface) on which the hard key 31 of the second housing 1B is disposed is opposed.

  The display 20 displays an image or the like (see FIG. 3) in the image display area pc. As the display 20, for example, an LCD (liquid crystal display), an organic EL display, or the like can be applied.

  The hard key 31 is used by the user to operate the mobile terminal device 1. The hard key 31 is a physical key that outputs a signal corresponding to the key pressed by the user. For example, the hard key 31 is a menu key, a numeric keypad, a cross key, a center key, an on-hook key, an off-hook key, or the like.

  The touch pad 30 is for operating the mobile terminal device 1. The touch pad 30 includes the above-described sensor, detects an object (such as a user's finger or stylus) that approaches or touches the touch pad 30 at predetermined time intervals, and detects the detected position (for example, two-dimensional on the touch pad 30). Position information indicating coordinates) is output. The detection area where the touch pad 30 detects an object is the entire surface (operation surface) on which the hard keys 31 of the second housing 1B are arranged. That is, the operation surface of the second housing 1B is the detection surface of the touch pad 30. Therefore, the key top surface of the hard key 31 is a part of the detection surface and is included in the detection region. The sensor provided in the touch pad 30 is a capacitance sensor or the like.

  In the present embodiment, the touch pad 30 detects whether or not the user's finger (operation article) is in contact with the operation surface of the second housing 1B. As shown in FIG. 2, the operation surface (detection region of the touch pad 30) of the second housing 1B is at a position different from the display surface (display region) of the display 20.

  In addition, although the foldable portable terminal device 1 is shown in FIG. 2, the present invention is not limited to this, and a portable terminal device such as a straight type, a slide type, or a biaxial hinge type may be used. In the present embodiment, a portable terminal device including an information processing device is illustrated, but the present invention is not limited to this. The present invention can be applied to any information processing apparatus including a display unit and an object detection unit having a planar detection area for detecting an object approaching or in contact with the display unit at a position different from the display area of the display unit. is there. The present invention is applicable to, for example, notebook PCs, portable game machines, digital cameras, digital video cameras, portable music players, and the like.

(Operation system of the mobile terminal device 1)
As described above, the mobile terminal device 1 includes the two operation units (input units) of the hard key 31 and the touch pad 30. In order to facilitate the user's operation with the touch pad 30 (to prevent erroneous operation), the main control unit 10 (information processing device) (see FIG. 1) of the mobile terminal device 1 includes a “key operation mode”, a “pointer mode”. ”And“ scroll mode ”.

  The key operation mode is a mode that can be operated only by the hard key 31. That is, in the key operation mode, the operation using the touch pad 30 is invalid. In key operation mode, for example, operate the cross key to move the focus (select an item in the list), press the center key to make a decision, operate the numeric keypad to enter numbers or characters, The user can press a key to start a call, or press an off-hook key to end a call or application.

  When the off-hook key is pressed and held in the key operation mode, the mode is shifted to the pointer mode. In the key operation mode, a specific application is activated to shift to the pointer mode. When the mobile terminal device 1 is activated, the main control unit 10 is in a key operation mode.

  The pointer mode is a mode in which an arrow mark cursor is displayed on the screen, and a cursor moving operation and a determining operation using the touch pad 30 are enabled. The pointer mode includes a cursor non-display state and a cursor display state. In the cursor non-display state, the user touches the touch pad 30 (the operation surface of the second housing 1B) and swipes a little to display the cursor. That is, the cursor transitions to the cursor display state. Moreover, the operation by the hard key 31 is possible similarly to the key operation mode. In the cursor display state, the user can move the cursor by swiping or flicking the touch pad 30 or single-tap the touch pad 30 within a predetermined time (for example, 1.5 seconds) after the cursor moves. Thus, the determination can be input at the position where the cursor is located, or the determination can be input at the position where the cursor is located by double-tapping the touch pad 30. When the hard key 31 is pressed in the cursor display state, the cursor is deleted. That is, the state transits to a cursor non-display state. Further, when a predetermined time elapses without operating the touch pad 30 in the cursor display state, the cursor transitions to the cursor non-display state.

  In the pointer mode, the key operation mode is entered by long-pressing the off-hook key. Also, the key operation mode is entered by terminating the specific application. In the pointer mode, a long tap on the touch pad 30 shifts to the scroll mode. When the mode is changed to the pointer mode, the cursor is displayed.

  The scroll mode is a mode that enables the screen to be scrolled by the touch pad 30. In the scroll mode, the screen can be scrolled by swiping or flicking the touch pad 30, or a predetermined process corresponding to the running application can be executed by long-tapping the touch pad 30. In the scroll mode, a single tap of the touch pad 30 makes a transition to the pointer mode. Also, in the scroll mode, when the predetermined time has passed without operating the touch pad 30, the mode is changed to the pointer mode. In the scroll mode, when the specific application is finished, the key operation mode is entered.

  As shown in FIG. 2, when the main control unit 10 is in the scroll mode, the main control unit 10 transitions to the pointer mode by accepting a short tap operation. Further, when the main control unit 10 is in the pointer mode, the main control unit 10 transitions to the scroll mode by accepting a long tap operation.

(Configuration of portable terminal device 1)
The configuration of the mobile terminal device 1 will be described with reference to FIG. FIG. 1 is a block diagram illustrating a configuration of the mobile terminal device 1. As illustrated in FIG. 1, the mobile terminal device 1 includes a main control unit 10 (information processing device), a display 20, a touch pad 30, a storage unit 40, and a work memory 50.

  The main control unit 10 includes a touch pad control unit 11, a touch event determination unit 12 (position information acquisition unit), and a display control unit 13. The touch pad control unit 11 acquires a detection signal generated in response to a touch operation on the touch pad 30 from the touch pad 30, and outputs the acquired detection signal to the touch event determination unit 12.

  When the detection signal is input from the touch pad control unit 11, the touch event determination unit 12 determines the type of the touch operation by executing an image control content determination process described later, and displays the determination result. To the unit 13.

  The display control unit 13 performs image control on objects (images (target objects) and pointers pt (signs)) displayed in the image display area pc of the display 20 based on the determination result by the touch event determination unit 12. The contents (for example, display scrolling, display of pointer pt) are executed.

  The storage unit 40 stores long press threshold time data indicating a reference time for a long press determination unit 123 (described later) of the touch event determination unit 12 to determine the presence or absence of a long press operation. The storage unit 40 also stores touch position data indicating the touch position determined by a touch determination unit 121 (described later) of the touch event determination unit 12. Further, the storage unit 40 also stores data such as an image displayed on the display 20, a cursor cr, and a pointer pt.

(Details of touch event determination unit 12)
Details of the touch event determination unit 12 will be described with reference to FIG. As illustrated in FIG. 1, the touch event determination unit 12 includes a touch determination unit 121, a move determination unit 122, and a long press determination unit 123 (target selection unit).

  The touch determination unit 121 acquires, from the touch pad control unit 11, a detection signal generated with a touch operation on the touch pad 30. Based on the acquired detection signal, the touch determination unit 121 performs a touch-down operation (a touch operation in which the user makes a finger touch the touch pad 30) and a touch-up operation (a touch operation in which the user releases the finger from the touch pad 30). Is detected (detected).

  The move determination unit 122 also acquires a detection signal generated with a touch operation on the touch pad 30 from the touch pad control unit 11. Based on the acquired detection signal, the move determination unit 122 detects a move operation (a touch operation in which the user moves a finger without releasing it from the touch pad 30. Swipe).

  The long press determination unit 123 acquires, from the touch pad control unit 11, a detection signal generated with a touch operation on the touch pad 30. Based on the acquired detection signal, the long press determination unit 123 detects (detects) a long press operation (a touch operation in which the user makes a finger contact the touch pad 30 beyond a threshold time).

(Example of image control; Part 1)
An example of image control by the touch event determination unit 12 will be described with reference to FIG. FIG. 3 is a diagram for explaining an example of image control executed by the touch event determination unit 12 and the display control unit 13. First, it is assumed that the main control unit 10 is in the pointer mode. Further, it is assumed that two image display area sections pc1 and pc2 are set on the display 20.

  As shown in FIG. 3, when the touchdown 30 is detected (step A) in the touchpad 30, the touch determination unit 121 acquires the detection signal generated along with the touchdown 1 from the touchpad control unit 11. To do. And the touch determination part 121 determines the position where the touchdown 1 was detected on the touchpad 30 based on the acquired detection signal.

  When the main control unit 10 is in the pointer mode, the long press determination unit 123 determines whether the touch operation is a long press operation, more specifically, the duration of the touch is longer than the long press threshold time of the storage unit 40. Whether it is too long or not. Here, the duration of the touch is the time from when touch-down is detected until touch-up or move is detected.

  When the duration of the touch is longer than the long press threshold time (step B), the main control unit 10 transitions from the pointer mode to the scroll mode. Along with this, the display control unit 13 deletes the cursor cr on the display 20. In addition, the touch determination unit 121 notifies the display control unit 13 of the position where the touchdown is detected, and the display control unit 13 corresponds to the position on the display 20 corresponding to the position where the touchdown is detected (hereinafter, corresponding The pointer pt is displayed / applied (referred to as “position”) (step B). Here, the position on the touch pad 30 and the position on the display 20 are associated with each other in advance one to one. In FIG. 3, a pointer pt is displayed in the image display area section pc2.

  After the pointer pt is displayed on the display 20 (that is, after the main control unit 10 transitions to the scroll mode), the move determination unit 122 detects a move operation on the touch pad 30 (step C).

  The move determination unit 122 acquires information on a touch position (a position indicated by a cross in FIG. 3) from the touch pad control unit 11 for each unit time. Then, the move determination unit 122 detects a change in the touch position in a period from when the touchdown 1 is detected until the unit time elapses as the first move operation. In addition, the move determination unit 122 determines the touch position (hereinafter referred to as the move start point) from the touch position when the first move operation is started (hereinafter referred to as the move start point) (hereinafter referred to as the move start point). Then, the move vector toward the move end point is calculated.

  After the first move operation is detected, the move determination unit 122 changes the touch position in the period from the time when the first move operation is completed until the unit time elapses. Detected as an operation. The move determination unit 122 calculates a move vector from the move start point of the second move to the move end point of the second move. Thereafter, the move determination unit 122 calculates the move vector of the third and subsequent moves in the same manner. Note that one swipe as a user operation corresponds to all the operations of the move included in the period from the time when touchdown 1 is detected to the time when touchup is detected.

  The move determination unit 122 notifies the display control unit 13 of the information on the move vector (or information on the move start point and the move end point). When the vector on the display 20 corresponding to the move vector is a downward vector in the coordinate system in the display 20, the display control unit 13 displays the image in the image display area section pc2 in the image display area section pc1. Scroll down (step C) so that it overlaps the image. Here, the vector on the display 20 corresponding to the move vector is obtained by converting the move vector detected in the coordinate system in the touch pad 30 into the coordinate system in the display 20. Note that the display control unit 13 does not move the pointer pt on the display 20.

  As shown in FIG. 3, when touch-down 2 is detected again (step D) after touch-up is detected (step C) on the touch pad 30, the move determination unit 122 performs the touch every unit time. Is acquired from the touchpad control unit 11 (position indicated by a cross in FIG. 3). Then, the move determination unit 122 detects a change in the position of the touch during a period from when the touchdown 2 is detected until the unit time elapses, as the first move operation. In addition, the move determination unit 122 calculates a move vector of the first move. After the first move operation is detected, the move determination unit 122 calculates the move vector of the second and subsequent moves in the same manner.

  The move determination unit 122 notifies the display control unit 13 of the information on the move vector (or information on the move start point and the move end point). When the vector on the display 20 corresponding to the move vector is a downward vector in the coordinate system in the display 20, the display control unit 13 displays the image in the image display area section pc2 in the image display area section pc1. Scroll down (step C) so that it overlaps the image.

(Image control content determination process flow)
The flow of image control content determination processing executed by the touch event determination unit 12 will be described with reference to FIGS. 4 and 5. FIG. 4 is a flowchart showing the flow of image control content determination processing. FIG. 5 is a graph showing the position of a touch on the touch pad 30 and its change. First, it is assumed that the main control unit 10 is in a pointer mode in which a cursor cr (see FIGS. 3 and 4) is displayed on the display 20.

  As shown in FIG. 4, in the image control content determination process, first, the touch determination unit 121 detects the touchdown 1 when the touchdown 1 is detected on the touch pad 30 (see step A in FIG. 4). The position (DX1, DY1) (see FIG. 5) is determined (S1, position information acquisition step).

  Next, the long press determination unit 123 detects a long press operation (see Step B of FIG. 3) (S2, target selection step). In other words, the long press determination unit 123 determines that the touchdown 1 is a long press operation. Then, the touch determination part 121 records the information which shows the position (DX1, DY1) where the touchdown 1 was detected in the memory | storage part 40 (S3).

  Subsequently, the touch determination unit 121 notifies the display control unit 13 of the position where the touch down 1 is detected on the touch pad 30. The display control unit 13 displays the pointer pt at a corresponding position on the display 20 corresponding to the position where the touchdown 1 is detected (see step B in FIG. 3) (S4).

  Thereafter, the touch determination unit 121 determines whether touch-up has been detected (S5). When the touch-up 1 is not detected (No in S5), the image control content determination process proceeds to S8. On the other hand, when a touch-up is detected (see step C in FIG. 3) (Yes in S5), when a new touch-down 2 is detected on the touch pad 30 (see step D in FIG. 3), the touch determination unit 121 determines the position (DX2, DY2) of touchdown 2 (see FIG. 5) (S6, position information acquisition step). The touch determination unit 121 then detects the difference (ΔX = DX2-DX1, ΔY = DY2-DY1) between the position (DX1, DY1) where the touchdown 1 is detected and the position (DX2, DY2) where the touchdown 2 is detected. ) (See FIG. 5) is calculated (S7).

  Next, the move determination unit 122 detects a move from the position (DX2, DY2) where the touchdown 2 is detected to the touch position (MX1, MY1) (see FIG. 5) after unit time (S8). (See step C in FIG. 3). Hereinafter, the position (DX2, DY2) is referred to as the start point of the move 1, and the position (MX1, MY1) is referred to as the end point of the move 1. Note that it is not necessary to detect touch-up at the positions (MX1, MY1).

  Thereafter, the move determination unit 122 calculates a correction end point (MX1 ′ = MX1−ΔX, MY1 ′ = MY1−ΔY) (see FIG. 5) of the move 1 (S9). When touch-up 1 is not detected (No in S5), the correction end point (MX1 ′, MY1 ′) of move 1 is equal to the end point (MX1, MY1) of move 1.

  The move determination unit 122 notifies the display control unit 13 (application) of the position (DX1, DY1) where the touchdown 1 is detected as the correction start point of the move 1 (S10, display control step). In addition, the move determination unit 122 notifies the correction end point (MX1 ′, MY1 ′) of the move 1 to the display control unit 13 (application) (S11, display control step). The display control unit 13 moves the move vector (MX1′-DX1, MY1′-DY1) from the correction start point (DX1, DY1) of the move 1 to the correction end point (MX1 ′, MY1 ′) in the coordinate system in the display 20. And the image in the image display area pc is scrolled along the converted vector (display control step).

  Alternatively, instead of S10 and S11, the move determination unit 122 may notify the display control unit 13 of the start point (DX2, DY2) of the move 1 and the end point (MX1, MY1) of the move 1. As shown in FIG. 5, the move vectors (MX1′-DX1, MY1′-DY1) from the correction start point (DX1, DY1) of the move 1 to the correction end points (MX1 ′, MY1 ′) of the move 1 are Is equal to a vector (MX1-DX2, MY1-DY2) from the start point (DX2, DY2) to the end point (MX1, MY1) of the move 1. Therefore, the vector converted from the vector (MX1-DX2, MY1-DY2) to the coordinate system in the display 20 is converted from the move vector (MX1'-DX1, MY1'-DY1) to the coordinate system in the display 20. Is equal to the vector

  In subsequent S12 to S17, detection of a new move n (n is an integer of 2 or more) and notification of the move n are executed.

  When the touch-up is not detected in S13 (No in S13) and the n-th move n is detected, in S12 to S17 of the image control content determination process, the move determination unit 122 determines the correction start point and the move of move n. The correction end point (MXn ′ = MXn−ΔX, MYn ′ = MYn−ΔY) of n is notified to the display control unit 13 (application). Here, the correction start point of move n is the correction end point (MXn-1 ′ = MX (n−1) −ΔX, MYn−1 ′ = MY (n−1) −ΔY of the n−1th move n−1. ).

  The display control unit 13 moves from the correction start point (MXn-1 ′, DYn-1 ′) of the nth move n to the correction end point (MXn ′, MYn ′) of the nth move n (MXn′−). MXn-1 ′, MYn′-MYn-1 ′) are converted into vectors in the coordinate system in the display 20, and the image in the image display area pc is scrolled along the converted vectors (display control step, operation) Control step).

  The information of the correction start point of move n and the correction end point of move n is notified not only to the display control unit 13 but also to an application installed in the mobile terminal device 1, and the application performs the operation of the notified move n. Accordingly, an action on the image in the image display area pc may be executed (operation control step).

  In FIG. 5, the move vector of the first move 1 and the move vector of the second move 2 are both move vectors in an oblique direction in the coordinate system (xy coordinate system) in the touch pad 30. However, in the present invention, when n (≧ 2) moves 1 to n are detected, at least one move m (1 ≦ m ≦ n) among the first move 1 to the n-th move n. The move vector may be an oblique vector in the coordinate system on the touchpad 30.

  If the touch-up is detected after the n-th move n is detected (Yes in S13), the image control content determination process ends.

(Modification)
FIG. 3 shows the flow of image control when two touchdowns 1 and 2 are detected. In the description of the flow of the image control content determination process, it is assumed that two touchdowns 1 and 2 are performed. In this modification, the flow of image control when the third touchdown is detected will be described with reference to FIG.

  As shown in FIG. 5, if the third touchdown is detected after the second move 2 (after the second touchup is detected), the touch determination unit 121 determines that the third touchdown is performed. The difference (ΔM = DX3-MX2, ΔN = DY3-MY2) between the detected position (DX3, DY3) and the end point (MX2, MY2) of the second move 2 is calculated.

  Next, the move determination unit 122 detects a move from the position (DX3, DY3) where the third touchdown is detected toward the touch position (MX3, MY3) after a unit time. Thereafter, the move determination unit 122 performs the correction start point of the move (DX3-ΔX-ΔM, DY3-ΔY-ΔN) and the correction end point of the move (MX3 ′ = MX3-ΔX-ΔM, MY3 ′ = MY3-ΔY). -ΔN) is calculated.

  Then, the move determination unit 122 notifies the display control unit 13 of the correction start point (DX3-ΔX-ΔM, DY3-ΔY-ΔN) and the correction end point (MX3 ′, MY3 ′) of the move.

  The display control unit 13 converts the move vector from the correction start point (DX3-ΔX-ΔM, DY3-ΔY-ΔN) to the correction end point (MX3 ′, MY3 ′) into a vector in the coordinate system in the display 20. Then, the image in the image display area pc is scrolled along the converted vector.

[Embodiment 2]
The following will describe another embodiment of the present invention with reference to FIG. For convenience of explanation, members having the same functions as those described in the embodiment are given the same reference numerals, and descriptions thereof are omitted.

  In the first embodiment, the configuration in which the display in the image display area section pc2 on which the pointer pt is displayed is scrolled (see FIG. 3).

  In the present embodiment, a configuration in which the slider sr in the seek bar se on which the pointer pt is displayed is slid. In the present embodiment, in addition to the data described in the first embodiment, each data of the seek bar se and the slider sr is also stored in the storage unit 40 (see FIG. 1). Moreover, the touch panel is arrange | positioned on the surface of the display 20B (refer FIG. 6) with which the portable terminal device 1 which concerns on this embodiment was equipped, The portable terminal device 1 performs touch operation with respect to the display 20B and the touchpad 30. FIG. Assume that it can be detected.

(Example of image control; 2)
FIG. 6 is an explanatory diagram illustrating an example of image control executed by the touch event determination unit 12 and the display control unit 13 according to the present embodiment. As shown in FIG. 6, the display 20 displays a seek bar se and a slider sr in addition to the image display area pc.

  As shown in FIG. 6, in this embodiment, when the main control unit 10 of the mobile terminal device 1 is in the pointer mode, when the touchdown is detected and the long press is detected (step A), the main control is performed. The unit 10 transitions from the pointer mode to the scroll mode. At this time, the touch determination unit 121 according to the present embodiment deletes the cursor cr on the display 20. Further, the touch determination unit 121 notifies the display control unit 13 of the position where the touchdown is detected, and the display control unit 13 sets the corresponding position on the display 20 corresponding to the position where the touchdown and long press are detected. The pointer pt is displayed (step B). Here, the position on the touch pad 30 and the position on the display 20 are associated with each other in advance one to one. In FIG. 6, a pointer pt is displayed in the seek bar se.

  After the pointer pt is displayed on the display 20 (that is, after the main control unit 10 transitions to the scroll mode), the move determination unit 122 detects a move operation on the touch pad 30 (step C).

  The move determination unit 122 acquires information on a touch position (a position indicated by a cross in FIG. 6) from the touch pad control unit 11 for each unit time. Then, as described in the first embodiment, the move determination unit 122 detects the change in the touch position in each move operation as the move operation. Also, a move vector from the start point to the end point of the move is calculated.

  The move determination unit 122 notifies the display control unit 13 of the information on the move vector (or information on the move start point and the move end point). When the vector on the display 20 corresponding to the move vector is a horizontal vector in the coordinate system in the display 20 or a vector including a horizontal component, the display control unit 13 Slide the slider sr in the horizontal direction (step C). Here, the vector on the display 20 corresponding to the move vector is obtained by converting the move vector detected in the coordinate system in the touch pad 30 into the coordinate system in the display 20. Note that the display control unit 13 does not move the pointer pt on the display 20.

  As shown in FIG. 6, when touch-down 2 is detected again (step D) after touch-up is detected (step C) on the touch pad 30, the move determination unit 122 touches every unit time. Is acquired from the touchpad control unit 11 (position indicated by a cross in FIG. 6). Then, as described in the first embodiment, the move determination unit 122 detects the change in the touch position in each move operation as the move operation. Also, a move vector from the start point to the end point of the move is calculated.

  The move determination unit 122 notifies the display control unit 13 of the information on the move vector (or information on the move start point and the move end point). When the vector on the display 20 corresponding to the move vector is a horizontal vector in the coordinate system in the display 20 or a vector including a horizontal component, the display control unit 13 Slide the slider sr in the horizontal direction (step C).

  In FIG. 6, the long press operation is performed on the display 20 (step A), while the move operation is performed on the touch pad (step C, step D). However, the move operation may also be performed on the display 20. In this case, the user performs the move operation in an area where the seek bar se is not displayed. Accordingly, since the finger performing the touch operation does not cover the seek bar se, the user can confirm the position of the slider sr in the seek bar se.

[Example of software implementation]
The control block (particularly the main control unit 10) of the mobile terminal device 1 may be realized by a logic circuit (hardware) formed in an integrated circuit (IC chip) or the like, or using a CPU (Central Processing Unit). It may be realized by software.

  In the latter case, the mobile terminal device 1 includes a CPU that executes instructions of a program that is software that realizes each function, and a ROM (Read Only Memory) in which the program and various data are recorded so as to be readable by a computer (or CPU). Alternatively, a storage device (these are referred to as “recording media”), a RAM (Random Access Memory) that expands the program, and the like are provided. And the objective of this invention is achieved when a computer (or CPU) reads the said program from the said recording medium and runs it. As the recording medium, a “non-temporary tangible medium” such as a tape, a disk, a card, a semiconductor memory, a programmable logic circuit, or the like can be used. The program may be supplied to the computer via an arbitrary transmission medium (such as a communication network or a broadcast wave) that can transmit the program. The present invention can also be realized in the form of a data signal embedded in a carrier wave in which the program is embodied by electronic transmission.

[Summary]
An information processing apparatus (main control unit 10) according to an aspect 1 of the present invention includes a display unit (display 20), an object detection unit (touch pad 30) having a planar detection region for detecting an object that is close to or touches. An information processing apparatus including a position information acquisition unit (touch event determination unit 12) that acquires position information indicating a position where the object detection unit has detected the object, and is displayed in a display area of the display unit. A target selection unit (long press determination unit 123) that selects one target object from one or a plurality of objects, and when a user operation instructing movement of the object is detected a plurality of times from the position information, Actions corresponding to each user operation are sequentially executed on the same target object.

  According to the above configuration, when a plurality of operations are detected after the target object is selected, actions corresponding to those operations are executed on the same target object. For this reason, the user can perform a plurality of user operations on the target object at an arbitrary position on the detection area. For example, the user can perform a plurality of user operations at a position different from the position where the target object is displayed so that the target object is not covered with a finger (object) used for the operation.

  The information processing apparatus according to aspect 2 of the present invention may further include a display control unit (13) that assigns a predetermined sign to the target object for display in the aspect 1.

  According to the above configuration, the target object is indicated by the predetermined sign. Therefore, the user can know which object is recognized by the information processing apparatus as an operation for a plurality of operations by checking the sign.

  In the information processing apparatus according to aspect 3 of the present invention, in the above-described aspect 1 or 2, the object at the start position of the movement of the object instructed by the first user operation may be set as the target object.

  According to the above configuration, the user can start the first operation and specify the target object.

  In the control method according to aspect 4 of the present invention, a display unit (display 20), an object detection unit (touch pad 30) having a planar detection region for detecting an object that approaches or touches, and the object detection unit includes the above-described object detection unit. A control method for an information processing apparatus including a position information acquisition unit (touch event determination unit 12) that acquires position information indicating a position at which an object is detected, wherein 1 or displayed in a display area of the display unit When a target selection step for selecting one target object from a plurality of objects and a user operation for instructing movement of the object from the position information are detected a plurality of times, an action corresponding to each user operation is performed with the same target And a motion control step executed sequentially on the object.

  According to said structure, there can exist the same effect as the information processing apparatus which concerns on the said aspect 1. FIG.

  The control method of the information processing apparatus according to each aspect of the present invention may be realized by a computer. In this case, the computer executes the control method by causing the computer to execute each step of the control method. A control program and a computer-readable recording medium on which the control program is recorded also fall within the scope of the present invention.

  The present invention is not limited to the above-described embodiments, and various modifications are possible within the scope shown in the claims, and embodiments obtained by appropriately combining technical means disclosed in different embodiments. Is also included in the technical scope of the present invention. Furthermore, a new technical feature can be formed by combining the technical means disclosed in each embodiment.

  The present invention can be used for an information processing apparatus including a touch pad.

10 Main control unit (information processing device)
20 Display (display part)
20B display (display unit, object detection unit)
30 Touchpad (object detection unit)
12 Touch event determination unit (location information acquisition unit)
13 Display Control Unit 123 Long Press Determination Unit (Target Selection Unit)
pt pointer (sign)

Claims (5)

A display unit; an object detection unit having a planar detection region for detecting an object that approaches or touches; and a position information acquisition unit that acquires position information indicating a position where the object detection unit detects the object. An information processing apparatus,
A target selection unit for selecting one target object from one or a plurality of objects displayed in the display area of the display unit;
An information processing apparatus that sequentially executes an action corresponding to each user operation on the same target object when a user operation for instructing movement of the object is detected a plurality of times from the position information. The information processing apparatus according to claim 1, further comprising a display control unit that displays the target object with a predetermined sign. The information processing apparatus according to claim 1, wherein the target selection unit sets the object at the start position of the movement of the object instructed by the first user operation as the target object. . A display unit; an object detection unit having a planar detection region for detecting an object that approaches or touches; and a position information acquisition unit that acquires position information indicating a position where the object detection unit detects the object. A method for controlling an information processing apparatus,
A target selection step of selecting one target object from one or a plurality of objects displayed in the display area of the display unit;
An operation control step of sequentially executing an action corresponding to each user operation on the same target object when a user operation instructing movement of the object is detected a plurality of times from the position information;
The control method characterized by including.   A control program for executing the control method of the information processing apparatus according to claim 4, wherein the control program causes a computer to execute the object selection step and the operation control step.

Images