JP5477108B2 - Information processing apparatus, control method therefor, and program - Google Patents

Description

  The present invention relates to an information processing apparatus and a program, and more particularly to a technique preferably applied to a touch panel that can identify simultaneous instructions for a plurality of positions on a display screen or an information processing apparatus equipped with the touch panel.

  In recent years, the number of devices with touch panel functions has increased from small displays installed in portable devices such as game machines and music players to relatively large displays used in presentations, meetings, classes, etc. . The touch panel display can be operated by the user with an intuitive instruction, so that the touch panel display is widely used in various fields regardless of gender.

  Generally, when an operation such as copying or moving an object is performed on a touch panel display, the following procedure is performed. First, touch a point in the object with your finger or pen to specify the object to be operated, then move the finger or pen to another object while touching the specified object. A command such as copy or move is selected from the window displayed when the pen is released from the display. This is a drag-and-drop operation similar to the operation performed with the mouse.

  In recent years, multi-touch panels equipped with sensors that can simultaneously detect multi-point touches have appeared. On displays equipped with such multi-touch panels, multiple objects can be selected by touching them with a finger or pen. It is possible to specify a range of a plurality of objects to be selected by an operation such as enclosing with both hands.

  However, in the above-described drag and drop method, a touch operation for selecting a command occurs in addition to the touch operation on the operation target object, and the intuitive operability on the touch panel display is impaired.

  On the other hand, for example, in Patent Document 1, in an information processing apparatus equipped with multi-touch, when it is detected that a plurality of designated positions exist simultaneously in the display range of one object on the screen, the designated position maintained. And determining the processing to be executed based on the number of the moved pointing positions.

JP 2009-294857 A

  In the invention disclosed in Patent Document 1, the copying / moving of an object is performed by detecting that the moving finger is separated from the multi-touch display, and the copying of the object to the separated position is identified as the operation content. Is done. Certainly, it is not necessary to select a command after moving a finger. However, in the case of a touch panel display with a very large operation area such as a relatively large display, the selection of the copy source and the copy destination are selected. If the location is far away, the operation of moving the finger from the copy source to the copy destination is cumbersome, increasing the load on the user.

  Further, in the case of a plurality of displays such as a two-screen terminal, for example, the copy source selection location and the copy destination selection location are not continuous, and an operation by drag and drop cannot be performed.

  Therefore, an object of the present invention is to enable smooth operation between a plurality of objects in a touch panel display having a very wide or non-continuous operation area.

  An information processing apparatus according to an aspect of the present invention is an information processing apparatus including an input device capable of detecting position information of a plurality of positions touched on a display screen, and monitors position information detected by the input device. And a touch monitoring unit that acquires information related to a specified situation of a plurality of objects to be operated and a touch action on the specified object, and an operation content for the specified object based on the information acquired by the touch monitoring unit. Operation determining means for determining, and operation executing means for executing processing corresponding to the operation content determined by the operation determining means.

  In the information processing apparatus according to the present invention, in the information processing apparatus, the input device is mounted on the first input device provided on the first display device mounted on the first housing and the second housing. A second input device provided on the second display device, and the touch monitoring means monitors the position information detected by the first input device and the second input device, and is displayed on the first display device. Information regarding the designation status of the object and the object displayed on the second display device and the touch operation on the designated object may be acquired.

  In the information processing apparatus of the present invention, in the above information processing apparatus, the input device detects speed information when the touched position changes, and the touch monitoring unit detects the position information detected by the input device and Based on the speed information, information related to a flicking motion that represents a motion of a specified object may be acquired.

  In the information processing apparatus of the present invention, in the information processing apparatus described above, the operation determination unit is specified when a plurality of objects are specified and a flick operation is performed on any one of the objects. The operation content for the selected object may be determined to be copy or move with the flicked object as the copy source or move source and another object as the copy destination or move destination.

  In the information processing apparatus according to the present invention, in the information processing apparatus described above, the input device detects the number of times the same or substantially the same position information is detected, and the touch monitoring unit detects the position information detected by the input device. Based on the number of times and the number of times, information related to the tap motion representing the motion of hitting the designated object may be acquired.

  In the information processing apparatus of the present invention, in the information processing apparatus described above, the operation determination unit is specified when a plurality of objects are specified and a tap operation is performed on any of the objects. The operation content for the selected object may be determined to be copy or move with the flicked object as the copy source or move source and another object as the copy destination or move destination.

  A program according to one aspect of the present invention is a program used in an information processing apparatus including an input device capable of detecting position information of a plurality of positions touched on a display screen, and is detected by the computer with the input device. The position information is monitored, the touch monitoring step for acquiring the information regarding the specified situation of the plurality of objects to be operated and the touch operation to the specified object, and the specified information based on the information acquired in the touch monitoring step. An operation determination step for determining the operation content for the object and an operation execution step for executing a process corresponding to the operation content determined in the operation determination step are executed.

  According to the present invention, an operation between a plurality of objects can be smoothly performed on a touch panel display having a very wide or non-continuous operation area.

1 is an external view of a PC according to an embodiment of the present invention. It is a block diagram which shows the hardware constitutions of PC concerning embodiment of this invention. It is a block diagram which shows the function structure of PC concerning embodiment of this invention. 5 is a flowchart illustrating a flow of user interface control according to the embodiment of the present invention. It is a figure for demonstrating touch panel operation by the user interface control which concerns on embodiment of this invention. It is a figure for demonstrating touch panel operation by the user interface control which concerns on embodiment of this invention.

  Embodiments of the present invention will be described below with reference to the drawings.

  FIG. 1 is an external view of an information processing apparatus according to an embodiment of the present invention. The information processing apparatus 1 of this embodiment is a two-screen terminal having, for example, a display 1 provided in a first housing having a main body and a display 2 provided in a second housing having a display.

  FIG. 2 is a block diagram showing a hardware configuration of the information processing apparatus according to the embodiment of the present invention. An information processing apparatus 1 according to the present embodiment includes a CPU (Central Processing Unit) 10, a ROM (Read Only Memory) 20, a RAM (Random Access Memory) 30, an HDD (Hard Disk Drive) 40, and an LCD (Liquid Crystal Display) controller 50. , LCD 60, touch panel controller 70, and touch panel 80.

  The CPU 10 controls the entire information processing apparatus and reads and executes programs in the HDD 40. The ROM 20 stores a boot program, fixed data, and the like. The RAM 30 functions as a main storage device. The HDD 40 is a hard disk device, and stores an OS (Operating System) 41 and a touch operation program 42 therein. The OS 41 is software that manages a computer system and provides a basic user operating environment. The OS 41 may be a commercially available product such as a Windows (registered trademark) OS or a Mac (registered trademark) OS, or may be independently created. The touch operation program 42 is software for causing the CPU 10 to execute processing unique to the present invention.

  The LCD 60 is a liquid crystal display which is an example of a display device, and image data is supplied thereto by an LCD controller 50. A touch panel 80 is overlaid on the surface of the LCD 60. As a touch panel method, any known method such as an ultrasonic method, a photoelectric method, a capacitance method, or the like can be adopted. The touch panel controller 70 detects the coordinates of the position where the user touches the touch panel 80 and issues it to the CPU 10 as an interrupt signal. Here, the touch panel controller 70 is configured to accept at least two touch operations.

  FIG. 3 is a block diagram showing a functional configuration of the information processing apparatus according to the embodiment of the present invention. In the information processing apparatus 1 according to the present embodiment, the CPU 10 reads the touch operation program 42 stored in the HDD 40, and the operation content for the designated object based on the information on the detected position information, the object designation, and the touch operation on the object. The control part 100 which is a functional part for performing the determination and execution of the process is configured. The control unit 100 logically includes a touch monitoring unit 110, an operation determination unit 120, and an operation execution unit 130. Each means may be realized by software as described above, or may be realized by hardware using a circuit or the like.

  The touch monitoring unit 110 monitors position information (position information detected by the touch panel controller 70) issued as an interrupt signal to the OS 41, and designates a plurality of objects to be operated and a touch operation to the designated object. Get information about. The object designation status can be grasped based on whether or not the position information of the object displayed matches the position information of the touched location. If both pieces of positional information match, the object is specified (or selected), and if they do not match, they are not specified (or selected).

  In addition, various actions such as a flick action, a tap action, and a pick action can be cited as the touch action on the designated object.

  The flicking motion is a motion to get a specified object in a certain direction. The touch panel controller 70 can obtain the speed information related to the operation from the change in the position of the finger being touched (difference in position information, time taken for the change). If it is within the range, the operation may be determined as a flick operation.

  The tap operation is an operation that strikes a specified object. The touch panel controller 70 can obtain the number of times the position information of the same place is detected and the time taken for the detection. If the number of times the detection time is detected within a predetermined range is the predetermined number, The operation may be determined to be a tap operation.

  The pick operation is an operation that pinches a specified object. When touch panel controller 70 detects two touches on a certain object, movement of the touch position (moving two points or moving only one point), and releasing two points after moving (leaving), The operation may be determined as a pick operation.

  The operation determination unit 120 determines the operation content for the designated object based on the information regarding the object designation status and the touch action on the designated object acquired by the touch monitoring unit 110. The operation execution unit 130 executes processing corresponding to the operation content determined by the operation determination unit 120.

  FIG. 4 is a flowchart showing a flow of user interface control according to the embodiment of the present invention. First, the touch monitoring unit 110 monitors OS panel touch information (position information issued as an interrupt signal), and acquires information on an object designation state and a touch operation on a selected object (step S101). Until an object is selected and a touch operation is performed on the object (step S102 / NO, step S103 / NO), OS monitoring is continued (step S101).

  When an object is selected (step S102 / YES) and a touch operation is performed on the object (step S103 / YES), the operation determination unit 120 determines that an operation content is specified, assuming that some operation is performed on the object. I do.

  The operation determining unit 120 determines whether there are a plurality of selected objects (step S104) or whether all the selected objects have been touched (step S105). This is to determine whether the performed operation should be handled by a touch panel operation unique to the present invention or by a normal touch panel operation (drag and drop). In the present invention, an operation of copying or moving one object to another object is performed simply, smoothly and intuitively by an operation between a plurality of objects.

  The operation determining means 120 should handle the touch panel operation unique to the present invention when there are a plurality of selected objects (step S104 / YES) and there is a touch operation on some selected objects (step S105 / YES). If there is, the content of the touch operation on some selected objects is determined.

  When the touch operation is a reciprocating flick operation (step S106 / YES), the operation determination unit 120 determines that the copy operation is for some selected objects. Then, the operation execution unit 130 performs a process of copying the flicked object (copy source) to another selected object (copy destination) as a process corresponding to the copy operation of the selected object (step S107).

  In addition, when the touch operation is a flick operation in one direction (step S106 / NO), the operation determination unit 120 determines that the operation is a movement operation for some selected objects. Then, the operation execution unit 130 performs a process of moving the flicked object (movement source) to another selection object (movement destination) as a process corresponding to the movement operation of the selected object (step S108).

  On the other hand, the operation determination means 120, when the selected object is a single object (step S104 / NO) or when there is a touch operation to all selected objects even when a plurality of objects are selected (step S105 / NO), It should be handled by a normal touch panel operation (drag and drop), and the content of the touch operation on the selected object is determined. Then, the following normal touch panel operation (drag and drop) processing is performed.

  The operation determining unit 120 determines that the selected object is a copy operation or a move operation when the touch operation is a drag of the selected object and there is another object at the drag destination (step S109 / YES). Then, the operation execution means 130 displays a copy / move selection screen (window) (step S110), and accepts an input by the user and performs a process corresponding to the designated operation (step S111).

  The operation determining unit 120 determines that the touch operation is a drag operation of the selected object and there is no other object at the drag destination (step S109 / YES), and the operation of moving the selected object. Then, the operation execution unit 130 performs a process of displaying the dragged object at the drag destination position as a process corresponding to the movement operation of the selected object (step S112).

  In the above flow, the copy / move is determined by the reciprocating motion and the unidirectional motion, but the copy / move is determined by the unidirectional flick motion, and the selection window is displayed as in the normal operation. Of course, it is possible to make the user select.

  Further, a touch operation may be used, and a tap operation may be used instead of a flick operation. When a tap operation is used, for example, a method of distinguishing by the number of taps is conceivable, such as moving when tapped once, copying when tapped twice, and the like.

  Further, a pick operation may be used as the touch operation. In this case, two-point touch on a certain object, movement of the touch position, and release of the touch position are detected, this touch action is determined as a pick action, and the object on which the pick action has been performed is set as a copy source or a move source. judge. Then, when the object does not exist at the next touched position, it is determined to move and the object is moved. When the object exists at the next touched position, it is determined to be copied or moved, for example, a selection window. Can be configured to display and allow the user to select.

  With reference to FIG.5 and FIG.6, touch panel operation by the user interface control which concerns on embodiment of this invention is demonstrated. As shown in FIG. 5A, a copy source file A is displayed on the display 1 and a copy destination directory (folder B) is displayed on the display 2. As shown in FIG. 5B, the user first touches the copy source file A. Next, as shown in FIG. 5C, the user touches the copy destination folder B while touching the file A.

  Then, as shown in FIG. 6A, the user flicks (shakes, shakes) the hand touching the file A in the direction of the copy destination folder B while touching the file A and the folder B. . Then, as shown in FIG. 5B, the file A is copied to the copy destination folder B, and the copy process is completed. At this time, when a flick is detected, the file A may be displayed so as to move to the copy destination or the movement destination, which makes it easy for the user to intuitively understand the movement of the object.

  The above-described embodiment is a preferred embodiment of the present invention, and the scope of the present invention is not limited to the above-described embodiment alone, and various modifications are made without departing from the gist of the present invention. Implementation is possible.

  For example, the user interface control according to the present invention is not limited to moving or copying a file, but can be applied to, for example, outputting a file (designating a printer to be printed and issuing a print command).

  The information processing apparatus according to the present invention may be an apparatus including a relatively large touch panel display in addition to the two-screen terminal.

1 Information processing device 10 CPU
20 ROM
30 RAM
40 HDD
41 OS
42 Touch operation program 50 LCD controller 60 LCD
DESCRIPTION OF SYMBOLS 70 Touch panel controller 80 Touch panel 100 Control part 110 Touch monitoring means 120 Operation determination means 130 Operation execution means

Claims (6)

An information processing apparatus including an input device capable of detecting position information of a plurality of positions touched on a display screen,
Touch monitoring means for monitoring position information detected by the input device, and acquiring information related to a specified situation of a plurality of objects to be operated and a touch operation to the specified object;
Based on the information acquired by the touch monitoring means, an operation determining means for determining an operation content for a specified object;
Possess an operation execution unit for executing a process corresponding to the determined operation contents by the operation determination means,
The input device detects speed information when the touched position changes,
The touch monitoring unit obtains information on a flick motion that represents a motion of a specified object based on position information and speed information detected by the input device,
The operation determining means, when a plurality of objects are specified and the flicking operation is performed on any of the objects, the operation content for the specified object is displayed as the flicking operation. An information processing apparatus that determines copying or moving with an object as a copy source or a movement source and another object as a copy destination or a movement destination . The input device includes: a first input device provided on a first display device mounted on a first housing; and a second input device provided on a second display device mounted on a second housing. Become
The touch monitoring unit monitors position information detected by the first input device and the second input device, and designates an object displayed on the first display device and an object displayed on the second display device. The information processing apparatus according to claim 1, wherein information related to a situation and a touch operation on a specified object is acquired. The input device detects the number of times the same or substantially the same position information is detected,
The touch monitoring means, based on the position information and the number detected by the input device, according to claim 1 or 2, characterized in that to obtain information about the tap operation represents an operation to tap the specified object Information processing device. The operation determining means, when a plurality of objects are specified and the tap operation is performed on any one of the objects, the operation content for the specified object is determined by the tap operation. The information processing apparatus according to claim 3 , wherein the information processing apparatus determines that the object is a copy source or a movement source and another object is a copy destination or a movement destination. A control method for an information processing apparatus including an input device capable of detecting position information of a plurality of positions touched on a display screen,
The information processing apparatus is
The position information detected by the input device and the speed information indicating the speed when the touched position is changed are monitored, and a plurality of objects to be operated are specified and a touch operation on the specified object is performed. Get information,
Based on the acquired information, the operation content for the specified object is determined,
While executing a process corresponding to the determined operation content,
When acquiring information related to the touch motion, based on the position information and speed information detected by the input device, to acquire information related to the flick motion that represents the motion of the specified object,
When determining the operation content for the specified object, when a plurality of objects are specified and the flick operation is performed on any one of the objects, the operation content for the specified object is: A control method characterized in that it is determined to copy or move an object for which the flick operation has been performed as a copy source or a movement source and another object as a copy destination or a movement destination. A program used for an information processing apparatus including an input device capable of detecting position information of a plurality of positions touched on a display screen,
On the computer,
The position information detected by the input device and the speed information indicating the speed when the touched position is changed are monitored, and a plurality of objects to be operated are specified and a touch operation on the specified object is performed. A touch monitoring step for obtaining information;
An operation determination step for determining the operation content for the designated object based on the information acquired in the touch monitoring step;
An operation execution step of executing processing corresponding to the operation content is determined by the operation determination step, when to run together,
In the touch monitoring step, based on the position information and speed information detected by the input device, obtain information related to a flick motion that represents a motion to touch the specified object,
In the operation determining step, when a plurality of objects are specified and the flicking operation is performed on any one of the objects, the flicking operation is performed on the operation content for the specified object. A program that determines that a copy or move is made with the copied object as a copy source or move source and another object as a copy destination or move destination .

Images