JP6668440B2 - Information processing apparatus, information processing method and program - Google Patents

Description

  The present invention relates to an information processing apparatus, an information processing method, and a program for performing a copy process by a touch operation on a touch panel.

  2. Description of the Related Art In recent years, a device having a touch panel including a display unit and a touch input unit has appeared, and a user can perform processing by intuitive operation using a UI (User Interface) by a touch operation. For example, a touch operation can be performed on an object indicating a file or the like displayed on the screen of the display device to perform an operation process such as copy or paste.

  For example, in Patent Literature 1, when one display object is touched with two fingers and a pinch-out operation is performed, and the touch distance between the two fingers is equal to or more than a predetermined value, the display object indicates. An apparatus for copying content data is described.

JP 2011-170785 A

  The touch operation is intuitive and easy for the user to understand.However, when the types of processing corresponding to the touch operation increase, the operation is slightly different and completely different processing. The number of cases that do it will increase. For example, in the case of Patent Document 1, in a pinch-out operation using two fingers, display enlargement processing is generally performed, and erroneous operations of the enlargement processing and the copy operation may frequently occur.

  In view of such circumstances, an object of the present invention is to provide an information processing apparatus, an information processing method, and a program that are less likely to cause an erroneous operation in a touch operation and can perform the operation accurately.

In view of the problems described above, the information processing device of the present invention
An information processing device for displaying an object on a display unit,
A touch detection unit that detects a touch operation;
An operation determination unit that determines a touch operation on the object based on a detection result of the touch detection unit,
An operation processing execution unit that executes processing based on a determination result of the operation determination unit;
With
The operation processing execution section, the is touch detection unit by detecting a touch of the two points in the object, with the hand touch of the two points of the touch is on the object, the other touch the object And displaying a copy of the object at a position where the object is touched up.

An information processing method according to the present invention is an information processing method in an information processing apparatus that displays an object on a display unit,
A touch detection step of detecting a touch operation;
An operation determining step of determining a touch operation on the object based on a detection result of the touch detecting step;
An operation processing execution step of executing processing based on a result of the operation determination step;
Including
The operation process executing step, the touch detection is detected touch two points in the object by step, in a state where the hand touch of the two points of the touch is on the object, the other touch the object And displaying a copy of the object at a position where the object has been touched up.

  The present invention is a program for causing a computer to execute each step of the information processing method.

  According to the present invention, when the display object is touched with a touch area equal to or larger than the predetermined area, the operation determination unit determines that the operation includes the copy mode. Since different operations can be performed by two types of touches, erroneous operations and erroneous determinations can be prevented.

1 is an external view showing a table display which is an information processing device according to the present invention. It is a functional block diagram showing an example of a table display. 5 is a flowchart illustrating an entire operation process according to the first embodiment. FIG. 4 is a diagram illustrating an object displayed on a display unit of the display device. 9 is a flowchart illustrating a procedure of an operation determination process A. FIG. 5 is a diagram illustrating a case where there are three palm touches in a display object area according to the first embodiment. FIG. 5 is a diagram illustrating a case where there are two palm touches in a display object area according to the first embodiment. FIG. 5 is a diagram illustrating a case where there is one palm touch in a display object area according to the first embodiment. 9 is a flowchart illustrating a procedure of an operation determination process B. FIG. 5 is a diagram illustrating a case where two palm touches are present in a display object area after a touch-up according to the first embodiment. FIG. 7 is a diagram illustrating a case where there is one palm touch in the area of the display object after the touch-up according to the first embodiment. FIG. 7 is a diagram illustrating a case where a palm touch is not present in a display object area after a touch-up according to the first embodiment. It is a flowchart which shows the processing procedure of operation processing execution. FIG. 5 is a diagram illustrating a palm touch being pinched out of an object according to the first embodiment. FIG. 7 is a diagram illustrating a state in which a palm touch pinched out of the object is picked up and the object is copied and displayed in the first embodiment. FIG. 13 is a diagram illustrating a case where there are three palm touches in a display object area according to the second embodiment. It is a figure which pinches out the palm touch in Embodiment 2 outside an object. FIG. 14 is a diagram illustrating a state in which a palm touch pinched out of an object is picked up and the object is copied and displayed in the second embodiment.

Hereinafter, embodiments of the present invention will be described with reference to the accompanying drawings.
FIG. 1 is an external view showing a table display as an information processing apparatus according to the present invention. FIG. 2 is a functional block diagram showing an example of the table display.

  The table display 10 is a device in which a display device 20 as a touch panel is provided on the entire surface of the table, and a plurality of users perform a touch operation while viewing the display to perform processing. The display device 20 has a structure including a touch input unit 22 above a display unit 21 such as a liquid crystal panel.

  The table display 10 includes a display control unit 30 that controls display on the display unit 21, a storage unit 40 that stores data, and a control unit 50 that controls processing according to an operation from the touch input unit 22.

  The control unit 50 includes a touch detection unit 51 that detects a touch position from an input signal of the touch input unit 22, a touch area calculation unit 52 that calculates a touch area of a region touched from the detected touch position, and detection of the touch detection unit 51. An operation determination unit 53 that determines a touch operation based on the result and the touch area by the touch area calculation unit 52, and an operation process execution unit 54 that performs an operation process based on the determined touch operation is provided.

  The operation determination unit 53 determines an operation mode from a touch operation such as touch-down, touch-up, flick, pinch-in, and pinch-out, the number of touches, and the like. Here, the touch-down is to touch the touch input unit 22 with a hand or the like, and the touch detection unit 51 detects the position as a new touch. Touch-up means releasing a touched hand or the like from the touch input unit 22, and the touch detection unit 51 detects a position where the touch has disappeared.

The table display 10 can support various touch operations. In particular, a copy operation will be described.
In the copy operation, a copy process is performed when one of the objects displayed on the display unit 21 is touched and one of the touches is pinched out.
In Patent Document 1 described as a background art, a pinch-out operation using a finger is used as a copy operation. However, in this embodiment, a pinch-out operation using a palm is performed, and a general enlargement operation in the pinch-out operation is performed. Is to be distinguished.

<First embodiment>
First, in the first embodiment, a touchdown operation is performed as a copy operation and a related operation, and will be described in detail below.
FIG. 3 is a flowchart illustrating the entire operation processing according to the first embodiment.

  For example, as illustrated in FIG. 4, it is assumed that the operation target object 100 is displayed on the display unit 21 of the display device 20. When the user performs a touch input on the surface of the display device 20, the touch detection unit 51 of the control unit 50 detects a touch position based on an input signal of the touch input unit 22 (step S1). Then, the operation determination unit 53 of the control unit 50 determines whether the operation is a touch-up operation or a touch-down operation based on the detection result of the touch detection unit 51 (step S2). In the case of touchdown, the operation proceeds to operation determination processing A of step S3. In the case of touch-up, the process proceeds to operation determination processing B in step S4. Then, the operation process execution unit 54 of the control unit 50 executes a process based on the operation determination result (Step S5).

FIG. 5 is a flowchart illustrating a processing procedure of the operation determination processing A.
The touch area calculation unit 52 of the control unit 50 calculates the touch area of the touch area from the detection result of the touch detection unit 51 (Step S11). The operation determination unit 53 of the control unit 50 determines whether a part or the whole of the touch area is within the area of the operation target object 100 displayed on the display unit 21 (Step S12). If it is not within the operation target object 100, the process ends. If it is within the object area to be operated, the process proceeds to step S13, and it is determined whether or not there is a touch whose touch area is equal to or larger than a preset threshold in the object area. If there is no such touch, the process ends.

Here, it is assumed that the input is performed with the finger of the hand and the palm of the hand, and a predetermined area for identifying “finger touch” and “palm touch” is set in advance as a threshold. A touch area equal to or larger than the threshold is referred to as “palm touch”, and a touch area smaller than the threshold is referred to as “finger touch”.
In this embodiment, the touch input is made by hand. However, the touch input by a pen and the input by a stamp having a large area may be used. Anyway, any type can be used as long as the touch can be distinguished into two types based on the area.

  The operation determination unit 53 determines whether there are three or more touches in the object area to be operated (step S14), and if there are three or more touches, determines that the operation is in the copy inhibition mode (step S15). The copy inhibition mode is a mode in which copy processing is not performed. This is a case where, for example, as shown in FIG. 6, there are three palm touches 111, 112, and 113 in the area of the object 100.

  Otherwise, the operation determination unit 53 determines whether there are two touches in the object area to be operated (step S16), and if there are two touches, determines that the mode is the copy mode (step S17). The copy mode is a mode for performing a copy process. This is a case where there are two palm touches 111 and 112 in the area of the object 100, for example, as shown in FIG.

Otherwise, the operation determination unit 53 determines that there is one touch in the object area to be operated (Step S18), and determines that the operation is in the object operation prohibition mode (Step S19). The object operation prohibition mode is a mode in which operation processing such as movement, rotation, and enlargement / reduction of an object is not performed. This is the case where there is one palm touch 111 in the area of the object 100, for example, as shown in FIG.
Since this is a touch-down touch operation, the number of touches cannot be 0, so the process ends here.

FIG. 9 is a flowchart illustrating the procedure of the operation determination process B.
Since the touch-up operation is performed in the operation determination process B, the touch position, the touch area, and the touch area are already known. After that, it is necessary to make an operation determination based on a decrease in the number of touched points by touch-up.

  The operation determination unit 53 of the control unit 50 determines whether or not there is a touch whose touch area is equal to or larger than a preset threshold in the object area to be operated (step S21). If there is no such touch, the process ends.

  The operation determination unit 53 of the control unit 50 determines whether there are three or more touches in the object area to be operated (Step S22), and if there are three or more touches, determines that the mode is the copy inhibition mode (Step S23). . For example, as shown in FIG. 6, there is a case where there are three touches of the palms 111, 112, and 113 even when there is a touch-up.

  Otherwise, the operation determination unit 53 determines whether there are two touches in the object area to be operated (step S24), and if there are two touches, determines that the mode is the copy mode (step S25). This is the case where the palm touch 113 touches up and the palms 111 and 112 remain in the area of the object 100 as shown in FIG.

  Otherwise, the operation determination unit 53 determines whether there is one touch in the object area to be operated (step S26). If there is one touch, the operation such as movement, rotation, and scaling of the object is performed. It is determined that the mode is the prohibition mode (step S27). This is the case where the palm touch 112 touches up and the palm 111 remains in the area of the object 100 as shown in FIG.

  If the number of touches is not one, the operation determining unit 53 determines that there is no touch (zero) (step S28), and determines that the mode is the object operation mode (step S29). The object operation mode is a mode that enables operations such as movement, rotation, and enlargement / reduction of an object. This is the case where the palm touch 111 touches up and no palm remains in the area of the object 100 as shown in FIG. 12, for example.

FIG. 13 is a flowchart illustrating a processing procedure for performing the operation processing.
The operation processing execution unit 54 of the control unit 50 executes processing based on the determination result of the operation determination unit 53.
The operation processing execution unit 54 determines whether the operation determination is the copy mode (step S31). If the mode is the copy mode, the operation determination unit 53 determines whether one of the touches pinches out from the inside of the operation target object and touches up (step S32). For example, as shown in FIG. 14, the palm 112 in the object 100 is pinched out, goes out of the object 100, and touches up as shown in FIG.

  At this time, since the touch detection unit 51 has detected the touch-up position, it outputs it to the operation processing execution unit 54 (step S33). The operation processing execution unit 54 copies and stores the data indicated by the operation target object in a predetermined folder set in advance in the storage unit 40 (step S34). Then, the display control unit 30 copies and displays the object at the touch-up position (Step S35). For example, as shown in FIG. 15, an object 200 that is a copy of the object 100 is displayed at a position where the palm 112 touches up.

  If the mode is not the copy mode, a process such as another mode (copy prohibition mode, object operation prohibition mode, object operation mode) is executed (step S36).

<Embodiment 2>
In the first embodiment, all touches are “palm touches”, but “finger touches” may be mixed.
As shown in FIG. 16, in the second embodiment, the “palm touch” is only the palm 111, and the other touches 112 and 113 are “finger touches”. Even in this case, the flowcharts of FIGS. 3, 5, 9, and 13 hold.

  Here, if there is at least one “palm touch”, the operation determining unit 53 determines in step S13 or step S21 that the mode includes the copy mode. The operation determination unit 53 determines each mode based on the number of touches, and the operation process execution unit 54 executes a process of an operation in each mode.

  For example, as shown in FIG. 17, when the palm 111 and the finger 112 are touching the object 100, the operation determination unit 53 determines that the object is in the copy mode because there are two touches and the palm has a touch area equal to or larger than the threshold. I do. Then, when the finger 112 pinches out of the object 100 and touches up as shown in FIG. 18, the object 200 which is a copy of the object 100 is displayed at the touch-up position as in FIG. 15. Further, copying and storing data indicated by the object 100 in a predetermined folder of the storage unit 40 is the same as in the first embodiment.

  Here, the finger 112 has pinched out of the object, but the same copy processing is performed even if the palm 111 is pinched out of the object.

<Embodiment 3>
In the first and second embodiments, the copy process is performed by pinching out a finger touch or a palm touch. In the third embodiment, the copy process is performed without pinching out.
For example, as shown in FIG. 7, when two palm touches are performed, the operation determination unit 53 determines the copy mode and performs the copy display of the object 100 at the position of the display unit 21 set in advance. It may be. Further, copying and storing data indicated by the object 100 in a predetermined folder of the storage unit 40 is the same as in the first embodiment.

  In this manner, when the display object is touched with a touch area equal to or larger than the predetermined area, the operation determination unit determines that the operation includes the copy mode. Since different operations can be performed by two types of touches, erroneous operations and erroneous determinations can be prevented. For example, in the pinch-out operation, the operation process can be clearly distinguished such that enlargement is performed in the case of only finger touch, and copy is performed in the case of only palm touch or a combination of finger touch and palm touch. .

  In addition, by prohibiting copying of three or more touches, even if an operation such as pinch-out is performed by mistake, the touch is not copied, and erroneous determination can be prevented.

  The program that operates in each device of the information management system according to the present invention is a program (a program that causes a computer to function) that controls a CPU (Central Processing Unit) and the like so as to realize the functions of the above-described embodiments according to the present invention. May be. The information handled by these devices is temporarily stored in a RAM (Random Access Memory) at the time of processing, and then stored in various ROMs such as a Flash ROM (Read Only Memory) or an HDD (Hard Disk Drive). Reading, correction and writing are performed by the CPU as necessary. Also, a program for realizing the function of each configuration may be recorded on a computer-readable recording medium, and the program recorded on this recording medium may be read into a computer system and executed to execute processing of each unit. Good. Here, the “computer system” includes an OS and hardware such as peripheral devices.

  The “computer-readable recording medium” refers to a portable medium such as a flexible disk, a magneto-optical disk, a ROM, and a CD-ROM, and a storage device such as a hard disk built in a computer system. Further, the “computer-readable recording medium” refers to a communication line for transmitting a program via a network such as the Internet or a communication line such as a telephone line, and dynamically holds the program for a short time. In this case, it is also assumed that a program holding a program for a certain period of time, such as a volatile memory in a computer system serving as a server or a client in that case, is included. Further, the above-mentioned program may be for realizing a part of the above-mentioned functions, or may be for realizing the above-mentioned functions in combination with a program already recorded in a computer system.

  As described above, the embodiments of the present invention have been described in detail with reference to the drawings. However, the specific configuration is not limited to these embodiments, and the present invention is a design change or the like within a range not departing from the gist of the present invention. Is also included.

  The information processing apparatus described in the present embodiment is an information processing apparatus that displays an object on a display unit, and includes a touch detection unit that detects a touch operation, and a touch on the object based on a detection result of the touch detection unit. An operation determination unit that determines an operation; and an operation processing execution unit that performs processing based on a determination result of the operation determination unit, wherein the operation determination unit performs a touch operation on the object by the touch detection unit. When the touch detection unit detects a new touch in the object when determining the process indicated by the touch operation based on the detected touch area, the operation process execution unit prohibits the process indicated by the touch operation. It may be configured.

  Further, the information processing method in the information processing apparatus described in the present embodiment is an information processing method in the information processing apparatus that displays an object on a display unit, and includes a touch detection step of detecting a touch operation, and a touch detection step. An operation determination step of determining a touch operation on the object based on the detection result; and an operation processing execution step of executing processing based on the determination result of the operation determination step, wherein the operation determination step is the touch detection step When a touch operation on the object is detected, and when a process indicated by the touch operation is determined based on a touch area, the touch detection step detects a new touch in the object. The configuration that prohibits the process indicated by the touch operation It may be.

10: Table display 20: Display device 21: Display unit 22: Touch input unit 30: Display control unit 40: Storage unit 50: Control unit 51: Touch detection unit 52: Touch area calculation unit 53: Operation determination unit 54: Operation processing Execution unit 100: Object

Claims (7)

An information processing device for displaying an object on a display unit,
A touch detection unit that detects a touch operation;
An operation determination unit that determines a touch operation on the object based on a detection result of the touch detection unit,
An operation processing execution unit that executes processing based on a determination result of the operation determination unit;
With
The operation processing execution section, the touched detector by detecting the touch of the two points in the object, with the hand touch of the two points of the touch is on the object, the other touch the object An information processing device for displaying a copy of the object at a position where the object is moved outside and touched up. The information processing apparatus according to claim 1, wherein the operation processing execution unit does not display a copy of the object until the other touch is touched up.   The information processing apparatus according to claim 1, wherein the operation determination unit determines a touch operation by identifying a touch based on a predetermined area set in advance. The information processing apparatus according to claim 3, wherein the operation determination unit performs an operation determination based on a decrease in a touch of the predetermined area or more in the object. The operation processing execution unit detects two types of touches, a touch having a predetermined area or more and a touch having a predetermined area or less, by the operation determination unit, and one of the two types of touches moves out of the object. The information processing apparatus according to claim 3 , wherein when the touch-up is performed, a copy of the object is displayed at the touch-up position. An information processing method in an information processing device that displays an object on a display unit,
A touch detection step of detecting a touch operation;
An operation determining step of determining a touch operation on the object based on a detection result of the touch detecting step;
An operation processing execution step of executing processing based on a result of the operation determination step;
Including
The operation process executing step, the touch detection is detected touch two points in the object by step, in a state where the hand touch of the two points of the touch is on the object, the other touch the object And displaying a copy of the object at a position where the object is moved up and touched up. A program for causing a computer to execute each step of the information processing method according to claim 6 .

Images