JP2011227828A - Information processor, information processing method and information processing program - Google Patents

Abstract

PROBLEM TO BE SOLVED: To improve the operability in copying or moving objects to other areas with a gesture operation.SOLUTION: Information for showing a gesture operation by users and the location on a display area, where the gesture operation is performed, is acquired. A first gesture operation for instructing to select objects in the display area and a second gesture operation for instructing to select any area in the display area, are determined based on the acquired information. An object 31 selected according to the first gesture operation and an area 41 selected according to the second gesture operation are identified. A third gesture operation that instructs the process for the identified object 31 is determined, while the object 31 and area 41 are identified. If the third gesture operation is determined to be performed, the identified object 31 is copied or moved to the identified area 41.

Description

  The present invention relates to an information processing apparatus, a processing method thereof, and a program.

  In recent years, as an operation for an electronically displayed object, an operation using a gesture input that allows a user to give an instruction by an intuitive input is increasing. For example, when creating / editing electronic data using objects, it is often convenient to specify the displayed object and copy or move it to the data being created / edited. Done.

  Conventionally, such an operation often performs a gesture operation of moving an object to a movement destination in an object selection state after performing a gesture operation of selecting a displayed object (see Patent Document 1). ).

JP 2005-301893 A

  As described above, conventionally, when an object is moved, the object must be moved from the selected position to the destination by causing the selected object to follow the user's hand. Therefore, for example, when an object is copied or moved to a position beyond the range that can be reached with one hand, the user must move the entire body greatly. In such a case, the range in which the object can be easily moved is limited.

  The present invention has been made in view of the above problems, and an object of the present invention is to provide a technique for improving operability when copying or moving an object to another area by a gesture operation.

  In order to solve the above problem, an information processing apparatus according to an aspect of the present invention includes an acquisition unit that acquires information indicating a gesture operation performed by a user and a position on a display area where the gesture operation is performed. Based on the information acquired by the acquisition means, a first determination means for determining whether or not a first gesture operation for instructing selection of any object in the display area has been performed, and the acquisition means Based on the acquired information, second determination means for determining whether or not a second gesture operation for instructing selection of any one of the display regions has been performed, and based on the first gesture operation Identifying one of the one or more selected objects and selecting based on the second gesture action Identification means for identifying any one area from among one or a plurality of areas, and a third gesture operation for instructing processing on the identified object while the object and the area are identified are performed. Third determination means for determining whether the third gesture operation has been performed, and object processing means for copying or moving the identified object to the identified area when it is determined that the third gesture operation has been performed. It is characterized by doing.

  According to the present invention, it is possible to improve operability when an object is copied or moved to another area by a gesture operation.

The figure which shows an example of the hardware constitutions of the information processing apparatus 10 concerning one embodiment of this invention. The figure which shows an example of the functional structure implement | achieved in CPU11 shown in FIG. The figure which shows the outline | summary of the process in the information processing apparatus 10 shown in FIG. 3 is a flowchart illustrating an example of a processing flow of the information processing apparatus 10 illustrated in FIG. 1. 3 is a flowchart illustrating an example of a processing flow of the information processing apparatus 10 illustrated in FIG. 1. 3 is a flowchart illustrating an example of a processing flow of the information processing apparatus 10 illustrated in FIG. 1. FIG. 9 is a diagram illustrating an example of a functional configuration realized in a CPU 11 according to the second embodiment. FIG. 10 is a diagram illustrating an example of a functional configuration realized in a CPU 11 according to the third embodiment.

  Hereinafter, an embodiment of the present invention will be described in detail with reference to the accompanying drawings.

(Embodiment 1)
FIG. 1 is a diagram illustrating an example of a hardware configuration of an information processing apparatus 10 according to an embodiment of the present invention.

  The information processing apparatus 10 includes a CPU 11, a ROM 12, a RAM 13, a storage unit 14, an input I / F 15, an output I / F 16, a system bus 17, an input device 18, and an output device 19. Composed. Communication between these units is realized by the system bus 17.

  A RAM (Random Access Memory) 13 is used as a work area when the CPU 11 executes a program, and temporarily stores various calculation results, coordinate data, and the like. A ROM (Read Only Memory) 12 stores programs and various data.

  The storage unit 14 is realized by a hard disk drive (HDD), a flash memory drive (SSD), a removable memory card, an optical disk, or the like, and stores various data. For example, various programs such as an operating system and applications are stored in the storage unit 14.

  A CPU (Central Processing Unit) 11 performs overall control of the operation of the information processing apparatus 10. Various processes in the information processing apparatus 10 are performed, for example, when the CPU 11 reads and executes a program stored in the storage unit 14 using the RAM 13 as a work area.

  The input device 18 is realized by, for example, various sensors, cameras, and the like, and inputs various information into the apparatus via the input I / F 15. Here, the input device 18 may generally include a camera or a sensor that is used in gesture recognition. The input device 18 according to the present embodiment uses a camera and a sensor to image reflected waves of infrared light applied to the human body, and detects outline information including the depth of each part of the human body and their movement. To do. Note that the input device 18 is not necessarily limited to such a configuration, and may be any configuration that can specify the user's body range and can detect a gesture motion (hand position, shape, movement). For example, a glove equipped with a sensor capable of detecting a position, shape, and movement in space may be used as an input device. In this case, the user wears the glove in both hands and performs a gesture operation. In addition, for example, a user image captured by a camera that captures normal visible light may be processed by image recognition, thereby performing gesture input.

  The output device 19 outputs various information to the outside of the apparatus via the output I / F 16. As the output device 19 according to the present embodiment, for example, a display, a screen, or the like is cited, and a device having a relatively large display area is assumed. The above is an example of the functional configuration of the information processing apparatus 10.

  Next, an example of a functional configuration realized in the above-described CPU 11 will be described with reference to FIG. These processing functions are realized, for example, when the CPU 11 reads and executes a program stored in the storage unit 14 using the RAM 13 as a work area.

  As the functional configuration of the CPU 11, an acquisition unit 21, a user identification unit 22, a gesture determination unit 23, an identification unit 27, an object processing unit 28, and a display processing unit 29 are realized.

  The acquisition unit 21 acquires gesture information from the input device 18 via the input I / F 15. The gesture information is information indicating the user's body range, information indicating a gesture operation (hand position, shape, movement) performed by the user, and a position on the display area where the gesture operation is performed.

  The user specifying unit 22 specifies (determines) whether the object is selected and the copy destination area or the movement destination area is selected by the same user. In this embodiment, since the user's external shape and depth can be acquired by the input device (sensor) 18, the range of the human body is determined using the output result of the sensor. Thereby, the user is specified. In addition, when the sensor cannot determine the outer shape and depth of the user, and when the overlap of multiple people or the continuity of the parts constituting the body cannot be recognized, the user is photographed with a camera, You may determine whether it is the same user.

  Based on the gesture information received by the acquisition unit 21, the gesture determination unit 23 determines which gesture operation instructing which process has been performed. In the present embodiment, the gesture operations performed by the user include a first gesture operation, a second gesture operation, and a third gesture operation.

  Here, the first gesture action refers to a gesture action that instructs selection of any object in the display area, and the second gesture action refers to a gesture action that instructs selection of a copy or movement destination area. Point to. The first gesture operation and the second gesture operation according to the present embodiment are performed by the same gesture operation (for example, an operation of grasping a space with a finger).

  The third gesture action refers to a gesture action that instructs the selected object to perform processing, and a gesture that gives an instruction to copy or move the selected object toward the selected area. Is the action. The third gesture operation according to the present embodiment is a movement that moves the selected object toward the selected copy destination area or the like by a certain amount or more in a state where the object and the copy destination area or the like are selected. It becomes.

  Here, the gesture determination unit 23 includes a first determination unit 24, a second determination unit 25, and a third determination unit 26 in order to determine (detect) the gesture operation described above.

  The first determination unit 24 determines whether or not the first gesture operation has been performed by the user based on the gesture information acquired by the acquisition unit 21. More specifically, when the first gesture operation is performed when an operation is performed in which no object is selected and an object displayed in the display area is grasped with a finger. judge.

  The second determination unit 25 determines whether or not the user has performed a second gesture operation based on the gesture information acquired by the acquisition unit 21 and the user identification result by the user identification unit 22. More specifically, when an object is selected (the user who selected the object) and the same user performs an operation such as grasping with one finger on any area displayed in the display area It is determined that the second gesture operation has been performed.

  Based on the gesture information acquired by the acquisition unit 21, the third determination unit 26 determines whether or not a third gesture operation has been performed by the user. More specifically, when the object and the area are selected and the operation of moving the selected object toward the selected copy destination area or the like by a certain amount or more is performed, the third It is determined that the gesture operation has been performed.

  Here, for the determination of the third gesture motion, a threshold value having an arbitrary value with respect to the movement amount and direction of the object is used. The threshold value may be set to a value that can clearly recognize the intention of copying or moving. For example, the amount of movement along with the direction of movement of the hand is determined as a distance from the coordinates and actual distance of the hand position before and after movement based on the sensor. For the movement amount, a threshold value such as within 10 cm may be set. For the movement direction, a threshold value may be set such that a line segment connecting the center of the object and the center of the selection area and an angle between the line segment and the movement direction is within 10 degrees. Furthermore, a mechanism may be provided that does not determine that the movement is the third gesture operation when the user gradually moves unconsciously while looking at the acceleration.

  The identification unit 27 identifies a target object or region when the first gesture operation and the second gesture operation are performed. That is, it functions as a first identification unit that identifies any object from one or a plurality of objects selected based on the first gesture action. Moreover, it functions as a second identification means for identifying any one region from one or a plurality of regions selected based on the second gesture operation. The identification unit 27 according to the present embodiment identifies an object or area based on the position of the user's head and the position and distance of the hand relative to the object displayed in the display area.

  In this identification, for example, the position of the display area with reference to the input device 18 is determined in advance, and a line segment connecting the position of the user's head and the position of the selected hand is near the intersection of the display area. What is necessary is just to identify a certain object as a selection object. In this case, an approximate position corresponding to the eye may be further estimated from the position of the head, and a line segment connecting the eye position and the hand position may be used. However, the method of identification is not limited to this. For example, when the position of the display area and the position of the hand are very close, an object existing near the position of the hand may be identified as the selection target. .

  If there are other objects or regions around the target object or region, it may be possible to mistakenly identify a target in the vicinity. For this reason, the identified result may be fed back to the user by emphasizing the selection target or the like, and the identification result may be corrected based on the subsequent change in the gesture operation of the user. For example, as an identification result, after highlighting an object (or region) to be selected, if the user performs a first gesture operation again after shifting upward, the upper object is identified. Anyway.

  The object processing unit 28 processes an object. More specifically, when the third determination unit 26 determines that the third gesture operation has been performed, the selected object is copied or moved to the selected area.

  Here, the processing performed by the object processing unit 28 may differ depending on the copy destination or movement destination area. More specifically, for example, if the object placement location on the document or image creation template is the copy destination or movement destination area, here, the corresponding document or image being created or edited using the template. Processing to place the object in the part is performed. If the copy destination or move destination area is a folder, a process of copying or moving an object to the folder is performed. If the copy destination or movement destination area is a trash can, a process for deleting the object is performed.

  The display processing unit 29 controls the output device 19 to display the result of the processing performed by the object processing unit 28. For example, a mode in which the object is arranged is displayed on the displayed template.

  Here, in order to make the explanation of the information processing apparatus 10 shown in FIG. 1 easy to understand, an example of a processing flow in the information processing apparatus 10 will be briefly described with reference to FIG. Here, a description will be given by taking as an example a processing flow when copying an object of the second document (another document) to the template area of the first document.

  Here, the output device 19 is, for example, a screen or the like, and the first document 30 and the second document 40 are displayed on the screen. The user uses the right hand 51 to perform the first gesture operation and select the object 31 in the first document 30. As described above, the user selects the object 31 by performing a gesture operation such as grasping the space with a finger.

  Subsequently, the user uses the left hand 52 to select the area 41 that is the copy destination of the object 31. Specifically, using the left hand 52, a second gesture operation is performed, and an area on the template in the second document 40 is selected. That is, the copy destination area 41 is selected using the left hand 52 while the object 31 is selected using the right hand 51. The left hand 52 and the right hand 51 are the same user's hands.

  Here, the user performs the third gesture operation while the object and the area are selected. Specifically, the user moves the right hand 51 selecting the object 31 toward the copy destination area 41 by a certain amount or more. As a result, the object 31 in the first document 30 is copied to the area 41 in the second document 40.

  Next, an example of the flow of processing in the information processing apparatus 10 shown in FIG. 1 will be described using the flowcharts shown in FIGS. First, an example of the flow of processing when selecting an object will be described with reference to FIG.

  The information processing apparatus 10 receives the gesture information from the input device 18 via the input I / F 15 in the acquisition unit 21 (YES in S101). As described above, the gesture information includes information indicating the user's body range, the gesture operation (hand position, shape, movement) performed by the user, and the position where the gesture operation is performed on the display area. It is.

  When the gesture information is received, the information processing apparatus 10 determines in the first determination unit 24 whether or not a first gesture operation instructing selection of an object has been performed. As described above, it is determined that the first gesture operation has been performed when an operation such as grasping with one finger on any object displayed in the display area is performed with no object selected. .

  If the first gesture operation is not performed as a result of the determination (detection) (NO in S102), the information processing apparatus 10 returns to the process of S101 again and waits for reception of gesture information. On the other hand, when the first gesture operation is performed (YES in S102), the information processing apparatus 10 identifies an object in the identification unit 27. That is, it is identified which object in the display area is selected based on the position of the hand on which the first gesture operation has been performed (S104). Thereafter, the information processing apparatus 10 uses the user specifying unit 22 to specify the user who has given the instruction. More specifically, the human body range of the user who performed the first gesture operation is determined (S105). Thereby, this process is completed.

  Next, an example of a processing flow when selecting a copy destination area or a movement destination area will be described with reference to FIG. This process is normally started in a state where an object is selected by the process of FIG.

  The information processing apparatus 10 receives gesture information from the input device 18 via the input I / F 15 in the acquisition unit 21 (YES in S201). Then, the second determination unit 25 determines whether an object is being selected. If no object is being selected (NO in S202), the information processing apparatus 10 returns to the process of S201 again and waits for reception of gesture information.

  If the object is being selected (YES in S202), the information processing apparatus 10 determines in the second determination unit 25 whether or not the second gesture operation has been performed by the user who has selected the object. . For example, the user performs the second gesture operation using a hand different from the hand that selects the object. Whether or not the user who has selected the object and the user who has performed the second gesture operation are the same user is determined based on the identification result of the user identification unit 22. That is, when the second gesture operation is performed within the human body range determined by the user specifying unit 22, the information processing apparatus 10 determines that the second gesture operation is performed by the same user.

  As a result of the determination, if the second gesture operation is performed by a user other than the user who has selected the object (NO in S203), the information processing apparatus 10 returns to the process of S201 again, and performs the gesture. Waiting to receive information.

  On the other hand, when it is determined that the user who has selected the object has performed the second gesture operation (YES in S203), the information processing apparatus 10 identifies an area in the identification unit 27. That is, it is identified which area in the display area has been selected based on the position of the hand on which the second gesture operation has been performed (S204). Thereafter, this process ends.

  Next, an example of the flow of processing when processing an object will be described with reference to FIG. This process is normally started in a state where an object and a region are selected by the processes of FIGS.

  The information processing apparatus 10 receives the gesture information from the input device 18 via the input I / F 15 in the acquisition unit 21 (YES in S301). Then, the third determination unit 25 determines whether an object and a region are being selected. If either one of the object and the area is not selected (NO in S302), the information processing apparatus 10 returns to the process of S301 again and waits for reception of gesture information.

  If the object and the area are being selected (YES in S302), the information processing apparatus 10 determines in the third determination unit 26 whether or not the third gesture operation has been performed. That is, it is determined whether or not the user has performed a gesture operation that moves the object being selected toward a copy destination area or the like of the selected collection by a certain amount or more.

  If the third gesture operation is not performed as a result of the determination (detection) (NO in S303), the information processing apparatus 10 returns to the process of S301 again and waits for reception of gesture information.

  On the other hand, when the third gesture operation is performed (YES in S303), the information processing apparatus 10 causes the object processing unit 28 to set the selected object to the selected copy destination area (copy destination or movement destination area). Copy (or move) is performed (S304). At this time, the information processing apparatus 10 causes the display processing unit 29 to display the process on a screen or the like. Thereafter, this process ends.

  As described above, according to the first embodiment, the operability when the object displayed in the display area is copied or moved to another area using the gesture operation is improved. In particular, such an operation can be easily performed even when the distance between the object and the copy or movement destination area exceeds the range that can be reached with one hand.

  Further, in order to determine whether or not the user who selects the object and the user who selects the area are the same, a gesture operation that instructs the selection of the object or area without the intention of the third party is performed. Even if it is carried out, it is possible to suppress the occurrence of malfunction due to it.

(Embodiment 2)
Next, Embodiment 2 will be described. In the second embodiment, a case will be described in which an object and a region are identified according to the type of the object or region.

  FIG. 7 is a diagram illustrating an example of a functional configuration realized in the CPU 11 of the information processing apparatus 10 according to the second embodiment. In addition, the same code | symbol is attached | subjected about the structure similar to FIG. 2 which demonstrated Embodiment 1, and the description may be abbreviate | omitted.

  As a functional configuration of the CPU 11 according to the second embodiment, an object type acquisition unit 61 and an area type acquisition unit 62 are newly provided.

  The object type acquisition unit 61 functions as a first acquisition unit, and acquires the type of an object that has already been identified by the identification unit 27. The area type acquisition unit 62 functions as a second acquisition unit, and acquires the type of one or a plurality of areas selected by the second gesture operation.

  The identification unit 27 identifies a region based on the type of object acquired by the object type acquisition unit 61 and the type acquired by the region type acquisition unit 62. Here, depending on the area, there may be an object that cannot be placed. For example, when creating / editing data using a template, there are cases where the types of objects that can be arranged are set in advance in the copy destination or movement destination area. An area on a certain template can be set (input) only text data, and an area on another template can be set such that only an image can be arranged. In such a case, the identification unit 27 identifies the selection target such that the object type matches the object type that can be placed in the copy destination or movement destination area.

  Here, the operation of the information processing apparatus 10 according to the second embodiment is the same as the processing in FIGS. 4 to 6 described in the first embodiment. For this reason, the description using the drawings is omitted here, and different points will be described briefly. As a difference, there is a process at the time of area identification (S204 in FIG. 5).

  When identifying an area, the information processing apparatus 10 obtains the type of an already identified object in the object type obtaining unit 61, and the area type obtaining unit 62 obtains an object in which a copy destination or destination area can be placed. Get the type. Then, the identification unit 27 identifies a region where the object can be arranged from one or a plurality of regions selected by the second gesture operation. For example, if the type of the object is an image, an area where the image can be arranged is identified as the copy or movement destination area.

  As described above, according to the second embodiment, in addition to the effects of the first embodiment, identification objects can be further narrowed down, and thus errors in identification processing can be suppressed.

(Embodiment 3)
Next, Embodiment 3 will be described. In the third embodiment, a case where the third gesture operation is performed based on the user's line of sight will be described.

  The information processing apparatus 10 according to the third embodiment acquires a face image including the user's eyes from an input device (for example, a camera) 18 via the input I / F 15. Then, the gaze direction is detected from the face image, and the object is processed using the gaze direction. For example, when the user views the selected object for a certain period of time and then views the selected copy or movement destination area for a certain period of time, it is determined that the third gesture operation has been performed.

  Here, FIG. 8 is a diagram illustrating an example of a functional configuration realized in the CPU 11 of the information processing apparatus 10 according to the third embodiment. In addition, the same code | symbol is attached | subjected about the structure similar to FIG. 2 which demonstrated Embodiment 1, and the description may be abbreviate | omitted.

  As a functional configuration of the CPU 11 according to the third embodiment, a line-of-sight determination unit 63 is newly provided.

  The line-of-sight determination unit 63 determines whether the line of sight of the user who is selecting the object or area is facing the object or area. In the third determination unit 26, when the user's line of sight is directed to the selected object for a certain period of time or more, the third gesture operation is performed when the user's line of sight is directed to the selected area for a certain period or more Is determined to have been performed. It should be noted that the determination of whether or not the time when the line of sight is directed to the object and the time when the line of sight is directed to the region may be performed using different threshold values.

  As described above, according to the third embodiment, in addition to the effects of the first embodiment, the operability is further improved. In the above description, the second embodiment and the third embodiment have been described separately, but it is needless to say that the second embodiment and the third embodiment may be combined.

  Further, the third gesture operation by the line of sight described in the third embodiment and the third gesture operation described in the first embodiment may be combined to form the third gesture operation. In this case, it is possible to suppress the occurrence of malfunction due to the accidental operation corresponding to the third gesture operation.

  The above is an example of a typical embodiment of the present invention, but the present invention is not limited to the embodiment described above and shown in the drawings, and can be appropriately modified and implemented without departing from the scope of the present invention. .

  For example, in the above description, the case where an area is selected after an object is selected has been described, but the processing order may be changed. In other words, the object may be selected after selecting the region.

  In the above description, the case where the first gesture operation when selecting an object and the second gesture operation when selecting an area are the same is described as an example. It is good also as each separate gesture operation. In this case, even if the order of the object selection process and the area selection process is switched, the process can be clearly distinguished. For example, the first gesture action may be an action of grasping an object, and the second gesture action may be an action of pointing with a finger.

  In the above description, the display area is not described in detail, but the display area may be a display using two-dimensional or three-dimensional display. For example, a three-dimensional display to which a display effect in the depth direction is added may be used. In that case, an apparent virtual display area position when viewed from the user may be handled as a display area position when the input device 18 is used as a reference.

  In the above description, the user specifying unit 22 is provided, and it is determined whether or not the first gesture operation and the second gesture operation are performed by the same user. There is no. That is, depending on the case, the first gesture operation and the second gesture operation may be performed by different users.

  Further, in the above description, when the third gesture operation is performed, it is not described clearly whether to copy the object or move the object, but which process is performed. May be determined in advance. Further, a button or the like for switching whether copying or moving processing is performed may be provided, and switching may be performed by pressing the button.

(Other embodiments)
The present invention is also realized by executing the following processing. That is, software (program) that realizes the functions of the above-described embodiments is supplied to a system or apparatus via a network or various storage media, and a computer (or CPU, MPU, etc.) of the system or apparatus reads the program. It is a process to be executed.

Claims (7)

Acquisition means for acquiring information indicating a gesture operation performed by a user and a position on a display area where the gesture operation is performed;
First determination means for determining whether or not a first gesture operation for instructing selection of any object in the display area is performed based on information acquired by the acquisition means;
Second determination means for determining whether or not a second gesture operation for instructing selection of any one of the display areas has been performed based on the information acquired by the acquisition means;
One of the one or more objects selected based on the first gesture action is identified, and any one of the one or more areas selected based on the second gesture action is identified. An identification means for identifying the region,
Third determination means for determining whether or not a third gesture operation for instructing processing on the identified object is performed in a state where the object and the region are identified;
An information processing apparatus comprising: object processing means for copying or moving the identified object to the identified area when it is determined that the third gesture operation has been performed. A user specifying means for specifying a user who has performed the first gesture operation;
The second determination means includes
Whether the second gesture operation has been performed by the user who has performed the first gesture operation based on the information acquired by the acquisition unit and the user information specified by the user specifying unit. The information processing apparatus according to claim 1, wherein determination is made. The third determination means includes
2. The determination according to claim 1, wherein the third gesture operation is determined to be performed when a gesture operation for moving the identified object toward the identified area by a predetermined amount or more is performed. Information processing device. The acquisition means includes
Obtaining an image containing the user's eyes,
The third determination means includes
The third gesture motion is determined to be performed when the user's line of sight is directed to the identified object and the identified region for a predetermined time or more, respectively. 1. An information processing apparatus according to 1. First acquisition means for acquiring the type of the identified object;
Second acquisition means for acquiring each of the types of objects that can be arranged in one or a plurality of areas selected based on the second gesture action;
The identification means includes
The region where the type acquired by the first acquisition unit and the type acquired by the second acquisition unit match is identified from the one or more regions. Information processing device. A processing method for an information processing apparatus,
An obtaining unit obtaining information indicating a gesture operation performed by a user and a position on a display area where the gesture operation is performed;
A step of determining whether or not a first gesture operation for instructing selection of any object in the display area has been performed based on information acquired by the acquisition unit;
First identifying means for identifying any object from one or more objects selected based on the first gesture action;
A step of determining whether or not a second gesture operation for instructing selection of any one of the display areas is performed based on the information acquired by the acquisition unit;
A step of second identification means identifying any region from among one or more regions selected based on the second gesture action;
A step of determining whether or not a third gesture operation for instructing processing on the identified object has been performed in a state where the object and the region are identified;
And a step of copying or moving the identified object to the identified area when it is determined that the third gesture operation has been performed. Computer
Acquisition means for acquiring information indicating a gesture operation performed by a user and a position on a display area where the gesture operation is performed;
First determination means for determining whether or not a first gesture operation for instructing selection of any object in the display area has been performed based on the information acquired by the acquisition means;
Second determination means for determining whether or not a second gesture operation for instructing selection of any one of the display areas has been performed based on the information acquired by the acquisition means;
One of the one or more objects selected based on the first gesture action is identified, and any one of the one or more areas selected based on the second gesture action is identified. An identification means for identifying the region,
Third determination means for determining whether or not a third gesture operation for instructing processing on the identified object is performed in a state where the object and the region are identified;
A program for functioning as an object processing means for copying or moving the identified object to the identified area when it is determined that the third gesture operation has been performed.

Images