JP7097774B2 - Display device, display method and program - Google Patents

Description

The present invention relates to a display device and the like.

In recent years, materials have been explained by displaying the materials on a large display device such as a table display. For example, the explainer rotates the material displayed on the table display toward the other party. At this time, when the explainer indicates a part to be explained, the characters of the displayed material are facing the other side, so that the explainer has a problem that the characters displayed in the material are difficult to read.

Here, a technique has been proposed in which the part explained by the explainer is shown in the material of the other party with respect to the material displayed on the display device. For example, when the local terminal device and the remote terminal device in which the same material is displayed on the display screen point to a predetermined point of the local terminal device, a device that points to the pointed out point to the remote terminal device has been proposed (for example). , Patent Document 1).

Japanese Unexamined Patent Publication No. 2001-157184

When using a large display device such as a table display, the explainer can duplicate the material so that the explainer and the other party can display the same material. However, the usage such as viewing one display device from different directions is different from the case where there is a terminal device on the explainer side and a terminal device on the other side. Therefore, there is a problem that the technique of displaying the pointed out point using a plurality of terminal devices cannot be applied when one display device is used.

In view of the above-mentioned problems, it is an object of the present invention to provide a display device or the like that reflects an operation made into a first object as an operation on a second object for a plurality of objects displayed on the display unit. And.

In order to solve the above-mentioned problems, the display device of the present invention is used.
In a display device including a display unit for displaying an object, an operation detection unit for detecting an operation on the object, and a processing execution unit for executing a process in response to the operation.
Among the objects displayed on the display unit, the interlocking setting unit for setting the first object and the second object as interlocking targets is provided.
The processing execution unit is characterized in that the operation detected for the first object is reflected as an operation for the second object.

The display method of the present invention is
A display method including a display step for displaying an object, an operation detection step for detecting an operation on the object, and a process execution step for executing a process according to the operation.
Among the objects displayed by the display step, the interlocking setting step for setting the first object and the second object as interlocking targets is included.
The process execution step is characterized in that the operation detected for the first object is reflected as an operation for the second object.

The program of the present invention
On the computer
It is a program that realizes a display function for displaying an object, an operation detection function for detecting an operation on the object, and a process execution function for executing a process in response to the operation.
Among the objects displayed by the display function, the interlocking setting function for setting the first object and the second object as interlocking targets is realized.
The process execution function is characterized in that the operation detected for the first object is reflected as an operation for the second object.

According to the display device of the present invention, it is possible to reflect the operation on the object linked to the operated object. By doing so, even when the object such as the material displayed on the explainer side and the other party is displayed on one display device, the explainer performs the object on the explainer side. The touch operation can be reflected as the operation of the object on the other side.

It is a figure for demonstrating the whole structure of the display device in 1st Embodiment. It is a figure for demonstrating the functional structure of the display device in 1st Embodiment. It is a figure which showed an example of the data structure of the object information in 1st Embodiment. It is operation flow diagram for demonstrating the main process in 1st Embodiment. It is operation flow diagram for demonstrating the main process in 1st Embodiment. It is a figure for demonstrating the operation example in 1st Embodiment. It is a figure for demonstrating the operation example in 1st Embodiment. It is a figure for demonstrating the operation example in 1st Embodiment. It is a figure for demonstrating the operation example in 1st Embodiment. It is a figure for demonstrating the operation example in 1st Embodiment. It is operation flow diagram for demonstrating the main process in 2nd Embodiment. It is a figure for demonstrating the operation example in 2nd Embodiment. It is operation flow diagram for demonstrating the main process in 3rd Embodiment. It is a figure for demonstrating the operation example in 3rd Embodiment. It is a figure for demonstrating the functional structure of the display device in 4th Embodiment. It is operation flow diagram for demonstrating the main process in 4th Embodiment. It is operation flow diagram for demonstrating the main process in 5th Embodiment. It is a figure for demonstrating the operation example in 5th Embodiment. It is operation flow diagram for demonstrating the main process in 6th Embodiment. It is operation flow diagram for demonstrating the main process in 7th Embodiment. It is a figure for demonstrating the operation example in 7th Embodiment.

Hereinafter, embodiments of the present invention will be described with reference to the drawings. In this embodiment, as an example, a table display type display device to which the present invention is applied will be described.

[1. First Embodiment]
[1.1 Overall configuration]
The first embodiment will be described. FIG. 1 is an external view showing a table display which is a display device 10.

The display device 10 is provided with a display unit 110. Here, FIG. 1 shows a state in which an area E100 in which an object can be arranged (hereinafter referred to as a “work area”) and an object E102 and an object E104 arranged in the work area are displayed on the display unit 110. ..

As shown in FIG. 1, one or a plurality of objects can be arranged in the work area E100. Further, in the present embodiment, it is possible to display an object indicating a file as an object. An object indicating a file is an object displaying an image (hereinafter referred to as "sheet image") representing the contents of the file.

For the sheet image, for example, if the file is still image data, the still image is used as the sheet image as it is. If the file is a file containing data of a plurality of pages such as a presentation file and a PDF (Portable Document Format) file, an image that captures a normal display mode is used as a sheet image for each page. If the file is a moving image file, one or more frame images may be used as a sheet image, and an appropriate image is displayed as a sheet image based on the data format of the file.

The example of FIG. 1 is an example of displaying a sheet image of a presentation file as an object E102 or an object E104 which is an object indicating a file. In this way, the sheet image for one page of the presentation file is displayed as an object.

In addition, the user can operate the object by touch operation. For example, the user can perform operations such as moving, scaling, and rotating an object, and drawing operations on an object by touch operations. Further, when a file containing data of a plurality of pages is displayed as an object indicating a file, the user can instruct a page forward or return operation. When the user performs a page feed operation, the sheet image of the next page of the currently displayed page is displayed in the object indicating the file. In addition, when the user performs a page return operation, the sheet image of the page before the currently displayed page is displayed in the object indicating the file. By doing so, the file can be arranged and displayed as an object in the work area, and the user can confirm the contents of the file by the sheet image. Therefore, the user of the display device 10 of the present embodiment can give an explanation while displaying the material by displaying the file of the material to be explained as an object.

[1.2 Function configuration]
FIG. 2 is a functional block diagram of the display device 10. As shown in FIG. 2, the display device 10 includes a control unit 100, a display unit 110, a touch detection unit 120, an image processing unit 130, a communication unit 140, and a storage unit 150. ..

The control unit 100 is a functional unit for controlling the entire display device 10. The control unit 100 realizes various functions by reading and executing various programs, and is configured by, for example, one or a plurality of arithmetic units (CPUs (Central Processing Units)).

The display unit 110 is a functional unit that displays various information to the user and displays a work area. For example, it is composed of an LCD (Liquid Crystal Display), an organic EL display (OLELD: Organic Electroluminescence Display), and the like.

The touch detection unit 120 is a functional unit that detects an operation by touch from the user. The touch detection unit 120 can detect a plurality of touch positions as a touch operation. Further, as the operation detected by the touch detection unit 120, for example, the number of touches, the touch area, and the gesture may be included. Further, the touch detection unit 120 is configured as a touch panel by being placed on top of the display unit 110. The method for detecting the touch operation on the touch detection unit 120 may be any method such as a capacitance method, a resistance film method, and an infrared method.

The image processing unit 130 is a functional unit that performs various image processing. For example, generate a sheet image. To generate the sheet image, the image processing unit 130 reads out the file stored in the file storage area 152 described later, and generates the image data of the sheet image for each file based on the data format of the file. The image data of the generated sheet image is stored in the sheet image data storage area 154, which will be described later, in association with the file. In addition, the sheet image is displayed as an object indicating the file, and the sheet image to be displayed for the object indicating the file is moved and displayed in an enlarged / reduced manner based on the operation detected by the touch detection unit 120. Or rotate the display.

The communication unit 140 is a functional unit that connects to a network and communicates with other devices. For example, communication is performed by using a wired / wireless LAN or using a mobile phone network such as 3G / LTE / 5G.

The storage unit 150 stores various programs and various data necessary for the operation of the display device 10. The storage unit 150 is composed of, for example, an SSD (Solid State Drive) which is a semiconductor memory, an HDD (Hard Disk Drive), or the like.

Here, the storage unit 150 secures a file storage area 152 and a sheet image data storage area 154, and further stores object information 156.

The file storage area 152 is an area for storing a file to be displayed as an object on the display unit 110. In the file storage area 152, for example, a file such as a still image file, a moving image file, or a PDF file is stored.

The sheet image data storage area 154 is an area for storing sheet image data. In the sheet image data storage area 154, for example, image data corresponding to a file to be displayed as an object is stored. For example, the sheet image data storage area 154 stores an image file of a sheet image for each object indicating a file.

The object information 156 is information about an object arranged on the work area. As shown in FIG. 3, the object information 156 includes an object ID for identifying an object (for example, "0x01"), a file name of a file to be displayed as an object (for example, "presentation.ppt"), and an object. Work area coordinates (eg, "(100,900)-(300,1050)") that indicate the coordinates of the area in the work area where is displayed, the scaling factor of the object (eg, "50%"), and the rotation of the sheet image. The sheet rotation angle (for example, "0 °") indicating the angle and the interlocking destination object ID (for example, "0x02") for identifying the object to be set as the interlocking target are stored.

In the present embodiment, the object to be linked means an object that reflects the operation input from the user in one object. For example, it is assumed that "0x02" is stored in the object information 156 as the interlocking destination object ID of the object whose object ID is "0x01". In this case, the user's operation input to the object whose object ID is "0x01" is reflected in the object whose object ID is "0x02". In this way, the object operated by the user is called the "link source object" (first object), and the object that reflects the operation input by the user is called the "link destination object" (second object). ..

Further, in the object information 156, "0x02" is stored as the interlocking destination object ID of the object whose object ID is "0x01", and "0x01" is stored as the interlocking destination object ID of the object whose object ID is "0x02". And. In such a case, it is shown that the object whose object ID is "0x01" and the object whose object ID is "0x02" are interlocked with each other. Further, with respect to the object whose object ID is "0x01" and the object whose object ID is "0x02", the operation input to one of the objects is reflected in the other object.

It should be noted that the objects that are interlocked with each other are also simply referred to as "objects that are interlocked with each other" including the interlocking source object and the interlocking destination object. The number of objects to be linked may be two or more. Therefore, the operation performed on the interlocking source object may be interlocked and reflected on a plurality of other interlocking destination objects.

Further, by reflecting the operation made to the interlocking source object to the interlocking destination object, a predetermined process is executed in the interlocking destination object. The predetermined process is, for example, a process of displaying a cursor or a marker, a drawing process of drawing a line diagram or a figure, or a process of enlarging / reducing an object. In the present embodiment, it will be described that the process of displaying the cursor is executed as a predetermined process. That is, when a touch operation is performed on the interlocking source object, the touch operation is reflected on the interlocking destination object and the cursor is displayed on the interlocking destination object.

The object ID is a value that can uniquely identify an object, and for example, stores a serial number. In addition, it may be a hash value or a code according to a predetermined system. Further, the interlocking destination object ID does not store any value when there is no interlocking object.

The seat rotation angle is a display angle of the sheet image on the display unit 110, and for example, an angle of 0 ° or more and less than 360 ° is stored. The angle stored in the seat rotation angle changes depending on the rotation operation of the object input by the user. The work area coordinates are changed by the moving operation and the scaling operation of the object, and the scaling ratio is changed by the scaling operation of the object input by the user.

Information other than the above-mentioned information may be stored in the object information 156. For example, the stacking order of objects may be stored. If the file to be displayed as an object is a file containing multiple pages, the page number currently displayed by the object may be stored, or information such as the coordinates of the line or figure drawn by the drawing operation may be stored. You may.

[1.3 Processing flow]
Subsequently, the flow of the main process in the first embodiment will be described with reference to FIGS. 4 and 5. In addition, it is assumed that one or more objects indicating a file are arranged in the work area.

First, with reference to FIG. 4, the control unit 100 determines whether or not the operation detected by the touch detection unit 120 is a touch operation instructing the mode switching to the copy mode (step S102). The copy mode is a mode in which the display device 10 duplicates an object arranged on the display unit 110 and arranges it as a new object. Further, the touch operation indicating the copy mode is, for example, an operation in which the user touches the area of one object displayed in the work area at two places with the palm of the hand.

If the control unit 100 determines in step S102 that the operation detected by the touch detection unit 120 is a touch operation instructing the mode switching to the copy mode, the process proceeds to step S104 (step S102; Yes). On the other hand, if the control unit 100 determines that the touch operation for instructing the mode switching to the copy mode has not been performed, the control unit 100 executes processing of another operation mode based on the touch operation (step S102). No → step S120). The processing of other operation modes is an operation of moving an object, an operation of scaling an object, and an operation of page forward / return. In step S120, the control unit 100 stores the object information 156 based on the touch operation, and the image processing unit 130 generates a sheet image and processes the sheet image. After executing the process of step S120, the process proceeds to step S152 of FIG. 5 (step S120 → step S152).

If the result of step S102 is affirmative, the control unit 100 subsequently identifies the object to be the duplication source operated by the user in step S102 (hereinafter referred to as "copy source object") (step S104). ). For example, the control unit 100 identifies as a copy source object an object in which all the touch positions detected by the touch detection unit 120 are included in the area specified by the work area coordinates stored in the object information 156.

Subsequently, the control unit 100 determines whether or not the operation detected by the touch detection unit 120 is an operation for copying an object (step S106). In the object copy operation, for example, after the user touches the area of the copy source object in two places with the palm, one palm is moved to the outside of the copy source object, and both hands are released from the display unit 110 as it is. It is an operation to touch up. The copy operation may be a specific gesture operation such as an operation of finely moving (shaking) the copy source object up / down / left / right by a touch operation, or an operation of moving the object in a predetermined direction and returning it to the original position. Various methods can be considered as design items. If the control unit 100 determines that the operation detected by the touch detection unit 120 is a copy operation, the process proceeds to step S108 (step S106; Yes). If the control unit 100 determines that the operation detected by the touch detection unit 120 is not a copy operation, the process returns to step S102 (step S106; No → step S102). In this case, the display device 10 has canceled the copy mode.

If the determination in step S106 is an affirmative result, the touch detection unit 120 subsequently detects the position where the touch-up operation is performed by the user in step S106 (step S108).

Subsequently, the control unit 100 duplicates the file of the copy source object (step S110). For example, the control unit 100 reads the file name of the copy source object from the object information 156. Then, the control unit 100 identifies the file stored in the file storage area 152 from the read file name (for example, "presentation.ppt"). Then, the control unit 100 duplicates the specified file and stores the file storage area 152 with a name different from the file name of the original file (for example, "presentation-copy.ppt").

Subsequently, the control unit 100 displays an object that duplicates the copy source object (hereinafter, referred to as “copied object”) at the touch-up position detected by the touch detection unit 120 in step S108 (step S112). The touch-up position is, for example, in step S106, the control unit 100 is set to the position of the center of the palm touched up outside the area of the object.

Subsequently, the control unit 100 stores the copied object information in the object information 156 (step S114). For example, the control unit 100 newly generates an object ID indicating the copied object, and the generated object ID, the file name duplicated in step S108, and the rectangular area centered on the touch-up coordinates detected in step S106. The object information in which the coordinates, the scaling ratio of the copy source object, and the sheet rotation angle are set are added to the object information 156. By doing so, the control unit 100 can handle the copy source object and the copied object as different objects.

Subsequently, the control unit 100 performs interlocking setting for the copied object so that the copy source object is the interlocking destination object (step S116). Specifically, the control unit 100 stores the object ID of the object specified in step S104 as the interlocking destination object ID with respect to the object information of the copied object stored in step S112.

Further, the control unit 100 also performs interlocking setting for the copy source object so that the copied object is the interlocking destination object (step S118). Specifically, the control unit 100 stores the object ID of the object information stored in step S114 as the interlocking destination object ID for the object information of the object specified in step S104. By doing so, the copy source object and the copied object are set as objects linked to each other.

Subsequently, with reference to FIG. 5, the control unit 100 determines whether or not there is a touch operation on the object by the user (step S152). For example, when the touch position detected by the touch detection unit 120 is included in any of the areas specified by the work area coordinates stored in the object information 156, the control unit 100 touches the object by the user. Judge that there was an operation. If the control unit 100 determines that there is no touch operation on the object, the main process ends (step S152; No). If the control unit 100 determines that there is a touch operation on the object, the process proceeds to step S154 (step S152; Yes → step S154).

If the result in step S152 is affirmative, the control unit 100 subsequently identifies the object to which the touch operation has been performed (step S154). For example, when the touch position detected by the touch detection unit 120 is included in the area specified by the work area coordinates in a specific object, the control unit 100 identifies the specific object as the touch-operated object. do. Further, when the touch position detected by the touch detection unit 120 is included in the area specified by the work area coordinates of the plurality of objects, the control unit 100 selects the object in the foremost layer among the plurality of objects. Identify as a touched object.

Subsequently, the control unit 100 reads out the object information 156, and whether or not another object ID is stored as the interlocking destination object ID of the object specified in step S154, that is, whether or not the interlocking destination object is set. Is determined (step S156). If the interlocking destination object is not set, the control unit 100 executes the process based on the touch operation detected by the touch detection unit 120 in step S152, and then ends the main process (step S156; No.). → Step S170). If the linked object is set, the process proceeds to step S158.

When there is a setting of the interlocking destination object (step S156; Yes), the control unit 100 subsequently determines whether or not to perform a process of displaying the cursor on the interlocking destination object (step S158). That is, the object specified in step S154 reflects the touch operation performed by the user in step S152 on the interlocking destination object as the interlocking source object. At this time, if the touch operation performed by the user is an operation for displaying the cursor, the control unit 100 performs a process of displaying the cursor on the interlocking destination object.

Whether or not the touch operation performed by the user is an operation for displaying the cursor is determined, for example, when the mode for displaying the cursor is selected by the user and the interlocking source object is touched. It is determined that the operation to display is performed. Further, when a predetermined gesture operation is performed, it may be determined that the operation to display the cursor has been performed. When the operation of displaying the cursor is performed, the control unit 100 determines that the process of displaying the cursor on the interlocking destination object is performed. If the process of displaying the cursor on the linked object is not performed, the control unit 100 executes the process based on the touch operation detected by the touch detection unit 120 in step S152, and then ends the main process (. Step S158; No → Step S170). To perform the process of displaying the cursor on the linked object, the process proceeds to step S160.

When the process of displaying the cursor on the linked object is performed (step S158; Yes), the control unit 100 subsequently calculates the coordinates in the object from the coordinates touched by the user (step S160). The in-object coordinates refer to the coordinates obtained by converting the coordinates in the coordinate system based on the work area into the coordinates in the coordinate system based on the object. The coordinates in the object are calculated based on the touched coordinates, the work area area of the touched object, the scaling factor, and the seat rotation angle.

Subsequently, the control unit 100 calculates the corresponding coordinates of the interlocking destination object of the interlocking source object (step S162). The corresponding coordinates are the coordinates obtained by converting the coordinates in the object of the interlocking destination object corresponding to the coordinates in the object of the object touched by the user into the coordinates in the coordinate system based on the work area. That is, in step S162, the control unit 100 converts the operation position of the interlocking source object into the operating position of the interlocking destination object.

Subsequently, the control unit 100 controls the display unit 110 to perform a process of displaying the cursor at the corresponding coordinates (step S164). By such a process, the control unit 100 performs a process assuming that the user performs a touch operation on the corresponding coordinates calculated in step S160. As a result, the control unit 100 can identify and display the position corresponding to the touch-operated position with the cursor with respect to the interlocking-destination object of the object (interlocking source object) touch-operated in step S152. Become.

Subsequently, the control unit 100 determines whether or not the touch-up operation has been performed by the user (step S166), and if it is determined that the touch-up operation has been performed, the control unit 100 determines that the cursor displayed in step S164. Is deleted (step S166; Yes → step S168). On the other hand, if the control unit 100 determines that the touch-up operation has not been performed, the process returns to step S160 (step S166; No → step S160). By doing so, the control unit 100 performs a process of displaying the cursor at the corresponding coordinates until the user performs a touch-up operation.

As described above, according to this process, the operation performed on the first object is reflected as the operation on the second object set as the interlocking target, and the cursor is displayed on the second object. Will be done. That is, the operation is reflected in the objects linked to each other and the process is executed, so that the user appears that the two objects are moving (likely linked) in the same way.

[1.4 Operation example]
An operation example in this embodiment will be described with reference to the drawings. First, the copy mode will be described with reference to FIG. FIG. 6 is an example of the work area W100 displayed on the display unit 110, and the object S100 is displayed in the work area W100. Further, in the description of the operation example, the instruction for switching the mode to the copy mode will be described as an operation of touching the area of one object displayed in the work area at two places with the palm of the hand.

For the sake of explanation, the touch operation on the display unit 110 will be described as being performed by the user's hand and the pen. Further, the touch operation by the user's hand will be described as inputting by the finger of the hand and the palm of the hand. The identification of the pen, the finger of the hand, and the palm is identified by, for example, the touch area when the touch operation is performed. In this case, a first predetermined area for distinguishing the pen and the finger of the hand and a second predetermined area for distinguishing the finger of the hand and the palm are set in advance. If the touch area is less than the first predetermined area, a touch operation with a pen, if the touch area is equal to or more than the first predetermined area and less than the second predetermined area, a finger touch operation is performed. If there is, it is identified that the touch operation by the palm has been performed. The touch operation may be identified by combining the number of touches, the capacitance, and the like. For example, in the case of combining with the number of touches, if five touches whose touch area is the area of the fingers of the hand are included in the predetermined range, it may be determined that the palm is touched in the predetermined range.

FIG. 6 is an example of a state in which the palms H100 and H102 touch two places in the area of the object S100 displayed in the work area W100. Since this operation is a touch operation for instructing the mode switching to the copy mode, the control unit 100 determines that the user has instructed the mode switching to the copy mode.

Then, it is assumed that the palm H102 of FIG. 6 is operated by the user to move in the direction of the arrow in FIG. 6 (the direction of the upper right) and is moved to the position of H104. In this state, when the palm H104 is touched up from the display unit 110, the control unit 100 controls to display the object S102, which is a copy of the object S100, on the display unit 110 at the position where the palm H104 is touched up. As a result, as shown in FIG. 7, the object S100 and the object S102 are displayed on the display unit 110. At this time, the control unit 100 stores the object information of the object S100 and the object S102 in the object information 156 so that the object S100 and the object S102 become objects that are interlocked with each other.

FIG. 8 is an example in which an operation different from the copy mode is performed by the user. For example, FIG. 8 shows a case where the user touches the area of the object S102 displayed in the work area W100 with the fingertips F100 and F102. Since this operation is not an instruction to switch the mode to the copy mode, the control unit 100 performs a process different from the process of copying the object. For example, when the operation of moving the fingertip in the direction of the arrow in FIG. 8 is performed by the user, the control unit 100 controls to rotate the object operated by the user and display it on the display unit 110. As a result of this processing, as shown in FIG. 9, the object S102 is displayed on the display unit 110 in a direction different from that of the object S100.

FIG. 10 is an example when a touch operation is performed on the object. Although the touch operation on the object will be described as being performed by the pen, it may be a one-point touch operation by the finger of the hand. For example, when the user performs a pen operation P100 which is a touch operation on the object S100, the control unit 100 controls to display the cursor C100 at the corresponding coordinates in the object S102 which is the interlocking destination object of the object S100. Further, the control unit 100 moves the cursor C100 to the corresponding coordinates and displays it according to the movement of the position of the pen. By doing so, for example, when the user traces the object with the pen, the part traced by the pen can be shown on the object directed to the other side. Then, when the pen operation P100 is terminated by the user, the control unit 100 controls to erase the display of the cursor C100.

As shown by the cursor C100 in FIG. 10, the control unit 100 may display the cursor C100 so as to match the display direction of the cursor C100 according to the direction of the object displaying the cursor C100. Specifically, the control unit 100 reads the information of the interlocking destination object of the touch-operated object from the object information 156, and rotates and displays the cursor C100 by the same angle as the sheet rotation angle of the interlocking destination object. By doing so, the angle of the sheet and the angle of the cursor match, and the display is easy for the user to see. Further, the size of the cursor C100 may be displayed in a size corresponding to the scaling factor of the object.

In the description of FIG. 9, the case where the object S100 is operated by the user has been described, but when the object S102 is operated by the user, the control unit 100 controls to display the cursor on the object S100. .. That is, since the object S100 and the object S102 are stored in the object information 156 as objects that are interlocked with each other, when the operation of one object is performed by the user, the control unit 100 cursors on the other object. Is controlled to display.

By doing so, the user who operates the object (the user on the explainer side) browses the linked object by tracing the part to be explained with the pen or the like. It is possible to indicate the position traced with a pen or the like to the user (the user on the other side).

It should be noted that one object may be linked with a plurality of objects. In this case, in the object information 156, a plurality of object IDs are stored as the interlocking destination object IDs of one object. Further, in step S162 and step S164, the control unit 100 calculates the corresponding coordinates for each interlocking destination object and displays the cursor on the corresponding coordinates. By doing so, the user can operate one object (interlocking source object) to display the cursor on a plurality of interlocking destination objects.

Further, the interlocking setting may be canceled when it is detected that the object is closed or the interlocking setting is canceled. In this case, the control unit 100 deletes the object ID stored in the interlocking destination object ID of the object information 156 for the object for which the interlocking setting is canceled and the object for which the interlocking setting is set. Above, the object information 156 may be stored. By doing so, the determination in step S156 becomes a negative result, and the process proceeds to step S170, so that the control unit 100 reflects the operation only on the object to which the touch operation is performed.

[2. Second Embodiment]
In the second embodiment, unlike the first embodiment, characters and figures are displayed by displaying a marker or an underline instead of a cursor at a position corresponding to a position touch-operated by the user. It is an embodiment which identifies and displays a modification.

Here, the marker is a display showing the locus of the position touched down by the user by a thick line of a semi-transparent color, and the underline is a thin opaque locus of the position touched down by the user. It is a display indicated by a line. In this way, by identifying and displaying the position operated by the user on the linked object by a marker or underline, it is possible to show the position touched down by the user on the object directed to the other side. It becomes. The identification display may be displayed by something other than a marker or an underline, and any display may be performed as long as the position touched down by the user can be shown. For example, the display device 10 may display a circular figure imitating a laser pointer, or a straight line connecting the position where the touchdown was first performed and the position where the touchdown is currently performed is drawn on the interlocking destination object. It may be drawn at the corresponding position. In this embodiment, the position corresponding to the position touch-operated by the user will be identified and displayed by the marker.

The functional configuration of the present embodiment is substantially the same as that of the first embodiment, and the processing flow of FIG. 5 is replaced with the processing flow of FIG. The same processing as that of the first embodiment is designated by the same reference numerals, and the description thereof will be omitted.

In the present embodiment, if step S156 is an affirmative result, the control unit 100 subsequently determines whether or not to perform a process of displaying the marker on the interlocking destination object (step S252). For example, it is determined that the process of displaying the marker is performed when the mode for displaying the marker is selected. Further, it may be determined that the process of displaying the marker is performed when a predetermined gesture operation is performed.

Further, after the corresponding coordinates are calculated in step S162, the control unit 100 subsequently performs a process of displaying a marker on the corresponding coordinates (step S254). Since the marker is displayed based on the corresponding coordinates, the marker is displayed along the orientation of the object (rotation angle of the sheet).

Further, when the touch-up operation is performed by the user, the marker displayed in step S254 is erased (step S166; Yes → step S256).

FIG. 12 is a diagram for explaining an operation example of the present embodiment. FIG. 12 is an example of the work area W200 displayed on the display unit 110. The object S200, the object S202, the object S204, and the object S206 are displayed in the work area W200, and the object S200, the object S202, the object S204, and the object S206 are objects that are linked to each other. And.

Here, it is assumed that the user performs a pen operation P200 as a touch operation on the object S200. At this time, the control unit 100 calculates the corresponding coordinates of the coordinates on which the pen operation P200 is performed, and controls to display the marker on the corresponding coordinates. Therefore, for the object S202, the object S204, and the object S206 linked with the object S200, the marker display M202 is displayed on the object S202, the marker display M204 is displayed on the object S204, and the object S206 is displayed based on the pen operation P200. The marker display M206 is displayed in. Note that FIG. 12 is shown as an example in which the control unit 100 does not control the display of the marker on the object S200 operated by the user and the marker is not displayed on the object S200, but the control unit 100 is operated by the user. Markers may also be displayed on the objects.

According to the present embodiment, the display device 10 can display a marker instead of a cursor at a position corresponding to a position touch-operated by the user. In particular, this embodiment is considered to be effective when it is desired to emphasize a certain range and display it, such as when reading out characters displayed on an object.

[3. Third Embodiment]
The third embodiment is different from the first embodiment in that the display device reflects the drawing operation performed by the user on the interlocking destination object.

The drawing operation is an operation of drawing a line diagram or a figure on an object or deleting an already drawn line diagram or a figure. Further, by executing the drawing process based on the drawing operation, the line diagram or the figure is drawn by superimposing it on the sheet image. Unlike the second embodiment, the drawn line diagram or figure is brought into a drawn state without being erased by the touch-up operation. The line diagram or figure drawn on the object is deleted by performing a drawing operation for deleting the line diagram or figure. Whether or not a drawing operation has been performed or what kind of drawing processing is to be performed is switched, for example, depending on the mode. That is, the process of touch operation is changed according to the mode, and the process of drawing a line diagram or the like or the process of erasing the line diagram or the like is performed. It should be noted that the drawing operation may be performed by a predetermined gesture operation without switching by the mode.

The line diagram or graphic data drawn by the drawing operation (hereinafter referred to as “drawing data”) may be stored in the storage unit 150 in association with the sheet image. The drawing data is stored when the touch-up operation is performed, when a predetermined time interval is reached, or when the user instructs the operation to store the drawing data.

Further, when displaying the sheet image, the drawing data may be read and the drawing data may be superimposed on the sheet image and displayed. By doing this, when a file containing multiple pages is displayed as an object, when the page for which the drawing operation has been performed is redisplayed by the page forward / page back operation, it will be performed up to that point. It is possible to display the drawing by the drawing operation again and draw or delete the line diagram or the like.

In addition, by storing the drawing data in association with the sheet image, the file and the drawing data are sent as separate files when the file for which the drawing operation is performed is sent, or the drawing data is superimposed on the original file. It is possible to send files.

The functional configuration of the present embodiment is substantially the same as that of the first embodiment, and the processing flow of FIG. 5 is replaced with the processing flow of FIG. The same processing as that of the first embodiment is designated by the same reference numerals, and the description thereof will be omitted.

In the present embodiment, if step S156 is an affirmative result, the control unit 100 subsequently determines whether or not a drawing operation has been performed (step S352).

Further, after the corresponding coordinates are calculated in step S162, the control unit 100 subsequently performs a drawing process based on the drawing operation on the corresponding coordinates (step S354).

It should be noted that whether or not the drawing process is performed and what kind of drawing process is performed may be determined depending on whether or not the selected mode or a predetermined gesture operation has been performed, as described above. Further, the drawn line diagram or figure is not deleted by the touch-up operation by the user, but the drawing operation for deleting the line diagram or figure by the user is performed, so that the control unit 100 controls the line diagram. And delete figures.

An operation example of this embodiment will be described with reference to FIG. FIG. 14 is an example of the work area W300 displayed on the display unit 110. The object S300 and the object S302 are displayed in the work area W300. Here, it is assumed that the object S300 and the object S302 are objects that are linked to each other.

Here, it is assumed that the user has performed a drawing operation by the pen operation P300 as a touch operation. At this time, the display device 10 calculates the corresponding coordinates of the coordinates performed by the pen operation P300, and performs processing based on the drawing operation on the corresponding coordinates. Therefore, the drawing operation performed by the user on the object S300 is reflected by the display device 10 on the object S302 which is the interlocking destination object. Note that FIG. 14 is shown as a diagram in which the control unit 100 does not control the object S300 operated by the user to display the line diagram or the like drawn by the drawing operation, and the line diagram or the like is not displayed on the object S300. However, a line diagram or the like may be displayed on the object operated by the user.

For example, when the user draws a line diagram by freehand on the object S300, the display device 10 displays the result of the previous drawing on the object S302 which is the interlocking destination object of the object S300. Control to do. Therefore, as shown in FIG. 14, the drawing operation by the pen operation P300 for the object S300 is displayed on the object S302 as a diagram M300 by the display device 10. Since drawing is performed based on the corresponding coordinates, a line diagram or the like is displayed on the object S302, which is the interlocking destination object of the object S300, along the direction of the object of the object S302.

According to the present embodiment, the display device 10 draws a line diagram drawn by the user on the interlocking destination object, and maintains the drawn state even when the user performs a touch-up operation. Therefore, this embodiment is effective when a plurality of line diagrams are input by the user, or when the user does not want to delete the line diagram or the like even if a touch-up operation is performed. ..

[4. Fourth Embodiment]
Unlike the first embodiment, the fourth embodiment is a copy source object and a copied object when an operation of rotating the copied object within a predetermined angle range (for example, 135 ° to 225 °) is performed. It is an embodiment in which and is an object that is interlocked with each other.

The functional configuration of the display device 12 in the present embodiment is obtained by replacing FIG. 2 showing the functional configuration of the display device 10 of the first embodiment with FIG. Further, in the main processing of the present embodiment, the processing flow of FIG. 4 is replaced with the processing flow of FIG. The same functional parts and processes as those in the first embodiment are designated by the same reference numerals, and the description thereof will be omitted.

The functional configuration of the display device 12 in the present embodiment will be described with reference to FIG. The display device 12 of the present embodiment is different from the display device 10 of the first embodiment in that the object interlocking angle 158 and the timeout time 160 are further stored in the storage unit.

The object interlocking angle 158 is a sheet rotation angle of the copied object when the copy source object and the copied object are interlocked with each other. For example, a value of "135 ° to 225 °" is stored. In this case, when the seat rotation angle of the copied object is 135 ° or more and 225 ° or less, the display device 12 sets the object touched by the user and the copied object as objects that are interlocked with each other.

Further, the time-out time 160 is a time during which the display device 12 can make the copy source object and the copied object an object that is interlocked with each other. For example, the value "1 minute" is stored. In this case, if the sheet rotation angle of the copied object is included in the angle stored in the object interlocking angle 158 by 1 minute after the object is copied, the display device 12 will display the copy source. Let the object of and the copied object be the objects that are linked to each other. Further, if it exceeds 1 minute after the object is copied, the display device 12 copies the copied object to the copy source object regardless of the object rotation angle, assuming that a timeout has occurred. Do not consider objects to be linked to each other.

The object interlocking angle 158 and the timeout time 160 may be stored in advance in the display device 12 or may be set by the user.

Subsequently, with reference to FIG. 16, the main process of the display device 12 of the present embodiment will be described. After displaying the copied object in step S110, the control unit 100 determines whether or not the user has performed a rotation operation on the copied object (step S402). When it is determined that the operation to rotate the copied object has been performed by the user, the control unit 100 rotates and displays the copied object based on the operation by the user (step S402; Yes → step S404). At this time, the control unit 100 stores the angle of the sheet image displayed on the copied object in the sheet rotation angle of the object information 156.

Subsequently, the control unit 100 determines whether or not the angle of the copied object is included in the angle stored as the object interlocking angle 158 (step S406). When the control unit 100 determines that the angle of the copied object is included in the angle stored as the object interlocking angle 158, the display device 12 executes the processes after step S112 (step S406; Yes).

When the control unit 100 determines that the angle of the copied object is not included in the angle stored as the object interlocking angle 158, the control unit 100 subsequently determines whether or not the timeout has occurred (step S406). No → step S408). That is, the control unit 100 determines whether or not the elapsed time since the object was copied exceeds the timeout time 160. If the control unit 100 determines that a time-out has occurred, the main process ends (step S408; Yes). If the control unit 100 determines that the time-out has not occurred, the process returns to step S402 (step S408; No → step S402).

Further, even if the user does not rotate the object in step S402, the process proceeds to step S408 (step S402; No → step S408).

According to the present embodiment, the display device 12 can determine whether or not the copy source object and the copied object are objects that are interlocked with each other, depending on whether or not the rotation operation of a predetermined angle is performed. .. Therefore, the user can choose to link the object when copying the object for explanation to others, and not link the object when simply duplicating the object, improving convenience. You can expect it.

In the description of the present embodiment, it is determined whether or not the control unit 100 performs the interlocking setting based on the object rotation angle, but it may be realized by a method other than such a method. For example, in step S110, the control unit 100 stores the angle (initial angle) when the copied object is displayed. Further, in step S402, when the copied object is rotated, the control unit 100 may calculate the difference from the initial angle and perform the interlocking setting when the difference is equal to or larger than the preset threshold value. By doing so, even if the copy source object is tilted, the control unit 100 makes the copy source object and the copied object interlock with each other based on the angle rotated by the rotation operation. You can decide whether or not.

[5. Fifth Embodiment]
Unlike the first embodiment, the fifth embodiment reflects the touch operation by the user on both the interlocking source object and the interlocking destination object that have been touch-operated by the user for the objects that are interlocked with each other. Is. For example, when an operation for displaying a marker is performed, the display device of the present embodiment displays the marker on the interlocking source object and the interlocking destination object.

The functional configuration of the display device 10 in this embodiment is substantially the same as that in the first embodiment. Further, in the main processing of the present embodiment, the processing flow of FIG. 5 is replaced with the processing flow of FIG. The same processing as that of the first embodiment is designated by the same reference numerals, and the description thereof will be omitted.

In the present embodiment, when there is a touch operation on the object, the control unit 100 executes the process based on the touch operation detected by the touch detection unit 120 (step S152; Yes → step S552). Further, when the interlocking destination object is set for the touched object, the corresponding coordinates are obtained, and the control unit 100 also executes the process based on the touch operation at the corresponding coordinates (step S554). These processes are repeated until touch-up is performed.

Further, when the touch-up is performed and the touch operation is a cursor display or a marker display, the cursor or marker displayed in step S552 and step S554 is deleted (step S556; Yes → step S558).

By the above-mentioned processing, it is possible to reflect the touch operation by the user on both the object touch-operated by the user (interlocking source object) and the interlocking destination object. In the flow diagram shown in FIG. 17, the control unit 100 identifies the object to which the touch operation has been performed and determines whether or not there is a setting of the interlocking destination object each time until the touch-up is performed (step). S154 → step S156), it is not necessary to perform such a process. For example, an area for storing the interlocking destination object ID of the touch-operated object is secured in the storage unit 150, and the control unit 100 secures the interlocking-destination object ID of the touch-operated object when the touch operation is performed in step S152. To remember. If there is no interlocking destination object ID of the touched object, the area for storing the interlocking destination object ID is cleared. Then, after the processing of step S552, the control unit 100 may read out the area for storing the interlocking destination object ID, and if the object ID is stored, the determination in step S156 may be a positive result.

An operation example of this embodiment will be described with reference to FIG. FIG. 18 is an example of the work area W500 displayed on the display unit 110. The object S500 and the object S502 are displayed in the work area W500. Here, it is assumed that the object S500 and the object S502 are objects that are linked to each other.

Here, it is assumed that the user has performed a marker display operation by the pen operation P500 as a touch operation. At this time, the control unit 100 controls to display the marker M500 at the position where the pen operation P500 is performed. Further, the control unit 100 calculates the corresponding coordinates corresponding to the position where the pen operation P500 is performed, and performs a process of displaying the marker M502 with respect to the corresponding coordinates. Therefore, the touch operation performed by the user on the object S500 is reflected on the object S500 and the object S502 by the control unit 100.

According to the present embodiment, the display device 10 can display the touch operation performed by the user on the touched object (interlocking source object) and the interlocking destination object of the touched object. .. Therefore, the user can confirm how the touch operation is reflected in the interlocking destination object by confirming the object on which the touch operation is performed.

In FIG. 18, a touch operation on the first object among the objects linked to each other is reflected as an operation on another object (second object) among the objects linked to each other, and the objects linked to each other. This was explained as an example in which a marker is displayed on the object. The cursor may be displayed on the objects linked to each other by the touch operation, or the drawing operation may be reflected on the objects linked to each other.

As described above, according to this process, the operation performed on the first object is reflected as the operation on the second object set as the interlocking target. That is, by interlocking operations in objects that are interlocked with each other, the user appears that the two objects are moving (appearing to be interlocked) in the same way.

Further, by reflecting the operations performed on the first object and the second object, it is possible to directly perform operations on each object, for example. For example, when an annotation such as drawing a line diagram is input, the content drawn by the first object is also reflected in the second object. That is, drawing and changes can be reflected in the file corresponding to the first object and the file corresponding to the second object by one operation.

[6. 6th Embodiment]
The sixth embodiment is different from the first embodiment in that, for objects linked to each other, in addition to displaying the cursor at the position touch-operated by the user and the corresponding position, the page forward and page return operations are linked. Is.

The functional configuration of the display device 10 in this embodiment is substantially the same as that in the first embodiment. Further, in the main processing of the present embodiment, the processing flow of FIG. 5 is replaced with the processing flow of FIG. The same processing as that of the first embodiment is designated by the same reference numerals, and the description thereof will be omitted.

The flow of the main process in the present embodiment will be described with reference to FIG. First, if step S156 is an affirmative result, the control unit 100 subsequently determines whether or not a page forward or page back operation has been performed (step S652). The page forward or page back operation is, for example, a swipe gesture operation on an object. It may be a touch operation to the button for page forward or page return displayed on the object.

When the control unit 100 determines in step S652 that the page forward or page back operation has been performed, the control unit 100 subsequently performs the page forward or page back process for the touch-operated object (step). S654). Further, the control unit 100 also executes a page forward or page return process for the interlocking destination object of the touch-operated object (step S656).

If the control unit 100 determines in step S652 that the page forward or page back operation has not been performed, the display device 10 executes the operations of steps S158 to S170.

In this embodiment, it has been described that page feed and page return are linked, but in addition to page linking, an operation of enlarging / reducing an object, an operation of moving an object, an operation of rotating, and an operation of closing an object are performed. May be linked.

According to the present embodiment, even when the display device 10 displays a file containing data of a plurality of pages (for example, a PDF file) as an object, the copy source object and the copied object are used. It is possible to link the displayed pages. Therefore, even when the user operates an object indicating a file containing data of multiple pages, the user does not need to perform an operation to make the displayed page the same for the copy source object and the copied object. , It is possible to concentrate on the operation of tracing the part to be explained with a pen or the like.

[7. Seventh Embodiment]
Unlike the first embodiment, the seventh embodiment is an embodiment in which, in addition to displaying the cursor at the position touch-operated by the user and the corresponding position, the enlargement / reduction display for each object is individually performed.

The functional configuration of the display device 10 in this embodiment is substantially the same as that in the first embodiment. Further, in the main process of the present embodiment, the process flow of FIG. 5 is replaced with the process flow of FIG. 20. The same processing as that of the first embodiment is designated by the same reference numerals, and the description thereof will be omitted.

The flow of the main process in the present embodiment will be described with reference to FIG. 20. First, if step S156 is an affirmative result, the control unit 100 subsequently determines whether or not an operation of enlarging or reducing the object has been performed (step S752). The operation of enlarging or reducing the object is, for example, the operation of enlarging the object is a pinch-out gesture operation, and the operation of reducing the object is a pinch-in gesture operation. It may be a touch operation to the button for enlarging or reducing displayed on the object.

When it is determined that the operation of enlarging or reducing the object has been performed, the control unit 100 subsequently enlarges or reduces the object based on the operation of enlarging or reducing the object (step S754). At this time, the control unit 100 stores the scaling ratio in the object information 156 for the enlarged or reduced object.

In FIG. 20, steps S158 to S170 are the same as those in the first embodiment, and by these processes, the process of displaying the cursor on the corresponding coordinates and the process of erasing the cursor are executed. A part of this step may be replaced with the step of the second embodiment to display the marker. Specifically, by substituting step S158 with step S252 of FIG. 11, step S164 with step S254 of FIG. 11, and step S168 with step S256 of FIG. 11, the process of displaying the marker at the corresponding coordinates is performed.

An operation example of this embodiment will be described with reference to FIG. 21. FIG. 21A is an example of the work area W700 displayed on the display unit 110. The object S700 and the object S702 are displayed in the work area W700. Here, it is assumed that the object S700 and the object S702 are objects that are linked to each other. Further, the position operated by the user will be described as being displayed by a marker.

Here, as shown in FIG. 21A, it is assumed that the object S702 is pinched out outward by moving the finger H700 and the finger H702 of the hand in the direction of the arrow. In this case, as shown in FIG. 21B, the object S702 is enlarged and displayed as compared with that before the pinch-out operation is performed.

In the state shown in FIG. 21B, it is assumed that the user performs a pen operation P700 as a touch operation on the object S700. At this time, the control unit 100 calculates the corresponding coordinates corresponding to the position where the pen operation P700 is performed, and performs a process of displaying the marker M702 with respect to the corresponding coordinates. Therefore, the touch operation performed by the user on the object S700 is reflected in the object S702 by the control unit 100.

Note that FIG. 21B shows an operation example in which the marker M700 is displayed even at the position where the user has touched the touch. By doing so, the user on the explainer side can also confirm at which position the marker is identified and displayed.

Further, as shown in the marker M700 and the marker M702, the size (thickness) of the marker can be changed according to the scaling ratio of the object displaying the marker so that the display can be easily seen by the user. Even if the identification display is other than the marker such as a cursor or an underline, the size may be changed according to the scaling ratio of the object to be identified and displayed.

According to the present embodiment, when the display device 10 is browsing an object in which the user on the explainer side and the user on the other side are linked to each other, for example, only the user on the other side expands the object. Even if it is desired to be displayed, it is possible to display the cursor / marker at the position corresponding to the position touch-operated by the explainer-side object while magnifying and displaying only the other-side object. Therefore, the other user can see the cursor / marker display by the operation of the explainer at the same time while looking at the object displayed in his / her favorite size.

[8. Modification example]
Although the embodiment of the present invention has been described in detail with reference to the drawings, the specific configuration is not limited to this embodiment, and the design and the like within a range not deviating from the gist of the present invention are also within the scope of claims. include. Further, regarding the processing flow, other than the above description, the order of the steps may be changed or some steps may be omitted as long as there is no contradiction.

In addition, it goes without saying that the above-described embodiments can be executed in combination with each embodiment. For example, by combining the first embodiment and the second embodiment, the display device can identify and display the touch position by the cursor display or the marker display according to the user's selection.

Further, the program that operates in each device in the embodiment is a program that controls a CPU or the like (a program that causes a computer to function) so as to realize the functions of the above-described embodiment. Then, the information handled by these devices is temporarily stored in a temporary storage device (for example, RAM) at the time of processing, then stored in a storage device such as an HDD or SSD, and is read and corrected by the CPU as necessary. -Writing is performed.

Further, in the case of distribution to the market, the program can be stored and distributed in a portable recording medium, or transferred to a server computer connected via a network such as the Internet. In this case, it goes without saying that the storage device of the server computer is also included in the present invention.

10, 12 Display device 100 Control unit 110 Display unit 120 Touch detection unit 130 Image processing unit 140 Communication unit 150 Storage unit 152 File storage area 154 Sheet image data storage area 156 Object information 158 Object interlocking angle 160 Timeout time

Claims (12)

In a display device including a display unit for displaying an object, an operation detection unit for detecting an operation on the object, and a processing execution unit for executing a process in response to the operation.
When the second object is rotated after the second object based on the first object among the objects displayed on the display unit is duplicated, the first object and the second object are displayed. Equipped with an interlocking setting unit that sets
The processing execution unit is a display device characterized in that an operation detected for a first object is reflected as an operation for the second object. The interlocking setting unit is the first when the second object is rotated by a predetermined time after the second object based on the first object is duplicated. If the object and the second object are set as interlocking targets and the second object is rotated after the lapse of time, the first object and the second object are set as interlocking targets. The display device according to claim 1, wherein the display device is not provided. When the interlocking setting unit is operated to cancel the interlocking setting for either the first object or the second object, the interlocking setting unit is an interlocking target for the first object and the second object. The display device according to claim 1 or 2, wherein the setting of is released. The processing execution unit is
The operation position of the operation detected for the first object is converted into the operation position of the second object.
The identification is displayed according to the operation position of the second object.
The display device according to any one of claims 1 to 3, wherein the display device is characterized by the above. The display device according to claim 4, wherein the processing execution unit further performs identification display according to the operation position detected for the first object. The display device according to claim 4 or 5, wherein the processing execution unit displays the identification display in a size corresponding to the scaling factor of the object. The display device according to any one of claims 4 to 6, wherein the identification display is a cursor or a marker. The display device according to any one of claims 1 to 3, wherein the detected operation is a touch operation, a drawing operation, an enlargement / reduction operation, or a page feed operation. The eighth aspect of the present invention is characterized in that the processing execution unit reflects the operation detected for the first object as an operation for the second object and also reflects the operation for the first object. The display device described. The processing execution unit according to any one of claims 1 to 9, wherein when the detected operation is a predetermined operation, the processing execution unit executes the processing on the object in which the operation is detected. The display device described. A display method including a display step for displaying an object, an operation detection step for detecting an operation on the object, and a process execution step for executing a process according to the operation.
If the second object is rotated after the second object based on the first object among the objects displayed by the display step is duplicated, the first object and the second object Including the interlocking setting step to set the interlocking target
The processing execution step is a display method characterized in that an operation detected for a first object is reflected as an operation for the second object. On the computer
It is a program that realizes a display function for displaying an object, an operation detection function for detecting an operation on the object, and a process execution function for executing a process in response to the operation.
When the second object is rotated after the second object based on the first object among the objects displayed by the display function is duplicated, the first object and the second object are displayed. Realizes the interlocking setting function that sets as the interlocking target,
The processing execution function is a program characterized in that an operation detected for a first object is reflected as an operation for the second object.

Images