JP6168406B2 - Object operation system, control program, and control method - Google Patents

Description

  The present invention relates to an object operation system, a control program, and a control method, and more particularly, to an object operation system capable of displaying and operating an object, and a control program and control method that enable cancellation of an operation performed on the object.

  In recent years, an electronic conference or the like that uses a display screen (referred to as a shared screen) that can be used by a plurality of users and writes and discusses display elements (hereinafter referred to as objects) such as characters, graphics, and images on the shared screen. Has been done. In such a shared screen, a plurality of users can write various objects, delete the written objects, and move the objects to arbitrary locations in the shared screen. Some shared screens can store an operation history and perform an editing operation such as an operation to cancel the previous operation and return it to the original (called an undo operation) based on the operation history.

  Regarding the editing operation based on such an operation history, for example, Patent Document 1 listed below discloses an information processing method for providing a virtual space that can be accessed simultaneously by a plurality of users using at least one information processing apparatus including a display unit. The information processing apparatus draws an object in the virtual space on the display unit, and the information processing apparatus displays history information of an operation performed on the object by a user in the virtual space. Storing the information in a storage unit disposed inside or outside the apparatus, and the history information includes information on a position in the virtual space where the user performed an operation on the object, and the information processing apparatus includes: In response to an instruction to cancel the operation from the user, a first viewing range that is a range in the virtual space that the user visually recognizes is displayed. And a step in which the information processing apparatus extracts the history information in which the position of the object that is the target of the operation is included in the first viewing range as the candidate for canceling the operation. ing.

JP 2010-113539 A

  In a situation where multiple users operate objects and collaborate, if you want to cancel the last operation performed by one user, cancel the operation performed by another user by performing an Undo operation on the entire shared screen. May interfere with collaborative work.

  With respect to this problem, Patent Document 1 proposes a method for designating a user's work area or Undo range. However, it is difficult to remember what operation was performed at what timing for the object displayed in which location, so if you specify the region and perform the Undo operation, the operation will be canceled. If the specified area contains an unintended object, the unintended operation may be undone, and the operation cannot be canceled as the user intended. It was.

  The present invention has been made in view of the above problems, and a main object of the present invention is to provide an object operation system, a control program, and a control method that can appropriately cancel an operation that deletes or moves an object. is there.

One aspect of the present invention includes a display unit that displays an object, an operation unit, and a control unit that controls the display unit and the operation unit, and the control unit is an object displayed on the display unit When an operation for deleting or moving is performed, operation history information that associates the object information with the display position of the object is created and stored, and an operation for designating an area on the display unit is detected. , Referring to the operation history information, identifying an object that has been deleted or moved from the specified area, displaying the trace of the identified object in an operable manner at the display position, and performed the identified object A text indicating an operation content or an icon schematically indicating the specified object is displayed as a trace of the object .

One aspect of the present invention is a control program that operates in a control unit that controls a display unit that displays an object and an operation unit, and deletes or moves the object displayed on the display unit to the control unit. When an operation is performed, a first process of creating and storing operation history information in which the object information and the display position of the object are associated with each other, and detecting an operation for designating an area on the display unit, A second process for identifying an object deleted or moved from the designated area with reference to the operation history information; and a third process for displaying the trace of the identified object at the display position so as to be operable. In the third process, text indicating the content of an operation performed on the specified object or an icon schematically indicating the specified object is displayed on the icon. It is displayed as traces of objects and wherein the Rukoto.

One aspect of the present invention is a control method in a system including a display unit that displays an object, an operation unit, and a control unit that controls the display unit and the operation unit, and is displayed on the display unit. A first process for creating and storing operation history information in which the object information and the display position of the object are associated with each other when an operation for deleting or moving the object is performed, and an area on the display unit When an operation to be specified is detected, a second process for specifying an object deleted or moved from the specified area with reference to the operation history information, and a trace of the specified object is displayed at the display position so as to be operable. 3 and processing is executed, and the third process, objects text or the particular showing the contents of the made to the identified object operation An icon showing expression manner, and displaying the trace of the object.

  According to the object operation system, the control program, and the control method of the present invention, an operation that deletes or moves an object can be canceled appropriately.

  The reason is that the control unit (control program) of the object operation system identifies an object that has been deleted or moved from the designated area by referring to the operation history information stored in advance when an operation for designating the area is performed, This is because the trace of the identified object is displayed so as to be operable at the display position of the object so that the operation of deleting or moving the desired object can be canceled.

It is a figure which shows typically the structure of the object operation system which concerns on one Example of this invention. It is a figure which shows typically the other structure of the object operation system which concerns on one Example of this invention. It is a figure which shows typically the other structure of the object operation system which concerns on one Example of this invention. It is a figure which shows typically the other structure of the object operation system which concerns on one Example of this invention. It is a block diagram which shows the structure of the object operation system which concerns on one Example of this invention. It is an example of the operation history management table which concerns on one Example of this invention. It is an example of the operation definition table which concerns on one Example of this invention. It is an example of the operation definition method which concerns on one Example of this invention. It is a flowchart figure which shows the whole operation | movement of the object operation system which concerns on one Example of this invention. It is a flowchart figure which shows the operation | movement (object trace display process) of the object operation system which concerns on one Example of this invention. It is a figure which shows the conventional area | region designation | designated operation typically. It is a figure which shows an example of the trace display of the deleted object which concerns on one Example of this invention. It is a figure which shows the other example of the trace display of the deleted object which concerns on one Example of this invention. It is a figure which shows an example of the display of the trace of the deleted object and operation content which concern on one Example of this invention. It is a figure which shows an example of the icon display as a trace of the deleted object which concerns on one Example of this invention. It is a figure which shows the other example of the icon display as a trace of the deleted object which concerns on one Example of this invention. It is a figure which shows an example of the display of the trace of the deleted object and Undo instruction | indication button which concern on one Example of this invention. It is a figure which shows an example of the trace display of the moved object which concerns on one Example of this invention.

  As shown in the background art, in a system in which a plurality of users operate an object on a shared screen, a deletion or movement operation may be canceled in order to restore an object deleted or moved by a certain user. In this case, if an Undo operation is performed on the entire screen, another user's operation may be canceled. Therefore, a method of specifying an area and undoing the operation in the specified area is used.

  Here, when you specify an area, you must specify the area where the deleted or moved object was displayed, but you can remember what operation was performed at what timing on the displayed object Therefore, it is difficult to specify the area properly, and there is a possibility that an operation on an unintended object may be canceled, and a desired deletion or movement operation cannot be canceled appropriately. It was.

  Therefore, in one embodiment of the present invention, in order to be able to appropriately specify the area where the deleted or moved object is displayed, the trace of the deleted or moved object (the deleted or moved object is located at the location). Information that allows the user to identify what happened). In that case, it is difficult to specify the area if the trace of the object is displayed on the entire shared screen, the trace of the object that is the target of all previous operations, or the trace of the object is always displayed. Since the visibility of other objects deteriorates, when an area is specified, the object displayed in the specified area within the specified time or deleted from the specified area with the specified number of operations Alternatively, the moved object is specified, and the trace of the specified object is displayed for a predetermined time.

  Accordingly, it is possible to specify an area so as to include an object that is a target of deletion or movement and not include an object that is a target of an unintended operation. In addition, a desired deletion or movement operation can be canceled without interfering with an object operation of another user.

  In order to describe the above-described embodiment of the present invention in more detail, an object operation system, a control program, and a control method according to an embodiment of the present invention will be described with reference to FIGS. 1 to 4 are diagrams schematically showing the configuration of the object operation system according to the present embodiment, and FIG. 5 is a block diagram showing the configuration of the object operation system. 6 to 8 are examples of information referred to by the object operation system according to the present embodiment, and FIGS. 9 and 10 are flowcharts illustrating the operation of the object operation system. FIG. 11 is a diagram schematically illustrating a conventional region designation operation, and FIGS. 12 to 18 are diagrams schematically illustrating a region designation operation according to the present embodiment.

  The present invention is applicable to both cases where there is one operator and a plurality of operators. In this embodiment, a system having a shared work area that can be operated by a plurality of operators will be described. There are four possible forms of this system. As shown in FIG. 1, the first form includes a touch panel having a display unit 40 that displays an object and an operation unit 50 that operates the object, and a control unit 20 that controls the display unit 40 and the operation unit 50. It is the form comprised with the apparatus united. In the second embodiment, as shown in FIG. 2, a touch panel having a display unit 40 and an operation unit 50 and a control unit 20 that controls the display unit 40 and the operation unit 50 are configured separately, and these are wired. Or it is a form connected by radio | wireless. In the third embodiment, as shown in FIG. 3, a device in which the display unit 40 and the control unit 20 are integrated and an operation unit 50 that sends an operation signal to the control unit 20 in a wired or wireless manner are separately provided. It is the form comprised by. As shown in FIG. 4, the fourth mode is a mode in which the display unit 40, the operation unit 50, and the control unit 20 are configured separately and are connected by wire or wirelessly. Hereinafter, in order to simplify the description, the description will be made on the premise of the first embodiment of FIG.

  The object operation system 10 of this embodiment is a display panel, an electronic blackboard, a tablet terminal, a notebook computer device, or the like having a calculation function. As shown in FIG. 5A, the control unit 20 and the storage unit 30 are used. And the display unit 40 and the operation unit 50.

  The control unit 20 includes a CPU (Central Processing Unit) 21 and a memory such as a ROM (Read Only Memory) 22 and a RAM (Random Access Memory) 23. The CPU 21 receives a control program from the ROM 22 and the storage unit 30. The entire operation of the object operation system 10 is controlled by calling and developing the program in the RAM 23 and executing it. Further, as shown in FIG. 5B, the control unit 20 also functions as a screen state change unit 20a, a user operation interpretation unit 20b, and an operation history management unit 20c.

  The screen state changing unit 20a displays the object on the display unit 40 according to the content of the user operation interpreted by the user operation interpreting unit 20b. In addition, when an instruction to display the menu screen for the displayed object is given, a menu screen or the like that enables selection of processing (generation, editing, movement, deletion, Undo, etc.) that can be executed for the object is displayed. To do. Further, when the user operation interpretation unit 20b detects an operation for designating an area and the operation history management unit 20c identifies an object displayed in the designated area, the identified object is identified according to an instruction from the operation history management unit 20c. Information that can be identified, for example, an image obtained by subjecting the image of the object to image processing for changing one or more of transparency, hue, and size, text indicating the content of the operation, or a specific object Icons and the like (these are collectively referred to as object traces) are displayed. Further, in accordance with an instruction from the operation history management unit 20c, an instruction means (Undo instruction) for canceling an operation performed on the identified object and a type of the operation performed on the identified object in association with the trace of the object. Button).

  The user operation interpretation unit 20b interprets a user operation performed by the operation unit 50. In addition, when an operation that needs to manage the history of an object (in this embodiment, a deletion or movement operation) is performed, the operation history management unit 20c is instructed to perform history management related to the operation. When an operation for designating an area is performed, the operation history management unit 20c is instructed to specify the object displayed in the designated area. In addition, when a predetermined time elapses after the timer provided in the control unit 20 is monitored and an operation for designating an area is detected, and the Undo operation for the designated area is not instructed, the screen state The change unit 20a is instructed to erase the display of the object trace.

  When the user operation interpretation unit 20b detects an operation that needs to manage the history, the operation history management unit 20c creates a table (operation history management table described later) describing the operation history information, and stores the storage unit 30. To remember. Further, when the user operation interpretation unit 20b detects an operation for designating an area, an object deleted or moved from the designated area (preferably, deleted or moved within a predetermined time with reference to the operation history management table). And / or an object deleted or moved from the designated area by an operation within a predetermined number of times) and instructing the screen state changing unit 20a to display the trace of the specified object.

  The screen state changing unit 20a, the user operation interpreting unit 20b, and the operation history managing unit 20c may be configured as hardware, or the control unit 20 may be configured as the screen state changing unit 20a, the user operation interpreting unit 20b, and the operation. The software may be configured as software (control program) that functions as the history management unit 20c, and the control program may be executed by the CPU 21.

  The storage unit 30 includes a memory, an HDD (Hard Disk Drive), an SSD (Solid State Drive), and the like, and stores the contents of the operation performed by the operation unit 50 and the information of the object displayed on the display unit 40. In addition, the above-described operation history management table and the like are stored.

  The display unit 40 includes an LCD (Liquid Crystal Display), an organic EL (Electro Luminescence) display, and the like, and provides a shared work area where a plurality of operators can operate the object. The operation unit 50 includes a touch sensor including a grid-like electrode disposed on the display unit 40, a hard key, and the like, and receives various operations on the object. The display unit 40 and the operation unit 50 constitute a touch panel.

  Next, an operation history table managed by the operation history management unit 20c will be described. FIG. 6 is an example of the operation history management table. The operation time, operation name (operation type), operation parameters, information for specifying whether or not to display a trace, and a trace are displayed. The display coordinates and the like of the trace when displaying are stored in association with the object information. The operation parameters include the coordinates of the generated object when the operation type is an object generation, and the destination coordinates when the operation type is an object movement. FIG. 7 is an example of the operation definition table, and defines an operation corresponding to the operation name in the operation history management table. In the operation definition table, an operation definition method, presence / absence of trace display, trace display coordinates, and the like are described. FIG. 8 is an example of the operation definition method, and defines the operation definition method in the operation definition table.

  When an operation is input, the operation definition table in FIG. 7 is referred to, and an operation definition method for processing the operation, necessity / unnecessity of trace display, and trace display coordinates are acquired. An operation definition method for processing an operation is referred to by name as shown in FIG. After the operation processing, the operation history is stored in the operation history management table shown in FIG. When an area is designated, the seventh column (trace display coordinates) of the operation history management table of FIG. 6 is searched, and an operation included in the area for which the trace display coordinates are designated becomes a trace display candidate.

  Hereinafter, a control method using the object operation system 10 having the above configuration will be described. The CPU 21 executes the processing shown in the flowcharts of FIGS. 9 and 10 by developing the control program stored in the ROM 22 or the storage unit 30 in the RAM 23 and executing it. In the following description, an object displayed on the display unit 40 (touch panel) is previously deleted or moved, and the history of the operation is registered in the operation history management table of FIG. To do. In addition, regarding the display of traces, an image of the object is displayed, an annotation (type of operation, etc.) is displayed together with the image, text indicating the content of the operation, and an icon schematically indicating the object that is the target of the operation It is assumed that the type of display can be set, and the trace display type is set in advance by the user.

  First, the control unit 20 (user operation interpretation unit 20b) determines whether the operation performed by the user is an area designation operation (S101). When the user operation is not an area specifying operation, the control unit 20 (user operation interpretation unit 20b) determines the operation, and the control unit 20 (screen state change unit 20a) determines the determined operation (for example, object generation or editing). , Movement, deletion, Undo, etc.), the screen state is changed (S111).

  On the other hand, when the user operation is an area designation operation, the control unit 20 (operation history management unit 20c) refers to the operation history management table of FIG. 6 and searches for an operation history in the designated area (S102). It is determined whether there is an operation for moving the object displayed in the area outside the designated area or an operation for deleting the object displayed in the designated area (S103). Specifically, it is determined whether the coordinates specified in the trace display coordinate field of the operation history management table in FIG. 6 are within the designated area. If the coordinates are within the designated area, the coordinates are displayed as the trace display coordinates. It is determined whether the corresponding operation name is “Move” or “Delete”. Then, the control unit 20 (operation history management unit 20c) determines that there is no operation for moving the object displayed in the designated area out of the designated area and the operation for deleting the object displayed in the designated area. In this case, the control unit 20 performs processing corresponding to the region designation operation (for example, selects an object in the designated region as an operation target, and edits, moves, (Delete, Undo, etc. are executed) (S111).

  On the other hand, the control unit 20 (operation history management unit 20c) determines that there is an operation for moving the object displayed in the designated area outside the designated area or an operation for deleting the object displayed in the designated area. In this case, the object moved or deleted from the designated area is specified, and the control unit 20 (screen state changing unit 20a) displays the trace of the specified object in accordance with the instruction from the operation history management unit 20c (S104). At that time, if the traces of all the objects displayed in the designated area in the past are displayed, it becomes difficult to designate the area, and the visibility of other objects may be deteriorated. The operation history management unit 20c) refers to the time information in the operation history management table, refers to the object moved or deleted from the specified area within a predetermined time, and / or the order recorded in the operation history management table. It is also possible to specify an object that has been moved or deleted from the designated area by an operation within a predetermined number of times.

  FIG. 10 shows details of the trace display processing of the object, and the control unit 20 (user operation interpretation unit 20b) determines whether another user operation for designating an area is performed (S201). If no area is designated, the process skips to S203, and if another area is designated, a display color that is not used in another designated area is determined (S202). Note that the processing in S201 and 202 is performed in order to prevent mixing when a plurality of areas are designated and object traces are displayed in the plurality of designated areas, and is not essential. For example, when a plurality of designated areas are sufficiently separated from each other, there is a low possibility that the traces of the object are mixed, and therefore the processing of S201 and 202 may be omitted. In addition, here, the display color of the object is changed when a plurality of areas are specified. However, for example, the transparency, hue, size, etc. of the object may be changed. What is necessary is just to determine a hue, a size, etc.

  Next, the control unit 20 (screen state changing unit 20a) determines whether the trace display type setting is an image (S203), and if it is set to an image, the transparency, An image subjected to image processing for changing one or more of hue and size is displayed as a trace (S204). Next, the control unit 20 (screen state changing unit 20a) determines whether or not the trace display type setting is annotation addition (S205). If the annotation display is not set to annotation addition, the process ends and annotation addition is performed. If set, an annotation of the operation content such as the operation type is displayed (S206). In S203, when the trace display type setting is not an image, the control unit 20 (screen state changing unit 20a) displays text indicating the content of the operation or an icon schematically indicating the object that is the target of the operation. Display (S207), and the process ends.

  Returning to the flowchart of FIG. 9, the control unit 20 (user operation interpretation unit 20 b) starts a timer count (S 105) and detects an operation for designating an area (or displays an object trace). After that, it is determined whether or not a predetermined time has elapsed (S106). If the predetermined time has not elapsed, an operation for canceling a predetermined trace display (for example, an operation of pressing and holding a trace of an object, etc.) ) Is determined (S107). When the predetermined time has elapsed in S106, or when the trace display canceling operation is performed in S107, the control unit 20 (screen state changing unit 20a) cancels the display of the trace of the object (S110), The process ends. In this way, when a predetermined time has elapsed since the operation for designating the area has been detected, the display of the trace of the object is deleted, thereby causing the occurrence of a malfunction such as deterioration of the visibility of other objects. Can be prevented.

  If the trace display cancel operation has not been performed in S107, the control unit 20 (user operation interpretation unit 20b) has performed an Undo operation on the trace of the object displayed in the designated area (for example, on the trace of the object). On the other hand, whether or not Undo has been instructed on the displayed menu screen is determined (S108), and if an Undo operation has not been performed on the trace of the object, the process returns to S106 and the elapse of a predetermined time is monitored. On the other hand, when an Undo operation is performed on an object trace, the control unit 20 (screen state changing unit 20a) cancels the deletion or movement operation performed on the object displayed in the designated area. The deleted object is restored or moved and displayed at the position before the movement (S109). Thereafter, the control unit 20 (screen state changing unit 20a) cancels the display of the trace of the object (S110) and ends the series of processes.

  Hereinafter, the process will be specifically described using a screen on which an object is displayed. Here, in order to facilitate understanding, the number of objects is three, each object is indicated by a simple rectangle, and the hatching type is changed to distinguish the three objects.

  As shown in FIG. 11A, in a state where three objects A to C are displayed on the screen, a predetermined user can perform operations (here, “Create”, “ It is assumed that a menu screen showing “Edit”, “Delete”, and “Undo” is displayed, and “Delete” is selected from the menu screen to delete the object A. Here, when the object A is deleted and then the deletion operation is undone to restore the object A, the operation can be undone once for the entire screen. However, when a plurality of users are operating an object, if there is an object operation of another user performed after deletion of the object A performed by a predetermined user, the object operation of the other user is undoed. The object A cannot be restored.

  Therefore, when a plurality of users operate an object, a region where the object A has been deleted is designated, and Undo is instructed to the region without affecting other users' operations. Only user operations can be undone. However, if the time has elapsed since the deletion operation of the object A, it is difficult to specify the area from which the object A has been deleted, and the area from which the object A has been deleted as shown in FIG. If a non-part is specified and Undo is instructed, the object A cannot be restored, and if another object operation has been performed in the specified area, the object operation is undoed. Problems occur.

  Therefore, in this embodiment, when an operation for designating an area is performed, a trace of an object to be operated in the area is displayed so that the area can be appropriately designated. FIG. 12 shows an example of this. When the touch position is moved and an area defined by the start point and end point of the touch position (area indicated by a one-dot chain line in the figure) is specified, the area is a target for the deletion operation. If the trace display type setting is an image, the trace of the object (here, object A) is subjected to image processing that changes its transparency, hue, size, etc. To do. Here, it is shown that the transparency and the hue are changed by changing the type of the frame line and the type of hatching. After confirming that the trace of the object is displayed in the specified area in this way, restore the desired object by instructing Undo for the specified area (or trace of the object) Can do.

  In the above operation, if there is no object to be deleted in the designated area, the trace of the object is not displayed, so the user designates another area, and when the trace of the desired object is displayed in the designated area, By instructing Undo for the designated area or the trace of the object, the desired object can be restored. Also, if there are multiple objects in the specified area, the traces of the multiple objects are displayed, so you can respecify the area so that only the traces of the desired object are displayed, and A desired object can be restored by instructing Undo or instructing Undo only for the trace of the desired object.

  Further, in the operation for designating an area, as shown in FIG. 13A, there may be a case where a part of the object that is the object of the deletion operation is included in the designated area. In such a case, the trace of the object may not be displayed, or as shown in FIG. 13B, the entire trace of the object is displayed (the trace of the object is displayed outside the designated area). Alternatively, as shown in FIG. 13C, only the portion of the object trace that overlaps the designated area may be displayed. In the case of FIG. 13B or FIG. 13C, when Undo is instructed to the designated area, the entire object may be restored, or the entire trace of the object may be restored. The object may not be restored unless the area is redesignated to include it.

  In FIG. 12, only the trace of the object that is the object of the deletion operation is displayed. However, only the trace of the object does not know whether the object has been deleted or moved. There are cases where the user cannot determine whether or not there is. In such a case, if the trace display type setting is set to annotation addition, the operation history management unit 20c refers to the operation history management table of FIG. As shown in FIG. 14, it is possible to display the content of the specified operation (here “Delete”) in association with the trace of the object (for example, in the vicinity of the trace of the object).

  12 to 14 show the trace of the object, it is only necessary to be able to specify the object to be deleted or moved. Therefore, if the trace display type setting is not set to the image, the operation history management unit 20c refers to the operation history management table of FIG. 6 to identify the operation content (operation name), operation time, and the like. The contents of the performed operation and the operation time can be displayed as text. Further, as shown in FIG. 15, a graphic such as an icon schematically showing the object to be deleted can be displayed at the position where the object to be deleted was displayed.

  Here, when displaying text, icons, etc. (referred to as icons, etc.) indicating the content and time of operation, not the trace of the deleted object itself, the size of the object is different from the size of the icon. In this case, if an area is specified so as to surround the entire object to be deleted, an icon or the like indicating the trace of the object may be displayed, but as shown in FIG. When the area is specified so as to overlap a part of the formed object and include the entire display area such as the icon, the entire icon or the like may be displayed as shown in FIG. As shown in FIG. 16 (c), icons or the like may be displayed in a deformed manner according to the shape of the object overlapping the designated area, or the icons or the like may not be displayed as shown in FIG. 16 (d). May be. In addition, as shown in FIG. 16E, when an area is specified so as to overlap a part of the deleted object and a part of the display area such as an icon, as shown in FIG. In addition, the entire icon or the like may be displayed, as shown in FIG. 16 (g), the icon or the like may be displayed only in a portion overlapping the designated area, or as shown in FIG. 16 (h). An icon or the like need not be displayed.

  12 and 13 display only the trace of the object to be deleted, FIG. 14 displays the trace of the object to be deleted and the contents of the operation, and FIGS. 15 and 16 indicate the deletion target. An icon or the like that schematically shows the object that has been displayed is displayed, but instead of or in addition to these, as shown in FIG. 17, it is associated with the object to be deleted (for example, the object to be deleted) It is also possible to display means for instructing Undo (such as an Undo instruction button) in the vicinity of the object. By displaying such an Undo instruction button, after specifying the area, you can display the menu screen etc., and you can simplify the operation compared to instructing the Undo operation from within the menu screen, User convenience can be improved.

  12 to 17 describe the case of undoing the operation of deleting the object, the operation of moving the object can be undoed. Also in this case, as shown in FIG. 18, when an object to be moved (here, object A) is displayed in the designated area, a trace of the object to be moved is displayed in the designated area. . When Undo is instructed for the designated area (or the trace of the object, etc.), the object moving operation is undoed and the object A is displayed at the original position.

  In this way, when the user performs an operation to specify an area, if the deleted or moved object is displayed in the specified area, the trace of the object is displayed or the operation is performed on the trace of the object. Is added to the object trace, the Undo instruction button is added to the object trace, or the text or icon is displayed instead of the object trace. Thereby, the user can cancel the operation of deleting or moving a desired object. In addition, even when a plurality of users operate an object at the same time, it is possible to cancel only a desired operation of a predetermined user without interfering with the object operation of another user by appropriately designating an area. Become.

  In addition, this invention is not limited to the said Example, The structure and control can be changed suitably, unless it deviates from the meaning of this invention.

  For example, in the above embodiment, when the user performs an operation of specifying an area and an object that is to be deleted or moved is displayed in the specified area, the trace of the object is displayed. It may be possible to select whether or not to display the trace, and the trace of the object may be displayed only when the user sets to display the trace of the object.

  Further, in the above embodiment, it is assumed that one user is performing the operation. However, if the designated area is different, even if a plurality of users perform the operation simultaneously, The control of the present invention can be applied.

  In the above embodiment, the case where the object is operated on the touch panel has been described. However, the present invention can be similarly applied to the case where the object is operated using an operation unit such as a laser mouse. In that case, the area can be specified by left-clicking the mouse and moving the cursor, and the menu screen can be displayed by right-clicking with the cursor placed in the area or on the trace of the object. The desired operation can be canceled by selecting the undo operation on the menu screen with the mouse.

  In the above embodiment, the object is described as a rectangular figure, but the form of the object is arbitrary, and the method of the present invention is similarly applied to figures, images, photographs, text, etc. of any shape. can do.

  The present invention relates to a system capable of operating objects such as characters and graphics, in particular, a system in a system capable of joint operation by a plurality of operators, a control program operating in the system, and a recording medium recording the control program And a control method for controlling display and operation of objects in the system.

DESCRIPTION OF SYMBOLS 10 Object operation system 20 Control part 20a Screen state change part 20b User operation interpretation part 20c Operation history management part 21 CPU
22 ROM
23 RAM
30 storage unit 40 display unit 50 operation unit

Claims (24)

A display unit that displays an object; an operation unit; and a control unit that controls the display unit and the operation unit.
The controller is
When an operation for deleting or moving the object displayed on the display unit is performed, operation history information in which the object information and the display position of the object are associated is created and stored, and the display unit When the operation for designating the area is detected, the operation history information is referred to, the object deleted or moved from the designated area is identified, and the trace of the identified object is displayed at the display position so as to be operable ,
Displaying text indicating the content of an operation performed on the identified object or an icon schematically showing the identified object as a trace of the object ;
An object operation system characterized by that. The controller is
The operation history information is stored in order in association with the time when the operation for deleting or moving the object is performed, and when an operation for designating an area on the display unit is detected, referring to the operation history information, Identifying an object deleted or moved from the specified area within a predetermined time and / or an object deleted or moved from the specified area by a predetermined number of operations;
The object operation system according to claim 1. The controller is
Displaying the type of operation performed on the identified object in association with the trace of the object;
The object operation system according to claim 1, wherein the object operation system is an object operation system. A display unit that displays an object; an operation unit; and a control unit that controls the display unit and the operation unit.
The controller is
When an operation for deleting or moving the object displayed on the display unit is performed, operation history information in which the object information and the display position of the object are associated is created and stored, and the display unit When the operation for designating the area is detected, the operation history information is referred to, the object deleted or moved from the designated area is identified, and the trace of the identified object is displayed at the display position so as to be operable,
Displaying the type of operation performed on the identified object in association with the trace of the object;
An object operation system characterized by that . The controller is
An image obtained by performing image processing for changing one or more of transparency, hue, and size on the image of the identified object is displayed as a trace of the object.
The object operation system according to claim 4 . The controller is
Displaying instruction means for canceling an operation performed on the identified object in association with the trace of the object;
The object operation system according to claim 1, wherein the object operation system is an object operation system. The controller is
When displaying the trace of the object for a plurality of designated areas, change the display color of the trace for each of the designated areas,
The object operation system according to any one of claims 1 to 6, wherein The controller is
If a predetermined time has elapsed after detecting an operation for designating the area, the display of the trace of the object is deleted.
The object operation system according to claim 1, wherein the object operation system is an object operation system. A control program that operates in a control unit that controls a display unit and an operation unit that display objects,
In the control unit,
A first process for creating and storing operation history information associating the information of the object and the display position of the object when an operation for deleting or moving the object displayed on the display unit is performed;
A second process for identifying an object deleted or moved from the designated area with reference to the operation history information when an operation for designating the area on the display unit is detected;
Performing a third process for operably displaying the trace of the identified object at the display position ;
In the third process,
The icon that schematically shows the text or the specified object indicating the contents of the made to the identified object manipulation, that displays as traces of the object,
A control program characterized by that. In the first process,
In association with the operation history information, the time when the operation for deleting or moving the object is performed is stored in order,
In the second process,
When an operation for designating an area on the display unit is detected, the operation history information is referred to, and an object deleted or moved from the designated area within a predetermined time and / or specified by an operation within a predetermined number of times. Identify objects that have been deleted or moved from the region,
The control program according to claim 9. In the third process,
Displaying the type of operation performed on the identified object in association with the trace of the object;
The control program according to claim 9 or 10, wherein: A control program that operates in a control unit that controls a display unit and an operation unit that display objects,
In the control unit,
A first process for creating and storing operation history information associating the information of the object and the display position of the object when an operation for deleting or moving the object displayed on the display unit is performed;
A second process for identifying an object deleted or moved from the designated area with reference to the operation history information when an operation for designating the area on the display unit is detected;
Performing a third process for operably displaying the trace of the identified object at the display position;
In the third process,
Displaying the type of operation performed on the identified object in association with the trace of the object;
A control program characterized by that . In the third process,
An image obtained by performing image processing for changing one or more of transparency, hue, and size on the image of the identified object is displayed as a trace of the object.
The control program according to claim 12 , wherein: In the third process,
Displaying instruction means for canceling an operation performed on the identified object in association with the trace of the object;
The control program according to any one of claims 9 to 13, In the third process,
When displaying the trace of the object for a plurality of designated areas, change the display color of the trace for each of the designated areas,
The control program according to any one of claims 9 to 14, wherein In the third process,
If a predetermined time has elapsed after detecting an operation for designating the area, the display of the trace of the object is deleted.
The control program according to any one of claims 9 to 15, wherein: A control method in a system including a display unit that displays an object, an operation unit, and a control unit that controls the display unit and the operation unit,
A first process for creating and storing operation history information that associates the information of the object and the display position of the object when an operation for deleting or moving the object displayed on the display unit is performed;
When an operation for designating an area on the display unit is detected, a second process for specifying an object deleted or moved from the designated area with reference to the operation history information;
Performing a third process for operably displaying the trace of the identified object at the display position ;
In the third process,
Displaying text indicating the content of an operation performed on the identified object or an icon schematically showing the identified object as a trace of the object ;
A control method characterized by that. In the first process,
In association with the operation history information, the time when the operation for deleting or moving the object is performed is stored in order,
In the second process,
When an operation for designating an area on the display unit is detected, the operation history information is referred to, and an object deleted or moved from the designated area within a predetermined time and / or specified by an operation within a predetermined number of times. Identify objects that have been deleted or moved from the region,
The control method according to claim 17. In the third process,
Displaying the type of operation performed on the identified object in association with the trace of the object;
The control method according to claim 17 or 18, characterized in that: A control method in a system including a display unit that displays an object, an operation unit, and a control unit that controls the display unit and the operation unit,
A first process for creating and storing operation history information that associates the information of the object and the display position of the object when an operation for deleting or moving the object displayed on the display unit is performed;
When an operation for designating an area on the display unit is detected, a second process for specifying an object deleted or moved from the designated area with reference to the operation history information;
Performing a third process for operably displaying the trace of the identified object at the display position;
In the third process,
Displaying the type of operation performed on the identified object in association with the trace of the object;
A control method characterized by that . In the third process,
An image obtained by performing image processing for changing one or more of transparency, hue, and size on the image of the identified object is displayed as a trace of the object.
The control method according to claim 20 , wherein: In the third process,
Displaying instruction means for canceling an operation performed on the identified object in association with the trace of the object;
The control method according to any one of claims 17 to 21, characterized in that: In the third process,
When displaying the trace of the object for a plurality of designated areas, change the display color of the trace for each of the designated areas,
The control method according to any one of claims 17 to 22, wherein In the third process,
If a predetermined time has elapsed after detecting an operation for designating the area, the display of the trace of the object is deleted.
The control method according to any one of claims 17 to 23, wherein:

Images