JP2008281715A - Display control apparatus and display control method - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To reproduce recorded contents desired by a user in an easy-to-understand manner in a display control apparatus for reproducing the recorded contents on a display apparatus. <P>SOLUTION: The display control apparatus includes at least: an acquisition means which acquires, from a recording apparatus connected with a display apparatus for recording contents of a change when contents are changed in a drawing area for drawing an object on the display apparatus, information about the contents of the change; an input means for inputting a first condition to extract, from the information acquired by the acquisition means, information to be used for reproducing the contents; and a playback means for extracting information which satisfies the first condition from the information acquired by the acquisition means and continuously reproducing the contents on the display apparatus using the extracted information. <P>COPYRIGHT: (C)2009,JPO&INPIT

Description

  The present invention relates to a display control technique for reproducing recorded content recorded on a recording device on a display device.

  Application for causing a display device to function as an electronic whiteboard in a display control system in which a display device provided with a digitizer and a display control device that receives the output from the digitizer and controls the display of the display device are connected Is generally known.

  The application is generally called an electronic whiteboard application. By using the application, drawing objects such as characters and diagrams can be drawn on the display screen of the display device using a digitizer pen.

  Electronic whiteboard applications are used, for example, in meetings when visual explanations are performed while annotating materials displayed on the electronic whiteboard, or when conference participants perform brainstorming jointly. .

  In general, in such an electronic whiteboard application, information (operation information) related to an operation performed by the user during execution of the electronic whiteboard application, sound, and the like can be recorded. When an object is drawn by the operation, information about the drawing object (drawing object information) can be recorded. Then, by using the reproduction function, the recorded content can be reproduced as past conference information.

  However, since these recorded contents recorded as conference information are enormous, there is a problem that it takes much time for the user to review the recorded contents.

  For this reason, conventionally, proposals have been made to display an enormous amount of recorded content recorded as conference information in an easy-to-view manner for the user. For example, Patent Literature 1 proposes a display control system that displays a speech time zone of each participating member during a conference and the content of the speech on a screen using a conference time axis. According to this document, the content of a statement is displayed in a list on the screen along the conference time axis. By replaying, it is possible to review the conference information efficiently.

Further, Patent Document 2 proposes a display control system capable of reproducing a drawn object such as a drawn character or figure and a voice uttered when the drawn object is synchronously reproduced. . According to this document, a user can search for desired utterance contents based on a list of drawing contents, and reproduce the utterance contents according to a time zone in which the drawing contents are recorded. Can be played.
JP-A-6-266632 JP 2003-260896 A

  However, in the case of the reproduction methods of Patent Documents 1 and 2, it is necessary to look at the contents of the remarks and the drawing contents displayed on the screen and find out the recorded contents to be reproduced by the user. There is a problem that the burden is large.

  On the other hand, for example, it is conceivable that the recorded content that the user wants to reproduce is extracted by keyword search, and the extracted recorded content is reproduced according to the user's designation. The playback result is not continuous. For this reason, there exists a problem that it is difficult for a user to grasp | ascertain the content of a meeting.

  The present invention has been made in view of the above problems, and an object of the present invention is to make it possible for a display control device capable of reproducing recorded content on a display device to reproduce the user-desired recorded content in an easy-to-understand manner. And

In order to achieve the above object, a display control apparatus according to the present invention has the following configuration. That is,
A display control device connected to the display device,
A recording device connected to the display device, and at least the content of the change from the recording device that records the content of the change when the drawing content changes in the drawing area for drawing the object on the display device An acquisition means for acquiring information about,
Input means for inputting a first condition for extracting information used for reproduction of the drawing content from the information acquired by the acquisition means;
Reproducing means for extracting information satisfying the first condition from the information obtained by the obtaining means, and continuously reproducing the drawing contents on the display device using the extracted information.

  According to the present invention, in a display control apparatus capable of reproducing recorded contents on a display device, the user-desired recorded contents can be reproduced in an easily understandable manner by the user.

  Details of each embodiment will be described below with reference to the drawings.

[First Embodiment]
1. External Configuration of Display Control System FIG. 1 is a diagram showing an external configuration of a conference system (display control system) 100 having a display control device according to the first embodiment of the present invention. In FIG. 1, reference numeral 110 denotes a display device. The display device 110 is a display device with a digitizer in which a digitizer 140 is attached around the screen.

  A computer device 120 functions as a display control device that controls display on the display device 110 and is connected to the display device 110 so as to be communicable. The computer device 120 is capable of drawing objects such as characters and graphics and editing drawing objects, and is equipped with an electronic whiteboard application for causing the display device 110 to function as an electronic whiteboard.

  A digitizer pen 130 is an input device. The display device 110 functioning as an electronic whiteboard can be used to draw objects such as characters and figures and edit the drawn objects using the digitizer pen 130.

  In addition to the digitizer pen 130, the input device includes a keyboard 150 and a mouse 160 that are connected to the computer device 120 and input instructions to the computer device 120.

2. Configuration of Display Control Device FIG. 2 is a block diagram showing a configuration of a computer device 120 that functions as a display control device. The computer device 120 includes a CPU 201, a RAM 202, a ROM 203, an HDD 204, an input device I / F unit 205, a network interface unit 206, and a display I / F unit 207.

  The input device I / F unit 205 receives information regarding the designated position output from the digitizer 140. In addition, it receives instructions from the keyboard 150 and the mouse 160 that function as input devices for the computer device 120.

  The electronic whiteboard application 210 stored in the HDD 204 has a function executed in the drawing mode and a function executed in the playback mode. The drawing mode is a mode for causing the display device 110 to function as an electronic whiteboard, and the playback mode is a mode for causing the display device 110 to function as a playback device.

  As functions executed in the drawing mode, the electronic whiteboard application 210 includes a recognition unit 211, a processing execution unit 212, a drawing control unit 213, and a recording unit 214.

  The recognition unit 211 recognizes various operation instructions received by the input device I / F unit 205. Specifically, a page operation instruction, a drawing object generation instruction, an already generated drawing object editing instruction, and the like are recognized.

  The process execution unit 212 executes processes corresponding to various operation instructions recognized by the recognition unit 211.

  When the drawing object displayed on the display device 110 changes as a result of the processing executed by the processing execution unit 212, the drawing control unit 213 generates a changed drawing object, and passes the display I / F 207 unit. The data is output to the display device 110.

  The recording unit 214 records information (operation information) about the operation instruction in the operation information table 221 of the HDD 204 in accordance with various operation instructions recognized by the recognition unit 211. If the drawing object changes in accordance with the operation instruction, information about the drawing object (drawing object information) is recorded in the drawing object information table 222.

  On the other hand, as functions executed in the playback mode, the electronic whiteboard application 210 includes an operation information acquisition unit 215, a playback part extraction unit 216, and a playback unit 217.

  The operation information acquisition unit 215 acquires an operation information table and a drawing object information table designated by the user from among a plurality of operation information tables 221 and a drawing object information table 222 recorded in the HDD 204 for each conference.

  Based on the acquired operation information table 221 and drawing object information table 222, the reproduction part extraction unit 226 extracts operation information to be used for reproducing recorded contents. Here, the operation information to be used for reproducing the recorded contents is operation information having an attribute designated by the user and operation information recorded before and after the operation information (details will be described later).

  The reproduction unit 217 extracts operation information determined to be used for reproduction, and reproduces the recorded content on the display device 110 using the operation information.

  Note that the electronic whiteboard application 210, the operation information table 221, and the drawing object information table 222 are appropriately loaded into the RAM 202 and executed by the CPU 201 under the control of the CPU 201.

3. Configuration of Display Window FIG. 3 is a diagram illustrating an example of a UI displayed on the display device 110 when the electronic whiteboard application drawing mode is activated in the conference system 100.

  In FIG. 3, reference numeral 300 denotes a display window. Reference numeral 301 denotes a drawing input area (drawing area) in the display window 300. Under the drawing mode, the drawing object can be drawn using the digitizer pen 130. 302 and 303 are examples of drawn drawing objects.

  Reference numeral 302 denotes a character string “September” input with five handwritten strokes in the handwriting input mode. Reference numeral 303 denotes a straight line input in the tool input mode, and is composed of one stroke. Switching between the handwriting input mode and the tool input mode is performed by a menu (not shown).

  It should be noted that the drawing objects 302 and 303 drawn in the drawing area 301 can be edited. Specifically, by selecting a drawing object and selecting an item from a menu (not shown), editing operations such as movement, resizing, erasing, cutting, and copying can be performed.

  Reference numeral 304 denotes a page operation area for performing a page operation on the drawing area 301. Page thumbnails are displayed in the page operation area 304, and page operations such as page switching, movement, deletion, and new addition can be performed by using the digitizer pen 130.

  Reference numeral 305 denotes a page operation button. The page operation button 305 includes a displayed page number and a page forward / return button, and the page can be switched by using the button.

4). Configuration of Operation Information Table 221 FIG. 4 is a diagram illustrating an example of the operation information table 221 in which operation information related to user operations performed during the execution of the drawing mode of the electronic whiteboard application 210 is recorded.

  The operation information table 221 is generated for each conference. Operations such as a drawing object generation operation, an editing operation, and a page operation are sequentially recorded in the operation information table 221 as operation information.

  Each operation information recorded in the operation information table 251 includes items such as “operation start time”, “operation end time”, “operation type”, “object ID”, “page number”, and “user ID”. It is.

  The “operation start time” is the time when the operation is started. “Operation end time” is the time when the operation is ended. “Operation type” represents the type of operation.

  “Object ID” indicates an identifier of the drawing object when the drawing object drawn in the drawing area 301 is changed (generated or edited) by the user's operation, and is shown in the drawing object information table shown in FIG. It corresponds to.

  “Page number” indicates the page on which the operation is performed or the page number of the switching destination. “User ID” indicates the ID of the operator.

5. Configuration of Drawing Object Information Table 222 FIG. 5 is a drawing object information table that records drawing object information related to drawing objects that have changed due to generation or editing operations during the playback mode of the electronic whiteboard application 210 in the conference system 100. It is a figure which shows an example.

  The drawing object drawn in the drawing area 301 is automatically assigned an ID. In the drawing object information table 222, “drawing object ID”, “data type”, and data necessary for drawing the drawing object (“drawing object data”) are recorded as drawing object information.

  “Data type” is an item indicating the type of drawing object, and indicates the type of graphic tool such as a stroke, straight line, rectangle, or circle. In the “drawing object data”, an array of (X, Y) coordinates is recorded for a handwritten stroke, a start point / end point coordinate is recorded for a straight line, and an upper left coordinate and a lower right coordinate are recorded for a rectangle. In addition, color data, line type data, fill color, and the like may be recorded.

6). Reproduction process flow FIG. 6 is a flow chart showing a flow of reproduction processing of the recording contents of the computer system 120. When the playback mode of the electronic whiteboard application 210 is activated, in step S601, first, a designation of a conference by the user is accepted in order to select a recorded content in which a conference to be reproduced by the user is recorded.

  In step S602, an operation information table and a drawing object information table corresponding to the conference specified in step S601 are read.

  In step S603, a UI for selecting a reproduction method is displayed, and selection of the reproduction method from the user is accepted. FIG. 7 is a diagram illustrating an example of a UI for selecting a playback method.

  As shown in FIG. 7, in the present embodiment, the recorded content is reproduced based on all the recorded operation information, or the operation information having a specific attribute is extracted, and the recorded content is based only on the operation information. It is possible to select whether to perform reproduction (see 701).

  Further, when extracting operation information having a specific attribute, the user can select the attribute (see 702). In the example of FIG. 7, “stroke”, “special mark”, “search”, “recognition”, and the like are displayed as selectable attributes (see 703).

  In step S604, operation information having the attribute selected in step S603 is extracted. After operation information having a specific attribute is extracted in step S604, a UI for setting a condition (second condition) for extracting operation information before and after the extracted operation information is displayed. .

  FIG. 8 is a diagram illustrating an example of a UI for setting a condition for extracting operation information recorded within a predetermined time as operation information before and after the operation information extracted in step S604. According to FIG. 8, a user desired time length can be set.

  FIG. 9 is a diagram illustrating an example of a UI for setting conditions for extracting operation information for a predetermined number of operations as operation information before and after the operation information extracted in step S604. According to FIG. 9, the user-desired number of operations can be set.

  Thus, in this embodiment, in addition to the operation information extracted in step S604, operation information recorded within the time before and after the extracted operation information or the number of operations is also extracted. This is because, depending on the selected attribute, even if only the operation information having the attribute is extracted and the recorded content is reproduced, the user may not be able to grasp the reproduced content.

  For example, the attribute “stroke” refers to a drawing object generation operation performed by the digitizer pen 130 which is an input device or another input device. In this case, even if only the portion where the stroke is performed is extracted and reproduced, it is possible to grasp how the stroke is drawn.

  Similarly, “edit” indicates that an editing operation such as enlargement, reduction, or movement has been performed on a drawing object. In this case, even if only the part where the editing operation has been performed is extracted and reproduced, the user can grasp the editing transition.

  On the other hand, the “special mark” is used during the meeting, for example, as a mark indicating an important part. Therefore, by extracting only the part for which the special mark marking operation has been performed, The operation may be an extremely short time operation. For this reason, even if the reproduction is performed only based on the extracted operation information, there is a problem that the reproduction is instantaneous and the user cannot grasp the reproduction result. In the present embodiment, in view of such a problem, the operation information recorded within a predetermined time before or after the operation information extracted according to the attribute or within a predetermined number of operations is also extracted and the extracted operation is performed. The information can be used for reproduction.

  In step S605, it is determined whether a time length is specified in the UI of FIG. If it is determined in step S605 that the time length has been specified, the process proceeds to step S607. In step S607, operation information recorded within a specified time is further extracted as operation information before and after the operation information extracted in step S604.

  On the other hand, if it is determined in step S605 that the time length has not been specified, the process proceeds to step S606. In step S606, it is determined whether the number of operations is specified in the UI of FIG. If it is determined in step S606 that the number of operations has been designated, the process proceeds to step S608.

  In step S608, operation information for the designated number of operations is further extracted as operation information before and after the operation information extracted in step S604.

  On the other hand, if it is determined in step S606 that the number of operations has not been specified, the process proceeds to step S609.

  In step S609, based on the extracted operation information, the recorded contents are continuously reproduced in the order in which the operation information is recorded. Here, the extracted operation information includes both the operation information extracted in step S604 and the operation information extracted in step S607 when it is determined “Yes” in step S605. If “Yes” is determined in step S606, both the operation information extracted in step S604 and the operation information extracted in step S608 are included. On the other hand, if “No” is determined in step S606, only the operation information extracted in step S604 is included.

  In order to perform playback based on the extracted operation information, the state of the entire electronic whiteboard application at the time related to the extracted operation information (or operation information recorded within the time before or after or the number of operations) Is displayed.

  Here, the state of the entire electronic whiteboard application refers to a state in which drawing objects that have already been drawn in the same page are displayed when the extracted operation information is recorded.

  Specifically, during the execution of the drawing mode of the electronic whiteboard application, all of the recorded operation information is recorded between the time when the extracted operation information is switched to the page to which the operation information belongs. A state in which operation information is used for simultaneous playback.

  Therefore, the operation information performed up to the operation start time is, for example, drawn, and is simultaneously reproduced as recorded content if it is not erased. Although it may be configured to perform playback only based on the extracted operation information and operation information before and after that, it is usually easier for the user to grasp the playback result if the entire electronic whiteboard can be viewed, Playback is performed in this way.

  FIG. 10 and FIG. 11 are conceptual diagrams showing the state of continuous reproduction using the extracted operation information using the time axis. Among these, FIG. 10 shows continuous reproduction when the time length or the number of operations is not specified. On the other hand, FIG. 11 shows continuous reproduction when the time length or the number of operations is designated.

  In FIG. 10, (a) visualizes the operation performed by the user from the start of the conference to the end of the conference along the time axis. In FIG. 10A, the rectangles arranged along the time axis indicate the user's continuous operation. The left side of each rectangle indicates the operation start time of the continuous operation, and the right side indicates the operation end time. Represent. Of the rhombuses shown inside each rectangle, the black rhombuses represent operation information corresponding to the drawing object information having the attribute selected in step S603. The white rhombus represents operation information corresponding to the drawing object information that does not have the attribute selected in step S603.

  That is, the operation information 1001 to 1004 is extracted operation information. Further, the operation information 1011 to 1014 is operation information recorded between the time when the extracted operation information is switched to the page and the operation start time of the extracted operation information. The operation information 1011 to 1014 is operation information used for displaying the entire state of the electronic whiteboard application when the recorded information is reproduced using the operation information 1001 to 1004.

  On the other hand, in FIG. 10, (b) shows a state in which recorded contents are continuously reproduced using the extracted operation information. As shown in FIG. 10B, first, in order to display the state of the entire electronic whiteboard application, the recorded content is reproduced based on the operation information 1001 and then the recorded content is reproduced based on the operation information 1001. Is done. Subsequently, in order to display the state of the entire electronic whiteboard application, the recorded contents are reproduced simultaneously based on the operation information 1012, and then the recorded contents are reproduced based on the operation information 1002. Hereinafter, similarly, when the recorded content is reproduced based on the operation information 1004, the reproduction process is terminated.

  In this way, based on the operation information extracted by selecting the attribute, the recorded content is continuously played back in order from the earliest time, so that the recorded content can be reviewed in a time significantly shorter than the entire time. Is possible. Note that the reproduction of the recorded content is realized by referring to each item constituting the operation information and performing extraction, connection, and reproduction processing.

  On the other hand, when the time length or the number of operations is designated, as shown in FIG. 11, the operation information before and after the extracted operation information is continuously reproduced.

  For example, if “3 seconds” is set in step S605, the operation information for 3 seconds before and after the operation start time and operation end time of each operation information (1101 to 1104) extracted in step S604 is also obtained. It will be extracted. Specifically, the operation information 1101 ′, 1101 ″, 1102 ′, 1102 ″, 1103 ′, 1103 ″, 1104 ′, 1104 ″ is extracted.

  Then, in order to display the state of the entire electronic whiteboard application at each operation start time of the extracted operation information (1101 'to 1104'), simultaneous reproduction based on the operation information 1111 to 1114 is performed.

  When “5 operations” is set in step S606, the operation information (1101 ′ to 1104 ″) for five operations before and after each operation information (1101 to 1104) extracted in step S604. It will be extracted.

  Then, in order to display the state of the entire electronic whiteboard application at each operation start time of the extracted operation information (1101 'to 1104'), simultaneous reproduction based on the operation information 1111 to 1114 is performed.

  As is clear from the above description, in this embodiment, the user designates an attribute when reproducing the recorded content based on the operation information recorded during the execution of the drawing mode of the electronic whiteboard application. Then, the operation information having the designated attribute is extracted, and the recorded content based on the operation information is continuously reproduced. As a result, the user-desired recorded contents can be reproduced in a manner that is easy for the user to understand.

  Further, in the present embodiment, when the user-desired recording content is selectively and continuously reproduced, the operation information before and after the corresponding operation information is extracted and reproduced using the operation information. . As a result, the user can easily grasp the reproduction result.

  Furthermore, in this embodiment, when reproducing the recorded contents based on the extracted operation information, when the extracted operation information is recorded, the drawing objects already drawn in the same page are reproduced simultaneously. In addition, it is configured to regenerate. As a result, the user can see the state of the entire electronic whiteboard application and can easily grasp the reproduction result.

  In the continuous reproduction in the present embodiment, it is desirable that there is a display that indicates that the operation information extracted when the connected portion is reproduced is switched. For example, in the case of FIG. 10, reproduction based on operation information from operation information 1001 to operation information 1004 is continuously performed. Therefore, for example, a telop informing that the scene has been switched may be inserted into each joint, or video effects such as fade-in / out may be used to make playback easier to understand.

  The selectable attributes are not limited to the attributes shown in FIG. For example, with the “character recognition attribute” that is an operation attribute for recognizing a character formed by a drawing object drawn on an electronic whiteboard and converting it to text information, or an operation attribute for recognizing a figure There is a certain “graphic recognition attribute”.

  Further, in the electronic whiteboard application, for example, a “material search attribute” that is an operation attribute for searching a material file or the like, and an “position search attribute” that is an operation attribute for searching for an operation at a specific position are provided. Can be mentioned. Furthermore, “copy (cut) paste attribute” that is an operation attribute for performing copy (or cut) / paste, and “page switching attribute” that is an operation attribute for performing page switching are included.

  As described above, it is possible to define attributes according to the types of operations that can be performed on the electronic whiteboard. Further, the attribute can be subdivided. For example, an attribute such as a color type for the “stroke attribute”, a pen thickness type, and a font type for the “text input attribute” may be defined. However, since there are some attributes that do not appear frequently during the meeting and attributes that are not important when looking back on the meeting later, these attributes are effective to fulfill the purpose of the present invention. It is desirable to be.

[Second Embodiment]
In the first embodiment, a case has been described in which an attribute is designated when extracting user-desired operation information. However, the present invention is not limited to this, and it may be configured to be designated by a drawing object.

  In the present embodiment, operation information and drawing object information recorded using an electronic whiteboard application are extracted based on a specific drawing object and reproduced. The external configuration of the conference system and the configuration of the computer apparatus are the same as those described in the first embodiment, and thus description thereof is omitted here.

  FIG. 12 is a flowchart showing the flow of reproduction processing in the computer apparatus according to the present embodiment.

  When the playback mode of the electronic whiteboard application 210 is activated, in step S601, first, a user designates a conference to select a recorded content in which a conference to be played is recorded. In step S602, an operation information table and a drawing object information table corresponding to the conference specified in step S601 are read.

  In step S1203, a UI for selecting a search type is displayed, and selection of the search type from the user is accepted. FIG. 13 is a diagram illustrating an example of a UI for selecting a search type.

  As shown in FIG. 13, in this embodiment, it is possible to select to reproduce the recorded content based on all the recorded operation information (see 1301). It is also possible to select operation information extracted at the time of generating or editing a drawing object corresponding to a specific figure, character, or drawing position and reproducing the recorded content based only on the operation information ( 1302).

  In step S1204, a search condition (first condition) input screen (any one of FIGS. 14 to 16) corresponding to the search type selected in step S1203 is displayed, and input of the search condition is accepted.

  Here, each search type and search condition will be described.

  The graphic search is used when searching for an arbitrary graphic. For example, since there is a high possibility that a figure such as an enclosing mark or underline is used for pointing, the part where the specified drawing object is drawn during the meeting is searched by entering the figure as a search target. Can be extracted. As the search condition input screen, for example, an input screen as shown in FIG. 14 is displayed, and the user can input a graphic to be searched for on the input screen. In the case of graphic search, the graphic input by the user in FIG. 14 serves as a search key, the drawing object information table is searched, and operation information when a similar drawing object is recorded during the meeting is extracted.

  Character search is used when searching for an arbitrary character. It is possible to search and extract operation information when a specified character is described during a meeting. As the search condition input screen, for example, an input screen as shown in FIG. 15 is displayed, and the user can input a character to be searched for on the input screen. In the case of character search, the character input by the user in FIG. 15 serves as a search key, the drawing object information table is searched, and operation information recorded when the same character is drawn during the conference is extracted. It should be noted that when the drawing object information table is searched, a character recognition process is executed together, and a character input by handwriting input (stroke) is recognized as text information.

  The position search is used when searching for a drawing object at an arbitrary position. It is possible to search and extract operation information of a generation operation or an editing operation recorded when a drawing object is generated or edited at an arbitrary position on the electronic whiteboard. As the search condition input screen, for example, an input screen as shown in FIG. 16 is displayed, and the user can input a position to be searched on the input screen. In the case of position search, the position information input in FIG. 16 is a search key. As a result, the drawing object information table is searched, and operation information recorded when the drawing object is generated or edited at the position during the conference is extracted.

  Returning to FIG. In step S609, continuous reproduction is performed in the order in which the operation information is recorded based on the operation information extracted in step S1205.

  In order to perform playback based on the extracted operation information, the state of the entire electronic whiteboard application at the time related to the extracted operation information is displayed.

  However, the recorded content may be reproduced based only on the operation information extracted by the search without displaying the state of the entire electronic whiteboard as the range displayed at the time of reproduction. In particular, in the position search, if the recorded contents are reproduced based only on the extracted operation information, only the recorded contents based on the operation information recorded when the drawing object is generated or edited at a specific position can be reproduced. Is more effective.

  In addition, the position search may be combined with another search or the playback method described in the first embodiment. For example, search and playback may be performed under conditions such as a specified figure in a specified range, or a specified range may be specified. Playback may be performed under the condition of attribute manipulation.

  As is clear from the above description, according to the present embodiment, the user can specify the search condition based on the drawing object when reproducing the recorded content based on the operation information recorded in the electronic whiteboard application. It becomes.

[Third Embodiment]
In the first and second embodiments, in the electronic whiteboard application, the drawing object information is recorded in association with the operation information table. However, the present invention is not limited to this. You may comprise so that audio | voice data and its attribute information (information regarding a speaker, etc.) may be recorded together.

  In this case, it is assumed that the audio data and the attribute information are sequentially recorded in association with the time information when the electronic whiteboard application is started. As a result, when the recorded content is reproduced based on the extracted operation information, the audio data recorded between the operation start time and the operation end time of the operation information is reproduced together.

  As a result, it is possible to reproduce the audio data while greatly reducing the reproduction time. Note that, when extracting operation information, attribute information of audio data may be selected.

[Other Embodiments]
Note that the present invention can be applied to a system (for example, a copier, a facsimile machine, etc.) consisting of a single device even if it is applied to a system composed of a plurality of devices (for example, a host computer, interface device, reader, printer, etc.). You may apply.

  Needless to say, the object of the present invention can also be achieved by supplying a system or apparatus with a storage medium storing software program codes for realizing the functions of the above-described embodiments. In this case, the above functions are realized by the computer (or CPU or MPU) of the system or apparatus reading and executing the program code stored in the storage medium. In this case, the storage medium storing the program code constitutes the present invention.

  As a storage medium for supplying the program code, for example, a floppy (registered trademark) disk, hard disk, optical disk, magneto-optical disk, CD-ROM, CD-R, magnetic tape, nonvolatile memory card, ROM, or the like is used. be able to.

  Further, the present invention is not limited to the case where the functions of the above-described embodiments are realized by executing the program code read by the computer. For example, an OS (operating system) running on a computer performs part or all of actual processing based on an instruction of the program code, and the functions of the above-described embodiments may be realized by the processing. Needless to say, it is included.

  Furthermore, after the program code read from the storage medium is written in a memory provided in a function expansion board inserted into the computer or a function expansion unit connected to the computer, the functions of the above-described embodiments are realized. Is also included. That is, after the program code is written in the memory, the CPU or the like provided in the function expansion board or function expansion unit performs part or all of the actual processing based on the instruction of the program code, and is realized by the processing. This is also included.

It is a figure which shows the external appearance structure of the conference system (display control system) 100 which has a display control apparatus concerning the 1st Embodiment of this invention. It is a block diagram which shows the structure of the computer apparatus 120 which functions as a display control apparatus. 6 is a diagram illustrating an example of a UI displayed on the display device 110 when a drawing mode of an electronic whiteboard application is activated in the conference system 100. FIG. It is a figure which shows an example of the operation information table 221 which recorded the operation information regarding the user's operation performed while drawing mode of the electronic whiteboard application 210 was performed. 6 is a diagram illustrating an example of a drawing object information table 252 that records drawing object information related to drawing objects that have been changed by a generation or editing operation or the like during execution of the playback mode of the electronic whiteboard application 210 in the conference system 100. FIG. 10 is a flowchart showing a flow of a recorded content reproduction process in the computer apparatus 120. It is a figure which shows an example of UI for selecting the reproduction | regenerating method. It is a figure which shows an example of UI which sets the conditions for extracting the operation information recorded within the predetermined time as the operation information before and behind the extracted operation information. It is a figure which shows an example of UI which sets the conditions for extracting the operation information for a predetermined number of operations as the operation information before and after the extracted operation information. It is the conceptual diagram which represented a mode that it reproduced continuously using the extracted operation information using a time-axis. It is the conceptual diagram which represented a mode that it reproduced continuously using the extracted operation information using a time-axis. It is a flowchart which shows the flow of the reproduction | regeneration processing in the computer apparatus concerning the 2nd Embodiment of this invention. It is a figure which shows an example of UI for selecting a search kind. It is a figure which shows an example of the input screen of the search conditions corresponding to the selected search kind. It is a figure which shows an example of the input screen of the search conditions corresponding to the selected search kind. It is a figure which shows an example of the input screen of the search conditions corresponding to the selected search kind.

Claims (9)

A display control method in a display control device connected to a display device,
A recording device connected to the display device, and at least the content of the change from the recording device that records the content of the change when the drawing content changes in the drawing area for drawing the object on the display device An acquisition process for acquiring information on,
An input step of inputting a first condition for extracting information used for reproducing the drawing content from the information acquired in the acquisition step;
A reproduction step of extracting information satisfying the first condition from the information acquired in the acquisition step, and continuously reproducing the drawing content on the display device using the extracted information. A display control method characterized by the above.   The information acquired in the acquisition step includes user operation information when the drawing content changes in the drawing area and object information related to the object when the object drawn in the drawing area changes due to the operation. The display control method according to claim 1, further comprising: In the input step, an attribute of an object included in the object information can be input as the first condition.
The reproduction step extracts the object information having the input attribute, and continuously reproduces the operation information corresponding to the recorded operation information using the extracted object information. The display control method according to claim 2, wherein the drawn content is continuously reproduced. In the input step, a figure or a character can be input as the first condition,
The reproduction step extracts object information relating to an object that forms a graphic or character that is the same as or similar to the input graphic or character, and uses the extracted object information in the order in which the corresponding operation information is recorded. The display control method according to claim 2, wherein the drawing content is continuously reproduced on the display device by continuously reproducing. In the input step, a position in the drawing area can be input as the first condition,
The reproduction step extracts object information related to an object drawn at the input position, and continuously reproduces the operation information corresponding to the recorded operation information using the extracted object information. The display control method according to claim 2, wherein the drawing content is continuously reproduced on the display device. The input step further includes a setting step for setting a second condition for extracting information recorded before and after information satisfying the first condition,
The reproduction step extracts information satisfying the second condition in addition to information satisfying the first condition, and continuously reproduces the drawing contents on the display device using the information. The display control method according to claim 1. In the setting step, time or the number of operations can be set as the second condition,
The reproduction step is information recorded before and after information satisfying the first condition as information satisfying the second condition, and is information recorded within a set time or a set number of operations. The display control method according to claim 6, wherein information recorded in the information is extracted. A display control device connected to the display device,
A recording device connected to the display device, and at least the content of the change from the recording device that records the content of the change when the drawing content changes in the drawing area for drawing the object on the display device An acquisition means for acquiring information about,
Input means for inputting a first condition for extracting information used for reproduction of the drawing content from the information acquired by the acquisition means;
Reproducing means for extracting information satisfying the first condition from the information obtained by the obtaining means, and continuously reproducing the drawing content on the display device using the extracted information. A display control device. A program for causing a computer to execute the display control method according to any one of claims 1 to 7.

Images