JP2008275687A - Display control device and method - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To reproduce drawing contents in such a manner that the contents are easily recognized, in a simple method while shortening the reproduction time in a display control device allowing successive reproduction of drawing contents. <P>SOLUTION: The display control device includes: an operation information acquisition part 241 which acquires information 261 and 262 relating to contents of a change from a hard disk 206 wherein contents of the change are recorded, in the case of the change of drawing contents drawn in a drawing area for drawing an object; a reproduction part extraction part 246 which determines information to be used for reproduction of drawing contents, out of acquired information 261 and 262 and decides a reproduction timing of the information; and a reproducing par 247 which extracts information determined to be used for reproduction and uses the extracted information to reproduce the drawing contents on a display device at the decided reproduction timing. <P>COPYRIGHT: (C)2009,JPO&INPIT

Description

  The present invention relates to a display control technique for reproducing drawing contents drawn on a drawing area for drawing an object.

  In recent years, large-screen display devices such as plasma displays, rear projection displays, and front projectors have become widespread, and presentations, meetings, classes, etc. using such large-screen display devices have been held. Yes.

  In conducting a meeting, a class, or the like using a large screen display device, a user has so far used a pointing stick, a laser pointer, or the like as means for indicating a specific position on the display screen.

  However, recently, a pointing system including a digitizer that detects a position (indicated position) on a display screen instructed by a user has been developed, and the number of cases in which this is used is increasing. According to such a pointing system, a cursor on the display screen is moved or a tool corresponding to the indicated position is activated in accordance with the user's designated position on the display screen, and characters, figures, etc. are drawn on the display screen. Objects can be created. Further, the generated drawing object can be freely edited.

  In general, in such a pointing system, a large screen display device is connected to a video output terminal of a display control device such as a personal computer, so that display data generated by the personal computer is displayed on the large screen display device. Further, the digitizer and the personal computer are connected using an interface cable, and information on the indicated position is transmitted via the interface cable.

  Furthermore, an application is installed on the personal computer side in order to reflect information related to the designated position input via the interface cable in the movement of the cursor and the generation of drawing objects such as characters and figures.

  In the pointing system configured as described above, various functions can be realized by making the installed application multifunctional.

  For example, the handwriting input function can be realized by directly drawing in accordance with the designated position on the display screen. As a result, the large screen display device can be used as an electronic whiteboard.

  Further, when the drawing content displayed on the display screen changes in accordance with the user's operation, the content of the change is recorded together with the time data, and is played back according to the time data. Functions can also be realized. According to the playback function, the content drawn on the display screen during the conference can be played back over the time of the conference. For example, when a large screen display device is used as an electronic whiteboard The reproduced contents can be used as minutes during the meeting.

  Here, various proposals have been made regarding the playback function for playing back the contents of changes recorded together with time data.

  For example, Japanese Patent Application Laid-Open No. 2004-336289 discloses a snapshot of a whiteboard as a recording target to be recorded for playback by a playback function, thereby enabling a meeting or class to be played back. Japanese Patent Laid-Open No. 6-205151 discloses a configuration for reproducing audio / video information during a meeting together.

  Furthermore, proposals have been made for the purpose of improving the convenience of the user when playing back using the playback function. For example, functions such as fast-forward mode and double-speed playback mode have been proposed for the purpose of shortening the playback time, in addition to the normal speed.

Japanese Patent Application Laid-Open No. 11-112922 discloses a configuration for analyzing event points such as video scene change points and audio speaker change points from input stream data such as video and audio. According to the publication, when an event point is detected during reproduction, a stream is reproduced slowly in the vicinity of the event point, so that a user can easily recognize a specific stream.
JP 2004-336289 A JP-A-6-205151 Japanese Patent Laid-Open No. 11-112922

  However, the playback function for the purpose of improving user convenience has several problems when applied to the pointing system. For example, in the case of the above-described playback function, for example, a drawing object that is not directly related to grasping the contents of a meeting or the like, such as a drawing object that has been temporarily handwritten and then deleted immediately, is played back. Become. Alternatively, when a character is drawn by handwriting input with a stroke per stroke, each drawing object input by handwriting is sequentially reproduced one by one. Therefore, there is a problem that it takes a long time for reproduction.

  On the other hand, if playback is performed using fast-forwarding, double-speed playback, etc., the playback time will be shortened, but the part necessary for understanding the playback content will also be played back at high speed, so the user cannot grasp the playback content. There is a problem.

  On the other hand, as in the above-mentioned Patent Document 3, a configuration in which a recorded drawing object is analyzed and an event point is detected to reproduce slowly in the vicinity of the event point can be considered. However, in the case of this method, there is a problem that the recorded drawing object needs to be analyzed and the processing becomes complicated.

  The present invention has been made in view of the above problems, and in a display control apparatus capable of sequentially reproducing drawing contents, realizes reproduction with a simple method to easily understand the reproduction contents while reducing the reproduction time. The purpose is to do.

In order to achieve the above object, a display control apparatus according to the present invention has the following configuration. That is,
A display control device connected to the display device,
An acquisition means for acquiring information about the content of the change from a recording device that records the content of the change when the content of the drawing drawn in the drawing area for drawing the object changes;
A determination unit that determines information to be used for reproducing the drawing content from the information acquired by the acquisition unit, and determines a reproduction timing of the drawing content based on the information;
And a reproduction unit that extracts information determined to be used for reproduction by the determination unit, and reproduces the drawing content on the display device at the determined reproduction timing using the extracted information.

  According to the present invention, in a display control apparatus capable of sequentially reproducing display contents, it is possible to realize reproduction with easy grasping of contents by a simple method while shortening reproduction time.

  Details of each embodiment will be described below with reference to the drawings.

[First Embodiment]
1. External Configuration of Conference System FIG. 1 is a diagram showing an external configuration of a conference system (display control system) 100 having a display control apparatus according to the first embodiment of the present invention.

  A rear projection display 101 has a function as a display unit that displays an execution result of an application (control program) for realizing an electronic whiteboard stored in a personal computer, which will be described later.

  In the rear projection display 101, an optical system including a light source lamp, a color filter, a liquid crystal panel, an optical lens, a mirror and the like is configured. The light emitted from the light source lamp is separated into three colors of RGB by a color filter and the like, and each is irradiated to the liquid crystal panel. The light modulated by the liquid crystal panel is enlarged and projected on the display screen of the rear projection type display 101 by the optical system, whereby the execution result of the electronic whiteboard application is displayed on the display screen.

  Reference numerals 102 and 103 denote digitizer modules arranged on the left and right of the upper part of the display screen. The digitizer modules 102 and 103 scan the surface of the display screen by transmitting infrared rays. Then, when there is an obstacle on the display screen, the transmitted infrared ray is blocked and the level of the received signal is changed to detect the position and size of the obstacle. As described above, by arranging the digitizer modules 102 and 103, the rear projection display 101 has a function as an input unit that receives an instruction to the display screen from the user.

  As a result, the rear projection display 101 can detect the position and size when a predetermined position on the display screen is instructed by using, for example, a finger or an indicator stick.

  Reference numeral 107 denotes a digitizer pen for instructing a position on the display screen, and functions as a pointing device for instructing the display screen. The digitizer pen 107 has a click determination switch attached to the pen tip and an eraser switch 108 attached to the side of the pen. When the eraser switch 108 is pressed, the mode is temporarily changed to the eraser mode. When the position on the display screen is designated in this state, the drawing object corresponding to the designated position is erased.

  A personal computer 104 functions as a display control device that controls display of a drawing object displayed on the rear projection type display 101 based on an instruction from the digitizer pen 107 or the like. The personal computer 104 is connected to the rear projection type display 101 via an image signal cable 105 and a communication cable 106. The personal computer 104 is connected to a keyboard (not shown) that functions as an input device, and various applications in the personal computer 104 are controlled based on inputs from the keyboard.

2. Is a structural view 2 of each part constituting the conference system 100 is a block diagram showing the configuration of each unit constituting the conferencing system 100. As described above, the conference system 100 includes the digitizer pen 107 that functions as a pointing device and the rear projection display 101 that functions as an electronic whiteboard. Furthermore, a personal computer 104 that functions as a display control device and a keyboard 220 that functions as an input device for the personal computer 104 are provided.

2.1 Digitizer Pen The digitizer pen 107 that functions as a pointing device can indicate a predetermined position on the display screen by the digitizer modules 102 and 103 functioning as the input unit 232 that detects the specified position.

2.2 Rear Projection Display Display The rear projection display 101 includes a display unit 231, an input unit 232, and an output unit 233.

  The input unit 232 receives an instruction from the digitizer pen 107, and the output unit 233 outputs information about the received instruction position to the personal computer 104. In the personal computer 104, the drawing mode of the electronic whiteboard application is executed, and various processes corresponding to the information related to the designated position are executed, so that the display unit 231 receives and displays the execution result.

  As a result, the rear projection display 101 can display the movement of the cursor to the detected designated position, the generation / deletion of drawing objects such as characters / graphics, or the generation / deletion of drawing objects by handwriting input. As a result, the rear projection type display 101 functions as an electronic white boat.

  Further, the display unit 231 of the rear projection display 101 receives and displays the playback content output by executing the playback mode of the electronic whiteboard application of the personal computer 104. That is, the rear projection display 101 also functions as a playback device that displays playback content.

2.3 Personal Computer The personal computer 104 that functions as a display control device includes a CPU 201, a RAM 202, a ROM 203, a flash memory 204, an input unit 205, a hard disk 206, and a network interface unit 207.

  The input unit 205 receives information regarding the indicated position output from the output unit 233 of the rear projection type display 101. Also, an instruction from the keyboard 220 that functions as an input device for the personal computer 104 is received.

  The electronic whiteboard application 240 stored in the flash memory 204 has a function executed in the drawing mode and a function executed in the playback mode. The drawing mode is a mode for causing the rear projection type display 101 to function as an electronic whiteboard, and the playback mode is a mode for causing the rear projection type display 101 to function as a playback device.

  As functions executed in the drawing mode, the electronic whiteboard application 240 includes a recognition unit 241, a processing execution unit 242, a drawing control unit 243, and a recording unit 244.

  The recognition unit 241 recognizes various operation instructions received by the input unit 205. Specifically, a page operation instruction for moving a page defined in the drawing area, a drawing object generation instruction, an already generated drawing object editing instruction, and the like are recognized.

  The process execution unit 242 executes processes corresponding to various instructions recognized by the recognition unit 241.

  When the drawing object displayed on the display unit 231 changes as a result of the processing executed by the process execution unit 242, the drawing control unit 243 generates an object after the change and outputs the changed object to the display unit 231.

  The recording unit 244 sequentially records the operation information in the operation information table 251 of the hard disk 206 when the drawing object displayed on the display unit 231 changes in accordance with various operation instructions recognized by the recognition unit 241. Further, information regarding the changed drawing object is sequentially recorded in the drawing object table 252.

  On the other hand, as functions executed in the playback mode, the electronic whiteboard application 240 includes an operation information acquisition unit 245, a playback part extraction unit 246, and a playback unit 247.

  The operation information acquisition unit 245 acquires an operation information table and a drawing object table designated by the user from a plurality of operation information tables 251 and a drawing object table 252 recorded in the hard disk 206 for each meeting.

  Based on the acquired operation information table 251 and drawing object table 252, the reproduction part extraction unit 246 determines operation information to be used for reproduction of drawing contents and operation information unnecessary for reproduction, and reproduction of the drawing contents. Determine timing.

The conditions for discriminating operation information to be used for reproduction and operation information unnecessary for reproduction are as follows.
• Is the created or edited drawing object grouped?
-Whether the created or edited drawing object is a temporary drawing object.
-Is the page operation a continuous page operation?
Whether the drawing object editing operation corresponds to a predetermined editing operation.

  It should be noted that character processing (determination of whether or not the character is a character and character recognition processing) is executed on the drawing object generated by handwriting input, and the character portion processing is executed by the reproduction part extraction unit 246. Shall.

  The reproduction unit 247 extracts operation information determined to be used for reproduction, and reproduces the drawing content at the determined reproduction timing using the operation information.

  The electronic whiteboard application 240, the operation information table 251 and the drawing object table 252 are appropriately taken into the RAM 202 and executed by the CPU 201 under the control of the CPU 201.

  The network interface unit 207 performs communication with the outside.

3. Configuration of Display Window FIG. 3 is a diagram showing an example of a UI displayed on the rear projection display 101 when the electronic whiteboard application drawing mode is activated in the conference system 100.

  In FIG. 3, reference numeral 300 denotes a display window. Reference numeral 301 denotes a drawing input area (drawing area) in the display window 300. Under the drawing mode, a drawing object can be drawn by pointing input using the digitizer pen 107. 302 and 303 are examples of drawn drawing objects.

  Reference numeral 302 denotes a character string “September” input with five handwritten strokes in the handwriting input mode. Reference numeral 303 denotes a straight line input in the tool input mode, and is composed of one stroke. Switching between the handwriting input mode and the tool input mode is performed by a menu (not shown).

  The menu may be arranged in the display window 300 or may be displayed as a context menu on condition that a switch attached to the digitizer pen 107 is pressed. Alternatively, the digitizer pen 107 may be switched by separately attaching a dedicated switch for switching the input mode. In the tool input mode, a graphic tool such as a circle or a rectangle may be provided in addition to a tool for drawing a straight line.

  It should be noted that the drawing objects 302 and 303 drawn in the drawing area 301 can be edited. Specifically, by selecting a drawing object and selecting an item from a menu (not shown), editing operations such as movement, resizing, erasing, cutting, and copying can be performed.

  Reference numeral 304 denotes a page operation area for performing a page operation on a page defined in the drawing area 301. A page thumbnail is displayed in the page operation area 305, and page operations such as page switching, movement, deletion, and new addition can be performed by using a page operation button 306.

  Reference numeral 306 denotes a page operation button. The page operation button 306 includes a page number being displayed and a button for page advance / return. Pages can be switched by using the button.

4). Configuration of Operation Information Table 251 FIG. 4 shows the operation information recorded when the drawing content drawn in the drawing area 301 changes in accordance with the user operation while the drawing mode of the electronic whiteboard application 240 is executed. It is a figure which shows an example of the performed operation information table 251. FIG.

  The operation information table 251 is generated for each conference. When the drawing content drawn in the drawing area 301 is changed by drawing object generation operation, editing operation, page operation, etc., the change content is sequentially recorded on the hard disk 206 by the recording unit 244 as operation information. An operation information table is generated.

  Each piece of operation information recorded in the operation information table 251 includes items such as operation start time, operation end time, operation type, object ID, page number, and user ID.

  The operation start time is the time when the operation is started. The operation end time is the time when the operation is ended. The operation type represents the type of operation.

  The object ID indicates the identifier of the drawing object changed by the user's operation, and corresponds to the drawing object table shown in FIG. The page number indicates the page on which the operation is performed or the page number of the switching destination. The user ID indicates the operator's ID.

5. Configuration of the Drawing Object Table 252 FIG. 5 shows an example of the drawing object table 252 that records information related to drawing objects generated or edited while the electronic whiteboard application 240 is in the playback mode in the conference system 100. FIG.

  The drawing object drawn in the drawing area 301 is automatically assigned an ID. As information about the drawing object, the drawing object table 252 records a drawing object ID, a data type, a group ID, and data (drawing object data) necessary for drawing the drawing object.

  The data type is an item indicating the type of drawing object, and indicates the type of graphic tool such as a stroke, straight line, rectangle, or circle. The drawing object data stores an (X, Y) coordinate array for a handwritten stroke, a start point / end point coordinate for a straight line, and an upper left coordinate / lower right coordinate for a rectangle. In addition, color data, line type data, fill color, and the like may be stored.

  The group ID is an ID assigned to each group when a plurality of drawing objects belong to the same group.

  As a method of grouping, a method in which drawing objects drawn in the drawing area 301 in close proximity to each other are grouped together, a method in which strokes whose drawing positions are close to each other in the same group, or a combination thereof Etc. Furthermore, grouping may be performed in units of character strings in combination with character recognition processing by a character recognition program. This processing will be described later. Alternatively, it is possible to perform a grouping operation manually by providing items such as “grouping” and “ungrouping” in the menu in the display window 300. For example, a plurality of drawing objects may be manually selected, and grouping may be performed by selecting grouping from a menu.

  In the present embodiment, the operation information table (FIG. 4) and the drawing object table (FIG. 5) are created for each meeting, and are recorded on the hard disk 206 in the meeting system 100 during the meeting or at the end of the meeting. However, the recording destination is not limited to the hard disk 206 but may be recorded in a recording device (not shown) such as a server on the network via the network interface unit 207.

6). Diagram 6 of the playback window, in the conference system 100, based on the operation information table 251 and the drawing object table 252, an example of a playback window 600 for reproducing rendered content drawn in the drawing area 301 in the conference drawing It is. FIG. 6 shows an example of a UI in the playback mode of the electronic whiteboard application 240.

  As shown in FIG. 6, a playback result display area 601 is displayed at the top of the screen, and a playback operation area 602 is displayed at the bottom of the screen.

  Reference numeral 603 denotes various operation buttons for controlling the reproduction method. The operation buttons 603 for controlling the playback method include buttons for changing the playback speed such as fast forward and rewind in addition to normal playback and stop. In addition, an extraction / reproduction button 604 for extracting and reproducing only a portion necessary for reproduction in order to shorten the reproduction time is included.

  Reference numeral 605 denotes a slider indicating a playback point during playback. The user can change the playback point by dragging the slider 605. Reference numeral 606 denotes a page transition corresponding to the page number of the operation information table 251. In the case of FIG. 6, pages 1, 2, 3, 4, 2, 1, 3, and 4 are switched in order from the start of the conference, and page 3 is currently being reproduced.

7). The overall process flow diagram 7 in the conference system 100 is a flowchart showing a meeting reproduction processing procedure in the playback mode of the electronic whiteboard application 240 of the conference system 100.

  In step S701, initialization necessary for the operation of the electronic whiteboard application 240 is performed, and a list of operation information tables is read and displayed.

  In step S702, a meeting to start reproduction is designated. There is no limitation on the method of specifying the conference, but the user may directly specify from the list of operation information tables displayed in step S701, or the user may specify after searching with a predetermined search condition.

  In step S703, reproduction is performed based on the operation information recorded in the operation information table designated in step S702. A detailed flow of the reproduction process based on the operation information will be described with reference to FIG.

  In step S704, it is determined whether or not the electronic whiteboard application 240 is terminated. If not finished, the process returns to step S702, and reproduction is performed again based on another operation information table.

8). Reproduction process flow diagram 8 is a flowchart showing a playback procedure performed based on the operation information of the specified operation information table.

  In step S801, the designated operation information table 251 and the corresponding drawing object table 252 are read, and a progress timer for reproduction time control is initialized.

  In step S802, the reproduction time control timer is advanced. In step S803, each piece of operation information in the operation information table is read in order of operation start time, and it is determined whether there is next operation information. If there is no next operation information, the process proceeds to step S805. In step S805, if the operation end time of the current operation information is the conference end time, it is determined that the conference has ended, and the reproduction process ends.

  On the other hand, if it is determined that there is next operation information, the process proceeds to step S804. The reproduction process in step S804 will be described with reference to the flowchart in FIG.

9. Details of Reproduction Processing FIG. 9 is a flowchart showing details of the reproduction processing (step S804) in the reproduction processing procedure of the conference system 100.

  As shown in FIG. 9, in step S901, if the operation type of the read operation information is a page operation, the process proceeds to step S902.

  In step S902, it is determined whether the operation information has been recorded along with the continuous page operation. The continuous page operation is an operation in which the operator continuously switches pages in order to search for a target page. A continuous page operation is determined when an intermediate page display time other than the first and last is short, or when an operation such as generation / editing of another drawing object is not performed during the page switching operation.

  In the example of the operation information table in FIG. 4, pages are switched from 1 → 2 → 3 → 4 → 3 → 2 → 1. Of these, the page switching operation from page 2 to 3, 3 to 4, 4 to 3, and 3 to 2 is determined as a continuous page operation because the display time is short and no other operation is entered in the middle. .

  If it is determined in step S902 that the operation is a continuous page operation, the process proceeds to step S903.

  In step S903, operation information that does not require reproduction is skipped, and the operation information to be reproduced and the reproduction time control timer are changed to the last page switching operation. Therefore, at the time of reproduction, the drawing content corresponding to the operation information on page 2 is reproduced, and then the drawing content corresponding to the operation information on page 1 is reproduced.

  In step S904, it is determined whether or not the operation information is operation information recorded with a long editing operation. The long editing operation is a case where a drawing object is moved over a long time when it is moved by drag and drop.

  In this case, the operation information in which the movement of the drawing object being dragged is operation information that does not need to be reproduced, and it is only necessary to reproduce the drawing content corresponding to the operation information recorded when the drawing object is at the start position.

  Alternatively, for example, when the color of the drawn object is changed, the operation information recorded when an operation such as selecting a color from the color selection dialog box and pressing the OK button is not necessary at the time of reproduction. In this case, the operation information recorded between the color change operation start time and the operation end time is set as a reproduction unnecessary portion, and the drawing content is reproduced based only on the operation information recorded at the start and end of the editing operation. Skip playback.

  As described above, when the editing operation has a large difference between the operation start time and the operation end time, the editing operation is regarded as a long editing operation, and the process advances to step S905 to perform skip reproduction.

  If it is determined in step S904 that the editing operation is not long, the process proceeds to step S906 to perform normal reproduction. Here, in the example of the continuous page switching operation described above, since the switching operation from page 2 to page 1 is changed in step S903, the switching operation to page 1 is normally reproduced.

  If it is determined in step S901 that the page operation is not performed, it is determined in step S907 whether the object is a temporary drawing object.

  A temporary drawing object is a drawing object that has been drawn but has been erased immediately after being drawn. In this embodiment, even if an incorrect handwritten stroke is input when the digitizer pen 107 is used to input a handwritten stroke, the user can immediately trace the incorrect handwritten stroke while pressing the eraser button of the digitizer pen 107. Can be erased.

  FIG. 10 is a diagram illustrating an example of a display screen of a temporary drawing object. FIG. 10 shows a state in which the next drawing object 1001 (object ID = 0006) is erroneously input after drawing five handwritten strokes in the operation information table of FIG.

  In FIG. 4, the drawing object 1001 (object ID = 0006) is deleted immediately after generation. A correct object (object ID = 0007) is drawn after erasure. In such a case, the drawing object 1001 is regarded as a temporary drawing object.

  Other conditions that can be considered as a temporary drawing object include: deletion within a certain period of time after creation of a drawing object, deletion within a predetermined number of operations after generation, deletion when a predetermined operation is not included after generation, deletion by a specific operation (eraser switch menu Elimination). As described above, a drawing object that has been temporarily drawn in the drawing area 301 but immediately erased is determined to be a temporary drawing object. As a result, the operation information recorded when the drawing object is drawn (operation information related to the generation operation) and the operation information recorded when the drawing object is deleted (operation information related to the deletion operation) are determined as operation information that does not need to be reproduced. Is done.

  If it is determined in step S907 that the object is a temporary drawing object, the process advances to step S908. In step S908, the operation information determined not to be reproduced is skipped, and the operation information and the reproduction time timer are changed to the next operation information after the temporary drawing object is deleted.

  Since the processing in step S904, step S905, and step S906 is the same as described above, the description thereof is omitted.

  In the example of FIGS. 4 and 10, the drawing object (ID = 0007) is reproduced so as to be drawn after the drawing object (ID = 0005) is drawn.

  If it is determined in step S907 that the object is not a temporary drawing object, the process proceeds to step S909. In step S909, it is determined whether the stroke is a handwritten stroke.

  If it is determined that the stroke is a handwritten stroke, the process proceeds to step S910. If it is other graphic data or text data, the process advances to step S912.

  In step S910, character processing is performed by a character recognition program. The character processing includes a character cutting unit that extracts and forms a character or a character string from one or more handwritten strokes drawn in the drawing area 301, and a character recognition unit that performs character recognition from the extracted strokes. Consists of One or more handwritten strokes recognized to form a character by this character processing are subsequently processed as one character or character string.

  In addition, even after character processing, more accurate character processing can be performed by calculating and separating the most probable character combination from a plurality of recognition candidate characters using a word dictionary or semantic dictionary. Can be done. Further, a semantic analysis process may be performed, and a process of recognizing a character string in units of words or lines may be performed. The handwritten strokes processed as described above are processed as a group.

  In this embodiment, character processing and grouping are dynamically performed when the electronic whiteboard application 240 (playback mode) is executed. However, the present invention is not limited to this. For example, it is performed in advance at the time of recording the operation information or the like on the hard disk 206 during the meeting or at the end of the meeting, or when the electronic whiteboard application 240 (playback mode) is activated, and the character string data is stored. It may be.

  In step S911, in order to shorten the reproduction time, a process for reproducing the grouped drawing objects at a time is performed, and in step S905, reproduction with a reduced time is performed. Specifically, the remaining drawing objects in the group are reproduced at the same timing as the reproduction of the drawing object currently being reproduced, and the reproduction time control timer is set to the last operation end time in the group. In this way, when reproducing each drawing object grouped, it is possible to shorten the reproduction time by omitting the recorded operation information and advancing the reproduction time control timer.

  If it is determined in step S909 that the stroke is not a handwritten stroke, the process proceeds to step S912. In step S912, it is determined whether the drawing objects are grouped. Whether it is grouped or not is determined by the group ID item in the drawing object table of FIG. The assignment of the group ID may be performed automatically as described above, or may be performed manually.

  If it is determined in step S912 that grouping has been performed, the process proceeds to step S911, and the same processing is performed thereafter.

  If it is determined in step S912 that the images are not grouped, the process advances to step S906 to perform normal reproduction according to the operation information.

  As is clear from the above description, in the conference system according to the present embodiment, when there is a change in the drawing content of the drawing area, the change content is recorded in the operation information table. Furthermore, when the change in the drawing content is a change in each drawing object on the drawing area, the content of the change is recorded in the drawing object table. As a result, when reproducing the drawing content, it is possible to determine whether or not the operation information is necessary for reproduction based on the operation information table and the drawing object table and to determine the reproduction timing.

  As a result, it is possible to reproduce only the operation information necessary for reproduction at an appropriate timing, and it is possible to easily realize reproduction that shortens the reproduction time and easily grasps the contents.

[Second Embodiment]
In the first embodiment, the operation information table 251 and the drawing object table 252 are recorded and the drawing contents are reproduced by the personal computer 104 connected to the rear projection display 101. However, the present invention is not limited to this. For example, a device for recording the operation information table and the drawing object table and a device for reproducing the drawing contents may be provided separately via a network. Hereinafter, the display control apparatus according to the present embodiment will be described. In the following, only differences from the first embodiment will be described.

  FIG. 11 is an overall configuration diagram of a conference system (display control system) using the display control apparatus according to the present embodiment. In FIG. 11, reference numerals 1101 and 1102 denote conference systems each including a rear projection display, a personal computer, and a digitizer pen, and have the same configuration as shown in FIG.

  Reference numeral 1103 denotes a network such as the Internet. A conference server 1104 stores the operation information table and the drawing object table received from the conference systems 1101 and 1102 at each point. A personal computer 1105 functions as a display control device.

  The conference is performed at the conference system 1101 or 1102 at each point, and the operation information table and the drawing object table recorded there are stored in the conference server 1104 via the network 1103 through the network interface unit of each conference system.

  The reproduction of the drawing content can be performed by a device that can be connected to the conference server 1104 via the network 1103 such as the personal computer 1105 in addition to the conference systems 1101 and 1102. These devices have a function for executing the playback mode of the electronic whiteboard application.

  In the present embodiment, the operation information is acquired and the reproduction portion is extracted by the personal computer 1105 in the reproduction of the drawing content, but the present invention is not limited to this. For example, a part or all of the above processing (acquisition of operation information, extraction of a reproduction part) may be performed on an external information processing apparatus such as the conference server 1104, and only reproduction display may be performed by a personal computer.

  As described above, according to the present embodiment, it is possible to reduce the reproduction time and easily reproduce the content when reproducing the drawing content using the operation information recorded in the conference system including the remote conference. Is possible. Moreover, it is possible to reduce the processing load on the playback device by performing a part or all of the processing other than display with a display control device other than the playback device.

[Other Embodiments]
Note that the present invention can be applied to a system (for example, a copier, a facsimile machine, etc.) consisting of a single device even if it is applied to a system composed of a plurality of devices (for example, a host computer, interface device, reader, printer, etc.). You may apply.

  Needless to say, the object of the present invention can also be achieved by supplying a system or apparatus with a recording medium that records a program code of software that implements the functions of the above-described embodiments. In this case, the function is realized by the computer (or CPU or MPU) of the system or apparatus reading and executing the program code stored in the recording medium. In this case, the recording medium on which the program code is recorded constitutes the present invention.

  As a recording medium for supplying the program code, for example, a floppy (registered trademark) disk, hard disk, optical disk, magneto-optical disk, CD-ROM, CD-R, magnetic tape, nonvolatile memory card, ROM, or the like is used. be able to.

  Further, the present invention is not limited to the case where the functions of the above-described embodiments are realized by executing the program code read by the computer. For example, an OS (operating system) running on a computer performs part or all of actual processing based on an instruction of the program code, and the functions of the above-described embodiments may be realized by the processing. Needless to say, it is included.

  Further, when the program code read from the recording medium is written in a memory provided in a function expansion board inserted into the computer or a function expansion unit connected to the computer, the functions of the above-described embodiments are realized. Is also included. That is, after the program code is written in the memory, the CPU or the like provided in the function expansion board or function expansion unit performs part or all of the actual processing based on the instruction of the program code, and is realized by the processing. This is also included.

It is a figure which shows the external appearance structure of the conference system 100 which has a display control apparatus concerning the 1st Embodiment of this invention. FIG. 2 is a block diagram showing a configuration of each part constituting the conference system 100. 6 is a diagram illustrating an example of a UI displayed on the rear projection display 101 when a drawing mode of an electronic whiteboard application is activated in the conference system 100. FIG. An example of the operation information table 251 in which operation information is recorded when the drawing content drawn in the drawing area 301 is changed in accordance with a user operation while the drawing mode of the electronic whiteboard application 240 is being executed. FIG. 6 is a diagram illustrating an example of a drawing object table 252 that records information on a drawing object that has been generated or edited during execution of the playback mode of the electronic whiteboard application 240 in the conference system 100. FIG. 6 is a diagram showing an example of a playback window 600 that plays back the drawing content drawn in the drawing area 301 during the conference based on the operation information table 251 and the drawing object table 252 in the conference system 100. FIG. 7 is a flowchart showing a conference playback processing procedure in a playback mode of an electronic whiteboard application 240 of the conference system 100. It is the flowchart which showed the reproduction | regeneration processing procedure performed based on the operation information of the designated operation information table. 10 is a flowchart showing details of a reproduction process (step S804) in the reproduction process procedure of the conference system 100. It is the figure which showed the example of a display screen of a temporary drawing object. It is a whole block diagram of the conference system using the display control apparatus concerning the 2nd Embodiment of this invention.

Claims (9)

A display control method in a display control device connected to a display device,
An acquisition step of acquiring information regarding the content of the change from a recording device that records the content of the change when the content of the drawing area for drawing the object changes;
A determination step of determining information to be used for reproduction of the drawing content from the information acquired in the acquisition step, and determining a reproduction timing of the drawing content based on the information;
A step of extracting information determined to be used for reproduction in the determination step, and reproducing the drawing content on the display device at the determined reproduction timing using the extracted information. A characteristic display control method.   The information on the contents of the change includes an operation information table in which user operation information for changing the drawing contents drawn in the drawing area is sequentially recorded, and a drawing in which information on objects in the drawing area changed by the operation is sequentially recorded. The display control method according to claim 1, further comprising an object table.   When the operation information recorded in the operation information table is operation information related to a page operation for moving a page defined in the drawing area and is a continuous page operation, the determination step includes the continuous operation The display control method according to claim 2, wherein the operation information related to the first page operation and the operation information related to the last page operation of the performed page operation are determined as information to be used for reproducing the drawing content.   If the operation information recorded in the operation information table includes operation information related to an object generation operation in the drawing area and operation information related to an object deletion operation generated by the generation operation, the determination step The display control method according to claim 2, wherein the operation information regarding the generation operation and the operation information regarding the erasing operation are determined not to be information to be used for reproducing the drawing content. Further comprising a grouping step of grouping information on the plurality of objects recorded in the drawing object table;
The determining step determines the reproduction timing of the information related to the plurality of objects grouped in the grouping step as the reproduction timing of the information related to the object first recorded in the drawing object table in the group. The display control method according to claim 1.   The grouping step groups information related to a plurality of objects that form one character or one word by reproducing each of the information related to the objects recorded in the drawing object table as a same group. The display control method according to claim 5, wherein:   When the operation information recorded in the operation information table is operation information related to the editing operation of the object in the drawing area, the reproduction step uses the operation information related to the editing operation to reproduce the drawing content. The display control method according to claim 2, wherein the object after the editing is finished by the editing operation is reproduced. A display control device connected to the display device,
An acquisition means for acquiring information about the content of the change from a recording device that records the content of the change when the content of the drawing drawn in the drawing area for drawing the object changes;
A determination unit that determines information to be used for reproducing the drawing content from the information acquired by the acquisition unit, and determines a reproduction timing of the drawing content based on the information;
Information that is determined to be used for reproduction by the determination means, and using the extracted information, reproduction means for reproducing the drawing content on the display device at the determined reproduction timing. A display control device. A control program for causing a computer to execute the display control method according to claim 1.

Images