JP2007066081A - Electronic conference device, and electronic conference device control program - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To notify another person clearly of an object pointed in a display screen. <P>SOLUTION: The electronic conference device 1 designates a fixed range of an image displayed on a display device according to input operation received from personal computers 2, 3 and 4 and a PDA 5 through a network, generates an object based on the corresponding partial image, and also stores a display image that is ranged as a whole image in association with the object. The electronic conference device 1 displays the object with the whole image. When the displayed object is selected by input operation by a pointing device or the like, the selected object is highlighted in a special format. <P>COPYRIGHT: (C)2007,JPO&INPIT

Description

  The present invention relates to an electronic conference device and an electronic conference device control program for supporting a conference by sharing data among information devices used by attendees of the conference.

  Conventionally, systems for electronically supporting a conference have been considered (for example, Patent Documents 1 and 2).

  The electronic support device described in Patent Document 1 is shared with an information sharing area for sharing information, which is personal knowledge transmitted by the conference attendee via the information processing device, with all the conference attendees. Clearly distinguish it from the selected display area for editing the structure of information that is knowledge, and display it on a display device that can be commonly viewed by attendees of the conference, and in this state displayed on the display device, When a predetermined object is specified from the objects displayed in the information sharing area (file icon, temporarily copied information (character string, image, etc.)), the specified object is selected in the selection display area. Can be displayed at the position.

  This allows other meeting attendees and meeting facilitators to easily recognize that the information provided by one meeting attendee has been updated, and the provided information is displayed directly in the selection display area. Since no synchronization processing is required in each information processing apparatus, the conference can be operated without hindering the progress of the discussion.

  The electronic conference system described in Patent Document 2 is a server / client type electronic conference system in which a plurality of clients are connected to one server, and each client can view or edit information on the server. A plurality of screen buffers for storing display screen data of a document are provided, and for each screen buffer, a shared screen mode in which a plurality of clients can simultaneously display the display screen data, or only one client can display the display screen data. When one of the individual screen modes is selected and the same document data is stored in both the server screen buffer in the shared screen mode and the server screen buffer in the individual screen mode, each client individually Document data stored in the screen buffer of the server in screen mode When editing operation and, at every predetermined timing corresponding to the operation, performed on the document data which the same editing operation and editing operation is stored in the screen buffer of the server in the shared-screen mode.

As a result, when adding or editing a shared document on an individual device, parts that are not needed by others or that are not desired to be seen by others are not shared by all devices, so they can be shared without worrying about the eyes of others. A document can be added and edited, and the convenience of users such as conference attendees can be improved.
JP 2003-28166 A JP 2003-281101 A

  In the devices (systems) described in Patent Documents 1 and 2, when pointing to an object displayed on the screen, a pointing device such as a mouse or a touch panel is operated to move the cursor to a desired object. Done.

  In general, a laser pointer or the like is used when pointing to an object on a whiteboard or screen. Since the laser pointer has high brightness, you can easily recognize the object you are pointing to, but the mouse cursor does not have high brightness like the laser pointer. Sometimes it was difficult to tell if

  An object of the present invention is to provide an electronic conference apparatus and an electronic conference apparatus control program that allow an object pointed on a display screen to be clearly recognized by others.

  According to the first aspect of the present invention, range specifying means for specifying a certain range of an image displayed on a display device, and object generation for generating an object based on a partial image corresponding to the range specified by the range specifying means Means, an object storage means for storing the object generated by the object generation means, and a display image targeted for range specification by the range specification means in association with the object stored in the object storage means as an entire image Whole image storage means for storing, object display means for displaying the object stored by the object storage means, object selection means for selecting an object displayed by the object display means, and selected by the object selection means Object special table Characterized by comprising the object highlighting means for highlighting by changing the form.

  According to a second aspect of the present invention, in the first aspect of the present invention, the object highlighting means changes the display mode of the object as time elapses.

  According to a third aspect of the present invention, in the second aspect of the present invention, the object highlighting means changes the first display form for changing the size of the object or the second display position for changing the object as time elapses. The object is highlighted in any of the display forms.

  According to a fourth aspect of the present invention, in the first aspect of the invention, the object display means is based on an input means for inputting a coordinate data string representing a locus, and a locus represented by the coordinate data string input by the input means. Operation discriminating means for discriminating the form of the designated operation for the object displayed by the step, wherein the object highlighting means emphasizes the object by a display form corresponding to the form of the designated operation discriminated by the operation discriminating means. It is characterized by displaying.

  According to a fifth aspect of the present invention, in the first aspect of the invention, there is provided setting means for setting display setting data that defines a form of highlighting, and the object highlighting means is a display set by the setting means. The object is highlighted by a display form corresponding to the setting data.

  The invention according to claim 6 is the invention according to claim 1, further comprising a history storage means for storing a history of data related to the highlighting executed by the object highlighting display means.

  According to a seventh aspect of the present invention, in the sixth aspect of the invention, the discriminating means for discriminating whether or not the history storage means stores data related to highlighting for the object selected by the object selecting means, It further comprises message display means for displaying a predetermined message when it is determined by the determination means that data is stored.

  The invention according to claim 8 is the invention according to claim 6, further comprising highlight reproduction means for reproducing the highlight for the object based on the data relating to the highlight stored by the history storage means. And

  According to the ninth aspect of the present invention, the computer generates an object based on a range designating unit for designating a certain range of the image displayed on the display device and a partial image corresponding to the range designated by the range designating unit. An object generating means for storing, an object storing means for storing the object generated by the object generating means, and a display image subjected to range specification by the range specifying means in association with the object stored in the object storing means An entire image storage means for storing an entire image; an object display means for displaying an object stored by the object storage means; an object selection means for selecting an object displayed by the object display means; and the object selection means. Selected object Characterized in that to function transfected as an object highlighted means for highlighting is changed to a special display form.

  According to the first and ninth aspects of the present invention, when any one of the objects generated in the image displayed on the display device is designated by the input operation by the user, the input operation is performed according to the input operation. Since an object can be selected, changed to a special display form, and highlighted, the object pointed on the display screen can be clearly recognized by others.

  According to the second aspect of the invention, in addition to the effect of the first aspect of the invention, the object can be recognized more clearly by changing the display mode of the highlight display with the passage of time.

  According to the third aspect of the present invention, in addition to the effect of the second aspect of the invention, as a display form that changes with the passage of time, the size of the object is changed (enlarged / reduced), or the display position of the object By changing (swinging), the object can be clearly recognized.

  According to the fourth aspect of the invention, in addition to the effect of the first aspect, when the object to be highlighted is designated by writing using a pointing device, the object is designated by any trajectory. By highlighting based on whether or not it is (designation operation form), it is possible to improve the operability so that the object can be designated only by the writing operation and the form of the highlight display can be designated.

  According to the fifth aspect of the invention, in addition to the effect of the first aspect of the invention, the display setting data that defines the form of the highlight display can be set, so that the form of the highlight display can be arbitrarily changed. Can be recognized easily according to the situation.

  According to the sixth aspect of the present invention, in addition to the effect of the first aspect of the invention, data relating to highlighting performed on the object is stored as a history, for example, in a display screen during a meeting. The highlighting performed on the object can be confirmed, and based on this, the contents discussed in the meeting can be grasped.

  According to the seventh aspect of the present invention, in addition to the effect of the sixth aspect of the present invention, when the object selected as the target of highlighting has already been highlighted, for example, others who are participating in the conference are the same When an object is specified and highlighted, a message indicating who previously specified the object is displayed, so that discussion can be made more efficient and active.

  According to the eighth aspect of the invention, in addition to the effect of the sixth aspect of the invention, the data related to the highlighting performed on the object is sequentially stored in a history, that is, time-sequentially. Based on the above, it is possible to reproduce the highlight for the object in time series. Accordingly, for example, after the conference is ended, by confirming in time series which object is highlighted, it is possible to grasp a change in contents discussed in the conference.

Embodiments of the present invention will be described below with reference to the drawings.
FIG. 1 is a block diagram showing a system configuration using the electronic conference apparatus 1 in the present embodiment.

  In the electronic conference apparatus 1, a plurality of personal computers 2, 3, 4 and a personal digital assistant (PDA) 5 are wirelessly connected by a wireless local area network (LAN) or a wired connection by a USB (Universal Serial Bus) or the like. Connected by other networks. As for the interconnection method, other methods can be used in both cases of wireless and wired.

  In the electronic conference apparatus 1 according to the present embodiment, a virtual whiteboard (electronic whiteboard) is set and image data is managed by executing an electronic conference apparatus control program. In the present embodiment, an object as a unit of various processes is set in an image, and the object and the data of the entire image are managed in association with each other. The electronic conference apparatus 1 pastes, for example, data (coordinate time series data) representing a locus input by handwriting through a pointing device (mouse, tablet, etc.) or image data of a screen processed by an application on an electronic whiteboard. An image based on the image data managed by the electronic whiteboard can be projected (displayed) on the screen 7 through the projector 6 and shown to the attendees of the conference.

  The electronic conference apparatus 1 also shares image data managed by the electronic whiteboard with the personal computers 2, 3, 4 and the PDA 5 connected via a network (wireless LAN, USB, etc.). 3 and 4 and the PDA 5 can also display the same screen, accept input operations for image data, and execute various processes.

  Further, the electronic conference apparatus 1 inputs the results of various processes for the image data managed by the electronic whiteboard in the personal computers 2, 3, 4 and the PDA 5, selectively synthesizes them, and projects (displays) them through the projector 6. Can be made. For example, in the personal computers 2, 3, 4 and the PDA 5, a trajectory (coordinate data string) with respect to image data input using a pointing device (mouse, tablet, etc.) can be input and displayed. The trajectory data is used to determine which one of the personal computers 2, 3, 4 and the PDA 5 has designated an object displayed on the display screen.

FIG. 2 is a block diagram showing a detailed configuration of the electronic conference apparatus 1 shown in FIG.
As shown in FIG. 2, the electronic conference apparatus 1 includes a CPU (Central Processing Unit) 10, a RAM (random access memory) 11, a ROM (Read Only Memory) 12, an RTC (Real Time Clock) 13, a wireless LAN controller 14, It has a video signal output controller 15, LCD controller 16, device controller 17, USB controller 18, hard disk controller 19, LCD 20, pointing device 21, USB interface 22, and hard disk 23.

  The CPU 10 executes various programs stored in the ROM 12, an OS loaded from the hard disk 23, and various application programs. The application program includes a program that provides functions such as presentation, word processor, spreadsheet, and graphic drawing, and an electronic conference device control program for realizing the electronic whiteboard function in the present embodiment.

  The RAM 11 temporarily stores various programs and data, and is used as a work area for various processes executed by the CPU 10. When the electronic conference device control program (electronic whiteboard function) is executed, image data pasted on the electronic whiteboard and files of various data (objects, etc.) managed by this function are stored.

The ROM 12 stores a program for controlling the entire system in advance.
The RTC 13 is backed up by a dedicated battery and outputs data indicating the date and time.
The wireless LAN controller 14 controls wireless communication with the personal computers 2 and 3.

  The video signal output controller 15 outputs a video signal for causing the projector 6 to project an image, for example, by RGB or DVI (Digital Visual Interface). The video signal output controller 15 outputs a video signal for displaying an electronic whiteboard image under the control of the CPU 10 when the electronic whiteboard function is activated.

  The LCD controller 16 controls display on the LCD 20 under the control of the CPU 10. A pointing device 21 is integrated and integrated on the display surface of the LCD 20, and a handwriting (trajectory) corresponding to the coordinate time-series data input by the pointing device 21 is displayed in accordance with the input position.

  The device controller 17 performs input control of the pointing device 21. For example, the device controller 17 detects a portion where a pen tip of a pen used as a position instruction unit on the tablet contacts, and takes in the position information (coordinate data). Note that the tablet is integrated with the display surface of the LCD 20 in an overlapping manner. In addition, input control is performed using a pointing device such as a mouse other than a tablet.

  Under the control of the CPU 10, the USB controller 18 executes and controls data transfer conforming to the USB standard with other information devices such as the personal computer 4 and the PDA 5 connected via the USB interface 22.

  The hard disk controller 19 controls writing and reading of programs and data to and from the hard disk 23 under the control of the CPU 10. In addition to programs such as an OS (Operating System) program and various application programs (including an electronic conference device control program), the hard disk 23 includes files including image data and management / setting data managed by the electronic whiteboard function. It is recorded and read as needed. The management / setting data stored in the hard disk 23 includes terminal management data, object management data, and display setting data described later (details will be described later (FIGS. 3, 4, and 5)).

  In addition to the pointing device 21 integrated with the LCD 20 as a pointing device, coordinate time-series data representing handwriting according to drawing with a marker (pen) on the board in the shape of a general whiteboard is input. A possible apparatus may be connected to the electronic conference apparatus 1.

  In the system configuration shown in FIG. 1, the electronic whiteboard image data is output from the electronic conference apparatus 1 to the projector 6 and the image by the projector 6 is projected onto the screen 7. For example, the electronic conference apparatus 1 It is also possible to use a display having a large screen that receives data from and displays an image.

Next, an example of data managed in the electronic conference apparatus 1 will be described.
FIG. 3 shows an example of terminal management data for managing a plurality of terminals (personal computers 2, 3, 4, PDA 5) connected via a network. In the terminal management data, the terminal name of the terminal, the user name of the user who uses the terminal, data of display colors determined in advance for the terminal, and the like are associated. The terminal name and user name data are acquired from each terminal via the network, or acquired and set by another means. The display color data is arbitrarily set for each user. For example, when the user inputs a handwriting (coordinate data string) to the image on the display screen by a drag operation using a pointing device or the like, The color used when displaying this handwriting in an image is shown.

  FIG. 4 shows an example of object management data for managing data related to an operation for highlighting an object set in image data.

  The object management data includes, for example, data related to objects operated on the electronic whiteboard when the electronic whiteboard is used in a meeting, and is managed for each meeting, for example. That is, in the object management data, the meeting name is associated with the data related to the meeting (including the date, place, participant name, etc.), and the data indicating the object operated on the electronic whiteboard during the meeting. The operation data indicating the operation content for the object is associated with the operation data and sequentially set in time series. The operation data includes, for example, data indicating an operation date and time, an operator (user name), a designated operation form (a difference input operation form in which an object is selected), and the like.

  FIG. 5 shows an example of display setting data for managing data related to highlighting on an object. The display setting data includes setting data that defines a highlighted display form and reference data that serves as a determination criterion for an input operation for selecting an object (see FIG. 10).

  The setting data that defines the display form of the highlight display is set for each display form. In this embodiment, “enlarged type” and “rolling type” are prepared as display forms. For the “enlarged” display mode, for example, the time for changing the display (seconds), the enlargement rate (times), and the number of changes are set. For the “rolling type” display mode, for example, the time for changing the display (seconds), the swing width (magnification for the specified range), and the number of changes are set.

  The reference data is based on what trajectory is specified when performing an operation for specifying an object to be highlighted on the display screen by writing using a pointing device (a form of the specified operation), that is, an underline for the object. This is a reference value for determining whether or not the trajectory represents (underline) (see FIG. 12). Here, the upper limit of the difference in height (upper and lower ends of the trajectory) determined to be an underline is set. In addition, as a form of designation | designated operation, when writing the underline with respect to an object, the case where the locus | trajectory surrounding the area | region applicable to an object is written may be written (refer FIG. 13).

Next, the operation of the electronic conference apparatus 1 in this embodiment will be described.
First, the overall operation (electronic whiteboard processing) by the electronic conference apparatus 1 will be described with reference to the flowchart shown in FIG.

  When activated, the electronic conference apparatus 1 executes a confirmation process for terminals connected via a network (wireless LAN, USB, etc.) (step A1). In the electronic conference apparatus 1, for example, terminal management data as shown in FIG. 3 is stored in the hard disk 23 in advance, and data corresponding to a terminal whose connection has been confirmed is validated.

  The electronic conferencing apparatus 1 enables the electronic whiteboard function to be used through the network for the terminal whose connection has been confirmed. That is, the image data projected on the screen 7 managed by the electronic conference apparatus 1 is shared, and various processes can be executed by receiving an input operation on the image data.

  In the input operation, in addition to an operation mode in which a command is selected from a menu or the like, input of coordinate data representing a locus in the image in the normal mode (handwriting input operation), input of coordinate data for selecting an object to be highlighted in the image ( It is possible to execute an operation mode such as an emphasis operation.

  Processing that can be executed by selecting a command includes objectification processing for generating an object from displayed image data, setting processing for setting a display mode of a difference for highlighting an object, and emphasis processing based on the highlighting history for the object. Reproduction operation processing that reproduces

  When the electronic conference apparatus 1 receives an input operation on the pointing device 21 or an operation from the personal computers 2, 3, 4 and the PDA 5 connected via the network (step A2), the electronic conference apparatus 1 executes processing corresponding to the operation mode (step A2). Step A3) (details will be described later).

  The electronic conference apparatus 1 executes processing according to the operation mode, updates display data according to the processing result (step A4), outputs the display data to the projector 6, and projects (displays) it on the screen 7. (Step A5).

  Next, details of the process (step A3) corresponding to the operation mode shown in the flowchart of FIG. 6 will be described with reference to the flowchart shown in FIG.

  First, the CPU 10 of the electronic conference apparatus 1 discriminates an operator based on which terminal has received input operation data through the network through the wireless LAN controller 14 or the USB controller 18 (USB interface 22) (steps). B1). Note that the input from the device controller 17 is determined as an input operation to the pointing device 21.

  Here, when the received input operation is command designation (step B2, Yes), the CPU 10 executes processing according to the command. Details of the objectification processing, setting processing, and reproduction operation processing executed by command designation will be described later.

  On the other hand, if the coordinate data is input by operating the pointing device (step B4, Yes), the CPU 10 executes handwriting data input processing if the current operation mode is a handwriting input operation (steps B5 and B6). In the handwriting data input process, the input coordinate data string is combined with the current image data, and a locus representing the handwriting is drawn in the image.

  Further, if the current operation mode is an emphasis operation, the CPU 10 executes an emphasis process (steps B5 and B8). In the highlighting process, an object selected as a highlighting target is determined based on the input coordinate data, and a highlighting display mode corresponding to an input operation for selecting the object is determined and displayed. The object is highlighted according to the form (details will be described later).

  In addition, when it is other input operation (step B4, No), the other process according to the input operation is performed (step B7).

  Next, object conversion processing for generating an object from displayed image data will be described with reference to the flowchart shown in FIG. FIG. 9 shows an example of an image that is a target of objectification processing.

  The input operation for illuminating the object may be performed in the electronic conference apparatus 1 or may be performed in terminals (personal computers 2, 3, 4 and PDA 5) connected via a network.

  First, when “objectification” is selected from the menu (step C1, Yes), the CPU 10 converts the specified range into, for example, a rectangle based on the coordinate time-series data input by the drag operation for specifying the range. Set by frame. For example, the rectangular frame is set by a straight line in the horizontal and vertical (x, y) direction located at a predetermined distance from the image within the specified range.

  For example, as shown in FIG. 9A, when an image handwritten and input as “whiteboard” is converted into an object, as shown in FIG. 9B, the object conversion target range is surrounded. A correct trajectory. As a result, as shown in FIG. 9C, a “whiteboard” and a range-designated rectangular frame including the handwritten input image are set.

  The CPU 10 cuts out an image (partial image) within the range specification and temporarily stores it in the RAM 11 (step C2). Then, the CPU 10 generates an object based on the partial image and the position of the designated range, adds a rectangular frame to the cut partial image, and pastes it as an object on the electronic whiteboard (step C3). At this time, the object is pasted at the position where the partial image is cut out.

  In object generation, a file for storing various data is generated and stored. That is, (1) a screen file obtained by removing an object (partial image) from the entire image, (2) a thumbnail image file of the entire image, (3) an object setting file, and (4) an object image file.

  The object setting file includes data (hereinafter referred to as object data) consisting of a set of data indicating the position and size of the object in the entire image and the object image file name (pasted image name) in the entire image. Is included for the set object. The data indicating the position of the object is defined by data indicating the xy coordinates of the vertex as the starting point of the rectangular frame set for the range-specified image and the sizes in the xy directions from the starting point.

  When the object is generated, the CPU 10 manages the object and an image (overall image, partial image) related to the object by generating each file described above. The CPU 10 saves the files related to these objects and ends the objectification process (step C4).

  Next, a setting process for setting a display form when highlighting an object in an image will be described.

  For example, when a command for executing the setting process is designated, the CPU 10 starts the setting process and displays a setting screen for setting a display form as shown in FIG. 10, for example.

  In the setting screen shown in FIG. 10, items for setting setting data for defining a display form for highlighting and reference data serving as a determination criterion for an input operation for selecting an object are prepared.

  As setting data for defining the display form of the highlight display, items for individually setting “enlarged type” and “rolling type” are prepared. For the “enlarged” display mode, for example, the time for changing the display (0.1 to 9.9 seconds), the enlargement rate (1.1 to 9.9 times), and the number of changes (2 to 99 times), respectively. It can be arbitrarily set within the settable range. Similarly, for the “rolling type” display mode, for example, the time for changing the display (0.1 to 9.9 seconds), the swing width (magnification for the specified range) (1.1 to 9.9 times) The number of changes (2 to 99 times) can be arbitrarily set within each settable range.

  In addition, as reference data, the upper limit of the height difference determined to be an underline, which is a reference value for determining whether or not the locus represents an underline (underline) with respect to an object, is the number of pixels (4 to 99 pixels). It can be set by specifying.

  When the “OK” button in the setting screen is designated after the setting operation for each item is performed, the CPU 10 displays the data set for each item as a display setting data as shown in FIG. 23 and the setting process is terminated.

  If the “cancel” button on the setting screen is designated, the data set for each item is discarded and the setting process is terminated.

  The display setting data set by the setting process is referred to when an input operation for instructing execution of object highlighting is performed in an emphasis process described later.

  Next, highlighting processing for highlighting an object in a special display form will be described with reference to a flowchart shown in FIG.

  Coordinate data input when the operation mode is an emphasis operation is sequentially acquired and stored as data for selecting an object to be highlighted (step D1). Here, continuous coordinate data, that is, coordinate data representing a locus input by a drag operation of the pointing device is input. This acquisition of coordinate data is executed until the drag operation is completed (step D2).

  When the acquisition of the coordinate data is completed, the CPU 10 determines the form of the trajectory (designation operation form) input by the input operation for selecting an object based on the input coordinate data (step D3).

  In the present embodiment, the display form for the object selected as the highlight target is determined according to the form of the designation operation. Here, it is assumed that the object is selected by specifying a range that specifies the area range corresponding to the object or by adding an underline to the object. It is assumed that “rolling type” highlighting is set.

  FIG. 12 shows an example of a trajectory indicating a range designation or an underline input by a drag operation.

  The CPU 10 compares the input coordinate data (trajectory) with a value (hereinafter referred to as a set value) of “the upper limit of the height difference determined to be underline” indicated by the display setting data set by the setting process. To determine whether the range is specified or underlined.

  The trajectory indicated by A in FIG. 12 overlaps the character (or object), and the height (difference between the upper and lower ends of the trajectory) exceeds the set value, so it is determined that the range is designated. The trajectory shown in B overlaps with the character but is determined to be underlined because the height is less than the set value. The trajectory shown in C does not overlap the character, and the height is less than the set value, so it is determined as an underline. The trajectory shown in D is determined to be underlined because the height exceeds the set value but does not overlap the character.

  If the CPU 10 determines that the range is designated by the locus indicated by the input coordinate data (Yes in step D3), the object stored by the objectization process indicates whether the object is set at the position corresponding to the locus. Is determined based on the data related to the file, that is, the data indicating the position of the object.

  Here, when the object does not exist (step D4, No), the CPU 10 acquires an image in a range indicated by the locus, and is set for the operator determined in step B1 (FIG. 7) for this image. The display color is highlighted (step D9). The display color set for the operator is determined by referring to display color data corresponding to the user name (operator) set in the terminal management data (see FIG. 3).

  FIG. 13 shows an example of an image corresponding to the range indicated by the trajectory. A shown in FIG. 13 is a trajectory determined as the range designation. In the case of designating a range, for example, an image in a rectangular frame surrounded by a line parallel to the xy coordinate axes in contact with the upper and lower ends and the left and right ends of the trajectory is acquired.

  On the other hand, if an object exists at the position specified in the range (step D4, Yes), the CPU 10 searches the object management data for the corresponding object, and checks whether operation data is stored in association with this object. Determine. That is, it is determined whether the same object has been designated as a highlight target in the past.

  If it has been designated in the past, the CPU 10 displays a predetermined message, for example, in the vicinity of the object on the display screen (step D6).

  FIG. 14 shows an example in which a message is displayed in the vicinity of an object (an image representing the character “target” in the figure). In the example shown in FIG. 14, a message indicating the operation content stored as operation data in the object management data as a message, that is, the operation date and time, the operator (user name), and the form of the designated operation is displayed.

  For example, when another person who is participating in a conference specifies and highlights the same object, it is possible to confirm when and who previously specified the object by displaying a message. Can be achieved.

  Note that the content of the message is not limited to the example of FIG. 14, and part of the operation data may be selectively used.

  When the message is displayed, after a predetermined time (for example, 1 second) elapses, the message display is stopped and the object is highlighted by “enlarged type” (step D7). The CPU 10 performs image processing on the object image in accordance with data (time, enlargement rate, number of times) set in advance for the “enlargement type” of the display setting data, and displays the image.

  FIG. 15 shows an example in which “enlarged type” highlighting is performed on the object representing the character “target”. FIG. 15A shows the original display form. As shown in FIGS. 15B to 15E, the object is highlighted by sequentially enlarging it according to a predetermined enlargement ratio as time passes. ing.

  As a result, the object pointed on the display screen can be clearly recognized by others.

  When the CPU 10 finishes highlighting the object by the “enlarged type”, the CPU 10 sets the operation content of the highlighting in the object management data as history data (step D8). That is, the operation data indicating the operation content (“enlarged type”) for the object is stored in association with the data indicating the object to be enlarged. In the object management data, for example, data indicating objects and operation data for each meeting are classified and sequentially stored. Note that the conference name and conference data in the object management data are separately input and stored by the user.

  By the way, when it is determined that the input coordinate data is underlined by the trajectory indicated by the input coordinate data (step D10, Yes), whether the object is set at the position corresponding to the trajectory is related to the object stored by the object processing. It is determined based on the file to be processed, that is, data indicating the position of the object.

  Here, when the object does not exist (step D11, No), the CPU 10 acquires an image in the range indicated by the locus in the same manner as in the range designation, and discriminates this image in step B1 (FIG. 7). The displayed color is highlighted with the display color set for the operator (step D15).

  B shown in FIG. 13 is a locus determined as an underline. In the case of the underline, for example, it is surrounded by a line parallel to the xy coordinate axes that are in contact with the upper and lower ends and the left and right ends of coordinate data (characters, etc.) that exist continuously above the trajectory with a distance within a predetermined distance. Get the image inside the rectangular frame. In the case of the underline shown in B of FIG. 12, an image representing the characters “plan” is acquired. In the case of the underline indicated by D in FIG. 12, there is no image data within a predetermined range above the trajectory. In this case, the designation by the underline may be invalidated.

  On the other hand, when the object exists at the position designated by the underline (step D11, Yes), the CPU 10 searches the object management data for the corresponding object in the same manner as the range designation, and corresponds to this object. In addition, it is determined whether operation data is stored. That is, it is determined whether the same object has been designated as a highlight target in the past.

  If it has been designated in the past, the CPU 10 displays a predetermined message, for example, in the vicinity of the object on the display screen, for example, as shown in FIG. 14, as in the case of range designation (step D13). ).

  When the message is displayed, after a predetermined time (for example, 1 second) elapses, the message display is stopped and the object is highlighted by the “rolling type” (step D14). The CPU 10 performs image processing on the object image in accordance with data (time, width of swing, number of times) set in advance for the “rolling type” of the display setting data, and displays the image.

  FIG. 16 shows an example in which “rolling type” highlighting is performed on the object representing the character “target”. FIG. 16A shows the original display form. As shown in FIGS. 16B to 16E, the display position of the object is sequentially changed according to a predetermined roll width as time passes. Is highlighted.

  As a result, the object pointed on the display screen can be clearly recognized by others.

  When the CPU 10 finishes highlighting the object by the “rolling type”, the CPU 10 sets the operation contents of the highlight display in the object management data as history data (step D8). That is, operation data indicating the operation content ("rolling type") for the object is stored in association with data indicating the object to be enlarged.

  In this way, it is possible to easily select an object to be highlighted by an input operation on the displayed image, and to simultaneously specify a display form to be highlighted by a designation operation form (range designation, underline). Therefore, good operability can be provided.

  In the above description, the highlight display form is specified by the specification operation form (range specification, underline). For example, a menu button as shown in FIG. 17 is set on the display screen, and this button is used. The form of highlighting may be explicitly specified by a selection operation.

  FIG. 17B shows an enlarged part of the menu button shown in FIG. The button A shown in FIG. 17B corresponds to a “rolling type” display button, and the button B corresponds to a “enlarged type” display form.

  For example, after selecting the button A, an input operation for selecting an object is performed, so that the selected object is highlighted by the “rolling type” display form indicated by the button A.

  Note that a button C (“Open” button) shown in FIG. 17B is a button that can instruct a reproduction operation process described later, and a button D can instruct execution (command) of a setting process. By selecting these buttons, the corresponding process can be executed.

  By preparing such a menu, even a user who is inconvenient to input a trajectory with a pointing device can easily highlight an arbitrary object.

  Next, the reproduction operation process for reproducing the highlight process based on the highlight display history for the object will be described with reference to the flowchart shown in FIG. In the reproduction operation process, the highlight display for the object is reproduced in time series based on the data recorded as the history data in the object management data.

  In a state where an image can be displayed (projected) by electronic whiteboard processing (step E1, Yes), the CPU 10 selects a command (for example, an “Open” button) that instructs reading of object management data (step E2). , Yes), the conference name and conference data are read out from the object management data, and the conference record list image is displayed (step E3).

  FIG. 19 shows an example of a screen on which a conference record list is displayed. In the example shown in FIG. 19, the meeting date and time, the meeting name, and the meeting place are displayed in a list in association with each other. In the conference record list display, any one can be arbitrarily selected by operating a pointing device, for example.

  Here, when any conference is set and the “OK” button is designated, the CPU 10 reads the object management data of the selected image objection (step E5). For example, when “XX conference” is selected, data indicating the object to be highlighted and the operation data history set in association with the conference name are acquired.

  Then, an image is displayed based on the image data used in the conference (whole, each object file), the first object and operation data are selected (step E6), and the object operation is reproduced (step E7). ). That is, the object corresponding to the data indicating the object is displayed with highlighting according to the operation content indicated by the operation data.

  Here, when an instruction to execute the next highlighting is input, for example, by an operation of the pointing device (step E8), the next object and operation data are selected and the object highlighting is similarly performed according to the corresponding data. Is reproduced (steps E6 and E7).

  In addition, when the instruction to execute the next highlighting is not input after a certain period of time (for example, 3 seconds (which may be arbitrarily set)) (Yes in step E9), the next data exists. If so (step E10, No), the next object and operation data are selected in the same manner, and the highlighted display of the object is reproduced according to the corresponding data in the same manner (steps E6, E7).

  Thus, in response to an instruction for the next operation or every time a certain time elapses, based on the data indicating the object to be highlighted and the operation data stored as history data in the object management data, Emphasis on objects executed by user operations during a meeting can be reproduced sequentially in time series.

  Thus, for example, after the meeting is over, by confirming which objects are highlighted in chronological order, what kind of discussion is done in the meeting and how the contents of the discussion change You can know what happened.

  In the above-described embodiment, the case of changing the size (“enlarged type”) and changing the display position (“rolling type”) are shown as the display forms of the object highlight display. Display is also possible. For example, not only enlargement as a size change but also reduction, or a combination of enlargement and reduction. May be. Furthermore, it is possible to change the display color of the object, change the shape of the object, rotate the object, and change the font and color of characters in the object with time. Moreover, the highlight display which combined these arbitrarily is also possible.

  Further, an electronic conference apparatus control program that can be executed by a computer that implements the electronic conference apparatus 1 is recorded on a recording medium such as a magnetic disk (flexible disk, hard disk, etc.), optical disk (CD-ROM, DVD, etc.), semiconductor memory, etc. Or can be provided through a communication medium. By controlling the operation of the computer by the electronic conferencing apparatus control program, the functions in the above-described embodiments can be realized.

The block diagram which shows the system configuration | structure which uses the electronic conference apparatus 1 in this embodiment. The block diagram which shows the detailed structure of the electronic conference apparatus 1 shown in FIG. The figure which shows an example of the terminal management data for managing the some terminal (personal computer 2,3,4, PDA5) connected via a network. The figure which shows an example of the object management data for managing the data regarding the operation for the highlighting with respect to the object set in image data. The figure which shows an example of the display setting data for managing the data regarding the highlighting with respect to an object. The flowchart for demonstrating the whole operation | movement (electronic whiteboard process) by the electronic conference apparatus 1. FIG. The flowchart for demonstrating the detail of the process (step A3) according to operation mode. The flowchart for demonstrating the object-ization process for producing | generating an object from the displayed image data. The flowchart for demonstrating the object-ization process for producing | generating an object from the displayed image data. The figure which shows an example of the setting screen for setting a display form. The flowchart for demonstrating the emphasis process for highlighting an object on a special display form. The figure which shows an example of the locus | trajectory showing the range designation | designated or underline input by drag operation. The figure which shows an example of the image applicable to the range which a locus | trajectory shows. The figure which shows the example by which the message was displayed in the vicinity of the object. The figure which shows the example by which the "enlarged type" highlight display was carried out with respect to the object showing the character of "target". The figure which shows the example by which the highlight of "rolling type" was highlighted with respect to the object showing the character of "target". The figure which shows the example of a setting of a menu button. The flowchart for demonstrating the reproduction operation process which reproduces an emphasis process based on the history of the emphasis display with respect to an object. The figure which shows an example of the screen as which the meeting record list was displayed.

Explanation of symbols

  DESCRIPTION OF SYMBOLS 1 ... Electronic conference apparatus, 2, 3, 4 ... Personal computer, 5 ... PDA, 6 ... Projector, 7 ... Screen, 10 ... CPU, 11 ... RAM, 12 ... ROM, 13 ... RTC, 14 ... Wireless LAN controller, 14a DESCRIPTION OF SYMBOLS: Antenna, 15 ... Video signal output controller, 16 ... LCD controller, 17 ... Device controller, 18 ... USB controller, 19 ... Hard disk controller, 20 ... LCD, 21 ... Pointing device, 22 ... USB interface, 23 ... Hard disk.

Claims (9)

A range specifying means for specifying a certain range of an image displayed on the display device;
Object generating means for generating an object based on a partial image corresponding to the range specified by the range specifying means;
Object storage means for storing the object generated by the object generation means;
Whole image storage means for storing a display image which is a target of range designation by the range designation means in association with an object stored in the object storage means as a whole image;
Object display means for displaying the object stored by the object storage means;
Object selection means for selecting an object displayed by the object display means;
An electronic conference apparatus, comprising: an object highlighting display unit that highlights an object selected by the object selection unit by changing it to a special display form.   The electronic conference apparatus according to claim 1, wherein the object emphasis display unit changes a display form of the object with time.   The object highlighting means highlights an object in either a first display form for changing the size of the object or a second display form for changing the display position of the object as time elapses. The electronic conference apparatus according to claim 2. An input means for inputting a coordinate data string representing the locus;
Operation discriminating means for discriminating the form of the designation operation for the object displayed by the object display means, based on the locus represented by the coordinate data string input by the input means,
2. The electronic conference apparatus according to claim 1, wherein the object highlighting means highlights the object in a display form corresponding to a designated operation form determined by the operation determining means. Having setting means for setting display setting data that defines the form of highlighting;
2. The electronic conference apparatus according to claim 1, wherein the object highlighting means highlights an object in a display form corresponding to display setting data set by the setting means.   2. The electronic conference apparatus according to claim 1, further comprising history storage means for storing a history of data relating to highlighting executed by the object highlighting means. (Displays a predetermined message (date and time, name of the selected person, etc.) when the selected object has been highlighted in the past)
A discriminating unit for discriminating whether or not data relating to highlighting for the object selected by the object selecting unit is stored in the history storage unit;
7. The electronic conference apparatus according to claim 6, further comprising message display means for displaying a predetermined message when the determination means determines that data is stored.   7. The electronic conference apparatus according to claim 6, further comprising highlight display reproduction means for reproducing the highlight display on the object based on the data related to the highlight display stored by the history storage means. Computer
A range specifying means for specifying a certain range of an image displayed on the display device;
Object generating means for generating an object based on a partial image corresponding to the range specified by the range specifying means;
Object storage means for storing the object generated by the object generation means;
Whole image storage means for storing a display image which is a target of range designation by the range designation means in association with an object stored in the object storage means as a whole image;
Object display means for displaying the object stored by the object storage means;
Object selection means for selecting an object displayed by the object display means;
An electronic conference device control program for causing an object selected by the object selecting unit to function as an object highlighting display unit that highlights an object by changing it to a special display form.

Images