JP2006099414A - Electronic conference device and electronic conference device control program - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To attain support for activating discussion in a conference. <P>SOLUTION: An electronic conference device 1 inputs the designation of a fixed range with respect to an overall image, and generates an object by segmenting a partial image from an image pertinent to the inputted range designation, and stores the generated object while making it related with an overall image. The electronic conference device 1 displays the generated object, and inputs and processes various operations, and displays the overall image corresponding to the object in response to an instruction of selecting the displayed object. <P>COPYRIGHT: (C)2006,JPO&NCIPI

Description

  The present invention relates to an electronic conference device and an electronic conference device control program for supporting a conference by sharing data among information devices used by attendees of the conference.

  Conventionally, systems for electronically supporting a conference have been considered (for example, Patent Documents 1 and 2).

  The electronic support device described in Patent Document 1 is shared with an information sharing area for sharing information, which is personal knowledge transmitted by the conference attendee via the information processing device, with all the conference attendees. Clearly distinguish it from the selected display area for editing the structure of information that is knowledge, and display it on a display device that can be commonly viewed by attendees of the conference, and in this state displayed on the display device, When a predetermined object is specified from the objects displayed in the information sharing area (file icon, temporarily copied information (character string, image, etc.)), the specified object is selected in the selection display area. Can be displayed at the position.

  This allows other meeting attendees and meeting facilitators to easily recognize that the information provided by one meeting attendee has been updated, and the provided information is displayed directly in the selection display area. Since no synchronization processing is required in each information processing apparatus, the conference can be operated without hindering the progress of the discussion. In addition, during the discussion using the selection display area by all meeting attendees, mainly the facilitator of the meeting, for the information generated / provided in a divergent manner, a grant attribute combining at least two attribute values is added. Since it can be given, the relationship between each information can be organized on the spot, and efficient information collection and information grasping can be performed.

  The electronic conference system described in Patent Document 2 is a server / client type electronic conference system in which a plurality of clients are connected to one server, and each client can view or edit information on the server. A plurality of screen buffers for storing display screen data of a document are provided, and for each screen buffer, a shared screen mode in which a plurality of clients can simultaneously display the display screen data, or only one client can display the display screen data. When one of the individual screen modes is selected and the same document data is stored in both the server screen buffer in the shared screen mode and the server screen buffer in the individual screen mode, each client individually Document data stored in the screen buffer of the server in screen mode When editing operation and, at every predetermined timing corresponding to the operation, performed on the document data which the same editing operation and editing operation is stored in the screen buffer of the server in the shared-screen mode.

As a result, when adding or editing a shared document on an individual device, parts that are not needed by others or that are not wanted to be seen by others are not shared by all devices, so they can be shared without worrying about the eyes of others. You can add and edit documents, improve the convenience of users such as meeting attendees, and display the same document as the document displayed on the shared screen on a separate screen that only you can see. Since the editing performed on the document displayed on the shared screen can be performed on the individual screen regardless of the display content of the shared screen, the convenience for the user can be improved.
JP 2003-28166 A JP 2003-281101 A

  In this way, the system for supporting a conventional meeting is configured so that information provided by individual attendees is considered while allowing information to be shared among attendees. Is supporting the meeting.

  However, in any system, meeting attendees share information to prevent the progress of discussions, or to improve the convenience of meeting attendees (users). It was not intended to stimulate the discussion itself by stimulating the creativity of attendees and providing more ideas.

  An object of the present invention is to provide an electronic conference device and an electronic conference device control program capable of supporting the activation of discussions in a conference.

  According to the first aspect of the present invention, range specifying means for specifying a certain range of an image displayed on a display device, and object generation for generating an object based on a partial image corresponding to the range specified by the range specifying means Means, an object storage means for storing the object generated by the object generation means, and an entire image for storing the display image targeted for the range specification as an entire image in association with the object stored in the object storage means Corresponding to the object selected by the object selection means, the object display means for displaying the object stored by the object storage means, the object selection means for selecting the object displayed by the object display means, and the object selection means The whole image memory Characterized by comprising the entire image display means for displaying the whole image stored by.

  According to a second aspect of the present invention, in the first aspect of the present invention, the display image that is the target of the range specification is an image displayed by another application.

  The invention according to claim 3 is the invention according to claim 1, characterized in that it has a pointing device, and the display image that is the target of the range specification is an image composed of data input from the pointing device. To do.

  According to a fourth aspect of the present invention, in the first aspect of the invention, the apparatus further comprises a time lapse determining means for determining a lapse of a predetermined time, and the object display means is predetermined by the time lapse determining means. When it is determined that a predetermined time has elapsed, the object stored by the object storage means is displayed.

  The invention according to claim 5 is the invention according to claim 4, further comprising condition setting means for setting a condition for displaying the object by the object display means, wherein the object display means is set by the condition setting means. The object is displayed according to the specified conditions.

  According to a sixth aspect of the present invention, in the first aspect of the present invention, in the first aspect, an array change request input means for inputting a change request for the arrangement of objects displayed by the object display means; and the object display means includes the array change request. Each time a change request is input by the input means, the arrangement of a plurality of objects stored in the object storage means is randomly changed and displayed.

  According to a seventh aspect of the present invention, in the first aspect of the present invention, the display request input means for inputting a display request for the object stored in the object storage means, and the object display means are input by the display request input means. A plurality of objects stored in the object storage means are displayed as a list in response to the displayed request.

  The invention described in claim 8 relates to the invention described in claim 1, wherein a plurality of object selection means for selecting a plurality of objects displayed by the object display means and a plurality of objects selected by the plurality of object selection means are associated with each other. And setting means for setting a predetermined common attribute.

  According to a ninth aspect of the present invention, in the first aspect of the invention, the object is connected between a connection unit connected to another information device via a network and the other information device connected by the connection unit. And sharing means for sharing the object stored in the storage means.

  According to a tenth aspect of the present invention, in the ninth aspect of the invention, a second object display means for displaying a device object corresponding to the other information device together with an object displayed by the object display means; In accordance with the instruction input by the related instruction input means, the related instruction input means for inputting an instruction indicating the association between the device object displayed by the object display means and the object displayed by the object display means, An association setting means for setting an association between the device object and the object is provided.

  According to an eleventh aspect of the invention, in the ninth aspect of the invention, image data storage means for storing image data corresponding to each of the other information devices connected by the connection means, and storage by the image data storage means. And a combination display means for selectively combining and displaying image data corresponding to each of the other information devices.

  According to a twelfth aspect of the present invention, a computer generates an object based on range designation means for designating a certain range of an image displayed on a display device, and a partial image corresponding to the range designated by the range designation means. Object generating means for storing, an object storing means for storing the object generated by the object generating means, and a display image which is a target of the range specification is stored as an entire image in association with the object stored in the object storing means. An entire image storage means, an object display means for displaying the object stored by the object storage means, an object selection means for selecting an object displayed by the object display means, and an object selected by the object selection means Corresponding to Whole image stored by serial whole image storage means, characterized in that to function as the entire image display means for displaying.

  According to the invention described in claims 1 and 12, when a certain range is specified for the displayed image, and some information is displayed in the image corresponding to the specified range, the information is displayed. Based on the partial image to be represented, an object as a processing unit of various processes can be generated. Therefore, if a characteristic part in the entire image, such as a character string, a figure, or an image, is converted into an object, this object is displayed on the screen, and various operations can be performed according to the content and progress of the meeting, for example, By moving, copying, deleting, etc., it is possible to stimulate the creativity of the conference attendees by functioning as an idea processor, and to stimulate discussion by providing more ideas. If an object is selected as necessary, the entire image including the object can be displayed and the details of the object can be easily confirmed.

  According to the second aspect of the invention, in addition to the effect of the first aspect of the invention, the object is generated from the image displayed on the screen by the other application, so that the information created by the other application can be easily conferenced. Can be used.

  According to the invention of claim 3, in addition to the effect of the invention of claim 1, in general, the contents of the discussion are often written down (handwritten) in a meeting or the like, and thus an object is generated from the handwritten memo contents. And can be used for meetings.

  According to the invention of claim 4, in addition to the effect of the invention of claim 1, when a predetermined time has passed, for example, when a certain time has passed since the last input operation, a conference is held. Since there is a possibility that the object is in a stagnation state, it is possible to stimulate the creativity by automatically displaying the object, and to activate the argument that stagnation is triggered by this.

  According to the fifth aspect of the present invention, in addition to the effect of the fourth aspect of the invention, conditions for displaying an object, such as a display start time (for example, a period during which no input operation is performed), an object to be displayed, By enabling the selection method, display pattern, and the like to be set according to the user's preference, it is possible to display objects that are effective for stimulating the conference by stimulating creativity.

  According to the sixth aspect of the present invention, in addition to the effect of the first aspect of the invention, when displaying an object, the arrangement of a plurality of objects is randomly changed so that the attendee of the meeting does not intend. By presenting object relationships, you can stimulate your creativity and activate your meeting.

  According to the seventh aspect of the present invention, in addition to the effect of the first aspect of the invention, a plurality of objects can be displayed in a list and presented to the meeting attendee, so that the items set as objects can be easily You can organize, and you can organize discussions and make meetings progress smoothly.

  According to the invention of claim 8, in addition to the effect of the invention of claim 1, a screen is obtained by selecting a plurality of objects and associating them and setting common attributes such as size, color, group, etc. By organizing the objects inside and clarifying the relationship between the objects, the progress of the conference using the objects can be made smooth and new creativity can be stimulated.

  According to the ninth aspect of the present invention, in addition to the effect of the first aspect of the invention, the object is shared by connecting to other information devices via the network and sharing the objects, so that the attendees of the conference can use each of them individually. The attendees can perform operations on the objects in the information equipment. In this case, the operation contents for the object can be shared by the meeting attendees, or can be handled as the examination contents of individual attendees using the object.

  According to the tenth aspect of the present invention, in addition to the effect of the ninth aspect, the apparatus object corresponding to each of the other information devices connected via the network, that is, the object corresponding to the conference attendee (attendance) (Person object) can be displayed and the association with other objects can be set, for example, the assignment of the person in charge of the matter represented by the object can be determined by the association with the object.

  According to the eleventh aspect of the invention, in addition to the effect of the ninth aspect of the invention, the operation contents for the shared object in other information devices connected via the network, that is, individual attendance using the object By separately storing image data representing the contents of a person's examination and combining them or displaying them using image data corresponding to a specific attendee, the opinions of attendees can be used as operations for objects in the meeting. Can be provided.

  Embodiments of the present invention will be described below with reference to the drawings.

  FIG. 1 is a block diagram showing a system configuration using the electronic conference apparatus 1 in the present embodiment.

  A plurality of personal computers 2, 3, 4, PDA (personal digital assistant) 5 and the like are connected to the electronic conferencing apparatus 1 by wireless connection using a wireless local area network (LAN) or wired connection using USB (Universal Serial Bus). ing. As for the interconnection method, other methods can be used in both cases of wireless and wired.

  In the electronic conference apparatus 1 according to the present embodiment, a virtual whiteboard (electronic whiteboard) is set and image data is managed by executing an electronic conference apparatus control program. In the present embodiment, an object as a unit of various processes is set in an image, and the object and the data of the entire image are managed in association with each other. The electronic conference apparatus 1 pastes data representing a locus input by handwriting (coordinate time series data) or image data of a screen processed by an application through an pointing device (such as a tablet) on the electronic whiteboard. An image based on the image data managed by the whiteboard can be projected (displayed) on the screen 7 through the projector 6 and shown to the attendees of the conference.

  The electronic conference apparatus 1 also shares image data managed by the electronic whiteboard with the personal computers 2, 3, 4 and the PDA 5 connected via a network (wireless LAN, USB, etc.). A similar screen can be displayed on the 3 and 4 and the PDA 5.

  Further, the electronic conference apparatus 1 inputs the results of various processes for the image data managed by the electronic whiteboard in the personal computers 2, 3, 4 and the PDA 5, selectively synthesizes them, and projects (displays) them through the projector 6. Can be made.

FIG. 2 is a block diagram showing a detailed configuration of the electronic conference apparatus 1 shown in FIG.
As shown in FIG. 2, the electronic conference apparatus 1 includes a CPU (Central Processing Unit) 10, a RAM (random access memory) 11, a ROM (Read Only Memory) 12, an RTC (Real Time Clock) 13, a wireless LAN controller 14, It has a video signal output controller 15, LCD controller 16, tablet controller 17, USB controller 18, hard disk controller 19, LCD 20, tablet 21, USB interface 22, and hard disk 23.

  The CPU 10 executes various programs stored in the ROM 12, an OS loaded from the hard disk 23, and various application programs. The application program includes a program that provides functions such as presentation, word processor, spreadsheet, and graphic drawing, and an electronic conference device control program for realizing the electronic whiteboard function in the present embodiment.

  The RAM 11 temporarily stores various programs and data, and is used as a work area for various processes executed by the CPU 10. When the electronic conference device control program (electronic whiteboard function) is executed, image data pasted on the electronic whiteboard and files of various data (objects, etc.) managed by this function are stored.

The ROM 12 stores a program for controlling the entire system in advance.
The RTC 13 is backed up by a dedicated battery and outputs data indicating the date.
The wireless LAN controller 14 controls wireless communication with the personal computers 2 and 3.

  The video signal output controller 15 outputs a video signal for causing the projector 6 to project an image, for example, by RGB or DVI (Digital Visual Interface). The video signal output controller 15 outputs a video signal for displaying an electronic whiteboard image under the control of the CPU 10 when the electronic whiteboard function is activated.

  The LCD controller 16 controls display on the LCD 20 under the control of the CPU 10. A tablet 21 is integrated on the display surface of the LCD 20 so that handwriting corresponding to coordinate time-series data input by the tablet 21 is displayed in accordance with the input position.

  The tablet controller 17 detects a portion where the pen tip of the pen used as the position instruction means on the tablet 21 has come into contact, and takes in the position information (coordinate data). The tablet 21 is integrated with the display surface of the LCD 20 in an overlapping manner.

  Under the control of the CPU 10, the USB controller 18 executes and controls data transfer conforming to the USB standard with other information devices such as the personal computer 4 and the PDA 5 connected via the USB interface 22.

  The hard disk controller 19 controls writing and reading of programs and data to and from the hard disk 23 under the control of the CPU 10. In addition to programs such as an OS (Operating System) program and various application programs (including an electronic conference device control program), the hard disk 23 records files including image data and setting data managed in the electronic whiteboard function. Read out as needed.

  In the configuration shown in FIG. 2, the tablet 21 is provided as a pointing device, but other pointing devices, a mouse, and other coordinate data input devices may be provided.

  In addition to the tablet 21 integrated with the LCD 20 as a pointing device, it is possible to input coordinate time series data representing handwriting according to drawing with a marker (pen) on the board in the shape of a general whiteboard. It is also possible to adopt a configuration in which a simple device is connected to the electronic conference device 1.

  In the system configuration shown in FIG. 1, the electronic whiteboard image data is output from the electronic conference apparatus 1 to the projector 6 and the image by the projector 6 is projected onto the screen 7. For example, the electronic conference apparatus 1 It is also possible to use a display having a large screen that receives data from and displays an image.

  Next, operation | movement of the electronic conference apparatus 1 in this embodiment is demonstrated, referring the flowchart shown in FIGS.

In the electronic conference apparatus 1 according to the present embodiment, the electronic whiteboard function executed by the electronic conference apparatus control program performs activation processing, drag processing (drag menu processing, object editing menu processing), file menu processing, and automatic object display processing. Execute.
Hereinafter, details of various processes executed by the electronic conference apparatus 1 will be described individually.

(Start process)
First, the activation process will be described with reference to the flowchart shown in FIG.

  In the electronic conference apparatus 1, an arbitrary application program can be executed. Applications include, for example, presentations, word processors, spreadsheets, and graphic drawing. In the electronic conference apparatus 1, when an application program is being executed, a screen processed by this application is displayed on the LCD 20.

  Here, when the execution of the electronic whiteboard function is instructed, the CPU 10 activates the electronic conference device control program and starts the activation process. First, the CPU 10 captures a screen when the electronic whiteboard function is activated, that is, acquires image data of a screen that is an object to be processed by the application at the time of activation, and temporarily stores it in the RAM 11 (step A1).

  The CPU 10 displays an electronic whiteboard screen (window) on the LCD 20 (step A2), and pastes the captured screen on the electronic whiteboard (step S3). Then, the CPU 10 enables the electronic whiteboard to be used, that is, inputs coordinate time-series data (handwriting data) by handwriting input operation using a pen on the tablet 21 so that an image representing the handwriting can be displayed.

  FIG. 11 shows an example of an electronic whiteboard display screen. The electronic whiteboard is provided with a handwriting input area in addition to a plurality of command buttons that can be instructed by a pen operation.

  When the screen processed by the application when the electronic whiteboard is activated is captured, the captured screen is displayed in the handwriting input area. For example, in the case of a presentation application, a character string, a figure, an image, and the like are displayed.

  In the above description, the screen by another application is captured and pasted on the electronic whiteboard. However, if the application is not executed when the electronic whiteboard function is activated, FIG. An electronic whiteboard in an initial state where an image as shown is not pasted is displayed.

  In this case, in the process described below, coordinate time-series data (image data) representing handwriting input by handwriting using a pen on an electronic whiteboard is set as a processing target. In the following description, image data input by handwriting will be described as a processing target.

(Drag processing)
Next, the drag process will be described with reference to the flowchart shown in FIG. In the drag process, various processes can be executed by a drag operation on the image data input (pasted) to the electronic whiteboard. The drag operation refers to an operation of inputting coordinate time series data by moving the pen tip in contact with the tablet 21.

  Here, for example, as shown in FIG. 12A, coordinate time-series data (image data) representing a character string ("whiteboard") input by handwriting is input to the electronic whiteboard. .

  When the electronic whiteboard is active (data input is possible) and the pen is in a mode as a tool for selecting an object, dragging using the pen in the data input area of the electronic whiteboard screen shown in FIG. When the range is specified by the operation (steps B1 to B3), the CPU 10 determines whether the object managed as the processing unit is included in the range specified by the drag operation (step B4). Details of the object will be described later (FIGS. 5 and 13).

  Whether or not the range is specified, for example, the end point and end point of the coordinate time series data input by the drag operation are located in the vicinity (or the handwriting intersects), and the coordinate time series data surrounds an area of a predetermined size or more. It is determined by whether or not

  For example, when the image data representing the handwritten character string shown in FIG. 12A is dragged so as to surround the character string as shown in FIG. Since no object is defined, it is determined that no object is included (No in step B4).

  In this case, the CPU 10 matches the timing when the pen is released from the tablet 21 (display screen of the LCD 20) (pen up) in the vicinity of the position where the image data is input by the drag operation, for example, FIG. ), A drag menu is displayed (step B7). In the drag menu, for example, command names (options) of “objectification”, “blank insertion”, “deletion (left justification)”, “erasure”, “copy”, and “move” are listed.

  Next, the CPU 10 executes a drag menu process for a process corresponding to the command selected from the drag menu (step B8).

FIG. 5 shows a flowchart of the drag menu process.
The processing other than the “objectification” of the drag menu is not directly related to the present invention, and thus the description thereof is omitted. If a part outside the drag menu is instructed with a pen (or clicked with a mouse or the like) (step C2, Yes), the drag menu is closed to return to the original display screen (step C3).

  First, when “objectification” is selected from the drag menu (step C1, Yes), the CPU 10 sets the specified range based on the coordinate time-series data input by the drag operation for specifying the range, for example. Set by a rectangular frame. For example, the rectangular frame is set by a straight line in the horizontal and vertical (x, y) direction located at a predetermined distance from the image within the specified range.

  Then, an image (partial image) within the specified range is cut out and temporarily stored in the RAM 11 (step C4). Then, the CPU 10 generates an object based on the partial image and the position of the designated range, adds a rectangular frame to the cut partial image, and pastes it as an object on the electronic whiteboard (step C5). At this time, the object is pasted at the position where the partial image is cut out.

  In the generation of the object, a file for storing various data as shown in FIG. 13 is generated. That is, (1) a screen file (file name: picmmddhhmm.bmp) obtained by removing an object (partial image) from the entire image, (2) a thumbnail image file (file name: sammmddhhmm.bmp) of the entire image ((2) in FIG. 13) (B)), (3) Object setting file (file name: cardmmddhhmm.def), (4) Object image file (file name: cardmmddhhmm.bmp).

  Note that the image file (FIG. 13 (2) (a)) of the entire image corresponding to the thumbnail image of the entire image is separately stored with a predetermined file name.

  In each file name, “mmddhhmm” indicates that the previous “mm” indicates the current month, “dd” indicates the current date, “hh” indicates the current time, and the subsequent “mm” indicates the current minute. When an object is generated, each is set based on data acquired from the RTC 13, and a file name is automatically generated.

  As shown in FIG. 13 (3), the configuration of the object setting file is data consisting of a set of data indicating the size and size of the object in the entire image and the object image file name (pasted image name). (Hereinafter, object data) is included in the entire image for the set object. The data indicating the position of the object is defined by data indicating the xy coordinates of the vertex as the starting point of the rectangular frame set for the range-specified image and the sizes in the xy directions from the starting point.

  When the object is generated, the CPU 10 manages the object and an image (overall image, partial image) related to the object by generating each file described above. The CPU 10 saves the files related to these objects (step C6) and closes the drag menu (step C7).

  FIG. 12D shows an example of a screen when an object is pasted and the drag menu is closed.

  Note that an object pasted on the screen can be edited by moving it to an arbitrary position on the screen in addition to editing using an object edit menu described later. For example, in the same manner as a GUI (Graphical User Interface) operation generally performed on a personal computer or the like, a drag operation is performed with an object selected with a pen so as to follow the movement position of the pen tip. Move the object to. When the object is moved, the object data (position data) of the object to be moved in the object setting file is changed.

  Here, when a drag operation for specifying a range of the objectized image shown in FIG. 12 is performed (FIG. 4, step B3, Yes), the CPU 10 includes each object included in the object setting file for the entire image. With reference to the data indicating the position of the object, it can be determined that the object is included in the specified range (step B4, Yes).

  In this case, the CPU 10 displays the object editing menu near the position where the image data is input by the drag operation in accordance with the timing when the pen is released from the tablet 21 (display screen of the LCD 20) (pen up). (Step B5). In the object editing menu, command names (options) of “delete”, “color coding”, “grouping”, “group release”, and “automatic size adjustment” are listed (FIGS. 15B and 16B). FIG. 17 (c)).

  Next, the CPU 10 executes object edit menu processing for various processing on the object according to the command selected from the object edit menu (step B6).

FIG. 6 shows a flowchart of the object edit menu process.
First, when “delete” is selected from the object editing menu (step D1, Yes), the CPU 10 closes the object editing menu and displays an object deletion confirmation message shown in FIG. 14 (step D7).

  If there is an input for selecting “OK” (step D8, Yes), the CPU 10 deletes the range-specified object (step D10), closes the deletion confirmation message, and ends the process. (Step D11). In this case, the object is deleted from the display screen, and the original image (partial image) is displayed. Further, the object data of the object to be deleted is deleted from the object setting file ((3) in FIG. 13). In addition, the screen file excluding the object (FIG. 13A) is also updated to image data including a partial image corresponding to the deleted object.

  On the other hand, when there is an input for selecting “cancel” from the object deletion confirmation message (step D9, Yes), the CPU 10 closes the deletion confirmation message and ends the process (step D11).

  Next, when “color classification” is selected from the object edit menu (step D2, Yes), the CPU 10 displays a color classification submenu provided with a plurality of colors as options (step D12).

  For example, as shown in FIG. 15A, in a screen on which two objects (“whiteboard” and “search”) are displayed, a range surrounds the two objects as shown in FIG. 15B. It shall be specified. In this case, when the object editing menu shown in FIG. 15B is displayed and “color coding” is selected, color coding using a plurality of colors “white”, “red”, “blue”, “green”,. Display a submenu.

  Here, when an instruction to select any color is input from the color classification submenu (step D13), the CPU 10 sets attribute data indicating the selected color (for example, “red”) to the object to be edited. The object is added in common, the object is changed to a red display (step D15), the object edit menu and the submenu are closed, and the process is terminated (step D16). For example, the attribute data indicating the color is managed by being added to the object data (FIG. 13 (3)) of each object included in the object setting file.

  For the object whose color is changed, only the frame display may be changed to red, or only a partial image in the frame or all the portions may be changed in color.

  On the other hand, when the part outside the object edit menu is instructed by the pen (or clicked with the mouse or the like) (step D14, Yes), the object edit menu is closed and the process is terminated (step D16).

  In the above description of “color classification”, the case of changing the color of two (plural) objects has been described, but it is of course possible to change the color by specifying one object.

  Next, when “grouping” is selected from the object editing menu (step D3, Yes), the CPU 10 executes grouping on the selected objects, closes the object editing menu, and ends the processing. (Step D17).

  For example, as shown in FIG. 16A, in a screen on which two objects (“projector” and “search”) are displayed, a range is specified so as to surround the two objects as shown in FIG. It shall be assumed. In this case, the object editing menu shown in FIG. 16B is displayed. When “Group” is selected here, the partial images of the two objects are combined into one partial image, and this partial image is displayed. An object consisting of is generated and displayed as shown in FIG.

  In this case, the image file of the object (FIG. 13 (4)) is changed to an image file of a partial image obtained by combining two partial images, and the combined image included in the object setting file (FIG. 13 (3)). Instead of the object data of the two objects, object data corresponding to the synthesized object is set.

  When performing “grouping” of objects, individual object files (object data included in object image files and object setting files) before grouping are referred to as “ungrouping” described later. It shall be memorized separately so that it can respond.

  Next, when “ungroup” is selected from the object edit menu (step D4, Yes), the CPU 10 cancels the grouping of the selected object, closes the object edit menu, and ends the process (step D18). ).

  In other words, if the objects for which the range is specified by dragging are grouped as described above, the files before grouping are stored using the individual object files stored before grouping. Ungroup by returning to the state. As a result, the grouped objects are individually separated, and a plurality of objects are displayed.

  Next, when “automatic size adjustment” is selected from the object edit menu (step D5, Yes), the CPU 10 refers to the object data (in the object setting file) for the plurality of selected objects, and The largest size is extracted for each of the vertical and horizontal directions. Then, the object size is adjusted by changing the vertical and horizontal sizes of all the objects to the largest extracted size, the object edit menu is closed, and the process is terminated (step D19). In this case, the position and size of the object data are changed for the object whose size is adjusted in the object setting file.

  For example, as shown in FIG. 17A, in a screen on which two objects of different sizes (“whiteboard” and “search”) are displayed, the two objects are surrounded as shown in FIG. 17B. The range is specified as follows. In this case, the object editing menu shown in FIG. 17C is displayed, and when “automatic size adjustment” is selected here, the larger of the two objects, that is, the size of the object “whiteboard” is displayed. In addition, the size of the object “search” is adjusted, and two objects are displayed in the same size as shown in FIG.

  If a part outside the object edit menu is instructed with a pen (or clicked with a mouse or the like) (step D6, Yes), the object edit menu is closed and the original display screen is restored (step D20).

  In this way, by selecting multiple objects and associating them and setting common attributes such as size, color, group, etc., organize objects on the screen and clarify the relationship between objects Can do. Thereby, the progress of the meeting using an object can be made smooth, and creativity can be stimulated newly.

  FIG. 18 shows an example of editing an object using the object edit menu. FIG. 18 shows an example of object editing based on the KJ method.

  First, as shown in FIG. 18A, it is assumed that a character string that is a keyword that has been discussed during a meeting is randomly input by handwriting.

  Here, each object is made into an object by the above-described drag menu process, and all objects are selected, and “automatic size adjustment” is executed from the object edit menu, so that the same size is obtained as shown in FIG. An object corresponding to each adjusted keyword can be displayed (in card form). Thereby, each object can be easily handled on the screen.

  The carded object is displayed in the same color by moving it to an arbitrary position according to the discussion of the meeting, for example, bringing the positions of the related objects close to each other, and as shown in FIG. By inputting a line connecting the objects by handwriting (object “local”, “TV conference”, “net meeting”, “remote location”), related objects are grouped. Then, the arrangement of each object can be determined, and discussion can proceed based on this.

  In this way, by performing various operations on objects according to the content and progress of the conference, it functions as an idea processor, stimulating the creativity of conference attendees, and providing more ideas Activation can be achieved.

(File menu processing)
Next, the file menu process will be described with reference to the flowcharts shown in FIGS. In the file menu process, an object can be displayed, and an entire image including the object can be displayed using the object.

  The electronic conference apparatus 1 is provided with a file menu for accepting execution of file menu processing. For example, when “File” on the command line is selected on the display screen of the electronic whiteboard shown in FIG. 11, a file menu as shown in FIG. 19 is displayed.

  In the file menu shown in FIG. 19, command names (options) such as “screen call”, “screen save”, “object list”, “shuffle”, “attendant object automatic display”, and “setting” are displayed in a list.

  Here, when “call screen” is selected from the file menu (step E1, Yes), the CPU 10 closes the file menu, and displays a screen list for selecting and displaying the screen in which the object is set from the list. A display window is displayed (step E2).

  FIG. 20 shows an example of a screen list display window. In the screen list display window, a list display area (the area on the right side in the figure) for displaying thumbnail image file names of the screen (image data) on which the object is set, and the file name specified in this area are displayed. A screen display area for displaying the screen in a reduced size, and “OK” and “Cancel” buttons are provided.

  When any screen (file name) is selected in the list display area (step E3, Yes), the CPU 10 highlights the selected file name, for example, reads the corresponding thumbnail image file, and displays the screen display area. Is reduced and displayed (step E4). In this way, by arbitrarily selecting the file name displayed in the list display area, it is possible to search for a screen to be called while confirming by a reduced display.

  When the “OK” button is selected in a state where the screen corresponding to any one of the file names is displayed in a reduced size (step E5, Yes), the CPU 10 reads the entire image file corresponding to the file name, and the electronic white The screen is displayed on the board screen (step E6), the screen list display window is closed, and the process is terminated (step E8).

  On the other hand, when the “Cancel” button is selected, the CPU 10 closes the screen list display window and ends the file menu process (step E8).

  Although the file names of the thumbnail image files are displayed in a list in the list display area, the file name of the entire image or an arbitrary name for identifying the screen may be displayed. When any one is selected in the list display, a thumbnail image file corresponding to this is read out and displayed in the screen display area.

  Next, when “object list” is selected from the file menu (step E9, Yes), the CPU 10 closes the file menu, and displays an object list for designating and displaying the screen on which the object is set. A window is displayed (step E10).

  FIG. 21 shows an example of the object list display window. In the object list display window, an object list display area for displaying a list of objects and “call screen”, “attach object”, and “cancel” buttons are provided. The CPU 10 reads out the object image file for each object, and displays the list by, for example, a vertical 4 horizontal 5 array.

  When any object is selected in the object list display area (step E11, Yes), the CPU 10 highlights the selected object, for example (step E12). Here, an object displayed in the object list display area can be arbitrarily selected and highlighted.

  When the “call screen” button is selected in a state where any object is highlighted (step E13, Yes), the CPU 10 reads the entire image file including the object, and the electronic whiteboard screen. (Step E14), the object list display window is closed, and the process is terminated (step E18).

  Further, when the “object pasting” button is selected with any object highlighted (step E15, Yes), the CPU 10 pastes the selected object as an independent object on the electronic whiteboard screen. At step E16, the object list display window is closed and the process is terminated (step E18).

  On the other hand, when the “cancel” button is selected, the CPU 10 closes the object list display window and ends the file menu process (step E18).

  In this way, by generating an object that is a keyword for the discussion of the meeting from the image, it is possible to easily call and display the screen used in the discussion by selecting the object. It is possible to stimulate the discussion by making the progress smooth and simply providing useful information for proceeding with the discussion.

  Next, when “screen save” is selected from the file menu (step E19, Yes), the CPU 10 closes the file menu and displays a screen save confirmation message as shown in FIG. 22 (step E20).

  If there is an input for selecting “OK” (step E21, Yes), the CPU 10 sets a predetermined file name for the image data of the screen currently displayed on the electronic whiteboard screen. Save (step E22), close the screen save confirmation message and end the process (step E24).

  On the other hand, if there is an input for selecting “cancel” from the screen save confirmation message (step E23, Yes), the CPU 10 closes the screen save confirmation message and ends the process (step E24).

  Next, when “shuffle” is selected from the file menu (step E25, Yes), the CPU 10 closes the file menu and displays a shuffle confirmation message as shown in FIG. 23 (step E26).

  If there is an input for selecting “OK” (step E27, Yes), the CPU 10 randomly changes the position of each object currently displayed on the electronic whiteboard screen (step E28), The shuffle confirmation message is closed and the process is terminated (step E30).

  On the other hand, when there is an input for selecting “cancel” from the shuffle confirmation message (step E23, Yes), the CPU 10 closes the shuffle confirmation message and ends the process (step E30).

  In this way, by randomly changing the arrangement of multiple objects, the meeting attendees may present unintended object relationships, which stimulates creativity for the attendees and Activation can be achieved.

  Next, when “Create attendee object” is selected from the file menu (step E31), the CPU 10 closes the file menu and displays an attendee object creation confirmation message as shown in FIG. 24 (step E32). ).

  If there is an input to select “OK” (step E33, Yes), the CPU 10 creates and displays an attendee object on the electronic whiteboard screen (step E34), and displays an attendee object creation confirmation message. Is closed to end the processing (step E36).

  FIG. 25A shows an example of a screen on which a plurality of attendee objects are additionally displayed by executing “create attendee object” in a state where a plurality of objects are displayed on the electronic whiteboard screen. .

  For example, the electronic conference apparatus 1 automatically obtains data for identifying each of the personal computers 2, 3, 4 and the PDA 5 through the network, for example, a user name arbitrarily registered by the conference attendee, and obtains this data. Based on this, an object of a predetermined size including the user name is generated as shown in FIG. For example, in the initial state, attendee objects are displayed in a list at predetermined positions.

  Rather than creating an attendee object based on the data acquired through the network, data (name) etc. about attendees of the meeting using personal computers 2, 3, 4 and PDA 5 are registered separately. Thus, an attendee object may be generated based on this data.

  In this way, the attendee object displayed on the electronic whiteboard screen can be moved to an arbitrary position in the same manner as other objects, and various objects described in the object editing menu process can be edited.

  For example, the example shown in FIG. 25 (b) shows a case where attendees are assigned to each of the objects “table of contents”, “goal image”, “plan”, etc. representing the page of the material. Each person object is moved to the vicinity of the object in charge, and a line indicating the relationship is input by handwriting input.

  The CPU 10 generates and stores related data indicating the relationship between each object and the attendee object (user name) in response to an instruction (line input) indicating the association of the attendee object with each object. This related data can be arbitrarily called according to an instruction from the user, and can display an object or a list showing the correspondence between the object and the attendee (user name).

  On the other hand, if there is an input to select “Cancel” from the attendee object creation confirmation message (Yes in step E35), the CPU 10 closes the attendee object creation confirmation message and ends the process (step E36).

  Next, when “automatic object display” is selected from the file menu (step E37, Yes), the CPU 10 closes the file menu (step E38) and activates an automatic object display process (FIG. 10) described later, The process after step F5 of the process is executed (step E39). The object automatic display process is a process of automatically displaying an object in accordance with the object display conditions set by the “setting” process (steps E40 to E49) described later. Details will be described later.

  Next, when “setting” is selected from the file menu (step E40, Yes), the CPU 10 closes the file menu and displays an object automatic display setting window for setting conditions for automatically displaying objects. (Step E41).

  FIG. 26 shows a display example of the object automatic display setting window. The object automatic display setting window is provided with an item “automatic object display” for setting execution of automatic object display. When the check box for this item is selected (step E42, Yes), the "automatic object display" is set to be executed (step E43).

  When execution of “automatic object display” is set, settings for the items “automatic display start time”, “object extraction reference”, and “display pattern” are possible.

  The “automatic display start time” is for setting a time indicating how many minutes have passed after the input operation on the electronic whiteboard screen is last, for example, 1 minute to 60 minutes. Can be arbitrarily set in the edit box.

  The “object extraction criterion” is used to set a condition for determining which object is to be displayed among a plurality of stored objects. Any one of “descending date” can be selected by a radio button.

  In this case, it is assumed that data indicating the usage frequency of the object is managed corresponding to each object image file. When “usage frequency ascending order” or “usage frequency descending order” is selected, an object to be displayed is extracted with reference to data indicating the usage frequency. When “date ascending order” or “date descending order” is selected, the object to be displayed can be extracted by referring to the file name of the object image file, for example.

  The “display pattern” is for setting a pattern for displaying an object. For example, any of patterns 1 to 4 prepared in advance can be set with a radio button. Details of the automatic display pattern of the object will be described later (FIGS. 27 and 28).

  Thus, when there is an input to the edit box or a radio button selection operation (step E44), the CPU 10 performs setting according to the selection operation (step E45).

  Here, when there is an input for selecting “OK” (step E46, Yes), the CPU 10 stores data indicating the changed contents, that is, data indicating conditions for automatically displaying the object (hard disk 23). ), The object automatic display setting window is closed, and the process is terminated (step E49).

  On the other hand, when there is an input for selecting “cancel” from the object automatic display setting window (step E48, Yes), the CPU 10 closes the object automatic display setting window and ends the process (step E49).

  In this way, by making it possible to set the conditions for displaying an object, such as the period during which no input operation is performed, the method of selecting an object to be displayed, the display pattern, etc. according to the user's preference, In an automatic object display process to be described later, it is possible to display an object effective for stimulating a conference by stimulating creativity.

  If a portion outside the file menu is instructed by the pen (or clicked with a mouse or the like) (step E50, Yes), the file menu is closed and the original display screen is restored (step E51).

(Automatic object display processing)
Next, automatic object display processing will be described with reference to the flowchart shown in FIG. In the automatic object display process, the object can be automatically displayed according to the data indicating the conditions for automatically displaying the object set by the “setting” process of the file menu process.

  First, when the automatic object display process is activated, the automatic object display timer starts counting (step F1). This timer is for counting the time elapsed after the last input operation on the electronic whiteboard screen.

  When there is any input operation on the electronic whiteboard screen (step F2, Yes), the CPU 10 resets the automatic object display timer (step F4) and starts counting again (step F1).

  On the other hand, when there is no input operation on the electronic whiteboard screen (step F2, No) and it is determined that the automatic display start time indicated by the data indicating the conditions for automatically displaying the object has elapsed (step F3, Yes), The object is displayed on the electronic whiteboard screen according to the object extraction standard and the display pattern of the same data (step F5).

  For example, as a display pattern, the electronic whiteboard screen may be fixedly displayed at a predetermined position, or may be displayed while changing the display position of the object, as shown in FIGS. There are patterns to be displayed while changing the number of objects to be displayed.

  FIGS. 27 (a1) to (a4) and (b1) to (b4) each show a pattern in which a display object is changed and displayed while changing one object to be displayed.

  FIGS. 28C1 to 28C8 show patterns in which objects to be displayed are changed and displayed while sequentially changing the number of objects to be displayed simultaneously to 1 to 5 and 5 to 1. FIG.

  Of course, display patterns other than those shown in FIGS. 27 and 28 can be used.

  Here, when there is an input operation in which an object to be displayed is instructed with a pen (or clicked with a mouse or the like) (step F6, Yes), the CPU 10 cancels the automatic object display and the entire image including this object. Are read out and displayed on the electronic whiteboard screen (step F7). For example, when there is a new idea due to automatic display of an object, a more specific discussion can be started by displaying the entire image including the object.

  When the entire image is displayed, the automatic object display process is continuously executed, and when there is no input operation for a certain period of time, the automatic object display is started.

  On the other hand, when an operation other than the operation of selecting the object is performed while the object is automatically displayed (step F8, Yes), the CPU 10 cancels the automatic object display and returns to the original state ( Step F9).

  In this way, when a predetermined time has elapsed, for example, when a certain time has elapsed since the last input operation, the conference may be in a stagnation state, so the object is automatically displayed. This stimulates creativity for the attendees, and this can be used as an opportunity to stimulate the discussions that have stagnated.

  Next, a case will be described in which processing contents in the personal computers 2, 3, 4 and PDA 5 connected via the network are projected (displayed) through the projector 6 by the electronic conference apparatus 1.

  The personal computers 2, 3, 4, and PDA 5 obtain image data managed by the electronic whiteboard in the electronic conference apparatus 1, that is, each file shown in FIG. 13 and data related to the above-described various processes via the network ( Sharing). Various processes that can be operated on the electronic whiteboard in the electronic conference apparatus 1 for these data can also be realized by executing the electronic conference apparatus control program in each process.

  The electronic conference apparatus 1 acquires the processing contents executed in the personal computers 2, 3, 4 and the PDA 5 through the network, and the image data of the electronic whiteboard screen corresponding to each processing content is as shown in FIG. 29, for example. Each of the personal computers 2, 3, 4 and PDA 5 stores the data in a dedicated layer.

  In FIG. 29, the lowest layer (layer 1) is a layer for displaying a file of a template (for example, a screen (ruled line, minutes, spreadsheet, etc.) by an application).

  The layers 2 to 5 correspond to the personal computers 2, 3, 4 and the PDA 5 used by the users 1 to 4, respectively, and image data is stored according to the processing content acquired from each.

  For example, in response to an instruction from the user, the electronic conference apparatus 1 combines and displays (projects) all layers, or selects one of a plurality of layers (for example, layers 1 and 2). 5), can be synthesized and displayed. It is also possible to select and display one layer (that is, the content of operation by a specific conference attendee).

  In this way, the operation contents for the shared object in other information devices (personal computers 2, 3, 4 and PDA 5) connected via the network, that is, the examination contents of individual attendees using the object are described. Image data to be represented can be stored separately, and these can be combined or displayed using image data corresponding to a specific attendee, so that the attendee's opinion can be provided to the meeting as the operation content for the object .

  Furthermore, the above embodiments include inventions at various stages, and various inventions can be extracted by appropriately combining a plurality of disclosed constituent elements. For example, even if some constituent elements are deleted from all the constituent elements shown in the embodiment, at least one of the problems described in the column of problems to be solved by the invention can be solved, and described in the column of the effect of the invention. In a case where at least one of the obtained effects can be obtained, a configuration in which this configuration requirement is deleted can be extracted as an invention.

  In addition, an electronic conference apparatus control program that can be executed by a computer that implements the electronic conference apparatus 1 is recorded on a recording medium such as a magnetic disk (flexible disk, hard disk, etc.), an optical disk (CD-ROM, DVD, etc.) Or can be provided through a communication medium. By controlling the operation of the computer by the electronic conference device control program, the functions in the above-described embodiments can be realized.

The block diagram which shows the system configuration which uses the electronic conference apparatus 1 in embodiment of this invention. The block diagram which shows the detailed structure of the electronic conference apparatus 1 shown in FIG. The flowchart for demonstrating the starting process in this embodiment. The flowchart for demonstrating the drag process in this embodiment. The flowchart for demonstrating the drag menu process in this embodiment. The flowchart for demonstrating the object edit menu process in this embodiment. The flowchart for demonstrating the file menu process in this embodiment. The flowchart for demonstrating the file menu process in this embodiment. The flowchart for demonstrating the file menu process in this embodiment. The flowchart for demonstrating the automatic object display process in this embodiment. The figure which shows an example of the display screen of the electronic whiteboard in this embodiment. The figure which shows the example of a display for demonstrating the drag process in this embodiment. The figure for demonstrating the various files related to the production | generation of the object in this embodiment. The figure which shows an example of the object deletion confirmation message in this embodiment. The figure which shows the process example when "color classification" of the object edit menu in this embodiment is selected. The figure which shows the process example when "grouping" of the object edit menu in this embodiment is selected. The figure which shows the process example when "size automatic adjustment" of the object edit menu in this embodiment is selected. The figure which shows the example of edit of the object using the object edit menu in this embodiment. The figure which shows an example of the file menu in this embodiment. The figure which shows an example of the screen list display window in this embodiment. The figure which shows an example of the object list display window in this embodiment. The figure which shows an example of the screen preservation | save confirmation message in this embodiment. The figure which shows an example of the shuffle confirmation message in this embodiment. The figure which shows an example of the attendee object creation confirmation message in this embodiment. The figure which shows an example of the screen on which the attendee object in this embodiment was displayed. The figure which shows the example of a display of the object automatic display setting window in this embodiment. The figure which shows an example of the automatic display pattern of the object in this embodiment. The figure which shows an example of the automatic display pattern of the object in this embodiment. The figure which shows the concept of the layer used with the electronic conference apparatus 1 in this embodiment.

Explanation of symbols

  DESCRIPTION OF SYMBOLS 1 ... Electronic conference apparatus, 2, 3, 4 ... Personal computer, 5 ... PDA, 6 ... Projector, 7 ... Screen, 10 ... CPU, 11 ... RAM, 12 ... ROM, 13 ... RTC, 14 ... Wireless LAN controller, 14a DESCRIPTION OF SYMBOLS: Antenna, 15 ... Video signal output controller, 16 ... LCD controller, 17 ... Tablet controller, 18 ... USB controller, 19 ... Hard disk controller, 20 ... LCD, 21 ... Tablet, 22 ... USB interface, 23 ... Hard disk.

Claims (12)

A range specifying means for specifying a certain range of an image displayed on the display device;
Object generating means for generating an object based on a partial image corresponding to the range specified by the range specifying means;
Object storage means for storing the object generated by the object generation means;
Whole image storage means for storing the display image that is the target of the range specification as a whole image in association with the object stored in the object storage means;
Object display means for displaying the object stored by the object storage means;
Object selection means for selecting an object displayed by the object display means;
An electronic conference apparatus comprising: a whole image display unit for displaying a whole image stored by the whole image storage unit corresponding to the object selected by the object selection unit.   The electronic conference apparatus according to claim 1, wherein the display image that is the target of the range specification is an image displayed by another application. A pointing device,
The electronic conference apparatus according to claim 1, wherein the display image to be the target of the range specification is an image made of data input from the pointing device. It further comprises a time passage determination means for determining the passage of a predetermined time,
2. The electronic device according to claim 1, wherein the object display unit displays the object stored in the object storage unit when it is determined by the time elapse determination unit that a predetermined time has elapsed. Conference equipment. Comprising condition setting means for setting conditions for displaying an object by the object display means,
5. The electronic conference apparatus according to claim 4, wherein the object display means displays an object in accordance with the condition set by the condition setting means. An array change request input means for inputting an array change request for the objects displayed by the object display means;
2. The object display means is characterized in that the arrangement of a plurality of objects stored in the object storage means is randomly changed and displayed each time a change request is input by the arrangement change request input means. The electronic conference apparatus described. Display request input means for inputting a display request for an object stored in the object storage means;
2. The electronic conference apparatus according to claim 1, wherein the object display means displays a list of a plurality of objects stored in the object storage means in response to a display request input by the display request input means. A plurality of object selection means for selecting a plurality of objects displayed by the object display means;
2. The electronic conference apparatus according to claim 1, further comprising setting means for setting a predetermined common attribute in association with a plurality of objects selected by the plurality of object selecting means. Connection means for connecting to other information devices via a network;
2. The electronic conference apparatus according to claim 1, further comprising a sharing unit that shares the object stored by the object storage unit with the other information device connected by the connection unit. . Second object display means for displaying a device object corresponding to the other information device together with an object displayed by the object display means;
Related instruction input means for inputting an instruction indicating the association between the device object displayed by the second object display means and the object displayed by the object display means;
10. The electronic conference apparatus according to claim 9, further comprising an association setting unit configured to set an association between the device object and the object in accordance with an instruction input by the association instruction input unit. Image data storage means for storing image data corresponding to each of the other information devices connected by the connection means;
10. The electronic conference apparatus according to claim 9, further comprising: composite display means for selectively combining and displaying image data corresponding to each of the other information devices stored by the image data storage means. . Computer
A range specifying means for specifying a certain range of an image displayed on the display device;
Object generating means for generating an object based on a partial image corresponding to the range specified by the range specifying means;
Object storage means for storing the object generated by the object generation means;
Whole image storage means for storing the display image that is the target of the range specification as a whole image in association with the object stored in the object storage means;
Object display means for displaying the object stored by the object storage means;
Object selection means for selecting an object displayed by the object display means;
An electronic conference device control program for functioning as a whole image display means for displaying a whole image stored by the whole image storage means corresponding to an object selected by the object selection means.

Images