JP2006065498A - Conference support system, its server device, and program - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To allow browsers to accurately and efficiently understand the process of collecting opinions. <P>SOLUTION: When board image data picked up and recorded is displayed on the user terminals PC1-PCn of the browsers, a card that is the center of a topic at a conference is estimated from information that shows changes in the state of cards on a board 1 detected from the board image data. A focus display pattern M21 showing the range of focus containing the card estimated is displayed over the board image data. Further, card images contained in the range of focus shown by the focus display pattern M21 are read from a card image database 13a and enlarged for display in the focus display area M3. When the range of focus shown by the focus display pattern M21 contains a plurality of overlapping cards, the images of the plurality of overlapping cards are expanded for display in an expansion display area M4. <P>COPYRIGHT: (C)2006,JPO&NCIPI

Description

  The present invention relates to a conference information management system and a server device for viewing conference content electronically and computerized conference information.

  The KJ method is known as one of the opinion gathering methods used in meetings and workshops. The KJ method writes ideas and opinions from brainstorming, etc., and miscellaneous information collected from various survey sites one by one on a small card (out of paper), and those with similar contents from each other In the work of collecting and grouping, we try to generate hints and inspirations that help solve the theme.

  The basic procedure of the KJ method is shown below. First, participants write data such as ideas and collected information on a small card one by one. Next, the created cards are arranged on a desk or the like, and a group is created by collecting cards whose contents written on the cards are similar. In addition, a nameplate summarizing the contents is attached to each created group. In the card group organization, first, a small group is created, then a small group is created as a middle group, and then a middle group is created as a large group. When the KJ method is used in this way, it is possible to collect various opinions while repeating the group organization of cards and derive hints useful for solving the theme (for example, see Non-Patent Document 1 and Non-Patent Document 2). ).

  Recently, in meetings and workshops using the above-mentioned KJ method, attempts have been made to record the process of collecting opinions and reuse the recorded information as necessary. As a process recording technique, for example, a process of recording a card grouping process using a video camera is used. In this way, for example, by making it possible to view the process of collecting opinions in different places (virtual places) in terms of time and space, people who could not participate in the meeting grasp the flow and contents of the meeting. can do.

Employment and Ability Development Organization Lifelong Vocational Ability Development Promotion Center, “KJ Law”, [online], “Ability Garden (Lifelong Vocational Ability Development Promotion Center / Homepage)”, [Search August 3, 2004], Internet <URL: http://nokai.ab-garden.ehdo.go.jp/giho/43.html>

Jiro Kawakita, “KJ Method-Let's Talk”, Chuo Koronsha, 1986, p. 121-169

  However, in the conventional system, when a person who could not participate in the conference in a virtual place browses the recorded process of collecting opinions, the recorded process is simply displayed on the viewer's display device. . For this reason, there is a problem that it is difficult for the viewer to grasp the flow and points of the conference and the information transmission efficiency is poor.

  The present invention focuses on the above circumstances, and an object of the present invention is to provide a conference support system, a server device, and a program thereof that enable a viewer to accurately and efficiently grasp the process of collecting opinions. There is.

  In order to achieve the above object, the conference support system and its server device and program according to the present invention provide a board on the board detected from the conference image when the captured and recorded conference image is displayed on the display device of the viewer. The card that is the center of the topic in the meeting is estimated based on the information indicating the change in the card status. A focus display pattern indicating the range of interest including the estimated card is displayed superimposed on the conference image. As a result, since the portion that is the center of the topic is automatically tracked and displayed, the viewer can accurately and efficiently grasp the center of the topic in the conference.

The present invention is also characterized by having the following various configurations.
In the first configuration, at least one of the display position, shape, and size of the focus display pattern is variably set according to the input operation information. With this configuration, for example, the viewer or the system operator can arbitrarily change the attention range indicated by the focus display pattern when it is determined that there is another topic center.

  In the second configuration, the image of the card included in the attention range indicated by the focus display pattern is enlarged and displayed in the second display area of the display device. Thus, the viewer can more clearly visually recognize the description content of the card included in the attention range in the entire image while ensuring the listability of the entire image.

  In the third configuration, when a plurality of cards overlapping each other are included in the attention range indicated by the focus display pattern, the images of the plurality of overlapping cards are expanded and displayed in the third display area of the display device. I have to. If it does in this way, a viewer will be able to visually recognize the contents of a plurality of the cards which were piled up in the attention range, respectively. Therefore, it is possible to clearly understand what kind of card combination the group created in the opinion gathering process is composed of.

  A 4th structure is comprised so that the time position in the whole meeting period of the meeting image currently displayed on the display apparatus may be detected, and meeting progress display information showing the detected time position may be produced | generated and displayed. As a result, the viewer can confirm at which time position the currently reproduced image is in the entire meeting.

  In short, in the present invention, when a captured and recorded conference image is displayed on the viewer's display device, the topic is the center of the topic in the conference based on the information indicating the card state change on the board detected from the conference image. And the focus display pattern indicating the range of interest including the estimated card is displayed superimposed on the conference image.

  Therefore, according to the present invention, it is possible to provide a conference support system, a server device, and a program thereof that enable a viewer to accurately and efficiently grasp the process of collecting opinions.

  FIG. 1 is a schematic configuration diagram showing an embodiment of a conference support system according to the present invention. This system includes a server device SV, a board imaging device VI, a card imaging device CA, a communication network NW, and user terminals PC1 to PCn. The server device SV has a function as a conference information management device. The server device SV has a function of taking in video data captured by the board imaging device VI via a cable and image data captured by the card imaging device CA. And a function of capturing via a cable.

  The user terminals PC1 to PCn are configured by a personal computer and include a display device and input devices such as a keyboard and a mouse. These user terminals PC1 to PCn are used by a user who is a conference viewer to browse a conference pattern in a virtual place.

  The communication network NW is configured by a LAN (Local Area Network) if the system is constructed in, for example, an office or an office. On the other hand, when the system is configured across a plurality of offices or offices, a computer network represented by the Internet and a subscriber for connecting the computer network and the user terminals PC1 to PCn. It consists of a net.

  FIG. 2 is a diagram showing how conference information is recorded in the system shown in FIG. In the figure, a board 1 is provided on a desk or a wall, and an opinion gathering process by the KJ method or the like is executed on the board 1. In this process, for example, cards 21 to 2i on which opinions are entered are placed on the board 1, and the participants move the cards 21 to 2i on the board 1 to form groups of people with similar written opinions. This is done by creating. The board 1 may be a commercially available white board, imitation paper, or the like, or may use the wall or desk of the venue as it is.

  As shown in FIG. 3, the cards 21 to 2i include an opinion entry area 21A and a card identification area. The opinion entry area 21A is an area where conference participants write their opinions using a pen or the like. A two-dimensional barcode 21B is displayed in the card identification area. The two-dimensional barcode 21B includes individual identification information (hereinafter referred to as a card ID) unique to each card and is written in advance on the card. Instead of the two-dimensional barcode 21B, it is also possible to use a one-dimensional barcode 21B ′ as in the cards 21 ′ to 2i ′ shown in FIG. The cards 21 to 2i are not limited in shape and material as long as an opinion can be entered using a writing instrument such as a pen. For example, commercially available sticky notes with an adhesive can be used.

  The board imaging device VI is composed of, for example, a video camera capable of capturing moving images, and images the entire board 1 on which opinions are aggregated over time. Then, the board video data and digital audio data obtained by this imaging are input to the server device SV connected via a cable such as a DV cable.

  The card imaging device CA is constituted by a digital still camera, for example, and images the opinion entry area 21A and the card identification area of the cards 21 to 2i one by one. Then, the card image data obtained by this imaging is input to the server apparatus SV connected via a cable such as a USB cable.

  When the board imaging device VI and the card imaging device CA have a function of recording the captured board video data and card image data on a recording medium, the board video data and digital audio obtained by the imaging are recorded. The data and card image data may be temporarily recorded on the recording medium, and the recording medium may be set in the drive of the server apparatus SV so that the data is taken into the server apparatus SV.

By the way, the server apparatus SV is configured as follows. FIG. 5 is a block diagram showing the functional configuration.
The server device SV includes a central processing unit (CPU) 11 such as a microprocessor. A data memory 13 and a program memory 14 are connected to the CPU 11 via a bus 12, and a video input interface (video input I / F) 15, a camera input interface (camera input I / F) 16, and a communication interface ( Communication I / F) 17 is connected.

  The video input I / F 15 performs reception processing of board video data transmitted from the board imaging device VI via a cable under the control of the CPU 11. The camera input I / F 16 performs reception processing of card image data transmitted from the camera imaging device CA via a cable under the control of the CPU 11. The communication I / F 17 communicates with the user terminals PC1 to PCn via the communication network NW under the control of the CPU 11.

  The data memory 13 uses, for example, a RAM or a hard disk as a storage medium. The data memory 13 is provided with a card image database 13a, a card position database 13b, a video / audio database 13c, and a viewer database 13d.

  In the card image database 13a, the card image data read from the card imaging apparatus CA via the camera input I / F 16 is associated with the card ID represented by the two-dimensional barcode 21B described in advance on the card. Remembered. FIG. 6 shows an example of the storage result. In this example, the card images 201 to 20i of the cards 21 to 2i are stored in association with the card IDs (C1 to Cn).

  The card position database 13b stores the position information of the cards 21 to 2i on the board 1, that is, the position information of the cards when pasting, moving, and removing are performed. This position information is composed of a time ID (T1 to Tj) issued for each photographing time, a time, a card ID to be operated, a card position, and an overlap flag indicating whether or not the cards overlap. FIG. 7 shows an example of the storage result.

The video / audio database 13c stores board video 10x captured from the board imaging device VI via the video input I / F 15.
The viewer database 13d stores the viewer information input by the viewer using the user terminals PC1 to PCn. The viewer information includes a browser ID and password issued at the time of browser registration, a browsing date and time, and browsing progress. FIG. 8 shows an example of the storage result.

  The program memory 14 stores a conference information storage program group and a conference information browsing program group as control programs according to the present invention. The conference information storage program group includes a card ID recognition program 141a, a card image registration program 141b, a card position detection program 141c, and a card position registration program 141d. The conference information browsing program group includes a focus display program 142a, an overlapping development program 142b, playback control programs 142c and 142d, a viewer registration program, and a viewer management program 142e.

The card ID recognition program 141a decodes the two-dimensional barcode information 21B described on the card from each frame of the captured card images 201 to 20i and the board video 10x, and recognizes the card ID.
The card image registration program 141b associates the card images 201 to 20i captured from the card imaging device CA via the camera input I / F 16 with the card ID recognized by the card ID recognition program 141a in the card image database 13a. Remember.

  The card position detection program 141c recognizes the barcode of the card images 201 to 20i included in the frame for each frame of the board image 10x captured from the board imaging device VI via the video input I / F 15. Then, the positions of the card images 201 to 20i on the board video 10x are detected based on the recognized barcode position.

  The card position registration program 141d determines the positions of the card images 201 to 20i detected by the card position detection program 141c for each frame of the board video 10x, and the positions of the card images 201 to 20i detected in the previous frame. Compare with And the change history information is produced | generated about the card images 201-20i from which the position change was detected, and it memorize | stores in the card position database 13b. The change history information includes a time ID issued at each frame shooting time (time stamp) of the card image, the card ID, detected position information, and an overlap flag.

  The focus display program 142a estimates the card that is the center of the topic in the conference based on the change history information of each card stored in the card position database 13b. Then, a focus display pattern indicating the range of interest including the estimated card is generated, and the generated focus display pattern is superimposed on the board video and displayed in the board image display area.

  Further, the focus display program 142a, when a user performs an operation for changing the display position of the focus display pattern on the user terminals PC1 to PCn, the display position, shape, and shape of the focus display pattern according to this operation. Change at least one of the sizes.

  Further, the focus display program 142a reads out from the card image database 13a the image of the card included in the portion surrounded by the attention range indicated by the focus display pattern. Then, the read card image is enlarged and displayed in a focus display area different from the board display area based on the position information stored in the card position database 13b. In addition, an enlargement / reduction button is displayed in the focus display area, and the function of changing the display size of the partial image when the viewer operates the enlargement / reduction button.

  The overlapping development program 142b determines whether or not a plurality of overlapping cards are included within the attention range indicated by the focus display pattern. When a plurality of overlapping cards are included, the images of the overlapping cards are selectively read out from the card image database 13a and displayed in the development display area.

  The reproduction control program 142c creates and distributes a browsing screen according to a reproduction control command transmitted from the user terminals PC1 to PCn via the communication network NW. The playback control command includes commands for specifying playback, stop, feed and return. Moreover, the chapter reproduction | regeneration function which divides | segments meeting time into a some chapter for a certain time unit and performs reproduction | regeneration control for every these chapters is also provided.

  The browser registration program 142d has a browser registration control function for managing the viewers of the conference information stored in the server device SV. When the server apparatus SV receives the browser registration request transmitted from the user terminals PC1 to PCn via the communication NW, the server apparatus SV issues a browser ID and a password and transmits them to the requesting user terminals PC1 to PCn. The issued browser ID and password are stored in a viewer database 13 d provided in the data memory 13.

  The browser management program 142e performs browser authentication, management of the progress of browsing conference information, and the like. The browser authentication is performed by transmitting the browser ID and password issued by the browser registration program 142d from the user terminals PC1 to PCn. The server device SV compares the received browser ID and password with the browser ID and password stored in the browser database 13d, and starts browsing conference information if they match. The browsing progress management is performed by storing the browsing date and browsing progress in the browsing database 13d for each browsing. When the viewer browses the conference information from the user terminals PC1 to PCn, the viewing date and time and the progress are automatically stored. If not browsed, “NULL” is stored in the browse date and time and the progress, respectively.

Next, the operation of the server apparatus SV in the conference support system configured as described above will be described.
(1) Saving conference information
(1A) Card image registration process
For example, prior to the start of the conference, the conference manager images each of the cards 21 to 2i on which opinions are described using the card imaging device CA. The card image data 201 to 20i obtained by this imaging is sent to the server apparatus SV via a cable.

When the card image data 201 to 20i are sent, the server device SV executes a card image registration process as follows. FIG. 6 is a flowchart showing the processing procedure and processing contents.
That is, first, in step S9a, the card images 201 to 20i are taken in via the camera input I / F 16 and stored in the reception buffer in the data memory 13. Next, the card ID recognition program 14a is executed in step S9b, and the card ID is recognized by decoding the two-dimensional barcode included in the card images 201 to 20i. In step S9c, the card images 201 to 20i are stored in the card image database 13a in association with the recognized card ID. As a result, the card image database 13a stores all the card image data 201 to 20i of the cards 21 to 2i in association with the card IDs (C1 to Cn), for example, as shown in FIG.

(1B) Video / audio data storage processing
Now, when the conference is started, the pattern is continuously captured by the board imaging device VI from the start to the end of the conference. The imaging range at this time is set so that conference participants existing around the board 1 are included. The board video 10x and the audio data obtained by the imaging are sent to the server device SV via a cable. The board video 10x and audio data are received by the video input I / F 15 in the server device SV, then transferred to the data memory 13 and stored in the video / audio database 13c.

(1C) Card position database creation process
The server apparatus SV executes a card position database creation process as follows during the storage period of the board video 10x or after the storage ends. FIG. 10 is a flowchart showing the processing procedure and processing contents.
That is, in step S10a, the board video 10x is read from the video / audio database 13c in units of frames, and the processing from step S10b to step S101 is repeated for each read frame.

  First, in step S10c, the card ID recognition program 14a is executed for a certain frame of the board video 10x, thereby decoding the two-dimensional barcodes of all the cards included in the frame and recognizing the card ID. In step S10d, the card position detection program 141b is executed for all the recognized two-dimensional barcodes, and all the positions of the card images included in the frame are detected.

  For example, the position is detected as shown in FIG. That is, a base point is set on the board 1 in the board video 10x, and the number of pixels in the X direction and the number of pixels in the Y direction from the base point to the two-dimensional barcode are calculated. The calculated number of pixels in the X direction and the number of pixels in the Y direction are employed as the position information of the card 201. Here, the position information is calculated using two-dimensional coordinates, but not limited to two dimensions, it is possible to use a three-dimensional coordinate system, and any technique can be used as long as the card position can be detected. It doesn't matter.

  Next, in steps S10e to S10k, the server device SV compares the positions of the card images 201 to 20i included in the frame and the previous frame. First, in step S10f, a change in card position is determined. Here, the card position change is the addition, movement and disappearance of a new card. When addition or movement of the cards 21 to 2i is detected, the process proceeds to step S10h, and it is determined whether or not a card already exists at the same location in the previous frame. That is, it is determined whether or not a plurality of cards have overlapped. In this determination, both a case where the barcode completely overlaps so that the barcode cannot be read and a case where a new card overlaps a part of the existing card are detected.

  As a result of the determination, if an overlap of a plurality of cards is detected, the overlap flag is set to ON in step S10i. In step S10j, for example, as with time ID (T3) in FIG. 7, the shooting time (time stamp) of the frame, the card ID and card position, and the overlap flag are turned on and stored in the card position database 13b. .

  On the other hand, if no overlap is detected in the determination in step S10h, the process proceeds to step S10j. In step S10j, for example, like the time ID (T1, T2) in FIG. 7, the shooting time of the frame, the card ID and card position, and the overlap flag are set to “NULL” and stored in the card position database 13b. .

  On the other hand, when the disappearance of the cards 21 to 2i is detected in the determination in step S10f, the process proceeds to step S10g, and it is determined whether or not the card is not detected even after a certain period of time has elapsed. This determination is performed, for example, in order not to erroneously determine that the card has disappeared when a participant in the conference or a hand moving the card temporarily hides the two-dimensional barcode. In step S10g, when the state in which the card is not detected continues for a certain period of time, the process proceeds to step S10j, for example, the shooting time of the frame, the card ID, and the card, as shown by time ID (T4) in FIG. The position is set to “NULL” and stored in the card position database 13b.

Thereafter, the processing described above is repeatedly executed for all the frames of the board video 10x, and as a result, information representing the card state change history from the start time to the end time of the conference is stored. FIG. 7 shows an example of the storage result.
(2) Meeting information distribution
Next, a conference information browsing screen is created using the created card image database 13a and card location database 13b, and the created conference information is distributed and displayed to the user terminals PC1 to PCn via the communication network NW. The operation to be performed will be described.

(2A) Configuration of the conference information browsing screen
FIG. 12 is a diagram illustrating an example of a conference browsing screen displayed on the user terminals PC1 to PCn. The conference browsing screen includes an entire display area M1, a board display area M2, a focus display area M3, a development display area M4, a playback control button M5, a time lapse display unit M6, a chapter playback control button M7, and a chapter progress display unit M8. Prepare.

  In the entire display area M1, video data of the entire conference hall captured by the board imaging device VI is displayed. In the board display area M2, board video data obtained by imaging the board 1 among the video data of the entire conference hall is displayed. In addition, a focus display pattern M21 indicating a range of interest is superimposed on the board video data. The focus display pattern M21 can be arbitrarily moved by operating the pointer M22 with a mouse. In the focus display area M3, the card images 201 to 20i included in the portion within the range of interest surrounded by the focus display pattern M21 are displayed based on the position information stored in the card position database 13b. In the focus display area M3, buttons 31 and 32 for enlarging / reducing the display size of the image displayed in the focus display area M3 are displayed.

  In the unfolded display area M4, for example, card images indicating the contents of overlapping cards such as card images 201 to 203 are unfolded and displayed. The playback control button M5 includes buttons for playback, stop, send, and return, and performs temporal playback control of the conference information. The chapter playback control button M7 is used to specify a desired chapter in playback during the conference time. The chapter being played is displayed in the chapter progress display section M8.

(2B) Creation of meeting browsing information screen
A procedure for creating the conference browsing information screen configured as described above will be described. FIG. 13 is a flowchart showing the processing procedure and processing contents.
Assume that a conference information reproduction request command is transmitted from the user terminal PC1 in a state where the user terminals PC1 to PCn are connected to the server apparatus SV via the communication network NW. Then, the CPU 11 of the server device SV repeatedly performs the processing from step S13a to step S13f every time the time changes in a certain unit time.

  First, when a time change is detected in step S13b, in step S13c, the CPU 11 of the server apparatus SV reads the entire video data from the video / audio database 13c of the data memory 13, and the display content of the entire display area M1 is read. Update to the entire video data. At the same time, the board video data is read from the video / audio database 13c, and the display content of the board display area M2 is updated to the read board video data. Then, the time position of the detected time and the corresponding chapter in the entire conference record are detected, and the time passage display unit M6 and the chapter progress display unit M8 are updated based on the detected time position and chapter, respectively.

  Next, the CPU 11 of the server apparatus SV proceeds to step S13d, accesses the card position database 13b, and searches whether the card position information at the time is stored. If the time does not exist in the card position database 13b, the process proceeds to step S13b and waits for the next time change. On the other hand, if the time exists, the process proceeds to step S13e, where the update processing of the display position of the focus display pattern M21 and the update of the card image included in the portion of interest in the focus display area M3 associated therewith are as follows. The processing is executed, and further the card image update processing in the expanded display area M4 is executed. FIG. 14 is a flowchart showing the update processing procedure and processing contents.

  That is, first, in step S14a, the card position database 13b is accessed to read out the card position information at the time. In step 14b, it is determined whether or not the display position of the focus display pattern M21 needs to be moved based on the read card position information. If it is determined that it is necessary to move, the display position of the focus display pattern M21 is moved to a new position in step 14c.

  For example, when a card whose position has changed more than a certain number of times within a certain time is found, the card is regarded as the card at the center of the topic of the conference, and the focus display pattern M21 is displayed within a predetermined range centered on this card. Set the position. Further, when the position of the attention card changes, the focus display pattern M21 is moved to a position centered on the movement destination of the card. Furthermore, when the position of the attention card does not move or disappears for a certain period of time, the attention card is changed to another card having a history of movement within a certain period of time in the past, and a predetermined range centered on this card To move the display position of the focus display pattern M21.

  Subsequently, in step 14d, the CPU 11 of the server apparatus SV selectively reads out the image data of each card included in the attention range surrounded by the focus display pattern M21 from the card image database 13a and displays it in the focus display area M3. Let At this time, the display position of each card image follows the corresponding card position information stored in the card position database 13b. Thus, in the focus display area M3, the image data of each card included in the attention range surrounded by the focus display pattern M21 is clearly enlarged and displayed after following the movement of the focus display pattern M21.

  Next, in step S14e, the CPU 11 of the server device SV determines whether or not there are overlapping card images included in the attention range surrounded by the focus display pattern M21. This determination is made based on the overlap flag stored in the card position database 13b. That is, if the overlap flag of the corresponding card is “ON”, it is determined that there is an overlap, and if “NULL”, it is determined that there is no overlap.

  If it is determined that there is an overlap, the process proceeds to step S14f, the image data of each overlapping card is read from the card image database 13a, and the read card image data is shown in FIG. 12 by step S14g. Are displayed side by side in the expanded display area M4. Therefore, even when there are overlapping card images displayed in the focus display area M3, the contents of the opinions described in these card images can be presented to the viewer without exception. When the overlap flag is “NULL”, the card image data is not displayed in the expanded display area M4.

(2C) Browsing operation
Finally, an operation of browsing the created conference information via the communication network NW in the user terminals PC1 to PCn will be described. It is assumed that the viewer has registered in advance as a viewer.
First, the user terminals PC1 to PCn transmit a browse request command together with a browser ID and a password to the server device SV via the communication network NW. The server device SV receives the transmitted browsing request via the communication I / F 17, and executes the browsing management program 142e. In accordance with this browser management program 142e, the CPU 11 of the server device SV first accesses the viewer database 13d, and performs browser authentication based on the browser ID and password of the request source. When this authentication is completed, the display data of the conference browsing information screen created as described above is distributed from the server SV to the requesting user terminals PC1 to PCn via the communication network NW, and the user terminals PC1 to PCn. Displayed on the display device. FIG. 12 is an example of the conference browsing information screen displayed on the display units of the user terminals PC1 to PCn.

  Also, assume that the user operates an input device such as a keyboard or a mouse on the user terminals PC1 to PCn to move the focus display pattern M21. Then, the input operation information is sent from the user terminals PC1 to PCn to the server device SV, and the server device SV changes the position of the focus display pattern M21 on the conference browsing information screen according to the input operation information. In this way, even if the attention range automatically set by the server device SV is different from the range that should be noticed, the viewer can arbitrarily change the attention range.

  Further, in the user terminals PC1 to PCn, when the viewer designates a chapter desired to be reproduced by operating the chapter reproduction control button M7, or when the reproduction control button M5 is operated to designate reproduction, stop, feed, and return. Operation information to that effect is sent from the user terminals PC1 to PCn to the server device SV. The server device SV selects a chapter to be played back according to the operation information, and plays back, stops, sends, and returns the conference video data and board video data. Accordingly, the viewer can selectively reproduce and view the video data only during a necessary time zone during the conference period.

  At this time, the server device SV stores the chapter selection history by the viewer and the history of playback, stop, send, and return control of the video data in the viewer database 13d in association with the viewer ID. For this reason, the server device SV can manage the progress of browsing the content of the conference for each viewer, and the system operator can understand the level of the conference content of each viewer based on the managed history information. Can be grasped.

  As described above, in this embodiment, when the board video data imaged and recorded is displayed on the user terminals PC1 to PCn of the viewer, the change in the state of the card on the board 1 detected from the board video data is represented. Based on the information, the card which is the center of the topic in the conference is estimated, and the focus display pattern M21 indicating the attention range including the estimated card is displayed superimposed on the board video data. Therefore, the viewer can accurately and efficiently grasp the meeting points.

  Further, the card image included in the attention range indicated by the focus display pattern M21 is read from the card image database 13a and displayed in an enlarged manner in the focus display area M3. Therefore, the viewer can clearly see the content of the opinion described on the card included in the attention range in the board video data. Thereby, it is possible to maintain high visibility for the card image in the attention range while ensuring the list of the entire image.

  Further, when a plurality of overlapping cards are included in the attention range indicated by the focus display pattern M21, the images of the overlapping plurality of cards are expanded and displayed in the expanded display area M4. For this reason, the viewer can confirm all the description contents of the plurality of cards that overlap within the attention range.

  Further, in the user terminals PC1 to PCn, the viewer can variably set the display position of the focus display pattern M21 by operating the keyboard and mouse, operating the chapter playback control button M7, and operating the playback control button M5. Remote control of chapter selection / playback, video data playback / stop / feed / return. By doing in this way, the viewer can browse the conference information in the optimum form requested by the viewer.

  Further, at that time, the chapter selection history by the viewer and the history of playback, stop, send, and return control of the video data are stored in the viewer database 13d in association with the viewer ID. For this reason, as described above, the server apparatus SV can manage the progress of the browsing of the conference content for each viewer, and the system operator can manage each viewer based on the managed history information. It becomes possible to grasp the degree of understanding of the contents of the meeting.

  The present invention is not limited to the above embodiment. For example, the server apparatus SV can be configured separately into a server apparatus for storing conference information and a server apparatus for distribution. In this case, the data memory 13 is configured to be accessible by both the storage server device and the distribution server device.

  In the above-described embodiment, the card position database 13b is created in real time by the input from the board photographing apparatus VI in the server apparatus SV. However, the video / audio data 13d stored in the data memory 13 is read out. The card position database 13b may be created. Further, the cards 21 to 2i may be imaged after the conference ends. In this way, since the cards 21 to 2i are not imaged during the conference, the participants can concentrate on the discussion at the conference.

Further, when the browsing of the conference information is interrupted using the viewer database 13d, it can be reproduced from the middle. In addition, it is possible to send a mail or the like to a viewer who has not been browsed to encourage browsing.
Further, the present invention also relates to the configuration and stored items of the card image database 13a, card position database 13b, and viewer database 13d stored in the data memory 13, the processing procedure and processing contents of each program stored in the program memory 14. Various modifications can be made without departing from the scope of the present invention.

  In short, the present invention is not limited to the above-described embodiment as it is, and can be embodied by modifying the constituent elements without departing from the scope of the invention in the implementation stage. Further, various inventions can be formed by appropriately combining a plurality of constituent elements disclosed in the embodiment. For example, some components may be deleted from all the components shown in the embodiment. Furthermore, you may combine suitably the component covering different embodiment.

1 is a schematic configuration diagram of a system that realizes an embodiment of a conference information management system according to the present invention. The figure which shows the mode of the recording of the meeting information in the system shown in FIG. The figure which shows the structure of the card | curd shown in FIG. The figure which shows the 2nd structural example of the card | curd shown in FIG. The block diagram which shows the function structure of the server apparatus as a meeting information management apparatus in the system shown in FIG. The figure which shows the structure of the card image database provided in the server apparatus shown in FIG. The figure which shows the structure of the card position database provided in the server apparatus shown in FIG. The figure which shows the structure of the card viewer database provided in the server apparatus shown in FIG. 6 is a flowchart showing a card image registration processing procedure and its contents by the server device shown in FIG. 5. 6 is a flowchart showing a card position registration processing procedure and its contents by the server device shown in FIG. 5. The figure which shows an example of the card position detection method in the card position detection program of FIG. The figure which shows an example of the meeting browsing information screen displayed on the user terminal used with the system shown in FIG. The flowchart which shows the preparation procedure of the meeting browsing information screen data by the server apparatus shown in FIG. 5, and its processing content. The flowchart which shows the update procedure of the focus display part and overlap expansion | deployment part in the meeting browsing information screen data preparation by the server apparatus shown in FIG. 5, and its processing content.

Explanation of symbols

  SV ... server device, VI ... board imaging device, CA ... card imaging device, communication network ... NW, PC1-PCn ... user terminal, 1 ... board, 21-2i, 21'-2i '... card, 21A, 21A' ... Opinion entry area, 21B, 21B '... bar code, 11 ... CPU, 12 ... bus, 13 ... data memory, 13a ... card image database, 13b ... card position database, 13c ... video / audio database, 13d ... viewer database, DESCRIPTION OF SYMBOLS 14 ... Program memory, 141a ... Card ID recognition program, 141b ... Card image registration program, 141c ... Card position detection program, 141d ... Card position registration program, 142a ... Focus display program, 142b ... Overlapping development program, 142c ... Reproduction control program , 14 d ... Browser registration program, 142e ... Browser management program, 15 ... Video input I / F, 16 ... Camera input I / F, 17 ... Communication I / F, 10x ... Board video, 201-20i ... Card image, M1 ... Whole display area, M2 ... Board display area, M21 ... Focus display pattern, M22 ... Pointer, M3 ... Focus display area, M4 ... Expanded display area, M5 ... Playback control button, M6 ... Time elapsed display section, M7 ... Chapter playback Control button, M8... Chapter progress display section.

Claims (15)

It is a conference support system that supports conferences that employ a method that aggregates opinions by moving multiple cards each containing opinions on the board and grouping them together with similar opinions. And
A first imaging device that images the movement of a plurality of cards on the board in a time series during a conference period;
A display device capable of displaying images;
A server device connectable via a communication line to at least the display device among the first imaging device and the display device;
The server device
Means for capturing a conference image captured by the first imaging device and storing it in a first storage means;
Means for detecting a change in the state of the card on the board based on the conference image stored in the first storage means, and storing change history information representing the detected state change in the second storage means; ,
Means for reading a conference image stored in the first storage means and displaying the conference image in a first display area of the display device;
Means for estimating a card that is the center of a topic in a meeting based on the change history information stored in the second storage means;
Generating a focus display pattern indicating a range of interest including the estimated card, and superimposing the generated focus display pattern on the conference image to be displayed in the first display area. Meeting support system. The server device
The conference support according to claim 1, further comprising means for receiving an input operation by a conference viewer and changing at least one of a display position, a shape, and a size of the focus display pattern according to the input operation. system. The server device
2. The apparatus according to claim 1, further comprising means for enlarging and displaying, on the second display area of the display device, an image of a card included in an attention range indicated by the focus display pattern among the conference images. Meeting support system. A second imaging device that images each of the surfaces on which the opinions of the plurality of cards are written;
And the server device
Means for capturing images of a plurality of cards imaged by the second imaging device and storing them in a third storage means;
Means for determining whether or not a plurality of overlapping cards are included in the attention range indicated by the focus display pattern;
When it is determined that the plurality of overlapping cards are included, images of the overlapping plurality of cards are selectively read out from the third storage unit and developed in the third display area of the display device. The conference support system according to claim 1, further comprising means for displaying. Means for detecting a time position in the entire conference period of the conference image displayed on the display device;
2. The conference support system according to claim 1, further comprising: means for generating conference progress display information representing the detected time position and displaying the generated conference progress display information on the display device. . Used in a system that supports conferences that employ a method that aggregates opinions by moving multiple cards each containing their opinions on the board and grouping them together with similar opinions. A server device,
Means for capturing a conference image obtained by capturing the movement of a plurality of cards on the board in a time series during a conference period and storing it in a first storage unit;
Means for detecting a change in the state of the card on the board based on the conference image stored in the first storage means, and storing change history information representing the detected state change in the second storage means; ,
Means for reading a conference image stored in the first storage means and outputting the read conference image to the display device to display it in a first display area of the display device;
Means for estimating a card that is the center of a topic in a meeting based on the change history information stored in the second storage means;
A focus display pattern indicating a range of interest including the estimated card is generated, and the generated focus display pattern is output to the display device so as to be superimposed on the conference image and displayed in the first display area. And a server device.   7. The server according to claim 6, further comprising means for receiving an input operation by a conference viewer and changing at least one of a display position, a shape, and a size of the focus display pattern according to the input operation. apparatus.   A unit for outputting, to the display device, an image of a card included in the attention range indicated by the focus display pattern in the conference image so as to be enlarged and displayed in the second display area of the display device; The server device according to claim 6. Means for capturing a card image obtained by imaging each of the faces on which the opinions of the plurality of cards are recorded and storing them in a third storage means;
Means for determining whether or not a plurality of overlapping cards are included in the attention range indicated by the focus display pattern;
When it is determined that the plurality of overlapping cards are included, the images of the overlapping cards are selectively read out from the third storage unit, and the read card images are read out from the display device. The server device according to claim 6, further comprising means for outputting to the display device so that the third display area is expanded and displayed. Means for detecting a time position in the entire conference period of the conference image displayed on the display device;
7. The apparatus according to claim 6, further comprising: means for generating meeting progress display information representing the detected time position and outputting the generated meeting progress display information to the display device to display the generated meeting progress display information. Server device. A server computer for a system that supports meetings that employs a method of gathering opinions by moving multiple cards each containing their opinions on the board and grouping them together with similar opinions. A program used,
A process of capturing a conference image obtained by capturing a movement of a plurality of cards on the board during the conference period in a time series and storing it in the first storage means;
A process of detecting a change in the state of the card on the board based on the conference image stored in the first storage means and storing change history information representing the detected change in the second storage means; ,
A process of reading the conference image stored in the first storage means and outputting the read conference image to the display device so as to be displayed in the first display area of the display device;
Based on the change history information stored in the second storage means, a process for estimating a card that is the center of a topic in a meeting;
A focus display pattern indicating a range of interest including the estimated card is generated, and the generated focus display pattern is output to the display device so as to be superimposed on the conference image and displayed in the first display area. A program that causes the server computer to execute processing. A process of accepting an input operation by a conference viewer;
The program according to claim 11, further causing the server computer to execute a process of changing at least one of a display position, a shape, and a size of the focus display pattern according to the input operation.   The server computer further includes a process of outputting, to the display device, an image of a card included in the attention range indicated by the focus display pattern in the conference image so as to be enlarged and displayed in the second display area of the display device. 12. The program according to claim 11, wherein the program is executed. A process of capturing a card image obtained by imaging each of the surfaces on which the opinions of the plurality of cards are recorded and storing them in a third storage unit;
A process of determining whether or not a plurality of cards overlapping each other are included in the attention range indicated by the focus display pattern;
When it is determined that the plurality of overlapping cards are included, the images of the overlapping cards are selectively read out from the third storage unit, and the read card images are read out from the display device. The program according to claim 11, further causing the server computer to execute a process of outputting to the display device so that the third display area is expanded and displayed. Processing for detecting a time position in the entire conference period of the conference image displayed on the display device;
12. The process according to claim 11, wherein the server computer is further configured to generate conference progress display information representing the detected time position and output the generated conference progress display information to the display device to display the conference progress display information. program.

Images