JP2010277613A - Method for recording and reproducing conference content - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To record various pieces of information generated in a conference or the like in association with a speaker, a word, a phrase or the like together with time information so that desired information can be searched later by use of a predetermined search key. <P>SOLUTION: The method includes: a conference room 100, an entrance/exit control unit 200 which manages entrance/exit to and from the conference room, a display unit 300, an image/voice collection unit 400, a recording unit 500, an information integration unit 600, a comprehensive control unit 700, and a clock 800. Conference information recorded in the recording unit 500 is searched by use of a keyword, key phrase or the like input through an input and output interface 900. <P>COPYRIGHT: (C)2011,JPO&INPIT

Description

The present invention, using a specific keyword or key phrase in the record, after the day along with the cooperation to date and time the details of the speech and the speech content of a person who has attended to the subject and the speaker in the conference, the conference content, The present invention relates to a conference content recording / reproducing method in which a speaker is specified or estimated, and the point in time of the speaker can be searched.

  For example, in research announcements on technology development, it is important to determine what laws, rules, and causal relationships the results obtained from the technology development are. In addition, when multiple engineers and managers attend and give presentations, question-and-answer sessions, discussions, etc. at each stage such as idea creation, basic specification creation, prototyping, commercialization, and patent application, the contents discussed Often there are truly important inventions.

  By confirming the location of prior speech and the idea provider at each stage at a later date, the results of such meetings are required to clarify the share of share rights and ensure the share of resources. ing. Such an activity is also referred to as DR (design review) or DRM (design review meeting).

  Currently, multiple companies and universities are grouped into a single organization, and a paper document that records the contents of presentations and discussions (hereinafter referred to as meetings) hosted by managers of those organizations, or the contents of questions and answers, or easy There is a method of recording as an electronic document on a reproducible recording medium or creating a video recording of a scene taken from the venue, and an authorized administrator authenticating and recording the video recording. Then, use the notary public office as an authentication means to calculate the attribution of rights, the share of development costs, etc. at a later date and reproduce the contents of paper documents or recording media that have been certified at the notary public office. The method of confirming with is taken.

  In addition, in relation to the technical contents of the present invention, Patent Document 1, Patent Document 2, Patent Document 3, and Patent Document 4 are disclosed as a conventional technique for recording contents of a meeting or the like as an electronic document and a conventional technique for a participant authentication method. And so on. Further, as a conventional technique for generating a text document from the content of statements made at a meeting or the like, for example, Patent Document 5 can be cited. Furthermore, Patent Literature 6, Patent Literature 7 and the like can be cited as disclosures of technologies related to an electronic board as a display used in an embodiment of the present invention.

JP 2004-208188 A JP 2002-271498 A Japanese Patent Laid-Open No. 2002-251393 JP-A-8-316953 JP 2005-277462 A Japanese Patent Laid-Open No. 2002-142054 JP 2007-220341 A

  The contents of questions, answers, and discussions presented at such meetings are diagrams, structure diagrams, mechanism diagrams, parameters, and / or mathematical formulas, which are displayed on a display such as a whiteboard or electronically with statements. Visible on the screen of a display (such as the electronic board described above). There is a high possibility that changes such as additional writing, correction, and deletion are made at any time with respect to this display content. In order to record such a wide variety of information without leaking along with the time information along the time axis, it is impossible with conventional writing, and conventional recording means and recording means are not sufficient.

  In addition, after recording such a wide variety of information, a so-called prior speaker or related information that is first spoken using a term (word) or description (phrase) included in the speech as a search key. May be requested to perform a reverse search. At present, there is no system that can easily search and reproduce intended information for such a demand.

  The object of the present invention is to record a wide variety of information generated in a conference or the like together with time information in cooperation with speakers, terms, phrases, etc., and use a predetermined search key from the recorded information to obtain desired information. It is to realize a conference content recording system that can easily reproduce the above.

  In order to achieve the above-mentioned object, the present invention records various information such as a display image, a speaker video, and a voice of the speech generated in a meeting or the like together with time information as electronic information linked with personal authentication information of the voice. Thus, desired information can be easily acquired from the recorded electronic data at a later date using a predetermined search key.

  The conference content recording system of the present invention includes various means for realizing the object of the present invention in a conference room. This means includes, as an important element, a display for displaying information such as documents, drawings, and mathematical formulas related to the theme of the conference as images and presenting them to all the attendees of the conference. This display is provided with a function to read the image information displayed on the display screen periodically at a predetermined time or at any time by arbitrary operation and record it together with the time information. A means having the above is provided separately.

  This recording system includes means for collecting the content of the speech of the speaker who makes the presentation of the subject of the conference and its video, the content of speech of the speaker of the question and answer (voice information) and the video information, and recording them together with the time information. It is. Furthermore, an information integration means for specifying the speaker and linking the time information with the audio information and the video information is included. This speaker also includes a conference facilitator.

  The conference room constituting the system of the present invention is provided with entrance / exit control means for managing entrance / exit of conference attendees. This entry / exit control means identifies attendees entering and leaving the conference room, and confirms the trends of participants with time information, including entering and leaving the conference room during and after the conference, Record. The recorded entry / exit information is used as one of the key information in the identification and recording of the speaker in the conference. In the following specific description, the means is described as a unit.

  The configuration of the conference content recording system according to the present invention will be described in more detail as follows. The conference content recording system according to the present invention includes the above-described conference room, entrance / exit control unit, display, audio information and video information collection unit, recording unit, information integration unit, clock, and overall control unit. The recording unit stores various information collected by the entrance / exit control unit, display unit, audio information and video information collection unit, and information integration information created by the information integration unit.

  Information recorded in the recording unit can be retrieved at a later date using the required information as a key.

  Various information that occurred in the conference held in this conference room can be comprehensively recorded and reproduced by searching based on the required key, so the content of the conference can be identified by speaker, key information, time Can be reproduced with specific, etc. In addition, because the conference content can be reproduced along the time axis by specifying the speaker, it is easy to specify the so-called first speaker, and so on, based on a wide variety of information generated at the conference, a specific word or phrase can be A speaker can be specified as a search key, or vice versa.

3 is a functional block for explaining the overall configuration of the conference content recording system according to the present invention. It is a conceptual diagram explaining the structural example of the meeting room which concerns on this invention. It is a functional block diagram explaining the structural example of the entrance / exit control unit provided in the conference room which concerns on this invention. It is a functional block diagram explaining the example of the entrance / exit detection apparatus which comprises an entrance / exit control unit. It is a flowchart explaining an example of the entrance / exit detection operation before the meeting start in an entrance / exit control unit. It is a flowchart explaining an example of the entrance / exit detection operation after the meeting start in an entrance / exit control unit. It is a functional block diagram explaining the structural example of the display unit provided in the conference room which concerns on this invention. It is a figure explaining the specific example of a display unit. It is a figure explaining the specific example of the display part of a display unit. It is a flowchart explaining an example of the reading and recording operation | movement of the content displayed on a display unit. FIG. 3 is a functional block diagram for explaining a configuration example of a video / audio collecting unit according to the present invention. It is a figure explaining the structural example of the speaker video collection apparatus which comprises a video / audio collection unit. It is a figure explaining the structural example of the speaker voice collection apparatus which comprises a video / audio collection unit. FIG. 3 is a functional block diagram illustrating a configuration example of a recording unit according to the present invention. It is a functional block diagram explaining the structural example of the information integration unit which concerns on this invention. It is a functional block diagram explaining the structural example of the audio | voice-key information extraction apparatus in an information integration unit. It is a figure explaining the example of a process of the information cooperation apparatus in an information integration unit. It is a flowchart explaining an example of the procedure which searches the meeting information currently recorded on the recording unit.

  A variety of information generated at a meeting or the like is recorded together with time information in cooperation with a speaker, the utterance or a word or phrase displayed on the display, and desired information can be easily obtained from the recorded information. I was able to reproduce it.

  FIG. 1 is a functional block diagram illustrating the overall configuration of a conference content recording system according to the present invention. The conference content recording system of this embodiment includes a conference room 100, an entrance / exit control unit 200 for managing entrance / exit into the conference room, a display unit 300, a video / audio collecting unit 400, a recording unit 500, an information integration unit 600, A control unit 700 and a clock 800 are included. The overall control unit 700 is used to input the search conditions in the information search mode, which will be described later, the pre-setting of bibliographic items and the like necessary before the start of the system, the holding of the conference, and the like. An input / output interface 900 is connected. The input / output interface 900 includes an input device 901 including, for example, a keyboard and a mouse, and a display monitor 902 for checking keywords or key phrases and search conditions and outputting results, and executes a conversation between the operator and the system. .

  The clock 800 may be a clock provided in each control device or the overall control unit (CPU) 700, and these clocks are radio wave calibration clocks that are calibrated with a standard time radio wave signal (JJY), thereby improving the accuracy of date and time. You may make it hold | maintain. These components are connected to each other via a data bus 1000 and operate organically in order to achieve the object of the present invention under the control of the control device included in each component and the overall control unit 700. Hereinafter, embodiments of the present invention will be described in detail with reference to examples.

  A configuration example of Example 1 of the conference room 100 for operating the conference content recording system according to the present invention will be described with reference to FIG. A door 101 is provided at the entrance of the conference room 100. Although only one door 101 is shown in FIG. 2, this does not exclude the presence of a plurality. However, considering the installation cost of the entrance / exit detection device 201 provided in the vicinity of the door 101, it is desirable to configure the conference room 100 to enter / exit with one door 101. Although FIG. 2 shows that the entrance / exit detection device 201 is installed inside the conference room 100, it goes without saying that it may be provided outside.

  Inside the conference room 100, a display 301 and a display writing device 302 for writing information to the display are provided. The display writing device 302 corresponds to the function of the display 301. Details will be described later. A display reading device 302 for reading information displayed on the display 301 is provided. The display reading device 302 also corresponds to the function of the display 301 and will be described in detail later.

  Further, a video sampling device and a voice sampling device are installed inside the conference room 100. The video sampling device includes a plurality of cameras 4041-404 n and is installed in the conference room 100 so as to collect a video of a speaker and a video of an attendee passing through the door 101. The voice collection device is composed of a plurality of microphones (hereinafter referred to as microphones) 4051-405m, and is installed so as to collect a voice of a speaker.

  Inside the conference room 100, a presenter seat (podium) 305 for presenting the theme of the conference and a seat 306 for attendees of the conference are arranged. Although not shown, it is also possible to provide a seat for a conference attendant.

  FIG. 3 is a diagram illustrating a configuration example of an entrance / exit control unit provided at the entrance / exit of the conference room. The entrance / exit control unit 200 includes an entrance / exit detection device 201, an entrance / exit person information recording device 202, an attendee registration device 203, a voice analysis device 204, an attendee ID information storage device 205, and an entrance / exit control means control device 206. Consists of. The entrance / exit detection device 201 detects personal information of participants who are going to enter the conference room, and detects and manages participants who enter the conference room after that.

  A configuration example of the entrance / exit detection device 201 is shown in FIG. 3A. The entrance / exit detection device 201 includes an ID card reader 2011 that reads information stored in an ID card embedded with an IC chip carried by a participant who wants to enter a conference room, a so-called biointerface 2012 that performs biometric authentication of the participant, A camera 2013 for collecting the participant's appearance / request and the like, and a microphone 2014 for collecting the participant's voice can be provided. The bio-interface 2012 is a static feature (fingerprint, palm shape, retina and iris pattern, etc.) or behavioral feature (handwriting: writing trajectory, speed, writing pressure, etc.) of human physical features. Is detected. As other behavioral features, there is a method of detecting the lip movement feature, the blink feature, etc. during conversation using the output of the camera 2013.

  Such a bio-interface 2012 is provided for use in place of personal authentication using an ID card, but it is desirable that both be provided side by side in a meeting where authentication accuracy is particularly required. Alternatively, there is a method using only the biointerface. In the first embodiment, in order to detect the personal information (personal authentication), the participant carries the ID card embedded with the IC chip, and reads the personal authentication information stored in the IC chip in a non-contact manner. To do.

  Participants who want to enter the conference room are required to speak in the entrance / exit detection device 201. This utterance is easy to read out a predetermined phrase, but if you can use advanced speech recognition software, even an attendance greeting, natural conversation, oral declaration of affiliation / name, etc. Good. The voice collected by the microphone is analyzed by the voice analyzer 204. The voice analysis is performed using any one of the spectrum, waveform, and voiceprint of the collected voice, or a combination of two or more thereof. In the first embodiment, a voiceprint analysis method is used. The analysis result is recorded as a part of each ID information in the attendee ID information storage device 205 as digital data.

  The room entry / exit information recording device 202 records the room entry / exit information detected by the room entry / exit detection device 201, and the attendee registration device 203 registers the attendee of the day and leaves it as attendance history information. Time information acquired from the clock 800 is added to the room entry / exit information detected by the room entry / exit detection device 201 and is recorded in the room entry / exit information recording device 202.

  First, FIG. 3B shows a flow of processing for explaining an example of the entrance / exit detection operation before the start of the conference in the entrance / exit control means. FIG. 3B illustrates the operation of the entrance / exit control unit in a state where the door of the conference room is opened before the start of the conference. The state in which the door of the conference room is opened means an operation that does not require door opening / closing information. Therefore, this entrance / exit detection operation includes performing in the conference room (in the room with the door closed).

  In FIG. 3B, when an attendee approaches the entrance / exit of the conference room 100 and the ID card reader 2011 in FIG. 3A senses (there is an ID feeling, it is expressed as step-1 ··· S-1). The control unit control device 206 activates the microphone 2014 with the camera 2013 and starts collecting images of a person in the vicinity of the ID card reading device 2011 (S-2), and collects sound accompanying dialogue with the staff (S2). -4). As a matter of course, a microphone having directivity for the person is used. When performing biometric authentication, the biointerface is activated to perform biometric authentication (S-01), and features are detected (S-02).

  The video information collected by the camera 2013 is transferred to the video / audio collecting unit 400 together with the detected ID information (S-3). The audio information collected by the microphone 2014 is also transferred to the video / audio collecting unit 400 together with the ID information (S-5). The video information and audio information transferred to the video / audio collection unit 400 are compared with the attendee ID information recorded in the attendee ID information storage device 205 (S-6). If there is no attendance history in this comparison (S-7) (No determination), it is recorded as history information in this attendee ID information storage device 205 (S-8). If there is a past attendance history in the comparison (S-7) (Yes determination), it is recorded in the room occupant information recording device 202 (S-9), and the attendee registration device 203 as the attendee of today's meeting. It is registered (S-10). After recording in the room occupant information recording device 202, the process returns to the next participant process.

  Next, an example of the entrance / exit detection operation of the entrance / exit control unit after the start of the conference will be described with reference to FIG. 3C. This operation is an operation of the entrance / exit control unit in a state where the door of the conference room is closed, and is an operation of the entrance / exit control unit at the time of conference exit / exit, conference entrance / exit, and conference end.

  This system constantly monitors opening and closing of the door 101 (S-11). When the conference starts, the door 101 is closed. When an attendee leaves the room for some reason after the meeting starts, the person who leaves the room approaches the door 101 of the conference room 100 from the room. When the door 101 is opened and the ID card reader 2011 in FIG. 3A senses (ID sense, S-12), the person who has left the room is compared with the information recorded in the attendee ID information storage device 205. Specify (S-13). It is determined whether there is a record that the identified person leaving the room has entered the room (S-14). Usually, since there is a record of entering the room, it is determined whether to leave (S-15), and the fact that the person leaving the room has left the room is recorded in the room information recording device 202 (S-17). When it is confirmed that the person leaving the room leaves and the door 101 is closed (S-18), the process returns to (S-12).

  In the case of midway entry, the person entering the room is specified in (S-13) of FIG. 3C. It is determined whether or not there is a midway exit record after the start of the conference for the room occupant identified in (S-14). When there is a midway exit record after the start of the conference, the entrance / exit determination is made (S-15), and the entrance / exit information recording device 202 records the re-entry. This halfway entry / exit record serves as proof of the absence of the participant during a specific time period. This can be used as a subject exclusion condition in the search for prior speakers.

  In the case of late entry of a late participant, since there is no midway exit record in the entry / exit information recording device 202 in (S-14) of FIG. 3C, identification of the participant before the conference start in FIG. The same process as the recording is performed (S-16). Then go to (S-17). By performing the processing as described above, the entrance / exit status of the conference participants can be accurately grasped along with the time. This is one of the criteria for determining the degree of contribution to important evaluation items such as new proposals of individual participants when information including recorded conference contents is reused.

  FIG. 4 is a functional block diagram illustrating a configuration example of the display unit 300 in FIG. The display unit 300 in FIG. 1 includes a display 301, a display writing device 302 (302A / 302B), a display reading device 303, and a display unit control device 304. The display 301 displays a display image for a proposal (presentation) for holding the conference, such as a document, a drawing, and a mathematical formula related to the theme of the conference. In addition, the display 301 presents all the attendees with the contents of postscripts, corrections, and deletions that have been performed thereafter on the displayed visible image. Then, the display is attached with a function for reading the visible information displayed on the display screen periodically at a predetermined time or at any time by arbitrary operation and recording it together with the time information.

  The display 301 employed in the first embodiment is a whiteboard (or projection screen), and is a conference content recording system using the whiteboard as a display. As shown in FIG. 4A, the display 301 includes a display writing device 302 and a display reading device 303. The display writing device 302 includes a writing operation device 302A and a projection device 302B. Typically, the writing operation device 302A is a personal computer, and has an information source to be displayed on the display 301 in addition to the function of performing the display operation of the projection device 302B. A display reader 303 is attached to the display 301 which is a whiteboard. The proposed image is projected and displayed on the whiteboard display surface by the projection device 302B controlled by the operation device 302A on the whiteboard display surface.

  The display reading device 303 reads an image displayed by two-dimensionally scanning the display surface of the whiteboard. This reading is performed periodically at a predetermined time or at any time by arbitrary operation on the image information displayed on the display screen. The read information is recorded together with the time with an identifier indicating the display content of the display 301 in the recording unit 500 of FIG. 1 under the control of the display unit control device. In addition to the above whiteboard, a projection screen is installed, and the screen content displayed on the projection screen is performed by a projection device and a writing operation device (such as a personal computer). The contents can be read by a display reader. The image information displayed on the projection screen may be transferred directly from the writing operation device to the recording unit.

  FIG. 5 is a functional block diagram illustrating a configuration example of the video / audio collecting unit 400. The video / audio collection unit 400 includes a speaker video collection device 401, a speaker voice collection device 402, and a recording unit control device 403. The speaker video collecting device 401 inputs the imaging output of the video sampling device 404 including the cameras 4041 to 404n. The speaker voice collecting device 402 inputs the collected voice output of the voice sampling device 405 including the microphones 4051 to 405m.

  As shown in FIG. 5A, the speaker video collecting device 401 collects and processes video information taken by the cameras 4041-404n. For example, the imaging output of the camera 4041 is input to the motion detection device 4013 through an analog-digital converter (ADC) 4012. For example, the motion detection device 4013 extracts a difference between frames as an effective video signal. The motion detection device 4013 is provided in order to reduce the amount of recorded data, and may be unnecessary if the compression rate of the video compression device 4014 at the subsequent stage is sufficiently large. The compressed video signal is recorded in the recording unit 500.

  A configuration example of the speaker voice collecting device 402 is shown in FIG. 5B. The speaker voice collecting device 402 compresses the voice output of the microphones 4051 to 405m through the ADC 4021 by the voice compression device 4022, and the compressed voice signal is recorded in the recording unit 500. These operations are performed by the recording unit controller 403.

  A configuration example of the recording unit 500 is shown in FIG. The recording unit 500 includes a display display content recording device 501 that records information displayed on the display 301, a speaker video recording device 502 that records video information of a speaker collected by the speaker video collecting device 401, and speaker audio. Extracted from the speech content recording device 503 for recording the speech information of the speaker collected by the collecting device 402, the preliminary content recording device 504 for pre-recording the outline of the conference subject, and the speech of the conference participant collected in correspondence with the ID It has a voice print data storage device 505 for recording a voice print, and a recording unit control device 506 for controlling the operation of these devices.

  FIG. 7 is a functional block diagram illustrating a configuration example of the information integration unit 600 in FIG. The information integration unit 600 performs information association processing for recording various information such as voice, video, and display image generated in the conference in association with the participant ID information and time. The information integration unit 600 includes a voice → key information extraction / creation device 601, a key information / thesaurus storage device 602, an information linkage device 603, a dictionary 604, and an information integration unit control device 605. The voice-to-key information extraction device 601 extracts idiomatic terms, new words, technical terms, etc. in a predetermined field from the voice of the speaker by referring to the contents stored in the dictionary 604 and the key information / thesaurus storage device 602. The information linking device 603 associates with the ID of the speaker. The key information thus obtained updates the recorded contents of the key information / thesaurus storage device 602 to enrich the key information / thesaurus. The dictionary 604 includes a dictionary specialized for a specific technical field in addition to the general-purpose dictionary, and always operates in cooperation with the key information / thesaurus.

  FIG. 7A is a functional block diagram illustrating a configuration example of the voice-key information extraction device in the information integration unit 600. The speech recognition → key information extraction and creation device 601 includes a speech recognition / key information extraction device 6011, an extracted key information / thesaurus comparison device 6012, a key information / speaker association device 6013, and a voiceprint determination device 6014. The voice recognition / key information extraction device 6011 recognizes words, terms, and phrases from the voice collected by the microphone, and the new result is new in comparison with the key information stored in the key information / thesaurus storage device 602. While registering as key information, the information link device 603 and the key information / speaker associating device 6013 associate key information with a speaker using the determination result of the voiceprint determining device 6014.

  FIG. 7B is a diagram for explaining a processing example of the information cooperation apparatus 603 in the information integration unit 600. In the information cooperation device 603, “key information + speaker A” 60131, “key information + speaker B” 60131,... “Key information + speaker N” 6013N created by the key information / speaker association device 6013. Is input to the information linkage apparatus 603. The information linking device 603 adds the time information obtained from the clock to the input “key information + speaker” and transfers it to the information integration unit 600.

  The information integration unit 600 is input with the speech content of the speaker from the speech content recording device 503 and the display content of the display from the display display content recording device 501. Regarding these inputs, the information integration unit 600 links time, a speaker, a word, a phrase, and the like as keys. The integrated information is recorded in the recording unit 500 together with each information generation time. Needless to say, the recording unit 500 has a plurality of recording areas and records the integrated information recording area as described above, as well as rough information collected by the camera and microphone, intermediate processing information, and information generated from each unit. Has a region.

  FIG. 8 is a flowchart illustrating an example of a procedure for searching for conference information recorded in the recording unit 500. This conference information search is used to specify the technical idea, specific technical means, etc. (hereinafter referred to as “a certain remark”) proposed by the remark, description, display, etc. at the conference after the conference ends. The 1, an input device 901 including a keyboard and a mouse and a display monitor 902 for confirming a keyword or key phrase and search conditions and outputting a result are connected as an input / output interface 900. In the following description, it is assumed that the input / output interface 900 uses a keyboard and a mouse. FIG. 8 shows a flow of search for identifying a previous speaker of “a certain speech” from the conference information recorded in the recording unit 500.

First, “a certain remark” is input as a keyword or a key phrase composed of a plurality of words from the input / output interface 900 including a keyboard and mouse. At this time, a known search condition such as a conference date, a code for specifying a draft is input (S-31). The recording unit is searched based on the keyword or key phrase and the search condition (S-32). If there is a keyword or key phrase to be obtained by this search (S-33), the name of the speaker associated with the keyword or key phrase or the presence or absence of information specifying the related speaker is determined (S-34). If yes, the name of the speaker is output at (S-38). This output may include a keyword or key phrase input at the start of the search, or may include bibliographic items of the corresponding conference. By using “patentization”, “intellectualization”, “application”, and the like as keywords, it is possible to easily determine whether there is a patent proposal.

  If the corresponding keyword or key phrase is not found in (S-33), the process returns to (S-31) and the search condition is input again. Also, if there is no speaker name associated with the keyword or key phrase in (S-34), “not applicable” is output (S-38), and it is selected whether to end or enter the estimation work (S--). 35). For this selection, buttons such as “Yes” and “No” are displayed on the display monitor 902 to allow the operator to select them. The operator presses the “Yes” button to select to enter the estimation work, and performs a narrowing search work using related words or the like (S-36).

  The estimation work is repeated a predetermined number of times due to the importance of the object to be searched, time constraints, etc. (S-37). When one or a plurality of prior speakers are estimated by this estimation work, the result is output on the display monitor 902, printed out if necessary (S-38), and the process ends. The estimated multiple prior speaker candidates are listed in descending order of probability. The probability for this estimation is calculated by probability theory, such as the frequency of utterances of a predetermined word, the identification of the utterers before and after, the utterance contents of the questioners.

  With the conference content recording system configured as described above, various information generated in the conference is recorded together with the time information in cooperation with the speaker, the word, the phrase, etc., and a predetermined information is recorded from the recorded information. Desired information can be easily reproduced using a search key, and a prior speaker can be specified or estimated. Note that the key used for the measure may be a feature in image data or voiceprint data other than words / phrases.

  In the second embodiment, an electronic board capable of electronically writing, displaying, and reading is used as the display unit 300 in FIG. Since the configuration and operation other than the display unit 300 are the same as those in the first embodiment, only the writing / displaying / reading and recording / configuration of image information displayed on the display unit 300 will be described here. This electronic board is an electronic display device that can be directly written on the screen. FIG. 4B shows a configuration example of this display device. In FIG. 4B, the display device includes a display unit 3011 and a direct input unit 3012. The display unit 3011 uses a display panel that can control display / non-display for each pixel, such as a liquid crystal panel, a plasma panel, or an organic EL panel. The direct input unit 3012 is provided so as to overlap the screen of the display unit 3011.

  The direct input unit 3012 is a two-dimensional coordinate detection device. The two-dimensional coordinate detection device may be a known coordinate detection method such as an optical method, an electrostatic method, or a resistance method. Note that a display panel including a position sensor in a pixel can be used. A display panel provided with a position sensor in a pixel can display on a screen, and can add, modify, and delete the display. The display unit 3011 and the direct input unit 3012 in FIG. 4B are integrated. Can be understood as an image.

  In FIG. 4B, an image is written on the display unit 3011 by the display control device 3015 in the display writing device 302, and a screen display is performed. With respect to the displayed image, addition / correction / deletion is directly input on the screen using a pen-like input tool 3016. In this embodiment, an erasing tool (eraser) 3017 is provided in a part of the input tool 3016, but a member (erasing tool) having an erasing function may be separately provided. The erased contents can be saved in the background.

  Addition / correction by the input tool 3016, and the erasure result of the display part by the erasure tool are detected by the two-dimensional coordinate detection unit 3013, and are reflected on the screen of the display unit 3011 by the display control device 3015 by the addition / modification / erasure writing device 3014. .

  FIG. 4C is a flowchart for explaining the operation of recording information on the display screen, which has been displayed, added, erased, corrected, etc., on the recording unit using the electronic board shown in FIG. 4B. First, a presentation image is displayed on the display unit 3011 (S-21). The presenter explains the displayed image, and writes, corrects, deletes, etc. directly to the input unit 3012 as necessary. Specifically, underlining the corresponding parts of the display image increase according to the explanation, adding a circle, and writing a picture for explanation. In the process, the entered characters and pictures are erased to correct the erroneous entry (S-22). Directly input information such as writing, correction, and erasing is read by the display reader 303 (S-23).

  This reading is performed together with time information. The timing of reading can be performed every certain time or at any time according to the presenter's will. If there is no movement on the screen within a predetermined time, reading is not performed, and reading is performed when there is a change or after a lapse of time determined from that time. Or, when writing, correcting, erasing, etc. on the screen, it is performed at any time by the presenter's will.

  It is desirable to be able to select this reading mode and to combine timings. The read screen information is recorded in the recording unit via the video / audio collecting unit (S-24). This recording is completed (S-24), and during the conference (S-25) such as presentation and discussion (S-25), (S-22) → (S-24) is repeated. Then, when the conference ends (S-26), this process is completed.

  Also according to the second embodiment, various information generated in a meeting or the like is recorded together with time information in cooperation with a speaker, a phrase, a phrase, or the like, and desired information is recorded using a predetermined search key from the recorded information. Can be easily reproduced, and the prior speaker can be specified or estimated.

100: Conference room 101: Door 200: Entry / exit control unit 201: Entry / exit person detection device 202: Entry / exit person information recording device 203: Attendee registration device 204: Voice analysis device 205: Attendee ID information storage device 206: Entry Exit control unit controller 2011: ID card reader 2012: biointerface 2013: camera 2014: microphone (microphone)
2015: Door sensor 300: Display unit 301: Display 302: Display writing device 303: Display reading device 304: Display unit control device 305: Presenter / progress desk 306: Attendee seat 3011: Display unit 3012: Direct input unit 3013 Two-dimensional coordinate detection device 3014: writing device 3015: display control device 3016: input tool 3017: eraser (eraser)
400: Recording unit 401: Speaker video collecting device 4011: Camera posture control device 4012: Video signal ADC (analog / digital converter)
4013: Motion detection device 4014: Video compression device 402: Speaker voice collection device 4021: Audio signal ADC (analog / digital converter)
4022: Audio compression device 403: Recording unit control device 404: Video sampling device 4041-404n: Camera 405: Audio sampling device 4051-405m: Microphone (microphone)

500: Recording unit 501: Display display content recording device 502: Speaker video recording device 503: Speech content recording device 504: Preliminary content recording device 505: Voiceprint data storage device 506: Recording unit control device 600: Information integration unit 601: Audio → Key information extraction device 6011: Voice recognition / key information extraction / creation device 6012: Extracted key information / thesaurus comparison device 6013: Key information / speaker association device 6014: Voiceprint determination device 602: Key information / thesaurus storage device 603: Information Link device 604: dictionary 605: information integration unit controller 700: overall control unit 800: clock 900: input / output interface 1000: bus line.

Claims (2)

A method for recording and reproducing a conference content in which a variety of information generated in a conference held in a conference room is recorded and desired information can be extracted from the recorded information.
Information integration with an entrance / exit control unit provided at the entrance of the conference room for managing entrance / exit of conference participants, a display unit installed in the conference room, a video / audio collection unit, a recording unit, and information integration A unit, a general control unit, and a clock that outputs time information
The entrance / exit control unit includes an entrance / exit detection device, an entrance / exit information recording device, an attendee registration device, an attendee ID information storage device, and an entrance / exit control unit control device,
The video / audio collecting unit includes a speaker video collecting device that inputs a shooting output from a video collecting device including a plurality of cameras, and a speaker voice collecting device that inputs a sound output of a sound collecting device including a plurality of microphones. Have
The recording unit includes a display display content recording device that records visible information displayed on the display, a speaker video recording device that records video information of a speaker collected by a speaker video collecting device, and a speaker voice. A speech content recording device for recording speech information of a speaker collected by the collecting device, a preliminary content recording device for pre-recording a summary of the conference subject, and a voiceprint extracted from the speech of the conference participant collected in correspondence with the ID A voiceprint data storage device for recording
The information integration unit includes a voice → key information extraction and creation device, a key information / thesaurus storage device, an information linkage device, a dictionary, and an information integration unit control device.
The overall control unit has an input / output interface for inputting the search conditions in the information search mode, which will be described later, pre-setting bibliographic items and the like necessary for system activation and prior to the conference. Have
The information recorded in the recording unit is searched for information recorded in the recording unit by using a specific word or a specific phrase input from the input / output interface of the overall control unit at a later date as search key information. ID information, such as the name of the speaker, is identified and output as the speaker,
The conference content recording / reproducing method , wherein if the speaker corresponding to the specific word or the specific phrase is not searched, the overall control unit estimates and outputs the speaker . In claim 1,
The content of the conference is characterized in that the overall control unit estimates the frequency of speech of the specific word or the specific phrase, the speaker before and after the specific word or the specific phrase, and the content of the questioner by an established theory. Recording and playback method .

Images