JP2018201153A - Information processing system - Google Patents

Abstract

To provide an information processing system that can divide the content of the minutes into the details of representations and the details of inquiries to prevent the content of the minutes from becoming redundant.SOLUTION: An information processing system 1 comprises at least one acquisition device 2 and an image forming apparatus 3. The acquisition device 2 acquires agenda information indicating the details of a conference along the time series from a plurality of participants in the conference. The image forming apparatus 3 specifies, from the agenda information, the details of inquiries indicating the details of questions and answers between questioners and a presenter from among the plurality of participants. The image forming apparatus 3 generates minutes information indicating the content of the minutes on the basis of the details of the inquiries.SELECTED DRAWING: Figure 1

Description

  The present invention relates to an information processing system.

  The minutes creation system described in Patent Literature 1 includes a minutes creation device and a plurality of information terminals. Each information terminal is used for each participant of the conference. The information terminal displays the conference material. The minutes creation device converts the utterance content during the meeting into text information. The minutes creation device creates minutes by associating character information with material information. The material information indicates the material of the meeting. Information on the material is obtained from the information terminal.

JP2013-109106A

  However, in the minutes creation system described in Patent Document 1, for example, the contents of the minutes are mixed with the contents of the announcement and the contents of the questions. The contents of the presentation indicate the presenter's explanation regarding the material. The question contents include a questioner's question regarding the presenter's explanation and an answer corresponding to the presenter's question. Many of the presenters' explanations can be found in the material. Therefore, the contents of the minutes including the announcement contents may be redundant.

  The present invention has been made in view of the above problems, and its purpose is to divide the contents of the minutes into announcement contents and question contents, and to prevent the contents of the minutes from becoming redundant. To provide a system.

  The information processing system of the present invention includes at least one acquisition device and a terminal device. The said acquisition apparatus acquires the agenda information which shows the content of the said meeting from the some participant who participates in a meeting along a time series. The said terminal device specifies the question content which shows the content of the question and answer of a questioner and a presenter among these participants from the said agenda information. The terminal device generates minutes information indicating the contents of the minutes based on the question contents.

  According to the information processing system of the present invention, it is possible to divide the contents of the minutes into announcement contents and question contents, and to prevent the contents of the minutes from becoming redundant.

It is a block diagram which shows the information processing system which concerns on embodiment of this invention. It is a perspective view which shows the acquisition apparatus which concerns on embodiment of this invention. 1 is a diagram illustrating a configuration of an image forming apparatus according to an embodiment of the present invention. (A) is a figure which shows an example of the 1st minutes formed on the paper, (b) is a figure which shows an example of the 2nd minutes formed on the paper. It is a flowchart which shows the production | generation process of the minutes information by the control part which concerns on embodiment of this invention.

  Hereinafter, embodiments of the present invention will be described with reference to the drawings. However, the present invention is not limited to the following embodiments. In the drawings, the same or corresponding parts are denoted by the same reference numerals and description thereof will not be repeated.

  An information processing system 1 according to an embodiment of the present invention will be described with reference to FIG. FIG. 1 is a block diagram showing an information processing system 1 according to this embodiment. In the present embodiment, the information processing system 1 creates a minutes. The contents of the minutes indicate the contents of the meeting.

  Here, for example, a conference is a decision in which a plurality of participants participate to make a decision. In the present invention, the conference may be a lecture or a lecture. The lecture will proceed according to the subject. The lecture will be about the academic methods and results.

  The plurality of participants include, for example, a presenter and a questioner. For example, the presenter explains the contents of the presentation using materials. The presenter answers the questioner's question. The questioner asks questions about the contents of the presentation.

  As shown in FIG. 1, the information processing system 1 includes a plurality of acquisition devices 2, an image forming device 3, and a presenter terminal 7. In the information processing system 1, the plurality of acquisition devices 2, the image forming device 3, and the presenter terminal 7 are connected via a communication network L. The communication network L is, for example, an Internet line or a dedicated line.

  The presenter terminal 7 is, for example, a notebook personal computer. The presenter terminal 7 stores a plurality of materials. The plurality of materials are used when the presenter explains the contents of the presentation at the meeting. The material is, for example, an image showing a slide. The slide includes a material image, a character image, and an AR marker. The AR marker is a marker for distinguishing materials from other materials.

  The presenter terminal 7 includes, for example, a display unit. The presenter terminal 7 causes the display unit to display a plurality of materials in order in the meeting. As a result, the plurality of participants can confirm the material via the display unit. The presenter terminal 7 may sequentially display a plurality of materials on the wall surface of the venue via a projector, for example. In addition, the presenter terminal 7 may sequentially display a plurality of materials on a display of a notebook computer included in each of a plurality of participants, for example.

  The presenter terminal 7 outputs the material information to the image forming apparatus 3 after the conference is finished, for example. The material information is information in which each of a plurality of materials is associated with a conference time series. Specifically, the material information includes a plurality of materials and usage information. The usage information indicates the timing at which each material was used in the meeting in chronological order. The presenter terminal 7 may output the material information to the image forming apparatus 3 before the meeting is started, for example. In this case, the material information is information in which each of a plurality of materials is associated with a time series scheduled for the meeting.

  The plurality of acquisition devices 2 acquire agenda information from a plurality of participants. The agenda information indicates the content of the meeting in chronological order. Each of the plurality of acquisition devices 2 is possessed by each of a plurality of participants. In the present embodiment, the agenda information includes audio information and agenda image information. The audio information indicates the participant's utterance content and utterance volume. The agenda image information indicates an image indicating an environment that enters the view of the participant. Each of the acquisition devices 2 outputs agenda information to the image forming device 3.

  The acquisition device 2 includes a recording unit 21 and an imaging unit 22. The recording unit 21 records the participant's voice. The recording unit 21 outputs the participant's voice to the image forming apparatus 3 as agenda information. The imaging unit 22 captures an agenda image. Typically, the agenda image is a moving image. The imaging unit 22 outputs the agenda image to the image forming apparatus 3 as agenda information.

  The image forming apparatus 3 is an example of a terminal device of the present invention. The image forming apparatus 3 includes an input unit 31, an image forming unit 32, and a control unit 4. The image forming unit 32 forms an image on a recording medium based on the image data. In the present embodiment, the image forming unit 32 creates a minutes on a recording medium based on the minutes information. The minutes information indicates the contents of the minutes.

  The input unit 31 outputs an operation signal to the control unit 4. The operation signal corresponds to an operation of an operator who operates the image forming apparatus 3. The operation of the operator includes various settings of the image forming apparatus 3, for example.

  The control unit 4 includes, for example, a processor and a storage unit. The processor is, for example, a CPU (Central Processing Unit). The storage unit includes, for example, a semiconductor memory and an HDD (Hard Disk Drive). The processor controls the input unit 31 and the image forming unit 32 based on a computer program. The computer program is stored in advance in the storage unit.

  The storage unit stores the agenda information input from the acquisition device 2. The storage unit stores the agenda information in association with the participant. Specifically, the storage unit stores in advance the identification number of the acquisition device 2, the participant's personal name, and the participant's classification. The identification number is a number assigned to each acquisition device 2. The identification number is used for recognizing the individual of the acquisition device 2. The participant's personal name is stored in association with the identification number. In other words, the participant and the acquisition device 2 are stored in association with each other. The classification of the participant is stored in association with the identification number. The classification of the participant indicates whether or not the participant is the first participant. The first participant includes a presenter. The first participant further includes a preset participant among the participants excluding the presenter. The participant classification further indicates whether the first participant is a presenter. The storage unit stores the agenda information in association with the identification number. As a result, each piece of agenda information is stored in the storage unit in association with each participant.

  Further, the storage unit stores the material information input from the presenter terminal 7. The storage unit stores the material information in association with the identification number of the acquisition device 2 used by the presenter.

  The control unit 4 generates minutes information based on the minutes information and material information. The processor of the control unit 4 functions as a search unit 41, a generation unit 42, and a specification unit 43 based on a computer program. Details of the search unit 41, the generation unit 42, and the specification unit 43 will be described later with reference to FIGS. 4 (a) and 4 (b).

  Next, the configuration of the acquisition device 2 will be further described with reference to FIGS. 1 and 2. FIG. 2 is a perspective view showing the acquisition device 2. As illustrated in FIG. 2, the acquisition device 2 further includes a main body 23 in addition to the recording unit 21 and the imaging unit 22. In the present embodiment, the acquisition device 2 is a head mounted display.

  The main body 23 is formed in a U shape. The main body 23 is attached to the participant's head. The main body unit 23 supports the recording unit 21 and the imaging unit 22. The recording unit 21 includes, for example, a frame unit and a microphone. The frame portion extends from the main body portion 23. The microphone is arranged at the tip of the frame part. The microphone is located in the vicinity of the participant's mouth when the main body 23 is attached to the participant's head. As a result, the recording unit 21 can record the participant's voice.

  The imaging unit 22 includes a frame unit and an imaging element. The frame portion extends from the main body portion 23. The image sensor is disposed at the tip of the frame portion. The imaging element is, for example, a CCD (Charge Coupled Device) image sensor. The image sensor is located in the vicinity of the participant's eyes when the main body 23 is mounted on the participant's head. As a result, the imaging unit 22 can capture an agenda image. Note that the acquisition device 2 may include, for example, a pin microphone attached to the chest of the participant and an image sensor arranged in parallel with the pin microphone.

  Next, the configuration of the image forming apparatus 3 will be further described with reference to FIGS. 1 and 3. FIG. 3 is a diagram illustrating a configuration of the image forming apparatus 3. As shown in FIG. 3, the image forming apparatus 3 is a multi-function machine. The multifunction device has, for example, a printer function. The multifunction machine has at least one of a copy function and a facsimile function, for example.

  In addition to the input unit 31, the image forming unit 32, and the control unit 4, the image forming apparatus 3 further includes a paper feed unit 33, a fixing unit 34, and a discharge tray 35. The image forming apparatus 3 forms an image on the paper S fed from the paper feed unit 33. The paper S is an example of the recording medium of the present invention. The paper S is, for example, plain paper, copy paper, recycled paper, thin paper, thick paper, glossy paper, or OHP (Overhead Projector) paper.

  The image forming unit 32 includes an image carrier 32a, a charging unit 32b, an exposure unit 32c, a developing unit 32d, and a transfer unit 32e. The image forming unit 32 forms a toner image on the paper S. The fixing unit 34 fixes the toner image on the paper S. The sheet S on which the toner image is fixed is discharged to the discharge tray 35.

  The input unit 31 includes, for example, a display. The display displays various screens. The input unit 31 has a touch panel function.

  Next, the control unit 4 will be further described with reference to FIGS. 1, 4A, and 4B. First, with reference to FIG. 4A and FIG. 4B, the minutes according to the present embodiment will be described. The minutes are formed by dividing the first minutes A1 and the second minutes A2. FIG. 4A is a diagram showing an example of the first minutes A1 formed on the paper S. FIG. FIG. 4B is a diagram illustrating an example of the second minutes A2 formed on the paper S. The first minutes A1 shows the presentation contents of the presenter. The second minutes A2 shows the contents of questions between the presenter and the questioner.

  As shown in FIG. 4A, the first minutes A1 are formed on the paper S. The first minutes A1 includes a plurality of slides G and a description D corresponding to each of the plurality of slides G. The explanation D shows the explanation content of the presenter corresponding to the slide G. The description D is located immediately below the corresponding slide G. The first minutes A1 are formed, for example, by arranging the slide G and the description D in order so as to correspond to the time series of the meeting.

  The description D includes a description D1 and a description D2. The explanation D2 is an emphasis portion, and is formed in bold so as to be emphasized more than the explanation D1. The description D2 may be different in color from the description D1, for example. The description D2 may be underlined.

  As shown in FIG. 4B, the second minutes A2 are formed on the paper S. The second minutes A2 includes a plurality of slides G, a question N, and an answer M of the question N. The question N indicates the question content of the questioner. The answer M indicates the answer content of the presenter corresponding to the question N. For example, the second minutes A2 are formed by sequentially arranging the slide G, the question N, and the answer M so as to correspond to the time series of the meeting. The question N is located immediately below the corresponding slide G. The answer M is located immediately below the corresponding question N.

  The question N includes a question N1 and a question N2. The answer M includes an answer M1 and an answer M2. The question N2 and the answer M2 are emphasized portions, and are formed in bold so as to be emphasized more than the question N1 and the answer M1. The question N2 and the answer M2 may be different in color from the question N1 and the answer M1, for example. The question N2 and the answer M2 may be underlined.

  Next, the control unit 4 will be described with reference to FIGS. 1, 4A, and 4B. The control unit 4 described with reference to FIG. 1 generates minutes information based on the minutes information and the material information. Further, the control unit 4 controls the image forming unit 32 so as to form an image indicating the contents of the first minutes A1 on the paper S based on the minutes information. Further, the control unit 4 controls the image forming unit 32 so that an image indicating the content of the second minutes A2 is formed on the paper S based on the minutes information.

  The generation unit 42 generates character information based on the agenda information. Specifically, the generation unit 42 generates character information based on the voices of the plurality of participants. The generation unit 42 generates character information from voice by using voice recognition, for example. The character information indicates a plurality of character strings. The generation unit 42 arranges a plurality of character strings in a time series of the meeting and stores them in the storage unit.

  The search unit 41 searches the contents of questions from the agenda information based on the agenda information. In this embodiment, the search part 41 searches the character string which shows the question content from several character strings. The search unit 41 searches the question content and classifies the plurality of character strings into a character string indicating the question content and a character string indicating the announcement content. Specifically, the search unit 41 identifies a character string uttered during the question period among a plurality of character strings as a character string indicating the contents of the question. The question period is a period from the question start timing to the question end timing in the time series of the meeting. Moreover, in this embodiment, the search part 41 specifies the character string except the character string uttered during the question period among several character strings as a character string which shows the content of presentation.

  The search unit 41 specifies the question start timing based on the character information. The question start timing is the timing when participants other than the presenter start speaking. Specifically, the search unit 41 specifies, as the question N, a character string indicating a voice other than the presenter based on a plurality of character strings. The search unit 41 identifies the timing at which the question N is uttered as the question start timing in the time series of the meeting.

  The search unit 41 identifies the question end timing based on the agenda information and the character information. For example, the search unit 41 determines whether the plurality of character strings include a specific character string after the question N based on the plurality of character strings. The search unit 41 specifies the question end timing based on the position of the specific character string on the time series. The question end timing is the timing when the utterance corresponding to the specific character string is finished. The specific character string is set in advance. Typically, the specific character string is, for example, “OK” and “Thank you”.

  Moreover, the search part 41 specifies the period when the character string which shows a speech of a presenter continues after a question start timing. The search unit 41 identifies the continuous character string of the presenter as the character string indicating the end of the question when the period of continuous character strings indicating the speech of the presenter exceeds the first threshold in the time series of the meeting. In this case, the question and answer end timing is a timing when the continuous character string of the presenter exceeds the first threshold. In addition, the search unit 41 identifies the timing at which the slide is switched as the question and answer end timing based on the material information.

  Moreover, the search part 41 specifies a question end timing based on the presenter's agenda image among agenda information, for example. In detail, the search part 41 specifies the participant shown by the presenter's agenda image as a questioner after a question start timing. The search unit 41 determines whether or not a participant is shown in the agenda image by using, for example, face recognition. After specifying the questioner, the search unit 41 measures the period during which the questioner has framed out of the presenter's agenda image. The search unit 41 identifies the timing at which the measured period exceeds a predetermined period as the question and answer end timing.

  The search part 41 specifies the character string of a question period as a character string which shows the question content. The search part 41 specifies the character string which shows a speaker's voice in the character string which shows the question contents as the reply M. The search unit 41 adds a tag indicating the answer M to the character string identified as the answer M. The tag further indicates a slide G corresponding to the answer M.

  Moreover, the search part 41 specifies the character string which shows audio | voices other than a presenter as the question N in the character string which shows the question content. The search unit 41 adds a tag indicating the question N to the character string identified as the question N. The tag further indicates a slide G corresponding to the question N.

  The search part 41 specifies the character string which shows the audio | voice of the presenter except a question period as the description D. FIG. The search unit 41 adds a tag indicating the description D to the character string specified as the description D. The tag further indicates the slide G corresponding to the position on the time series of the description D. Note that when the query end timing is specified based on the first threshold, the search unit 41 specifies that the character string that continues beyond the first threshold is the answer M and the description D. The search unit 41 adds a tag indicating that it is the answer M and the explanation D to the character string identified as the answer M and the explanation D. The tag further indicates a slide G corresponding to a continuous character string.

  The generation unit 42 generates minutes information indicating the contents of the first minutes A1 based on the material information and the character string to which the tag indicating the description D is added. Specifically, the generation unit 42 rearranges each of the plurality of slides G in time series in the storage area. Further, the generation unit 42 arranges the description D immediately below the slide G indicated by the tag in the storage area. The explanation D arranged immediately below the slide G may be arranged in a plurality of stages based on the timing of the speaker's utterance. Specifically, the generation unit 42 arranges the explanation D in a plurality of stages in the storage area when there is no speech from the presenter beyond a predetermined period.

  Based on the document information, the character string to which the tag indicating the question N is added, and the character string to which the tag indicating the answer M is added, the generation unit 42 determines the contents of the second minutes A2. The minutes information shown is generated. Specifically, the generation unit 42 rearranges each of the plurality of slides G in time series in the storage area. The generation unit 42 arranges the question N and the answer M immediately below the slide G indicated by the tag in the storage area. Specifically, the question N is disposed immediately below the slide G, and the answer M is disposed immediately below the question N.

  The specifying unit 43 specifies an emphasized portion emphasized in the minutes. In the present embodiment, the highlighted portion is a part of the explanation D, the question N, and the answer M. The emphasized portion is formed in bold on the paper S.

  The specifying unit 43 specifies a period in which the agenda image captured by each of the plurality of participants excluding the presenter shows a specific image. The specific image is an image showing a slide of the material used in the meeting. In the present embodiment, an image showing a slide is specified by whether or not an AR marker is included. The identification unit 43 identifies a period indicating a specific image for the agenda image captured by each of a plurality of participants excluding the presenter.

  The specifying unit 43 specifies the number of the agenda images in which the periods indicating the specific images overlap in the time series of the meeting after specifying the period indicating the specific images for each agenda image of the plurality of participants excluding the presenter. calculate. As a result, in the time series of the meeting, the number of participants who enter the field of view with the same slide at the same timing is specified. When the number of identified agenda images is larger than a preset number, the identifying unit 43 identifies a character string indicating a voice in an overlapping period as an emphasized portion.

  The identification unit 43 edits the minutes information so that the emphasized part is formed in bold. The specifying unit 43 may specify an image indicating a slide by using, for example, image recognition instead of the AR marker.

  In the information processing system 1 of the present embodiment, the first minutes A1 indicating the contents of the conference announcement and the second minutes A2 indicating the contents of the question and answer of the meeting can be created based on the minutes information and the material information. Therefore, when most of the explanation D is described in the slide G, it is possible to prevent the contents of the minutes from becoming redundant by creating the second minutes A2 as the minutes.

  Next, with reference to FIG. 5, the process of generating minutes information by the control unit 4 will be described. FIG. 5 is a flowchart showing a process for generating minutes information by the control unit 4. For example, when the operation signal instructing generation of the minutes information is input after the minutes information and the material information are input, the control unit 4 performs the process of generating the minutes information.

  As shown in FIG. 5, after the operation signal is input, the control unit 4 generates character information based on the agenda information in step S10. After generating the character information, the control unit 4 searches for a question and answer start timing in step S20. After searching for the start timing, the control unit 4 searches for a question and answer end timing in step S30.

  After searching for the end timing, the control unit 4 specifies a character string indicating the question content and a character string indicating the announcement content based on the start timing and the end timing in step S40. After specifying the character string, the control unit 4 indicates the minutes information indicating the contents of the first minutes A1 and the contents of the second minutes A2 based on the specified character strings and the material information in step S50. Minutes information is generated. After generating the minutes information, the control unit 4 ends the minutes information generation process.

  The information processing system 1 according to the embodiment of the present invention has been described above with reference to FIGS. However, the present invention is not limited to the above-described embodiment, and can be implemented in various modes without departing from the gist thereof.

  For example, in the embodiment of the present invention, an image indicating the contents of the minutes is formed on the paper S based on the minutes information, but the present invention is not limited to this. The minutes should be confirmed by at least the participants. For example, the minutes information is output from the image forming apparatus 3 to the personal computer owned by the participant, and the worker may check the minutes via the monitor of the personal computer. The minutes information is output from the image forming apparatus 3 to a personal computer via e-mail or a recording medium, for example.

  In the embodiment of the present invention, the minutes information is generated by the image forming apparatus 3 which is an example of the terminal device based on the minutes information and the material information. However, the present invention is not limited to this. The terminal device only needs to be able to generate the minutes information based on the agenda information and the material information. The terminal device may be a personal computer, for example. In this case, the minutes information is output from the terminal device to the image forming apparatus, and an image indicating the minutes can be formed on the sheet by the image forming apparatus.

  In the embodiment of the present invention, the acquisition device 2, the image forming device 3, and the presenter terminal 7 are connected via the communication network L, but the present invention is not limited to this. The acquisition device 2 only needs to be able to output agenda information to the image forming device 3, and the presenter terminal 7 only needs to be able to output material information to the image forming device 3. For example, the agenda information and the material information are output from the acquisition device 2 and the presenter terminal 7 to the image forming device 3 via a recording medium.

  In order to facilitate understanding, the drawings schematically show each component mainly, and the thickness, length, etc. of each component shown in the drawings are different from the actual for convenience of drawing. . Moreover, the shape of each component shown by said embodiment is an example, Comprising: It does not specifically limit, A various change is possible in the range which does not deviate substantially from the effect of this invention.

  The present invention relates to an information processing system that can create minutes based on agenda information indicating the contents of a conference, and is useful for improving user convenience.

DESCRIPTION OF SYMBOLS 1 Information processing system 2 Acquisition apparatus 3 Image forming apparatus 4 Control part 41 Search part 42 Generation part

Claims (8)

At least one acquisition device that acquires agenda information indicating the contents of the conference from a plurality of participants participating in the conference in time series;
A terminal device for identifying, from the agenda information, a question and answer content indicating a question and answer content of the questioner and the presenter among the plurality of participants,
The said terminal device is information processing system which produces | generates the minutes information which shows the content of the minutes based on the said question content. The terminal device
A generating unit for generating character information based on the agenda information;
The information processing system according to claim 1, further comprising: a search unit that searches for the contents of the question based on the agenda information and the character information. The acquisition device includes a recording unit that records the voice of the participant, and an imaging unit that captures an agenda image indicating an image of an environment that enters the view of the participant,
The information processing system according to claim 2, wherein the search unit specifies a timing when the questioner speaks as a start timing of the question and answer. The character information indicates a plurality of character strings arranged in time series,
The information processing system according to claim 3, wherein the search unit searches a specific character string indicating the end of the question and answer from the plurality of character strings, and specifies the end timing of the question and answer.   5. The information processing system according to claim 3, wherein the search unit specifies a timing at which a period during which the presenter continuously utters exceeds a first threshold as an end timing of the question-and-answer session.   6. The search unit according to claim 3, wherein the search unit specifies a timing at which a material used in the conference by the presenter is switched to another material as an end timing of the question and answer. Information processing system.   7. The search unit according to claim 3, wherein the search unit specifies a timing at which a period when the questioner has framed out of the agenda image of the presenter exceeds a second threshold as an end timing of the question and answer session. The information processing system according to item 1. The terminal device is an image forming device,
The information processing system according to any one of claims 1 to 7, wherein the image forming apparatus forms an image indicating a content of the minutes on a recording medium based on the minutes information.

Images