JP7205844B1 - Report recording method, report recording program and report recording system - Google Patents

Abstract

A report recording method, a report recording program, and a report recording system that allow a presenter at an online conference to make a suitable presentation without creating material data in advance and that can also be archived after the event. offer. A report item recording system includes: a report item acquisition unit that acquires report items; An output unit, a comment input reception unit that receives input of a report comment by voice at the timing of displaying a report message, a characterization processing unit that converts the received report comment into character data through voice processing, and a predetermined conference that converts the character data into text data. and a recording unit for recording in association with the body and report items. [Selection drawing] Fig. 2

Description

The present invention relates to a method and the like for recording report items of conferences held online.

With recent changes in social conditions, there are more and more opportunities to hold business morning meetings, regular meetings, other meetings and conferences, as well as other reports and presentations online. As the number of online meetings increases, it will become possible for people who are far away to participate, and there will be less need to restrict participants due to physical restrictions such as the size of the meeting room. By facilitating archiving by means of recording, etc., it is becoming possible to contribute to information sharing when it is difficult to participate in a meeting in real time.

In addition, reference materials are usually distributed at such meetings, etc., but in conventional analog meetings, etc., those reference materials were mainly provided and shared in paper media. As conferences and other events have become online, the form of providing these reference materials has changed in various ways, and it has become possible to provide materials in a variety of forms, which have actually been proposed and implemented.

For example, in Patent Document 1, in a system that uploads material data to an external server and allows online meeting participants to view it, there is a technique related to a mechanism for changing and controlling the display state according to the computer operation of the participant. disclosed. By using this technique, it is expected that conference participants can be provided with more reliable opportunities to refer to materials.

JP 2016-170614

However, as can be seen from the need to upload the material data, such conventional technology requires the presenter to prepare the material data in advance. Therefore, if the material data does not reflect the real-time reactions of the presenter, such as questions at online conferences and remarks during the conference, we will revise the material data after the conference or create new supplementary materials. It was necessary to create

Not only is this work troublesome for the presenter, but if the opportunity for presentation is held regularly, there is no necessity for the participants to read the material data in advance, and even if they actually read it. It is doubtful that there is such a thing, and there is little need to create and prepare material data in advance.

In order to solve the above-described problems, the present invention provides a method for recording items to be reported by a meeting held online, comprising: a report item acquisition step for acquiring predetermined report items; a message outputting step of displaying and outputting a report message that is associated with the body and prompting the reporting of the predetermined report item; a comment input receiving step of receiving input of a report comment by voice at the timing of displaying the reporting message; A report item recording method for executing, by a computer, a characterization processing step of converting the reported comment into character data through voice processing, and a recording step of recording the character data in association with the predetermined meeting body and the report item. etc.

Further, in relation to the above invention, there is further provided a model generation step of generating a model for the speech processing based on the information recorded in the recording step, and the text processing step uses the model for speech processing. We also propose a report item recording method that further includes a model use substep that performs

Further, in relation to each of the above inventions, the message output step further includes a center display substep of outputting the report message relatively near the center of the display area provided in the online conference. We also propose methods.

Further, in relation to each of the above inventions, a report item recording method is also proposed, in which the message output step further includes a multiple message display sub-step for controlling display output of multiple report messages in a predetermined order.

Further, in relation to each of the above inventions, the comment input receiving step further includes a moving image input receiving substep of receiving an input of a moving image to be displayed while the voice input is being received together with the voice, and We also propose a report item recording method that further includes a moving image recording sub-step for recording in association with character data.

Furthermore, inventions relating to programs, systems, etc. related to each of the above methods are also proposed.

With the present invention, which mainly has the above configuration, a presenter at an online conference can make a suitable presentation without creating material data in advance, and it is possible to handle post-event archiving. .

Schematic diagram of the system of the invention FIG. 2 is a diagram showing an example of functional blocks of the system of Embodiment 1; Diagram showing an example of report message display output Schematic diagram showing an example of a configuration when each functional configuration of the system of Embodiment 1 is collectively realized as one piece of hardware. FIG. 4 is a diagram showing an example of the flow of processing in the system of the first embodiment; FIG. 11 is a diagram showing an example of functional blocks of the system of the second embodiment; A diagram showing an example of the flow of processing in the system of the second embodiment. A diagram for explaining a specific example of processing in the characterization processing step FIG. 11 is a diagram showing an example of functional blocks of the system of Embodiment 3; A diagram showing an example of the flow of processing in the system of the third embodiment. FIG. 11 is a diagram showing an example of functional blocks of the system of Embodiment 4; A diagram showing an example of the flow of processing in the system of the fourth embodiment.

First, FIG. 1 is shown. FIG. 1 is a diagram showing an outline of the present invention. As shown in the figure, the present invention allows one or a plurality of servers 0101, 0102 to communicate with participant terminals 0111, 0112, 0113, 0114, etc., which are terminals managed by a plurality of conference participants. It can be realized through sending and receiving information between them via a network.

As mentioned above, the present invention can be implemented by one or more servers 0101 and 0102. FIG. A specific example of using a plurality of servers is a conference data server that holds report items and conference archive data obtained from terminals managed by participants who are scheduled to give presentations at conferences among participant terminals. , a characterization processing server that performs characterization processing through voice processing, and a learning server for performing various processes to improve the accuracy of characterization processing and voice processing, etc. It is conceivable to use it by connecting via.

By the way, the types of participant terminals are not particularly limited, and for example, personal computers 0111, 0112, smartphones 0113, tablets 0114, etc. can be considered, and smart devices such as smart glasses and smart pens can also be considered. . Corresponding to the display on the display provided in these terminals, audio processing is performed using audio data and video data obtained through microphones, cameras, etc., which are also provided.

Up to this point, explanations have been given using Fig. 1 assuming a case where various servers are configured separately from all participant terminals and provided in the form of cloud computing via a network. The invention is not limited to such usage patterns. That is, by installing a program capable of executing the functions of the present invention on a predetermined participant terminal, all or part of the functions that can be provided by the present invention are executed on the participant terminal, so-called on-premise type Of course, it may be provided in any form. Moreover, it can also be realized by a method of connecting a recording medium storing a program as described here to a predetermined participant terminal.

Each embodiment of the present invention will be described below with reference to the drawings. First, mutual relationships between the embodiments and the claims are as follows. First, Embodiment 1 mainly corresponds to claims 1, 3, 6, 7, and the like. Embodiment 2 mainly corresponds to claim 2 and the like. Embodiment 3 mainly corresponds to claim 4 and the like. Embodiment 4 mainly corresponds to claim 5 and the like.

In addition, the present invention is not limited to these embodiments at all, and has the technical idea described in each claim of the claims according to common general technical knowledge, and various can be implemented in any manner.

<<Embodiment 1>>
<Overview>
FIG. 2 is a diagram showing an example of functional blocks of the report item recording system of this embodiment. As shown in the figure, the "report item recording system" 0200 of this embodiment includes a "report item recording unit" 0201, a "message output unit" 0202, a "comment input reception unit" 0203, and a "report item recording unit" 0201. It has a character processing unit 0204 and a recording unit 0205 .

In addition, the report item recording system described in detail below can also be configured so that one or more of its functions are realized by a plurality of devices, and the functional blocks are either hardware or It can be implemented as software. Taking a computer as an example, CPU, main memory, GPU, TPU, image memory, bus, secondary storage device (hard disk or non-volatile memory), keyboard, microphone, touch panel, electronic pen for touching the touch panel Various input devices such as, speakers, displays and other various output devices, hardware components such as other external peripheral devices, interfaces for external peripheral devices, communication interfaces, and driver programs for controlling those hardware and other application programs.

Then, by arithmetic processing according to the program developed on the main memory, data input from input devices and other interfaces and held in memory and hardware are processed and accumulated, and each hardware and software described above is processed and accumulated. Create commands to control. Here, the above program may be realized as a plurality of modularized programs, or may be realized as one program by combining two or more programs by cloud computing or other methods.

<Functional configuration>
The 'report item acquisition unit' 0201 is configured to acquire predetermined report items. The items to be reported here are defined according to the purpose of holding the conference, the items to be discussed in the conference, the attributes of the reporter, and other matters of the conference. In other words, when obtaining report items, IDs for identifying individual meeting bodies, the purpose of holding the meeting body, items to be discussed, participants, reporters, and IDs for identifying those persons. Information such as participant IDs is acquired in a mutually linked manner.

The report item acquisition unit acquires report items through output processing from a terminal managed by a person who organizes the conference body, a person who participates in the conference body, a reporter, or the like. For example, if "morning meeting", "general meeting", "management meeting", "project A progress confirmation", etc. are set in advance as meetings that are held regularly within the business, Acquire report items in a format that accepts information input. More specifically, for the "morning meeting", items such as "self-introduction and Q&A of new members", "reports on KPI achievement status of each department last week", and "sharing useful information" are reported. acquired as a matter. These report items can be obtained from each person described above as appropriate, and the process of obtaining information to delete or change the contents of the report items once obtained is also the acquisition of report items here. include. By adopting this structure, it is possible for all parties participating in or interested in the conference to set, change, or otherwise add or remove items for discussion, and to expand opportunities to provide the beginnings of lively discussions in the conference. will be able to

Here, when the report items are acquired, it is desirable that they are associated with the participant's ID of the participant who is the source of the acquisition. On top of that, among the various types of processing described above, regarding the deletion of report items and changes in content, there is an authority setting that only responds to processing requests from users identified by the participant ID, which is the original acquisition source. It is desirable that By adopting this structure, it is possible to avoid a situation in which the report items are changed or deleted in a manner unintended by the person who set the report items, and in the end the meeting does not proceed as intended. Become.

Even if the authority setting process described above is not performed, it is conceivable to record the participant ID of the person who changed the report item together with the changed contents. By recording such information so that it can be referred to, it is possible to discuss the intention of the change, etc. at the conference, and as a result, it becomes possible to help carry out frank discussions.

The 'message output unit' 0202 is configured to display and output a report message that is associated with a predetermined conference body and prompts a report of the predetermined report item. Here, the report message to be displayed and output is the content that prompts the report of a specific report item. When "status report" is set as a report item, a report message prompting the report of the achievement status is output.

The output timing of the report message can be set or changed according to the time interval relative to the date and time of the conference, or the number of output times can be set. More specifically, it may be output one day before the date and time of the meeting, or may be output multiple times every six hours from two days before the date and time of the meeting.

The setting of these output timings can be performed by a participant or the like who is linked by the participant ID, which is the output source of the predetermined report items. By adopting this configuration, the organizer of the meeting can check the contents of the report in advance and confirm the proceedings of the meeting in advance, and also can avoid omission of reports in the first place.

Incidentally, the report message is output in the form of display output in the message output unit. Specifically, output processing is performed in a format that can be displayed on a terminal managed by the participant to be output. The specific display mode can be set as appropriate, but it is desirable to output the report message relatively near the center of the display area. Specifically, it is conceivable to display and output a report message in a pop-up near the center of the display screen. By adopting this configuration, it is possible to output a report message to prompt a report even during work at a terminal, and avoid omission of a report.

In addition, as the output destination of the report message, if information specifying the reporter who should make the report is acquired together with the above-mentioned report item, only the reporter will be the output destination of the report message. good too. In addition, all the participants scheduled to participate in the conference body, or a plurality of persons who are associated with the report matter in some way may be output destinations. By adopting these structures, it is possible to output report messages not only to the reporter, but also to the reporter's superiors, colleagues, and the other party of the report. can be avoided.

By the way, here, it is possible to appropriately set whether or not to output a report message again when the above-mentioned predetermined timing comes after the input of the report comment is received by the comment input receiving section described later. In this case, the message with the same content may be displayed regardless of whether the report comment input acceptance process is performed or not. can be modified.") may be output. By adopting this structure, it is possible to encourage brushing up of the contents of the report and to remind the report so that no part of the report is omitted.

FIG. 3 is shown here. This figure shows an example of report message output from the message output section of the report item recording system of the present embodiment. In the figure, Mr. Ryota Ginza, who belongs to the design division of a business office, was about to apply by entering the prescribed items in the expense product application form. Since he was the person who reported the achievement status, even in the middle of the above application work, "KPI achievement status for the last week" was displayed near the center of the screen area so as to be superimposed on the display during the application work. Please tell me." is displayed and output. In this way, the structure in which the report message is displayed superimposed even during another task creates a situation in which the reporter is forced to focus on the report task above all else.

In addition, an icon indicating utterance is displayed at the lower right of the report message display in the same figure. By clicking this icon, the microphone is activated, and it becomes possible to receive the input of a report comment, which will be described later. In this way, by seamlessly constructing an interface from the display of report messages to the reception of input of report comments, it is possible to eliminate the psychological burden on the part of the reporter and avoid the omission of report comments. .

The 'comment input reception unit' 0203 is configured to receive input of a report comment by voice at the timing of displaying the report message. The display timing of the report message here means the timing at which the report message is output so that it can be displayed on the output destination terminal. It is configured to receive the input of the report comment by voice after the elapse of time. By adopting this configuration, it is possible to prompt the reporter who sees the display of the report message to quickly input a report comment.

In addition, as indicated by the phrase "receiving input of report comments by voice," the comment input reception unit accepts input of report comments after a predetermined time (approximately several seconds depending on the amount of text in the report message) has elapsed after the report message is displayed. Perform processing to enable Specifically, a process of activating a microphone provided in the terminal to enable acquisition of the voice of the reporter's utterance is performed, and a process of recording the acquired voice is performed. In addition, a process of activating a sensor for acquiring those voices is also conceivable. By controlling a terminal having some of these functions, the reporter can easily input a report comment without taking the trouble of inputting characters. Furthermore, by using a speech interface for inputting report comments, omissions in inputting report comments can be prevented.

The 'text processing unit' 0204 is configured to convert the received report comment into text data through voice processing. Various techniques are conceivable for converting the report comment into text data, and there are no particular limitations on the method. In the process of converting the data into character data, it is conceivable to summarize the speech data based on a predetermined rule and then convert the data into character data. By adopting this configuration, it is possible to suppress the amount of data to be acquired and improve the acquisition efficiency, and it is also convenient for improving the understanding of the text data and the report itself in the meeting body.

It is desirable that the degree of summarization of the summarization process can be adjusted as appropriate. For example, if the degree of summarization is increased, the character data may become itemized, which may contribute to comprehension of the summary, but may make it difficult to comprehend the content to be reported. On the other hand, at the stage of looking at the text data, it is only necessary to understand the topic, and it is desirable to deliberately limit the amount of information in the text data by setting a rule to ask the specific report items directly at the time of the meeting. In this way, considering that the purpose of using character data may differ depending on the meeting body or the report item, it is preferable to be able to generate character data with contents suitable for those purposes.

In addition, among the processing in the character conversion processing unit, there is not only processing to convert the acquired voice data into character data as it is, but also translation processing such as translating the content of the voice data into a predetermined language and then converting it into text. It may be feasible. By adopting this structure, it will be possible to support the evolution of interaction between global human resources and mutual understanding of work.

The 'recording unit' 0205 is configured to record the character data in association with the predetermined conference bodies and report items. The character data is information based on report comments input in association with predetermined report items, and according to the information acquisition path, the conference body ID for identifying the meeting body and the ID for identifying the report items. Perform processing to associate with.

In addition, when one meeting body includes a plurality of report items and each of them is associated with character data, it is conceivable that the association is made based on the order of reporting in the meeting body. By adopting this configuration, character data can be summarized and archived. For example, it is possible to display the character data in order according to the timetable of the meeting, and to allow absentees of the meeting or participants who want to check again to confirm the content of the report at the meeting after the fact. It is possible to contribute to convenience when doing so.

<Specific configuration>
FIG. 4 is shown here. This figure is a schematic diagram showing an example of a configuration when each functional configuration of the report item recording system of the present embodiment is collectively realized as one piece of hardware. Each device has a "CPU" 0401, a "storage device (storage medium)" 0402, a "main memory" 0403, an "input/output interface" 0404, and a "network interface" for executing various kinds of arithmetic processing. 0405, and transmits/receives information to/from an external peripheral device such as a "touch panel" 0406 or a "display" 0407 via an input/output interface.

In addition, the report item recording system of this embodiment can transmit and receive information to and from external devices such as a plurality of "participant terminals" 0408 and 0409 via a network interface. The specific aspect of this network interface may be wired or wireless, and the method of communication may be direct or indirect between terminals. Therefore, it is possible to adopt a form of so-called cloud computing in which information is transmitted and received between a specific external device or a user of the same device and a server managed by a third party.

Various programs as described below are stored in the storage device, and the CPU reads these various programs into the work area of the main memory, expands them, and executes them. These configurations are interconnected by a data communication path such as a "system bus" 0499, and perform information transmission/reception and processing (the basic configuration of the above configuration may be any of the other devices described below). The same is true for

(Specific composition of the reporting item acquisition department)
The report item acquisition unit is composed of a computer program and computer hardware. Store at a predetermined address in memory.

(Specific configuration of message output unit)
The message output unit is composed of a computer program and computer hardware. display and output a report message prompting a report of the items to be reported to a predetermined terminal.

(Specific configuration of the comment input reception unit)
The comment input reception unit is composed of a computer program and computer hardware. Specifically, at the timing of displaying the report message, the CPU reads out the "comment input reception program" 0430 from the storage device into the main memory and executes it. , receives the input of the report comment by voice from the terminal of the display output destination by executing the message output program, and stores it in a predetermined address of the main memory.

(Specific configuration of characterization processing unit)
The characterization processing unit is composed of a computer program and computer hardware. Specifically, the CPU reads out the "characterization processing program" 0440 from the storage device to the main memory and executes it, and by executing the comment input reception program The received report comment is converted into character data through voice processing and stored at a predetermined address in the main memory.

(Specific configuration of recording unit)
The recording unit is composed of a computer program and computer hardware. Specifically, the CPU reads out the "recording program" 0450 from the storage device to the main memory and executes it, and the character obtained by executing the character conversion processing program The data is stored and recorded in a predetermined address of the main memory in association with the predetermined conference bodies and report items.

<Process flow>
FIG. 5 is a diagram showing an example of the flow of processing when the report item recording system of the present embodiment is used to record the report items of a meeting held online. The flow of processing in the figure consists of the following steps. First, in step S0501, predetermined report items are acquired and recorded (report item acquisition step). After that, in step S0502, it is determined whether or not there is a request for output of the report message. If it is determined that there is no desire for output, the subsequent processing is not performed.

In step S0503, a report message is displayed and output to prompt a report of the predetermined report item in association with a predetermined meeting body (message output step), and in step S0504, the report is reported by voice at the timing of displaying the report message. Input of comments is accepted (comment input acceptance step). If the input of the report comment is not completed at this time, processing may be performed such that the processing from step S0502 onward is repeated.

Further, in the message output step, a process of controlling to display the report message relatively near the center of the display area (center display substep) may be performed.

After that, in step S0505, the received report comment is converted into character data through voice processing (characterization processing step), and in step S0506, the character data is recorded in association with the predetermined conference body and report items (recording step).

<effect>
By using the report item recording system that adopts the above configuration, the presenter at an online meeting can make a suitable presentation without creating material data in advance, and it can also be archived after the fact. be possible.

<<Embodiment 2>>
<Overview>
The report item recording system of this embodiment is basically the same as the technical features of the report item recording system described in the first embodiment, but the voice processing is performed based on the information recorded by the recording unit. A further feature is that a model is generated for the character processing unit, and voice processing is performed using the model.

<Functional configuration>
FIG. 6 is a diagram showing an example of functional blocks of the report item recording system of this embodiment. As shown in the figure, the "report item recording system" 0600 of this embodiment includes a "report item recording unit" 0601, a "message output unit" 0602, a "comment input receiving unit" 0603, and a "report item recording unit" 0601. It has a character conversion processing unit 0604, a recording unit 0605, and a model generation unit 0606, and the character conversion processing unit further has a model utilization means 0614. Since the basic configuration is the same as the report item recording system described with reference to FIG. .

The 'model generation unit' 0606 is configured to generate a model for the speech processing based on the information recorded in the recording unit. The recorded information referred to here can include, in addition to character data, meeting bodies and report items linked to the character data, voice data that was the basis of the characterization process, and the reporter. A wide range of information related to the report comment, such as the ID of the reporter to identify, the gender of the reporter, and the age of the reporter, can be included. These pieces of information are used to generate a model for speech processing, and these pieces of information are used as teacher data depending on what kind of model generation is intended.

It should be noted that it is possible to appropriately design what kind of method is used to generate the model using these pieces of information. For example, generating a model that improves the accuracy of recognizing words that frequently appear in specific report items in the office, or summarizing text data within a predetermined capacity in anticipation of the expected holding time of each meeting It is also conceivable to generate a model that contributes to processing. Needless to say, these models are not selectively generated, and multiple types of models may be generated, and it is also assumed that relearning will be performed through daily characterization processing through the model utilization means described later. .

The 'model using means' 0614 is configured to perform voice processing using the model generated by the model generation section in the text processing section. Here, when there are a plurality of models generated by the model generating unit, it may be arbitrarily selected or set which one of the one or more models is to be used or not. By making multiple models available according to the purpose of text processing, it is possible to meet the diverse needs of business operators.

<Specific configuration>
The hardware configuration of each device constituting the report item recording system of the present embodiment is basically the same as the hardware configuration of the report item recording system of the first embodiment described using FIG. Therefore, the specific processing of the "model generating unit" and "model using means", which have not been described so far, will be described below.

(Specific configuration of model generator)
The model generation unit is specifically composed of a computer program and computer hardware. A process for generating a model for the speech processing is performed, and the model generated as a result of the process is stored at a predetermined address in the main memory.

(Specific configuration of model utilization means)
The model utilization means is specifically composed of a computer program and computer hardware, and when the CPU reads out the character processing program from the storage device to the main memory and executes it, it also reads out and executes the "model utilization subprogram". , character processing is performed using the model obtained by executing the model generation program, and the processing result is stored in a predetermined address of the main memory.

<Process flow>
FIG. 7 is a diagram showing an example of the flow of processing in the report item recording system of this embodiment. The flow of processing in the figure consists of the following steps. First, in step S0701, the flow of processing in the figure consists of the following steps. First, in step S0701, predetermined report items are acquired and recorded (report item acquisition step). After that, in step S0702, it is determined whether or not there is a desire to output a report message. If it is determined that there is no desire for output, the subsequent processing is not performed.

In step S0703, a report message is displayed and output to prompt the report of the predetermined report item in association with a predetermined meeting body (message output step), and in step S0704, the report is reported by voice at the timing of displaying the report message. Input of comments is accepted (comment input acceptance step). If the input of the report comment is not completed at this time, processing may be performed such that the processing from step S0702 onward is repeated.

After that, in step S0705, the received report comment is converted into character data through voice processing (characterization processing step), and in step S0706, the character data is recorded in association with the predetermined conference body and report items (recording step), in step S0707, a model for the speech processing is generated based on the information recorded in the recording step (model generating step).

Here, FIG. 8 is shown. FIG. 7 is a diagram for explaining a specific example of processing in the characterization processing step in the flow of processing in the report item recording system of this embodiment described with reference to FIG. As shown in the figure, in the characterization processing step, first, in step S0815, it is determined whether or not a model is used in generating character data. If there is, as step S0825, voice processing is performed using the model according to the judgment result (model use sub-step). If it is determined not to use the model, then in step S0835 voice processing is performed without using the model.

After these processes are completed in both step S0824 and step S0834, the process proceeds to the process after step S0706 shown in FIG.

<effect>
By using the report item recording system of the present embodiment, compared to the case of using the report item recording system of the first embodiment, the characteristics of individual business operators, meeting bodies, report items, and unique reporting methods for each reporter. Even in such a case, it is possible to suitably convert it into text, and it is possible to widely visualize the contents of the report even to third parties.

<<Embodiment 3>>
<Overview>
The report item recording system of this embodiment is basically the same as the technical features of the report item recording system described in Embodiments 1 and 2, but when displaying and outputting report messages, a plurality of report messages are As a further feature, it is controlled to display and output in the order of .

<Functional configuration>
FIG. 9 is a diagram showing an example of functional blocks of the report item recording system of this embodiment. As shown in the figure, the "reported item recording system" 0900 of this embodiment includes a "reported item recording unit" 0901, a "message output unit" 0902, a "comment input reception unit" 0903, and a "report item recording unit" 0901. It has a character conversion processing unit 0904 and a recording unit 0905 , and the message output unit further has a 'plural message display unit' 0912 . Since the basic configuration is the same as that of the report item recording system described with reference to FIG. 2 of Embodiment 1, the function of the "multiple message display means" 0912, which is the difference, will be described below.

The 'multi-message display means' 0912 is configured to control the message output unit to display and output a plurality of report messages in a predetermined order. Here, multiple report messages refer to cases in which one meeting body has multiple items to report and a report message is output for each of them. It may also include cases where it is necessary to obtain reporting comments. In the latter case as well, a report message is displayed and output to the plurality of reporters, and the processing thereof is also included in the processing of the multiple message display means.

As a specific example of the process of displaying and outputting in a predetermined order, it is conceivable to sequentially display and output report messages in accordance with a predetermined reporting order or scheduled report time order. Furthermore, when it is determined that the input of the report comment by the immediately preceding reporter has been accepted, there may be a process of displaying and outputting the report message to the next reporter. If this structure is adopted, if the first reporter does not complete the input of the report comment by themselves, it will cause a great deal of trouble to the second and subsequent reporters, so such confusion should be avoided. Giving pressure leads to imparting motivation to complete the input of report comments early.

<Specific configuration>
The hardware configuration of each device constituting the report item recording system of the present embodiment is basically the same as the hardware configuration of the report item recording system of the first embodiment described using FIG. Therefore, the specific processing of the "multiple message display means", which has not been described so far, will be described below.

(Specific configuration of multiple message display means)
The multiple message display means is specifically composed of a computer program and computer hardware. When executing the message output program, the CPU reads out a "multiple message display subprogram" from the storage device into the main memory and executes it. A process for controlling display output of report messages in a predetermined order is performed.

<Process flow>
FIG. 10 is a diagram showing an example of the flow of processing in the report item recording system of this embodiment. The flow of processing in the figure consists of the following steps. First, in step S1001, predetermined report items are acquired and recorded (report item acquisition step). After that, in step S1002, it is determined whether or not there is a desire to output a report message. If it is determined that there is no desire for output, the subsequent processing is not performed.

In step S1003, a plurality of types of report messages prompting the report of the predetermined report items are displayed in a predetermined order in association with a predetermined meeting body (multiple message output step), and in step S1004, the plurality of reports Input of report comments corresponding to each report message is accepted by voice at the timing of displaying the message (multiple comment input acceptance step). If the input of the report comment is not completed at this time, processing may be performed such that the processing from step S1002 onward is repeated.

After that, in step S1005, the received report comment is converted into character data through voice processing (characterization processing step), and in step S1006, the character data is recorded in association with the predetermined conference body and report items (recording step).

<effect>
By using the report item recording system of the present embodiment, compared with the case of using the report item recording system of the first and second embodiments, even when there are multiple reporters, they cooperate with each other so as not to cause trouble. can motivate them to report

<<Embodiment 4>>
<Overview>
The report item recording system of this embodiment is basically the same as the technical features of the report item recording system described in Embodiments 1 to 3. A further feature is that the input of the display moving image is also received while the input is being received, and the recording unit also records the moving image in association with the character data.

<Functional configuration>
FIG. 11 is a diagram showing an example of functional blocks of the report item recording system of this embodiment. As shown in the figure, the "report item recording system" 1100 of this embodiment includes a "report item recording unit" 1101, a "message output unit" 1102, a "comment input reception unit" 1103, and a "report item recording unit" 1101. The comment input reception section further has a "moving image input reception means" 1113, and the recording section further has a "moving image recording means" 1115, respectively. Since the basic configuration is the same as the report item recording system described with reference to FIG. do.

The 'moving image input receiving unit' 1113 is configured to receive an input of the display moving image while the input of the voice is being received together with the voice in the comment input receiving unit. In the moving image input reception means, it is conceivable to perform control such as activating not only the microphone but also the camera on the terminal to which the report message is output, or activating an application for recording. It is conceivable that the timing for accepting video input is basically the same as the timing for accepting audio input.

The displayed moving image here may be an image of the reporter captured through the camera, or may be a display screen of a terminal managed by the reporter. In the former case, it is possible to process the presentation as if it were being recorded, so in effect, it is possible to enjoy the same result as if the report in the conference was recorded in advance. can. In the latter case, by displaying information that supplements the voice data and recording the display screen, it is possible to enrich the information contained in the content of the report.

The 'moving image recording means' 1115 is configured such that the recording unit also records the moving image in association with character data. In the case of the example given above, if you verbally enter a report comment and instruct to link the information contained in the report content in the video to a specific web page, in the text data, It is conceivable that the link processing is recorded as it is reflected. By adopting this configuration, it becomes possible to archive even moving image data, and information can be shared even with those who could not participate in the conference body.

<Specific configuration>
The hardware configuration of each device constituting the report item recording system of the present embodiment is basically the same as the hardware configuration of the report item recording system of the first embodiment described using FIG. Therefore, in the following, specific processing of the "moving image input receiving means" and "moving image recording means" which have not been explained so far will be explained.

(Specific configuration of video input receiving means)
The moving image input receiving means is specifically composed of a computer program and computer hardware, and when executing the comment input receiving program, the CPU reads out the "moving image input receiving subprogram" from the storage device into the main memory and executes it. At the same time, the input of the display moving image while the input of the sound is being received is also received and stored in a predetermined address of the main memory.

(Specific Configuration of Moving Image Recording Means)
The moving image recording means is specifically composed of a computer program and computer hardware. When executing the recording program, the CPU reads a "moving image recording subprogram" from the storage device into the main memory, executes it, and receives the input. A moving image is also linked with the character data and stored and recorded in a predetermined address of the main memory.

<Process flow>
FIG. 12 is a diagram showing an example of the flow of processing in the report item recording system of this embodiment. The flow of processing in the figure consists of the following steps. First, in step S1201, predetermined report items are acquired and recorded (report item acquisition step). After that, in step S1202, it is determined whether or not there is a desire to output a report message, and if it is determined that there is a desire to output a report message, the process proceeds to step S1203 and subsequent steps. If it is determined that there is no desire for output, the subsequent processing is not performed.

In step S1203, a report message prompting the report of the predetermined report item is displayed in association with a predetermined meeting body (message output step), and in step S1204, at the timing of displaying the report message, the The input of the report comment is accepted by accepting the input of the displayed moving image while the voice input is being accepted (moving image input accepting step). If the input of the report comment is not completed at this time, processing may be performed such that the processing from step S1202 onward is repeated.

After that, in step S1205, the received report comment is converted into character data through voice processing (text processing step), and in step S1206, in addition to the character data, the video input together in the video input receiving step is also converted to text data. The video is recorded in association with the predetermined meeting body and report items (moving image recording step).

<effect>
By using the report item recording system of the present embodiment, compared with the case of using the report item recording system described in Embodiments 1 to 3, a rich amount of information can be provided to the participants of the conference body by simple means. becomes possible.

0200... report item recording system, 0201... report item acquisition unit, 0202... message output unit, 0203... comment input reception unit, 0204... text processing unit, 0205... recording unit

Claims (7)

A method for recording matters to be reported by a meeting held online,
a report item acquisition step for acquiring predetermined report items;
A report message that is associated with a predetermined conference body and prompts the report of the predetermined report item is sent by the conference body.
a message output step of displaying and outputting to a terminal managed by a participant who is planning to present
a comment input receiving step of receiving input of a report comment by voice from the terminal at the timing of displaying the report message;
a characterization processing step of converting the report comment received from the terminal into character data through voice processing;
a recording step of recording the character data in association with the predetermined meeting body and report items;
A report item recording method that executes the above on a computer. further comprising a model generation step of generating a model for the speech processing based on the information recorded in the recording step;
2. The report item recording method according to claim 1, wherein the text processing step further comprises a model use substep of performing voice processing using the model. 3. The report item recording method according to claim 1, wherein the message outputting step further has a central display substep of outputting the report message in the vicinity of the center of the display area provided in the online conference. . 4. The report item recording method according to any one of claims 1 to 3, wherein the message output step further comprises a multiple message display substep for controlling display output of a plurality of report messages in a predetermined order. The comment input receiving step further includes a moving image input receiving substep for receiving an input of a moving image to be displayed while the input of the voice is being received together with the voice,
5. The report item recording method according to any one of claims 1 to 4, wherein the recording step further includes a moving image recording substep of recording the moving image in association with character data. A program for recording matters reported by a meeting held online,
a report item acquisition step for acquiring predetermined report items;
A report message that is associated with a predetermined conference body and prompts the report of the predetermined report item is sent by the conference body.
a message output step of displaying and outputting to a terminal managed by a participant who is planning to present
a comment input receiving step of receiving input of a report comment by voice from the terminal at the timing of displaying the report message;
a characterization processing step of converting the report comment received from the terminal into character data through voice processing;
a recording step of recording the character data in association with the predetermined meeting body and report items;
A report recording program that makes it possible to execute on a computer. A system for recording matters reported by a meeting held online,
a report item acquisition unit that acquires predetermined report items;
A report message that is associated with a predetermined conference body and prompts the report of the predetermined report item is sent by the conference body.
A message output unit that displays and outputs to a terminal managed by a participant who is planning to present
a comment input reception unit that receives input of a report comment by voice from the terminal at the timing of displaying the report message;
a characterization processing unit that converts the report comment received from the terminal into character data through voice processing;
a recording unit that records the character data in association with the predetermined meeting body and report items;
Report record system.

Images