JP2023070466A - Information processing method, computer program, and information processing apparatus - Google Patents

Abstract

To provide an information processing method designed to support examination or analysis of a video obtained by recording a business negotiation, a computer program, and an information processing apparatus.SOLUTION: In an information processing method, an information processing apparatus acquires a business negotiation video obtained by recording a business negotiation, converts, based on the acquired business negotiation video, voice information related to a speech of a participant who participates in the business negotiation to text information, and displays the converted text information. The information processing apparatus may record the business negotiation video, receive conditions for multiple participants participating in the business negotiation to share the business negotiation video, and generate information for accessing the business negotiation video on the basis of the received conditions. The conditions may specify a point of time at which reproduction of the business negotiation video is started.SELECTED DRAWING: Figure 7

Description

Applied for application of Article 30, Paragraph 2 of the Patent Act Published on the website of ailead on July 8, 2021 (https://www.ailead.app/)

Applied for application of Article 30, Paragraph 2 of the Patent Act Published on the website of PR TIMES on July 8, 2021 (https://prtimes.jp/main/html/rd/p/000000011.000040516.000000011.000040516. html)

Applied for application of Article 30, Paragraph 2 of the Patent Law Published on September 14, 2021 on the PR TIMES website (https://prtimes.jp/main/html/rd/p/000000017.000040516. html)

Applied for application of Article 30, Paragraph 2 of the Patent Act Published on the website of PR TIMES on September 22, 2021 (https://prtimes.jp/main/html/rd/p/000000019.000040516. html)

Applied for application of Article 30, Paragraph 2 of the Patent Act Published on the website of PR TIMES on October 12, 2021 (https://prtimes.jp/main/html/rd/p/000000020.000040516.000040516. html)

Applied for application of Article 30, Paragraph 2 of the Patent Act Published on the PR TIMES website on October 28, 2021 (https://prtimes.jp/main/html/rd/p/000000022.000040516.000040516. html)

The present invention relates to an information processing method, a computer program, and an information processing apparatus for handling recorded business negotiation videos.

2. Description of the Related Art In recent years, by transmitting and receiving data such as images and sounds between a plurality of terminal devices via a network, it is possible for a plurality of users using the terminal devices to converse at the same time. Using this technology, so-called online conferences or remote conferences, in which a plurality of users in remote locations hold conferences via a network, are widely used.

In Patent Document 1, producers and consumers gather online at the same date and time and actually gather in one place by utilizing an online conference application and an online payment site that allow online video calls with multiple people. An online market system has been proposed that allows people to check each other's faces and interact with each other in real time, just like a marche (market) where buying and selling activities are carried out. In this online market system, consumers can purchase desired goods or services through an online payment site.

Utility Model Registration No. 3232531

It is expected that online or remote conference systems will be used, for example, for business negotiations. In such a system, it is relatively easy to store video footage of business negotiations. It is desirable for companies, etc., to investigate or analyze the video of business talks that they have saved in order to improve the quality or sales of the business talks, but business talks may last several hours, so it is necessary to investigate or analyze the video. It is not easy.

The present invention has been made in view of such circumstances, and aims to provide an information processing method, computer program, and information processing that can be expected to support investigation or analysis of video recordings of business talks. It is to provide a device.

In an information processing method according to an embodiment, an information processing device acquires a video of a recorded business meeting, converts voice information related to the speech of a participant who participated in the business meeting into text information based on the acquired video of the business meeting. Convert and display the converted text information.

In the case of one embodiment, it can be expected to support investigation, analysis, or the like of recorded videos of business negotiations.

1 is a schematic diagram for explaining an overview of an information processing system according to an embodiment; FIG. 1 is a block diagram showing the configuration of a negotiation recording server device according to an embodiment; FIG. FIG. 10 is a schematic diagram showing a configuration example of a business negotiation video; 2 is a block diagram showing the configuration of a terminal device according to this embodiment; FIG. 5 is a flow chart showing the procedure of online negotiation processing performed by the negotiation recording server device according to the present embodiment; FIG. 10 is a schematic diagram showing a display example of a negotiation video; FIG. 10 is a schematic diagram showing a display example of a negotiation video; FIG. 10 is a schematic diagram for explaining sharing of a video of a negotiation; 5 is a flow chart showing a procedure of a negotiation video sharing process performed by the negotiation recording server device according to the present embodiment; FIG. 4 is a schematic diagram for explaining a comment function; 7 is a flow chart showing a procedure of comment processing performed by the negotiation recording server device according to the present embodiment; FIG. 10 is a schematic diagram showing an example of a search screen for a business negotiation video; 5 is a flow chart showing a procedure of a negotiation video search process performed by the negotiation recording server device according to the present embodiment; FIG. 4 is a schematic diagram for explaining a speech content search function; FIG. 10 is a schematic diagram showing an example of a display screen for analysis results; FIG. 11 is a schematic diagram showing another example of a display screen for analysis results; 4 is a flow chart showing the procedure of analysis processing performed by the negotiation recording server device according to the present embodiment; FIG. 10 is a schematic diagram showing a display example of topic classification results;

A specific example of an information processing system according to an embodiment of the present invention will be described below with reference to the drawings. The present invention is not limited to these examples, but is indicated by the scope of the claims, and is intended to include all modifications within the scope and meaning equivalent to the scope of the claims.

<System configuration>
FIG. 1 is a schematic diagram for explaining an outline of an information processing system according to this embodiment. It should be noted that in the present embodiment, conducting business negotiations using a system such as an online conference or a remote conference is called online business negotiations. In online business negotiations, various online conversations are held between a user of a seller who sells a product or service and a user of a purchaser who purchases the product or service. Online business negotiations do not necessarily involve the purchase and sale of goods or services. For example, it may be related to the response of the person in charge to the inquiry from the customer, etc., and it may be related to various conversations between the seller and the purchaser other than these It's fine. Furthermore, online business negotiations are not limited to those held between a seller and a purchaser, and may include, for example, a sales conference or a meeting held between a plurality of employees working for a company that is a seller.

The information processing system according to the present embodiment includes an online business negotiation server device 1 that provides functions for online business negotiations through online conferences or remote conferences, a business negotiation recording server device 2 that records and accumulates images related to online business negotiations, an online A terminal device 3 is used by each of a plurality of users participating in the business negotiation. In this embodiment, the online negotiation server device 1 and the negotiation recording server device 2 are separate servers. good too.

The online business negotiation server device 1 relays transmission and reception of various data such as images, voices, characters, etc. among a plurality of terminal devices 3 via a network, thereby allowing users in different locations to exchange information such as conversations. Realize The online business negotiation server device 1 receives data transmitted by one terminal device 3, for example, and transmits the received data to the other terminal device 3. FIG.

The business negotiation recording server device 2 acquires various data transmitted and received between the plurality of terminal devices 3 by the online business negotiation server device 1, and in this embodiment, obtains business negotiation video recording the business negotiations and records them in a database or the like. conduct. In the present embodiment, the business negotiation video is a video captured by the camera or the like of each terminal device 3 during the online business negotiation and transmitted and received between the plurality of terminal devices 3 by the online business negotiation server device 1. This data includes so-called images (moving images) captured by the camera of the device 3 or the like and voice recorded by the microphone of the terminal device 3 or the like. The business negotiation video includes not only video captured by a camera or the like, but also video recorded when a document, image, or the like for a presentation is shared and displayed by a plurality of terminal devices 3. can be In online business negotiations, for example, for the purpose of reducing the amount of communication data or protecting the privacy of the user, business negotiations may be conducted only by transmitting and receiving voices without transmitting and receiving images captured by the terminal device 3 . In the present embodiment, such data that does not contain an image but contains only voice is also called a negotiation video, and is handled in the same way as a negotiation video containing an image.

The terminal device 3 is a device used by each user who participates in online business negotiations, and may be a general-purpose information processing device such as a smart phone, a tablet terminal device, or a personal computer. The terminal device 3 includes a camera for capturing images of the user and a microphone for acquiring the voice of the user. However, the camera and microphone may be built in the terminal device 3 or may be external devices connected to the terminal device 3 by wire or wirelessly. Also, the terminal device 3 may have at least a microphone, and may not have a camera. In this embodiment, it is assumed that one user uses one terminal device 3, but the present invention is not limited to this. Alternatively, one user may use a plurality of terminal devices 3 to participate in online business negotiations.

Further, in the information processing system according to the present embodiment, the business meeting recording server device 2 performs a process of converting the utterances of the participants who participated in the business meeting into text from the video of the business meeting recorded in the online business meeting. The business negotiation recording server device 2 associates the text information of the content of the speech of the participant with identification information such as the name or ID of the user who made the speech, and information such as the timing of the speech (the time from the start of the video of the business negotiation). , recorded in the database together with the video of the business talk. The business negotiation recording server device 2 can use this text information to provide the user with a service to retrieve the recorded video of the business negotiations, for example, by receiving an input of a keyword of a character string.

Further, in the information processing system according to the present embodiment, the negotiation recording server device 2 performs processing for realizing a search function for a plurality of negotiation videos recorded in the database. For example, the negotiation recording server device 2 extracts the text information including the search keyword input by the user through the terminal device 3 based on the text information obtained by converting the voice of the negotiation video into text as described above, and extracts the text information. are displayed on the terminal device 3 as a search result. The negotiation recording server device 2 also searches for negotiation videos based on identification information such as names or IDs of users who have participated in the negotiations, and searches for negotiation videos based on the dates of the negotiations.

Further, in the information processing system according to the present embodiment, the business meeting recording server device 2 performs processing for realizing sharing of business meeting images by a plurality of users who have participated in the online business meeting. The negotiation recording server device 2 transmits information such as a URL (Uniform Resource Locator) for accessing the negotiation video recorded in the database to (the terminal device 3 of) the user who participated in the negotiation. A user who has received this information on the terminal device 3 can acquire or reproduce the video of the business negotiation by accessing the specified URL using an application program such as a Web browser.

Further, in the information processing system according to the present embodiment, the negotiation recording server device 2 accepts input of a user's comment on the negotiation video, and records the received comment in the database in association with the negotiation video. The negotiation recording server device 2 also performs processing for sharing the recorded comments among a plurality of users who have participated in the negotiation. For example, while the user is reproducing (displaying) a video of a business negotiation on the terminal device 3 , the business negotiation recording server device 2 receives an input of a comment regarding this video of the business negotiation via the terminal device 3 . The business negotiation recording server device 2 records the input comment in the database in association with the reproduction time of the business negotiation video being reproduced. Thereafter, when this business negotiation video is reproduced, the business negotiation recording server device 2 causes the terminal device 3 to display the comment together with the business negotiation video.

In the information processing system according to the present embodiment, the negotiation recording server device 2 aggregates information such as the timing, duration, and number of times each participant speaks in the negotiation, and causes the terminal device 3 to display this information. The business negotiation recording server device 2 may display such information, for example, together with the video of the business negotiation. may be displayed.

Further, in the information processing system according to the present embodiment, the acquisition and recording of the business negotiation video by the business negotiation recording server device 2 is performed by a personified computer program for performing these processes, that is, a so-called bot is used for online negotiations. by participating as a participant in Further, when the bot participates in the online business negotiation, the business negotiation recording server device 2 gives consent to the participation of the bot in the business negotiation (recording of video of the business negotiation) from other users participating in the online business negotiation. to confirm. The business negotiation recording server device 2 records the presence or absence of consent by each participant, and records the video of the business negotiation with the participation of the bot when all the users agree.

In the present embodiment, it is assumed that a plurality of users use the terminal device 3 to conduct business negotiations online, but the present invention is not limited to this. Business negotiations may also be held. In this case, for example, the terminal device 3 or some kind of photographing device may photograph the negotiations, and the photographed images may be obtained by the negotiation recording server device 2 and recorded in a database.

<Device configuration>
FIG. 2 is a block diagram showing the configuration of the negotiation recording server device 2 according to this embodiment. The business negotiation recording server device 2 according to the present embodiment includes a processing unit 21, a storage unit (storage) 22, a communication unit (transceiver) 23, and the like. In the present embodiment, it is assumed that one server device performs the processing related to the recording of business negotiations, but the processing may be performed by a plurality of distributed server devices.

The processing unit 21 includes an arithmetic processing unit such as a CPU (Central Processing Unit), MPU (Micro-Processing Unit), GPU (Graphics Processing Unit) or quantum processor, ROM (Read Only Memory) and RAM (Random Access Memory). It is configured using By reading and executing the server program 22a stored in the storage unit 22, the processing unit 21 performs a process of recording the video of the online business negotiation, a process of converting the audio of the recorded video of the business negotiation into text, and a video of the recorded business negotiation. are shared among a plurality of participants.

The storage unit 22 is configured using a large-capacity storage device such as a hard disk. The storage unit 22 stores various programs executed by the processing unit 21 and various data required for processing by the processing unit 21 . In the present embodiment, the storage unit 22 stores a server program 22a executed by the processing unit 21. FIG. The storage unit 22 is also provided with a business discussion video DB (database) 22b that records business discussion videos in association with various information.

In the present embodiment, the server program (computer program, program product) 22a is provided in a form recorded in a recording medium 99 such as a memory card or an optical disk, and the negotiation recording server device 2 reads out the server program 22a from the recording medium 99. is stored in the storage unit 22. However, the server program 22a may be written in the storage unit 22 at the manufacturing stage of the negotiation recording server device 2, for example. Further, for example, the server program 22a may be delivered by another remote server device or the like, and the negotiation recording server device 2 may acquire the information through communication. For example, the server program 22a may be recorded in the recording medium 99 and read by the writing device and written in the storage unit 22 of the negotiation recording server device 2 . The server program 22 a may be provided in the form of distribution via a network, or may be provided in the form of being recorded on the recording medium 99 .

FIG. 3 is a schematic diagram showing a configuration example of the negotiation video DB 22b. The business meeting video DB 22b of the business meeting recording server device 2 according to the present embodiment is a database for recording business meeting videos of recorded online business meetings. , “comment information” and “analysis information” are recorded in association with each other. "Date and time" is information related to the date and time when the online business negotiation was held, and may include information such as the start time, end time, or holding time of the online business negotiation, for example.

The "participant" in the negotiation video DB 22b is information about the user who participated in the online negotiation, and may include information such as "user name", "information destination", and "agreement information", for example. The “user name” is information for uniquely identifying each user, and is character string information such as the user's real name or ID, for example. "Information destination" is information indicating a destination to which various information is to be sent to each user, and information such as an e-mail address or an ID of the terminal device 3 is set. “Consent information” is, for example, information indicating whether or not each user has consented to participating in a bot that records a video of the negotiation before the start of the online negotiation.

The "business talk video" is a recorded video of an online business talk, and is, for example, a moving image file itself, or information or a file name indicating the storage location of this file. The business negotiation video may be recorded as a separate moving image file for each user who participates in the business negotiation, or may be recorded as one moving image file in which the videos of a plurality of users are arranged side by side.

"Text information" is information obtained by converting the contents of the speech of the participants into text based on the video of the business talk, and includes information such as "timing of speech", "speaker", "text of speech", and "topic information". obtain. "Speech timing" is information indicating when the participant spoke. information can be set. In the "speech timing", at least the information of the start time of the speech is recorded, and information such as the end time of the speech or the duration of the speech may be further recorded. "Speaker" is information indicating who the user is who made the speech, and for example, a user name can be set. In the present embodiment, it is assumed that one user participates in an online business negotiation using one terminal device 3, and the voice captured (recorded) by any terminal device 3 It is determined which user uttered the voice based on the presence of the voice. When a plurality of users participate in online business negotiations using one terminal device 3, or when, for example, a single camera captures an offline business negotiation in which a plurality of users participate, the business negotiation recording server device 2 For example, it is possible to distinguish who the speaker is based on characteristics such as the tone, pitch, tone, inflection, or rhythm of the utterance. To distinguish between speakers, for example, a learning model in which machine learning has been performed in advance, so-called AI (Artificial Intelligence), can be used. "Speech text" is information obtained by converting the voice of the participant's speech included in the recorded business negotiation video into text. Speech-to-text conversion processing is performed by existing so-called speech recognition processing. "Topic information" is information indicating what topics (things, topics, etc.) are included in the spoken text, and topic classification such as ice breaker or closing, for example, can be set. In the present embodiment, the business negotiation recording server device 2 classifies the topic of the utterance text using a learning model that has undergone machine learning in advance.

The “comment information” is information of comments such as characters or images input to the video of the business talk using the terminal device 3 by a user who participated in the business talk or a user who viewed the video of the business talk. The 'comment information' may include information such as 'reproduction timing', 'input person', and 'comment'. "Reproduction timing" is information indicating the input timing of a comment with respect to the reproduction time of the business negotiation video. obtain. "Inputter" is information indicating who the user who input the comment is, and for example, a user name can be set. "Comment" is the substance of the comment input by the user. In this embodiment, comments are text, but comments such as images or voices may be handled.

"Analysis information" is information obtained by analyzing the results of each user who participated in the business negotiation. Information may be included. "User name" is information for uniquely identifying each user. Since this "user name" is the same as the "user name" included in the above-mentioned "participant", the negotiation recording server device 2 may collectively record the "participant" and the "analysis information". . "Number of utterances" is the number of times each user uttered in this negotiation. "Speech time" is the total value of the time spent by each user speaking in the negotiation. “Longest utterance duration” is the longest time in the negotiation, among the times during which one user continues utterance that is interrupted by other users.

Note that the structure of the negotiation video DB and the items to be recorded, etc. shown in FIG. 3 are merely an example, and are not limited to this.

The communication unit 23 of the negotiation recording server device 2 communicates with various devices via a network N including a mobile phone communication network, a wireless LAN (Local Area Network), the Internet, and the like. In this embodiment, the communication unit 23 communicates with the online business negotiation server device 1, one or a plurality of terminal devices 3, and the like via the network N. FIG. The communication unit 23 transmits data provided from the processing unit 21 to other devices, and provides the processing unit 21 with data received from other devices.

Note that the storage unit 22 may be an external storage device connected to the negotiation recording server device 2 . The negotiation recording server device 2 may be a multicomputer including a plurality of computers, or may be a virtual machine virtually constructed by software. The business negotiation recording server device 2 is not limited to the above configuration, and includes, for example, a reading unit for reading information stored in a portable storage medium, an input unit for accepting operation inputs, or a display unit for displaying images. It's okay.

In the negotiation recording server device 2 according to the present embodiment, the server program 22a stored in the storage unit 22 is read out and executed by the processing unit 21, whereby the negotiation video acquisition unit 21a, the text conversion processing unit 21b, the search The processing unit 21c, the sharing processing unit 21d, the comment processing unit 21e, the analysis processing unit 21f, the consent processing unit 21g, and the like are implemented in the processing unit 21 as software functional units. In this figure, as the functional units of the processing unit 21, the functional units related to the process of recording the negotiation video are illustrated, and the functional units related to other processes are omitted.

The business negotiation image acquisition unit 21 a performs processing for acquiring business negotiation images captured by the plurality of terminal devices 3 participating in the online business negotiation and transmitted and received between the plurality of terminal devices 3 by the online business negotiation server device 1 . In the present embodiment, the business negotiation video acquisition unit 21a acquires the business negotiation video transmitted and received between the plurality of terminal devices 3 by the online business negotiation server device 1 by allowing a bot, which is an anthropomorphic computer program, to participate in the online business negotiation. The business negotiation video acquisition unit 21a records the business negotiation video of the online business negotiation acquired from the online business negotiation server device 1 in the business negotiation video DB 22b of the storage unit 22 together with information such as "date and time" and "participants".

The text conversion processing unit 21b performs a process of converting voices uttered by participants in the business discussion video acquired by the business discussion video acquisition unit 21a into text. The text conversion processing unit 21b converts speech into text using, for example, a learning model that has undergone machine learning in advance. Note that conversion processing from voice to text is performed by so-called voice recognition processing, and since voice recognition processing is an existing technology, detailed description thereof will be omitted. Any method may be employed for conversion processing from voice to text by the text conversion processing unit 21b. The text conversion processing unit 21b converts the voice contained in the video of the business negotiation into text by distinguishing it for each participating user, and stores the obtained "utterance text" in correspondence with the "utterance timing" and the "speaker" in the business negotiation video DB 22b. Record.

Further, the text conversion processing unit 21b performs a process of classifying topics included in the utterance content based on the converted text information. The text conversion processing unit 21b classifies topics of text information using, for example, a learning model that has undergone machine learning in advance. As learning models for outputting topic classification results in response to input of text information, learning models such as RNN (Recurrent Neural Network), LSTM (Long Short Term Memory), BERT (Bidirectional Encoder Representations from Transformers), etc. are adopted. obtain. Since the text information classification process using the learning model is an existing technique, detailed description thereof will be omitted. The text conversion processing unit 21b records the "topic information" in association with the "spoken text" in the "text information" of the business negotiation video DB 22b based on the classification result of the topic by the learning model. Note that one utterance text can include multiple topics. In the present embodiment, the topic classification of the text information is performed by the negotiation recording server device 2. However, the topic classification is not limited to this. It may be configured to transmit to the device 2 .

The search processing unit 21c performs processing for providing a user with a search service for the business talk video recorded in the business talk video DB 22b. The search processing unit 21c receives an input of a search keyword (character string) from the user via the terminal device 3, for example, and extracts a business discussion video including the received search keyword in the "speech text" from the business discussion video DB 22b. The search processing unit 21c transmits information related to one or more extracted business talk videos, such as information such as “date”, “participant”, and thumbnail images of the business talk videos, to the terminal device 3, and searches for the business talk video corresponding to the search keyword. is displayed on the terminal device 3 as a list.

The search processing unit 21c also receives, for example, the name or ID of a user who has participated in an online business negotiation, or a topic related to text information from the user via the terminal device 3 as a search condition. For example, the search processing unit 21c extracts from the business discussion video DB 22b the business discussion video in which the user with the accepted user name participates, and transmits information on one or more of the extracted business discussion videos to the terminal device 3 for a list display. Further, for example, the search processing unit 21c extracts a business discussion video containing a text corresponding to the received topic, and transmits information on one or a plurality of extracted business discussion videos to the terminal device 3 for a list display.

The sharing processing unit 21d performs processing for sharing the business negotiation video recorded in the business negotiation video DB 22b among a plurality of users. For example, after the end of the online business negotiation, the sharing processing unit 21d sends information, such as an e-mail containing a hyperlink, for accessing the business negotiation video (reproducing or displaying the business negotiation video) to the user who participated in the online business negotiation. to share the business discussion video with the users participating in the online business discussion. Further, for example, when a list of business talk videos is managed for each user, the sharing processing unit 21d adds the business talk videos of the online business talks in which the user has participated to this list so that the users participating in the online business talks can see the business talks. share the video. It should be noted that the sharing of the business negotiation video by a plurality of users may be performed in any manner.

The comment processing unit 21e accepts input of comments from users who have viewed the video of the business negotiations after the online business negotiations, and performs processing for sharing the received comments among a plurality of users. In the present embodiment, when a business discussion video is played back, the user can specify a specific playback timing within the playback time of the business discussion video and input a comment such as text or an image. The comment processing unit 21e acquires the comment input by the terminal device 3, and records the "comment" together with the "reproduction timing" and "inputter" information in the negotiation video DB 22b in association with the negotiation video. In addition, the comment processing unit 21e transmits the input comments to the plurality of users who share the business negotiation video, or notifies that the comments have been input, thereby allowing the plurality of users to share their comments. share comments between

The analysis processing unit 21f performs processing for analyzing the features of each user who participated in the online business negotiation based on the business negotiation video recorded in the business negotiation video DB 22b. In the present embodiment, the analysis processing unit 21f calculates, for example, the number of times each user has spoken (uttered) in an online conference, the total time spent speaking, and the duration of one speech, based on the video of the negotiations or the text information converted therefrom. Calculate the maximum value of time, etc. The analysis processing unit 21f records information such as the calculated "utterance count", "utterance time", and "maximum utterance duration" in the business negotiation video DB 22b in association with the "user name".

Further, the analysis processing unit 21f aggregates the "number of times of speech" and "time of speech" for a plurality of online business negotiations held in a predetermined period, for example, based on the "analysis information" recorded in the business negotiation video DB 22b, and outputs the aggregation result. It is transmitted to the terminal device 3 of the user and displayed. In addition, for example, the analysis processing unit 21f aggregates the information about a plurality of users belonging to a group such as a department or a team of a company, and displays on the terminal device 3 the information comparing the characteristics of the plurality of users belonging to the group. Let The analysis processing unit 21f can calculate numerical values indicating various characteristics of each user regarding online business negotiations, and cause the terminal device 3 to display the numerical values.

The consent processing unit 21g performs a process of obtaining consent from each user who participates in the online negotiation before or after the online negotiation starts (but before recording the video of the negotiation). The consent processing unit 21g causes the terminal device 3 that has accessed the online negotiation server device 1 to participate in the online negotiation, for example, to display a message inquiring whether or not to agree to record the online negotiation. The consent processing unit 21g receives an answer about whether or not the user has consented from the terminal device 3, and stores whether or not the consent has been given in the "consent information" of the negotiation video DB 22b. The consent processing unit 21g causes the business discussion image acquisition unit 21a to start processing such as acquisition of the video of the online business negotiation when consent is obtained from all the users participating in the online business negotiation.

FIG. 4 is a block diagram showing the configuration of the terminal device 3 according to this embodiment. The terminal device 3 according to the present embodiment includes a processing unit 31, a storage unit (storage) 32, a communication unit (transceiver) 33, a display unit (display) 34, an operation unit 35, a camera 36, a microphone 37, and the like. It is The terminal device 3 is a device used by a user who participates in online business negotiations, and can be configured using a general-purpose information processing device such as a smart phone, a tablet terminal device, or a personal computer.

The processing unit 31 is configured using an arithmetic processing unit such as a CPU or MPU, a ROM, and the like. The processing unit 31 reads out and executes the program 32a stored in the storage unit 32, thereby performing processing for realizing online business negotiations, processing for searching business negotiation videos recorded from the online business negotiations, and displaying the business negotiation videos. Various processing such as processing is performed.

The storage unit 32 is configured using, for example, a nonvolatile memory device such as a flash memory or a storage device such as a hard disk. The storage unit 32 stores various programs executed by the processing unit 31 and various data required for processing by the processing unit 31 . In the present embodiment, the storage unit 32 stores a program 32a executed by the processing unit 31. FIG. In this embodiment, the program 32a is distributed by a remote server device or the like, and the terminal device 3 acquires it through communication and stores it in the storage unit 32. FIG. However, the program 32a may be written in the storage unit 32 during the manufacturing stage of the terminal device 3, for example. For example, the program 32a may be stored in the storage unit 32 after the terminal device 3 reads the program 32a recorded in the recording medium 98 such as a memory card or an optical disc. For example, the program 32 a may be recorded in the recording medium 98 and read by a writing device and written in the storage unit 32 of the terminal device 3 . The program 32 a may be provided in the form of distribution via a network, or may be provided in the form of being recorded on the recording medium 98 .

The communication unit 33 communicates with various devices via a network N including a mobile phone communication network, a wireless LAN, the Internet, and the like. In this embodiment, the communication unit 33 communicates with the online negotiation server device 1, the negotiation recording server device 2, and the like via the network N. FIG. The communication unit 33 transmits data received from the processing unit 31 to other devices, and provides the processing unit 31 with data received from other devices.

The display unit 34 is configured using a liquid crystal display or the like, and displays various images, characters, etc. based on the processing of the processing unit 31 . The operation unit 35 receives a user's operation and notifies the processing unit 31 of the received operation. For example, the operation unit 35 receives a user's operation using an input device such as mechanical buttons or a touch panel provided on the surface of the display unit 34 . Further, for example, the operation unit 35 may be an input device such as a mouse and a keyboard, and these input devices may be detachable from the terminal device 3 .

The camera 36 is configured using an imaging device such as a CCD (Charge Coupled Device) image sensor or a CMOS (Complementary Metal Oxide Semiconductor) image sensor. The camera 36 is arranged, for example, at an appropriate location on the housing of the terminal device 3 . The camera 36 supplies data of an image (moving image) captured by the imaging device to the processing unit 21 . The microphone 37 is arranged, for example, at an appropriate place on the housing of the terminal device 3 , acquires sounds around the terminal device 3 (for example, user's uttered voice), and provides voice data to the processing unit 21 . Note that the camera 36 and the microphone 37 may be built in the terminal device 3 or may be detachable from the terminal device 3 .

Further, in the terminal device 3 according to the present embodiment, the processing unit 31 reads out and executes the program 32a stored in the storage unit 32, so that the online business negotiation processing unit 31a, the business negotiation video processing unit 31b, and the like function as software. is realized in the processing unit 31 as a unit. The program 32a may be a program dedicated to the information processing system according to the present embodiment, or may be a general-purpose program such as an Internet browser or web browser.

The online negotiation processing unit 31a communicates with the online negotiation server device 1 through the communication unit 33, and performs various processes for realizing online negotiations. The online negotiation processing unit 31 a transmits, to the online negotiation server device 1 , moving image data including images captured by the camera 36 and voices acquired by the microphone 37 , for example. The online business negotiation processing unit 31a also receives the moving image data relating to one or more other users participating in the online business negotiation from the online business negotiation server device 1, and displays the moving image data side by side on the display unit 34 in an appropriate arrangement. . As a result, each user who participates in online business negotiations using the terminal device 3 can transmit an image of himself/herself and a voice uttered by himself/herself to other users, as well as an image of other user(s) and the other user's voice. The voice uttered by the user can be viewed on the terminal device 3, and a plurality of users in remote locations can converse while looking at each other, and conduct online business negotiations.

Also, the online business negotiation processing unit 31a, in addition to the moving image data including the images and voices of the users participating in the online business negotiations, for example, provides presentation materials (which may include information such as still images, moving images, voices, texts, etc.). Various data such as data or text data related to chat calls may be transmitted/received to/from the online negotiation server device 1 . This allows these data to be shared among a plurality of users participating in online business negotiations.

Further, in the information processing system according to the present embodiment, the user who is the organizer of the online business negotiation uses the terminal device 3 to send information such as the date and time of the online business negotiation and the participating users to the online business negotiation server device 1. Register in advance. The online negotiation processing unit 31 a of the terminal device 3 accepts the registration operation of the information by the user of the organizer, and transmits the accepted information to the online negotiation server device 1 . The online business negotiation server device 1 transmits, by e-mail or the like, notice of the online business negotiation including information such as the date and time of the online business negotiation and the URL or link for accessing the online business negotiation to users registered as participants.

The business negotiation video processing unit 31b communicates with the business negotiation recording server device 2 through the communication unit 33, and performs processing such as searching and displaying the business negotiation video recorded in the business negotiation video DB 22b by the business negotiation recording server device 2. The business negotiation video processing unit 31b displays, for example, a list of information related to online business negotiations in which the user has participated, accepts the user's selection of one of the online business negotiations, and produces a business negotiation video recording of the accepted online business negotiations. The video data is requested from the negotiation recording server device 2 , and the moving image data transmitted from the negotiation recording server device 2 is reproduced and displayed on the display unit 34 .

Further, the negotiation video processing unit 31b receives, for example, an input of a search keyword from the user, transmits the accepted keyword to the negotiation recording server device 2, and receives search results from the negotiation recording server device 2 to find a keyword that matches the keyword. It displays, for example, a list of information related to business negotiation videos. Further, the negotiation video processing unit 31b accepts an input of a user's comment on the displayed negotiation video, transmits the received comment to the negotiation recording server device 2, and records it in the negotiation video DB 22b.

The business negotiation video processing unit 31b also acquires various kinds of information analyzed by the business negotiation recording server device 2 based on the business negotiation video, and displays the acquired analysis result information on the display unit . The business negotiation recording server device 2 analyzes, for example, the number of times each user speaks in an online conference, the total time spent speaking, the maximum duration of one speech, and the like, and stores these analysis results in the business negotiation video DB 22b. It is recorded and transmitted to the terminal device 3 of the user who participated in the online business negotiation. The negotiation video processing unit 31b receives the analysis result information transmitted from the negotiation recording server device 2, and displays the analysis result.

<Online Negotiation Processing>
In the information processing system according to the present embodiment, at least one user who is scheduled to participate in an online business meeting acts as an organizer, and registers information such as the date and time of the online business meeting and the participants in the online business meeting server device 1 in advance. do. The online business meeting server device 1 transmits a notice of the online business meeting to the registered participants, and when the time to start the online business meeting arrives (or earlier), the URL or link attached to the notice of the meeting is sent. Receive access from the terminal device 3 using the access information, etc., and hold online business negotiations.

In addition, the user of the online business meeting organizer sets the date and time of the online business meeting, the URL, etc. in the business meeting recording server device 2 using the terminal device 3, and the bot that records the video of the business meeting by the business meeting recording server device 2 is set to the online business meeting. Join as a single user. A bot that participates in an online business negotiation receives video data transmitted from terminal devices 3 of a plurality of other users via an online business negotiation server device 1, and records the received business negotiation video in a business negotiation video DB 22b. be able to.

In the information processing system according to the present embodiment, before the bot of the business meeting recording server device 2 starts recording business meeting videos relating to online business meetings, processing is performed to obtain consent from the users participating in the online business meetings to record the business meeting videos. will be The business negotiation recording server device 2 displays a message asking whether or not the user agrees to record the video of the business negotiation on the terminal device 3 of the user participating in the online business negotiation, and receives the user's answer to this inquiry. The business meeting recording server device 2 starts recording the business meeting video when consent is obtained from all the users participating in the online business meeting. If consent is not obtained from all users (at least one user refuses to record the video of the business meeting), the business meeting recording server device 2 does not record the video of the business meeting. Exit the bot. In addition, regardless of whether or not consent has been obtained, the negotiation recording server device 2 records information as to whether or not each user has consented in the negotiation video DB 22b as "agreement information".

Acquisition of consent by the negotiation recording server device 2 is achieved by, for example, displaying a dialog box or a pop-up window on the display unit 34 of the terminal device 3 and displaying a message asking whether or not to agree to the dialog box or the like. This can be done by providing two buttons labeled "yes" and "no" for accepting responses from the user, and accepting operations on these buttons from the user. Further, for example, the business meeting recording server device 2 uses the chat function of online business meetings to display a message on the terminal device 3 of each user asking whether or not to agree to record the video of the business meeting. You can get an answer from In this case, the negotiation recording server device 2 records the sentences of the answers obtained from each user in the negotiation video DB 22b as "agreement information". Further, for example, the business negotiation recording server device 2 may cause the terminal device 3 to output an inquiry message by voice, and obtain an answer by each user's utterance. In this case, the negotiation recording server device 2 records the data of the voice of the answer obtained from the user or the text data of this voice in the negotiation video DB 22b as "agreement information". It should be noted that these methods of obtaining consent by the negotiation recording server device 2 are merely examples, and the method is not limited to this, and any method of obtaining consent may be used.

The business meeting recording server device 2 that has started recording the business meeting video continues recording until the online business meeting ends. The online business negotiation server device 1 transmits and receives moving image data including an image of the user and a voice uttered by the user among a plurality of terminal devices 3 used by a plurality of users participating in the online business negotiation. of users to conduct online business negotiations. After the negotiation is over and all the users have left (the terminal device 3 is disconnected from the online negotiation server device 1), the negotiation recording server device 2 records the user's information included in the negotiation video recorded in the negotiation video DB 22b. Perform processing to convert the spoken voice into text. In the present embodiment, the negotiation recording server device 2 converts the voice of the negotiation video into text after the online negotiation is over. It is also possible to convert speech to text in parallel.

The business negotiation recording server device 2 converts the voice of the user's speech included in the video of the business negotiation into text using the existing technology of speech recognition processing. At this time, the business negotiation recording server device 2 distinguishes the uttered voices of each user who participated in the online business negotiations and converts them into text. The business negotiation recording server device 2 records the information of the text converted from the voice of the utterance in the business negotiation video DB 22b in association with the user name of the user who made this utterance and the information on the timing of the utterance in the business negotiation video.

In addition, the negotiation record server device 2 classifies topics included in the utterances of the users participating in the online negotiation based on the text information obtained by converting the voice of the negotiation video using a machine-learned learning model in advance. conduct. For the learning model, for example, a classification model that classifies topics included in the text information for the input of text information can be used. Note that the learning model may classify one piece of input text information into a plurality of topics. The business negotiation recording server device 2 inputs text information obtained by converting the voice of the video of the business negotiation into the learning model, and acquires the topic classification result output by the learning model. The business negotiation recording server device 2 records the obtained topic classification result in the business negotiation video DB 22b as topic information in association with the text information.

FIG. 5 is a flow chart showing the procedure of online negotiation processing performed by the negotiation recording server device 2 according to the present embodiment. The processing unit 21 of the negotiation recording server device 2 according to the present embodiment allows the bot that records the video of the negotiation to participate in the online negotiation based on the command given from the terminal device 3 based on the operation of the organizer of the online negotiation, for example. (step S1).

Next, the consent processing unit 21g of the processing unit 21 performs processing for obtaining consent for recording the negotiation video from the users participating in the online negotiation (step S2). This earthenware consent processing unit 21g displays a message inquiring about the presence or absence of consent on the terminal device 3 of each user, acquires an answer to this inquiry from the user via the terminal device 3, and uses the obtained answer of each user for business negotiations. It is recorded as "consent information" in the video DB 22b. The consent processing unit 21g determines whether consent has been obtained from all the users participating in the online business negotiation (step S3). If consent is not obtained from all users (S4: NO), that is, if at least one user refuses to record the negotiation video, the consent processing unit 21g causes the bot to leave the online negotiation (step S4). , terminate the process.

If consent has been obtained from all users (S3: YES), the business negotiation video acquisition unit 21a of the processing unit 21 acquires the moving image and A video of business talks including audio data is acquired via the bot participating in the online business talks, and the acquired video of business talks is recorded in the video DB 22b of business talks (step S5). The business negotiation image acquisition unit 21a determines whether or not the online business negotiation has ended (step S6). If the online business negotiation has not ended (S6: NO), the process returns to step S5 to record the business negotiation video. continue.

When the online business negotiation has ended (S6: YES), the text conversion processing unit 21b of the processing unit 21 performs a process of converting the user's uttered voice included in the business discussion video recorded in the business discussion video DB 22b into text (step S7). . At this time, the text processing unit 21b records the text obtained by converting the voice of the utterance in the negotiation video DB 22b in association with information such as the timing of the utterance and the speaker in the online negotiation. Further, the text conversion processing unit 21b performs a process of classifying topics included in the contents of the user's utterance based on the text obtained by converting the voice of the utterance (step S8). At this time, the text conversion processing unit 21b uses a learning model that classifies topics that have undergone machine learning in advance, inputs the converted text to the learning model, and acquires the topic classification result output by the learning model. to classify the topics of user utterances. After the topic classification processing by the text conversion processing unit 21b ends, the processing unit 21 ends the online negotiation process.

6 and 7 are schematic diagrams showing one display example of the business negotiation video. For example, a user who participates in an online business negotiation can access the business negotiation recording server device 2 using the terminal device 3 and view the business negotiation video recorded in the business negotiation video DB 22b. FIG. 6 depicts a reproduction screen on which the terminal device 3 reproduces and displays the negotiation video. The terminal device 3 displays, for example, a title character string such as "online business meeting" and information on the date and time of the online business meeting such as "October 4, 2021, 19:00" at the top of the reproduction screen of the business negotiation video. , and below these, a moving image that reproduces the video of the business negotiation is displayed. In this example, five users and the bot of the business negotiation recording server device 2 participate in online business negotiations, and moving images are displayed in which images of the users are arranged in a 3×2 matrix.

The terminal device 3 has a plurality of buttons for receiving operations such as playback, rewinding, and fast-forwarding arranged in the center of the screen below the display area of the moving image on the playback screen. Two alternative buttons are provided to select either "text". The example shown in FIG. 6 is the state in which the button labeled "Animation" is selected, and the state in which the "Text" button is selected is shown in FIG. 7 (details of FIG. 7 will be described later). ).

The terminal device 3 provides a seek bar indicating the playback time point of the negotiation video below the location where these buttons are provided on the playback screen. The user can appropriately change the reproduction time point (reproduction time, reproduction position) of the negotiation video by performing an operation to slide the slider of the seek bar to the left or right using the operation unit 35 of the terminal device 3 . Further, the terminal device 3 according to the present embodiment displays an utterance timing bar indicating the utterance timing of the user who participated in the online business negotiation below the seek bar on the reproduction screen of the business negotiation video. In the example shown in FIG. 6, five utterance timing bars corresponding to five users who have participated in the online business negotiation are displayed vertically. The seek bar and each utterance timing bar are provided so as to extend to the left and right with substantially the same length, and the playback timing of the negotiation video indicated by the seek bar is associated with the utterance timing indicated by the utterance timing bar.

The terminal device 3 displays the user name, etc. of the user corresponding to this speech timing bar on the upper left of each speech timing bar, and on the upper right, the time spent by the user speaking out of the total time of the online negotiation is displayed from 0% to 0%. Displayed at a rate of 100%. Each utterance timing bar is a light-colored bar extending left and right, and a dark-colored area indicating the timing at which the user spoke and the time during which the user continued to speak. It can be seen that the more dark-colored regions attached to the speech timing bar of a user, the greater the amount and time spent speaking in online negotiations. Each utterance timing bar is associated with a seek bar, and the user viewing the business negotiation video moves the slider of the seek bar to a position corresponding to the dark-colored area attached to the desired user's utterance timing bar. , a scene in which a desired user speaks can be displayed in the business negotiation video.

When the "text" button provided on the playback screen is selected, the terminal device 3 displays the text display screen shown in FIG. On the text display screen, the terminal device 3 displays the text obtained by converting the voice of the negotiation video in chronological order in the region where the negotiation video was displayed on the reproduction screen of FIG. The terminal device 3 also displays a reduced version of the negotiation video next to the text display area. The terminal device 3 vertically scrolls the text of the utterance content displayed on the text display screen in synchronization with the reproduction of the negotiation video. As a result, on the text display screen, the content uttered by the user in the reproduced negotiation video is displayed as text, and the displayed text changes as the negotiation video progresses.

The terminal device 3 displays the text of each user's utterance content on the text display screen, together with the timing when this utterance was made, the user name of the user who made this utterance, and the like. In the illustrated example, the text "Try something for a week or two..." uttered by "User A" at the utterance timing "01:57" is displayed, and the text "User B" is displayed at the utterance timing "02:11". is displayed, and at the utterance timing of ``02:19'', ``User A'' uttered ``Let's try this for a week or two. and..." text is displayed. These pieces of information displayed by the terminal device 3 are recorded in the negotiation video DB 22b of the negotiation recording server device 2 in association with the negotiation video. When the business negotiation recording server device 2 transmits the business negotiation video to the terminal device 3 for display, the business negotiation recording server device 2 reads out the associated text information, speech timing, and speaker information from the business negotiation video DB 22b and transmits them to the terminal device 3. .

<Sharing processing of business negotiation video>
In the information processing system according to the present embodiment, after the online business negotiation ends, the business negotiation video recorded in the business negotiation video DB 22b by the business negotiation recording server device 2 can be shared by a plurality of users. In the present embodiment, the sharing of the business discussion video means that a plurality of users can view the business discussion video, and each user can leave comments, etc. on the business discussion video. There may be. It is not necessary for each user's terminal device 3 to have (that is, stored in) the business negotiation video, and each user can access the business negotiation recording server device 2 to view the business negotiation video. Just do it.

In the information processing system according to the present embodiment, after an online business meeting ends, for example, information for sharing a business meeting video by a user who is the host of the online business meeting is acquired from the business meeting recording server device 2, and this shared information is shared with other users. Sharing of the video of the negotiation is realized by transmitting the video to the users. Acquisition and transmission of information for sharing the business meeting video may be performed not only by the user of the organizer, but also by a user other than the organizer. In addition, sharing of the business discussion video may be limited to users who have participated in the online business discussion, or any user may be able to share the business discussion video regardless of whether or not they have participated in the online business discussion. The setting of the access authority to the business negotiation video recorded by the business negotiation recording server device 2 can be made appropriately.

FIG. 8 is a schematic diagram for explaining sharing of a business negotiation video. For example, after the online business negotiation ends, the user of the online business negotiation can directly access the business negotiation recording server device 2 using the terminal device 3 to view the video of the online business negotiation. At this time, the terminal device 3 displays the playback screen shown in FIG. The user can generate link information for accessing the displayed negotiation video by performing a predetermined operation while the reproduction screen of the negotiation video is being displayed. When a predetermined operation is performed on the playback screen, the terminal device 3 displays a dialog box for generating this link information superimposed on the playback screen, as shown in FIG.

The terminal device 3 displays a title string of "Share video" at the top of the dialog box, and below it, "Share current playback time", "Share video", and "Share by specifying playback time". ” are displayed side by side. The terminal device 3 provides radio buttons for each of the three options, and accepts selection of any one of the three options using the radio buttons. The terminal device 3 also displays a button labeled "Copy Link" at the lower right position of the dialog box. When the user selects one of the options using the operation unit 35 of the terminal device 3 and operates the "copy link" button, the terminal device 3 reproduces on the reproduction screen. Link information for sharing the video of business negotiations among a plurality of users, that is, information such as a URL for accessing the video of business negotiations recorded in the business negotiation recording server device 2 is generated.

The generated link information is copied to a clipboard used for so-called copy and paste of the terminal device 3 . By performing a paste operation, the user can paste the link information copied to the clipboard into an e-mail or the like, and can transmit the business negotiation video to the user who wants to share it. A user who has obtained link information by receiving an e-mail or the like uses his/her own terminal device 3 to access the business negotiation recording server device 2 based on the link information, thereby transmitting a desired business negotiation video to his or her terminal device 3. can be played in When the business negotiation video is accessed based on the link information, the terminal device 3 displays the reproduction screen shown in FIG. 6 to reproduce the business negotiation video.

“Share current playback time” is an option for sharing the business negotiation video at the playback time of the business negotiation video being played back on the playback screen. When this option is selected, information regarding the current reproduction time of the business negotiation video is embedded in the link information. When accessing and reproducing the negotiation video via this link information, the terminal device 3 starts reproducing the negotiation video from the reproduction time embedded in the link information. "Share video" is an option for generating link information that does not include playback time information and sharing this negotiation video. When accessing and reproducing the negotiation video via this link information, the terminal device 3 starts reproduction from the beginning of the negotiation video. “Specify playback time and share” is an option for the user to specify an arbitrary playback time and share the business negotiation video, instead of the playback time of the business negotiation video being played back on the playback screen. When this option is selected, the terminal device 3 displays a screen (not shown) for specifying the playback time, and accepts the user's specification of an arbitrary time during the playback time of the negotiation video. Information about the reproduction time specified by the user is embedded in the link information.

When a click operation or a touch operation is performed on the "copy link" button, the terminal device 3 transmits information such as the sharing method selected by the user and the specified reproduction time to the negotiation recording server device 2. Request the generation of link information. The business negotiation recording server device 2 receives a link information generation request from the terminal device 3, accesses the requested business negotiation video, generates link information for starting reproduction from a specified time, and sends the request source terminal device 3 Send to The terminal device 3 receives the link information from the negotiation recording server device 2, copies the received link information to a clipboard or the like, and provides it to the user.

FIG. 9 is a flow chart showing the procedure of the negotiation video sharing process performed by the negotiation recording server device 2 according to the present embodiment. The processing unit 21 of the negotiation recording server device 2 according to the present embodiment causes the terminal device 3 to display the reproduction screen shown in FIG. 6 or 7 (step S21), and reproduces and displays the negotiation image desired by the user. do. The shared processing unit 21d of the processing unit 21 performs a business negotiation on the terminal device 3 based on whether or not a predetermined operation such as a menu item selection operation, an icon operation, or a shortcut operation has been performed on the playback screen of the terminal device 3. It is determined whether or not a sharing operation for sharing an image has been performed (step S22). If the sharing operation has not been performed (S22: NO), the processing unit 21 causes the terminal device 3 to continue displaying the playback screen.

If a sharing operation has been performed (S22: YES), the sharing processing unit 21d causes the terminal device 3 to display the dialog shown in FIG. Accept (step S24). Based on the selected sharing method, the sharing processing unit 21d accesses the negotiation video and generates link information for starting playback from the designated playback time (step S25), and returns the process to step S21. The link information may include, for example, information such as a URL indicating the location where the business negotiation video is stored, and information on the reproduction time. In the flow chart of this figure, it is assumed that the negotiation recording server device 2 performs processing such as dialog display and sharing method selection via the terminal device 3, but the present invention is not limited to this, and these processing can be performed via the terminal device. The device 3 may perform the process alone and transmit the processing result to the negotiation recording server device 2 .

Further, in the information processing system according to the present embodiment, the user can add a comment to the business negotiation video reproduced and displayed on the terminal device 3 . The comments of the information processing system according to the present embodiment are recorded in the business discussion video DB 22b in association with the specific playback time of the business discussion video. users.

FIG. 10 is a schematic diagram for explaining the comment function. When reproducing a business negotiation video with a comment on the reproduction screen that reproduces and displays the business negotiation video, the terminal device 3 displays, for example, a balloon-shaped icon on the upper side of the seek bar to notify the user that there is a comment. do. The comment icon is displayed at the playback time associated with the comment. The terminal device 3 reproduces and displays the negotiation video from the reproduction time of the comment in response to a click operation or a touch operation on the comment icon, and displays the comment. At this time, the terminal device 3 acquires information about one or a plurality of comments stored in association with the negotiation video from the negotiation recording server device 2, and displays the comments attached to the negotiation video.

In the information processing system according to this embodiment, the terminal device 3 displays a comment area on the right side of the playback screen. The comment area is a rectangular area extending in the vertical direction, a title string of "comment" is displayed at the top, and one or more comments are displayed vertically in chronological order below the title string. . For each comment, the terminal device 3 displays information such as the user name of the user who entered the comment, the corresponding playback time, and the text of the comment, surrounded by a rectangular frame. When the user selects one comment displayed in the comment area, the terminal device 3 starts reproducing the business negotiation video from the reproduction time associated with the selected comment. In the illustrated example, the user A has added a comment "Temporary setting...", and the user B has responded with a comment "Hearing from an angle of XX...". In addition, User A added a comment, "This way of communicating about XX...".

The terminal device 3 provides a text box for inputting a comment, a time setting section for specifying a time, and two buttons "Send" and "Cancel" below the comment area. In the time setting section, the playback time of the negotiation video being played back on the playback screen is displayed as an initial value, and the user can increase or decrease the playback time to set an arbitrary time. When the "Send" button is operated, the terminal device 3 transmits the text of the comment entered in the text box and the reproduction time set in the time setting unit to the business negotiation recording server device 2, thereby Information about comments is registered in the video DB 22b. When receiving the text of the comment and the reproduction time information from the terminal device 3, the negotiation recording server device 2 records the information in the negotiation video DB 22b in association with the negotiation video being reproduced. When the business negotiation video data is transmitted to the terminal device 3 for reproduction, the business negotiation recording server device 2 checks whether or not a comment associated with the business negotiation video DB 22b is recorded, and the comment is recorded. In that case, the information is read out and transmitted to the terminal device 3 together with the video of the negotiation.

FIG. 11 is a flow chart showing the procedure of comment processing performed by the negotiation recording server device 2 according to the present embodiment. The comment processing unit 21e of the processing unit 21 of the negotiation recording server device 2 according to the present embodiment displays a comment area on the right side of the reproduction screen when a predetermined operation is performed while the terminal device 3 is displaying the reproduction screen. is displayed (step S31). Further, the comment processing unit 21e acquires from the business negotiation video DB 22b the comment information attached to the business negotiation video being played back on the playback screen, and transmits the information to the terminal device 3, so that one or a plurality of comments are displayed in the comment area. is displayed (step S32).

The comment processing unit 21e determines whether or not the user has input a comment in the comment area via the terminal device 3 (step S33). If no comment has been input (S33: NO), the comment processing unit 21e returns the process to step S31. If a comment has been input (S33: YES), the comment processing unit 21e acquires the comment input by the user from the terminal device 3, and records the comment information in the business discussion video DB 22b in association with the business discussion video (step S34), the process ends.

<Search processing for business negotiation video>
In the information processing system according to the present embodiment, as described above, the business negotiation recording server device 2 performs the process of converting the speech included in the business negotiation video into text, and the text information of the content of the speech of the participants is stored in the business negotiation video DB 22b along with the business negotiation video. to record. In the information processing system according to the present embodiment, it is possible to search for a business discussion video by targeting text information associated with the business discussion video.

FIG. 12 is a schematic diagram showing an example of a search screen for business negotiation videos. The terminal device 3 displays a search screen on the display unit 34 in response to a predetermined operation such as a menu item selection operation, an icon operation, or a shortcut operation, and receives input from the user such as conditions for a business negotiation video to be searched. The search screen has a condition input area on the left side for the user to enter various search conditions. On the search screen shown in the figure, it is possible to enter search conditions such as "meeting host name" and "keyword search", as well as search conditions such as "conversation title", "conference participants" and "date" as "basic information". , input units such as text boxes, combo boxes, or pull-down menus for inputting conditions are arranged vertically in the condition input area.

In addition, the terminal device 3 displays information related to one or more business negotiation videos corresponding to the conditions set by the user in the condition input area in the area on the right side of the search screen. List. In the illustrated example, the display order is "sort order: date", and the user can change the display order. The information related to each business meeting video displayed in a list includes a thumbnail image of the business meeting video, the date and time of the online business meeting, the user names of the participants in the online business meeting, and part of the textual information of the audio of the business meeting video. can be The text information included in each piece of displayed information is, for example, text information including a keyword input by the user as a keyword search condition, and the corresponding keyword is highlighted by enlarged display or color-changed display. In the illustrated example, for "online business negotiation A" whose "participants" are "user A, user B, and user C", the thumbnail image and the text "who will use it..." are displayed first, For "online business negotiation B" whose "participants" are "user D, user E, and user F", a thumbnail image and text such as "because of manual work..." are displayed second, and "participants" are displayed. is displayed thirdly, the thumbnail image and the text such as "And regarding the disclosure range..." for "online business negotiation C" for which "user G, user H".

When the terminal device 3 displaying the search screen receives the input of the search condition to any of the search condition input units provided in the condition input area, the terminal device 3 transmits the received search condition to the business negotiation recording server device 2 to perform the business negotiation. Request a video search. In response to this request, the business negotiation recording server device 2 searches for one or a plurality of business negotiation videos that meet the search conditions from among the business negotiation videos recorded in the business negotiation video DB 22b, and sends information about the corresponding business negotiation video to the requesting terminal. Transmit to device 3 as a search result. At this time, the business negotiation recording server device 2 transmits to the terminal device 3 information such as a thumbnail image, date and time of the meeting, participants, text information, etc., as information related to the video of the business meeting that matches the search conditions. The terminal device 3 receives the search results from the negotiation recording server device 2 and displays a list of the search results on the search screen.

For example, when the meeting host name is set as a search condition, the business meeting recording server device 2 matches the search condition with the user name first registered as a participant among the business meeting videos recorded in the business meeting video DB 22b. Objects can be extracted as search results. For example, when a predetermined character string is set as a search condition for a keyword search, the business negotiation recording server device 2 extracts speech texts containing the keyword character string from the speech texts recorded in the business negotiation video DB 22b, and can be extracted as a search result.

Further, for example, the business negotiation recording server device 2 can search for a business negotiation video using the title attached to the business negotiation video as a search condition. Although not shown in FIG. 3, the title of the business talk video can be set by the user of the organizer before the start of the online business talk, for example, and recorded in the business talk video DB 22b together with the business talk video. The business negotiation recording server device 2 can acquire the character string set as the search condition for the title, extract the business negotiation video including this character string in the title from the business negotiation video DB 22b, and obtain the search result. In addition, for example, when the user name of a participant is set as a search condition, the business meeting recording server device 2, based on the information of the participant recorded in the business meeting video DB 22b, searches for the online business meeting in which the user with the set user name has participated. can be extracted as a search result. Also, for example, when the date search condition is set, the business negotiation recording server device 2 can similarly extract the corresponding business negotiation video based on the date information recorded together with the business negotiation video in the business negotiation video DB 22b.

FIG. 13 is a flow chart showing the procedures of the negotiation video search process performed by the negotiation recording server device 2 according to the present embodiment. The search processing unit 21c of the processing unit 21 of the negotiation recording server device 2 according to the present embodiment receives search conditions such as keywords or participants input by the user via the terminal device 3 (step S41). The search processing unit 21c selects the received search conditions from the business discussion video recorded in the business discussion video DB 22b based on various information such as text information or user names recorded in the business discussion video DB 22b in association with the business discussion video. (step S42).

Next, the search processing unit 21c acquires various information recorded in the business negotiation video DB 22b in association with the extracted one or more business negotiation videos (step S43). The search processing unit 21c transmits to the terminal device 3 the information on the business negotiation video acquired from the business negotiation video DB 22b (step S44), displays the information as a search result on the terminal device 3, and ends the search processing.

Further, in the information processing system according to the present embodiment, in addition to searching for a plurality of business discussion videos recorded in the business discussion video DB 22b as described above, a function of searching for the content of a participant's utterance for one business discussion video is provided. is provided. FIG. 14 is a schematic diagram for explaining the speech content search function. For example, while the business negotiation video is being played back on the playback screen shown in FIG. A search area is displayed on the left side of the playback screen for searching the text information of the utterance content about. A title string of "utterance search" is displayed in the upper part of the search area, and a dialog box for entering a keyword as a search condition is provided below the title string. Below this dialog box, one or a plurality of pieces of text information are arranged in the vertical direction and displayed as a list as a search result. Information displayed as a list of search results may include the user name of the user who made the corresponding utterance, the playback time when the utterance was made, and text information obtained by converting the utterance content into text. The terminal device 3 highlights the keyword of the search condition included in the text information displayed as the search result.

The terminal device 3 displaying the search area on the left side of the playback screen acquires the keyword entered in the dialog box of the search area. The terminal device 3 transmits information indicating which business negotiation video is being reproduced and the input keyword to the business negotiation recording server device 2, and requests retrieval of speech content. In response to this request, the business negotiation recording server device 2 extracts the spoken text including the input keyword from the text information recorded in the business negotiation video DB 22b in association with the target business negotiation video. The business negotiation recording server device 2 transmits the speech text including the keyword and the information such as the speaker associated therewith as the search result to the terminal device 3 that requested the search. Based on the search results received from the negotiation recording server device 2, the terminal device 3 displays a list of text information of speech content including the keyword input as the search condition, for example, in order of playback time. The illustrated example is for a case where "release" is entered as a keyword. As a result of the search, the utterance text of “User A” “… First of all, “Release” Thank you for your hard work…” and the utterance text of “User B” “ The uttered text of "..." by "user C" and the uttered text of "...thank you, it's the number of 'release'..." are displayed. The uttered text of the search results is highlighted with the search keyword "release".

In this embodiment, it is assumed that the business negotiation recording server device 2 performs the search processing of the utterance contents, but the search processing is not limited to this, and the search processing may be performed by the terminal device. In this case, the terminal device 3 acquires and stores text information associated with the negotiation video, for example, when acquiring the negotiation video to be reproduced from the negotiation recording server device 2 . The terminal device 3 can extract text information including the keyword of the input search condition from the stored text information and display it as a search result.

After displaying the list of search results, the terminal device 3 accepts an operation to select any one of the displayed text information. When the selection operation is received, the terminal device 3 acquires the reproduction time associated with the selected text information, and starts reproducing the negotiation video on the reproduction screen from this reproduction time.

<analysis processing of business negotiation video>
The information processing system according to the present embodiment provides a function of analyzing various information related to online business negotiations based on the business negotiation video recorded in the business negotiation video DB 22b by the business negotiation recording server device 2 and various information related thereto. . For example, on the playback screen shown in FIG. 6, the terminal device 3 displays an utterance timing indicator indicating the utterance timing of the user who participated in the online business negotiation, in parallel with a seek bar indicating the playback time of the business negotiation video, below the display area of the reproduced business negotiation video. Show bar. The user's utterance timing shown in each utterance timing bar is obtained by totaling the utterance timings of the text information recorded in the business negotiation video DB 22 b of the business negotiation recording server device 2 . In addition, the terminal device 3 displays the utterance ratio of each user as a numerical value of 0% to 100% near the right end of the utterance timing bar of each user. The speech ratio is obtained by calculating the ratio of each user's speech time to the total value of the speech time of all participants in this online business negotiation.

In the present embodiment, information such as the utterance timing and utterance time ratio of each user is generated by the business negotiation recording server device 2 based on the information recorded in the business negotiation video DB 22b, and the terminal device that reproduces and displays the business negotiation video. Send to 3. However, the business negotiation recording server device 2 transmits the information recorded in the business negotiation video DB 22b to the terminal device 3, and the terminal device 3 that receives this information generates and displays information such as speech timing and speech time ratio. good too.

The information such as the timing of utterance and the rate of utterance time shown in FIG. 6 above is obtained by analyzing the information regarding the online business negotiations recorded in one video of the business negotiations. In the information processing system according to the present embodiment, it is possible not only to analyze information about one video of business negotiations, but also to analyze information about a plurality of videos of business negotiations recorded in the video DB 22b of business negotiations, and provide the analysis results to the user. can. This information analysis processing is performed by the negotiation recording server device 2 based on the information recorded in the negotiation video DB 22 b , and the processing result is transmitted to the terminal device 3 . The terminal device 3 receives the analysis result from the negotiation recording server device 2 and displays it on the display unit 34 .

FIG. 15 is a schematic diagram showing an example of a display screen for analysis results. A user who uses the information analysis function provided by the information processing system according to the present embodiment registers, for example, one or a plurality of users to be analyzed as a team in the negotiation record server device 2, and from the terminal device 3 By instructing the business negotiation recording server device 2 to perform analysis processing, it is possible to acquire analysis results from the business negotiation recording server device 2 and display them on the terminal device 3 . In the illustrated example, "average conversation time", "weekly conversation count", "weekly conversation time", "total number of conversations", "total conversation time", and "conversation participation The business negotiation recording server device 2 analyzes the six analysis items of "number of times the transaction was made", and the terminal device 3 displays the analysis results.

The business negotiation recording server device 2 extracts information on online business negotiations in which registered users have participated for a predetermined period such as one week, one month or one year from the business negotiation video DB 22b, and analyzes the above six analysis items for each user. Calculate the numerical value for The predetermined period for which the analysis is performed can be appropriately set by the user. “Average conversation time” is the average time spent by users in conversation (utterance) in one online business meeting. The “weekly number of conversations” is the average number of times the user participates in online business negotiations in one week. “Weekly conversation time” is the average value of the total time spent in online business negotiations by users in one week. The "total number of conversations" is the number of online business negotiations during a predetermined period. “Total conversation time” is the time spent in online business negotiations during a predetermined period. “Number of times of participation in conversation” is the number of times of participation in online business negotiations in a predetermined period.

The terminal device 3 switches and displays the analysis result of each analysis item on the analysis result display screen, for example, according to the so-called tab selection of the above six analysis items. In the example shown in FIG. 15, the "average conversation time" tab is selected, and the analysis result of this analysis item is displayed. The terminal device 3 also displays the character string indicating the analysis item and the numerical value related to this analysis item on the tab for switching the analysis item. The numerical value displayed on the tab may be, for example, an average value, maximum value, minimum value, or the like for a plurality of users (team members) included in the registered team. In the illustrated example, an average value is used.

The terminal device 3 displays the user names and the like of multiple users included in the team in a vertical list as the analysis result of the analysis item of "average conversation time", and also displays numerical values related to the analysis item calculated for each user. A horizontal bar graph is displayed in correspondence with the user name of the user. A plurality of displayed users are sorted and arranged in ascending or descending order of numerical values of analysis results, for example. In addition, the terminal device 3 indicates the average value of the entire team as a vertical straight line with respect to the horizontal bar graph. Display examples of the five analysis items other than the "average conversation time" are omitted, but the terminal device 3 can provide the user with analysis results in the same display method as the "average conversation time".

FIG. 16 is a schematic diagram showing another example of the analysis result display screen. In the example shown in FIG. 16, the terminal device 3 displays the analysis results of three analysis items: "percentage of conversation", "time spent talking alone", and "time spent by the customer talking alone". “Conversation ratio” is the ratio of conversations in online business negotiations in which the user participated during a predetermined period. The “time spent talking alone” is the maximum time spent talking alone by the user in online business negotiations in which the user participated during a predetermined period. The time during which the user continues to talk alone is the time during which the user alone is talking (uttering) without any other users talking. It should be noted that, for example, even in a state in which only this user continues to talk, if there is a state of no conversation for a predetermined period of time between them, the user's conversation may be temporarily interrupted.

The "customer talking alone time" is the maximum time that users (customers) other than this user talk alone in online business negotiations in which the user participates. When a plurality of customers are participating in an online business negotiation, the maximum value of the time spent talking alone for each customer can be calculated, and the maximum value of all customers can be used as the analysis result. As to which of the plurality of users participating in the online business negotiation is to be the customer, for example, all users other than the user to be analyzed may be regarded as the customer, or, for example, users other than the users registered as a team may be regarded as the customer. Alternatively, for example, registration of users who are regarded as customers may be accepted in advance. In the case of accepting customer registration in advance, for example, the business meeting recording server device 2 receives from the user who is the host of the online business meeting or the user who requests the analysis of the business meeting a setting as to whether or not the user participating in the online business meeting is a customer. Information indicating whether or not each user is a customer is received via the apparatus 3 and recorded in the negotiation video DB 22b in accordance with the received settings.

The terminal device 3 displays the user names and the like of the multiple users included in the team in a vertical list as the analysis results of the analysis items of the "proportion of conversation", and also displays numerical values related to the analysis items calculated for each user. A horizontal bar graph is displayed in correspondence with the user name of the user. As shown in FIG. 16, the terminal device 3 can display the analysis results such as the "proportion of conversation" in the same manner and manner as the analysis results shown in FIG.

FIG. 17 is a flow chart showing the procedure of analysis processing performed by the negotiation recording server device 2 according to the present embodiment. The analysis processing unit 21f of the processing unit 21 of the business negotiation recording server device 2 according to the present embodiment receives a request to perform analysis processing regarding online business negotiations from the terminal device 3 (step S51), and starts analysis processing. The analysis processing unit 21f acquires one or a plurality of user names included in the team to be analyzed based on the pre-registered information about the team (step S52). Based on the acquired user name, the analysis processing unit 21f reads out information about the online business negotiation in which the user has participated from the business negotiation video DB 22b (step S53).

Based on the information read from the business negotiation video DB 22b, the analysis processing unit 21f calculates "average conversation time", "weekly number of conversations", "weekly conversation time", and "total number of conversations" for each user included in the team. , "Total Conversation Time", "Number of Conversations Participated in", "Percentage of Conversations", "Time Continuing to Talk Alone" and "Customer Continuing to Talk Alone" (Step S54). The analysis processing unit 21f calculates the average value of each analysis item in the team including these users based on the calculation result of each analysis item for each user (Step S55). The analysis processing unit 21f transmits the analysis result including information such as the values regarding each analysis item for each user and the average value in the team to the terminal device 3 that requested the analysis processing (step S56), and ends the processing. .

<Other functions>
(1) Library Function In the information processing system according to the present embodiment, the user who views the business negotiation video on the terminal device 3 can create a library in which the necessary business negotiation video is collected. A user who accesses the business negotiation video recorded in the business negotiation video DB 22b of the business negotiation recording server device 2 by the above-described business negotiation video sharing function can reproduce and view the business negotiation video on the terminal device 3, and can view the business negotiation video. You can register it in your own library. For example, when a predetermined operation is performed on the playback screen shown in FIG. 6, the terminal device 3 registers the displayed negotiation video in the user's library. The terminal device 3 displays a list of the business talk videos registered in the library according to a predetermined operation of the user, receives selection of one business talk video from the listed business talk videos, and displays the selected business talk video. Play and view.

In this embodiment, each user's library is managed as information that collects, for example, link information to business negotiation videos. Management of the library information may be performed by the negotiation recording server device 2 or may be performed by the terminal device 3 . In addition, the information processing system automatically registers business talk videos of online business talks in which the user has participated in the user's library. It is also possible to provide an automatic registration function to the library, such as automatic registration of videos of business talks, such as online business talks.

(2) Topic Function In the information processing system according to the present embodiment, the business negotiation recording server device 2 classifies the text information obtained by converting the voice of the business negotiation video into text as described above by topic classification. When the user performs a predetermined operation, such as a menu item selection operation, an icon operation, or a shortcut operation, on the terminal device 3, the business negotiation recording server device 2 transmits information on the topic classification result to the terminal device 3. 3 displays the topic classification results.

FIG. 18 is a schematic diagram showing a display example of topic classification results. The illustrated example is an example of the topic classification result displayed by the terminal device 3 when the user performs an operation to display the topic classification result on the screen for displaying the text of the voice of the business negotiation video shown in FIG. . In the information processing system according to the present embodiment, the terminal device 3 displays a label associated with the topic included in the text information near the position where the text information of the user's utterance content is displayed. In the illustrated example, labels in which numerical values "1" and "2" are written in upside-down teardrop-shaped or waterdrop-shaped balloons are displayed near the text information. For example, text information labeled with "1" indicates that it has been classified into class 1 by topic classification.

Further, in the information processing system according to the present embodiment, the user can set arbitrary label names for numerical labels displayed as topic classification results. For example, the user can select one from one or more displayed labels and enter an arbitrary character string to set an arbitrary label name for the selected label. The terminal device 3 acquires the label name set by the user and stores the correspondence relationship between the label of the original numerical value and the label set by the user. When the topic classification label is displayed thereafter, the terminal device 3 converts the numeric label into the set label name based on the stored correspondence, and displays a speech balloon describing the set label name near the text information. to display.

Note that the label name set by the user may be treated as a valid label name only for this user, for example, and may be shared among multiple users, such as other users registered in the same team as this user. may be shared. When a label name is shared among a plurality of users, the negotiation recording server device 2 holds information on the correspondence relationship between the numerical value of the label and the label name. If the label name is reflected only to the user who has set it, the information on the correspondence relationship between the numerical value of the label and the label name may be held only in the terminal device 3 used by this user, or held in the negotiation recording server device 2. may be

<Summary>
In the information processing system according to the present embodiment having the above configuration, the business meeting recording server device 2 acquires the video of the recorded online business meeting via the online business meeting server device 1, and based on the acquired video of the business meeting, the participants It converts voice information related to speech into text information. For example, when the terminal device 3 displays the video of the business negotiation, the business negotiation recording server device 2 transmits the converted text information to the terminal device 3 together with the video of the business negotiation, and causes the terminal device 3 to display the text information. Since the business negotiation recording server device 2 converts the audio of the video of the business negotiation into text information, the user can check the contents of the speech of the participants in the online business negotiation on a text basis, so that the recorded business negotiation video of the online business negotiation can be obtained. It can be expected to support the investigation or analysis of

In the information processing system according to the present embodiment, the business negotiation recording server device 2 records the business negotiation video in the business negotiation video DB 22b, receives the conditions for sharing the business negotiation video from the user via the terminal device 3, and records the business negotiation video. Link information or the like for accessing the video of the negotiation recorded in the DB 22b is generated. The conditions for sharing the business talk video can be, for example, "share the current playback time", "share the video", and "share with specified playback time", etc., and these start playing the business talk video. It is a condition that specifies when to As a result, one user provides another user with the link information generated by the business negotiation recording server device 2, so that a plurality of users can access and view the video of the business negotiation, thereby realizing the sharing of the video of the business negotiation. be done.

Further, the information processing system according to the present embodiment provides a search function using a search keyword for text information of a business meeting video, or a business meeting video search function based on users who have participated in online business meetings. As a result, the user can easily find and view a desired business negotiation video from among the plurality of business negotiation videos recorded by the business negotiation recording server device 2 .

Further, in the information processing system according to the present embodiment, input of comment information is received from the user who viewed the business negotiation video, and the business negotiation recording server device 2 stores the received comment information in the business negotiation video DB 22b in association with the business negotiation video. . When the terminal device 3 displays the video of the business negotiation, the business negotiation recording server device 2 transmits the associated comment information together with the video of the business negotiation to the terminal device 3, and causes the terminal device 3 to display the comment information together with the video of the business negotiation. This allows other users to check the comment input by one user together with the video of the negotiation.

In the information processing system according to the present embodiment, the business negotiation recording server device 2 stores the comment information input by the user in association with the reproduction time of the business negotiation video (the display time for the reproduction time). is displayed, a seek bar indicating the playback time (playing point) with respect to the playback time of the negotiation video is displayed, and an index indicating the display point of the comment information is displayed on this seek bar. It is possible to easily grasp at what point in the video other users added comment information.

In addition, in the information processing system according to the present embodiment, when a user's predetermined operation (for example, a click operation or a touch operation) on comment information displayed by the terminal device 3 is received, the reproduction time associated with the comment information is displayed. From (point of display), playback of the negotiation video is started. This allows the user to easily check the business negotiation video at the time when the comment information was added.

In addition, in the information processing system according to the present embodiment, when the terminal device 3 displays the business negotiation video, each user who has participated in the online business negotiation related to this business negotiation video has an utterance timing (utterance point) with respect to the reproduction time of the business negotiation video. are displayed in chronological order. For example, the terminal device 3 displays an utterance timing bar for each user side by side with a seek bar indicating the reproduction time point of the negotiation video, thereby displaying the utterance timing for each user. As a result, the user viewing the video of the business negotiation can easily grasp the timing at which the user participating in the online business negotiation speaks.

In addition, in the information processing system according to the present embodiment, based on the business negotiation video recorded in the business negotiation video DB 22b and related information, the business negotiation recording server device 2 records the ratio of utterances (conversation ratio) of the users participating in the online business negotiation. ) or the time spent speaking alone (time spent talking alone), etc., and display the analysis results on the terminal device 3 . The negotiation recording server device 2 also performs these analyzes for a plurality of users, and displays the analysis results of the plurality of users on the terminal device 3 in comparison. Accordingly, the user can expect to analyze in detail the characteristics of each user related to the online business negotiation based on the business negotiation video recorded in the business negotiation video DB 22b.

In addition, in the information processing system according to the present embodiment, the bot that records the video of the business negotiations on the business negotiation recording server device 2 participates in the online business negotiations that the online business negotiations server device 1 conducts. Acquire the video of the business meeting that recorded the image of As a result, even if there are a plurality of types of online business negotiation server devices 1, for example, the business negotiation recording server device 2 can easily acquire video of the business negotiations by allowing the bot to participate. can be expected to respond to

Further, in the information processing system according to the present embodiment, the negotiation recording server device 2 receives consent for recording the negotiation video from the users participating in the online negotiation, and records the received consent in the negotiation video DB 22b. This can be expected to prevent troubles related to the recording of the video of the negotiation.

The embodiments disclosed this time are illustrative in all respects and should be considered not restrictive. The scope of the present invention is indicated by the scope of the claims rather than the meaning described above, and is intended to include all modifications within the scope and meaning equivalent to the scope of the claims.

1 online business negotiation server device 2 business negotiation recording server device 3 terminal device 21 processing unit 21a business negotiation video acquisition unit 21b text conversion processing unit 21c search processing unit 21d sharing processing unit 21e comment processing unit 21f analysis processing unit 21g consent processing unit 22 storage unit 22a Server program 22b Business talk video DB
23 communication unit 31 processing unit 31a online negotiation processing unit 31b negotiation video processing unit 32 storage unit 32a program 33 communication unit 34 display unit 35 operation unit 36 camera 37 microphone 98, 99 recording medium N network

In an information processing method according to an embodiment, an information processing device acquires a video of a recorded business meeting, converts voice information related to the speech of a participant who participated in the business meeting into text information based on the acquired video of the business meeting. converting, displaying the converted text information, receiving input of comment information for the business discussion video, storing the received comment information in association with a display time point with respect to the reproduction time of the business discussion video, and reproducing the business discussion video. A seek bar indicating a reproduction time point with respect to time is displayed, and an index indicating a display time point associated with comment information received as an input to the negotiation video is displayed in association with the seek bar.
In an information processing method according to an embodiment, an information processing device acquires a video of a recorded business meeting, converts voice information related to the speech of a participant who participated in the business meeting into text information based on the acquired video of the business meeting. The converted text information is displayed, and utterance time points relative to the reproduction time of the business discussion video are displayed in chronological order for each participant who participated in the business discussion related to the business discussion video.
In an information processing method according to one embodiment, an information processing device receives consent from a participant in a business negotiation to participate in a bot that records a business negotiation, records information related to the received consent, and receives the consent from the participant. When obtained, the bot participates in the business negotiation as a participant, acquires a recorded business negotiation video, and based on the acquired business negotiation video, voice information related to the speech of the participant who participated in the business negotiation. is converted into text information, the converted text information is displayed, and the bot exits the negotiation if the consent of the participant is not obtained.

Claims (16)

The information processing device
Acquire business talk videos that record business talks,
Converting voice information related to the speech of a participant who participated in the business talk into text information based on the obtained business talk video,
displaying the converted text information;
Information processing methods. The information processing device
Record the video of the business meeting,
Receiving a condition for sharing the business talk video by a plurality of participants who participated in the business talk,
generating information for accessing the business negotiation video based on the accepted conditions;
The information processing method according to claim 1 . The condition is a condition that specifies a point in time to start playing when playing the business negotiation video.
The information processing method according to claim 2. The information processing device
Receiving a search keyword for the business negotiation video,
extracting the business negotiation video corresponding to the test information containing the received search keyword from among the plurality of recorded business negotiation videos;
The information processing method according to any one of claims 1 to 3. The information processing device
Receiving information related to participants who participated in the business negotiation,
Extracting the business talk video of the business talk in which the participant corresponding to the received information participates from among the plurality of recorded business talk videos;
The information processing method according to any one of claims 1 to 4. The information processing device
Receiving input of comment information on the business talk video,
storing the received comment information in association with the business negotiation video;
displaying said comment information;
The information processing method according to any one of claims 1 to 5. The information processing device
storing the comment information in association with a display time point with respect to the reproduction time of the business negotiation video;
displaying a seek bar indicating a playback time point with respect to a playback time of the business negotiation video when the business negotiation video is played;
displaying an index indicating the display time point of the comment information on the seek bar;
The information processing method according to claim 6. The information processing device receives an operation on the displayed comment information, and reproduces the business negotiation video associated with the comment information from the display point of time associated with the comment information.
The information processing method according to claim 7. The information processing device displays, in chronological order, the utterance time point with respect to the reproduction time of the business discussion video for each participant who participated in the business discussion related to the business discussion video.
The information processing method according to any one of claims 1 to 8. The information processing device
calculating the ratio of utterances during the business talks for the participants who participated in the business talks related to the business talk video,
display information about the calculated percentage;
The information processing method according to any one of claims 1 to 9. The information processing device
Calculating the time during which the participant who participated in the business talk related to the business talk video continued to speak alone during the business talk,
display information about the calculated time;
The information processing method according to claim 10. The information processing device
Calculate the ratio and the time for a plurality of participants who participated in a plurality of business negotiations,
displaying the calculation results for the plurality of participants in comparison;
The information processing method according to claim 11. the information processing device causes a bot that records the business negotiation video to participate in the business negotiation as a participant;
The information processing method according to any one of claims 1 to 12. The information processing device
Receiving consent from participants in the business talks regarding the recording of the business talk video,
record information about consents received;
The information processing method according to any one of claims 1 to 13. to the computer,
Acquire business talk videos that record business talks,
Converting voice information related to the speech of a participant who participated in the business talk into text information based on the obtained business talk video,
A computer program for executing a process of displaying the converted text information. an acquisition unit that acquires a recorded negotiation video;
a conversion unit that converts audio information related to the speech of a participant who participated in the business negotiation into text information based on the acquired video of the business negotiation;
and a display processing unit that performs processing for displaying the converted text information on a display unit.

Images