JP2022179354A - Information processing apparatus and program - Google Patents

Abstract

To provide simpler and more user-friendly means of communication.SOLUTION: A context information acquisition unit 80 acquires context information transmitted from each of listener terminals 3 via a communication unit 19. A first condition determination unit 90 determines whether or not the context information acquired by the context information acquisition unit 80 satisfies a predetermined first condition. A second condition determination unit 92 determines whether or not the context information acquired by the context information acquisition unit 80 satisfies a predetermined second condition. An audio information management unit 84 generates audio information to be output according to the condition satisfied by the context information if a condition determination unit 82 determines that the predetermined condition is satisfied. The audio information management unit 84 transmits the generated audio information to a speaker terminal 2 and the listener terminals 3, respectively.SELECTED DRAWING: Figure 3

Description

There is an application for exception to loss of novelty

The present invention relates to an information processing device and program.

Conventionally, a technology is known in which participants share voices and moving images via a network. In recent years, services using such technology are called, for example, WEB conferencing, VR conferencing, etc., and are widely used. For example, Patent Literature 1 proposes a technique related to a function for a facilitator who mainly speaks at meetings, seminars, etc., to add stamp information combining pictures, marks, etc. to make it easier to understand the intention of his/her contribution.

JP 2018-136597 A

However, many of the conventional technologies, including the technology described in Patent Document 1 above, provide information from the information sender (seminar organizer, facilitator, etc.) to the information receiver (seminar audience, etc.). Most of the information is transmitted, and messages can be sent by chat etc. to convey the intention from the information receiver (seminar audience, etc.) to the information sender (seminar organizer, facilitator, etc.) It was pointed out that it was difficult for the sender of the information to confirm the reaction to the content of the statement, making it difficult to proceed with the conference or seminar.
Furthermore, regardless of whether it is the sender of information or the recipient of information, the information that conveys their intentions (stamps, messages, etc.) is often monotonous and inadequate as a method of information transmission. It was not less.

SUMMARY OF THE INVENTION It is an object of the present invention to provide a communication means that is simpler and easier to use.

In order to achieve the above object, an information processing device according to one aspect of the present invention includes:
a first terminal used by a first user capable of transmitting predetermined information;
a second terminal used by a plurality of second users capable of receiving predetermined information;
a server;
An information processing device that functions as a server in an information processing system that includes
a first context information acquiring means for acquiring first context information from one of the second users among the plurality of second users;
a second context information acquiring means for acquiring second context information from the other second users among the plurality of second users;
condition determination means for determining whether the first context information and the second context information satisfy a predetermined condition;
output information generating means for generating output information to be output as voice when the condition is satisfied;
Prepare.

According to the present invention, it is possible to provide communication means that are simpler and easier to use.

1 is a block diagram showing an example of the configuration of an information processing system according to one embodiment of the present invention; FIG. 2 is a diagram illustrating an example of a hardware configuration of a server in the information processing system of FIG. 1; FIG. 3 is a diagram showing an example of functional configurations of the server of FIG. 2 and the speaker terminal and audience terminal of FIG. 1; FIG. 2 is a diagram showing an example of images displayed on the speaker terminal and the audience terminal of FIG. 1; FIG. FIG. 5 is a diagram showing an example of images displayed on the speaker terminal and the audience terminal shown in FIG. 1, and showing an example different from the example shown in FIG. 4; FIG. 4 is a flowchart for explaining the flow of various processes executed by the server of FIG. 3; FIG. 10 is a diagram showing an example of an image displayed on an information processing terminal that constitutes an information processing system according to another embodiment of the present invention;

BEST MODE FOR CARRYING OUT THE INVENTION Hereinafter, embodiments of the present invention will be described with reference to the drawings.

First, referring to FIG. 1, the configuration of an information processing system (hereinafter referred to as "this system") according to an embodiment of the present invention will be described.
FIG. 1 is a block diagram showing an example of the configuration of this system.

As shown in FIG. 1, this system includes a server 1, a speaker terminal 2, and audience terminals 3-1 to 3-n (n is an arbitrary integer value of 1 or more). The server 1, the speaker terminal 2, and the audience terminals 3-1 to 3-n are interconnected via a network N such as the Internet. Note that the network N is not an essential element, and for example, Bluetooth (registered trademark), Wi-Fi, LAN (Local Area Network), etc. may be used.
In the following description, when there is no need to individually distinguish between the audience terminals 3-1 to 3-n, they will be collectively referred to as "listener terminals 3".

The server 1 is an information processing device managed by an administrator or the like of this system. The server 1 communicates with each of the speaker terminal 2 and the audience terminal 3 as appropriate, and executes various processes to be described later.

The speaker terminal 2 is an information processing terminal mainly used by a speaker who speaks in a web seminar related to this system (hereinafter referred to as "seminar").

The audience terminal 3 is an information processing terminal used by the audience who attends the seminar. Note that the speaker terminal 2 and the audience terminal 3 are configured by, for example, general-purpose information processing terminals such as personal computers, smartphones, and tablets.

Note that each of the speaker and the audience can receive services related to this system by using applications or web browsers installed in the speaker terminal 2 and the audience terminal 3, respectively.

FIG. 2 is a block diagram showing an example of a hardware configuration of a server in the information processing system of FIG. 1. As shown in FIG.

As shown in FIG. 2, the server 1 includes a control unit 11, a ROM (Read Only Memory) 12, a RAM (Random Access Memory) 13, a bus 14, an input/output interface 15, an output unit 16, an input unit 17 , a storage unit 18 , a communication unit 19 and a drive 20 .

The control unit 11 is composed of a microcomputer or the like including a CPU, GPU, and semiconductor memory, and executes various processes according to programs recorded in the ROM 12 or programs loaded from the storage unit 18 to the RAM 13 .
The RAM 13 also stores data necessary for the control unit 11 to execute various processes.

Control unit 11 , ROM 12 and RAM 13 are interconnected via bus 14 . An input/output interface 15 is also connected to this bus 14 . An output unit 16 , an input unit 17 , a storage unit 18 , a communication unit 19 and a drive 20 are connected to the input/output interface 15 .

The output unit 16 includes a display, a speaker, and the like, and outputs various information as images and sounds.

The input unit 17 is composed of a keyboard, a mouse, etc., and inputs various information.

The storage unit 18 is composed of a hard disk, a DRAM (Dynamic Random Access Memory), or the like, and stores various data.
The communication unit 19 communicates with other devices (for example, the speaker terminal 2, the audience terminal 3, etc.) via a network N including the Internet.

A drive 20 is provided as required. A removable medium 31 such as a magnetic disk, an optical disk, a magneto-optical disk, or a semiconductor memory is mounted in the drive 20 as appropriate. A program read from the removable medium 31 by the drive 20 is installed in the storage unit 18 as necessary. The removable medium 31 can also store various data stored in the storage unit 18 in the same manner as the storage unit 18 .

FIG. 3 shows an example of functional configurations of the server 1, the speaker terminal 2, and the audience terminal 3. As shown in FIG.

As shown in FIG. 3, the control unit 11 of the server 1 causes a context information acquisition unit 80, a condition determination unit 82, and a voice information management unit 84 to function by executing various programs.

The context information acquisition unit 80 acquires the context information transmitted from each of the listener terminals 3 via the communication unit 19 .

The condition determination unit 82 determines whether or not the context information acquired by the context information acquisition unit 80 satisfies a predetermined condition. That is, although the details will be described later with reference to FIG. 4, for example, the condition determination unit 82 determines whether or not the context information acquired by the context information acquisition unit 80 includes predetermined stamp information.
Here, the condition determination section 82 is provided with a first condition determination section 90 and a second condition determination section 92 . The functions of the first condition determination section 90 and the second condition determination section 92 will be specifically described below.
First, the first condition determination unit 90 determines whether or not the context information acquired by the context information acquisition unit 80 satisfies a predetermined first condition. That is, the details will be described later with reference to FIG. 5, but for example, the first condition determination unit 90 adds the first keyword ("high" in the example of FIG. 5) to the context information acquired from one audience member. text) is included.
Then, the second condition determination section 92 determines whether or not the context information acquired by the context information acquisition section 80 satisfies a predetermined second condition. That is, although the details will be described later with reference to FIG. 5, for example, the second condition determination unit 92 adds a second keyword ("five" in the example of FIG. 5) to the context information acquired from other listeners. text) is included.

When the condition determination unit 82 determines that a predetermined condition is satisfied, the audio information management unit 84 generates audio information to be output according to the condition satisfied by the context information. In addition, the voice information management unit 84 transmits the generated voice information to each of the speaker terminal 2 and the audience terminal 3 .

Further, as shown in FIG. 3, the control unit 110 of the listener terminal 3 executes various programs to cause a context information reception unit 130, a voice information acquisition unit 132, and an output information control unit 134 to function. .
The context information reception unit 130 receives input of context information from each of the listeners. Also, the context information receiving unit 130 transmits the received context information to the server 1 .

The voice information acquisition unit 132 acquires voice information transmitted from the server 1 via the communication unit 120 .

The output information control unit 134 executes control for outputting various kinds of output information via an output unit (not shown).

FIG. 4 is a diagram showing an example of images displayed on the speaker terminal and the audience terminal shown in FIG. With reference to FIG. 4, the stamp display function accompanied by voice reproduction according to this system will be described.

FIG. 4 shows a chat display area C and a virtual space simulating a seminar hall (hereinafter referred to as "seminar space"). Also, in the seminar hall, an icon A corresponding to the speaker, and icons B1, B2, and B3 corresponding to the listeners, respectively, are arranged. The example of FIG. 4 shows a situation in which each of the listeners is listening to a seminar by a lecturer via this system.
Here, in the example of FIG. 4, when looking at the chat display area C, each of the users corresponding to the icons B1 to B3 inputs a message including an icon resembling applause (hereinafter referred to as "applause stamp"). is displayed. When looking at the seminar space in FIG. 4, applause stamps are displayed on the left side of the icons B1 to B3. This indicates that the applause stamp of the icon corresponding to the user in the virtual space has been displayed as a result of each user giving an instruction to display the applause stamp.
For example, the user can input the applause stamp in the chat display area C by converting the word "applause" after inputting it in the chat display area C. FIG.
Furthermore, in the example of FIG. 4, together with the display of the applause stamp, a sound effect of “clap clap clap” is reproduced on each of the speaker terminal 2 and the audience terminal 3 . As a result, the lecturer who conducts the seminar can more realistically experience the audience's reactions to his or her seminar.

Furthermore, the actions shown in FIG. 4 are actions that can be completed by one user, but the actions shown in the embodiment of FIG. 5 are basically completed only when two or more users work together. possible action.
In FIG. 5, icons B4 to B6 corresponding to users participating in the meeting are arranged. In the example of FIG. 5, for example, members belonging to the same department in the company are having a simple meeting via this system.
In the example of FIG. 5, in the chat display area C, the message "high" is input by the user corresponding to the icon B4, and the message "five" is input by the user corresponding to the icon B6.
Here, in this system, the words "high" and "five" are set as mutually related words, and when two or more users input the words "high" and "five" in order, A specification that outputs the sound "crackling" is adopted. Specifically, in the example of FIG. 5 as well, the word "high" is input by the user of the icon B4, and the word "five" is input by the user of the icon B6. Therefore, in the example of FIG. 5 as well, the voice "clap clap clap" is output via the information processing terminal or the like used by each user.
In this way, the present system has a function that can be realized by a plurality of users performing linked actions, so that each user can communicate with each other while feeling a sense of solidarity.

FIG. 6 shows an example of the flow of linked reaction processing executed by the server of FIG.

In step S<b>1 , the context information acquisition unit 80 acquires the context information transmitted from each of the audience terminals 3 via the communication unit 19 .

In step S2, the first condition determination unit 90 determines whether or not the first keyword is included in the context information acquired from one listener.
If the context information includes the first keyword, a determination of YES is made in step S2, and the process directly proceeds to step S3.
On the other hand, if the context information does not include the first keyword, NO is determined in step S2, and the process returns to step S1.

In step S<b>3 , the context information acquisition unit 80 acquires, via the communication unit 19 , context information newly transmitted from another audience member terminal 3 .

In step S4, the second condition determination unit 92 determines whether or not the newly acquired context information includes the second keyword.
If the context information includes the second keyword, YES is determined in step S4, and the process directly proceeds to step S5.
On the other hand, if the context information does not include the second keyword, NO is determined in step S4, and the process returns to step S3. If the second keyword is not acquired for a certain period of time, or if it is determined that the second keyword is not included a predetermined number of times, the linked reaction process ends.

In step S5, when the condition determination unit 82 determines that the predetermined condition is satisfied, the voice information management unit 84 generates voice information to be output according to the condition satisfied by the context information. , the generated voice information is transmitted to the speaker terminal 2 and the audience terminal 3, respectively. Thus, the linked reaction process executed by the server 1 ends.

Although one embodiment of the present invention has been described above, the present invention is not limited to the above-described embodiment, and modifications, improvements, etc. within the range that can achieve the object of the present invention are included in the present invention. is.

Another embodiment, which is an application of the above embodiment, will now be described with reference to FIG.
FIG. 7 is a diagram showing an example of images displayed on the speaker terminal and audience terminal in FIG. 1, and is a diagram showing an example different from the example in FIG. The speech input stamp display function of this system will be described with reference to FIG.
In the example of FIG. 7, a message including an icon resembling the character "!" (hereinafter referred to as a "voice input stamp") is input and displayed as the user's message corresponding to the icon B1 in the chat display area C. there is In this embodiment, the voice input stamp is a stamp indicating acceptance of temporary voice input from each of the listeners. Specifically, in the example of FIG. 7, any voice input is allowed for 10 seconds at the audience terminal 3 used by the audience member corresponding to the icon B1, and the input voice is output as voice to other audience members. be done.
Even in services such as conventional web conferences, it is possible to set whether or not to accept input information from a voice or a camera (for example, a mute function). For example, when listening to a seminar or the like, priority is given to the speaker's voice, so it is common for the audience to listen to the seminar or the like in a state in which input of the voice or the like is not accepted. However, for this reason, there are problems such that the speaker cannot check the reaction of the audience, and it is difficult for the audience to communicate with each other, so that the seminar itself is difficult to liven up.
In order to solve such a problem, the voice input stamp shown in FIG. 7 recognizes voice input under a certain condition (for example, 10 seconds) and transmits it, mainly for the purpose of transmitting the reaction to the speaker. By doing so, it is possible to transmit one's own reaction to the lecturer and audience, and to operate seminars and the like that are closer to reality.
In addition, when temporarily inputting audio with services such as conventional web conferencing, it is necessary to turn off the mute function once, input audio, and then turn on the mute function again. be. Furthermore, in conventional services, etc., stamps and the like are not displayed at the same time, so the audience's voice is suddenly reproduced.

In addition, in the examples of FIGS. 4 and 7, various text messages are input via the chat display area C, but this is an example and is not limited. For example, the system may display a message directly input in the virtual space without going through the chat display area C. FIG. For example, the system may not set the chat display area C in the first place.

Furthermore, the words "high" and "five" employed in the example of FIG. 5 are, of course, illustrative and not limiting. The system may employ any type and number of relevant words as triggers to output speech.

Note that in the examples of FIGS. 4 and 7, the stamp display instruction is input as a message in the chat field, but the present invention is not limited to this. For example, an audience member or the like may give a display instruction more simply using a shortcut or the like.

Further, in the example of FIG. 4, the sound reproduced together with the applause stamp has been described as "clap-clap-clap", but the present invention is not limited to this. Any sound suitable for the displayed stamp may be played, or the sound played may be freely customized by the audience.

Also, in the example of FIG. 4, the displayed stamp has been described as a clapping stamp, but the present invention is not limited to this. The stamp displayed in this system may be any stamp or the like used in existing communication tools or the like.

Further, in the above-described embodiment and other embodiments, the above various stamps, messages, and the like have been described as input by the user via a keyboard or the like, but the present invention is not limited to this.
For example, this system analyzes various actions such as clapping hands, raising hands, and good signs (thumbs up gestures) based on the images captured by each user, and automatically displays the various stamps and messages described above. A specification in which is input may be adopted.

Further, in the above-described embodiment, the users who use this system are described as being a lecturer who gives a seminar or the like and an audience member who attends the seminar or the like, but the present invention is not limited to this. The use of this system is not limited to seminars and the like, but can be used for various purposes such as in-house meetings, lectures, events, gatherings of friends, and Internet games. In that case, the users are not limited to lecturers and audience members, but can use this system according to their respective purposes.

Further, although the description is omitted in the above-described embodiment, the various stamps described above may be associated with ON/OFF of any function other than the voice input function. For example, when a predetermined stamp is displayed by operating a chat or shortcut key, etc., the system turns on various functions such as a mute function, a camera function, and a function to leave the virtual space (VR conference space, conference room, etc.). A specification for switching between /OFF may be adopted.

Also, for example, the system configuration shown in FIG. 1 and the hardware configuration of the server 1 shown in FIG. 2 are merely examples for achieving the object of the present invention, and are not particularly limited.

Also, for example, the series of processes described above can be executed by hardware or by software.

Further, for example, the number and users of various hardware constituting this system are arbitrary, and the system may be configured including other hardware. Furthermore, the same computer or the like may be employed for the various types of hardware described above.

Further, for example, when a series of processes is executed by software, a program constituting the software is installed in a computer or the like from a network or a recording medium.
The computer may be a computer built into dedicated hardware.
Also, the computer may be a computer capable of executing various functions by installing various programs, such as a server, a general-purpose smart phone, or a personal computer.
That is, for example, any computer, any mobile terminal such as a smart phone, or the like may be freely adopted as various hardware in the above-described embodiments. Furthermore, any combination of types and contents of various input units and various output units may be employed.

Further, for example, a recording medium containing such a program is not only constituted by a removable medium (not shown) that is provided separately from the device main body in order to provide the program to the user, but also is pre-installed in the device main body. It consists of a recording medium, etc. provided to the user in the

In this specification, the steps of writing a program recorded on a recording medium are not only processes that are performed chronologically in that order, but also processes that are not necessarily chronologically processed, and that are performed in parallel or individually. It contains the processing to be performed.
Further, in this specification, the term "system" means an overall device composed of a plurality of devices, a plurality of means, or the like.
Furthermore, in the flow charts, communications may be handled separately on the receiving side and the transmitting side, and all or some of the processes described may be communicated on the receiving side or the transmitting side only, for example.

In summary, the information processing system to which the present invention is applied can take various embodiments having the following configurations.
That is, the information processing apparatus to which the present invention is applied is
a first terminal used by a first user capable of transmitting predetermined information;
a second terminal used by a plurality of second users capable of receiving predetermined information;
a server;
An information processing device that functions as a server in an information processing system that includes
a first context information acquisition means (for example, a context information acquisition unit 80) for acquiring first context information from one of the plurality of second users;
a second context information acquisition means (for example, a context information acquisition unit 80) for acquiring second context information from the other second users among the plurality of second users;
condition determination means (e.g., condition determination unit 82) for determining whether the first context information and the second context information satisfy a predetermined condition;
an output information generating means (for example, a voice information management unit 84) for generating output information to be output as voice when the condition is satisfied;
Prepare.

Also, the first context information and the second context information may be text information.

Also, the first context information and the second context information may be stamp information.

Also, the condition determining means can determine whether or not the first context information and the second context information satisfy the condition, which is a combination of predetermined text information.

Also, the output information may be voice information.

1 server 11 control unit 80 context information acquisition unit 82 condition determination unit 90 first condition determination unit 92 second condition determination unit 84 voice information management unit 2 speaker terminal 3-1 to 3-n audience terminal 110 control unit 130 context Information reception unit 132 Voice information acquisition unit 134 Output information control unit

Claims (6)

a first terminal used by a first user capable of transmitting predetermined information;
a second terminal used by a plurality of second users capable of receiving predetermined information;
a server;
An information processing device that functions as a server in an information processing system that includes
a first context information acquiring means for acquiring first context information from one of the second users among the plurality of second users;
a second context information acquiring means for acquiring second context information from the other second users among the plurality of second users;
condition determination means for determining whether the first context information and the second context information satisfy a predetermined condition;
output information generating means for generating output information to be output as voice when the condition is satisfied;
Information processing device. wherein the first context information and the second context information are text information;
The information processing device according to claim 1 . wherein the first context information and the second context information are stamp information;
The information processing device according to claim 1 . The condition determination means determines whether the first context information and the second context information satisfy the condition, which is a combination of predetermined text information.
The information processing apparatus according to claim 2. wherein the output information is audio information;
The information processing apparatus according to claim 2 or 3. a first terminal used by a first user capable of transmitting predetermined information;
a second terminal used by a plurality of second users capable of receiving predetermined information;
a server;
In an information processing system that functions as a server in an information processing system including
a first context information obtaining step of obtaining first context information from one of the plurality of second users;
a second context information obtaining step of obtaining second context information from the other second users among the plurality of second users;
a condition determination step of determining whether the first context information and the second context information satisfy a predetermined condition;
output information generating means for generating output information to be output as voice when the condition is satisfied;
A program that executes a process including

Images