WO2022024371A1 - Web meeting system and web meeting program - Google Patents

Abstract

This web meeting system comprises: a text conversion processing device that generates text data from the speech of a speaker in a web meeting; a main meeting/non-main meeting control device that distinguishes between a main web meeting in which a client is participating by gazing thereat, and a non-main meeting in which the client is participating without gazing thereat; and a display unit that simultaneously displays a display screen of the main web meeting and a display screen of the non-main web meeting. The main meeting/non-main meeting control device sets the microphone of the non-main web meeting to mute, and displays text data of the non-main web meeting on the display screen of the non-main web meeting.

Description

Web conferencing system and web conferencing program

The present invention relates to a web conferencing system and a web conferencing program.

In recent years, telework has been carried out in order to avoid long-term travel and to balance with the family such as childcare. The Web conferencing system has become indispensable as a business tool for performing telework.

In the web conferencing system, the client transmits a self-portrait taken by a camera and a voice speaking into a microphone to a server via a network. In addition, the client receives images and sounds of other participants from the server via the network.

In such a Web conferencing system, the client only has to speak when necessary and participate in the topic of interest, and it is not always necessary to pay close attention to one conference over the entire time. Clients can expect to improve business efficiency if they can perform many tasks in a limited amount of time. For example, while participating in a Web conference, it is possible to improve the efficiency of business by creating a document for another business or participating in a plurality of Web conferences at the same time.

For example, Patent Document 1 discloses a Web conferencing system in which the remarks of a client other than the main speaker are converted into text and multiplexed on the display screen of the client. According to the Web conferencing system of Patent Document 1, even if a plurality of remarks are made at the same time, the remarks of the main speaker are not disturbed.

Japanese Unexamined Patent Publication No. 2016-136746

However, in the Web conferencing system of Patent Document 1, it is not considered that the client participates in a plurality of Web conferencing. When a client participates in a plurality of Web conferences, there is a problem that the remarks of one conference flow to another Web conference via the client, and interference occurs between the Web conferences.

The present invention has been made in view of such a point, and an object of the present invention is to provide a web conferencing system and a web conferencing program in which a client can participate in a plurality of web conferencing at the same time.

The web conferencing system of the present invention includes a text conversion processing device that generates text data from the voice of a speaker of a web conference, a main web conference in which a client gazes and participates, and a non-main web in which a client participates without gaze. It includes a main conference-non-main conference control device that distinguishes the conference from the conference, and a display unit that simultaneously displays the display screen of the main Web conference and the display screen of the non-main Web conference. The main conference-non-main conference control device sets the microphone of the non-main Web conference to mute and displays the text data of the non-main Web conference on the display screen of the non-main Web conference.

According to the present invention, a client can participate in a plurality of Web conferences at the same time.

It is a figure which shows an example of the structure of the Web conferencing system which concerns on Embodiment 1 of this invention. It is a figure which shows an example of the display screen of the Web conference displayed in the window of a client apparatus. It is a figure which shows an example of the display screen of the Web conference displayed in the window of an external display. It is a block diagram which shows an example of the structure of a client apparatus. It is a block diagram which shows an example of the configuration of a service server. It is a flowchart which shows an example of the processing of the Web conferencing program in the client apparatus which concerns on Embodiment 1 of this invention. It is a flowchart which shows an example of the process of the Web conference service program in the Web conference service server. It is a figure which illustrates the contents of the database of the text data stored in the text conversion service server. It is a flowchart which shows an example of a text-making service program. It is a figure which shows an example of the structure of the Web conferencing system which concerns on Embodiment 2 of this invention. It is a flowchart which shows an example of the processing of the Web conferencing program in the client apparatus which concerns on Embodiment 2 of this invention. It is a figure which shows an example of the structure of the Web conferencing system which concerns on Embodiment 3 of this invention. In the web conferencing system of FIG. 11, a diagram illustrating a communication sequence between a web conferencing program of three running web conferencing, a web conferencing service program of two web conferencing service servers, and a text conversion service program of a text conversion service server. Is. It is a figure which illustrates the window of the non-main Web conference which concerns on Embodiment 4 of this invention. It is a figure which illustrates the flowchart of the text-making service program which concerns on Embodiment 4 of this invention. It is a figure which illustrates the window of the non-main Web conference which concerns on Embodiment 5 of this invention. It is a figure which illustrates the flowchart of the text-making service program which concerns on Embodiment 5 of this invention.

Hereinafter, embodiments of the present invention will be described in detail with reference to the drawings. In addition, in all the drawings for explaining the embodiment, the same members are designated by the same reference numerals in principle, and the repeated description thereof will be omitted.

(Embodiment 1)
The first embodiment will be described with reference to FIGS. 1 to 8.

<Web conferencing system>
FIG. 1 is a diagram showing an example of the configuration of the Web conferencing system according to the first embodiment of the present invention. As shown in FIG. 1, the web conferencing system SYS includes a personal computer 2, an external display 4, a network 6, a web conferencing A service server 7, a web conferencing B service server 8, and a text conversion service server (text conversion), which are client devices. Processing device) 9 and the like are provided. The window 3 of the Web conference is displayed on the display unit of the personal computer 2. The window 5 of the Web conference is displayed on the display unit of the external display 4. In the following, the Web conferencing A service server and the Web conferencing B service server may be referred to as a Web conferencing service server.

The web conferencing service servers 7 and 8 are servers that provide web conferencing to clients. The client 1 operates the personal computer 2 to access the Web conferencing service servers 7 and 8. For example, the window (display screen) 3 of the web conference A is displayed on the integrated display (display unit) 21 of the personal computer 2, and the window (display screen) 5 of the web conference B is displayed on the external display 4, for example. Will be done. As described above, in the present embodiment, the integrated display 21 of the client device and the external display 4 share and display the display screens of the plurality of Web conferences A and B in which the client 1 participates.

The text conversion service server 9 is a functional block that converts the voice of the speaker of the Web conference into text data. At that time, the text conversion service server 9 adds a time stamp to the text data. The text conversion service server 9 transmits the generated text data to the personal computer 2 (web conference program) of the participant of the corresponding web conference. Further, the text conversion service server 9 stores the generated text data in a storage device (not shown). When storing the text data, the text conversion service server 9 may also store the corresponding voice data.

The client (participant of the web conference) 1 can watch the information of each conference (image of the participant and the content of the text) displayed in the windows 3 and 5 of the web conference and the voice spoken by the participant. By speaking by himself / herself, he / she can participate in a plurality of Web conferences (for example, Web conferences A and B) at the same time.

The web conference A and the web conference B may be different web conferences provided by different web conference service companies. In this case, a plurality of Web conferencing programs are implemented in the personal computer 2. Alternatively, the web conference A and the web conference B may be different web conferences provided by one web conference service company. In this case, it is possible to set a plurality of different Web conferences with one service server and one Web conference program.

The text conversion service server 9 may be provided in common to a plurality of Web conferencing service servers. In this case, the text conversion service server 9 generates, for example, voice text data of a web conference held by a plurality of web conference service servers 7 and 8.

On the other hand, the text conversion service server 9 may be provided for each Web conference service server. In this case, the text conversion service server 9 converts only the voice of the Web conference held at the corresponding Web conference service server into text data. In the example of FIG. 1, a plurality of text conversion service servers corresponding to each of the Web conferencing service servers 7 and 8 are provided. Further, in this case, each of the Web conferencing service servers 7 and 8 may have the function of the text conversion service server.

FIG. 2A is a diagram showing an example of a display screen of a Web conference displayed in a window of a client device. In FIG. 2A, the outer frame of the window 3 is highlighted, indicating that the client 1 is the main web conference that pays close attention to and participates in the web conference A displayed in the window 3.

The image 30 of the organizer and the image 31 of the participants (for example, participants A and B) are displayed in the window 3. The frame line surrounding the image of the participant is not actually displayed on the screen, but is indicated for convenience in order to assign the reference numeral 31 to the images of the participant A and the participant B.

Further, the window 3 shows a self-portrait 32 of the client 1, a button group 33 for performing various controls such as a mute button for switching on / off of mute of the microphone and a video button for permitting transmission of the self-portrait. The border of the button group 33 is also shown for convenience and is not displayed on the actual screen. The main conference selection button 34 displayed on the upper right of the screen selects the main conference and indicates whether the Web conference on the display screen is the main conference or the non-main conference. In FIG. 2A, the main conference selection button 34 is on, indicating that the Web conference A is the main conference. In this case, the video button is turned on and the self-portrait is sent. The client 1 can transmit voice by turning off the mute button to cancel the voice mute and then speaking.

FIG. 2B is a diagram showing an example of a display screen of a Web conference displayed in a window of an external display. In FIG. 2B, the outer frame of the window 5 is not highlighted, and the Web conference B displayed in the window 5 is a non-gaze conference to the extent that the outline of the conference progress is to be grasped.

Similar to FIG. 2A, the image 50 of the organizer and the image 51 of the participants (for example, participants C to F) are displayed in the window 5. The frame line surrounding the image of the participant is not actually displayed on the screen, but is displayed for convenience in order to assign the reference numeral 51 to the images of the participants C to F.

Further, the window 5 shows a self-portrait 52 of the client 1, a button group 53 for performing various controls such as a mute button for switching on / off of mute of the microphone and a video button for permitting transmission of the self-portrait. The border of the button group 53 is also shown for convenience and is not displayed on the actual screen. The main conference selection button 60 displayed on the upper right of the screen is a button indicating whether the conference is a main conference or a non-main conference. In FIG. 2B, the main conference selection button 60 is off and shaded. This indicates that the Web conference B is not a main conference but a non-main conference.

When Web conference B is a non-main conference, the microphone is kept muted. As a result, the remarks of the client 1 do not interfere with the Web conference B of the non-main conference.

Further, in the window 5, a text box 54, a timeline bar 55, a comment text data 56, a comment display switching button 57 for switching whether or not to display a statement for each speaker, and the like are displayed. The border of the text data 56 is not displayed on the actual screen, but is displayed for convenience in order to assign the reference numeral 56 to the series of text data.

The remark display switching button 57 is provided for each participant including the organizer and the client 1, and the remark display can be switched on / off for each participant. In FIG. 2B, the remark display of Participant D and Participant F is turned off. It is possible to easily confirm the contents of the meeting by confirming the remarks of only the participants who lead the opinions at the meeting.

The timeline bar 55 shows the timeline from the start time of the Web conference to the present. In the timeline bar 55, for example, the uppermost part indicates the start time of the in-progress meeting, and the lowermost part indicates the current time of the in-progress meeting. When the client 1 moves the pointer 59 to an arbitrary position on the timeline bar 55, the text data of the statement at the corresponding time is displayed in the text box 54. As a result, the client 1 can check the content of the statement (text data) in the non-main Web conference retroactively in time.

The absence mark 58 in the timeline bar 55 is a mark indicating the absence period during which the client 1 was temporarily out of the seat due to a visitor or the like. By moving the pointer 59 to the position of the absence mark 58, the client 1 can confirm the content of the statement at the meeting at the time of absence. The absence detection process can be performed, for example, on the image of the camera 20 or the voice data of the microphone 24.

In this case, the camera 20 and the microphone 24 function as a detection device for detecting the absence of the client 1. According to this configuration, it is not necessary to newly provide a detection device, and the complexity of the configuration of the client device can be suppressed.

Switching between the main web conference to be watched and the non-watching web conference can be performed by the operation of the client 1. The client 1 selects the main conference selection button (34, 60) on the display screen of the Web conference to be the main by clicking with an input device such as a mouse.

For example, when the Web conference A in FIG. 2A is selected as the main conference and the client 1 clicks the main conference selection button 60 in FIG. 2B, the Web conference B becomes the main conference and the Web conference A becomes the non-main conference, respectively. Switch. At this time, the microphone of the Web conference A is automatically fixed to the mute state, and the microphone of the Web conference B is in a state where the mute can be released. The client 1 turns off the mute button of the button group 53 of the window 5 to cancel the voice mute, and then speaks.

<< Client device >>
FIG. 3 is a block diagram showing an example of the configuration of the client device. The client device may be a personal computer with a built-in display, a personal computer with a separate display, a tablet terminal, or the like. FIG. 3 illustrates a personal computer with a built-in display as a client device.

As shown in FIG. 3, the personal computer 2 includes a camera 20, an integrated display 21, an external display port 22, a speaker 23, a microphone 24, an input device 25 such as a keyboard and a mouse, a communication unit 26, an image RAM 27, for example, a CPU, and the like. It includes a computer 28 such as an MPU, a RAM 29, a storage device 200 such as a flash memory, and an internal bus 204.

The communication unit 26 selects an appropriate process from communication processes such as wired LAN, wireless LAN, and mobile communication, and connects to the network 6. The personal computer 2 transmits / receives information to / from the service server via the communication unit 26.

The storage device 200 includes a personal computer basic operation program 201 and a Web conference program 202 as processing programs. The web conferencing program 202 may be a plurality of programs. These processing programs are expanded in the RAM 29 and executed by the computer 28. Further, the storage device 200 is provided with a storage data area 203 for storing various data such as execution parameters necessary for executing a processing program. The storage device 200 may be a non-volatile memory medium other than the flash memory.

The computer 28 functions as a main conference-non-main conference control device or an information processing device by executing the Web conference program 202. When the Web conferencing program 202 includes a plurality of programs, each of them may be provided with a higher-level control program that controls the program.

The image data transmitted to the external display 4 via the integrated display 21 and the external display port 22 is temporarily held in the image RAM 27 and then read out.

<< Service Server >>
Next, the configurations of the Web conferencing service servers 7 and 8 and the text conversion service server 9 will be described. These servers have similar configurations for key locations. Therefore, here, these service servers are collectively referred to as a service server SVR, and unless otherwise specified, they will be described without distinction.

FIG. 4 is a block diagram showing an example of the configuration of the service server. As shown in FIG. 4, the service server SVR includes a network IF 70, a computer 71, a RAM 72, a storage 73, and an internal bus 77.

The network IF70 connects to the network 6 by selecting an appropriate process from communication processes such as a wired LAN, a wireless LAN, or a mobile communication.

The storage 73 is a storage device, and may be configured by, for example, a flash memory or a combination of a flash memory and a hard disk drive. The storage 73 stores processing programs such as the basic operation program 74 and the service program 75. The service program 75 includes a program for executing a service on the service server SVR, for example, a web conferencing service program, a text service program, and the like. These programs are expanded in the RAM 72 and executed by the CPU 71. Further, the storage 73 stores various data such as execution parameters necessary for executing the processing program as the storage data 76. The storage 73 may store a distribution program or the like to a client device such as a personal computer 2.

The storage 73 of the text conversion service server 9 stores a database of text data of the pronunciation voice of the Web conference. The database of text data will be described later.

<Web conferencing program>
FIG. 5 is a flowchart showing an example of processing of a Web conferencing program in the client device according to the first embodiment of the present invention. The process of FIG. 5 is executed for each Web conference. Here, a case where the Web conference A provided by the Web conference service server 7 is a main conference and the Web conference B provided by the Web conference service server 8 is a non-main conference will be described.

<< Main Web Conference >>
First, the control of the main conference (Web conference A) will be described. Processing is started in step S100. In step S101, the client 1 who is scheduled to participate in the Web conference receives the invitation mail from the organizer. The client 1 acquires the ID of the Web conference included in the invitation mail and participates in the Web conference (step S102). The reception of the invitation mail in step S101 may not be performed by the Web conference program 202, or may be performed by another mail program.

In step S103, the participant (client) sets resource control for the camera 20, microphone 24, and the like. These controls are performed, for example, from the button group 33 of FIG. 2A and the button group 53 of FIG. 2B. Further, in step S103, it is also set whether the conference is a main conference or a non-main conference for each participating Web conference. Whether it is a main conference or a non-main conference is set from the main conference selection button 34 in FIG. 2A and the main conference selection button 60 in FIG. 2B.

In the case of the main conference, for example, various settings are made by the client 1 from the button group 33 in FIG. 2A, but in the case of a non-main conference, the microphone is automatically muted as shown in the button group 53 in FIG. Some buttons are inactive. Further, when the conference is a non-main conference, the speech display switching button 57 is operated to set which participant's speech is displayed as text.

In step S104, it is determined whether or not the web conference executed by the web conference program is the main conference. If it is a main conference (Yes), the processes of steps S105 to S109 are performed, and if it is not a main conference (non-main conference) (No), the processes of steps S110 to S113 are performed. The processes of steps S105 to S109 and the processes of steps S110 to S113 are exclusive.

Steps S105 to S106 are processes for transmitting data to the service server SVR (for example, Web conferencing service servers 7 and 8). In step S105, the self-portrait of the client 1 is transmitted to the Web conferencing service servers 7 and 8. Further, the personal computer 2 detects the absence of the client 1 by using a camera image, voice such as speech or noise, or a combination thereof. When the absence of the client 1 is detected based on the absence detection process, the personal computer 2 notifies the text service server 9 that the client 1 is absent.

In step S106, the voice of the client 1 speaking into the microphone 24 is transmitted to the Web conferencing service server 7 and the text conversion service server 9. Since the web conference provided by the web conference service server 8 is set as a non-main conference by the client 1, the voice of the client 1 is not transmitted to the web conference service server 8.

In step S107, the personal computer 2 receives a conference image such as an image of another participant from the Web conference service server 7. In step S108, the personal computer 2 receives the conference voice (including the remarks of the organizer and other participants) from the Web conference service server 7. Here, the case where the personal computer 2 receives the conference image and the conference voice has been described, but the text data of the conference may be separately received from the text conversion service server 9.

The data transmission process (S105 to S106) and the data reception process (S107 to S108) are processes executed in parallel. In step S109, the self-portrait of the client 1 and the received conference image are displayed in the window 3 of the integrated display 21, and the received conference voice is output from the speaker 23. Further, the text data received from the text conversion service server 9 may be displayed in the window 3.

In step S114, the personal computer 2 confirms whether the client 1 has left the Web conference. If the client 1 has not left the Web conference (No), the process returns to step S103 and the subsequent processes are executed. On the other hand, when the client 1 leaves the Web conference (Yes), the process proceeds to step S115, and the Web conference program ends.

<< Non-main meeting >>
Next, the control of the non-main conference (Web conference B) will be described. Steps 100 to S104 are as described above. Step S110 is a process of transmitting data to the web conferencing service server 8, and transmits the self-portrait of the client 1 to the web conferencing service server 8. The self-portrait of the client 1 is taken by the camera 20 of the personal computer 2, and is the same image as in the case of step S105. Alternatively, it may be something like a still image or an avatar of the person.

Steps S111 to S112 are processes for receiving data from the Web conferencing service server 8. In step S111, the personal computer 2 receives a conference image such as an image of another participant or a displayed material from the Web conference service server 8. In step S112, the personal computer 2 receives the text data of the conference voice from the text conversion service server 9.

In step S113, the personal computer 2 displays the client's self-portrait, the received conference image, and the text data of the conference voice on the window 5 of the external display 4. Further, the personal computer 2 retroactively displays the text data of the non-main Web conference in the text box 54 of the window 5 of the non-main Web conference based on the time stamp.

If the non-main conference is changed to the main conference in the middle of the conference, the display screen may or may not be replaced between the integrated display 21 and the external display 4. In this case, for example, the content of FIG. 2A is displayed on the external display 4, and the content of FIG. 2B is displayed on the integrated display 21. The processing after step S114 is as described above.

<Web conferencing service program>
FIG. 6 is a flowchart showing an example of processing of the Web conferencing service program in the Web conferencing service server. Processing is started in step S120. The Web conferencing service program executes a plurality of processes Ps1, Ps2, ..., Psn in parallel according to the number of participating clients.

In step S121, the web conferencing service server (7, 8) performs a reception process based on the web conferencing participation request from the client 1. In the reception process, the Web conference service server (7, 8) confirms the conference ID and the control design of the conference. When the reception process is completed, the Web conferencing service server (7, 8) receives the camera image in step S122 and the speech voice in step S123.

Then, the Web conferencing service server (7, 8) receives the display image data obtained by synthesizing the images of other participants in step S124, and the voices of other participants including the organizer in step S125. It is transmitted to each of the Web conferencing programs (personal computer 2) of 1. When the text conversion service server 9 is provided, the web conferencing service server (7, 8) generates text data of the generated voices of the participants including the organizer and the client 1, and the web conferencing of the client 1. Send to the program (personal computer 2).

In step S126, the Web conferencing service server (7, 8) confirms that the corresponding client (1) has left the room. If the corresponding client has not left the room (No), the process returns to step S122, and the subsequent processing is executed. On the other hand, when the corresponding client leaves the room (Yes), the process proceeds to step S115.

In step S127, the web conferencing service server (7, 8) confirms whether or not all the clients have left. If there is a client that has not left (No), the process of step S127 is repeatedly executed. On the other hand, when all the clients leave (Yes), the process proceeds to step S128, and the Web conference service server (7, 8) ends the Web conference.

The web conferencing service server (7, 8) executes processes Ps1, Ps2, ..., Psn in parallel, and sends / receives data to / from the personal computer (client device) of each client.

<Text data>
FIG. 7 is a diagram illustrating the contents of a database of text data stored in a text conversion service server. In the database T1 shown in FIG. 7, the line R0 is the conference ID corresponding to the text data (for example, "Dpjn12jp"), the conference host city (organizer's location, for example, "Tokyo"), and the conference language (for example, "Japanese"). ), And the conference information header such as date.

The item name of each column is shown in row R1. In FIG. 7, for example, a “time stamp”, a “speaker”, and a “speaking content” indicating the speaking time are shown as item names. Text data is recorded after line R2. These records are made in order of speaking time.

<Text conversion service program>
FIG. 8 is a flowchart showing an example of a text conversion service program. Processing is started in step S130. The text conversion service program executes a plurality of processes Pt1, Pt2 to Ptn in parallel according to the number of clients.

In step S131, the reception process is performed based on the request from the client 1. In the reception process, the conference ID and the conference control settings are confirmed. When the reception process is completed, the text conversion service server 9 performs the process of transmitting / receiving data to / from the client device in steps S132 to S135 and the process of converting the remarks in steps S136 to S139 into text (text data generation) in parallel. And execute.

In step S132, the text conversion service server 9 receives a transmission request for text conversion data from the client device. The transmission request includes, for example, a speech time, a speaker, and the like. If there is no particular request for transmission, the latest data may be sent in real time.

In step S133, the text conversion service server 9 reads the text data corresponding to the speech time instructed by the client from the database T1. Further, the text conversion service server 9 may generate a text image based on the read text data (step S134). At this time, a time stamp bar is added to the text image. Further, when the information indicating the absence period of the client is received, the text conversion service server 9 adds the information of the absence period to the text data or generates a text image including the information indicating the absence period. In step S135, the text conversion service server 9 transmits the read text data (S133) or the generated text image (S134) to the client device that made the transmission request.

In step S136, the text conversion service server 9 receives a speech reception request from each client, and receives the speech voice of each client in step S137. Then, the text conversion service server 9 converts the speech voice into text, assigns each information such as the speech time and the speaker to the text data (step S138), and stores the text data and the imparted information in the database T1. Is updated (step S139).

In step S140, the text conversion service server 9 confirms that the corresponding client has left the Web conference. If the corresponding client has not left the room (No), the process returns to S132 and S136, respectively, and the subsequent processes are executed. On the other hand, when the corresponding client leaves the room (Yes), the process proceeds to step S141.

In step S141, the text conversion service server 9 confirms whether or not all the clients have left. If there is a client that has not left (No), the process of step S141 is repeatedly executed. On the other hand, when all the clients leave (Yes), the process proceeds to step S142, and the text conversion service server 9 terminates the text conversion service program.

Although an example of adding information indicating the absence period of the client to the text data is shown in step S134, this processing may be performed by the client device that has detected the absence period. Further, in the client device, based on the time stamp of the text data, the period may be displayed in the time stamp bar so as to be known.

Here, the case where the text conversion service program is provided from the independent text conversion service server 9 has been described as an example, but the function of the text conversion service server 9 is implemented in the Web conference service server 7, 8 or the client device. It does not matter if it is in the form of a server.

According to the present embodiment, interference of remarks does not occur between a plurality of Web conferences, and it is possible to retroactively confirm the remarks missed by the client 1. Therefore, the client 1 can participate in a plurality of Web conferences at the same time.

(Embodiment 2)
Next, the second embodiment will be described with reference to FIGS. 9 to 10. In the following, the matters described in the above-described embodiment will be omitted in principle. Also in this embodiment, the screens of the Web conference described with reference to FIGS. 2A to 2B, the personal computer 2 described with reference to FIGS. 3 to 4, and the service server SVR are commonly applied.

FIG. 9 is a diagram showing an example of the configuration of the Web conferencing system according to the second embodiment of the present invention. FIG. 9 is similar to FIG. 1, in which the external display 4 is replaced with a second client device 10 such as a smartphone. The second client device 10 is a device independent of the personal computer 2 which is the first client device. For example, the window 5a of the Web conference B is displayed on the display unit of the second client device 10. As described above, in the present embodiment, a plurality of client devices used by the same client 1 are provided, and the display screens of the plurality of Web conferences A and B are displayed on the display units of different client devices.

FIG. 10 is a flowchart showing an example of processing of a Web conferencing program in the client device according to the second embodiment of the present invention. FIG. 10 is similar to FIG. 5, and has a flow in which steps S150 to S151 are added between steps S102 and S103, and steps S152 are added between steps S104 and S110.

In step S150, the client devices (2, 10) determine whether or not the client has selected the main conference. When the main conference selection is made (Yes), the client device sends a main status indicating that the main conference selection has been made to other client devices used by the same client for the Web conference (Yes). Step S151). The other client device that received the main status sets the corresponding web conference to the non-main conference.

In this way, each client device can acquire information indicating whether the Web conference in the other client device is the main conference or the non-main conference. As a result, it is not set as a plurality of main conferences, and problems such as interference between Web conferences do not occur.

On the other hand, if the client does not select the main conference in step S150 (No), the process proceeds to step S103.

If all the web conferences in which the client participates are shared by the same web conference service server, the main status may be transmitted via the web conference service server.

In addition, a plurality of client devices for Web conferencing owned by the client may be registered and authenticated in advance so that the main status can be transmitted and received.

For example, when a client participates in a web conference using a smartphone or the like, it is assumed that the client cannot be caught in front of the client device. For example, if the smartphone is placed on a desk, the camera will point toward the ceiling instead of toward the client. Therefore, in step S152, the client device 10 such as a smartphone may receive, for example, a camera image of a stably installed client device such as a personal computer 2.

Then, in step S110, the client device 10 transmits the received camera image as the client image to the Web conferencing service servers 7 and 8. Also here, the camera image may be switched at the same time as the main status is switched by the authentication between the client devices of the client.

According to this embodiment, since a plurality of client devices are connected to the Web conferencing system SYS, it is possible to reduce the load on each client device.

(Embodiment 3)
Next, the third embodiment will be described with reference to FIGS. 11 to 12. In this embodiment, a case of participating in a plurality of Web conferences by using one client device will be described.

FIG. 11 is a diagram showing an example of the configuration of the Web conferencing system according to the third embodiment of the present invention. FIG. 11 is similar to FIG. 1, in which the external display 4 is deleted from FIG. 1, and a plurality of Web conference screens are displayed on the integrated display 21 of the personal computer 2.

As shown in FIG. 11, the integrated display 21 displays the window 3 of the web conference A1, the window 5b of the web conference A2, and the window 5c of the web conference B. That is, in the example of FIG. 11, the client 1 participates in three Web conferences.

Web conferencing A1 and A2 are web conferencing provided by the same web conferencing service server 7, and web conferencing B is a web conferencing provided by the web conferencing service server 8.

Here, it is assumed that the main conference that the client 1 pays attention to is the Web conference A1, and the window 3 is displayed larger than the windows 5b and 5c of the other Web conference (non-main conference). Alternatively, the window 3 of the main conference may be displayed in the foreground.

As described above, in the present embodiment, the client 1 uses only one client device. Then, the integrated display (display unit) 21 of the client device displays each display screen of the plurality of Web conferences in which the client 1 participates.

FIG. 12 shows a communication sequence between the web conferencing program of the three running web conferencing in the web conferencing system of FIG. 11, the web conferencing service program of the two web conferencing service servers, and the text conversion service program of the text conversion service server. It is a figure exemplifying.

The web conferencing program (web conferencing program application) installed in the client device can connect (participate) to multiple web conferencing at the same time, and can be used as a main conference web conference program and a non-main conference web conference program. Can be controlled to switch between.

For example, when the client selects the Web conference A1 as the main conference, the information that the Web conference A1 is mainly selected is notified to the Web conference A service program, the Web conference B service program, and the text conversion service program, respectively. ..

The web conferencing A1 program, web conferencing A2 program, and web conferencing B program on the client device side transmit the self-portrait and speech voice of the client 1 to the corresponding web conferencing service program. Further, the Web conference A1 program, the Web conference A2 program, and the Web conference B program transmit the speech voice of the client 1 to the text conversion service program.

The Web conference A service program transmits the conference image and the conference voice of the Web conference A1 toward the Web conference A1 program which is the main conference. The Web conference A1 program displays the received conference image of the Web conference A1 in the window 3, and outputs the received conference voice from the speaker 23. Further, the Web conference A1 program may receive the text data of the Web conference A1 from the text conversion service program and display it in the window 3.

Next, the web conferencing A service program and the web conferencing B service program notify the corresponding web conferencing A2 program and the web conferencing B program that the web conferencing A2 and B are non-main conferences, and are non-main. Send the conference image for the conference. Further, the text conversion service program transmits the text data of the conference voices of the Web conferences A2 and B to the corresponding Web conference A2 program and the Web conference B program. The Web conference A2 program and the Web conference B program display the received text data in windows 5b and 5c, respectively.

Next, when the client 1 selects the web conference B as the main conference, the information that the web conference B is mainly selected is notified to the web conference A service program, the web conference B service program, and the text conversion service program. Will be done.

The web conferencing A1 program, web conferencing A2 program, and web conferencing B program on the client device side continue to transmit self-portraits and speech voices to the corresponding web conferencing A service program and web conferencing B service program. Further, the Web conference A1 program, the Web conference A2 program, and the Web conference B program continue to transmit the speech voice of the client 1 to the text conversion service program.

The Web conference B service program transmits the conference image and the conference voice to the Web conference B program corresponding to the Web conference B which is the main conference. The client device displays the window 5c of the Web conference B, which is the main conference, in a large size, and outputs the sound of the Web conference B.

Further, the web conference A service program notifies the web conference A1 program and the web conference A2 program that the web conferences A1 and A2 are non-main conferences, and transmits the conference images of the web conferences A1 and A2, respectively. .. Further, the text conversion service program transmits the text data of the conference voices of the Web conferences A1 and A2 to the Web conference A1 program and the Web conference A2 program, respectively.

The windows 3 and 5b of the Web conferences A1 and A2 are displayed smaller than the windows 5c of the main conference or displayed at a position other than the front.

According to the present embodiment, one client device can control gaze control for a plurality of Web conferences across a plurality of Web conference programs.

(Embodiment 4)
Next, the fourth embodiment will be described with reference to FIGS. 13 to 14. In this embodiment, a method of highlighting keywords that frequently appear in a meeting will be described. In the following, the Web conferencing system of FIG. 1 will be described as an example, but in the present embodiment, the configuration of the Web conferencing system is not particularly limited.

FIG. 13 is a diagram illustrating a window of a non-main conference according to the fourth embodiment of the present invention. FIG. 13 is similar to FIG. 2, but in the text box 54 of FIG. 13, “environmental protection” repeatedly spoken by a plurality of speakers in the Web conference B is highlighted as the keyword 61. By highlighting frequently-used keywords in this way, it is possible to easily grasp what kind of content is being discussed in the non-main Web conference B.

FIG. 14 is a diagram illustrating a flowchart of a text service program according to the fourth embodiment of the present invention. FIG. 14 is similar to FIG. 8, and step S160 is added between steps S133 and S134.

In step S160, the text conversion service program extracts words that are repeatedly spoken as keywords from the text data of the conference remarks read from the database T1 in step S133. Then, the text conversion service program adds information for highlighting the extracted keyword to the text data. Examples of the highlighting method include displaying the keyword in bold, underlining the keyword, changing the color of the keyword, and blinking the keyword.

According to this embodiment, it is possible to easily grasp what is being talked about in a non-main Web conference that is not being watched.

(Embodiment 5)
Next, the fifth embodiment will be described with reference to FIGS. 15 to 16. FIG. 15 is a diagram illustrating a window of a non-main conference according to the fifth embodiment of the present invention.

In the present embodiment, when the agenda (or keyword) of interest to the client 1 is registered in advance and it is detected from the text data 56 that the web conference of the registered agenda is started in the non-main web conference, the client Notified to 1.

Client 1 refers to the screen of FIG. 15 and presses the keyword registration button to register the agenda of interest, for example, "budget proposal". The keyword registration screen will be deleted after registration is completed. When the keyword "budget proposal" is detected in the text data 56 of the conference remark, the client device (web conference program) displays the notification image 63 urging the client 1 to participate in the web conference.

Further, for example, by registering the agenda of the meeting of interest in the keyword, the notification image 63 is displayed even when the meeting shifts to the agenda of interest, and the client 1 can easily participate in the meeting. .. Alternatively, the non-main conference may be automatically switched to the main conference.

FIG. 16 is a diagram illustrating a flowchart of a text service program according to the fifth embodiment of the present invention. FIG. 16 is similar to FIG. 8, and step S170 is added between steps S131 and S132, and between steps S131 and S136. Further, in FIG. 16, steps S171-S172 are executed in parallel with steps S134-S135.

In step S170, the text conversion service server (text conversion service program) 9 receives the keyword registered in advance in the client device. As a result, the keyword is registered in the text conversion service server 9.

In step S171, the text conversion service program performs a keyword detection process registered in step S170 on the text data read from the database T1. When the keyword is detected, the text conversion service program transmits the keyword match notification image data prompting the client 1 to participate in the conference to the Web conference program (step S172).

When converting the conference remarks into text in the client device, the client device (Web conference program) registers the keyword in the client device and displays the notification image 63 when the keyword is detected.

According to this embodiment, when a meeting of an agenda (keyword) of interest is held in a non-main Web meeting, this meeting can be changed to the main meeting.

Although the invention made by the present inventor has been specifically described above based on the embodiment, the present invention is not limited to the above embodiment and can be variously modified without departing from the gist thereof. For example, the above-described embodiments have been described in detail in order to explain the present invention in an easy-to-understand manner, and are not necessarily limited to those having all the described configurations. Further, it is possible to replace a part of the configuration of one embodiment with the configuration of another embodiment, and it is also possible to add the configuration of another embodiment to the configuration of one embodiment. .. Further, it is possible to add / delete / replace a part of the configuration of each embodiment with another configuration.

All of these belong to the category of the present invention, and the numerical values and messages appearing in the text and figures are merely examples, and even if different ones are used, the effect of the present invention is not impaired.

Further, the functions and the like of the invention may be implemented by hardware, for example, by designing a part or all of them by an integrated circuit. Further, it may be implemented by software by interpreting and executing an operation program by a microprocessor unit, a CPU, or the like. Further, the implementation range of the software is not limited, and the hardware and the software may be used together.

1 ... Client, 2, 10 ... Client device, 4 ... External display, 3, 5, 5a, 5b, 5c ... Web conference window, 6 ... Network, 7, 8 ... Web conference service server, 9 ... Text conversion service server , 53 ... Button group, 54 ... Text box, 55 ... Timeline bar, 56 ... Text data, 57 ... Speak display switching button, 58 ... Absence mark, 202 ... Web conference program, 75 ... Service program.

Claims (20)

1. A text processing device that generates text data from the voice of a speaker in a web conference,
   A main conference-non-main conference control device that distinguishes between a main web conference in which a client gazes and participates and a non-main web conference in which the client participates without gaze.
   A display unit that simultaneously displays the display screen of the main web conference and the display screen of the non-main web conference, and
   Equipped with
   The main conference-non-main conference control device sets the microphone of the non-main Web conference to mute, and displays the text data of the non-main Web conference on the display screen of the non-main Web conference.
   Web conferencing system.
2. In the Web conferencing system according to claim 1,
   The text conversion processing device adds a time stamp to the text data, and the text data is added with a time stamp.
   The main conference-non-main conference control device retroactively displays the text data of the non-main Web conference on the display screen of the non-main Web conference based on the time stamp.
   Web conferencing system.
3. In the Web conferencing system according to claim 2,
   The main conference-non-main conference control device displays the text data of the speaker selected by the client on the display screen of the non-main Web conference.
   Web conferencing system.
4. In the Web conferencing system according to claim 2,
   Equipped with a detection device that detects the absence of the client
   When the detection device detects the absence of the client,
   The main conference-non-main conference control device displays the absence period of the client on the display screen of the non-main Web conference.
   Web conferencing system.
5. In the Web conferencing system according to claim 1,
   The main conference-non-main conference control device displays a main conference selection button for switching between the main Web conference and the non-main Web conference on the display screen.
   Web conferencing system.
6. In the Web conferencing system according to claim 1,
   Equipped with one client device used by the client
   The main conference-non-main conference control device displays the display screen of each of the plurality of Web conferences in which the client participates on the display unit of the client device.
   Web conferencing system.
7. In the Web conferencing system according to claim 1,
   One client device used by the client and
   An external display connected to the client device and
   Equipped with
   The main conference-non-main conference control device causes the display unit of the client device and the external display to share and display the display screens of the plurality of Web conferences in which the client participates.
   Web conferencing system.
8. In the Web conferencing system according to claim 1,
   It is equipped with a plurality of client devices used by the same client.
   The main conference-non-main conference control device displays the display screens of a plurality of the Web conferences on different display units of the client equipments, and the Web conference in each client device is the main Web conference. Acquires information indicating whether the conference is the non-main web conference.
   Web conferencing system.
9. In the Web conferencing system according to claim 1,
   The text conversion processing device extracts keywords that frequently appear in the Web conference, and imparts information for highlighting the extracted keywords to the text data.
   Web conferencing system.
10. In the Web conferencing system according to claim 1,
    The text processing device registers the agenda of interest to the client and notifies the client when it detects that the web conferencing of the registered agenda has started in the non-main web conferencing.
    Web conferencing system.
11. A process of distinguishing between a main web conference in which a client gazes and participates and a non-main web conference in which the client participates without paying attention, and a process of setting the microphone of the non-main web conference to mute.
    The process of displaying the text data generated from the voice of the speaker of the non-main Web conference on the display screen of the non-main Web conference, and
    Is executed by the information processing device,
    Web conferencing program.
12. In the web conferencing program according to claim 11.
    Based on the time stamp given to the text data, the information processing apparatus causes the information processing apparatus to execute a process of displaying the text data of the non-main Web conference on the display screen of the non-main Web conference by going back in time.
    Web conferencing program.
13. In the web conferencing program according to claim 12.
    The information processing apparatus causes the information processing apparatus to execute a process of displaying the text data of the speaker selected by the client on the display screen of the non-main Web conference.
    Web conferencing program.
14. In the web conferencing program according to claim 12,
    Absence detection processing that detects the absence of the client and
    The process of displaying the absence period of the client on the display screen and
    Is executed by the information processing apparatus.
    Web conferencing program.
15. In the web conferencing program according to claim 11.
    The information processing apparatus causes the information processing apparatus to execute a process of displaying the main conference selection button for switching between the main Web conference and the non-main Web conference on the display screen.
    Web conferencing program.
16. In the web conferencing program according to claim 11.
    The information processing apparatus causes the display unit of one client device to execute a process of displaying the display screen of each of the plurality of Web conferences in which the client participates.
    Web conferencing program.
17. In the web conferencing program according to claim 11.
    The information processing device causes the information processing device to share and display the display screens of a plurality of the Web conferences in which the client participates in the display unit of one client device and the external display connected to the client device. ,
    Web conferencing program.
18. In the web conferencing program according to claim 11.
    It is equipped with a plurality of client devices used by the same client.
    A process in which the main conference-non-main conference control device displays the display screens of the plurality of Web conferences on the display units of a plurality of client devices used by the same client.
    A process in which the main conference-non-main conference control device acquires information indicating the main or non-main of the Web conference in each of the client devices.
    Is executed by the information processing apparatus.
    Web conferencing program.
19. In the web conferencing program according to claim 11.
    Based on the information given to the text data to highlight the keywords frequently appearing in the Web conference, the information processing apparatus executes the process of highlighting the keywords.
    Web conferencing program.
20. In the web conferencing program according to claim 11.
    When it is detected that the Web conference on the agenda of interest to the registered client is started in the non-main Web conference, the information processing apparatus causes the information processing apparatus to execute a process of notifying the client.
    Web conferencing program.

Images