JP2010199906A - Video conference apparatus, video conference system, video conference control method, and program of video conference apparatus - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide a video conference apparatus, a video conference system, a video conference control method and a program of the video conference apparatus, for not obstructing the tempo of conversations. <P>SOLUTION: When main processing is executed, a priority order table is acquired (S11) and voice data elimination processing is activated (S12). Then, when voice data is received (S14:YES), the voice data is stored (S16). When other voice data is being output (S17:YES), voice data information relating to the voice data is stored (S18). When there is the voice data delayed for T1 time or longer within the stored voice data (S19:YES), "1" is set to the value of the invalidation flag of the pertinent voice data information (S20). Then, output order setting processing is performed (S21), and when there is the voice data that can be output (S22:YES), the voice data whose output order is the first is output (S24). <P>COPYRIGHT: (C)2010,JPO&INPIT

Description

  The present invention relates to a video conference device, a video conference system, a video conference control method, and a program for the video conference device, and in particular, a video conference device, a video conference system, and a video conference control method that do not disturb the tempo of conversation. And a program of the video conference apparatus.

  2. Description of the Related Art Conventionally, a communication control device is known in which a plurality of communication devices at remote locations are connected to the same video conference system, as if they are holding a conference at the same location (see, for example, Patent Document 1). . According to the communication control device described in Patent Literature 1, call information transmitted from a plurality of communication devices is received, and the received call information is recorded. Then, when there is a portion that overlaps in time among the recorded call information, the priority of the timing for outputting the call information is set. Then, the call information is output while being shifted in time based on the set priority. Thereby, even if it is a case where a some user speaks simultaneously, each remark can be easily heard and comfortable communication can be aimed at.

JP 2002-232576 A

  However, in the communication control device of the invention described in Patent Document 1, when there is a time overlap, the conversation information is delayed because the call information of each user is reproduced in sequence with a time delay according to the priority. There was a problem of being played back and hindering the conversation tempo.

  Accordingly, the present invention has been made to solve the above-described problems, and provides a video conference apparatus, a video conference system, a video conference control method, and a video conference apparatus program that do not disturb the tempo of conversation. Objective.

In order to achieve the above object, a video conference apparatus according to a first aspect of the present invention is a video conference apparatus that controls a video conference that is performed via a network among a plurality of terminal apparatuses, from the terminal apparatus. Voice data receiving means for receiving voice data from the transmitted utterance, and when the voice data receiving means receives the voice data from the terminal apparatus, the voice data received from the other terminal apparatus is being output. Output judging means for judging whether or not,
Priority order for storing the terminal identification information for identifying the terminal apparatus that has transmitted the voice data and the priority order indicating the priority order for outputting the voice data to the terminal apparatus in association with each other. When the information storage means and the output determination means determine that the audio data received from the other terminal device is being output, based on the priority information stored in the priority information storage means The voice data received by the voice data receiving means, the reception start time that is the time when reception of the voice data is started, and the output that is the order information for outputting the voice data to the terminal device The rank and the terminal identification information for identifying the terminal device that has transmitted the voice data are associated with each other and stored as voice data information in the voice data information storage means. Voice data information storage control means, voice data output means for outputting the voice data to the plurality of terminal devices performing data communication in the video conference, and the voice data information stored in the voice data information storage means In the audio data output means, the audio data information that has not been output to the terminal device includes the audio data information that has passed a first predetermined time from the reception start time of the audio data information. A first determination unit that determines whether the audio data information that has passed the first predetermined time from the reception start time of the audio data information is present by the first determination unit; A first deletion unit that deletes the audio data information after a predetermined time has elapsed from the audio data information storage unit, and the audio data output unit The voice data corresponding to the highest output order of the voice data information stored in the voice data information storage means is sent to the plurality of terminal devices performing data communication in the video conference. It is characterized by outputting.

  According to a second aspect of the present invention, in addition to the configuration of the first aspect of the invention, in the audio data information stored in the audio data information storage unit, the audio data output unit may Second judgment means for judging whether or not the voice data information having a shorter output time of the voice data of the voice data information than a second predetermined time exists among the voice data not outputted to the terminal device; When the second determination means determines that the audio data information is shorter than the second predetermined time, the output of the audio data is shorter than the second predetermined time. First output rank update means for updating the output rank of the audio data information corresponding to time to the highest rank.

  According to a third aspect of the present invention, in addition to the configuration of the first or second aspect, the audio data output means starts outputting the audio data to the plurality of terminal devices. The terminal identification information corresponding to the priority higher than the priority corresponding to the terminal identification information identifying the terminal apparatus that has transmitted the audio data being output before the third predetermined time has elapsed It is determined that the voice data is received by the third judgment means, and third judgment means for judging whether or not the voice data is received by the voice data receiving means from the terminal device specified by If the audio data is stored in the audio data storage means, the audio data information corresponding to the audio data being output is deleted from the audio data storage control means. 2 When the voice data is stored in the voice data storage means, the output order corresponding to the received voice data when the voice data is judged to have been received by the deletion means and the third judgment means Is updated to the highest output rank.

  According to a fourth aspect of the present invention, in addition to the configuration of the first aspect of the present invention, the audio data output unit may be configured to transmit the audio data to a plurality of the terminal devices. The terminal corresponding to the priority higher than the priority corresponding to the terminal identification information for identifying the terminal device that has transmitted the audio data being output after the fourth predetermined time has elapsed since the output was started The voice data receiving means determines whether or not the voice data has been received from the terminal device specified by the identification information, and the voice data being output by the fourth judgment means Receiving the voice data from the terminal device identified by the terminal identification information corresponding to the priority higher than the priority corresponding to the terminal identification information identifying the terminal device transmitting A fifth determination means for determining whether or not a fifth predetermined time has elapsed since it was determined that the voice data was received at the stage, and a fifth after the voice data was received by the fifth determination means. When it is determined that a predetermined time has elapsed, in the audio data information stored in the audio data storage means, the audio data information corresponding to the audio data being output is deleted from the audio data storage control means. 3. When it is determined that the fifth predetermined time has passed since the voice data is received by the deletion means and the fifth judgment means, the voice data information stored in the voice data storage means is received. And a third output rank update means for updating the output rank corresponding to the audio data to the highest output rank.

  According to a fifth aspect of the present invention, there is provided a video conference system according to the first aspect of the present invention, the output unit that outputs the audio data output from the video conference apparatus, and the television controlled by the video conference apparatus. A video conference system including the terminal device including a display unit that displays image data used in a conference, wherein the video conference device includes the audio data information stored in the audio data storage unit. An output order transmitting means for transmitting an output order to the terminal device specified by the terminal identification information corresponding to the output order, wherein the terminal apparatus is the output order transmitting means of the video conference device; An output rank receiving means for receiving the output rank transmitted, and the output rank is notified based on the output rank received by the output rank receiving means. The information and an output order display control means for displaying on the display unit.

A video conference control method according to a sixth aspect of the present invention is a video conference control method for controlling a video conference performed between a plurality of terminal devices via a network, and an utterance transmitted from the terminal device. Voice data receiving step for receiving voice data according to the above, and whether or not the voice data received from another terminal device is being output when the voice data is received from the terminal device in the voice data receiving step An output determination step for determining whether or not
Priority order for storing the terminal identification information for identifying the terminal apparatus that has transmitted the voice data and the priority order indicating the priority order for outputting the voice data to the terminal apparatus in association with each other. When it is determined in the information storage means and the output determination step that the audio data received from another terminal device is being output, based on the priority information stored in the priority information storage means The voice data received in the voice data reception step, the reception start time that is the time when reception of the voice data is started, and the output that is the order information for outputting the voice data to the terminal device The rank and the terminal identification information for identifying the terminal device that transmitted the voice data are associated with each other and recorded as voice data information in the voice data information storage means. A voice data information storage control step, a voice data output step of outputting the voice data to a plurality of the terminal devices performing data communication in the video conference, and the voice data stored in the voice data information storage means In the information, does the voice data information that has not been output to the terminal device by the voice data output means includes the voice data information that has passed a first predetermined time from the reception start time of the voice data information? A first determination step for determining whether or not there is the audio data information that has passed the first predetermined time from the reception start time of the audio data information in the first determination step; A first deletion step of deleting the audio data information after a predetermined time has elapsed from the audio data information storage means; The audio data output step performs data communication in the video conference for the audio data corresponding to the output order with the highest output order of the audio data information stored in the audio data information storage means. Output to the plurality of terminal devices.

  According to a seventh aspect of the present invention, there is provided a video conference device program that causes a computer to function as various processing means of the video conference device according to any one of the first to fourth aspects.

  In the video conference device according to claim 1, whether or not the audio data received from another terminal device is being output when the voice data from the terminal device connected to the video conference conducted via the network is received. Output judging means for judging whether or not. When the output determination means determines that the audio data received from another terminal device is not being output, the terminal identification information and the received information are received according to the priority order of each terminal device stored in the priority order information storage means. Audio data information in which audio data, output order, reception start time, and output order are associated is stored in the audio data information storage means. Further, when there is audio data that has passed the first predetermined time from the reception start time among the audio data that has not been output, the audio data is deleted by the first deletion means. The voice data output means is configured to send voice data corresponding to the voice data information having the highest output order among the voice data information stored in the voice data information storage means to a plurality of terminals performing data communication in the video conference. Output. Thereby, the video conference apparatus determines the output order of the received audio data according to the priority order determined in advance. And it can output in order from the audio | voice data with a high output order with respect to each terminal device connected to the video conference. Further, since the audio data delayed for the first predetermined time which is the predetermined time is deleted, it is not output. As a result, the audio data is not output more late than necessary, and the possibility of hindering the conversation tempo during a video conference can be reduced.

  In the video conference apparatus according to claim 2, in addition to the effect of the invention according to claim 1, in the audio data that has not been output, does the audio data output time be shorter than the second predetermined time? Second determining means for determining whether or not is provided. In addition, when it is determined that there is audio data whose output time is shorter than the second predetermined time among the audio data not output by the second determining means, it corresponds to the audio data shorter than the second predetermined time. First output rank update means for updating the output rank to be performed to the highest rank. As a result, audio data having an output time shorter than the second predetermined time is output simultaneously with other audio data. As a result, it is possible to incorporate a short utterance such as a match made by a participant in the video conference into an utterance made in the video conference, thereby promoting a more natural conversation.

  In the video conference device according to claim 3, in addition to the effect of the invention according to claim 1 or 2, a third predetermined time after the audio data output means starts outputting audio data to the plurality of terminal devices. 3rd judging means for judging whether or not voice data has been received from a terminal device corresponding to a priority higher than the priority corresponding to the terminal device that has transmitted the voice data being output before ing. Further, when it is determined by the third determination means that the voice data has been received, second deletion means for deleting the voice data information corresponding to the voice data being output in the voice data information stored in the voice data storage means. It has. Further, when it is determined that the voice data has been received by the third determining means, the output rank corresponding to the received voice data is updated to the highest output rank in the voice data information stored in the voice data storage means. Second output rank update means is provided. As a result, even when other audio data is being output in the video conference, the audio data transmitted from the terminal device having a higher priority is preferentially output. As a result, it is possible to output the speech of the user of the terminal device having a high priority determined in advance in the video conference without delay.

  In the video conference apparatus according to claim 4, in addition to the effect of the invention according to any one of claims 1 to 3, the audio data being output after the fourth predetermined time has elapsed since the output of the audio data was started. And a fifth determination means for determining whether or not a fifth predetermined time has elapsed since it was determined that the audio data was received from the terminal device corresponding to a higher priority than the priority corresponding to the terminal device that transmitted ing. In addition, when the fifth determination unit determines that the fifth predetermined time has elapsed since the reception of the audio data, the third determination unit includes a third deletion unit that deletes the audio data information corresponding to the audio data being output. Yes. And a third output order update means for updating the output order corresponding to the received audio data to the highest output order when the fifth determination means determines that the fifth predetermined time has elapsed. Yes. As a result, if the audio data transmitted from the terminal device with the lower priority is being output in the video conference for a predetermined time or longer, the audio data transmitted from the terminal device with the higher priority is the fifth from the reception start time. It is output after a predetermined time has elapsed. As a result, audio data transmitted from a terminal device with a high priority and having an output time of a predetermined time or more can be output with a small delay.

  According to a fifth aspect of the present invention, there is provided a video conference system according to the first aspect of the present invention, and a terminal device including an output unit that outputs audio data and a display unit that displays image data used in the video conference. It is configured. The video conference apparatus includes an output order transmitting means for transmitting the output order to the terminal device specified by the terminal identification information corresponding to the output order. Also, the terminal device receives the output rank transmitted by the output rank transmission means by the output rank reception means, and outputs information indicating that the output rank is notified based on the received output rank by the output rank display control means. Display on the display. Thereby, the user who uses a terminal device can know the order in which his / her speech is output, and can grasp whether or not his / her speech has a delay.

  In the video conference control method according to claim 6, whether voice data received from another terminal device is being output when voice data by utterance is received from a terminal device connected to the video conference performed via the network. An output judging step for judging whether or not is provided. If it is determined in the output determination step that the voice data received from another terminal device is not being output, the terminal identification information and the received information are received according to the priority order of each terminal device stored in the priority order information storage means. Audio data information in which audio data, output order, reception start time, and output order are associated is stored in the audio data information storage means. Further, if there is audio data that has passed the first predetermined time from the reception start time among the audio data that has not been output, the audio data is deleted in the first deletion step. In the audio data output step, the audio data corresponding to the audio data information having the highest output order among the audio data information stored in the audio data information storage means is transmitted to a plurality of terminals performing data communication in the video conference. Output. Thereby, the video conference apparatus determines the output order of the received audio data according to the priority order determined in advance. And it can output in order from the audio | voice data with a high output order with respect to each terminal device connected to the video conference. Further, since the audio data delayed for the first predetermined time which is the predetermined time is deleted, it is not output. As a result, the audio data is not output more late than necessary, and the possibility of hindering the conversation tempo during a video conference can be reduced.

  The program of the video conference apparatus according to claim 7 causes the computer to function as various processing means of the video conference apparatus according to claim 1. Therefore, the effect of the invention according to any one of claims 1 to 4 can be achieved by causing a computer to execute the program of the video conference apparatus.

It is a figure which shows an example of the connection form of the video conference system. 2 is a block diagram showing an electrical configuration of the video conference apparatus 100. FIG. 3 is a schematic diagram showing a configuration of an audio data table 1100. FIG. 3 is a schematic diagram illustrating a configuration of a storage area of an HDD 104 of the video conference apparatus 100. FIG. 3 is a schematic diagram showing a configuration of a priority table 1200. FIG. 3 is a block diagram showing an electrical configuration of a terminal device 200. FIG. It is a figure which shows one specific example of the video conference screen 271 displayed on the monitor 270 of the terminal device 200. 4 is a flowchart of main processing executed by the video conference apparatus 100. 10 is a flowchart of a subroutine of audio data deletion processing executed by the video conference apparatus 100. 4 is a flowchart of a subroutine of output determination processing executed by the video conference apparatus 100. It is a timing chart figure which shows an example of audio | voice data and output audio | voice data. 6 is a flowchart of a subroutine of an output order setting process executed by the video conference apparatus 100. It is a timing chart figure which shows an example of audio | voice data and output audio | voice data. It is a timing chart figure which shows an example of audio | voice data and output audio | voice data. 10 is a flowchart of a subroutine of output order information display processing executed by the terminal device 200. It is a figure which shows one specific example of the video conference screen 271 on which output order information was displayed. It is a flowchart of the subroutine of the output order setting process performed with the video conference apparatus 100 in a modification. It is a timing chart figure which shows an example of audio | voice data and output audio | voice data.

  Hereinafter, a video conference system 1 according to an embodiment of the present invention will be described with reference to the drawings. First, an overview of the video conference system 1 will be described with reference to FIG.

  As shown in FIG. 1, a plurality of terminal devices 200 are connected to the video conference device 100 via the network 2, and can perform a video conference by transmitting and receiving images and audio between the terminal devices 200. . In FIG. 1, three terminal devices 200 are illustrated, but actually, it is sufficient that a video conference can be performed via the network 2, and two or more terminal devices 200 may be used. For example, a plurality of terminal devices 200 may exist in the same site of a certain company, or may exist in different offices or in different regions or countries.

  The video conference device 100 is, for example, a well-known personal computer and is a general-purpose device, and relays images, sounds, data, and the like transmitted from a plurality of terminal devices 200, thereby allowing the terminal devices 200 to communicate with each other. It is a device that realizes the video conference. The video conference apparatus 100 creates display image data to be shared in the video conference by synthesizing individual image data transmitted from each terminal device 200. And it has a function which transmits an audio | voice and the synthesized image data with respect to the several terminal device 200 connected to the video conference.

  The terminal device 200 is, for example, a known personal computer and is a general-purpose device. The terminal device 200 includes a camera 250 (see FIG. 6) for inputting an image for use in a video conference from the outside, and a microphone 240 (see FIG. 6) for inputting the audio of a participant in the video conference from the outside. 6). Further, a monitor 270 (see FIG. 6) for outputting an image received from the video conference apparatus 100 to the outside and a speaker 260 (see FIG. 6) for outputting the sound to the outside are provided.

  Next, the electrical configuration of the video conference apparatus 100 will be described with reference to the block diagram of FIG. As shown in FIG. 2, the video conference apparatus 100 includes a CPU 101 that controls the video conference apparatus 100. A ROM 102, a RAM 103, a hard disk drive (HDD) 104, a counter 105, a display control unit 106, an input control unit 107, a timing device 108, and a communication control unit 109 are connected to the CPU 101 via a bus 111. .

  The ROM 102 stores a program for starting the BIOS executed by the CPU 101 and setting values. Various data are temporarily stored in the RAM 103. Also, an audio data table storage area 1301 for storing an audio data table 1100 (see FIG. 3) is provided. Details of the audio data table 1100 will be described later. The audio data table storage area 1301 is a shared memory area for sharing information between different processes. The HDD 104 stores various programs executed by the video conference apparatus 100. The counter 105 measures time as a timer function.

  The display control unit 106 is connected to a monitor 120 for displaying an operation screen, and controls the display of the monitor 120. The input control unit 107 is connected to a keyboard 130 and a mouse 140 for a user to input an operation, and controls these inputs. In the time measuring device 108, time is measured as an internal clock. The communication control unit 109 is connected to the network 2 and controls data transmission / reception with the terminal device 200.

  Here, the audio data table 1100 will be described with reference to FIG. The audio data table 1100 is created in the audio data table storage area 1301 of the RAM 103 when the main process (see FIG. 8) of the video conference apparatus 100 is executed.

  The voice data table 1100 stores information (hereinafter referred to as “voice data information”) in which terminal ID, voice data name, output order, invalid flag, status flag, and start time information are associated with each other. The terminal ID stores information for identifying the terminal device 200 that has transmitted the audio data. In the present embodiment, as an example, the terminal ID is a Mac address of the terminal device 200. The terminal ID may be unique information that can identify the terminal device 200, and may be the IP address of the terminal device 200 or the like.

  The audio data name stores a file name for identifying audio data received from the terminal device 200 connected to the video conference. The output order stores the order in which the audio data received from each terminal device 200 is output to all the terminal devices 200 connected to the video conference system 1.

  The invalid flag stores a flag indicating whether or not the output of the stored audio data is invalid for each terminal device 200 connected to the video conference. When the value of the invalid flag is “1”, it indicates that the output of the stored audio data is invalid. Further, when the value of the invalid flag is “0”, it indicates that the output of the stored audio data is valid.

  The status flag stores the status of the audio data specified by the corresponding audio data name. When the value of the status flag is “0”, it indicates that the output of the audio data specified by the corresponding audio data name is in a waiting state for each terminal device 200 connected to the video conference. When the value of the status flag is “1”, it indicates that the audio data specified by the corresponding audio data name is being output to each terminal device 200 connected to the video conference. When the value of the status flag is “2”, it indicates that the output of the audio data specified by the corresponding audio data name has been completed.

  In the start time, the time when reception of audio data from the terminal device 200 connected to the video conference system 1 is started is stored.

  Next, the details of the HDD 104 will be described with reference to FIG. As shown in FIG. 4, the HDD 104 includes a plurality of storage areas including a priority table storage area 1401, a program storage area 1402, and a program related information storage area 1403.

  The priority table storage area 1401 stores a priority table 1200 (see FIG. 5). Details of the priority table 1200 will be described later. The program storage area 1402 stores various programs for causing the video conference apparatus 100 to execute various processes. For example, those programs stored in a CD-ROM are installed via a CD-ROM drive (not shown) and stored in the program storage area 1402. Alternatively, a program downloaded via the network 2 may be stored in the program storage area 1402. The program related information storage area 1403 stores information such as settings, initial values, and data necessary for program execution.

  Next, the details of the priority order table 1200 will be described with reference to FIG. The priority order table 1200 stores priority order information in which the terminal ID of the terminal device 200 participating in the video conference and the priority order are associated in advance. This priority order is an order used when determining audio data (hereinafter referred to as “output audio data”) to be output to each terminal device 200 in a video conference. In the present embodiment, a MAC address is used as the terminal ID. However, there is no problem as long as it is unique information that can identify the terminal device 200 in the video conference system 1.

  Next, the electrical configuration of the terminal device 200 will be described with reference to the block diagram of FIG. As illustrated in FIG. 6, the terminal device 200 includes a CPU 201 that controls the terminal device 200. A ROM 202, a RAM 203, a hard disk drive (HDD) 204, a counter 205, a timing device 206, an input / output control unit 207, and a communication control unit 208 are connected to the CPU 201 via a bus 211.

  The ROM 202 stores a program for starting the BIOS executed by the CPU 201 and setting values. Various data are temporarily stored in the RAM 203. The HDD 204 stores various programs executed by the terminal device 200. The counter 205 measures time as a timer function. The time measuring device 206 measures time as an internal clock.

  The input / output control unit 207 includes a keyboard 220 for a user to input an operation, a mouse 230, a microphone 240 for acquiring voice data by utterance for use in a video conference, and image data for use in a video conference. Is connected to the camera 250. The input / output control unit 207 is connected to a speaker 260 that outputs audio data transmitted from the video conference apparatus 100 and a monitor 270 that displays image data transmitted from the video conference apparatus 100 when a video conference is executed. Has been. The communication control unit 208 is connected to the network 2 and controls data transmission / reception with an external device such as the video conference apparatus 100.

  Next, the video conference screen 271 displayed on the monitor 270 of the terminal device 200 will be described with reference to FIG.

  When the video conference is executed, a video conference screen 271 is displayed on the monitor 270 of each terminal device 200 as shown in FIG. In this video conference screen 271, an individual area 272 for displaying image data transmitted from each terminal device 200 connected to the video conference to the video conference device 100 is provided for each terminal device 200. The image data displayed in the individual area 272 is image data captured by the camera 250 of each terminal device 200.

  Next, with reference to FIG. 8, main processing executed in the video conference apparatus 100 will be described. Here, the main process of FIG. 8 is executed when the power of the video conference apparatus 100 is turned on. In addition, when the power supply of the video conference apparatus 100 is turned off, the main process in FIG. 8 is automatically terminated.

  When the main process of FIG. 8 is executed, the priority table 1200 stored in the priority table storage area 1401 of the HDD 104 is acquired (S11). Then, the voice data deletion process (see FIG. 9) is started (S12). Here, a process different from the main process is generated, and the audio data deletion process operates. The process in which the main process is operating becomes a parent process, and the audio data deletion process activated from the main process operates as a child process. Details of the audio data deletion processing will be described later.

  Next, an output determination process (see FIG. 9) is started (S13). Here, a process different from the main process is generated, and the output determination process operates. The process in which the main process is operating becomes a parent process, and the output determination process started from the main process operates as a child process. Details of the output determination process will be described later.

  Next, it is determined whether or not voice data including voice data generated by the user's speech is received from the terminal apparatus 200 in the data transmitted from the terminal apparatus 200 (S14). This audio data is data acquired from the microphone 240 of the terminal device 200, and is determined based on whether or not the received audio data exceeds a predetermined volume value. Here, when the predetermined volume value is not reached, it is regarded as noise acquired from the microphone 240.

  When it is determined that the voice data by the user's utterance has been received (S14: YES), that is, when the voice data exceeding the predetermined volume value is received, only the voice data by the user's utterance is received from the received voice data. Obtained (S15). Next, the acquired audio data is stored in an audio data storage area (not shown) of the RAM 103 in association with the terminal ID of the terminal device 200 that transmitted the audio data (S16). This audio data storage area is a shared memory area for sharing information between different processes.

  Next, it is determined whether or not audio data other than the audio data stored in the audio data storage area in S16 is being output to all the terminal devices 200 connected to the video conference. S17). That is, in the audio data table 1100, determination is made based on whether or not there is audio data information in which the value of the status flag of the audio data information corresponding to other audio data is “1”. When audio data other than the audio data stored in the audio data storage area in S16 is being output (S17: YES), the audio data information related to the audio data stored in the audio data storage area in S16 is the audio data. It is stored in the table 1100 (S18).

  Here, the terminal ID of the terminal device 200 that has transmitted the audio data is stored in the terminal ID. In the audio data name, a file name of audio data stored in the audio data storage area is stored. In the output order, “1” is added to the largest output order value stored in the audio data table 1100 and stored. The invalid flag stores “0” as an initial value. The status flag stores “0” as an initial value. In the start time, the reception start time of the audio data stored in the audio data storage area is stored.

  Then, it is determined whether there is audio data delayed for a predetermined time T1 or more (S19). That is, it is determined whether or not audio data information stored in the audio data table 1100 includes audio data information that has passed for at least T1 hours from the start time. This determination process is determined based on whether or not there is audio data information that exceeds the current time in the time obtained by adding T1 time to the start time of the audio data information stored in the audio data table 1100. . Here, the current time is acquired from the timing device 108. The predetermined time T1 may be a time that does not interfere with the tempo of the conversation, and is, for example, “10 seconds” in the present embodiment.

  Further, when it is determined that the voice data due to the user's utterance has not been received (S14: NO), that is, the transmitted voice data has not reached the predetermined volume value, and is determined to be noise acquired from the microphone 240. If so, the process proceeds to S19.

  When it is determined that other audio data other than the audio data stored in the audio data storage area in S16 is not being output (S17: NO), that is, in the audio data table 1100, other audio data is supported. If there is no audio data information whose status flag value is “1”, the process proceeds to S19.

  In S19, when it is determined that there is audio data delayed for a predetermined time T1 or more (S19: YES), that is, from the start time in the audio data information stored in the audio data table 1100. If there is audio data information that has passed for T1 time or longer, “1” is set to the invalid flag value of the corresponding audio data information (S20). Then, an output order setting process is performed (S21). Details of the output order setting process will be described later.

  Further, when there is no delayed voice data for a predetermined time T1 or more (S19: NO), that is, the voice data information stored in the voice data table 1100 has passed T1 hours or more from the start time. If there is no audio data information being processed, the process proceeds to S21.

  When the output order setting process is executed in S21, it is determined whether there is any audio data that can be output for all the terminal devices 200 connected to the video conference (S22). This determination processing is determined based on whether or not there is audio data information other than the priority value “1” and the status flag value “2” in the audio data table 1100.

  When it is determined that there is sound data that can be output (S22: YES), the output order is transmitted to all the terminal devices 200 connected to the video conference (S23). That is, the corresponding output order is transmitted to each terminal device 200 specified by the terminal ID of the voice data information stored in the voice data table 1100. Here, for example, in the audio data table 1100 shown in FIG. 3, the output rank “1” is transmitted to the terminal device 200 whose terminal ID is specified by “terminal A”. The output order “2” is transmitted to the terminal device 200 whose terminal ID is specified by “terminal B”. The output order “3” is transmitted to the terminal device 200 whose terminal ID is specified by “terminal C”.

  Next, audio data whose output order of audio data information is “1” is output to all the terminal devices 200 connected to the video conference (S24), and the process proceeds to S14. Here, for example, in the case of the audio data table 1100 shown in FIG. 3, all the audio data identified by the audio data name “A1” is acquired from the audio data storage area of the RAM 103 and connected to the video conference. Is output to the terminal device 200. At this time, in the audio data table 1100, “1” indicating a state of being output is set as the value of the status flag corresponding to the audio data output in S24. When the output of the audio data output in S24 is completed, “2” is automatically set as the value of the status flag, and “1” is automatically set as the value of the invalid flag. Shall be. If it is determined that there is no audio data that can be output (S22: NO), the process proceeds to S14.

  Next, the audio data deletion process executed by the video conference apparatus 100 will be described with reference to FIG. Here, the audio data deletion process of FIG. 9 is started as a child process in S12 of the main process of FIG. Note that the audio data deletion process automatically ends when the main process in FIG. 8 ends.

  When the audio data deletion process is executed, it is determined whether there is audio data information whose invalid flag value is “1” (S31). This determination process is determined by whether there is audio data information whose invalid flag is “1” stored in the audio data table 1100.

  When it is determined that the voice data information whose invalid flag value is “1” is stored in the voice data table 1100 (S31: YES), the invalid flag stored in the voice data table 1100 is “ The audio data information “1” is deleted (S32). That is, in the audio data table 1100, the audio data information corresponding to the stored invalid flag “1” is deleted, and the audio data corresponding to the audio data name is deleted from the audio data storage area of the RAM 103. And it transfers to S31 again.

  If it is determined that the audio data information whose invalid flag value is “1” is not stored in the audio data table 1100 (S31: NO), the determination process of S31 is performed again.

  Thus, while the voice data deletion process is being executed, the invalid flag value in the voice data table 1100 is always detected, and the invalid flag value is changed to “1” in the process performed in another process. In this case, the corresponding audio data information and audio data are deleted.

  Next, with reference to FIG. 10, output determination processing executed by the video conference apparatus 100 will be described. Here, the output determination process of FIG. 10 is started as a child process in S13 of the main process of FIG. Note that the output determination process automatically ends when the main process in FIG. 8 ends.

  When the output determination process is executed, it is determined whether or not there is audio data whose output rank is 1st (S41). That is, it is determined whether or not there is audio data information whose output rank value is “1” in the audio data table 1100. When it is determined that there is no audio data with the output rank of 1st (S41: NO), that is, when there is no audio data information with an output rank value of “1” in the audio data table 1100, the process goes to S41. Transition.

  If it is determined that there is audio data with the output rank of 1st (S41: YES), that is, if there is audio data information with an output rank value of “1” in the audio data table 1100, the output rank is It is determined whether or not the first-ranked audio data has been output (S42). This determination processing is determined based on whether or not the value of the status flag corresponding to the audio data information whose output rank value is “1” in the audio data table 1100 is “2”.

  When it is determined that the output of the audio data whose output rank is 1st has not been completed (S42: NO), that is, in the audio data table 1100, corresponding to the audio data information whose output rank value is “1” When the value of the status flag to be performed is not “2”, the process proceeds to S41.

  When it is determined that the output of the audio data whose output rank is 1st has been completed (S42: YES), that is, in the audio data table 1100, the state corresponding to the audio data information whose output rank value is “1” If the value of the flag is “2”, it is determined whether or not there is audio data whose output rank is 2nd or higher (S43). That is, in the audio data table 1100, it is determined whether or not there is audio data information whose output rank value is “2” or more.

  When it is determined that there is no audio data whose output rank is second or higher (S43: NO), that is, when there is no audio data information whose output rank value is “2” or more in the audio data table 1100, S41. Migrate to

  If it is determined that there is audio data whose output rank is second or higher (S43: YES), that is, if there is audio data information whose output rank value is “2” or more in the audio data table 1100, the audio data The output order of the table 1100 is updated (S44), and the process proceeds to S41. Here, the value of the output order stored in the audio data table 1100 is subtracted by “1”. Note that the output rank value “1” is “0”.

  Next, the operation of the main process described above will be described with reference to the timing chart of FIG. 11 as an example. FIG. 11 shows output audio output from the video conference device 100 based on audio data (“A1”, “B1”, and “C1”) received from each terminal device 200 connected to the video conference. The time transition of data is shown.

  Here, as shown in FIG. 3, as the priority order stored in the priority order table 1200, the priority order value of the terminal device 200 that has transmitted the voice data (A1) is “1”, and the voice data (B1). The priority order value of the terminal apparatus 200 that has transmitted “2” is “2”, and the priority order value of the terminal apparatus 200 that has transmitted the voice data (C1) is “3”.

  First, reception of audio data (A1) is started at the timing of time tA1. At time tA1, since there is no output of audio data received from another terminal device 200, audio data (A1) is output as output audio data to each terminal device 200 connected to the video conference. .

  Next, reception of audio data (C1) is started at the timing of time tC1. At the timing of time tC1, the voice data (A1) is being output, and the priority order of the terminal apparatus 200 that has transmitted the voice data (A1) is the priority order of the terminal apparatus 200 that has transmitted the voice data (C1). Since it is higher, the audio data (C1) is not output.

  Next, reception of audio data (B1) is started at the timing of time tB1. At the timing of time tB1, the voice data (A1) is being output, and the priority order of the terminal device 200 that has transmitted the voice data (A1) is the priority order of the terminal device 200 that has transmitted the voice data (B1). Since it is higher, the audio data (B1) is not output.

  Next, the reception and output of the audio data (A1) are finished at the timing of time t1. At this time t1, the output order is updated, the output order for the audio data (B1) is “1”, and the output order for the audio data (C1) is “2”. Then, the audio data (B1) becomes output audio data, and output is started.

  Next, the value of the invalid flag of the audio data information corresponding to the audio data (C1) is set to “1” at the timing of time t2 when a predetermined time T1 has elapsed from the reception start time of the audio data (C1). The voice data information corresponding to the voice data (C1) and the voice data (C1) are deleted.

  Next, at the time t3, the output of the audio data (B1) that is the output audio data is completed.

  In the main process described above, the timing at which it is determined whether there is audio data delayed for T1 time or longer (see S19 in FIG. 8) is the timing at time t2.

  Next, with reference to FIG. 12, an output order setting process executed by the video conference apparatus 100 will be described. Here, the output order setting process of FIG. 12 is executed from the main process of the video conference apparatus 100 in S21 of FIG.

  When the output order setting process is executed, it is determined whether or not there is audio data whose output order is first (S51). That is, it is determined whether or not there is audio data information whose output rank value is “1” in the audio data table 1100. When it is determined that there is no audio data whose output rank is 1st (S51: NO), that is, it is determined that there is no audio data information whose output rank value is “1” in the audio data table 1100. If so, the output order of the audio data table 1100 is set based on the priority table 1200 stored in the priority table storage area 1401 (S53).

  Here, the order of output for the audio data transmitted from the terminal device 200 identified by the terminal ID corresponding to the order of descending priority is set in order from the highest priority stored in the priority order table 1200. . Then, it is determined whether there exists audio data whose duration does not exceed the predetermined time T2 (S54). That is, in the audio data information whose output rank value in the audio data table 1100 is “2” or later, audio data information whose duration from the reception start time to the reception end time does not exceed T2 time is included. It is judged by whether or not it exists. In the present embodiment, T2 time is assumed to be “1 second” as an example, assuming audio data of a short phrase such as a meeting of participants in a video conference. Note that the reception end time of the audio data is calculated from the data capacity of the audio data, and the duration is calculated by subtracting the reception start time from the reception end time.

  If it is determined that there is audio data with the output rank of 1st (S51: YES), that is, it is determined that there is audio data information with an output rank value of “1” in the audio data table 1100. If so, the output order corresponding to the audio data whose output order is second or higher is set (S52). Here, the output order is set on the basis of the priority order table 1200 for the audio data whose output order is second or higher. Then, the process proceeds to S54.

  If it is determined that there is audio data whose duration does not exceed the predetermined time T2 (S54: YES), audio data information whose duration does not exceed the predetermined time T2 in the audio data table 1100 Is set to the first output rank (S55). That is, there are a plurality of pieces of audio data information whose output rank value is “1” in the audio data table 1100, and audio data is output at the same time.

  Then, it is determined whether or not there is audio data information satisfying tA1 <tB1 + T3 (S56). Here, tA1 is the reception start time of the audio data received from the terminal device 200 with the highest priority in the priority table 1200, and is stored in the audio data table 1100. tB1 is the reception start time of the audio data received from the terminal device 200 whose priority is second or higher in the priority table 1200, and is stored in the audio data table 1100. Further, the T3 time is a predetermined time, and is, for example, “1 second” in the present embodiment. Here, it is determined whether or not the output of the audio data corresponding to the start time tA1 is started before the time T3 elapses after the output of the audio data corresponding to the start time tB1 is started.

  When it is determined that there is audio data satisfying tA1 <tB1 + T3 (S56: YES), in the audio data table 1100, the invalid flag corresponding to the audio data received from the terminal device 200 with the second highest priority is “1”. (S57). That is, if the output of audio data corresponding to the start time tA1 is started before the time T3 elapses after the output of audio data corresponding to the start time tB1 is started, the start in the audio data table 1100 is started. The invalid flag corresponding to the audio data information at time tB1 is set to “1”.

  Next, the output order corresponding to the audio data received from the terminal device 200 having a higher priority is set to 1st (S58). That is, in the audio data table 1100, the output order corresponding to the audio data information whose start time is tA1 is set to “1”. In the audio data table 1100, the order after the output order “2” is updated (S59). Then, the output order setting process ends.

  Next, the operation of the above-described video conference apparatus 100 will be described with reference to the timing chart of FIG. 13 as an example. FIG. 13 shows temporal transition of output audio data based on audio data (referred to as “A1”, “B1”, and “C1”) received from each terminal device 200 connected to the video conference. ing.

  Here, as shown in FIG. 3, as the priority order stored in the priority order table 1200, the priority order value of the terminal device 200 that has transmitted the voice data (A1) is “1”, and the voice data (B1). The priority order value of the terminal apparatus 200 that has transmitted “2” is “2”, and the priority order value of the terminal apparatus 200 that has transmitted the voice data (C1) is “3”.

  First, reception of audio data (A1) is started at the timing of time tA1. At time tA1, since there is no output of audio data received from another terminal device 200, audio data (A1) is output as output audio data to each terminal device 200 connected to the video conference. .

  Next, reception of audio data (C1) is started at the timing of time tC1. At the timing of time tC1, the voice data (A1) is being output, and the priority order of the terminal apparatus 200 that has transmitted the voice data (A1) is the priority order of the terminal apparatus 200 that has transmitted the voice data (C1). Since it is higher, the audio data (C1) is not output.

  Next, reception of audio data (B1) is started at the timing of time tB1. At the timing of time tB1, the voice data (A1) is being output, and the priority order of the terminal device 200 that has transmitted the voice data (A1) is the priority order of the terminal device 200 that has transmitted the voice data (B1). Since it is higher, the audio data (B1) is not output.

  Next, the reception of the audio data (B1) ends at the timing of time t4. At this timing, since the predetermined time T2 has not elapsed from the reception start time of the audio data (B1), the output order of the audio data (B1) is set to “1”, and the audio data (B1) Starts to output. That is, the audio data (B1) is regarded as audio data of a short phrase such as a meeting of participants in the video conference, and the audio data (A1) and the audio data (B1) are output simultaneously.

  Next, the reception of the audio data (A1) ends at the timing of time t5. At this timing, since the delay time of the audio data (C1) does not exceed the time T1, the output rank of the audio data (C1) is set to “1”, and the output of the audio data (C1) is started. .

  In the output rank setting process described above, the timing at which it is determined whether or not there is audio data whose duration does not exceed T2 time (see S54 in FIG. 12) is the timing at time t4.

  Next, the operation of the above-described video conference apparatus 100 will be described with reference to the timing chart of FIG. 14 as an example. FIG. 14 shows temporal transition of output audio data based on audio data (“A1” and “B1”) received from each terminal device 200 connected to the video conference.

  Here, as shown in FIG. 3, as the priority order stored in the priority order table 1200, the priority order value of the terminal device 200 that has transmitted the voice data (A1) is “1”, and the voice data (B1). The priority value of the terminal device 200 that has transmitted “2” is “2”.

  First, reception of audio data (B1) is started at time tB1. At the timing of time tB1, since there is no output of audio data received from another terminal device 200, audio data (B1) is output as output audio data to each terminal device 200 connected to the video conference. .

  Next, reception of audio data (A1) is started at the timing of time tA1. At the timing of time tA1, reception of the audio data (A1) is started until T3 time elapses from the output start time of the audio data (B1) being output. That is, tA1 <tB1 + T3 is satisfied. Therefore, the invalid flag of the voice data information corresponding to the voice data (B1) is set to “1”, and the voice data information corresponding to the voice data (B1) and the voice data (B1) are deleted. Also, the output order of the audio data (B1) is set to “1”, and output of the audio data (A1) is started.

  Next, the output of the audio data (A1) ends at the timing of time t6.

  In the output order setting process described above, the timing at which it is determined whether there is audio data satisfying tA1 <tB1 + T3 (see S56 in FIG. 12) is the timing at time tA1.

  Next, with reference to FIG. 15 and FIG. 16, the output order information display process executed by the terminal device 200 will be described. Here, the output order information display process is a process executed in a process activated from the main process (not shown) of the terminal device 200. Other processes performed in the terminal device 200 are performed in the main process, and details thereof are omitted. The output order information display process is terminated when a signal such as forced termination is received from the main process.

  As shown in FIG. 15, when the output order information display process is executed, it is determined whether or not the output order information is received from the video conference apparatus 100 (S51). This output order information is the order of audio data output to each terminal device 200 connected to the video conference in the video conference. In the main process of the video conference apparatus 100, the output order information is transmitted to each terminal apparatus 200 (see S23 in FIG. 8).

  If it is determined that the output order information has been received from the video conference apparatus 100 (S51: YES), information based on the received output order information is displayed in the output order information display area 273 of the video conference screen 271 as shown in FIG. (S52), and the process proceeds to S51. Here, as an example, a number based on the output order information is displayed as shown in FIG. Moreover, it is not limited to a number, and even if it is a display form of a symbol etc., there is no problem.

  If it is determined that the output order information has not been received from the video conference apparatus 100 (S51: NO), the process of S51 is performed again. That is, it is in a state of waiting for reception of the output order information from the video conference apparatus 100.

  As described above, in the present embodiment, the video conference apparatus 100 receives audio data from the utterances of participants in the video conference from the terminal device 200 connected to the video conference. Based on the priority table 1200 stored in the priority table storage area 1401 of the HDD 104 in advance, the output order for outputting audio data in the video conference is determined and stored in the audio data table storage area 1301 of the RAM 103. And stored as voice data information in the voice data table 1100. Then, the audio data is output to each terminal device 200 based on the output order. Further, data delayed for a predetermined time T1 or more is deleted, and the output order is updated. As a result, the audio data delayed for the predetermined time T1 or more is deleted, so that it is not output. As a result, the audio data is not output more late than necessary, and the possibility of hindering the conversation tempo during a video conference can be reduced.

  If there is audio data that is shorter than T2 time, which is a predetermined time, among the audio data that has not been output, the output rank corresponding to the audio data is updated to the highest rank. . As a result, audio data having an output time shorter than T2 time is output simultaneously with other audio data. As a result, it is possible to incorporate a short utterance such as a match made by a participant in the video conference into an utterance made in the video conference, thereby promoting a more natural conversation.

  Also, when audio data is received with a priority higher than the priority corresponding to the audio data being output before the time T3 elapses after the output of the audio data is started, it corresponds to the audio data being output. Audio data information and audio data are deleted. Then, the output order corresponding to the received audio data is updated to the highest output order and output. Thereby, even if other audio data is being output in the video conference, the audio data transmitted from the terminal device 200 having a higher priority is output with priority. As a result, it is possible to output the speech of the user of the terminal device 200 having a high priority determined in advance in a video conference without delay.

  In addition, the video conference device 100 transmits the output order to each terminal device 200. In addition, the terminal device 200 receives the transmitted output order and displays the received output order on the video conference screen 271 of the monitor 270. Thereby, the user who uses the terminal device 200 can know the order in which his / her speech is output, and can grasp whether or not his / her speech has a delay.

  Note that the terminal identification information of the present embodiment corresponds to “terminal ID”, and the start time of the audio data table 1100 corresponds to “reception start time”. The voice data table storage area 1301 of the RAM 103 corresponds to “voice data information storage means”, the record of the priority table 1200 corresponds to “priority information”, and the priority table storage area 1401 corresponds to “priority information storage means”. It corresponds to.

  The time T1 corresponds to the “first predetermined time”. The CPU 101 that executes S14 in FIG. 8 corresponds to “voice data receiving means” and “voice data receiving step”, and the CPU 101 that executes S17 in FIG. 8 corresponds to “output judgment means” and “output judgment step”. It corresponds to. The CPU 101 that executes S18 of FIG. 8 corresponds to “voice data information storage control means” and “voice data information storage control step”, and the CPU 101 that executes S24 of FIG. This corresponds to “output step”. The CPU 101 that executes S19 in FIG. 8 corresponds to “first determination means” and “first determination step”, and the CPU 101 that executes S20 in FIG. 8 and executes S32 in FIG. 8 is “first deletion means”. , And “first deletion step”.

  The time T2 corresponds to a “second predetermined time”. The CPU 101 that executes S54 in FIG. 12 corresponds to “second determination means”, and the CPU 101 that executes S55 in FIG. 12 corresponds to “first output order changing means”.

  The time T3 corresponds to a “third predetermined time”. The CPU 101 that executes S56 in FIG. 12 corresponds to “third determination means”, executes S57 in FIG. 12, and the CPU 101 that executes S32 in FIG. 8 corresponds to “first deletion means”. The CPU 101 that executes the process corresponds to “second output order changing means”.

  The speaker 260 corresponds to the “output unit”, and the monitor 270 corresponds to the “display unit”. The CPU 101 that executes S23 in FIG. 8 corresponds to the “output order transmitting means”, the CPU 101 that executes S51: YES in FIG. 15 corresponds to the “output order receiving means”, and the CPU 101 that executes S52 in FIG. This corresponds to “output order display control means”.

  In addition, this invention is not limited to embodiment mentioned above, A various change is possible. Hereinafter, modified examples will be described.

  In the video conference apparatus 100 according to the above-described embodiment, in S56 of the output order setting process of FIG. 12, it is determined whether there is audio data information that satisfies the condition of tA1 <tB1 + T3. If it exists, the corresponding audio data information and audio data are deleted, but this condition is not limited to this. For example, other conditions may be satisfied. This will be described in the following modification with reference to FIGS. 17 and 18.

  With reference to FIG. 17, the output order setting process of a modification is demonstrated. Note that S51 to S55 in FIG. 12 are the same processes as S61 to S65 in FIG. Also, S57 to S59 in FIG. 12 are the same processes as S68 to S70 in FIG. Note that the output order setting process of FIG. 17 is executed from the main process of the video conference apparatus 100 in S21 of FIG. 8 as in the above-described embodiment.

  When the output order setting process of the modification is executed, the processes of S61 to S65 are executed, and it is determined whether there is audio data information satisfying tB1 + T3 <tA1 (S66). Here, tA1 is the reception start time of the audio data received from the terminal device 200 with the highest priority in the priority table 1200, and is stored in the audio data table 1100. tB1 is the reception start time of the audio data received from the terminal device 200 whose priority is second or higher in the priority table 1200, and is stored in the audio data table 1100. Also, the T3 time is set to “1 second” in the modified example, as in the above-described embodiment. Here, it is determined whether or not the output of the audio data corresponding to the start time tA1 is started before the time T3 elapses after the output of the audio data corresponding to the start time tB1 is started.

  When it is determined that there is audio data satisfying tB1 + T3 <tA1 (S66: YES), it is determined whether or not the delayed time of the audio data received from the terminal device 200 having a higher priority has exceeded T2 time. (S67). That is, it is determined whether or not the time obtained by adding T2 time to tA1 which is the start time of reception of the audio data from the terminal device 200 with higher priority exceeds the current time. Here, the current time is acquired from the timing device 108.

  If it is determined that there is no audio data satisfying tB1 + T3 <tA1 (S66: NO), the process proceeds to S70.

  When it is determined that the delay time of the voice data received from the terminal device 200 with the higher priority exceeds T2 time (S67: YES), that is, reception of the voice data from the terminal device 200 with the higher priority. If the time obtained by adding T2 time to tA1 which is the start time of the time exceeds the current time, the process proceeds to S68.

  Further, when it is determined that the delay time of the audio data received from the terminal device 200 having the higher priority does not exceed the time T2 (S67: NO), that is, from the terminal device 200 having the higher priority. If the time obtained by adding T2 time to tA1, which is the reception start time of the audio data, does not exceed the current time, the process proceeds to S68.

  Next, the operation of the video conference apparatus 100 described above will be described with reference to the timing chart of FIG. 18 as an example. FIG. 18 shows the temporal transition of the output audio data based on the audio data (“A1” and “B1”) received from each terminal device 200 connected to the video conference.

  Here, as shown in FIG. 3, as the priority order stored in the priority order table 1200, the priority order value of the terminal device 200 that has transmitted the voice data (A1) is “1”, and the voice data (B1). The priority value of the terminal device 200 that has transmitted “2” is “2”.

  First, reception of audio data (B1) is started at time tB1. At the timing of time tB1, since there is no output of audio data received from another terminal device 200, audio data (B1) is output as output audio data to each terminal device 200 connected to the video conference. .

  Next, reception of audio data (A1) is started at the timing of time tA1. At the timing of time tA1, reception of audio data (A1) is started after T3 time has elapsed from the output start time of audio data (B1) being output. That is, tB1 + T3 <tA1 is satisfied.

  Next, at the timing of time t7, T2 time has elapsed since the reception of the audio data (A1) was started. Therefore, the invalid flag of the voice data information corresponding to the voice data (B1) is set to “1”, and the voice data information corresponding to the voice data (B1) and the voice data (B1) are deleted. Also, the output order of the audio data (B1) is set to “1”, and output of the audio data (A1) is started.

  As described above, in the modification, after T3 time has elapsed since the start of the output of the audio data, the audio data is received from the terminal device 200 having a higher priority than the priority corresponding to the audio data being output. Then, it is determined whether or not T2 time has elapsed. When the time T2 has elapsed, the audio data information corresponding to the audio data being output and the audio data being output are deleted. And the audio | voice data received from the terminal device 200 with a higher priority are transmitted. Accordingly, it is possible to output audio data transmitted from the terminal device 200 having a high priority and having an output time of a predetermined time or more with a small delay.

  In the modified example, the T3 time corresponds to the “fourth predetermined time”, and the T2 time corresponds to the “fifth predetermined time”. The CPU 101 that executes S66 in FIG. 17 corresponds to the “fourth determination unit”, and the CPU 101 that executes S67 in FIG. 17 corresponds to the “fifth determination unit”. The CPU 101 that executes S68 of FIG. 17 and executes S32 of FIG. 8 corresponds to the “third deletion unit”, and the CPU 101 that executes S69 of FIG. 17 corresponds to the “third output order changing unit”.

1 Video conference system 2 Network 100 Video conference device 101, 201 CPU
103, 203 RAM
104,204 HDD
108 timing device 200 terminal device 230 mouse 250 camera 260 speaker 270 monitor 271 video conference screen 272 individual display area 273 output order information display area 1100 audio data table 1200 priority order table 1301 audio data table storage area 1401 priority order table storage area

Claims (7)

A video conference apparatus that controls a video conference performed between a plurality of terminal devices via a network,
Voice data receiving means for receiving voice data from an utterance transmitted from the terminal device;
Output determination means for determining whether or not the audio data received from another terminal device is being output when the audio data is received from the terminal device by the audio data receiving means;
Priority order for storing the terminal identification information for identifying the terminal apparatus that has transmitted the voice data and the priority order indicating the priority order for outputting the voice data to the terminal apparatus in association with each other. Information storage means;
If the output determination means determines that the audio data received from another terminal device is being output, the audio data is based on the priority information stored in the priority information storage means. The voice data received by the receiving means, a reception start time that is a time when reception of the voice data is started, an output order that is information on a rank for outputting the voice data to the terminal device, and the voice Audio data information storage control means for associating with terminal identification information for identifying the terminal device that transmitted the data and storing it in the audio data information storage means as audio data information;
Audio data output means for outputting the audio data to a plurality of the terminal devices performing data communication in the video conference;
In the voice data information stored in the voice data information storage means, the voice data information that is not output to the terminal device by the voice data output means is first from the reception start time of the voice data information. First determination means for determining whether or not the audio data information for which a predetermined time has elapsed;
If it is determined by the first determination means that the audio data information that has passed the first predetermined time from the reception start time of the audio data information exists, the audio data information that has passed the first predetermined time is First deletion means for deleting from the voice data information storage means,
The audio data output means performs data communication in the video conference for the audio data corresponding to the output order with the highest output order of the audio data information stored in the audio data information storage means. A video conference apparatus that outputs to a plurality of the terminal devices. In the audio data information stored in the audio data information storage means, the output time of the audio data in the audio data information among the audio data not output to the terminal device by the audio data output means. Second determination means for determining whether or not the audio data information shorter than a second predetermined time exists;
When it is determined by the second determination means that the output time of the sound data of the sound data information is shorter than the second predetermined time, the output time shorter than the second predetermined time 2. The video conference apparatus according to claim 1, further comprising: first output rank update means for updating the output rank of the audio data information corresponding to the highest rank. The terminal device that has transmitted the audio data being output is identified before the third predetermined time elapses after the audio data output means starts outputting the audio data to the plurality of terminal devices. It is determined whether or not the voice data is received by the voice data receiving means from the terminal device specified by the terminal identification information corresponding to the priority higher than the priority corresponding to the terminal identification information. A third determination means;
When it is determined by the third determining means that the audio data has been received, the audio data information corresponding to the audio data being output in the audio data information stored in the audio data storage means Second deletion means for deleting from the data storage control means;
When it is determined that the audio data is received by the third determining means, the output order corresponding to the received audio data is the highest in the audio data information stored in the audio data storage means. The video conference apparatus according to claim 1, further comprising second output rank update means for updating the output rank. Identifying the terminal device that has transmitted the voice data being output after a fourth predetermined time has elapsed since the voice data output means started outputting the voice data to the plurality of terminal devices. The voice data receiving means determines whether or not the voice data is received from the terminal device specified by the terminal identification information corresponding to the priority higher than the priority corresponding to the terminal identification information. 4 judgment means,
The fourth determination means is specified by the terminal identification information corresponding to the priority higher than the priority corresponding to the terminal identification information identifying the terminal device that has transmitted the audio data being output. Fifth determination means for determining whether a fifth predetermined time has elapsed since it was determined that the voice data was received by the voice data receiving means from the terminal device;
When it is determined that the fifth predetermined time has elapsed since the reception of the audio data by the fifth determination unit, the audio data information stored in the audio data storage unit includes the audio data being output. Third deletion means for deleting the corresponding voice data information from the voice data storage control means;
When it is determined that the fifth predetermined time has elapsed since the reception of the audio data by the fifth determination means, the audio data information stored in the audio data storage means corresponds to the received audio data The video conference apparatus according to claim 1, further comprising: a third output order update unit that updates the output order to the highest output order. The video conference device according to claim 1, an output unit that outputs audio data output from the video conference device, and a display unit that displays image data used in the video conference controlled by the video conference device. A video conference system configured with the terminal device,
The video conference device is:
Output rank transmission means for transmitting the output rank of the voice data information stored in the voice data storage means to the terminal device specified by the terminal identification information corresponding to the output rank;
The terminal device
Output order receiving means for receiving the output order transmitted by the output order transmitting means of the video conference device;
A video conference system comprising: output order display control means for displaying information indicating the output order on the display unit based on the output order received by the output order receiving means. A video conference control method for controlling a video conference performed between a plurality of terminal devices via a network,
A voice data receiving step of receiving voice data from an utterance transmitted from the terminal device;
An output determination step of determining whether or not the audio data received from another terminal device is being output when the audio data is received from the terminal device in the audio data reception step;
Priority order for storing the terminal identification information for identifying the terminal apparatus that has transmitted the voice data and the priority order indicating the priority order for outputting the voice data to the terminal apparatus in association with each other. Information storage means;
If it is determined in the output determination step that the audio data received from the other terminal device is being output, the audio data is based on the priority information stored in the priority information storage means. The audio data received in the reception step, a reception start time that is a time when reception of the audio data is started, an output order that is information on an order for outputting the audio data to the terminal device, and the audio A voice data information storage control step for storing in the voice data information storage means as voice data information in association with terminal identification information for identifying the terminal device that has transmitted the data;
An audio data output step of outputting the audio data to a plurality of the terminal devices performing data communication in the video conference;
In the voice data information stored in the voice data information storage means, the voice data information that is not output to the terminal device by the voice data output means is first from the reception start time of the voice data information. A first determination step of determining whether or not the audio data information for which a predetermined time has elapsed;
If it is determined in the first determination step that the audio data information has passed the first predetermined time from the reception start time of the audio data information, the audio data information after the first predetermined time has passed. A first deletion step of deleting from the voice data information storage means,
In the audio data output step, the audio data corresponding to the output order having the highest output order of the audio data information stored in the audio data information storage unit is subjected to data communication in the video conference. A video conference control method, comprising: outputting to a plurality of the terminal devices.   A program for a video conference apparatus, which causes a computer to function as various processing means of the video conference apparatus according to claim 1.

Images