KR20230047261A - Providing Method for video conference and server device supporting the same - Google Patents

Abstract

The present invention discloses a video conference support method and a server device using the same, the video conference support method comprising, by a server processor of a server device supporting a video conference: opening a virtual meeting room; when a plurality of user terminals access the virtual meeting room, grouping the plurality of user terminals; and performing control of turning on the microphone of one user terminal among the user terminals included in each of the grouped user groups and turning off the microphones of remaining user terminals.

Description

Video conference support method and server device supporting the same {Providing Method for video conference and server device supporting the same}

The present invention relates to video conference control, and more particularly, to a video conference support method for preventing an acoustic feedback phenomenon from occurring during a video conference process and a server device supporting the same.

Acoustic feedback is often used as a term of howling, and it refers to the process in which the sound of a speaker is input back to a microphone in a sound system, and it is converted into noise as it passes through an amplifier and comes out again to the speaker. Since this acoustic feedback (howling) has long been considered as a problem of deteriorating sound quality of an acoustic system, many efforts have been made to solve it.

Acoustic feedback, by its nature, is expressed in the form of a strong signal at a specific frequency. As a small sound signal goes through feedback several times, it is gradually transformed into a loud sound at a specific frequency. Reflecting these characteristics, when a large signal is generated at a specific frequency, technology has been developed in the form of determining it as acoustic feedback and removing such a signal. Existing technologies are mainly aimed at detecting and suppressing an acoustic feedback phenomenon when it occurs, and thus there is a demand for a method for fundamentally eliminating the acoustic feedback phenomenon.

In order to solve the above problems, the present invention provides a method for supporting a video conference that can control a plurality of microphones and speakers not to be used in one space so that the acoustic feedback phenomenon itself does not occur, and a server device that supports the same.

On the other hand, the object of the present invention is not limited to the above object, and other objects not mentioned will be clearly understood from the description below.

A server device of the present invention for achieving the above object is a server communication unit for forming a communication channel with a plurality of user terminals, a server storage unit for storing data related to video conference support of the plurality of user terminals, and the server A communication unit and a server control unit functionally connected to the server storage unit, wherein the server control unit groups the plurality of user terminals, and the microphone of one of the user terminals among the user terminals included in each of the grouped user groups. and controlling to turn on and turn off the microphones of the remaining user terminals.

Here, the server control unit provides a screen related to group selection to the plurality of user terminals, and groups the plurality of user terminals based on selection information of the plurality of user terminals.

Alternatively, the server control unit obtains access address information of the plurality of user terminals, groups user terminals having the same access address into one user group based on the access address information, or generates sound feedback of the plurality of user terminals. Information on may be collected, and user terminals in which acoustic feedback has occurred within the same time point or a specified time point may be grouped into one user group.

Alternatively, the server control unit collects information on occurrence of acoustic feedback of the plurality of user terminals and communication access address information of the plurality of user terminals, and the user terminals generating the acoustic feedback at the same time or within a specified time point and the same communication connection. It is characterized in that user terminals having address information are grouped into user groups.

Meanwhile, the server control unit may generate a screen for displaying items corresponding to the plurality of user terminals in areas corresponding to user groups by dividing them, and provide the screen to the plurality of user terminals.

A video conference support method of a server device according to an embodiment of the present invention includes the steps of opening a virtual meeting room by a server processor of a server device supporting video conference, when a plurality of user terminals access the virtual meeting room, the Grouping a plurality of user terminals, controlling to turn on the microphone of one user terminal among the user terminals included in each of the grouped user groups and to turn off the microphones of the other user terminals characterized by

Here, the grouping step includes providing a screen related to group selection to the plurality of user terminals, and grouping the plurality of user terminals based on selection information of the plurality of user terminals. do.

Alternatively, the grouping may include obtaining access address information of the plurality of user terminals, and grouping user terminals having the same access address into one user group based on the access address information or sound of the plurality of user terminals. It is characterized in that it includes the step of collecting information on feedback generation and grouping user terminals in which acoustic feedback has occurred within the same time point or a specified time point into one user group.

Alternatively, the grouping may include collecting information on occurrence of acoustic feedback of the plurality of user terminals and communication access address information of the plurality of user terminals, user terminals to which acoustic feedback has occurred at the same point in time or within a specified time point, and the same and grouping user terminals having communication access address information into user groups.

Meanwhile, the method may further include generating a screen displaying items corresponding to the plurality of user terminals by dividing them into areas corresponding to user groups, and providing the screen to the plurality of user terminals. can

According to the present invention, the present invention can reduce the computing power required to detect and cancel acoustic feedback in a video conferencing system.

In addition, the present invention can be applied to a video conferencing system to provide an effect of improving sound quality.

In addition, various effects other than the above effects may be disclosed directly or implicitly in detailed descriptions according to embodiments of the present invention to be described later.

1 is a diagram illustrating an example of a video conference support system capable of improving an acoustic feedback problem according to an embodiment of the present invention.
2 is a diagram showing an example of a configuration of any one user terminal among user terminals belonging to a user group according to an embodiment of the present invention.
3 is a diagram showing an example of a configuration of a server device according to an embodiment of the present invention.
4 is a diagram illustrating an example of a video conference support method according to an embodiment of the present invention.
5 is a diagram illustrating another example of a video conference support method according to an embodiment of the present invention.
6 is a diagram illustrating an example of a screen interface related to video conference support according to an embodiment of the present invention.

In order to clarify the characteristics and advantages of the problem solving means of the present invention, the present invention will be described in more detail with reference to specific embodiments of the present invention shown in the accompanying drawings.

However, detailed descriptions of well-known functions or configurations that may obscure the gist of the present invention will be omitted in the following description and accompanying drawings. In addition, it should be noted that the same components are indicated by the same reference numerals throughout the drawings as much as possible.

The terms or words used in the following description and drawings should not be construed as being limited to a common or dictionary meaning, and the inventor may appropriately define the concept of terms for explaining his/her invention in the best way. It should be interpreted as a meaning and concept consistent with the technical idea of the present invention based on the principle that there is. Therefore, the embodiments described in this specification and the configurations shown in the drawings are only one of the most preferred embodiments of the present invention, and do not represent all of the technical ideas of the present invention. It should be understood that there may be equivalents and variations.

In addition, terms including ordinal numbers, such as first and second, are used to describe various components, and are used only for the purpose of distinguishing one component from other components, and to limit the components. Not used. For example, a second element may be termed a first element, and similarly, a first element may be termed a second element, without departing from the scope of the present invention.

In addition, terms used in this specification are only used to describe specific embodiments, and are not intended to limit the present invention. Singular expressions include plural expressions unless the context clearly dictates otherwise. In addition, terms such as "include" or "having" described in this specification are intended to designate that there is a feature, number, step, operation, component, part, or combination thereof described in the specification, but one or the other It should be understood that the above does not preclude the possibility of the presence or addition of other features, numbers, steps, operations, components, parts, or combinations thereof.

In addition, terms such as “unit”, “unit”, and “module” described in the specification refer to a unit that processes at least one function or operation, and may be implemented as hardware or software or a combination of hardware and software. Also, "a or an", "one", "the" and similar related words in the context of describing the invention (particularly in the context of the claims below) Unless indicated or otherwise clearly contradicted by context, both the singular and the plural can be used.

In addition to the above-mentioned terms, specific terms used in the following description are provided to aid understanding of the present invention, and the use of these specific terms may be changed in other forms without departing from the technical spirit of the present invention.

In addition, embodiments within the scope of the present invention include computer-readable media having or conveying computer-executable instructions or data structures stored thereon. Such computer readable media can be any available media that can be accessed by a general purpose or special purpose computer system. By way of example, such computer readable media may be in the form of RAM, ROM, EPROM, CD-ROM or other optical disk storage, magnetic disk storage or other magnetic storage, or computer executable instructions, computer readable instructions or data structures. physical storage media such as, but not limited to, any other medium that can be used to store or convey any program code means in a computer system and which can be accessed by a general purpose or special purpose computer system. .

The video conference supported by the video conference support system 10 of the present invention described below can be divided into a system operated in a web browser based on WebRTC and a system driven using individual applications. In the case of WebRTC-based audio input from the web browser (CHROME) is transmitted to the media server through the communication server, and the sound is transmitted to the user's web browser through mixing in the media server and again through the communication server. If WebRTC is not used, audio communication is performed in each application. The present invention can group user terminals gathered in one space or place so that acoustic feedback does not occur in an online video conference, and control microphone functions of the grouped user terminals. Through this, the present invention is an online video conference in which several users use their own terminals in one space, and the input signal of one terminal is output to the speaker of another terminal after passing through a media server, etc. At this time, it is possible to suppress the occurrence of acoustic feedback.

Hereinafter, the system, apparatus and method constituting the present invention will be described in more detail through each drawing.

1 is a diagram illustrating an example of a video conference support system capable of improving an acoustic feedback problem according to an embodiment of the present invention.

Referring to FIG. 1 , the video conferencing support system 10 according to an embodiment of the present invention includes a first access point 51, a first user group 51a, a second access point 52, and a second user group ( 52a), a network 50 and a server device 200. As another example, in the video conferencing support system 10 of the present invention, except for a server device that supports video conferencing, any one of the user terminals of the first user group 51a or the second user group 52a is a master device. As may be substituted for the role of the server device 200.

The first access point 51 may include an access point supporting communication channel formation of the first to third user terminals 101, 102, and 103 belonging to the first user group 51a. As an example, the first access point 51 may be a Wi-Fi access point. Alternatively, the first access point 51 may include a mobile communication base station device or a small base station device connected to the mobile communication base station. The first access point 51 receives an audio signal in connection with video conference support of the first to third user terminals 101, 102, and 103, and transmits the received audio signal through the network 50. It can be delivered to 2 access points (52).

The first user group 51a may include first to third user terminals 101 , 102 , and 103 . As an example, at least some of the first to third user terminals 101, 102, and 103 may be communication devices of the same type or communication devices of different types. For example, the first user terminal 101 may be a notebook device, the second user terminal 102 may be a smart phone terminal, and the third user terminal 103 may be a desktop computing device. The first to third user terminals 101, 102, and 103 form a communication channel with the first access point 51, and the second access point 52 via the first access point 51 and the network 50. ) can be connected to The first to third user terminals 101, 102, and 103 belong to the first user group 51a in relation to the video conference function, and correspond to the control of the server device 200 or the master terminal, during the video conference. Only the microphone of one user terminal may have a turn-on state. The master terminal is a user terminal that has opened a channel for video conferencing or a terminal for which a master terminal function is set, and is either one of the first to third user terminals 103 or user terminals belonging to the second user group 52a. can be any one of The first to third user terminals 101 , 102 , and 103 may include at least a communication interface, a microphone, and a speaker, or additionally include a camera for collecting images in relation to supporting a video conference function.

The second access point 52 is disposed at a location physically or communicatively separated from the first access point 51 and supports communication functions of the fourth to sixth user terminals 104, 105, and 106. can For example, the second access point 52 is a Wi-Fi access point, and may be disposed in an area where communication coverage does not overlap with that of the first access point 51 . The fourth to sixth user terminals 104, 105, and 106 are connected to the second access point 52, and the second access point 52 connects to the first access point 51 through the connected network 50. A communication channel can be formed. The second access point 52 may support a video conference function of the fourth to sixth user terminals 104 , 105 , and 106 . In the present invention, the second access point 52 may be a criterion for grouping the fourth to sixth user terminals 104, 105, and 106 into one user group.

The second user group 52a may include the fourth to sixth user terminals 104 , 105 , and 106 . Similar to the first to third user terminals 101, 102, 103 described above, at least some of the fourth to sixth user terminals 104, 105, and 106 may be communication devices of the same or different types. can In the fourth to sixth user terminals 104, 105, and 106, only the microphone of one of the terminals may be turned on while the video conference function is performed in response to the control of the server device 200 or the control of the master terminal. .

The network 50 may support formation of a communication channel between the first access point 51 and the second access point 52 . This network 50 may include an Internet communication network connected to a Wi-Fi communication network or a mobile communication network. The network 50 may support data transfer related to a video conference between the first access point 51 and the second access point 52 . As another example, the network 50 may be connected to the server device 200 and support data transmission between the server device 200 and the first user group 51a or the second user group 52a.

The server device 200 forms a communication channel with the first access point 51 or the second access point 52 through the network 50, and the first user group belonging to the first access point 51 51a or a video conference function of the second user group 52a belonging to the second access point 52 may be supported. For example, the server device 200 supports assignment of a communication channel or opening of a virtual meeting room for a video conference between the first user group 51a and the second user group 52a, and a user terminal connected to the virtual meeting room. information can be collected. The server device 200 may share the collected information with other user terminals. In particular, the server device 200 may provide a grouping state of user terminals to user terminals. The server device 200 may control a microphone of one user terminal among a plurality of user terminals belonging to a specific user group to be turned on and the microphones of the other user terminals to be turned off. In this regard, the server device 200 performs grouping for a plurality of user terminals in response to a specified criterion or user input, and controls acoustic feedback not to occur while performing a video conference function based on the grouped information (e.g. : Only one user terminal among user terminals belonging to one user group may control to turn on the microphone). On the other hand, in the video conferencing support system 10 of the present invention, it is described that the server device 200 performs the process of opening and maintaining a virtual meeting room for video conference and data transmission, but the present invention is not limited thereto. For example, a function of opening, maintaining, or terminating a virtual meeting room of the server device 200 may be performed by a specific user terminal. The specific user terminal may be any one of the first to sixth user terminals described above.

As an example, the server device 200 performs a process of grouping the user terminals participating in the video conference in the online video conference support system 10 into one user group when they are in the same space, and this Using the result, only one microphone (the terminal's microphone connected to the online video conference) can be turned on within one user group at a time. Here, in relation to the process of grouping users, the server device 200 may support user terminals to manually set up groups and enter the groups. Alternatively, when acoustic feedback occurs in at least one user terminal during a video conference, the server device 200 performs an acoustic feedback suppression process in the user terminal where the acoustic feedback has occurred, and thereafter, the result of the feedback and the location of the terminals The information can be used to automatically determine user groups. As such, the present invention can reduce the occurrence of acoustic feedback itself by performing microphone control through user grouping of user terminals when acoustic feedback is detected. To this end, the server device 200 configures that only one microphone can be used in one user group when the user group is determined. When a specific user terminal turns on the microphone, the server device 200 may automatically turn off the microphones of other user terminals in the group. The server device 200 arranges an object or item corresponding to the user terminals in the group in the same space on the screen output from each terminal in relation to the video conference, and interfaces that indicate that only one microphone can be used in the group. can be shown as a

2 is a diagram showing an example of a configuration of any one user terminal among user terminals belonging to a user group according to an embodiment of the present invention. The user terminal described in FIG. 2 may be a configuration of at least some of the user terminals belonging to the first user group 51a and the second user group 52a described above with reference to FIG. 1 .

Referring to FIG. 2 , a user terminal 100 according to an embodiment includes a communication interface 110, an input unit 120, an audio processing unit 130, a storage unit 140, a display 160, a camera 170, and a processor. (150) may be included.

The communication interface 110 may support communication functions of the user terminal 100 . The communication interface 110 may include a communication circuit supporting at least one communication method and an antenna for transmitting and receiving signals. For example, the communication interface 110 may include a wireless communication circuit supporting mobile communication type communication channel formation and a wired communication circuit supporting wired communication channel formation. When the communication interface 110 is configured as a wired communication circuit, a separate antenna configuration may be omitted. The communication interface 110 may form a communication channel with the server device 200 through the network 50 with the first access point 51 or the second access point 52 in response to the control of the processor 150. there is.

The input unit 120 may include at least one device that supports the input function of the user terminal 100. For example, the input unit 120 may include at least one of a keypad, a key input device, a keyboard, a touch screen, and a voice input device. The input unit 120 may generate an input signal according to a user manipulation and transmit it to the processor 150 . As an example, the input unit 120 generates an input signal corresponding to a user input (or manipulation) in a process in which the user selects which user group the user terminal belongs to, and transmits the corresponding input signal to the processor 150. can Alternatively, the input unit 120 may generate an input signal requesting turn-on of a turned-off microphone, an input signal requesting turn-off of a turned-on microphone, an input signal requesting termination of a video conference, and the like. can

The audio processing unit 130 may include a microphone (MIC) and a speaker (SPK) in relation to supporting the audio function of the user terminal 100 . When the user terminal 100 supports the video conferencing function, the audio processing unit 130 is automatically activated to collect audio signals, and transmits the collected audio signals through the communication interface 110 under the control of the processor 150. It can be transmitted to the server device 200. Alternatively, the audio processor 130 may output the audio signal received through the communication interface 110 through the speaker SPK. The microphone (MIC) may have a turn-on or turn-off state in response to control of the server device 200 .

The storage unit 140 may store programs and data related to the operation of the user terminal 100 . For example, the storage unit 140 may store a video conference application that performs a video conference function through the server device 200 . Also, the storage unit 140 may temporarily store video conference-related screens provided by the server device 200 . The storage unit 140 may store recorded data or recorded data related to a video conference in response to a user input.

The display 160 may output at least one screen related to the operation of the user terminal 100 . For example, the display 160 may output an access screen of the server device 200 and a screen related to a video conference performed through the server device 200 . The video conference-related screen includes list information of user terminals connected to the video conference, grouping information of user terminals, microphone status (eg, turn-on state or turn-off state) information of user terminals, and content screens shared during video conferences. It may contain at least some of the information.

The camera 170 may take a surrounding image of the user terminal 100 . Alternatively, the camera 170 may be activated according to the performance of the video conferencing function, collect an image of a subject disposed in a designated direction, and transmit the collected image to the server device 200 in response to control of the processor 150. The camera 170 may be automatically terminated in response to termination of the video conference function.

The processor 150 may process and transmit signals necessary for the operation of the user terminal 100 . For example, the processor 150 may execute a video conferencing application in response to a user input, and may access the server device 200 through the first access point 51 and the network 50 according to the execution of the application. The processor 150 may access a virtual meeting room provided by the server device 200 . Alternatively, the processor 150 may access the virtual meeting room created by the master terminal through the first access point 51 and the network 50 . The processor 150 may belong to a specific user group according to a designated method. For example, the processor 150 may receive a selection screen for selecting a user group from the server device 200 and belong to a user group selected by a user input. Alternatively, it may belong to a user group designated by control of the server device 200 . The processor 150 may turn on the microphone in response to control of the server device 200 . Alternatively, the processor 150 may transmit a signal requesting turn-on of the microphone to the server device 200 according to a user input, and may turn on the microphone according to whether the server device 200 permits it. Alternatively, the processor 150 may turn on a microphone according to a user input, transmit microphone turn-on information to the server device 200, and request to turn off the microphones of other user terminals belonging to the same group. . When a user input requesting termination of the video conference occurs, the processor 150 may terminate the connection to the server device 200 and terminate the video conference application. The processor 150 may record or perform recording related to the video conference according to a user input while the video conference is in progress.

3 is a diagram showing an example of a configuration of a server device according to an embodiment of the present invention.

Referring to FIG. 3 , a server device 200 according to an embodiment may include a server communication unit 210 , a server storage unit 240 and a server control unit 250 .

The server communication unit 210 may support formation of a communication channel of the server device 200 . The server communication unit 210 may form a communication channel with the first access point 51 and the second access point 52 . Alternatively, the server communication unit 210 forms a communication channel with at least one of the first to third user terminals 101, 102, and 103 through the network 50 and the first access point 51, and A communication channel can be formed with at least one of the fourth to sixth user terminals 104, 105, and 106 through (50) and the second access point (52). The server communication unit 210 includes a communication circuit supporting at least one communication method to support a communication function, and when the server communication unit 210 supports wireless communication channel formation, it may include an antenna connected to the communication circuit. there is.

The server storage unit 240 may store at least one program and data related to the operation of the server device 200 . For example, the server storage unit 240 may store a video conference support application related to video conference function support according to an embodiment of the present invention. In addition, the server storage unit 240 stores identification information of connected user terminals and device state information of user terminals (eg, camera turn-on/turn-off status of user terminals, microphone turn-on/ turn-off state, speaker turn-on/turn-off state), and grouping information of user terminals may be temporarily stored.

The server control unit 250 may perform operation of programs related to the operation of the server device 200 and processing and delivery of data. For example, the server controller 250 opens a virtual meeting room according to a request of at least one user terminal connected through the network 50, and controls access to the virtual meeting room of user terminals requesting access to the virtual meeting room. can do. The server control unit 250 may perform grouping of user terminals and perform various data controls related to video conference progress. In this regard, the server control unit 250 may include a grouping processing unit 251 and a video conference support unit 253 .

The grouping processor 251 may provide a group selection screen to user terminals accessing the virtual meeting room. The group selection screen may include identification information of the user terminals (eg, device identification number of the user terminal or user name information corresponding to the user terminal) and access point identification information to which the user terminals have accessed. Alternatively, the grouping processing unit 251 sets the user terminals to the same group if there are a plurality of user terminals in which the same acoustic feedback is detected at the same time when the audio feedback is detected while supporting the video conference. The grouping processing unit 251 analyzes the access points of user terminals participating in the video conference and can make user terminals existing in the same place into one user group. Alternatively, the grouping processing unit 251 determines a group of user terminals by combining the above-described two types of information (eg, acoustic feedback generation information and location-related information). The grouping processing unit 251 may perform user group visualization. The user group visualization process collects and shows user terminals of the same group on the screen of each user terminal, and confirms that they are in a group based on a certain section on the screen. The grouping processing unit 251 releases the acoustic feedback detection function when a user group is set.

The video conference support unit 253 may process transmission of data related to video conference. For example, specific content may be shared according to a request of a specific user terminal. The video conferencing support unit 253 sets only one microphone in one user group to be turned on, and when a user whose microphone is turned off turns on the microphone, all microphones of other users in the group are turned off.

4 is a diagram illustrating an example of a video conference support method according to an embodiment of the present invention.

Referring to FIG. 4 , in relation to the video conference support method, in step 401, the server control unit 250 of the server device 200 may perform video conference channel allocation. The channel may be a channel for a virtual meeting room.

In step 403, the server control unit 250 of the server device 200 checks whether a participating terminal (eg, at least one of the first to sixth terminals 101, 102, 103, 104, 105, and 106) is connected. can If there is no connection of the participating terminal, the server control unit 250 may skip steps 405 to 409 below.

When there is an access to the participating terminal, in step 405, the server control unit 250 of the server device 200 may provide a group option to the participating terminal. The user terminal can recognize the user group to which it belongs in advance and select the user group from the group option.

In step 407, the server control unit 250 of the server device 200 may receive selection group information from a participating terminal that has provided a group option, and process user grouping based on the received selection group information.

In step 409, the server controller 250 of the server device 200 may process control of the microphone function of each group. For example, in each user group, only the microphone of one user terminal may be controlled to be turned on, and the microphones of the remaining user terminals may be controlled to be turned off.

In step 411, the server control unit 250 of the server device 200 may check whether an event related to termination of the video conference support function occurs. Events related to termination of the video conferencing support function, for example, when a message requesting termination of a video conferencing channel is received or all participating terminals leave the video conferencing channel, the server control unit 250 determines that the video conferencing support function is terminated, and the video conferencing support function ends. You can end the conference channel. If there is no event related to the termination of the video conference support function, the server control unit 250 may branch to before step 403 and perform the following operation again.

5 is a diagram illustrating another example of a video conference support method according to an embodiment of the present invention.

Referring to FIG. 5 , in relation to the video conference support method, in step 501, the server control unit 250 of the server device 200 may perform video conference channel allocation. Channel allocation may include, for example, channel allocation related to virtual meeting room operation.

In step 503, the server control unit 250 of the server device 200 may check whether sound feedback is generated from user terminals participating in the virtual meeting room. In this regard, the server device 200 may receive information about the occurrence of acoustic feedback from participating terminals participating in the video conference (eg, user terminals 101, 102, 103, 104, 105, and 106 in FIG. 1). there is. Additionally, the server control unit 250 may receive information for identifying current location information from participating terminals together with identification information of each participating terminal. For example, the server control unit 250 may receive GPS location information of each participating terminal or access point information (or source IP address information) for Internet access.

In step 505, the server control unit 250 of the server device 200 may perform user grouping based on information received from participating terminals. For example, the server control unit 250 may determine, as one user group, user terminals having the same acoustic feedback generation time or occurring within a specified time period. Alternatively, the server control unit 250 may determine the corresponding user terminals as one user group when the source addresses of data transmitted by the user terminals are the same. Alternatively, the server controller 250 may receive GPS information from user terminals and determine user terminals having GPS information corresponding to the same location as the same user group. Alternatively, the server control unit 250 may determine the user group based on at least one of sound feedback occurrence time information, data origin address, and GPS information.

In step 507, the server controller 250 of the server device 200 may provide grouping information and control a microphone function. In this regard, the server control unit 250 may generate grouping visualization information (or a grouping screen) based on information about user grouping of participating terminals, and provide the generated grouping visualization information to participating terminals. In addition, the server control unit 250 may perform microphone function control in relation to video conference support of participating terminals. For example, the server control unit 250 may control to turn on only a microphone of one terminal among participating terminals belonging to each group. Participating terminals generate an input signal requesting microphone turn-on for speech input in response to user input and then provide it to the server device 200, and the server device 200 responds to the turn-on request of the corresponding participating terminal. The microphone may be turned on and the microphones of other participating terminals belonging to the same group may be controlled to be turned off.

Next, in step 509, the server control unit 250 of the server device 200 checks the occurrence of an event related to the end of the video conference, processes the end of the video conference according to the occurrence of the event, or branches before step 503 to perform the following operations. can be redone.

6 is a diagram illustrating an example of a screen interface related to video conference support according to an embodiment of the present invention.

Referring to FIGS. 1 to 6 , the video conference support screen may include a first group area 610 , a second group area 620 and a content display area 630 .

The first group area 610 includes, for example, first to third items corresponding to the first to third user terminals 101, 102, and 103 that perform a video conference function through the first access point 51. It may be an area where fields 601, 602, and 603 are disposed. In the first group area 610, the first to third items 601, 602, and 603 may indicate states of respective user terminals. For example, a first item 601 corresponding to the first user terminal 101 and a second item 602 corresponding to the second user terminal 102 may indicate a state in which the microphones of the corresponding terminals are turned off. . The third item 603 corresponding to the third user terminal 103 may indicate a state in which the microphone of the third user terminal 103 is turned on.

The second group area 620 includes, for example, fourth to sixth items corresponding to the fourth to sixth user terminals 104, 105, and 106 that perform a video conference function through the second access point 52. It may be an area where fields 604, 605, and 606 are disposed. In the second group area 620 , the fourth to sixth items 604 , 605 , and 606 may represent states of user terminals connected through the second access point 52 . For example, the fourth item 604 corresponding to the fourth user terminal 104 may indicate that the microphone of the fourth user terminal 104 is turned on. A fifth item 605 corresponding to the fifth user terminal 105 and a sixth item 606 corresponding to the sixth user terminal 106 may indicate a state in which microphones of corresponding terminals are turned off.

The content display area 630 may be an area where content shared by user terminals is displayed during a video conference. The shared content displayed on the content display area 630 is, for example, text or video provided for sharing by at least one of the first to sixth user terminals 101, 102, 103, 104, 105, and 106. may include at least some of them.

The video conference support screen may be displayed on each of the displays of the first to sixth user terminals 101 , 102 , 103 , 104 , 105 , and 106 . When at least one user terminal among the first to sixth user terminals 101, 102, 103, 104, 105, and 106 is disconnected, a corresponding item may be removed from the screen. Alternatively, when a new user terminal is accessed, an item corresponding to the new user terminal is added to the first group area 610 or the second group area 620 or disposed in the new group area according to the access location of the new user terminal. It can be. The server device 200 may control only one microphone to be turned on and operated for each of the first group area 610 and the second group area 620 separated by a distance at which acoustic feedback does not occur. To classify the first group area 610 and the second group area 620, the server device 200 may perform grouping of user terminals as described above with reference to FIGS. 4 and 5.

As described above, the method for supporting video conferencing according to the present invention, when manual or acoustic feedback occurs between online video conferencing user terminals, according to the space (e.g., sound output from a speaker of a specific user terminal is transmitted to the microphone of another user terminal). Spaces that are spaced apart enough to not be transmitted) are grouped and managed, and when one microphone in a group is turned on, the other microphones are turned off to block the occurrence of acoustic feedback. In addition, the method for supporting a video conference according to the present invention may display user terminals in a group in the same space on a screen and support turning on/off microphones between user terminals in a group.

As set forth above, this specification contains many specific implementation details, but these should not be construed as limiting on the scope of any invention or claimables, but rather may be specific to a particular embodiment of a particular invention. It should be understood as a description of the features in

Further, while operations are depicted in the drawings in a specific order, it should not be understood that all illustrated operations must be performed or that those operations must be performed in the specific order shown or in sequential order to obtain desired results. In certain cases, multitasking and parallel processing can be advantageous. Further, the separation of various system components in the embodiments described above should not be understood as requiring such separation in all embodiments, and the described program components and systems are generally integrated together into a single software product or packaged into multiple software products. You have to understand that it can be.

The present description presents the best mode of the invention and provides examples to illustrate the invention and to enable those skilled in the art to make and use the invention. The specification thus prepared does not limit the invention to the specific terms presented. Therefore, although the present invention has been described in detail with reference to the above-described examples, a person skilled in the art may make alterations, changes, and modifications to the present examples without departing from the scope of the present invention.

Therefore, the scope of the present invention should not be determined by the described embodiments, but by the claims.

10: video conferencing support system
50: network
51, 52: access point
51a, 52a: user group
100, 101, 102, 103, 104, 105, 106: user terminal
110: communication interface
120: input unit
130: audio processing unit
140: storage unit
150: processor
160: display
170: camera
200: server device
210: server communication interface
240: server memory
250: server control unit

Claims (10)

a server communication unit forming a communication channel with a plurality of user terminals;
a server storage unit for storing data related to video conference support of the plurality of user terminals;
A server control unit functionally connected to the server communication unit and the server storage unit;
The server control unit
Grouping the plurality of user terminals,
The server device for supporting video conferencing, characterized in that for controlling to turn on the microphone of one user terminal among the user terminals included in each of the grouped user groups and to turn off the microphones of the other user terminals. According to claim 1,
The server control unit
A server device for supporting video conferences, characterized in that providing a screen related to group selection to the plurality of user terminals and grouping the plurality of user terminals based on selection information of the plurality of user terminals. According to claim 1,
The server control unit
obtaining access address information of the plurality of user terminals, and grouping user terminals having the same access address into one user group based on the access address information;
A server device for supporting video conferencing, characterized in that for collecting information on occurrence of acoustic feedback of the plurality of user terminals, and grouping user terminals generating acoustic feedback at the same time or within a specified time point into one user group. According to claim 1,
The server control unit
Collect information about the occurrence of acoustic feedback of the plurality of user terminals and communication access address information of the plurality of user terminals;
A server device for supporting video conferences, characterized in that grouping user terminals having acoustic feedback at the same point in time or within a specified time point and user terminals having the same communication access address information into a user group. According to claim 1,
The server control unit
A server device for supporting video conferences, characterized in that creating a screen for displaying items corresponding to the plurality of user terminals in areas corresponding to user groups by dividing them, and providing the screen to the plurality of user terminals. . Opening, by a server processor of a server device supporting video conference, a virtual meeting room;
grouping the plurality of user terminals when a plurality of user terminals access the virtual meeting room;
and controlling to turn on the microphone of one of the user terminals included in each of the grouped user groups and to turn off the microphones of the remaining user terminals. . According to claim 6,
The grouping step is
providing a screen related to group selection to the plurality of user terminals;
and grouping the plurality of user terminals based on the selection information of the plurality of user terminals. According to claim 6,
The grouping step is
obtaining access address information of the plurality of user terminals and grouping user terminals having the same access address into one user group based on the access address information; or
and collecting information on generation of acoustic feedback from the plurality of user terminals, and grouping user terminals generating acoustic feedback at the same time or within a specified time point into one user group. According to claim 6,
The grouping step is
collecting information about the occurrence of acoustic feedback of the plurality of user terminals and communication access address information of the plurality of user terminals;
A method for supporting a video conference, comprising: grouping user terminals for which acoustic feedback has occurred within the same time point or a specified time point and user terminals having the same communication access address information into a user group. According to claim 6,
generating a screen displaying items corresponding to the plurality of user terminals in areas corresponding to user groups;
Providing the screen to the plurality of user terminals; video conference support method further comprising.

Images