KR20220004859A - System and method for web real-time communication based uncontact event service - Google Patents

Abstract

Provided is a system for providing a (web real-time communication WebRTC)-based non-face-to-face event service, which provides a platform two-way streaming a plurality of participants and an independent studio in real-time. According to the present invention, the system comprises: at least one participant terminal participating in and shooting a non-face-to-face event to transmit a video in real-time and receiving and outputting a studio video shot in an independent studio in real-time; at least one display provided to output the video received from at least one participant terminal, respectively; at least one camera shooting a host of a non-face-to-face event in the independent studio; and a non-face-to-face event service providing server including a participation request unit transmitting a participation request message to at least one participant terminal by using at least one type of medium, a storage unit storing one-to-one mapping information between at least one participant terminal and at least one display, a control unit receiving the video of at least one participant terminal in real-time on the basis of WebRTC and outputting the received video on the at least one display, and a transmission unit transmitting the video shot by the at least one camera to the at least one participant terminal on the basis of WebRTC.

Description

SYSTEM AND METHOD FOR WEB REAL-TIME COMMUNICATION BASED UNCONTACT EVENT SERVICE

The present invention relates to a WebRTC-based non-face-to-face event service providing system, and provides a platform for streaming in real time between a plurality of participants and an independent studio in order to host a non-face-to-face event.

As COVID-19 hits the world, there are signs that the economic and industrial paradigm will change from the ground up. The vitalization of the non-face-to-face industry has become a new daily routine and way of life. Economic and leisure activities that were previously conducted face-to-face are being converted to non-face-to-face services using innovative technologies such as remote video conferencing solutions. Radio wave technologies such as 5G are emerging as a key role for the vitalization and evolution of online-based services in the process of changing the economic life style to be non-face-to-face. This is expected to bring about a technological evolution that is different from the previous one in relation to services such as remote video conferencing and immersive content. will be the key

At this time, a method for implementing two-way video communication using wireless communication has been researched and developed. -0035312 (published on April 06, 2018), it is possible to restore lost packets even at a packet loss rate at a level that can occur in a general public Internet network or a mobile environment, not a dedicated network for video conferencing, and provides an interactive service In order to enable recovery of packet loss in a short time in real time, the transmitting device sequentially transmits a plurality of RTP (Real-time Transport Protocol) packets and a plurality of recovery packets, and the receiving device transmits a plurality of RTP packets and a plurality of recovery packets. A video codec device and WebRTC for performing video conferencing and video call functions such that a configuration for sequentially receiving recovery packets of A configuration of a video terminal for performing video communication with a video codec device through a web browser supporting (Web Real-Time Communication) is disclosed, respectively.

However, as non-face-to-face communication methods develop, people will want more beyond simple two-dimensional video conferencing, and augmented reality (AR) and virtual It will evolve in the direction of applying reality (VR), but the above-described configuration does not satisfy this. In addition, in addition to one-on-one video calls, it is required that a large number of audiences participate in a social distancing situation and connect them with an offline studio, but the configuration for this is not described. Furthermore, even in an indoor space called an offline studio, if a person who is in the incubation period of Corona participates, the possibility of contagion increases, so the meaning of social distancing may become invalid. Accordingly, research and development of a platform that can sustain life while maintaining a non-face-to-face state in the post-corona era is required.

In one embodiment of the present invention, social distancing is practiced by providing an offline independent studio and non-face-to-face events through real-time two-way video communication in situations where a large number of spectators or participants gather, such as events, events, and performances, and each country When people in the world participate in video communication, they help each country communicate by providing translated subtitles or simultaneous interpretation. It is possible to minimize the possibility of infection while making It is possible to provide a WebRTC-based non-face-to-face event service providing method that can build a perfect non-face-to-face environment by inserting a vibrating element so that others who meet in a real virtual environment can feel when shaking hands with the user. However, the technical task to be achieved by the present embodiment is not limited to the technical task as described above, and other technical tasks may exist.

As a technical means for achieving the above-described technical problem, one embodiment of the present invention is at least one of participating in a non-face-to-face event, photographing and transmitting participants in real time, and receiving and outputting studio images shot in an independent studio in real time. At least one participant terminal, at least one display provided to output an image received from at least one participant terminal one-to-one, at least one camera for photographing a non-face-to-face event host in an independent studio, and a participation request message to at least one participant terminal a participation request unit that transmits using at least one type of medium, a storage unit that maps and stores at least one participant terminal and at least one display one-to-one, Communication)-based non-face-to-face event service providing server comprising a control unit for controlling to receive in real time and output to at least one display and a transmission unit for transmitting an image captured by at least one camera to at least one participant terminal based on WebRTC include

Another embodiment of the present invention comprises the steps of delivering a participation request message to at least one participant terminal using at least one type of medium, mapping at least one participant terminal and at least one display installed in an independent studio one-to-one The step of storing, the step of receiving the video of at least one participant terminal in real time based on WebRTC (Web Real-Time Communication) and controlling to output it on at least one display, and the step of controlling the video captured by at least one camera to at least one participant and transmitting based on WebRTC to the terminal.

According to any one of the above-described problem solving means of the present invention, social distancing by providing an offline independent studio and conducting non-face-to-face events through real-time two-way video communication in situations where a large number of spectators or participants gather, such as events, events, and performances When people from each country participate via video communication, they help each country communicate by providing translated subtitles or simultaneous interpretation. It is possible to increase the sense of presence as if participating in the event, while zeroing the possibility of infection, and furthermore, it provides an offline independent studio as virtual reality (VR), modeling each participant in 3D and then capturing the motion to give a sense of realism as if they were meeting in real life. By inserting a vibrating element into the capture suit, it is possible to build a perfect non-face-to-face environment by allowing others to feel when shaking hands with the user in a real virtual environment, which is a threat to public health in the post-corona era. By preventing the occurrence and prevalence of infectious diseases, it can contribute to the promotion and maintenance of public health.

1 is a diagram for explaining a WebRTC-based non-face-to-face event service providing system according to an embodiment of the present invention.
FIG. 2 is a block diagram illustrating a non-face-to-face event service providing server included in the system of FIG. 1 .
3 is a diagram for explaining an embodiment in which a WebRTC-based non-face-to-face event service according to an embodiment of the present invention is implemented.
FIG. 4 is a diagram illustrating a process in which data is transmitted/received between components included in the WebRTC-based non-face-to-face event service providing system of FIG. 1 according to an embodiment of the present invention.
5 is an operation flowchart illustrating a method for providing a WebRTC-based non-face-to-face event service according to an embodiment of the present invention.

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS Hereinafter, embodiments of the present invention will be described in detail with reference to the accompanying drawings so that those of ordinary skill in the art can easily implement them. However, the present invention may be embodied in several different forms and is not limited to the embodiments described herein. And in order to clearly explain the present invention in the drawings, parts irrelevant to the description are omitted, and similar reference numerals are attached to similar parts throughout the specification.

Throughout the specification, when a part is "connected" with another part, this includes not only the case of being "directly connected" but also the case of being "electrically connected" with another element interposed therebetween. . In addition, when a part "includes" a certain component, it means that other components may be further included, rather than excluding other components, unless otherwise stated, and one or more other features However, it is to be understood that the existence or addition of numbers, steps, operations, components, parts, or combinations thereof is not precluded in advance.

The terms "about", "substantially", etc. to the extent used throughout the specification are used in or close to the numerical value when manufacturing and material tolerances inherent in the stated meaning are presented, and are intended to enhance the understanding of the present invention. To help, precise or absolute figures are used to prevent unfair use by unconscionable infringers of the stated disclosure. As used throughout the specification of the present invention, the term "step of (to)" or "step of" does not mean "step for".

In this specification, a "part" includes a unit realized by hardware, a unit realized by software, and a unit realized using both. In addition, one unit may be implemented using two or more hardware, and two or more units may be implemented by one hardware. Meanwhile, '~ unit' is not limited to software or hardware, and '~ unit' may be configured to be in an addressable storage medium or to reproduce one or more processors. Thus, as an example, '~' denotes components such as software components, object-oriented software components, class components, and task components, and processes, functions, properties, and procedures. , subroutines, segments of program code, drivers, firmware, microcode, circuitry, data, databases, data structures, tables, arrays and variables. The functions provided in the components and '~ units' may be combined into a smaller number of components and '~ units' or further separated into additional components and '~ units'. In addition, components and '~ units' may be implemented to play one or more CPUs in a device or secure multimedia card.

Some of the operations or functions described as being performed by the terminal, apparatus, or device in the present specification may be performed instead of by a server connected to the terminal, apparatus, or device. Similarly, some of the operations or functions described as being performed by the server may also be performed in a terminal, apparatus, or device connected to the server.

In this specification, some of the operations or functions described as mapping or matching with the terminal means mapping or matching the terminal's unique number or personal identification information, which is the identification data of the terminal. can be interpreted as

Hereinafter, the present invention will be described in detail with reference to the accompanying drawings.

1 is a diagram for explaining a WebRTC-based non-face-to-face event service providing system according to an embodiment of the present invention. Referring to FIG. 1 , the WebRTC-based non-face-to-face event service providing system 1 includes at least one participant terminal 100 , a non-face-to-face event service providing server 300 , at least one display 400 , and at least one camera. 500 , an HMD 600 , and a motion capture suit 700 . However, since the WebRTC-based non-face-to-face event service providing system 1 of FIG. 1 is only an embodiment of the present invention, the present invention is not limitedly interpreted through FIG. 1 .

At this time, each component of FIG. 1 is generally connected through a network 200 . For example, as shown in FIG. 1 , at least one participant terminal 100 may be connected to the non-face-to-face event service providing server 300 through the network 200 . In addition, the non-face-to-face event service providing server 300 may be connected to at least one participant terminal 100 , at least one display 400 , and at least one camera 500 through the network 200 . In addition, the at least one display 400 may be connected to the non-face-to-face event service providing server 300 through the network 200 . In addition, the at least one camera 500 may be connected to the non-face-to-face event service providing server 300 and the at least one display 400 through the network 200 . The HMD 600 may be connected to the participant terminal 100 through the network 200 . Finally, the motion capture suit 700 may be connected to the participant terminal 100 .

Here, the network refers to a connection structure in which information exchange is possible between each node, such as a plurality of terminals and servers, and an example of such a network includes a local area network (LAN), a wide area network (WAN: Wide Area Network), the Internet (WWW: World Wide Web), wired and wireless data communication networks, telephone networks, wired and wireless television networks, and the like. Examples of wireless data communication networks include 3G, 4G, 5G, 3rd Generation Partnership Project (3GPP), 5th Generation Partnership Project (5GPP), Long Term Evolution (LTE), World Interoperability for Microwave Access (WIMAX), Wi-Fi (Wi-Fi) , Internet, LAN (Local Area Network), Wireless LAN (Wireless Local Area Network), WAN (Wide Area Network), PAN (Personal Area Network), RF (Radio Frequency), Bluetooth (Bluetooth) network, NFC ( Near-Field Communication) networks, satellite broadcast networks, analog broadcast networks, Digital Multimedia Broadcasting (DMB) networks, and the like are included, but are not limited thereto.

In the following, the term at least one is defined as a term including the singular and the plural, and even if the at least one term does not exist, each element may exist in the singular or plural, and may mean the singular or plural. it will be self-evident In addition, that each component is provided in singular or plural may be changed according to embodiments.

At least one participant terminal 100 is a terminal that is connected to the non-face-to-face event service providing server 300 using a WebRTC-based non-face-to-face event service related web page, app page, program or application, and transmits and receives real-time interactive images can In addition, at least one participant terminal 100 may be a terminal that receives virtual reality content from the non-face-to-face event service providing server 300 and outputs it to the HMD 600 when the independent studio is configured as a virtual reality independent studio. have. In addition, at least one participant terminal 100, when a 3D live-action character is created, is connected to the motion capture suit 700, the motion captured so that the body motion received from the motion capture suit 700 is executed in the 3D live-action character. It may be a terminal that transmits data to the non-face-to-face event service providing server 300 . And, when at least one participant terminal 100 has a protrusion such as a villi provided inside the motion capture suit 700 and a vibrating element is provided on the bottom surface thereof, between the 3D live-action characters, that is, between the participant terminals 100 When there is contact, it may be a terminal that transmits data to the motion capture suit 700 so that the vibration element is output at a corresponding position of the motion capture suit 700 .

Here, the at least one participant terminal 100 may be implemented as a computer capable of accessing a remote server or terminal through a network. Here, the computer may include, for example, navigation, a laptop equipped with a web browser, a desktop, and a laptop. In this case, the at least one participant terminal 100 may be implemented as a terminal capable of accessing a remote server or terminal through a network. At least one participant terminal 100 is, for example, a wireless communication device that guarantees portability and mobility, including navigation, Personal Communication System (PCS), Global System for Mobile communications (GSM), Personal Digital Cellular (PDC), PHS(Personal Handyphone System), PDA(Personal Digital Assistant), IMT(International Mobile Telecommunication)-2000, CDMA(Code Division Multiple Access)-2000, W-CDMA(W-Code Division Multiple Access), Wibro(Wireless Broadband Internet) ) terminal, a smart phone, a smart pad, a tablet PC, etc. may include all kinds of handheld-based wireless communication devices.

The non-face-to-face event service providing server 300 may be a server that provides a WebRTC-based non-face-to-face event service web page, an app page, a program, or an application. And, the non-face-to-face event service providing server 300 is connected to at least one display 400 and at least one camera 500, and transmits a participation request message to at least one participant terminal 100, and the response is When on, it may be a server that stores at least one participant terminal 100 and at least one display 400 to be mapped one-to-one. In addition, the non-face-to-face event service providing server 300 takes pictures of a moderator through at least one camera 500 when an independent studio is provided offline, and WebRTC so that the result is output from at least one participant terminal 100 . It may be a server that streams or transmits shooting data based on (Web Real-Time Communication). And, the non-face-to-face event service providing server 300 may be a server that generates a 3D live-action character from 2D data of at least one participant when the independent studio is configured as a virtual reality studio, and a motion capture suit 700 ) may be a server that controls the 3D live-action character to move in the virtual reality studio to correspond to the captured motion data. In addition, the non-face-to-face event service providing server 300 is, in the virtual reality studio, contact between participants or between a participant and a moderator, that is, a 3D live-action character of a participant and a 3D live-action character of another participant shake hands, or a 3D live-action character of a participant When the 3D live-action character of the and the host touch each other, the motion capture suit 700 may be a server that vibrates protrusions such as villi formed inside the vibration element to reproduce the feeling of touch or handshake. In addition, the non-face-to-face event service providing server 300 transmits the virtual reality content of the virtual reality studio to the HMD 600 via the participant terminal 100, thereby transferring the HMD 600 as an output device and an input/output device (input: motion). It may be a server using the motion capture suit 700 as capture, output: protrusion vibration).

Here, the non-face-to-face event service providing server 300 may be implemented as a computer capable of accessing a remote server or terminal through a network. Here, the computer may include, for example, navigation, a laptop equipped with a web browser, a desktop, and a laptop.

The at least one display 400 may be a panel such as an LCD, PDP, or LED using a WebRTC-based non-face-to-face event service related web page, an app page, a program or an application. At this time, at least one display 400 is given an ID or unique identification code that can be identified, respectively, and when the non-face-to-face event service providing server 300 maps and stores it with at least one participant terminal 100, at least It may be a panel for receiving and outputting photographed data captured by one participant terminal 100 in real time.

Here, the at least one display 400 may be implemented as a computer that can access a remote server or terminal through a network. Here, the computer may include, for example, navigation, a laptop equipped with a web browser, a desktop, and a laptop. In this case, the at least one display 400 may be implemented as a terminal capable of accessing a remote server or terminal through a network. The at least one display 400 is, for example, a wireless communication device that ensures portability and mobility, such as navigation, Personal Communication System (PCS), Global System for Mobile communications (GSM), Personal Digital Cellular (PDC), and PHS. (Personal Handyphone System), PDA (Personal Digital Assistant), IMT (International Mobile Telecommunication)-2000, CDMA (Code Division Multiple Access)-2000, W-CDMA (W-Code Division Multiple Access), Wibro (Wireless Broadband Internet) It may include all types of handheld-based wireless communication devices such as terminals, smartphones, smartpads, and tablet PCs.

At least one camera 500 transmits the shooting data of the host or independent studio using a WebRTC-based non-face-to-face event service related web page, app page, program or application to the non-face-to-face event service providing server 300 , It may be a device that enables output from at least one participant terminal 100 . In this case, the at least one camera 500 may be a camera capable of performing control such as up/down/left/right or tilting at a remote location, and may include a thermal imaging camera that captures the temperature of a person.

Here, the at least one camera 500 may be implemented as a computer that can connect to a remote server or terminal through a network. Here, the computer may include, for example, navigation, a laptop equipped with a web browser, a desktop, and a laptop. In this case, the at least one camera 500 may be implemented as a terminal capable of accessing a remote server or terminal through a network. The at least one camera 500 is, for example, a wireless communication device that guarantees portability and mobility, such as navigation, Personal Communication System (PCS), Global System for Mobile communications (GSM), Personal Digital Cellular (PDC), and PHS. (Personal Handyphone System), PDA (Personal Digital Assistant), IMT (International Mobile Telecommunication)-2000, CDMA (Code Division Multiple Access)-2000, W-CDMA (W-Code Division Multiple Access), Wibro (Wireless Broadband Internet) It may include all types of handheld-based wireless communication devices such as terminals, smartphones, smartpads, and tablet PCs.

The HMD 600 may be a device for outputting virtual reality content using a WebRTC-based non-face-to-face event service related web page, an app page, a program, or an application. In addition, the HMD 600 may be connected to the participant terminal 100 and configured to output the virtual reality content received from the non-face-to-face event service providing server 300 in the participant terminal 100 .

Here, the HMD 600 may be implemented as a computer capable of accessing a remote server or terminal through a network. Here, the computer may include, for example, navigation, a laptop equipped with a web browser, a desktop, and a laptop. In this case, the HMD 600 may be implemented as a terminal capable of accessing a remote server or terminal through a network. The HMD 600 is, for example, a wireless communication device that ensures portability and mobility, and includes navigation, a personal communication system (PCS), a global system for mobile communications (GSM), a personal digital cellular (PDC), and a personal handyphone (PHS). System), PDA (Personal Digital Assistant), IMT (International Mobile Telecommunication)-2000, CDMA (Code Division Multiple Access)-2000, W-CDMA (W-Code Division Multiple Access), Wibro (Wireless Broadband Internet) terminal, smart It may include all kinds of handheld-based wireless communication devices such as a smartphone, a smartpad, and a tablet PC.

The motion capture suit 700 is a device that captures the motion of the wearer, such as a participant or host, using a WebRTC-based non-face-to-face event service related web page, app page, program or application and transmits it to the non-face-to-face event service providing server 300 . can be At this time, the motion capture suit 700, in addition to the general motion capture suit 700, has a protrusion such as a villi in the intestine is formed therein, and the lower surface of the protrusion further includes a vibrating element at preset intervals, It may be a device that outputs contact data such as contact of another participant or handshake with a host from the non-face-to-face event service providing server 300 via the participant terminal 100 .

Here, the motion capture suit 700 may be implemented as a computer capable of accessing a remote server or terminal through a network. Here, the computer may include, for example, navigation, a laptop equipped with a web browser, a desktop, and a laptop. In this case, the motion capture suit 700 may be implemented as a terminal capable of accessing a remote server or terminal through a network. The motion capture suit 700 is, for example, a wireless communication device that guarantees portability and mobility, such as navigation, Personal Communication System (PCS), Global System for Mobile communications (GSM), Personal Digital Cellular (PDC), and PHS ( Personal Handyphone System), PDA (Personal Digital Assistant), IMT (International Mobile Telecommunication)-2000, CDMA (Code Division Multiple Access)-2000, W-CDMA (W-Code Division Multiple Access), Wibro (Wireless Broadband Internet) terminal , may include all types of handheld-based wireless communication devices such as smartphones, smartpads, and tablet PCs.

2 is a block diagram for explaining a non-face-to-face event service providing server included in the system of FIG. 1, and FIG. 3 describes an embodiment in which a WebRTC-based non-face-to-face event service is implemented according to an embodiment of the present invention. It is a drawing for

Referring to FIG. 2 , the non-face-to-face event service providing server 300 includes a participation request unit 310 , a storage unit 320 , a control unit 330 , a transmission unit 340 , a communication support unit 350 , and a contact transmission unit. 360 , a camera control unit 370 , a splash distance calculation unit 380 , a souvenir providing unit 390 , and a database conversion unit 391 may be included.

The non-face-to-face event service providing server 300 or other server (not shown) operating in conjunction according to an embodiment of the present invention includes at least one participant terminal 100 , at least one display 400 , and at least one camera. When transmitting a WebRTC-based non-face-to-face event service application, program, app page, web page, etc. to the 500, the HMD 600 and the motion capture suit 700, at least one participant terminal 100, at least one display 400 , at least one camera 500 , HMD 600 , and motion capture suit 700 may install or open a WebRTC-based non-face-to-face event service application, program, app page, web page, and the like. In addition, using a script executed in a web browser, the service program is at least one participant terminal 100 , at least one display 400 , at least one camera 500 , HMD 600 and a motion capture suit 700 . It can also be driven in Here, the web browser is a program that enables the use of a web (WWW: World Wide Web) service, and refers to a program that receives and displays hypertext written in HTML (Hyper Text Mark-up Language), for example, Netscape. , Explorer, Chrome, and the like. In addition, the application means an application on the terminal, for example, includes an app (App) executed in a mobile terminal (smartphone).

Referring to FIG. 2 , the participation request unit 310 may transmit a participation request message to at least one participant terminal 100 using at least one type of medium. In this case, the at least one type of medium may be e-mail, SMS, MMS, call, social media, etc., but is not limited to the listed ones and is not excluded for reasons not listed.

The storage unit 320 may store the one-to-one mapping between the at least one participant terminal 100 and the at least one display 400 . Accordingly, the at least one display 400 may output the image received from the at least one participant terminal 100 on a one-to-one basis.

The controller 330 may control to receive an image of the at least one participant terminal 100 in real time based on Web Real-Time Communication (WebRTC) and output it to the at least one display 400 . In this case, the at least one participant terminal 100 may participate in a non-face-to-face event, photograph and transmit a participant in real time, and receive and output a studio image photographed in an independent studio in real time.

The transmitter 340 may transmit an image captured by the at least one camera 500 to the at least one participant terminal 100 based on WebRTC. At least one camera 500 may photograph a non-face-to-face event host in an independent studio. At this time, WebRTC (Web Real-Time Communication) is a protocol proposed by W3C that helps enable real-time communication such as voice and video without a separate plug-in. It does not require a separate plug-in and provides low latency. have. WebRTC is an open source project and has a mesh, SFU (Selective Forwarding Unit), and MCU (Multi-point Control Unit) structure. The mesh structure is a method in which each node connects one-to-one to exchange data like the p2p method, and the SFU and MCU have a structure in which multiple nodes communicate and a central server exists. The SFU structure is a method of distributing and communicating data in the central server without processing, and the MCU structure is a method of communicating data by processing the data in the central server. Since the communication method is different for each model, it is possible to find a method suitable for each model and use it. In the case of real-time streaming, it is necessary to communicate with a large number of users through a central server, and delay time is an important factor, so in one embodiment of the present invention, real-time streaming that can be accessed by two or more users by utilizing the SFU method can be used.

At this time, the transmitting unit 340 of the present invention has a structure in which each other acts as a broadcaster for live streaming between the participants and transmits and receives the corresponding video and chatting to each other. At this time, chat and streaming are provided on one screen, but may be configured to operate through a file made of javascript and java, respectively, and the transmission unit 340 may request live streaming transmission, and the ID of each participant terminal 100 You can register to support normal transmission and make a list so that receivers can access the streaming. After that, the receivers can freely access the live streaming being broadcast, access the desired streaming channel, watch the same video with the sender and other receivers, and share opinions through chatting.

Alternatively, when transmitting from the transmitter 340 to the participant terminal 100 , the real-time streaming may be interrupted or delayed due to differences in networking resources and computing resources of each participant terminal 100 . Accordingly, the transmitter 340 may use HTTP adaptive streaming to ensure Quality of Experience (QoE). For HTTP adaptive streaming, the transmission unit 340 may encode a video captured by at least one camera 500 in the form of segments to have various qualities. Information about the segment and the video may be stored in the transmitter 340 as a media presentation description (MPD) file. Through this, at least one participant terminal 100 requests the MPD file from the transmitter 340 when real-time streaming starts. The participant terminal 100 requests the next segment by using the segment information and the network status information described in the MPD file. HTTP adaptive streaming can provide a seamless streaming service to users because it adaptively determines the quality of a video segment to be requested according to network conditions.

At this time, if the bandwidth cannot be accurately predicted in HTTP adaptive streaming, a problem occurs when requesting the next segment. If the bandwidth is predicted to be larger than the actual bandwidth, a segment with a higher quality than the quality suitable for the network situation is downloaded, increasing the buffer consumption and the probability of interruption of playback. If the bandwidth is predicted to be smaller than the actual bandwidth, a segment with a lower quality than the requested quality is downloaded, and the bandwidth is not fully utilized. When the bandwidth is frequently changed, an unnecessary quality change may occur and thus a problem of lowering QoE may occur. In an embodiment of the present invention, a change pattern recognition bandwidth prediction technique for QoE improvement of HTTP adaptive streaming can be used. have.

According to an embodiment of the present invention, the transmitter 340 may minimize QoE degradation by performing bandwidth prediction optimized for the bandwidth fluctuation pattern. The transmitter 340 may estimate the bandwidth so that a constant quality can be requested when the bandwidth fluctuation is frequent. The transmitter 340 may predict the bandwidth by adjusting the responsiveness to the change in the available network bandwidth for accurate prediction when the bandwidth change is not frequent. The transmitter 340 may classify the bandwidth fluctuation pattern into a short-term fluctuation pattern in which bandwidth fluctuation is frequent and a long-term fluctuation pattern in which bandwidth fluctuation is not frequent. In order to distinguish a bandwidth fluctuation pattern, a short section is set while a segment is being downloaded, and the actual bandwidth (sTP _j ⁱ ) can be measured for each section. In an embodiment of the present invention, the actual bandwidth sTP _j ⁱ may be defined as the bandwidth during sub-download and may be measured as in Equation 1 below.

i is the index (Index, i) of the segment being downloaded, j is the index of the sub-download section, T is the length of the sub-download section, and sSi is the throughput during T. Fluctuation Factor (FF) indicating the degree of bandwidth fluctuation may be defined as in Equation 2 below.

x is the number of segments reflected in the bandwidth fluctuation pattern classification, and Di is the download time of the i-th segment. As the number of reflected segments increases, the accuracy of distinguishing bandwidth fluctuation patterns improves, but the time it takes to distinguish them increases, resulting in a trade-off with poor real-time performance. If the Fluctuation Factor (FF) is greater than the set threshold, it is determined as a short-term fluctuation pattern. In the short-term fluctuation pattern, when the bandwidth is predicted according to the changing bandwidth, an unnecessary quality change occurs, resulting in a problem of lowering QoE. In addition, playback interruption occurs because the quality is adjusted without considering the buffer occupancy when predicting the bandwidth. In order to prevent unnecessary quality change, the bandwidth is predicted as in Equation 3 below so that a segment of a constant quality can be requested.

m means the total number of sub-download sections, and TP ^E i means the predicted bandwidth when downloading the i-th segment. When the bandwidth is predicted as in Equation 3, unnecessary quality changes can be prevented and playback interruption can be minimized by making the buffer consumption constant. If the Fluctuation Factor (FF) is smaller than the set threshold, it is determined as a long-term fluctuation pattern. In the long-term fluctuation pattern, accurate bandwidth prediction is important. If the bandwidth is predicted to be larger than the actual bandwidth, a segment with a higher quality than the quality suitable for the network situation is downloaded, increasing the buffer consumption and the probability of interruption of playback. If the bandwidth is predicted to be smaller than the actual bandwidth, a segment with a lower quality than the requestable quality is downloaded, resulting in a problem that the bandwidth cannot be fully utilized. In addition, a lot of low-quality segments are accumulated in the buffer, which increases the delay until quality change and lowers the average quality, which lowers QoE. In the long-term fluctuation pattern, an embodiment of the present invention predicts the bandwidth as shown in Equation 4 below by adjusting the responsiveness to a change in the available network bandwidth.

α and β are parameters that determine the reactivity, and TPi is the bandwidth measured using the size Si of the i-th segment and the download time Di as shown in Equation 5 below. If the bandwidth is in a decreasing trend, the ratio of reflecting the previous bandwidth value is increased by increasing the α value. In case the bandwidth is increasing, the ratio of reflecting the currently measured bandwidth value is increased by increasing the β value.

Of course, in addition to the above-described method, a method of determining a flexible transfer rate in consideration of the available capacity of the computing resource as well as the networking resource may be used, and the method is not limited thereto.

In addition, an embodiment of the present invention may use HTML5 capable of streaming without installing a separate program, and the real-time streaming link may be an HTML5-based link. Here, HTML5 is the latest standard of HTML (Hyoer Text Markup Language), which is a web document standard, and includes a function of executing pictures, videos, and music in the center of document creation. HTML5 eliminates the need to separately install programs such as plug-in-based Active-X and Flash, and most of the problems caused by this can be solved. At this time, the biggest difference between the conventional HTML standard and HTML5 is that semantic markup is supported and an additional API is provided. Semantic markup is a new element that can semantically structure web documents. For example, if a document is created with elements such as <head>, <section>, and <footer> so that the contents of the document can be divided into header, body, and footer, the contents of the document can be clearly understood structurally. In addition, HTML5 provides various APIs. The API provided by HTML5 allows you to add various functions to web applications, such as supporting 2D graphics or checking the geographic location of a device.

In addition, HTML5 is a markup language used to create web pages, and it can express and provide HTML, which used to be displayed as hyperlinks and texts, to various applications such as multimedia. HTML5 can be implemented including HTML, a markup language for web document structure design, CSS for design expression, JavaScript for expressing interactive action, etc., and new tags are added to existing HTML tags. More can be added, and the structure to contain contents can be improved to even perform the role of a platform. Also, although HTML5 is not a standard for the mobile web, it provides many functions necessary for the implementation of the mobile web among the various functions described above. Two-dimensional graphics, audio, and various web forms can enrich and diversify the UI (User Interface) of the mobile web. That is, it is possible to provide multimedia information or support a user's dynamic interaction even in a mobile web environment. In the mobile web environment, there is a limitation in transmitting large amounts of data due to the nature of the mobile environment, and an environment in which the Internet is not connected frequently occurs. Alternatively, you can store the DB locally and query it with an SQL statement.

The communication support unit 350, when the language of the at least one participant terminal 100 is different or the language of the host of the independent studio is different from the language of the at least one participant terminal 100, the language of the host of the independent studio and A result of real-time translation or interpretation between languages of at least one participant terminal 100 may be provided as subtitles or audio. Real-time interpretation may further include an interpretation terminal (not shown), and real-time translation may use various translation programs, so it will not be described in detail in the specification of the present invention.

On the other hand, in the WebRTC-based non-face-to-face event service providing system 1, the independent studio may be virtual content built in virtual reality, and the HMD 600 may include at least one participant and at least one moderator within the virtual content. You can output virtual content for viewing in independent studios. In this case, the motion capture suit 700 may be provided to capture the motions of at least one participant and at least one host to apply the captured motion to a preset 3D live-action character. At this time, motion capture refers to the operation of recording the movement of the human body immediately or with a slight time difference. It refers to the operation of transferring the position information of an object to a computer character based on recorded information so that the movement of the human body can be expressed as a computer character as it is. By using motion capture, a character modeled in 3D can move naturally without complicated mathematical calculations. At this time, there are a mechanical method, a magnetic field method, and an optical method for the motion capture method. In an embodiment of the present invention, an optical method is used.

Here, the optical method is a method of recognizing a marker, which is an optical sensor (reflector) attached to a person or object with an infrared camera. The reason for using the optical method in an embodiment of the present invention is not limited in operation. , because it supports real-time. An optical motion capture device should be used in a space with a space of at least 6m in width and height. Therefore, data generation may become difficult.

For optical motion capture, HiRES camera, Cube, Wand, Calibration, which has various video speeds and resolutions that capture 60~240 frames per second, and can scan without distortion or distortion for ultra-high resolution. , scale) tools may be required. At this time, the Cube is used for the construction of absolute coordinates in the 3D coordinate system, and is an essential tool for the next step, Wand calibration. The wand determines the internal factors including the relative coordinate position of the camera and the origin actual focal length principal point. That is, it sets the 3D capture range of the camera, and various wands can be selected according to the size of the capture target.

In addition, the marker is a small ball-shaped coin-shaped styrofoam or sponge that acts as a sensor in the joint part of the movement of a person or an animal, and a material that can reflect infrared is attached. In one embodiment of the present invention, the motion capture suit It is attached to 700 and reflects infrared light around the lens, allowing it to track movement or motion. Here, the motion capture suit 700 is a motion capture-only outfit designed to facilitate the attachment of markers and camera shooting of the attached markers. It has good elasticity and activity, is designed to release moisture and is comfortable for breathing, and the outer surface of the suit can be made of high-adhesive fibers to make it easy to attach markers. may be provided.

In addition, a 3D live-action character is required, which may be the result of 3D modeling of a character from a 2D photo or video taken by a participant or a moderator. A 3D scanner is generally required for 3D modeling, but since each participant does not have a machine that can use a 3D scanner at home, installing them all or asking them to come out of the house to use the 3D scanner is not Not appropriate in the Corona situation. Accordingly, an algorithm for obtaining 3D data from a 2D image can be used, and an edge detection process is performed after schematically transforming the 2D image into a gray image. It is used to create 3D data for only the outer line of the image, and creates the front and back sides for the 3D spatial side and completes the 3D image. Hereinafter, a method of creating a 3D photorealistic model with a 2D image will be described in detail.

The first step is a segmentation step. Segmentation is the first step to transform a 2D image into 3D data. Segmentation is to find the object area of the 2D image and separate it from the background part and the foreground part when converting from a 2D image taken by a participant or a moderator to a 3D model. To this end, the foreground and background of the image are separated. Separation of the foreground and background of a simple model can be separated by a relatively simple method, but a figure with a rather complicated outline requires a rather complicated operation when separating the foreground and background. . There are many different methods for separating the foreground and the background. In an embodiment of the present invention, a method of detecting an edge and detecting an area using a Waterfront algorithm may be used.

It is assumed that the 2D image used for 3D modeling is an image with a blank space outside the central figure in order to make it relatively easy to separate the foreground image. If there is no blank space, a blank space is randomly created to separate the foreground and the background. Under this assumption, since there is no information in the background part, an edge is detected to detect a boundary region. Edge Detection is a technique widely used in image processing in terms of reducing data size, removing meaningless data, and preserving structural information of images. Since most edge extraction masks are sensitive to noise, even a small noise is considered as an edge and extracted in many cases. The method to compensate for the shortcomings of this part is the edge extraction technique using the Canny mask, which makes it insensitive to noise and allows effective edge extraction.

If the background image is expressed as the sea, the waterfront algorithm can be regarded as an island, and the waterfront algorithm detects the boundary between the sea and the island. For example, assuming that seawater flows only in the horizontal and vertical axes, when water flows only in the horizontal right direction and the vertical downward direction from the top, the flow of water stops at the part where the edge meets. Areas where water passes are classified as backgrounds. Next, find the lowermost position, not the background, and classify it as the background until it meets the edge when water flows in the horizontal left and vertical directions. This is called one cycle, and the algorithm is terminated when the background is no longer detected. Foreground and background can be accurately classified over multiple cycles.

The foreground region separated from the background using the Waterfront algorithm is labeled by the foreground region segmentation method. This is to compose the entire 3D model by combining relatively simple models in order to make a complex figure into a 3D model. Foreground segmentation is similar to the Waterfront algorithm. When moving in the horizontal right direction and the vertical right direction at the top of the part to which no labeling is applied, the background area and the area to the contact point become the same labeling area. Next, the vertices are distributed. 3D models are created separately for each same label, and the final model is composed of the whole by combining them. Using this method, it is possible to construct a model of a complex figure. The distribution of vertices subdivides the labeling area into certain sections. For example, the same number of vertices may be allocated to the same horizontal axis with respect to the horizontal axis. When the region is small, the vertex spacing becomes smaller, and when the region is wide, the vertex spacing becomes wider. The higher the number of vertices allocated to the same horizontal axis, the higher the 3D model becomes.

Since the same number of vertices exist on the same horizontal axis, a triangular surface can be constructed according to a uniform rule using three vertices. For example, if there are 10 vertices in the line on the left side of the face, 10 vertices can also be assigned to the line on the right side of the face, and a face can be configured according to a certain rule. In this case, the front and back sides can be set by the 3D conversion formula, and the degree of protrusion can be adjusted by using the image brightness information of the vertices generated in the vertex readjustment step as a height map. Of course, in addition to the above-described method, methods for creating a 3D live-action character may vary and are not limited to the above-described method, and any method capable of creating a 3D live-action character from a 2D photo or image is possible.

In this case, the motion capture suit 700 may be a two-way communication-based suit in which a protrusion such as a villi is formed therein, and a vibrating element is included at a preset interval. Accordingly, when there is a contact between at least one participant and a 3D live-action character corresponding to at least one moderator on the virtual content, the contact transfer unit 360 protrudes to the vibration waveform and vibration intensity pre-stored in the type of contact. can vibrate. In other words, in a non-face-to-face event, you can only confirm the existence of each other only through video, but you cannot feel a sense of reality or mutual contact where you can meet and shake hands or feel the atmosphere. In this case, the endothelium of the motion capture suit 700 may have protrusions made to mimic the shape of the villi of the intestine toward the inner direction. At this time, the vibrating element is disposed at a predetermined interval between the protrusion and the endothelium. Accordingly, when participant A's character taps on the shoulder of participant B's character, based on the tapped position (shoulder) and its strength (proportional to speed and weight), the shoulder portion of participant B's motion capture suit 700 is The vibrating element is made to vibrate with the voltage and current, but the number of times the shoulder is tapped is set to the vibration cycle so that even when participant A and participant B do not meet directly, it may be provided to give physical force by body contact. If, in addition to the vibrating element, it is possible to further add a configuration for applying pressure in a manner of increasing the air pressure in the protrusion. For example, if Participant A shakes hands with Participant B, and Participant A grabs it tighter, the air pressure on the bumps located on Participant B's finger is increased to inflate the bumps. to make it feel In this case, the protrusion may be made of rubber or latex, but is not limited thereto.

The camera control unit 370 may form a channel to remotely control at least one type of movement including up, down, left, and right of the at least one camera 500 . Since various programs for remotely controlling the camera are already known, it will be obvious that various programs may be used according to an embodiment without being limited to any one program, and will not be described in detail herein.

In this case, the at least one camera 500 includes a thermal imaging camera 500, and the droplet distance calculating unit 380 extracts saliva secreted from the mouth of the at least one host through the thermal imaging camera 500, , it is possible to provide the minimum distance between each facilitator based on the distance and angle from which the needle is extracted. While maintaining social distancing, each participant connects via online video, but the moderators (moderators) can be seen sitting close to each other and talking or conducting. Due to the unusual situation of broadcasting, each host cannot wear a mask, so you can see them sitting close to each other and talking while spitting, which is undesirable not only for the health of the host but also for the safety of all the people. Accordingly, in the method according to an embodiment of the present invention, the minimum distance to sit apart from each other can be informed by measuring the spitting distance with a thermal imaging camera, and the presenter can stand or sit by keeping the distance.

In this case, a thermal imaging camera is a technology for synthesizing images by detecting infrared rays generated from the surface of an object using an infrared image. Thermal imaging cameras can be used in a variety of applications, including non-destructive inspection of objects using thermal data and temperature distribution, as well as radiology using deep learning. Infrared thermography technology is a non-contact temperature measurement method that uses an infrared image to measure the intensity radiated in the infrared electromagnetic spectrum region to capture, display, and record heat on the surface of an object. A non-contact temperature measuring device can be used to measure the temperature of a fine surface, or in the case of a moving object, or when direct contact is not possible with conventional temperature measurement methods. The most representative device for measuring temperature using infrared is a pyrometer, which can measure the temperature of only one point. On the other hand, infrared or thermal imaging cameras can obtain more information, such as measuring the maximum/minimum and average temperature within a region of interest (ROI) as well as the temperature of a point. At this time, when the droplet is splashed, it is caught by the thermal imaging camera because the droplet is splashed with the same body temperature as the human body. The speed, intensity, and amount of salivation varies from person to person. Accordingly, it is possible to measure the distance at which the droplet bounces for each presenter, and allow the presenter to keep the distance by that distance.

The souvenir providing unit 390 may collect address information from at least one participant terminal 100 , and may request delivery and place an order request to the online shopping mall so that a preset participation souvenir can be delivered using the collected address information. In this case, the souvenir providing unit 390 may collect address information from each participant terminal 100 , and may place an order for souvenirs by courier in the online shopping mall.

The database conversion unit 391 may establish a one-stop process including planning, design, directing, operation, and result reporting of non-face-to-face events. It is possible to use the cloud service that is linked with the employee terminals for each part and unifies them into one platform even if different programs are used. For example, a cloud server based on any one or a combination of at least one of SaaS (Software as a Service), Iaas (Infrastructure as a Service) Saas (Software as a Service), and Paas (Platform as a Service) may be used. . With Iaas (Infrastructure as a Service), various infrastructure resources such as server resources, IP, network, storage, and power required for server operation can be provided flexibly and quickly. Iaas makes it easy to add or remove resources and provides an operating system so a friendly environment can be given. A service can be provided as Paas (Platform as a Service), and it is a service that provides a stable environment and an API for developing applications that use the environment. Paas makes it easy to build and deploy source code and is easy to adjust according to usage. SaaS (Software as a Service) is a service that provides users with applications running in the cloud environment. Saas can be easily accessed from anywhere on the Internet, and can be accessed from anywhere with a web browser.

Hereinafter, an operation process according to the configuration of the non-face-to-face event service providing server of FIG. 2 will be described in detail with reference to FIG. 3 as an example. However, it will be apparent that the embodiment is only one of various embodiments of the present invention and is not limited thereto.

Referring to FIG. 3A , as Corona 19 prolongs, there is a demand for non-face-to-face events, and there is a high possibility that offline non-face-to-face events that allow social distancing will be activated rather than events that directly attend offline events. Accordingly, as shown in FIGS. 3B and 3C, when building a non-face-to-face event platform, real-time two-way communication is possible using WebRTC, and all events such as planning, invitation, composition, and souvenirs are all in one platform as a one-stop platform to be able to do it in Referring to FIG. 3D , the studio conducts the offline event as it is, but builds a non-face-to-face event platform so that different tasks can be linked and progressed on one platform, and the offline studio can be built as shown in FIGS. 3E to 3J . Of course, the present invention is not limited thereto. It can be used for various meetings, commemorative ceremonies, awards ceremony, performances, workshops, and corporate events as shown in FIG. 3K , and the same effect as in FIG. 3L can be obtained. At this time, FIG. 4 (a) shows an embodiment in which a participant and a moderator wear a motion capture suit 700 and an HMD 600 so that a 3D live-action character can move in a virtual studio, and two-way streaming and data transmission and reception. Here, for the tactile feeling, the villus-like protrusion as shown in (b) is mounted in the motion capture suit 700 to convey a feeling of shaking hands or hugging each other even in a non-face-to-face social distancing situation.

The matters not described for the WebRTC-based non-face-to-face event service providing method of FIGS. 2 to 4 are the same as those described for the WebRTC-based non-face-to-face event service providing method through FIG. 1 or easily from the described content. Since it can be inferred, the following description will be omitted.

FIG. 5 is a diagram illustrating a process in which data is transmitted/received between components included in the WebRTC-based non-face-to-face event service providing system of FIG. 1 according to an embodiment of the present invention. Hereinafter, an example of a process in which data is transmitted and received between each component will be described with reference to FIG. 5, but the present application is not limited to such an embodiment, and the example shown in FIG. 5 according to various embodiments described above will be described. It is apparent to those skilled in the art that the data transmission/reception process may be changed.

Referring to FIG. 5 , the non-face-to-face event service providing server transmits a participation request message to at least one participant terminal using at least one type of medium (S5100). In addition, the non-face-to-face event service providing server stores the one-to-one mapping between at least one participant terminal and at least one display installed in an independent studio (S5200).

The non-face-to-face event service providing server receives the video of at least one participant terminal in real time based on WebRTC (Web Real-Time Communication) and controls to output it on at least one display (S5300), The video is transmitted to at least one participant terminal based on WebRTC (S5400).

The order between the above-described steps ( S5100 to S5400 ) is merely an example and is not limited thereto. That is, the order between the above-described steps ( S5100 to S5400 ) may be mutually changed, and some of these steps may be simultaneously executed or deleted.

Matters not described for the WebRTC-based non-face-to-face event service providing method of FIG. 5 are the same as those described for the WebRTC-based non-face-to-face event service providing method through FIGS. 1 to 4 or easily from the described content Since it can be inferred, the following description will be omitted.

The WebRTC-based non-face-to-face event service providing method according to the embodiment described with reference to FIG. 5 may also be implemented in the form of a recording medium including instructions executable by a computer, such as an application or program module executed by a computer. have. Computer-readable media can be any available media that can be accessed by a computer and includes both volatile and nonvolatile media, removable and non-removable media. Also, computer-readable media may include all computer storage media. Computer storage media includes both volatile and nonvolatile, removable and non-removable media implemented in any method or technology for storage of information such as computer readable instructions, data structures, program modules or other data.

The WebRTC-based non-face-to-face event service providing method according to an embodiment of the present invention described above is to be executed by an application basically installed in a terminal (which may include a program included in a platform or operating system, etc. basically installed in the terminal). Also, it may be executed by an application (ie, a program) installed directly in the master terminal by a user through an application providing server such as an application store server, an application, or a web server related to the corresponding service. In this sense, the method for providing a WebRTC-based non-face-to-face event service according to an embodiment of the present invention described above is implemented as an application (ie, program) installed basically in a terminal or directly installed by a user and read by a computer such as a terminal It can be recorded on a recordable medium.

The above description of the present invention is for illustration, and those of ordinary skill in the art to which the present invention pertains can understand that it can be easily modified into other specific forms without changing the technical spirit or essential features of the present invention. will be. Therefore, it should be understood that the embodiments described above are illustrative in all respects and not restrictive. For example, each component described as a single type may be implemented in a dispersed form, and likewise components described as distributed may be implemented in a combined form.

The scope of the present invention is indicated by the following claims rather than the above detailed description, and all changes or modifications derived from the meaning and scope of the claims and their equivalent concepts should be interpreted as being included in the scope of the present invention. do.

Claims (10)

at least one participant terminal participating in a non-face-to-face event, photographing and transmitting participants in real time, and receiving and outputting studio images shot in an independent studio in real time;
at least one display provided to output the image received from the at least one participant terminal on a one-to-one basis;
at least one camera for photographing a non-face-to-face event host in the independent studio; and
A participation request unit for transmitting a participation request message to the at least one participant terminal using at least one type of medium, a storage unit for storing the one-to-one mapping between the at least one participant terminal and the at least one display; A control unit that receives an image of one participant terminal in real time based on Web Real-Time Communication (WebRTC) and controls it to be output to the at least one display, and an image captured by the at least one camera to the at least one participant terminal a non-face-to-face event service providing server including a transmission unit for transmitting the WebRTC-based service;
WebRTC-based non-face-to-face event service provision system that includes.
The method of claim 1,
The non-face-to-face event service providing server,
When the language of the at least one participant terminal is different or the language of the moderator of the independent studio and the language of the at least one participant terminal are different from each other, the language of the moderator of the independent studio and the language of the at least one participant terminal are different a communication support unit that provides real-time translation or interpretation results in subtitles or voice;
WebRTC-based non-face-to-face event service providing system, characterized in that it further comprises.
The method of claim 1,
The independent studio is virtual content built in virtual reality,
The WebRTC-based non-face-to-face event service providing system,
an HMD through which the at least one participant and at least one presenter can view the independent studio within the virtual content;
WebRTC-based non-face-to-face event service providing system, characterized in that it further comprises.
The method of claim 1,
The independent studio is virtual content built in virtual reality,
The WebRTC-based non-face-to-face event service providing system,
a motion capture suit (Motion Capture Suit) provided to capture the motions of the at least one participant and the at least one host and apply the captured motion to a preset 3D live-action character;
WebRTC-based non-face-to-face event service providing system, characterized in that it further comprises.
5. The method of claim 4,
The motion capture suit is a two-way communication-based suit in which protrusions such as villi are formed on the inside, and vibration elements are included at preset intervals,
The non-face-to-face event service providing server,
a contact transmission unit that vibrates the protrusion with a vibration waveform and vibration intensity pre-stored in the type of contact when there is a contact between the at least one participant and the 3D live-action character corresponding to the at least one moderator on the virtual content;
WebRTC-based non-face-to-face event service providing system, characterized in that it further comprises.
The method of claim 1,
The non-face-to-face event service providing server,
a camera control unit forming a channel to remotely control at least one type of movement including up, down, left and right of the at least one camera;
WebRTC-based non-face-to-face event service providing system, characterized in that it further comprises.
The method of claim 1,
the at least one camera comprises a thermal imaging camera;
The non-face-to-face event service providing server,
a droplet distance calculator extracting saliva secreted from the mouth of the at least one host through the thermal imaging camera, and providing a minimum distance between each host based on the distance and angle from which the saliva is extracted;
WebRTC-based non-face-to-face event service providing system, characterized in that it further comprises.
The method of claim 1,
The non-face-to-face event service providing server,
a souvenir providing unit that collects address information from the at least one participant terminal and makes a delivery request and order request to the online shopping mall so that a preset participation souvenir can be delivered to the collected address information;
WebRTC-based non-face-to-face event service providing system, characterized in that it further comprises.
The method of claim 1,
The non-face-to-face event service providing server,
a database conversion unit for establishing a one-stop process including planning, design, directing, operation and result reporting of the non-face-to-face event;
WebRTC-based non-face-to-face event service providing system, characterized in that it further comprises.
In the non-face-to-face event service providing method executed in the non-face-to-face event service providing server,
transmitting a participation request message to at least one participant terminal using at least one type of medium;
storing the one-to-one mapping between the at least one participant terminal and at least one display installed in an independent studio;
receiving the video of the at least one participant terminal in real time based on Web Real-Time Communication (WebRTC) and controlling the video to be output to the at least one display; and
transmitting the image captured by the at least one camera to the at least one participant terminal based on the WebRTC;
A method of providing WebRTC-based non-face-to-face event services, including

Images