KR102242597B1 - Video lecturing system - Google Patents

Abstract

Disclosed is a video lecture system implemented to operate in various video input devices. The video lecture system comprises: an input/output terminal for receiving image data; and a server module that collects image data from the input/output terminal and provides a video lecture based on the image data.

Description

Video lecture system utilizing multiple remote camera services {VIDEO LECTURING SYSTEM}

The present invention relates to a video lecture system using multiple remote camera services, and more particularly, to a video lecture system capable of interlocking with various types of devices.

With the emergence of an information society that places importance on the rapid acquisition of a lot of information due to the recent rapid development of communication network technology, users are encouraged to use multimedia information such as voice, video, and video at a more advanced level in addition to the existing telephone and data transmission services. It has come to request a transport service for Korea.

Video conferencing is a representative application that utilizes such a multimedia transmission service, and a lot of research and development and implementation have been made in various environments.

Video conferencing refers to the use of a communication system made up of various terminals and lines to view images between distant people on a video screen, and to conduct a meeting in an atmosphere of being together in a conference room. The video system includes a conference room type video conference system and a desktop type video conference system.

It is called a video conference or a TV conference because it can display information related to the appearance of participants as well as audio as well as meetings between distant people. When meetings between the corporate headquarters and branch offices or meeting rooms are separated from each other, it is difficult to gather in one place and conduct a meeting remotely using a computer network.

The video conferencing system basically installs cameras, video compression and restoration codecs, monitors, microphones, and speakers in both conference rooms, and connects the two with a two-way video line, audio line, or dedicated line.In 1990, ITU- T has established a global standard for this and recommends its use. In recent years, some products have a function that allows you to hold a meeting with a personal computer, so you can conduct a meeting while sharing computer data with each other, and a function that allows you to draw letters or pictures with electronic pens on the monitor screens of both sides is also utilized.

In addition, a video conferencing system using the Internet has also emerged, which prevents wasted travel time for some meetings, effectively uses time, reduces related costs, and increases productivity, and it is also possible to store the progress of the meeting as video information. . By applying this, opportunities for remote counseling, remote medical treatment, and distance education are being prepared.

On the other hand, a general video conferencing system is a transmission method of only audio and video, unlike a PC, so when a camera or microphone malfunctions, conversation may be difficult, and even when there is a simple announcement, information can be transmitted only through audio and video. Because of this, there is a problem in that information cannot be transferred smoothly.

In order to solve this problem, Korean Patent Publication No. 10-2011-0062788 (camera, video conferencing device, and video conferencing method) was developed and applied.

According to the camera, the video conferencing apparatus, and the video conferencing method, the camera unit photographs a subject and generates a captured image signal, when a character is input, generates an OSD image including the input character, and the OSD generated in the captured captured image signal Composite the image. The image processing unit generates an image signal by compressing the synthesized image signal. In addition, the network interface unit transmits the generated video signal. According to the camera, the video conferencing apparatus, and the video conferencing method according to the present invention, since video data in which characters are inserted are transmitted and received, characters can be transmitted and received even on a video conferencing system not equipped with a data communication function.

However, according to such a conventional camera, video conferencing apparatus, and video conferencing method, an OSD image including text is generated, and an image signal is generated by synthesizing the OSD image generated with the captured image signal. Therefore, the text data is separately transmitted and received. There is a problem that cannot be done.

An aspect of the present invention discloses a video conference and video lecture system implemented to operate in various video input devices.

Another aspect of the present invention discloses a video conferencing and video lecture system implemented to operate in an environment where a network is restricted, including a gateway module.

Another aspect of the present invention discloses a video conferencing and video lecture system in which content spoken by a user is converted into text and deployed in the form of a chat window, and the text is translated into a language designated by the user.

Another aspect of the present invention discloses a videoconferencing and videolecture system including a videoconferencing booth that provides an enclosed space for videoconferencing.

Another aspect of the present invention discloses a video conferencing and video lecture system that provides a login function using a user's face recognition and gaze processing pattern.

Another aspect of the present invention discloses a video conference and video lecture system that facilitates work management and co-working by providing a user interface including a dashboard-type main screen.

Another aspect of the present invention discloses a video conferencing and video lecture system that provides a dual or triple shared screen between video conferencing participants, and provides a resize function and a drawing function of the shared screen.

Another aspect of the present invention discloses a video conferencing and video lecture system that provides a function to share and control multiple cameras and screens mounted on multiple devices with one and the same account of a host.

Another aspect of the present invention discloses a video lecture system for providing a secretary and assistant function that performs repetitive tasks such as grasping a user's concentration, checking progress, and submitting an assignment using an AI chatbot.

Another aspect of the present invention discloses a video lecture system that provides a task-oriented lounge screen including schedule management, to-do-list, and lecture reservation list.

Another aspect of the present invention discloses a video lecture system that provides an attendance check function, provides a history of attendance check history, and provides a phone connection function, a screen sharing function, a whiteboard function, and a biometric-based login function. do.

The technical problem of the present invention is not limited to the technical problem mentioned above, and other technical problems that are not mentioned will be clearly understood by those skilled in the art from the following description.

A video conferencing system according to an aspect of the present invention includes an input/output terminal for receiving video data; And a server module that collects image data from the input/output terminal and relays a video conference based on the image data.

Meanwhile, a gateway module connected to a network communication network to communicate with the server module; further comprising,

The input/output terminal includes: a first input/output terminal connected to a network communication network to communicate with the server module; And a second input/output terminal communicating with the server module through the gateway module,

The first input/output terminal is equipped with a video conferencing platform operated by the server module,

The server module receives video data from a plurality of input/output terminals through the video conferencing platform, encodes and manages the received video data, and outputs the encoded video data through the video conference platform to provide a plurality of input/output Provides a streaming function through the video conferencing platform by allowing a video conference between terminals to take place, receiving real-time streaming information from a real-time streaming channel,

The server module includes: an image receiver configured to collect image data input through the input/output terminal into a video conference space created on the video conference platform; An image processing unit that encodes the image data received by the image receiving unit based on a plurality of encoding parameters, and extracts audio from the image data received by the image receiving unit and converts it into text; Generates a chat window screen listing the speech balloons containing the text converted by the video processing unit in the order in which the video data is received, and requests and receives language setting information from the input/output terminal connected to the video conferencing platform, and sets the language A chat processing unit for translating the text converted by the image processing unit into the language of the country corresponding to the information, and generating a screen in which the translated text is expanded in the form of a chat window; And a video transmission unit for outputting the encoded video data and the chat window screen in the video conference space; and

The video conferencing platform may include: a first area to output the video conferencing space information and to select one of the video conferencing spaces through the input/output terminal; A second area for outputting video data and a chat window screen received from the server module; And a third area for outputting the real-time streaming information and selecting any one of the streaming information through the input/output terminal; and outputting a screen divided into the input/output terminal,

A video conference booth that provides an installation space for the input/output terminal and establishes a closed environment; further includes,

The videoconferencing booth may include a main body box formed in a rectangular parallelepiped box shape; A table that provides an installation space for the input/output terminal and is disposed on one side of the inner space of the main box so that the input/output terminal faces the other side of the inner space of the main box; A chair provided in a pair with the table; And a screen unit installed on the other side of the inner space of the main body box and connected to the input/output terminal to output a screen forming a background of the image data according to a control signal of the input/output terminal.

Meanwhile, the screen unit may include a case unit including a long hole formed in a longitudinal direction to accommodate a screen wound in a roll shape and allow the screen to be inserted and withdrawn; An installation bar installed to be rotatable when a predetermined external force is applied to an upper portion of the inner wall of the main body box; An upper driving part installed at both ends of the installation bar so as to be rotatable with the installation bar as an axis, and forming a gear surface along an outer circumferential surface; A lower driving unit arranged vertically below the upper driving unit, inserted into a rotation pin formed at a lower end of the main body box to rotate, and forming a gear surface along an outer circumferential surface; A motor unit connected to the installation bar and the rotation pin to rotate the installation bar and the rotation pin in the same forward or reverse rotation; And connecting the upper driving part and the lower driving part, and being engaged with a gear surface formed in the upper driving part and the lower driving part, and moving in a clockwise direction when the upper driving part and the lower driving part rotate forward, and the upper driving part And a chain unit moving in a counterclockwise direction when the lower driving unit rotates in reverse,

The case portion is detachably installed on the chain portion, and when the chain portion moves in a clockwise direction, it moves toward an upper side of the main box, and when the chain portion moves in a counterclockwise direction, the lower portion of the body box Installed so that it can be moved in the direction,

The screen portion further includes; an elastic portion connecting both ends of the chain portion,

The elastic portion includes a first through pin formed in a rectangular shape and having a first elastic block formed at one end thereof, and the first through pin penetrates through the first elastic block so that the first elastic block is positioned at a lower portion thereof. A first plate to which one end of the chain part is connected to the other end of the through pin; And a second through pin formed in a shape corresponding to the first plate and having a second elastic block formed at one end thereof, and the second through pin so as to contact the first elastic block with the second elastic block positioned at the top A second plate through which a pin is provided and to which the other end of the chain is connected to the other end of the second through pin; A connection pillar for fixing the first plate and the second plate to be spaced apart from each other by a predetermined distance; And an elastic member provided between the first plate and the first elastic block and between the second plate and the second elastic block, respectively.

According to the present invention, video conferencing and lectures are possible among a plurality of users without being limited to a region or a network environment, and convenience of communication between users may be improved.

In addition, the video conference booth includes a screen unit so that various background screens can be displayed, or efficient video conferences and lectures can be conducted using talk data output in the background.

1 is a conceptual diagram of a video conferencing system according to an embodiment of the present invention.
2 is a conceptual diagram of a video conferencing system according to another embodiment of the present invention.
3 is a control block diagram of the server module shown in FIGS. 1 and 2.
4 is an example of a screen output from the input/output terminal shown in FIG. 1.
5 is a diagram showing a video conferencing system according to another embodiment of the present invention.
6 and 7 are views showing in detail the screen unit shown in FIG. 5.
8 is a control block diagram of a server module according to another embodiment of the present invention.
9 to 13 are examples of screens output from the input/output terminal shown in FIG. 1.
14 to 16 are other examples of screens output from the input/output terminal shown in FIG. 1.

Advantages and features of the present invention, and a method of achieving them will become apparent with reference to the embodiments described below in detail together with the accompanying drawings. However, the present invention is not limited to the embodiments disclosed below, but will be implemented in various different forms. It is provided to completely inform the scope of the invention to the possessor, and the invention is only defined by the scope of the claims. The same reference numerals refer to the same elements throughout the specification.

The terms used in the present specification are for describing exemplary embodiments and are not intended to limit the present invention. In this specification, the singular form also includes the plural form unless specifically stated in the phrase. As used herein, “comprises” and/or “comprising” do not exclude the presence or addition of one or more other elements, steps, and actions to the mentioned elements, steps, and actions.

1 is a conceptual diagram of a video conferencing system according to an embodiment of the present invention.

Referring to FIG. 1, a video conferencing system 1000 according to an embodiment of the present invention may include an input/output terminal 100 and a server module 200.

The input/output terminal 100 is a device capable of communication and input/output of information, and may be implemented as, for example, a PC, a smartphone, or a tablet PC.

The input/output terminal 100 may be executed by being loaded with various operating systems, for example, Window, iOS, etc., and may be executed through the operating system by installing the video conferencing platform according to an embodiment of the present invention. Here, the video conferencing platform may support video conferencing between the input/output terminals 100, and further, may provide a playback function of streaming content.

The input/output terminal 100 may receive various types of image data. For example, the input/output terminal 100 may generate a videoconferencing image photographing a user through a videoconferencing platform.

The input/output terminal 100 may transmit image data to the server module 200 through network communication, and may support a video conference function by receiving and outputting image data from the server module 200. In this case, the input/output terminal 100 divides and provides the output screen through the video conference platform so that the video conference image and the streaming video can be simultaneously output. In this regard, a detailed description will be provided later.

The server module 200 is a general type of server that provides predetermined information in response to a client's connection request. According to the present embodiment, the server module 200 may be an operation server of a video conferencing platform installed in the input/output terminal 100.

The server module 200 is connected to the input/output terminal 100 through a network communication network and transmits and receives information for a video conference platform, thereby implementing a video conference service.

For example, when receiving video data from the input/output terminal 100, the server module 200 may encode and transmit the video data in an appropriate size according to the input/output terminal 100 to output the video data, A function of extracting and converting text from image data, and a function of translating the extracted text may be provided.

In addition, the server module 200 connects the input/output terminal 100 to a radio streaming channel, a video news streaming channel, and the like so that the input/output terminal 100 can perform real-time streaming.

Meanwhile, FIG. 2 is a conceptual diagram of a video conferencing system according to another embodiment of the present invention.

Referring to FIG. 2, the input/output terminal 100 may be divided into a first input/output terminal 101 that can access a network communication network and a second input/output terminal 102 that cannot access a network communication network.

The first input/output terminal 101 may be applied to the input/output terminal 100 shown in FIG. 1, and may be implemented as, for example, a PC, a smart phone, a tablet PC, or the like.

The second input/output terminal 102 is a terminal that cannot be connected to a network communication network, and may be implemented as, for example, a radio, a telephone, a speaker, or the like.

The video conferencing system 1000 according to another embodiment of the present invention may further include a gateway module 300 for accessing the second input/output terminal 102 to a network communication network.

The gateway module 300 may be connected to a network network to communicate with the server module 200.

The gateway module 300 may be disposed in a short distance with the second input/output terminal 102 to perform short-range wireless communication with the second input/output terminal 102.

The gateway module 300 may relay communication between the second input/output terminal 102 and the server module 200.

The gateway module 300 may receive a radio signal including voice from the second input/output terminal 102, demodulate the received radio signal and transmit it to the server module 200. In addition, the gateway module 300 may receive a radio signal including voice from the server module 200 and transmit it to the second input/output terminal 102.

The video conferencing system 1000 of the present invention enables video conferencing by interlocking various types of input/output terminals 101 and 102.

3 is a control block diagram of the server module shown in FIGS. 1 and 2.

Referring to FIG. 3, the server module 200 may include an image receiving unit 210, an image processing unit 220, a chat processing unit 230, and an image transmitting unit 240.

The image receiving unit 210 may receive image data generated by the input/output terminal 100. Here, the image data may include a videoconferencing image captured by the user.

For example, a video conferencing platform installed in the input/output terminal 100 can create a video conferencing space that can be accessed from a plurality of input/output terminals 100, and provides an input/output function of video data to the video conferencing space. The server module 200 may relay transmission and reception of video data between the input/output terminals 100 connected to the corresponding video conference space. The image receiving unit 210 may collect image data input to the video conference space.

The image processing unit 220 may encode and manage image data received by the image receiving unit 210.

For example, the image processing unit 220 may encode a videoconferencing image received by the image receiving unit 210 based on a plurality of encoding parameters. In this case, the parameters may include a bit rate related to an image, the number of frames per second, a resolution, and a length of an image set. Also, a sample rate, bit rate, and channel related to voice may be included. These parameters are only examples and other parameter values may be added.

The image processing unit 220 may encode and manage image data so that the videoconferencing image can be output from the input/output terminal 100 of various standards.

The image processing unit 220 may extract audio from image data received by the image receiving unit 210 and convert it into text.

For example, the image processing unit 220 may extract speech from image data through automatic speech recognition (ASR) technology. The image processing unit 220 may convert voice extracted through STT (Speech to Text) technology into text.

The chat processing unit 230 may generate a screen in which the text converted by the image processing unit 220 is expanded in the form of a chat window.

That is, the chat processing unit 230 may generate a chat window screen in which speech balloons describing text converted by the image processing unit 220 are arranged in the order in which the image data is received.

The chat processing unit 230 may translate the text into another language and output it.

The chat processing unit 230 may request and receive language setting information from the input/output terminal 100 connected to the video conferencing platform. The language setting information may include language information of a country designated by the user.

The chat processing unit 230 may translate text into a corresponding language based on language setting information designated by the input/output terminal 100 for receiving and outputting image data, and generate a chat window screen using the translated text. For example, the chat processing unit 230 may transmit the text to an external translation server to obtain the translated text in a designated language.

The video transmission unit 240 may transmit and output video data and a chat window to the input/output terminal 100.

That is, the image transmission unit 240 may output image data input from another input/output terminal 100 to a video conference space output from a certain input/output terminal 100.

4 is an example of a screen output from the input/output terminal shown in FIG. 1.

Referring to FIG. 4, the input/output terminal 100 may execute a video conferencing platform according to an embodiment of the present invention, and the video conferencing platform may output a divided screen.

For example, the videoconferencing platform may output a screen divided into a first area 10, a second area 20, and a third area 30.

The first area 10 may output videoconferencing space information. The video conference space information may include a video conference date and participant information. The input/output terminal 100 can receive any one video conference space through the first area 10, and when the video conference space is selected, it is regarded as participating in the video conference and informs the server module. It can be transmitted to (200).

The second area 20 may output image data 22 and a chat window 21 received from the server module 200.

The third area 30 may provide streaming information received from an external server. For example, the streaming information may include radio streaming data, in-house broadcasting streaming data, and the like.

When streaming information is selected through the third area 30, streaming may be performed in the second area 20.

5 is a diagram showing a video conferencing system according to another embodiment of the present invention.

Referring to FIG. 5, a videoconferencing system according to another embodiment of the present invention may further include a videoconferencing booth 500 in addition to the configurations shown in FIGS. 1 and 2.

The videoconferencing booth 500 provides an installation space for the input/output terminal 100, and may provide an environment in which a closed soundproof environment can be constructed to focus on a videoconferencing.

The video conference booth 500 may include a main body box 510, a chair 520, a table 530, and a screen unit 540.

The body box 510 may be formed in a rectangular box shape, and may include a frame part, a door part, and a panel part.

The frame unit may include a support frame assembled and maintained in a rectangular parallelepiped and fixed to the floor, a plurality of vertical frames provided by maintaining vertical on the upper part of the support frame, and a horizontal frame horizontally connecting the upper portions of the vertical frames.

The panel part is fixed to the frame part to seal the interior. Here, the panel portion is made of a transparent material so that the inner space can be checked from the outside.

The door portion may be provided on at least one side of the panel portion so as to be able to open and close the inside.

The chair 520 is provided in a pair with the table 530 to provide a space for a user participating in the video conference to sit. The table 530 provides an installation space for the input/output terminal 100.

Here, the chair 520 and the table 530 may be provided in the inner space of the body box 510 and may be disposed on one side wall. In this case, the input/output terminal 100 may be disposed on the table 530 to face the other side wall of the inner space of the body box 510.

The screen unit 540 may be installed on the other side wall of the inner space of the body box 510.

The screen unit 540 is connected to the input/output terminal 100 to output a predetermined screen according to a control signal from the input/output terminal 100. For example, the screen unit 540 may output video conference data, background screen, and the like.

The screen unit 540 may be photographed by the input/output terminal 100. That is, when a user conducts a video conference, a screen output from the screen unit 540 may be used as a background.

The video conferencing system according to the present embodiment includes such a screen unit 540 to produce various background screens during a video conference, or an efficient conference can be conducted using video conference data output in the background.

Meanwhile, the screen unit 540 illustrated in FIG. 5 may be provided to be movable in a vertical direction with respect to the wall surface of the body box 510. This will be described with reference to FIGS. 6 and 7.

6 and 7 are views showing in detail the screen unit shown in FIG. 5.

Referring to FIG. 6, the screen part 540 includes a case part 541, an installation bar 542, an upper drive part 543, a lower drive part 544, a motor part 545, a chain part 546, and an elastic part. (547) may be included.

The case portion 541 may accommodate a screen wound in a roll shape, and the screen can be withdrawn and inserted through a long hole including a long hole formed in the length direction.

The installation bar 542 may rotate when a predetermined external force is applied to the upper inner wall surface of the body box 510.

The upper driving part 543 may be installed at both ends of the installation bar 542 to rotate around the installation bar 542 as an axis.

The lower driving part 544 may be provided vertically below the upper driving part 543, and may be provided to be rotatable by being inserted into a rotation pin formed at the lower end of the body box 510.

The upper driving part 543 and the lower driving part 544 may form a gear surface along an outer circumferential surface.

The motor unit 545 may be connected to the installation bar 542 to rotate the installation bar 542 forward or reverse. When the installation bar 542 is rotated by the motor unit 545, the upper drive unit 543 will also rotate.

The motor unit 545 is connected to the rotation pin to rotate the lower driving unit 544 in the same direction as the upper driving unit 543.

The chain part 546 may connect the upper driving part 543 and the lower driving part 544.

The chain part 546 may be provided in engagement with a gear surface formed on the upper driving part 543 and the lower driving part 544, and clockwise or counterclockwise according to the rotation of the upper driving part 543 and the lower driving part 544 You can move to.

For example, the chain part 546 moves in a clockwise direction when the upper driving part 543 and the lower driving part 544 rotate in a forward direction, and moves in a counterclockwise direction when the upper driving part 543 and the lower driving part 544 rotate in reverse. I can.

Both ends of the case portion 541 may be installed detachably to the chain portion 546. At this time, the case portion 541 will move in the upper direction of the body box 510 when the chain portion 546 rotates in a clockwise direction, and when the chain portion 546 rotates in a counterclockwise direction, the body box ( 510).

The user can manipulate the motor unit 545 to adjust the height of the case unit 541 and fix the installation position thereof. Accordingly, the height of the case part 541 may be adjusted according to the height of the user, and further, the case part 541 may be lowered to facilitate cleaning or maintenance of the case part 541.

Meanwhile, the elastic part 547 is installed on at least a portion of the chain part 546 to absorb the vibration applied to the case part 541 while the case part 541 moves along the chain part 546. . This will be described with reference to FIG. 7.

Referring to FIG. 7, the elastic part 547 may include a first plate 5471, a second plate 5472, a connection pillar 5473, and an elastic member 5474.

The first plate 5471 may be formed in a rectangular shape, and a chain portion 546 may be connected to the upper side.

For example, the first plate 5471 may include a through pin having a first elastic block 5471a formed at one end thereof, and at this time, the first elastic block 5471a is located under the first plate 5471. The chain portion 546 may be connected to the other end passing through the first plate 5471.

The second plate 5472 may have a rectangular shape corresponding to the first plate 5471, and a chain portion 546 may be connected to the lower side thereof.

For example, the second plate 5472 may include a through pin having a second elastic block 5472a formed at one end thereof, and at this time, the second elastic block 5472a may be in contact with the first elastic block 5472a. The chain portion 546 may be connected to the other end located above the second plate 5472 and passing through the second plate 5472.

The connection post 5473 may fix the first plate 5471 and the second plate 5472 by a predetermined distance apart from each other.

Both ends of the connecting column 5473 are connected between the lower side of the first plate 5471 and the upper side of the second plate 5472, respectively, to form a space between the first plate 5471 and the second plate 5472 can do.

The elastic member 5474 may be provided on a lower side of the first plate 5471 and an upper side of the second plate 5472.

The elastic member 5474 may connect the first plate 5471 and the first elastic block 5471a, and connect the second plate 5472 and the second elastic block 5472a.

This elastic part 547 mitigates the impact applied to the case part 541 by recoiling the vibration generated while the chain part 546 is moving, and prevents noise and abrasion through the elastic member 5474's expansion and contraction action. Plays a role.

8 is a control block diagram of a server module according to another embodiment of the present invention, and FIGS. 9 to 13 are examples of screens output from the input/output terminal shown in FIG. 1.

Referring to FIG. 8, the server module 200 according to the present embodiment is configured to log in in addition to the configuration of the image receiving unit 210, the image processing unit 220, the chat processing unit 230, and the image transmission unit 240 shown in Fig. 3. A processing unit 250, an interface generation unit 260, and a shared screen control unit 270 may be further included.

The login processing unit 250 may provide a login function for the video conferencing platform according to an embodiment of the present invention.

The login processing unit 250 may provide a login function based on the user's face information. Here, the face information may include a user's face image and a gaze processing pattern.

The login processing unit 250 may receive the user's face information through the input/output terminal 100 and store it as member information. This will be described with reference to FIGS. 9 to 11.

Referring to FIG. 9, the input/output terminal 100 may output a screen requesting an input of a user's face image among face information in order to subscribe to a video conferencing platform according to an embodiment of the present invention.

10 and 11, the input/output terminal 100 displays a screen for requesting input of a user's gaze recognition and gaze processing pattern among face information for membership registration of a video conferencing platform according to an embodiment of the present invention. Can be printed.

The login processing unit 250 may request input of the user's face information when attempting to log in through the input/output terminal 100.

When the user's face information is input through the input/output terminal 100, the login processing unit 250 may process the login of the user according to whether or not the face information included in the member information matches.

For example, the login processing unit 250 may perform login processing by identifying a user through similarity analysis of a feature vector extracted from the user's face image. In this case, the login processing unit 250 may perform login processing by identifying the user's face image using the similarity analysis device disclosed in Korean Patent Application Laid-Open No. 10-2017-0110281.

The interface generator 260 may generate an interface of the video conferencing platform according to an embodiment of the present invention and output it to the input/output terminal 100.

Referring to FIG. 12, the interface generator 260 may generate an interface including a main screen in the form of a dashboard for business management and coworking and output to the input/output terminal 100.

Here, the main screen may include a full menu, a task board, a schedule management and group management menu, and in the case of a task board, a drawing, chatting, and file sharing menu may be included.

Referring to FIG. 13, when a drawing menu is selected from the task board, the interface generator 260 may provide a drawing function to the input/output terminal 100.

The interface generator 260 may provide a drawing sharing function among participants in the video conference. The interface generator 260 provides a drawing sharing screen among videoconferencing participants, and allows each videoconference participant's drawing to be shared on the drawing sharing screen.

The shared screen controller 270 may output a shared screen shared between video conference participants to the input/output terminal 100 of each video conference participant.

In this case, the shared screen controller 270 may output a shared screen in which dual or triple screens are superimposed, and may adjust the size of a corresponding screen according to a screen size adjustment signal input through the input/output terminal 100 and output it. .

Meanwhile, the video lecture system using multiple remote camera services according to an embodiment of the present invention may include the input/output terminal 100 and the server module 200 shown in FIG. It may further include a conference booth (500). In this case, the video conferencing booth 500 may provide an installation space for the input/output terminal 100, and may provide an environment in which a closed soundproof environment can be established to focus on video lectures.

Here, the input/output terminal 100 may be executed by mounting the video lecture platform according to the present embodiment in addition to the video conferencing platform. The server module 200 may be an operation server of not only a video conferencing platform but also a video lecture platform according to the present embodiment.

The image receiving unit 210 may receive image data generated by the input/output terminal 100. Here, the image data may include an image lecture image captured by the user.

For example, the video lecture platform installed in the input/output terminal 100 can create a video lecture space accessible from a plurality of input/output terminals 100, and provides an input/output function of video data to the video lecture space. The server module 200 may relay transmission and reception of video data between the input/output terminals 100 connected to the corresponding video lecture space.

The image processing unit 220 may encode and manage image data received by the image receiving unit 210.

For example, the image processing unit 220 may encode the video lecture image received by the image receiving unit 210 based on a plurality of encoding parameters. In this case, the parameters may include a bit rate related to an image, the number of frames per second, a resolution, and a length of an image set. Also, a sample rate, bit rate, and channel related to voice may be included. These parameters are only examples and other parameter values may be added.

The image processing unit 220 may encode and manage image data so that the video lecture image can be output from the input/output terminal 100 of various standards.

The image processing unit 220 may extract audio from image data received by the image receiving unit 210 and convert it into text.

For example, the image processing unit 220 may extract speech from image data through automatic speech recognition (ASR) technology. The image processing unit 220 may convert voice extracted through STT (Speech to Text) technology into text.

The chat processing unit 230 may generate a screen in which the text converted by the image processing unit 220 is expanded in the form of a chat window.

That is, the chat processing unit 230 may generate a chat window screen in which speech balloons describing text converted by the image processing unit 220 are arranged in the order in which the image data is received.

The chat processing unit 230 may translate the text into another language and output it.

The video transmission unit 240 may transmit and output video data and a chat window to the input/output terminal 100.

That is, the image transmission unit 240 may output image data input from another input/output terminal 100 to an image lecture space output from one input/output terminal 100.

14 to 16 are examples of screens output from the input/output terminal shown in FIG. 1.

Referring to FIG. 14, the input/output terminal 100 executes a video lecture platform to display a lecture screen output area (①), a white board share area (②), a screen share screen share area (③), and a participant list list output area (④). ), chat window output area (⑤), file sharing list output area (⑥), and device list area (⑦). Here, the device list can be displayed on the video lecture platform screen by controlling a computer webcam and multiple mobile cameras with the same account. It can operate according to any one of the displayed question modes.

The video lecture platform can output various control buttons at the bottom of the output screen. For example, the control button may include a cam screen setting button, a volume control button, a record button, an image recording button, a screen capture button, an emoticon button, and a menu close button.

Referring to FIG. 15, the input/output terminal 100 may execute a video lecture platform and output a lounge screen. The lounge screen is divided into a room creation function output area (①), reservation list output area (⑥), schedule management output area (⑨), to-do-list output area (⑬), and chatbot output area (⑮). Can be printed. Here, the chatbot can help to use the video lecture platform by voice, and can be implemented as an ordinary AI chatbot. AI chatbots can provide secretarial and assistant functions that perform repetitive tasks, such as checking user's concentration, checking progress, and submitting assignments.

Referring to FIG. 16, the input/output terminal 100 may execute a video lecture platform and output an attendance check screen. The attendance check screen may provide a history of attendance check history.

Although the embodiments of the present invention have been described with reference to the accompanying drawings, those of ordinary skill in the art to which the present invention pertains can be implemented in other specific forms without changing the technical spirit or essential features. You will be able to understand. Therefore, it should be understood that the embodiments described above are illustrative in all respects and are not limiting.

1000: video conferencing system
100: input/output terminal
200: server module

Claims (2)

An input/output terminal receiving image data; And
Including; a server module for collecting image data from the input/output terminal and servicing an image lecture based on the image data,
A gateway module connected to a network communication network to communicate with the server module; further comprising,
The input/output terminal,
A first input/output terminal connected to a network communication network to communicate with the server module; And
Includes; a second input/output terminal communicating with the server module through the gateway module,
The first input/output terminal,
The video lecture platform operated by the server module is mounted,
The server module,
The video lecture platform receives video data from a plurality of input/output terminals with one and the same account, encodes and manages the received video data, and outputs the encoded video data through the video lecture platform to provide a plurality of input/output. Provides a streaming function through the video lecture platform by allowing video lectures between terminals and receiving real-time streaming information from a real-time streaming channel,
The server module,
An image receiving unit for collecting image data input through the input/output terminal in the image lecture space generated on the image lecture platform;
An image processing unit that encodes the image data received by the image receiving unit based on a plurality of encoding parameters, and extracts audio from the image data received by the image receiving unit and converts it into text;
Generates a chat window screen listing the speech balloons containing the text converted by the video processing unit in the order in which the video data is received, but requests and receives language setting information from the input/output terminal connected to the video lecture platform, and sets the language A chat processing unit for translating the text converted by the image processing unit into the language of the country corresponding to the information, and generating a screen in which the translated text is expanded in the form of a chat window; And
Including; a video transmission unit for outputting the encoded video data and the chat window screen in the video lecture space; Including,
The input/output terminal,
A video conference platform that relays video conference based on video data input from the input/output terminal is mounted and executed,
The video conferencing platform,
A first area for outputting videoconferencing space information and for selecting any one of the videoconferencing spaces through the input/output terminal; A second area for outputting video data and a chat window screen received from the server module; And a third area for outputting the real-time streaming information and selecting any one of the streaming information through the input/output terminal; and outputting a screen divided into the input/output terminal,
A video conference booth that provides an installation space for the input/output terminal and establishes a closed environment; further includes,
The video conference booth,
A body box formed in a box shape of a rectangular parallelepiped;
A table that provides an installation space for the input/output terminal and is disposed on one side of the inner space of the main box so that the input/output terminal faces the other side of the inner space of the main box;
A chair provided in a pair with the table; And
A screen unit installed on the other side of the inner space of the main body box and connected to the input/output terminal to output a screen forming a background of the image data according to a control signal of the input/output terminal; and
The screen unit,
A case portion accommodating a screen wound in a roll shape and including a long hole formed in a longitudinal direction to enable the input and extraction of the screen;
An installation bar installed to be rotatable when a predetermined external force is applied to an upper portion of the inner wall of the main body box;
An upper driving part installed at both ends of the installation bar so as to be rotatable with the installation bar as an axis, and forming a gear surface along an outer circumferential surface;
A lower driving unit arranged vertically below the upper driving unit, inserted into a rotation pin formed at a lower end of the main body box to rotate, and forming a gear surface along an outer circumferential surface;
A motor unit connected to the installation bar and the rotation pin to rotate the installation bar and the rotation pin in the same forward or reverse rotation; And
The upper driving part and the lower driving part are connected to each other and provided in mesh with a gear surface formed in the upper driving part and the lower driving part, and when the upper driving part and the lower driving part rotate forward, they move in a clockwise direction, and the upper driving part and Including; when the lower driving unit rotates reversely, a chain unit moving in a counterclockwise direction,
The case portion is detachably installed on the chain portion, and when the chain portion moves in a clockwise direction, it moves toward an upper side of the main box, and when the chain portion moves in a counterclockwise direction, the lower portion of the body box Installed so that it can be moved in the direction,
The screen unit,
It further includes; an elastic portion connecting both ends of the chain portion,
The elastic part,
A first through pin formed in a rectangular shape and having a first elastic block formed at one end thereof, the first through pin is provided through the first through pin so that the first elastic block is positioned at a lower portion thereof, and the other end of the first through pin A first plate to which one end of the chain part is connected to;
And a second through pin formed in a shape corresponding to the first plate and having a second elastic block formed at one end thereof, and the second through pin so as to contact the first elastic block with the second elastic block positioned at the top A second plate through which a pin is provided and the other end of the chain is connected to the other end of the second through pin;
A connection pillar for fixing the first plate and the second plate to be spaced apart by a predetermined distance; And
And an elastic member provided between the first plate and the first elastic block and between the second plate and the second elastic block, respectively.
delete

Images