KR102501244B1 - Continuous mobile wireless live broadcasting and real-time video conferencing device - Google Patents

Abstract

A continuous mobile live broadcasting device, which broadcasts in real time to a plurality of terminals comprising a host terminal and a guest terminal by using a relay terminal that can broadcast in real time, comprises: a mobile cart having a cart body with a shelf and a wheel unit for moving while supporting the cart body; a communication unit supporting the mobile cart and transmitting and receiving data to and from the relay terminal; a camera unit consisting of at least one fixed camera supported on the mobile cart and photographing images and at least one mobile camera separated from the mobile cart, having a mobile communication unit, and photographing the images; a display unit displaying the images including the photographed images from the camera unit; a user input unit entering user commands; and a control unit controlling the communication unit to transmit the photographed images from the camera unit to the relay terminal such that the photographed images can be displayed on the host terminal and guest terminal, controlling the display unit to display the images of the host terminal, the images of the guest terminal, and the images photographed by the camera unit, which are received from the relay terminal, and controlling at least one mobile camera such that the at least one mobile camera moves to an area corresponding to input area data and photographs the images when data from any one of the image areas photographed by the camera unit is input from the host terminal, guest terminal, and user input unit. According to the present invention, the speed of data provision and the clarity of the provided data can be improved.

Description

Continuous mobile wireless live broadcasting and real-time video conferencing device}

The present invention relates to a mobile live broadcasting and conference device, and more specifically, a mobile live broadcasting device "Cartlive" that conducts real-time relaying and conferences with a plurality of terminals including a host terminal and a guest terminal using a relay terminal capable of real-time relaying. It is about.

In the case of a video conference using a real-time relay system or introducing a site, video can be provided along with explanations while filming the site by moving directly. In videoconferencing, it is common to hold a meeting while exchanging data in a fixed conference room, but when conducting an interview or real-time relaying in a place such as outside or on-site, the relay device must be mobile.

However, if you want to see or know a product or its current status in real time during real-time relaying, you must convey what you want to know through voice, and the user who receives the relay must move and explain while filming the video. If this occurs during real-time relaying, mutual communication may not be complete, which takes a lot of time, and it is difficult to expect satisfactory results for the meeting. In addition, the existing mobile relay method proceeds in the order of "movement -> installation -> relay and conference -> withdrawal" and is said to be mobile, but in the end, the relay device must be fixed in a fixed place and transmitted.

Therefore, the purpose of the present invention is to move from the four-step method of "1. Move -> 2. Install -> 3. Relay and conference -> 4. Withdrawal -> 1. Move" to "1. Move -> 2. Install -> 3. Relay and conference -> 1. Move" to simplify the three-step method, and to provide a mobile live relay device that provides relay and conference services that can continuously move a relay system over a wide area, which had to be fixed after installation.

To achieve the above object, a mobile live relay device for real-time relaying to a plurality of terminals including a host terminal and a guest terminal using a relay terminal capable of relaying in real time according to the present invention is provided on a cart body with shelves and the cart body. A movable cart having wheels for being supported and moving; a communication unit that is supported by the mobile cart and transmits/receives data with the relay terminal; a camera unit comprising at least one fixed camera that is supported by the mobile cart to capture an image and at least one mobile camera that has a mobile communication unit separated from the mobile cart and captures an image; a display unit displaying an image including a photographed image captured by the camera unit; a user input unit for inputting a user's command; and controlling the communication unit to transmit the captured image captured by the camera unit to the relay terminal so as to be displayed on the host terminal and the guest terminal, wherein the host terminal's image received from the relay terminal, the guest terminal's image, and Controls the display unit to display an image captured by the camera unit, and when data of any one of the image areas captured by the camera unit is input from the host terminal, the guest terminal, and the user input unit, the input area data and a control unit controlling the at least one mobile camera so that the at least one mobile camera is moved to a corresponding area and takes an image. While moving using a mobile cart, real-time relaying is performed between a host terminal and a guest terminal using a relay terminal to provide video. Since a photographed image is provided, a clear image can be provided quickly, so the speed of providing data and the clarity of provided data can be improved.

Here, the at least one mobile camera is composed of a plurality, and the control unit moves the plurality of mobile cameras to an area corresponding to the input area data, and then the area corresponding to the area data input in at least two directions. It is preferable to zoom in and transmit to the relay terminal, since it is possible to provide captured images in a plurality of directions for the input area data, which satisfies users, hosts, and guests who receive the images.

In addition, when the control unit identifies a repetitive movement operation in an enlarged photographed image, the control unit controls the plurality of moving cameras to move so that the pattern of the repetitive movement operation can be simultaneously photographed, thereby performing a production operation and a work operation in the input area. In this case, it is preferable to check the entire operation on one screen.

Here, if the plurality of mobile cameras include a telephoto camera having a telephoto lens for photographing a long-distance area and a wide-angle camera having a wide-angle lens for photographing a wide area, the movement is performed while directly photographing the input area data using the telephoto camera. It is desirable to be able to photograph the input area with a wide-angle camera.

Preferably, each of the plurality of mobile cameras further includes at least one microphone for receiving a voice including a user's voice, so that the voice of the input region can be provided.

According to the present invention, real-time relaying is provided to a host terminal and a guest terminal using a plurality of cameras and relay terminals while moving using a mobile cart, and therefore, the effect of the present invention is similar to that of the existing "1. Move -> 2. Installation -> 3. Relay & Conference -> 4. Withdrawal -> 1. Move” in the 4-step method “1. Move -> 2. Install -> 3. Relay & Conference -> 1. Move” in the 3-step method Since it is possible to continuously move by using the characteristics of , relay and real-time conferences can be held while continuously moving with a single relay mobile cart system without installing separate relay systems in various places, providing clear images quickly without restrictions in place. Therefore, there is an effect of improving the speed of providing data and the clarity of provided data.

1 is an exemplary view of a continuous mobile live broadcasting device according to the present invention.
2 is an exemplary diagram for providing an image of an input area.
3 is an exemplary diagram for providing images in a plurality of directions.
4 is an exemplary view of an image of an input area.
5 is a control block diagram.
6 is an exemplary diagram showing the actual configuration of a continuous mobile live broadcasting device.
7 is an exemplary view of real-time relaying while moving a production line in the field.
8 is an exemplary view of moving and relaying partitioned offices, factories, warehouses, and laboratories in real time.

Hereinafter, a continuous mobile live relay device 1 according to a preferred embodiment of the present invention will be described in detail with reference to the accompanying drawings.

Existing relay devices transmit video and audio to the base camp relay equipment by moving only the camera while moving the site while relay equipment is present in the base camp when real-time relay is performed outdoors. Since the wireless signals used are different, it is difficult to synchronize video and audio. Accordingly, transmission delay occurs because it cannot be relayed in real time, and technical operations such as synchronization after receiving signals from a plurality of cameras have to be performed. In order to improve this, a movable relay truck is used, but this relay truck has very limited movable places.

In order to improve the delay phenomenon, if wireless communication is replaced with wired communication, the delay phenomenon can be eliminated and relaying can be performed. However, this also has many limitations in relaying due to the problem of not being able to move from a fixed place.

As non-face-to-face meetings are activated, real-time video conferences are being held. However, in order to perform inspection visits that require moving while visiting various places, fixed relay systems have difficulties due to space limitations.

In addition, if you want to see a product or process during a real-time meeting such as product introduction with overseas companies, or if there is video information about the site that buyers want, we provide video data quickly and provide detailed video and audio information. If information is provided, it is expected that the effect of continuous mobile real-time videoconferencing will be significantly increased.

1 is an exemplary diagram of a mobile live relay device 1 according to the present invention.

The mobile live relay device 1 is connected to a relay terminal 4 using a wireless communication unit, and a plurality of terminals of a host terminal 2 and a guest terminal 3 are connected to the relay terminal 4. By being connected in this way, real-time relaying and video conferences can be performed in real time. Here, the relay terminal 4 consists of a server and may transmit various data stored in the mobile live relay device 1, the host terminal 2, and the guest terminal 3.

The mobile live relay device 1 can provide various images in a plurality of locations while moving, and can also provide images captured in various locations. Since the mobile live broadcast device 1 has both a fixed camera 31 and a mobile camera 32, it can conduct a video conference while moving and provide various images captured in various places at the same time.

Referring to FIG. 1, the configuration of the mobile live relay device 1 will be described.

The mobile live relay device 1 includes a mobile cart 10, a communication unit 20, a camera unit 30, a display unit 40, a user input unit 50, a microphone 60, a speaker 70, and a drone 80. and a control unit 90.

The mobile cart 10 has a cart body 11 on which shelves are formed and wheel parts 12 supported by the cart body 11 to move. The mobile cart 10 includes a communication unit 20, a camera unit 30, a display unit 40, a user input unit 50, a microphone 60, a speaker 70, a drone 80, and a control unit 90, which will be described later. support

The communication unit 20 is supported by the mobile cart 10 and transmits and receives data with the relay terminal 4.

The camera unit 30 is provided to take pictures of a fixed place and various and wide places. The camera unit 30 includes a fixed camera 31 and a moving camera 32 .

The fixed camera 31 is supported by the movable cart 10 to take images, and may be provided with at least one. The fixed camera 31 includes a telephoto fixed camera 311 , a wide-angle fixed camera 312 and a fixed communication unit 313 .

The telephoto fixed camera 311 is provided to zoom in and photograph a place far away from the mobile cart 10 .

The wide-angle fixed camera 312 may capture a wide area by taking a wide-angle view of a place close to the mobile cart 10 .

The fixed communication unit 313 may be provided in each of the telephoto fixed camera 311 and the wide-angle fixed camera 312 to transmit captured images to the relay terminal 4 .

The mobile camera 32 is separated from the mobile cart 10 and takes pictures of various places such as distant places. The mobile camera 32 may include a plurality of first mobile cameras 321 and second mobile cameras 322 .

The first mobile camera 321 includes a first mobile communication unit 321-1 and a first mobile wide-angle camera 321-2. The first mobile communication unit 321-1 may transmit an image captured by the first mobile wide-angle camera 321-2 to the relay terminal 4. The first moving wide-angle camera 321-2 can capture a wide area by taking a picture with a wide angle.

The second mobile camera 322 includes a second mobile communication unit 322-1 and a second mobile telephoto camera 322-2. The second mobile communication unit 322-1 may transmit an image captured by the second mobile telephoto camera 322-2 to the relay terminal 4. The second mobile telephoto camera 322-2 may capture a wide area by taking a picture with a wide angle.

The display unit 40 may display an image including a captured image captured by the camera unit 30 and an image received from the relay terminal 4 .

The user input unit 50 inputs a user's command.

The microphone 60 may be installed on the mobile cart 10 and the mobile camera 32 to receive voice generated around the mobile cart 10 and the mobile camera 32 .

The speaker 70 is installed on the mobile cart 10 or the mobile camera 32 and can output audio to the surroundings of the mobile cart 10 or the mobile camera 32 .

A plurality of drones 80 are provided, and include a first drone 81 and a second drone 82 .

The first drone 81 may fly by driving the first flight drive unit 811 . The first flight drive unit 811 may include a motor and a propeller.

The second drone 82 can fly due to the driving of the second flight drive unit 821 . The second flight drive unit 821 may include a motor and a propeller.

The control unit 90 controls the communication unit 20 to transmit the captured image taken by the camera unit 30 to the relay terminal 4 so that it is displayed on the host terminal 2 and the guest terminal 3, and the relay terminal 4 The display unit 40 is controlled to display the image of the host terminal 3 received from the host terminal 3, the image 3 of the guest terminal, and the video captured by the camera unit 30, and the host terminal 2 and the guest terminal ( 3) and at least one mobile camera 32 is moved to an area corresponding to the input area data to take a picture when any one of the area data captured by the camera unit 30 is input from the user input unit 50 Controls one moving camera (32).

After the plurality of mobile cameras 32 move to the area corresponding to the input area data, the control unit 90 enlarges and captures the area corresponding to the input area data in at least two directions, and transmits the pictures to the relay terminal 4. Control.

The controller 90 controls the plurality of moving cameras 32 to move so that a pattern of the repeated movement can be simultaneously photographed when recognizing a repetitive movement in an enlarged photographed image.

2 is an exemplary diagram for providing an image of an input area.

2 (a) during a video conference between the mobile live relay device 1, the host terminal 2, and the guest terminal 3 using the relay terminal 4, selecting point A and point B or dragging the area C indicates that

2 (b) In this way, when the user, host, and guest touch with their hand or click and drag input with the mouse on the captured image, the first drone 81 and the second drone 82 in which the moving cameras 321 and 322 are accommodated are It moves to point A, point B, and area C, and captures points, point B, and area C in a plurality of directions to provide captured images.

3 is an exemplary diagram for providing images in a plurality of directions.

FIG. 3 (a) One of the images of point, point B, and region C in a plurality of directions in FIG. ) is displayed.

FIG. 3 (b) One of the images of point, point B, and area C in FIG. 2 taken from a plurality of directions, and the captured images taken from one direction and the other are captured by the mobile live relay device 1, the host terminal 2, and the guest. It is displayed on the terminal (3).

4 is an exemplary view of an image of an input area.

When a user, host, or guest touches a captured image with their hand or clicks and drags an input with a mouse, the moving cameras 321 and 322 move to the input location and take a photo. The controller 90 repeatedly moves in the received image The first drone 81 and the second drone 82 in which the mobile cameras 321 and 322 are accommodated are moved or the mobile cameras 321 and 322 are moved so that the motion is grasped and the pattern of the repeated movement motion can be captured at the same time. A pattern of repetitive movement may be included on one screen by using the zoom function.

6 is an exemplary view of the actual configuration of the continuous mobile live broadcasting device 1, FIG. 7 is an exemplary view of real-time relaying while moving a production line in the field, and FIG. 8 is an example of moving a partitioned office, factory, warehouse, and laboratory. It is an example of real-time relaying.

Modifiable embodiments other than the above described embodiments will be described.

The control unit 90 stores data on processes and products at each site, and when a user, host, or guest touches, clicks, or drags with a mouse on a captured image, the moving camera 321 , 322) is moved to the input location and taken, and at the same time, data such as process data and products for the input location are transmitted to the mobile live relay device 1, the host terminal 2, and the guest terminal 3. can make it

The control unit 90 stores a transmission form for transmitting data such as process data and products for the input place along with the captured image, so that the user, host, and guest can touch, click, and use the mouse on the captured image. When a drag input is performed with the mouse, data such as process data and products for the place entered in the transmission form are loaded, and when a photographed image is received from the moving camera (321, 322), only image frames with a preset sharpness or higher are loaded into the transmission form. and send it

It may further include a video connector for selecting any one of the images received from a plurality of cameras and transmitting it to the stair terminal. This video connector may have a button that the user can directly select. The control unit may control a plurality of voices to be selected from among a plurality of microphones corresponding to a selected camera.

A battery unit for supplying power to all components supported on the mobile cart may be further included.

Images and audio received from a plurality of cameras and a plurality of microphones can be relayed in real time by processing the images with a signal processing unit provided.

The control unit may divide an area of the display unit to display an on-site image and host/guest images in separate areas.

In addition to the camera, a video player unit capable of transmitting existing data images may be further included.

It may further include an audio mixing device unit for enabling a video conference without sound delay by converging the performer's audio and the viewer's audio in real time.

Due to the mobile live broadcasting device 1, real-time relaying is performed to the host terminal 2 and the guest terminal 3 using the relay terminal 4 while moving using the mobile cart 10 to provide video, When region data is input on the relay image during real-time video, the moving camera (321, 322) moves to the input area data and takes a picture. Since it provides a captured image, it can quickly provide a clear image, so the promptness of data provision and the provided data clarity can be improved.

1: mobile live relay device 2: host terminal
3: guest terminal 4: relay terminal
10: mobile cart 11: cart body
12: wheel part 20: communication part
30: camera unit 31: fixed camera
311 Telephoto fixed camera 312 Wide angle fixed camera
313: fixed communication unit 32: mobile camera
321: first mobile camera 322: second mobile camera
40: display unit 50: user input unit
60: microphone 70: speaker
80: drone 81: first drone
82: second drone 90: control unit

Claims (5)

A mobile live relay device for real-time relaying to a plurality of terminals including a host terminal and a guest terminal using a relay terminal capable of real-time relaying,
A movable cart having a cart body on which shelves are formed and wheels supported by the cart body to move;
a communication unit that is supported by the mobile cart and transmits/receives data with the relay terminal;
a camera unit comprising at least one fixed camera supported by the mobile cart to capture an image and a plurality of mobile cameras separated from the mobile cart and having a mobile communication unit to capture an image;
a display unit displaying an image including a photographed image captured by the camera unit;
a user input unit for inputting a user command; and
The communication unit controls the communication unit to transmit an image captured by the camera unit to the relay terminal so as to be displayed on the host terminal and the guest terminal, and the video of the host terminal received from the relay terminal, the video of the guest terminal, and the Controls the display unit to display an image captured by the camera unit, and responds to the input area data when any one area data among the image areas captured by the camera unit is input from the host terminal, the guest terminal, and the user input unit. A control unit for controlling the plurality of mobile cameras so that the plurality of mobile cameras are moved to an area to take pictures;
The control unit controls the plurality of mobile cameras to enlarge and capture an area corresponding to the input area data in at least two directions after moving to an area corresponding to the input area data, and transmit the photographed image to the relay terminal;
The plurality of mobile cameras include a telephoto camera having a telephoto lens for capturing a long-distance area and a wide-angle camera having a wide-angle lens for capturing a wide area.
delete delete delete According to claim 1,
Each of the plurality of moving cameras,
A continuous mobile live broadcasting device, characterized in that it further comprises at least one microphone for receiving a voice including a user's voice.

Images