TW202123673A - Multi-robotic live production and webcast videography system includes at least one photographing robot, a main control equipment, and at least one operation mode unit - Google Patents

Abstract

A multi-robotic live production and webcast videography system includes at least one photographing robot which can perform live photography and video recording by its built-in procedures or learned capabilities rather than manual operation. The video recording includes image recording and audio recording, in which the photographing robot can move without human intervention; a main control device configured as a remote control device to remotely control the photographing robot, or configured to be installed inside the photographing robot directly, in which the main control device is used to receive the video recording message transmitted from the at least one photographing robot, and store it in a video recording database; at least one operation mode unit is for determining the operation mode of individual photographing robot to allow the photographing robot to perform the video recording operations according to the operation mode. The operation mold unit includes an operation mode database which stores the predetermined operations mode. The operation mode unit is located in the main control device or the photographing robot.

Description

Multi-robot live production and broadcast photography system

The present invention relates to robots, cameras, directors and video recorders, especially Multi-robotic Live Production & Webcast Videography System (Multi-robotic Live Production & Webcast Videography System).

Due to the development of imaging technology nowadays, it is necessary to shoot and video on many occasions for projection purposes. For example, the broadcast of ball games, the broadcast of major events, the coverage of scenic spots, the shooting of movies, the live broadcast of dramas or concerts and various live events, etc., may require on-site photography, production, and video recording.

Traditionally, interviewers or photojournalists come to the scene to take photos and videos. For example, a large-scale football game (such as the World University Games) is held. Often a news station needs to send a large number of photographers to the scene to record and record the same or different games. Real-time live broadcast. Due to social progress and economic development, labor costs are getting higher and higher. If the game requires multiple perspectives to shoot, due to the limitations of manpower, it is often impossible to capture the key perspectives needed for the moment. Therefore, on the one hand, too much human resources will be consumed, which will also cause the loss of the screen. What's more, the wire-line operation of multi-camera pre-wired video transmission is also quite time-consuming and labor-intensive, and it becomes an obstacle in the channel, which will cause concerns about the safety of the audience. If the camera signal is wirelessly transmitted, the staff must also assign multiple cameras at different locations one by one after arriving at the scene. It is time-consuming to install and connect the transmitter and receiver at fixed points. Moreover, the plug-in and installation of all video equipment at the position of the switcher of the video wired and wireless receiving end is also a very time-consuming task, and it is quite easy to make mistakes when time is tight.

Due to the development of artificial intelligence, it has been possible to implant intelligent functions into many mechanical devices to save labor costs. Therefore, this case hopes to propose a new multi-robot live production and broadcast photography system to solve the above-mentioned various technical shortcomings. .

Therefore, the purpose of the present invention is to solve the above-mentioned conventional technical problems. In the present invention, a Multi-robotic Live Production & Webcast Videography System (Multi-robotic Live Production & Webcast Videography System) is proposed. The multi-camera robot system for automatic video recording can perform video recording and move to change the shooting position according to the established rules or the ability after learning. The shooting robot shooting in this case has a variety of operation modes including manual remote control mode, logic mode, and AI (artificial intelligence). ) Mode and script mode, so that the camera robot can move and adjust the required video angle according to the operation mode, and send the video data back to the main control device for processing. The main control device can carry out on-site production procedures with screen selection, and it also has several operation modes to switch and broadcast, record and store the return screen. Therefore, the entire on-site photography, directing, production and recording operations can be performed. All are automated, and there is no need to configure a photographer to manually operate each camera. Therefore, this case can be applied to live broadcasts of various activities such as ball broadcasts, live broadcasts of major events, scenic spots, filming, dramas or concerts, etc., and there is no need to configure human operation cameras on the spot, and there is no need to spend a lot of time beforehand. Equipment and wiring. Not only can the labor cost be greatly reduced, but also a different number of camera robots can be configured according to the needs to cooperate with the different operations of the camera robot and the main control device. It can be used to adjust the focus of the scene, the viewing angle range and the switching mode of the camera's shooting mirror position. It is quite flexible in use and can ensure that all the required images are captured.

In order to achieve the above objective, the present invention proposes a multi-robot live production and broadcast photography system, which includes at least one camera robot, which can perform live photography and video recording according to its internal established regulations or learned capabilities without manual operation. Video includes video recording and audio recording; the camera robot is a robot equipped with a camera or a motion mechanism device with a camera that can change the shooting position of the camera. The photographing robot can be autonomously displaced without artificial movement; a master control device, which is a remote remote control device and uses a wired or wireless way to remotely control the photographing robot, or is directly installed inside the photographing robot; The main control device is used to receive the video message delivered from the at least one camera robot, including video and sound, and perform the operations of on-site reception screen switching and film production. The main control device also compares the received with the process The video data produced and processed on-site is stored in a video database, where the video database signal is connected to the main control device, and the video database is located inside or outside the camera robot; at least one operation mode unit, wherein the operation mode The unit mainly determines the operation mode of each camera robot, so that the camera robot performs video recording according to the operation mode; the operation mode unit includes an operation mode library, which stores the predetermined operation mode; where the operation mode unit is located in the The main control device or the camera robot; when the operation mode unit is in the main control device, the main control device instantly calculates the position of each camera robot and the recording intake area, and the at least A camera robot returns the recorded data to the main control device, and performs the mode guide switch selection and movie production of the on-site return screen according to the pre-selected and set operation mode, and stores it in the recording database; Operation mode unit bit When in the camera robot, the at least one operation mode unit is a plurality of operation mode units, and each of the operation mode units is stored in a corresponding camera robot, and the operation mode of the operation mode unit in each camera robot is instantaneous Calculate the running position of each camera robot and the recording intake area, and return the recorded data to the main control device, according to the pre-selected and set operation mode to switch the mode guide of the scene return screen And videos are produced and stored in the video database.

The features and advantages of the present invention can be further understood from the following description, and please refer to the accompanying drawings when reading.

10‧‧‧Photography Robot

20‧‧‧Master Control Device

30‧‧‧Video Database

40‧‧‧Operation Mode Unit

41‧‧‧Operation Mode Library

50‧‧‧Cloud Device

42‧‧‧Location Planning Unit

100‧‧‧Basketball Court

410‧‧‧Operation Mode

411‧‧‧Logical control mode

412‧‧‧AI (Artificial Intelligence) Mode

413‧‧‧Script Mode

Figure 1 shows a schematic diagram of the application of this case.

Figure 2 shows the block diagram of the device in this case.

Figure 3 shows another illustrative example of the block diagram of the device in this case.

Fig. 4 shows another illustrative example of the block diagram of the device in this case.

Figure 5 shows another illustrative example of the block diagram of the device in this case.

Figure 6 shows a schematic diagram of the operation mode library of this case.

With regard to the structural composition of this case, and the effects and advantages that can be produced, in conjunction with the drawings, a preferred embodiment of this case is described in detail as follows.

Please refer to Figures 1 to 6, which show the multi-robot live production and broadcast photography system of the present invention, which includes the following components:

At least one camera robot 10 is capable of performing live audio-visual production and recording based on established internal procedures or learned capabilities without manual operation, where the recording includes images Video recording and sound recording. The photographing robot 10 is a robot equipped with a photographing device or a motion mechanism device equipped with a photographing device that can change the shooting position of the camera. The camera robot 10 can be moved autonomously without artificial movement, for example, it can move through a movement mechanism configured by itself, or move on an existing track. Among them, the type of the photographic robot 10 may also be an unmanned aerial vehicle (UAV) or an unmanned surface vehicle (USV).

A main control device 20. The main control device 20 can be a remote remote control device, which can remotely control the photography robot 10 in a wired or wireless manner (as shown in Figs. 2 and 3), or the main control device 20 can be directly Installed inside the camera robot 10 (as shown in FIG. 4).

As shown in FIG. 4, the at least one camera robot 10 in this case may be a plurality of camera robots 10, and the main control device 20 is installed on one of the camera robots 10, and the main control device 20 controls the plurality of camera robots. 10.

The main control device 20 can be used to receive the video message delivered from the at least one camera robot 10, including images and sounds, and perform the operations of switching the on-site reception screen and film production. The main control device 20 also receives The video data and the video data after on-site production and processing are stored in a video database 30, where the video database 30 is signally connected to the main control device 20, and the video database 30 can be located in the camera robot 10 or the master In the control device 20, or an external cloud device 50 (as shown in FIG. 5).

The main control device 20 can also be used to instruct the actions of the at least one camera robot 10. The main control device 20 includes all input functions, that is, the main control device 20 can cut in and interrupt the previously planned video recording operation of each camera robot 10 at any time, and the background operator will guide the at least one camera robot through the main control device 20 10 video operations.

This case also includes at least one operation mode unit 40, where the operation mode unit 40 mainly determines the operation mode of each camera robot 10 so that the camera robot 10 can perform video recording operations according to the operation mode. The operation mode unit 40 includes an operation mode library 41, which stores a predetermined operation mode 410.

As shown in FIGS. 2 and 4, the operation mode unit 40 can be stored in the main control device 20, and the main control device 20 can calculate the position of each camera robot 10 and the recording intake area in real time, and The at least one camera robot 10 returns the recorded data to the main control device 20, and performs the on-site return screen guide switch selection and movie production and storage in the recording database according to the pre-selected and set operation mode 30 in. Or as shown in FIG. 3, the at least one operation mode unit 40 is a plurality of operation mode units 40, and each operation mode unit 40 is stored in a corresponding photographing robot 10, and the operation mode unit in each photographing robot 10 is 40 operation mode 410 calculates the position of each camera robot 10 and the recording intake area in real time, and returns the recorded data to the main control device 20, and performs on-site return according to the pre-selected and set operation mode The selection of the guide switching of the transmitted screen and the production of the film are stored in the video database 30.

As shown in FIG. 6, the operation mode library 41 in this case may include multiple operation modes 410, which are described as follows:

The first operation mode is the logic control mode 411, which applies the established logic to guide the image recording. Among them, the established logic can divide the focus of video recording into primary focus, secondary focus, secondary focus, etc., as the priority order during video recording.

This mode also includes the setting of the focus by the operator in the operation mode, so when performing live recording, the operator can set the focus first, and a higher proportion of the shooting and recording time is given to the focus that is ranked first. For example, in a basketball game, when Jeremy Lin’s games are played, the operator can input Jeremy Lin Howe’s feature is used as a priority for shooting focus to increase the ratio of shooting and video recording of the screen.

For example, when broadcasting a football game, it can be divided into four focal points. The first focal point is the ball, the second focal point is the players or coaches close to the ball, the third focal point is the players or coaches away from the ball, and the fourth focal point is the audience. When there are four camera robots 10, one focal point can be assigned to each camera robot 10. If it is not exactly four camera robots 10, the distribution of the screen shooting tasks can be determined through the predetermined logic inside the operation mode unit 40. For example, when there is only one camera robot 10, the focus can be alternately focused and the image zoomed in turn to perform the recording work. FIG. 1 shows a schematic diagram of the application in which four camera robots 10 are arranged in different positions of a basketball court 100 in this case.

For example, the broadcasting of scenic spots can be divided into static and dynamic. For example, the dynamic target is the first focus, and the static target is the second focus. Or it is a completely static scenic spot such as the scenery video of Jiugou Village, which can be preset which is the main focus or which is the secondary focus and so on.

The camera robot 10 is equipped with tracking and identification functions, so it can track and identify objects in the recorded image to perform automatic recording operations.

The second operation mode is the AI (artificial intelligence) mode 412, in which the camera robot 10 is installed on a machine with learning capabilities (learning robot), and the learning robot first learns and exercises on a specific target, and then The learning and training results are stored in the camera robot 10 so that the camera robot 10 can perform automatic video recording operations on the specific target. For example, let the learning robot watch a large number of broadcasts of specific ball games (such as basketball), so that it can learn the key points of the screen captures during basketball broadcasts, and increase the planning ability of the learning robot through actual on-site training. Therefore, a better screen capture focus can be planned. This allows the one or more camera robots 10 to record on-site images.

In this mode, it also includes the operator’s forcibly setting the focus of the recording in the operation mode, so that Therefore, when the camera robot 10 is broadcasting, it tracks and records the focal points that are ranked first in a higher proportion.

The third mode of operation is the script mode 413. For programs with a predetermined schedule, such as filming, drama, performance, etc., the screens that should be captured during shooting can be scheduled according to the previous schedule, so that at least one The camera robot 10 records on-site images.

The main control device 20 can be switched to manual, that is, it receives instructions from the operator, controls the screen switching or synthesis of the main control device 20, or instructs each camera robot 10 to perform photography according to the settings of the main control device 20.

According to the above description, the main control device 20 can perform automatic operation according to the above three operation modes, or switch to manual operation. Especially when the main control device 20 performs screen switching or synthesis, these operation modes can also be used for operations.

The operation mode unit 40 further includes a position planning unit 42 for planning the position and range of the camera robot 10 running on the spot. When there are multiple camera robots 10, the position planning unit 42 can be used to allocate the range of each camera robot 10. For example, in a basketball game, there is a camera robot 10 in each half of the court. In which half of the court the ball runs, that is, the camera robot 10 located in that half of the court will take pictures. Therefore, a better camera angle can be obtained and the need for the camera robot 10 is reduced. The distance moved. Or planning the followable path of each camera robot 10.

The advantage of this case is the application of a camera robot that can automatically record. It can record and move and change the shooting position in accordance with established regulations or learned capabilities. The camera robot shooting in this case has a variety of operating modes including logic mode, AI (artificial intelligence) ) Mode and script mode, so that the camera robot can move and adjust the required video angle according to the operation mode, and send the video data back to the main control device. The screen selection for on-site production inside the main control device is also It has a variety of operation modes to switch, record, and store the broadcast screen. Therefore, the entire on-site photography director production and video recording operation can be automated, without the need to manually operate the camera. Therefore, this case can be applied to ball broadcasts, live broadcasts of major events, scenic spots, movie shooting, drama or concert videos, etc. or various live broadcasts of different activities, and there is no need to configure human operation cameras on the spot, which can not only greatly reduce labor costs. The time to set up and wire the equipment, and also can configure different numbers of camera robots according to the needs, and coordinate with the different operating modes of the camera robots and the main control device, you can adjust the focus of the scene and the range of angle of view required for recording. The above is quite flexible, and can ensure that all the required pictures are captured.

In summary, the humanized and considerate design of this case is quite in line with actual needs. Compared with the conventional technology, the specific improvement of the existing defects is obviously a breakthrough advantage, and it does have an increase in efficacy, and it is not easy to achieve. This case has not been disclosed or disclosed in domestic and foreign documents and markets, and it has complied with the provisions of the Patent Law.

The above detailed description is a specific description of a possible embodiment of the present invention, but this embodiment is not intended to limit the scope of the patent of the present invention. Any equivalent implementation or modification that does not deviate from the technical spirit of the present invention should be included in In the scope of the patent in this case.

10‧‧‧Photography Robot

20‧‧‧Master Control Device

100‧‧‧Basketball Court

Claims (16)

A multi-robot live production and broadcast photography system, including: At least one camera robot can perform on-site photography and video recording according to its internal established procedures or learned capabilities without manual operation. The video includes video recording and audio recording; the camera robot may not be manually operated. Move and move autonomously; A main control device, the main control device is a remote remote control device that uses a wired or wireless method to remotely control the photography robot, or is directly installed inside the photography robot; The main control device is used to receive the video message delivered from the at least one camera robot, including video and sound, and perform the operations of on-site reception screen switching and film production. The main control device also compares the received with the process The video data produced and processed on-site is stored in a video database, where the video database signal is connected to the main control device, and the video data library is located inside or outside the camera robot; At least one operation mode unit, where the operation mode unit mainly determines the operation mode of each camera robot so that the camera robot performs video recording operations according to the operation mode; the operation mode unit includes an operation mode library that stores predetermined operations mode; Wherein the operation mode unit is located in the main control device or the camera robot; when the operation mode unit is located in the main control device, the main control device instantly calculates the position of each camera robot and video recording Intake area, and the at least one camera robot will return the recorded data to the main control device, according to the pre-selected and set operation mode to perform the on-site return screen guide switch selection and movie production and store it in the In the video database; when the operation mode unit is in the photography robot, the at least one operation mode unit is a plurality of operation mode units, and each operation mode unit is stored in a corresponding photography robot. In the robot The operation mode of the operation mode unit calculates the position of each camera robot's running position and the recording intake area in real time, and returns the recorded data to the main control device, and performs on-site return according to the pre-selected and set operation mode. The selection of the guide switching of the transmitted screen and the production of the video are stored in the video database. For the multi-robot live production and broadcast photography system described in item 1 of the scope of the patent application, the operation mode library includes the operation mode as a logic control mode, which is the application of the established logic to guide the image recording screen. For example, in the multi-robot live production and broadcast photography system described in item 2 of the scope of patent application, the established logic system divides the focus of the video into different priority orders to determine the time ratio of the video. For the multi-robot live production and broadcast photography system described in item 2 of the scope of patent application, the operator sets the focus in the operation mode, and a higher proportion of the shooting and video recording time is given to the focus that is ranked first. For example, the multi-robot live production and broadcast photography system described in item 1 of the scope of patent application, wherein the operation mode library contains the operation mode as AI (artificial intelligence) mode, and the camera robot is installed in advance on a machine with learning ability during operation , The machine first learns and trains on a specific subject, and then stores the results of the learning and training in the camera robot, so that the camera robot can perform automatic video recording operations on the specific subject. For the multi-robot live production and broadcast photography system described in item 5 of the scope of patent application, in this operation mode, the operator can forcibly set the focus of the recording, so that the camera robot has a higher focus on the prioritized focus during broadcasting. The proportion of tracking and recording. For example, the multi-robot live production and broadcast photography system described in item 1 or 2 or 5 of the scope of patent application, wherein the photography robot is equipped with tracking and identification functions, so it can track and identify the recorded video Objects in the image to perform automatic recording operations. For example, the multi-robot live production and broadcast photography system described in item 1 of the scope of patent application, wherein the operation mode library contains the operation mode as the script mode. For programs with a predetermined schedule, the shooting should be scheduled according to the previous schedule. The captured images are used to enable the at least one camera robot to record on-site images. For the multi-robot live production and broadcast photography system described in item 1 of the scope of patent application, the operation mode unit further includes a position planning unit, which is used to plan the position and range of the camera running on the scene; when there are multiple When photographing robots, the position planning unit is also used to allocate the range of each photographing robot to obtain a better photographing angle and reduce the distance the photographing robot needs to move; the position planning unit is also used to plan the followable path of each photographing robot . For the multi-robot live production and broadcast photography system described in item 1 of the scope of patent application, the master control device is also used to instruct the actions of the at least one camera robot; the master control device includes all input functions, that is, the master control device can Cut and interrupt the originally planned video recording operation of each camera robot at any time, and the operator in the background will guide the video recording operation of the at least one camera robot through the main control device. The multi-robot live production and broadcast photography system described in the first item of the scope of patent application, wherein the at least one camera robot is a plurality of camera robots, and the main control device is installed on one of the camera robots and is controlled by the main control device The multiple camera robots. The multi-robot live production and broadcast photography system described in the first item of the scope of patent application, wherein the photography robot is moved by a movement mechanism configured by itself, or moved on an existing track. Such as the multi-robot live production and broadcast photography system described in item 1 of the scope of patent application, wherein the recording The image data warehouse is located in the camera robot, or in the main control device, or in an external cloud device. The multi-robot live production and broadcast photography system described in item 1 of the scope of patent application, wherein the photography robot is selected from an unmanned aerial vehicle (UAV) or an unmanned surface vehicle (USV). For example, the multi-robot live production and broadcast photography system described in the first item of the scope of patent application, wherein the main control device can be switched to manual, that is, receive instructions from the operator to control the screen switching or synthesis of the main control device, or instructions Each camera robot performs video recording according to the setting of the master control device. For example, the multi-robot live production and broadcast photography system described in the first item of the patent application, wherein the main control device automatically operates according to the operation mode of the operation mode unit; the main control device also applies these operation modes when synthesizing pictures Work on it.

Images