WO2022226745A1

WO2022226745A1 - Photographing method, control apparatus, photographing device, and storage medium

Info

Publication number: WO2022226745A1
Application number: PCT/CN2021/090053
Authority: WO
Inventors: 杜丹阳
Original assignee: 深圳市大疆创新科技有限公司
Priority date: 2021-04-26
Filing date: 2021-04-26
Publication date: 2022-11-03
Also published as: CN116941235A

Abstract

A photographing method, a control apparatus, a photographing device, and a storage medium. The photographing method comprises: controlling a first photographing apparatus to photograph a first target, and controlling a second photographing apparatus to photograph a second target, so as to obtain first video data and second video data (S101); extracting a target image of the second target according to video frame images of the second video data (S102); and synthesizing the target image of the second target into a corresponding video frame image of the first video data, so as to obtain target video data (S103).

Description

Shooting method, control device, and storage medium of shooting equipment

technical field

The present application relates to the field of photographing technologies, and in particular, to a photographing method, a control device, a photographing device, and a storage medium.

Background technique

With the development of Internet technology, live video has gradually entered people's lives, such as introduction of travel live broadcast, live broadcast of goods and so on. Among them, live broadcast with goods refers to a new service method in which the anchor uses live broadcast technology to display goods online, consult and answer questions, and guide sales through some Internet platforms. In order to have a better live broadcast effect, a handheld PTZ with a camera can be used for live video, and a mobile terminal can also be installed on the handheld PTZ to shoot or watch the live video. The user provides the video data of one camera, so that the two shooting devices (the camera on the hand-held PTZ and the mobile terminal) cannot be fully utilized, so that a better experience cannot be provided to the user.

SUMMARY OF THE INVENTION

To this end, the present application provides a shooting method, a control device, a shooting device, and a storage medium, and videos shot by the shooting method can be applied to live video broadcasts, so as to give users a better viewing experience.

In a first aspect, the present application provides a photographing method, which is applied to a photographing device, where the photographing device at least includes a photographing device of a first photographing device and a second photographing device, and the method includes:

controlling the first photographing device to photograph the first target, and controlling the second photographing device to photograph the second target, to obtain first video data and second video data;

Extract the target image of the second target according to the video frame image of the second video data;

The target image of the second target is synthesized into the corresponding video frame image of the first video data to obtain target video data.

In a second aspect, the present application further provides a control device, the control device is configured to control the first shooting device and the second shooting device to capture images, the control device includes a memory and a processor;

the memory is used to store computer programs;

The processor is configured to execute the computer program and implement the following steps when executing the computer program:

In a third aspect, the present application further provides a photographing device, the photographing device includes a memory and a processor, and at least further includes a first photographing device and a second photographing device;

the first photographing device and the second photographing device are used for photographing images;

the memory is used to store computer programs;

The processor is configured to execute the computer program, and when executing the computer program, implement the steps of the photographing method according to any one of the embodiments of the present application.

In a fourth aspect, the present application further provides a computer-readable storage medium, where the computer-readable storage medium stores a computer program, and when the computer program is executed by a processor, the processor enables the processor to implement any one of the methods provided in the present application. The shooting method described in item.

Embodiments of the present application provide a photographing method, a control device, a photographing device, and a storage medium, wherein by controlling the first photographing device to photograph the first target and the second photographing device to photograph the second target, the first The video data and the second video data, then extract the target image of the second target according to the video frame image of the second video data, and synthesize the target image of the second target in the corresponding video frame image of the first video data to obtain the target video data In this way, the same video data of different targets can be obtained by using two shooting devices at the same time, so as to be used for live video, thereby improving the viewing experience of the user.

It is to be understood that both the foregoing general description and the following detailed description are exemplary and explanatory only and are not limiting of the present application.

Description of drawings

In order to explain the technical solutions of the embodiments of the present application more clearly, the following briefly introduces the accompanying drawings used in the description of the embodiments. For those of ordinary skill, other drawings can also be obtained from these drawings without any creative effort.

Fig. 1 is the structural schematic diagram of a kind of hand-held PTZ provided by the embodiment of the present application;

FIG. 2 is a schematic block diagram of a control device provided by an embodiment of the present application;

3 is a schematic structural diagram of another handheld pan/tilt provided by an embodiment of the present application;

4 is a schematic flowchart of steps of a shooting method provided by an embodiment of the present application;

5a and 5b are schematic diagrams of an application scenario of the shooting method provided by the embodiment of the present application;

6a and 6b are schematic diagrams of two kinds of target images provided by the embodiments of the present application;

7 is a schematic diagram of another application scenario of the shooting method provided by the embodiment of the present application;

8 is a schematic diagram of a preset composition position provided by an embodiment of the present application;

9a and 9b are schematic diagrams of determining sub-targets provided by an embodiment of the present application;

FIG. 10 is a schematic diagram of a scenario of playing target video data according to an embodiment of the present application.

Detailed ways

The technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the accompanying drawings in the embodiments of the present application. Obviously, the described embodiments are part of the embodiments of the present application, not all of the embodiments. Based on the embodiments in the present application, all other embodiments obtained by those of ordinary skill in the art without creative efforts shall fall within the protection scope of the present application.

It should also be understood that the terminology used in the specification of the application herein is for the purpose of describing particular embodiments only and is not intended to limit the application. As used in this specification and the appended claims, the singular forms "a," "an," and "the" are intended to include the plural unless the context clearly dictates otherwise.

It should also be further understood that, as used in this specification and the appended claims, the term "and/or" refers to and including any and all possible combinations of one or more of the associated listed items .

The flowcharts shown in the figures are for illustration only, and do not necessarily include all contents and operations/steps, nor do they have to be performed in the order described. For example, some operations/steps can also be decomposed, combined or partially combined, so the actual execution order may be changed according to the actual situation.

With the development of the Internet and streaming media technology, live video has gradually entered people's lives, such as introduction of travel live broadcast, live broadcast of goods and so on. Among them, live broadcast with goods refers to a new service method in which the anchor uses live broadcast technology to display goods online, consult and answer questions, and guide sales through some Internet platforms. In order to have a better live broadcast effect, a handheld gimbal with a camera can be used for live video, and a mobile terminal (such as a mobile phone) can also be installed on the handheld gimbal to shoot or watch live video, but because the process of live video is generally Only the video data of one camera can be provided to the viewer, resulting in that the two shooting devices (the camera on the hand-held PTZ and the mobile terminal) cannot be fully utilized, so that a better experience cannot be provided to the user.

To this end, the embodiments of the present application provide a photographing method, a control device, a photographing device, and a storage medium, wherein the control device and the photographing device can execute any photographing method provided by the embodiments of the present application, so as to make full use of the capabilities of the photographing device. The shooting device uses the shot video for live video broadcast, so as to improve the user's experience.

It should be noted that, in the embodiments of the present application, the photographing device is specifically a handheld pan/tilt as an example for introduction. It should be understood that the handheld pan/tilt does not constitute a limitation on the specific form of the photographing device.

Some embodiments of the present application will be described in detail below with reference to the accompanying drawings. The embodiments described below and features in the embodiments may be combined with each other without conflict.

Please refer to FIG. 1 . FIG. 1 shows the structure of a handheld pan/tilt 100 provided by an embodiment of the present application. As shown in FIG. 1 , the handheld pan/tilt 100 may include a holding part 10 , a pan/tilt 11 , and a device bracket 12 , a first photographing device 13 and a second photographing device 14 .

The gimbal 11 is disposed on the grip portion 10 , and the gimbal 11 is used to mount the first photographing device 13 to enhance the stability of the first photographing device 13 . It should be noted that, in the embodiment of the present application, the pan/tilt 11 may be a two-axis pan/tilt or a three-axis pan/tilt, and the shooting direction of the first shooting device 13 can be adjusted.

The first photographing device 13 may specifically include a camera fixedly installed on the gimbal 11 , or may include a camera detachably installed on the gimbal 11 , and the detachable installation may specifically be understood that the camera can be installed when the handheld gimbal 100 is used. On the gimbal 11, the camera can be detached from the gimbal 11 when not in use, so that the user can store or carry the camera.

The second photographing device 14 is disposed on the holding part 10 of the handheld platform 100 through the device bracket 12 . Specifically, the device bracket 12 may be a clamping part, and the clamping part is disposed on the holding part 10 for clamping The second photographing device 14 . Wherein, the second photographing device 14 may include a smart phone, a tablet computer, a camera, or the like.

In some embodiments, the second camera 14 may include a front camera and a rear camera, the front camera is located on the display screen side of the second camera 14, and both the front camera and the rear camera may be used for shooting.

The hand-held pan-tilt 100 includes a control device 20 disposed in the grip portion 10. As shown in FIG. 2, the control device 20 includes a processor 201 and a memory 202 that are coupled, such as through an I2C bus. The control device 20 can control the rotation of the pan/tilt 11 to adjust the photographing direction of the first photographing device 13 , and can also control the first photographing device 13 and the second photographing device 14 .

Wherein, the control device 20 may also adjust the parameters of the first photographing device 13 , for example, for adjusting the photographing parameters of the first photographing device 13 . Exemplarily, for example, it is used to control the first photographing device 13 to focus on the photographed object, or adjust the exposure time of the first photographing device 13, and so on.

In some embodiments, the control device 20 may also control the second shooting device 14 to shoot images, adjust the shooting parameters of the second shooting device 14, switch the front camera and the rear camera of the second shooting device 14 to shoot, of course It is also possible to control the display screen of the second photographing device 14 to display, for example, to display a photographed video image.

The processor 201 may be, for example, a Micro-controller Unit (MCU, MCU), a Central Processing Unit (Central Processing Unit, CPU), or a Digital Signal Processor (Digital Signal Processor, DSP) or the like.

The memory 202 may be a Flash chip, a read-only memory (ROM, Read-Only Memory) magnetic disk, an optical disk, a U disk, or a removable hard disk, and the like.

In some embodiments, as shown in FIG. 3 , the handheld cloud platform 100 further includes a display screen 15, and the display screen 15 can be arranged on the holding part 10, and can be used to display the content shot by the first shooting device 13, and also A shooting interface of the handheld platform 100 can be displayed, and the shooting interface can be used to adjust the shooting parameters of the first shooting device 13 .

Hereinafter, the shooting method provided by the embodiments of the present application will be described in detail with the handheld gimbal in FIG. 1 , that is, the shooting methods provided by the embodiments of the present application may be applied to the handheld gimbal. It should be noted that the handheld gimbal shown in FIG. 1 is only used to explain the shooting method of the present application.

Please refer to FIG. 4 , which is a schematic flowchart of steps of a photographing method provided by an embodiment of the present application. The shooting method can be applied to shooting equipment, such as the handheld gimbal provided in the above-mentioned embodiment, so as to make full use of the two shooting devices of the handheld gimbal to shoot videos for live video, thereby improving the viewing experience of users .

It should be noted that the photographing device includes at least a first photographing device and a second photographing device. In some embodiments, the photographing device further includes a pan/tilt and a device bracket. The pan/tilt may be a three-axis pan/tilt, and the first photographing device is installed On the gimbal, the second photographing device is installed on the equipment bracket, and the photographing device can control the photographing angle of the first photographing device and enhance the stability of the first photographing device through the gimbal.

In some embodiments, the first photographing device may be, for example, a camera, or, of course, a camera, and the second photographing device may be, for example, a mobile terminal, such as a cell phone.

As shown in FIG. 4 , the photographing method includes steps S101 to S103.

S101, controlling the first photographing device to photograph a first target, and controlling the second photographing device to photograph a second target, to obtain first video data and second video data;

S102, extracting the target image of the second target according to the video frame image of the second video data;

S103. Synthesize the target image of the second target into the corresponding video frame image of the first video data to obtain target video data.

The first target and the second target may be targets of different types, for example, the first target may be an item, and the second target may be a person (such as a video shooter or a video host); the first target and the second target may also be Targets of the same type, for example, the first target and the second target are both characters, or both can be objects, or both can be animals, and both can be landscapes.

In an embodiment of the present application, the first target includes a non-personal target, such as a landscape or an object, etc.; the second target includes a human target, such as a user using the photographing device, more specifically a video host.

When shooting, the positions of the first target and the second target relative to the shooting device are different, and may be located on different sides of the shooting device, or may be located on the same side of the shooting device but at different shooting angles.

Exemplarily, as shown in FIG. 5a, the types of the first target and the second target are different, the first target is a landscape, the second target is a person, and the first target and the second target are located on both sides of the handheld gimbal 100; As shown in FIG. 5b , the first target and the second target are of the same type, the first target is a vase, and the second target is also a vase. The first target and the second target are located on the same side of the handheld gimbal 100, but are located in different shots It is necessary to use two shooting devices to shoot separately, and the field of view of one shooting device cannot cover the first target and the second target.

In the embodiment of the present application, the first shooting device is controlled to shoot the first target, and the second shooting device is controlled to shoot the second target, so as to obtain the first video data corresponding to the first target and the video data corresponding to the second target. second video data. Then, the target image of the second target is extracted according to the video frame image of the second video data.

The target image may include part of the second target or all of the second target. Specifically, as shown in Figures 6a and 6b, the target image in Figure 6a includes all the second targets, and the target image in Figure 6b includes part of the second targets.

In some embodiments, in order to improve the shooting effect of the video and improve the user's viewing experience during live video, when the first shooting device is controlled to shoot the first target, the first shooting device can be specifically controlled to shoot the first target. photographing, and performing target recognition according to the photographed image; and tracking and photographing the first target according to the recognition result. It is especially suitable when the first target is a moving target, such as a robot, an electric toy car, etc. When shopping for these items through live video, tracking shooting can be used to facilitate the photographer and the user to watch the video, which is beneficial to the items. 's introduction.

Exemplarily, in a live video scenario, for example, the robot (the first target) is introduced through live video. During the live broadcast, the robot may move or complete other dynamic functions in order to introduce the robot. According to the target feature, the first shooting device is controlled to follow the robot to perform tracking shooting. As shown in Figure 7, the first shooting device can be controlled by the PTZ to follow the movement of the robot (eg, from time T1 to time Tn) to perform tracking shooting. By tracking the shooting, the first target can always be in the shooting picture, and the picture can also be kept stable, thereby improving the viewing experience of the user.

In some embodiments, when controlling the first photographing device to photograph the first target, specifically, according to the preset composition position, the motion of the first photographing device may be controlled by the pan/tilt so that the first target is located at the preset composition position, and photographing the first target. As a result, a video with a specific composition can be produced, thereby improving the user's video viewing experience.

The preset composition position may be the composition position selected by the user, and the composition position may be understood as setting the position of the first target in the shooting screen. Exemplarily, as shown in FIG. 8 , the preset composition position is the setting of the first target Of course, the upper left corner of the shooting screen can also be other positions, which is not specifically limited here, and can be set by the user to improve the user's experience.

Specifically, the gimbal can be controlled to rotate to adjust the position of the first target in the shooting screen. For example, to adjust the position of the upper left corner of the first target in the shooting screen, it is determined that the first target is in the upper left corner of the shooting screen as the preset Composition location.

In some embodiments, if a control instruction for controlling the rotation of the gimbal is detected, the rotation of the gimbal is controlled according to the control instruction to change the preset composition position of the first object in the first video data, and then the preset composition position of the first object in the first video data is changed according to the control instruction. The composition position is set to control the movement of the first photographing device through the PTZ, so that the first target is located at the changed preset composition position, and the first target is photographed. Therefore, it is convenient for the user to adjust the preset composition position, thereby shooting a variety of videos.

For example, if the user wants to synthesize the target image of the second target in the upper left corner of the corresponding video frame image of the first video data, the original preset composition position can be changed by controlling each axis of the gimbal.

In some embodiments, when controlling the second photographing device to photograph the second target, the photographing parameters of the first photographing device when photographing the first target may be specifically obtained; the second photographing device is determined based on the photographing parameters of the first photographing device and shooting the second target according to the determined shooting parameters. In this way, it can be ensured that the synthesized target video data has a better degree of matching, so that the target video data is more natural, thereby improving the user's viewing experience.

In the embodiments of the present application, the shooting parameters include, but are not limited to, exposure time, aperture size, resolution, white balance, and the like.

Extracting the target image of the second target according to the video frame image of the second video data, specifically, image recognition technology may be used to identify the second target from the video frame image of the second video data, and extract the target image of the second target.

In some embodiments, target recognition may also be performed on the video frame image of the second video data, and the recognition result is displayed for user confirmation when the second video data is displayed, and the target image of the second target is determined according to the user's confirmation result.

For example, if the second target in the video frame image of the second video data includes multiple sub-targets, the user needs to determine a specific sub-target among the multiple sub-targets. Specifically, target recognition can be performed on the video frame image of the second video data. Obtain the recognition results of multiple sub-targets, and display the recognition results of each sub-target for confirmation by the user when displaying the second video data, and specifically display the recognition frame corresponding to each sub-target when displaying each video frame of the second video data. In order for the user to determine, if the user operates one of the recognition frames, the image corresponding to the recognition frame is determined to be the target image of the specific sub-target.

Exemplarily, as shown in Figure 9a, it is recognized that the video frame image in the second video data includes 5 sub-targets, which are respectively sub-target a1, sub-target a2, sub-target a3, sub-target a4 and sub-target a5. , and display the recognition frames of the five sub-targets when displaying the video frame images in the second video data, and obtain the user's click operation on the recognition frames. For example, if the user clicks on the sub-target a5, the image corresponding to the recognition frame of the sub-target a5 is determined. The target image of a specific sub-target is used as the extracted target image, as shown in Figure 9b.

Of course, other methods may also be used to extract the target image of the second target according to the video frame image of the second video data, such as image segmentation, to segment the target image of the second target.

After extracting the target image of the second target, the target image of the second target is synthesized into the corresponding video frame image of the first video data to obtain target video data. Wherein, the corresponding video frame image of the first video data refers to a video frame with the same or similar acquisition time as the video frame image corresponding to the target image of the second target.

For example, the video capture frame rates of the first shooting device and the second shooting device are the same, for example, both are 30fps (frames per second), and the corresponding video frame image of the first video data refers to the video frame corresponding to the target image of the second target. The video frames with the same image acquisition time, for example, can be represented by the number of video frames. If the target image of the second target corresponds to the second video frame, the corresponding video frame image of the first video data is also the second frame. Video frame; if the target image of the second target corresponds to the second to mth video frames, the corresponding video frame images of the first video data are also the second to mth video frames.

In some embodiments, the target image of the second target is synthesized in the corresponding video frame image of the first video data, specifically, the image parameters of the corresponding video frame image of the first video data can be obtained; The image parameters of the corresponding video frame images, adjust the image parameters of the target image of the second target, so that the image parameters of the target image of the second target match the image parameters of the corresponding video frame images of the first video data; The target image of the second target is synthesized in the corresponding video frame image of the first video data.

The image parameters include at least one of brightness, color temperature, exposure, contrast, and saturation. Compared with the above-mentioned method of adjusting the shooting parameters of the shooting device before shooting, by changing the image parameters of the target image, the synthesized image can also be made to look more natural, thereby improving the user's viewing experience. It should be noted that the image parameters of the target image of the second target match the image parameters of the corresponding video frame image of the first video data. Specifically, the image parameters of the two images may be the same or similar, such as within a preset threshold range. , allowing users to look more natural.

In some embodiments, after adjusting the image parameters of the target image of the second target according to the image parameters, the parameter adjustment amount corresponding to the image parameter of the target image for adjusting the second target may also be obtained; the parameter adjustment amount is sent to the second shooting the device, so that the second shooting device changes the shooting parameters according to the parameter adjustment amount to shoot the second target. So that when the user selects other specific sub-targets, the target image of the sub-target is synthesized into the corresponding video frame image of the first video data, so that the synthesized image is also more natural, and does not need to be adjusted according to the image parameters, which improves the synthesis efficiency and efficiency. User viewing experience.

In some embodiments, in order to improve the viewing experience of the user, when synthesizing the target image of the second target into the corresponding video frame image of the first video data, a synthesis parameter may be specifically obtained, and according to the synthesis parameter, the second target The target image of the target is synthesized in the corresponding video frame image of the first video data. The synthesis parameter may be preset by the user to improve the user's experience.

Wherein, the synthesis parameter includes at least position information of the target image in the corresponding video frame image in the first video data. The position information refers to the position of the corresponding video frame image in which the target image is synthesized in the first video data, for example, it may be synthesized at the upper left corner, the upper right corner or the middle position.

In some embodiments, in order to improve the viewing experience of the user, different target images may have different position information in the corresponding video frame images of the first video data. The second target in the target video data synthesized in this way will not be in a fixed position when the video is played, so compared with the current small window or picture-in-picture, this method has better flexibility and higher customer experience.

In some embodiments, the different position information forms the target movement trajectory of the second target. For example, when the second target is a vehicle, by forming the target movement trajectory, the user can feel the vehicle is moving when watching the target video data, that is, feel the dynamic second target, but the actual shooting of the second target is static, which can further improve the user's experience.

In some embodiments, the different location information is determined according to the user's sliding track on the display screen of the second photographing device. For example, the user's sliding trajectory on the display screen of the second photographing device is an "L" shape, and the "L" shape determines different position information, that is, it can be understood that different position information forms the target movement trajectory of the second target. It is an "L" shape, which can not only improve the user's viewing experience, but also improve the operating experience of the video shooter.

In some embodiments, the target image of the second target is synthesized in the corresponding video frame image of the first video data, specifically, the first target video frame image may be determined from the video frame image of the first video data; The target images in the multi-frame video frame images of the data are synthesized in the first target video frame image. In this way, part of the video frames of the first video data can be played still, and the target image can be played relatively dynamically, thereby improving the user's viewing experience.

Exemplarily, for example, the first video data captured by the first photographing device is a landscape, and the second video data captured by the second photographing device is a character, so a frame of video frame image with better scenery (the first target video frame image) is selected. As a fixed background, the target images in the multi-frame video frame images are synthesized in the first target video frame image to realize the effect of a dynamic live broadcast of characters with fixed backgrounds, thereby improving the user's viewing experience.

In some embodiments, the target image of the second target is synthesized in the corresponding video frame image of the first video data, and specifically, the second target video frame image may be determined from the video frame image of the second video data; The target image in the target video frame image is synthesized in the multiple video frame images of the first video data. Thereby, the target image can be still played, and the first video data can be played dynamically, thereby improving the user's viewing experience.

Exemplarily, for example, the first video data captured by the first photographing device is a landscape, and the second video data captured by the second photographing device is a character, so the target image of the character is selected to fix the character, the scenery is dynamically played, and the fixed and dynamic live broadcast of the character is realized. The effect of the scenery, thereby improving the user viewing experience.

The first target video frame image and the second target video frame image are determined according to a user's selection operation. For example, the first target video frame image is determined according to the user's click operation on the display screen of the shooting device, and the second target video frame image is determined according to the user's click operation on the display screen of the second shooting device.

In some embodiments, in order to facilitate the video shooter to adjust the captured video at any time, target video data may also be displayed through the display screen of the second capture device. Exemplarily, as shown in FIG. 5a or FIG. 5b, the target video data is displayed on the display screen of the terminal, so that the video shooter can determine whether the shooting of the played video is satisfactory, so as to make timely adjustments.

In some embodiments, the target video data may also be output. Exemplarily, as shown in FIG. 10 , the obtained target video data can be sent to a server, and the server can send the video data to each terminal to play the video data for users to watch. For example, the server is installed with the server of the live broadcast platform, and the terminal is installed with the live broadcast platform. client.

It should be noted that, as shown in FIG. 10 , unlike existing live broadcast platforms that display images captured by multiple cameras through picture-in-picture or split-screen display, the target video data of the embodiment of the present application does not need to use these display technologies. (Picture-in-picture and split-screen display) display two video data, and can also display the shooting pictures of multiple shooting devices, and has better effects.

In some embodiments, a preset mode may also be preset, and the preset mode is used to trigger the execution of any of the shooting methods provided in this application, that is, when the user selects the preset mode, this preset mode is executed. The application provides the shooting method, thereby facilitating the user to determine whether to use the shooting method, thereby improving the user's experience.

Specifically, before controlling the first photographing device to photograph the first target and controlling the second photographing device to photograph the second target, a preset mode trigger instruction triggered by the user may also be obtained, and the preset mode trigger instruction may be obtained according to the preset mode trigger instruction. The steps of the shooting method provided by the present application are executed, for example, steps S101 to S103 are executed to realize the shooting of target video data.

In some embodiments, the preset mode may be specifically associated with a mode button set on the photographing device, and when the user operates the mode button, it means that the preset mode is selected. Correspondingly, the shooting method can also detect whether the user operates the mode button, and if it is detected that the user operates the mode button, the preset mode trigger instruction is generated.

In other embodiments, the display screen of the second photographing device displays a photographing control interface, and the photographing control interface includes a mode icon, and a preset mode can be associated with the mode icon. When the user operates the mode icon, it means that the user has selected the mode icon. the preset mode. Correspondingly, the shooting method may also detect whether the user operates the mode icon, and if it is detected that the user operates the mode icon, the preset mode trigger instruction is generated.

In the shooting method provided by the above embodiment, the first video data and the second video data are obtained by controlling the first shooting device to shoot the first target and the second shooting device to shoot the second target, and then according to the second video data The target image of the second target is extracted from the video frame image of the second target, and the target image of the second target is synthesized in the corresponding video frame image of the first video data to obtain target video data, thereby realizing the simultaneous shooting of different targets by using two shooting devices. The same video data is used for live video, thereby improving the user's viewing experience.

Embodiments of the present application also provide a control device, which may be set in a photographing device or other equipment, and used to control the first photographing device and the second photographing device of the photographing device to capture images, the control device includes a memory and a processor; the memory is used to store a computer program; the processor is used to execute the computer program and when executing the computer program, implement any of the shooting methods provided in the embodiments of this application. step. The control device may be a processor, a controller, a chip, a programmable logic device, or the like. The photographing device may be a camera, a mobile phone, a handheld device equipped with a camera, a movable platform, and the like.

Specifically, as shown in FIG. 2 , the photographing device 20 includes a processor 201 and a memory 202 connected by a bus, such as an I2C (Inter-integrated Circuit) bus.

The processor 201 may be a micro-controller unit (Micro-controller Unit, MCU), a central processing unit (Central Processing Unit, CPU), or a digital signal processor (Digital Signal Processor, DSP) or the like.

The memory 202 may be a Flash chip, a read-only memory (ROM, Read-Only Memory) magnetic disk, an optical disk, a U disk, a sliding hard disk, and the like.

Wherein, the processor is configured to run a computer program stored in the memory, and implement any one of the shooting methods provided in the embodiments of the present application when the computer program is executed.

Exemplarily, the processor is configured to run a computer program stored in the memory, and implement the following steps when executing the computer program:

In some embodiments, the control device is applied to a photographing device, the photographing device includes a pan/tilt and a device bracket, the first photographing device is mounted on the pan/tilt, and the second photographing device is mounted on the on the device stand.

In some embodiments, the first photographing device includes a camera, and the second photographing device includes a mobile terminal.

In some embodiments, the first target includes a non-personal target and the second target includes a character target.

In some embodiments, the controlling the first photographing device to photograph the first target includes:

The first photographing device is controlled to photograph the first target, and target recognition is performed according to the photographed image; and the first target is tracked and photographed according to the recognition result.

According to the preset composition position, the movement of the first photographing device is controlled by the pan/tilt so that the first target is located at the preset composition position, and the first target is photographed.

In some embodiments, the processor is further configured to:

If a control instruction for controlling the rotation of the PTZ is detected, control the rotation of the PTZ according to the control instruction to change the preset composition position of the first target in the first video data; according to the change After the preset composition position is obtained, the movement of the first photographing device is controlled by the pan/tilt so that the first target is located at the changed preset composition position, and the first target is photographed.

In some embodiments, the controlling the second photographing device to photograph the second target includes:

Obtain the shooting parameters when the first shooting device shoots the first target; determine the shooting parameters of the second shooting device based on the shooting parameters of the first shooting device, and determine the shooting parameters of the second shooting device according to the determined shooting parameters. target to shoot.

In some embodiments, the synthesizing the target image of the second target in the corresponding video frame image of the first video data includes:

Acquiring image parameters of the corresponding video frame image of the first video data; adjusting the image parameters of the target image of the second target according to the image parameters of the corresponding video frame image of the first video data, so that the first The image parameters of the target image of the second target match the image parameters of the corresponding video frame image of the first video data; and the adjusted target image of the second target is synthesized in the corresponding video of the first video data. in the frame image.

In some embodiments, the image parameters include at least one of brightness, color temperature, exposure, contrast, and saturation.

In some embodiments, after adjusting the image parameters of the target image of the second target according to the image parameters, the processor is further configured to:

Acquire a parameter adjustment amount corresponding to the image parameter of the target image for adjusting the second target; send the parameter adjustment amount to the second photographing device, so that the second photographing device can adjust the parameter according to the parameter adjustment amount The second target is photographed by changing the photographing parameters.

In some embodiments, the second photographing device includes a display screen, and the processor is configured to:

The target video data is displayed through the display screen of the second photographing device.

Obtaining synthesis parameters, wherein the synthesis parameters include at least position information of the target image in the corresponding video frame image in the first video data; according to the synthesis parameters, the target image of the second target is synthesized in the corresponding video frame image of the first video data.

In some embodiments, different target images have different position information in corresponding video frame images of the first video data.

In some embodiments, the different pieces of the position information form a target movement trajectory of the second target.

In some embodiments, the different pieces of the location information are determined according to the sliding track of the user on the display screen of the second photographing device.

The first target video frame image is determined from the video frame images of the first video data; the target images in the multiple video frame images of the second video data are synthesized into the first target video frame image.

A second target video frame image is determined from the video frame image of the second video data; and the target image in the second target video frame image is synthesized into multiple video frame images of the first video data.

In some embodiments, the first target video frame image and the second target video frame image are determined according to a user's selection operation.

In some embodiments, the processor is configured to: output the target video data.

In some embodiments, before the controlling the first photographing device to photograph the first target and the controlling the second photographing device to photograph the second target, the processor is further configured to:

Obtain a preset mode trigger instruction triggered by the user, and execute the control of the first shooting device to shoot the first target and the second shooting device to shoot the second target according to the preset mode trigger command. step.

In some embodiments, a mode button is provided on the photographing device; the processor is used for:

If it is detected that the user operates the mode button, the preset mode trigger instruction is generated.

In some embodiments, the display screen of the second photographing device displays a photographing control interface, and the photographing control interface includes a mode icon; the processor is configured to:

If it is detected that the user operates the mode icon, the preset mode trigger instruction is generated.

The embodiments of the present application further provide a computer-readable storage medium, where the computer-readable storage medium stores a computer program, the computer program includes program instructions, and the processor executes the program instructions to implement the above implementation The steps of any one of the shooting methods provided in the example.

The computer-readable storage medium may be an internal storage unit of the photographing device described in any of the foregoing embodiments, such as a memory or internal memory of the photographing device. The computer-readable storage medium may also be an external storage device of the photographing device, such as a plug-in hard disk equipped on the photographing device, a smart memory card (Smart Media Card, SMC), a secure digital (Secure Digital, SD) ) card, Flash Card, etc.

The above are only specific implementations of the present application, but the protection scope of the present application is not limited thereto. Any person skilled in the art can easily think of various equivalents within the technical scope disclosed in the present application. Modifications or substitutions shall be covered by the protection scope of this application. Therefore, the protection scope of the present application shall be subject to the protection scope of the claims.

Claims

A photographing method, characterized in that, applied to a photographing device including at least a first photographing device and a second photographing device, the method comprising:

controlling the first photographing device to photograph the first target, and controlling the second photographing device to photograph the second target, to obtain first video data and second video data;

Extract the target image of the second target according to the video frame image of the second video data;

The target image of the second target is synthesized into the corresponding video frame image of the first video data to obtain target video data.
The method according to claim 1, wherein the photographing device comprises a pan/tilt and a device support, the first shooting device is mounted on the pan/tilt, and the second shooting device is mounted on the device support superior.
The method according to claim 1, wherein the first photographing device comprises a camera, and the second photographing device comprises a mobile terminal.
The method of claim 1, wherein the first target comprises a non-personal target and the second target comprises a character target.
The method according to claim 1, wherein the controlling the first photographing device to photograph the first target comprises:

controlling the first photographing device to photograph the first target, and performing target recognition according to the photographed image; and

The first target is tracked and photographed according to the recognition result.
The method according to claim 1, wherein the controlling the first photographing device to photograph the first target comprises:

According to the preset composition position, the movement of the first photographing device is controlled by the pan/tilt so that the first target is located at the preset composition position, and the first target is photographed.
The method according to claim 6, wherein the method further comprises:

If a control instruction for controlling the rotation of the PTZ is detected, controlling the rotation of the PTZ according to the control instruction to change the preset composition position of the first target in the first video data;

According to the changed preset composition position, the movement of the first photographing device is controlled by the PTZ so that the first target is located at the changed preset composition position, and the first target is photographed.
The method according to claim 1, wherein the controlling the second photographing device to photograph the second target comprises:

acquiring shooting parameters when the first shooting device shoots the first target;

The shooting parameters of the second shooting device are determined based on the shooting parameters of the first shooting device, and the second target is shot according to the determined shooting parameters.
The method according to claim 1, wherein the synthesizing the target image of the second target into the corresponding video frame image of the first video data comprises:

Obtain the image parameters of the corresponding video frame image of the first video data;

Adjust the image parameters of the target image of the second target according to the image parameters of the corresponding video frame images of the first video data, so that the image parameters of the target image of the second target are the same as the image parameters of the first video data. matching the image parameters of the corresponding video frame images; and

The adjusted target image of the second target is synthesized into the corresponding video frame image of the first video data.
The method according to claim 9, wherein the image parameters include at least one of brightness, color temperature, exposure, contrast and saturation.
The method according to claim 9, wherein after adjusting the image parameters of the target image of the second target according to the image parameters, the method further comprises:

obtaining the parameter adjustment amount corresponding to the image parameter of the target image for adjusting the second target;

The parameter adjustment amount is sent to the second photographing device, so that the second photographing device changes the photographing parameter according to the parameter adjustment amount to photograph the second target.
The method according to claim 1, wherein the second photographing device comprises a display screen, and the method comprises:

The target video data is displayed through the display screen of the second photographing device.
The method according to claim 1, wherein the synthesizing the target image of the second target into the corresponding video frame image of the first video data comprises:

acquiring synthesis parameters, wherein the synthesis parameters include at least position information of the target image in the corresponding video frame image in the first video data;

According to the synthesis parameter, the target image of the second target is synthesized into the corresponding video frame image of the first video data.
The method according to claim 13, wherein the position information of the different target images in the corresponding video frame images of the first video data is different.
The method according to claim 13, wherein the different position information forms a target movement trajectory of the second target.
The method according to claim 13, wherein the different pieces of the position information are determined according to the sliding track of the user on the display screen of the second photographing device.
The method according to claim 1, wherein the synthesizing the target image of the second target into the corresponding video frame image of the first video data comprises:

Determine a first target video frame image from the video frame image of the first video data;

The target images in the multiple frames of video frame images of the second video data are synthesized into the first target video frame images.
The method according to claim 1, wherein the synthesizing the target image of the second target into the corresponding video frame image of the first video data comprises:

Determine a second target video frame image from the video frame image of the second video data;

The target image in the second target video frame image is synthesized into multiple video frame images of the first video data.
The method according to claim 17 or 18, wherein the first target video frame image and the second target video frame image are determined according to a user's selection operation.
The method of claim 1, wherein the method comprises:

The target video data is output.
The method according to claim 1, characterized in that before the controlling the first photographing device to photograph the first target and the controlling the second photographing device to photograph the second target, the method further comprises: :

Obtain a preset mode trigger instruction triggered by the user, and execute the control of the first shooting device to shoot the first target and the second shooting device to shoot the second target according to the preset mode trigger command. step.
The method according to claim 21, wherein a mode button is provided on the photographing device; the method comprises:

If it is detected that the user operates the mode button, the preset mode trigger instruction is generated.
The method according to claim 21, wherein the display screen of the second photographing device displays a photographing control interface, and the photographing control interface includes a mode icon; the method comprises:

If it is detected that the user operates the mode icon, the preset mode trigger instruction is generated.
A control device, characterized in that the control device is used to control a first photographing device and a second photographing device to photograph images, and the control device includes a memory and a processor;

the memory is used to store computer programs;

The processor is configured to execute the computer program and implement the following steps when executing the computer program:

controlling the first photographing device to photograph the first target, and controlling the second photographing device to photograph the second target, to obtain first video data and second video data;

Extract the target image of the second target according to the video frame image of the second video data;

The target image of the second target is synthesized into the corresponding video frame image of the first video data to obtain target video data.
The control device according to claim 24, wherein the control device is applied to a photographing device, the photographing device comprises a pan/tilt and a device bracket, the first photographing device is mounted on the pan/tilt, the The second photographing device is mounted on the equipment support.
The control device according to claim 24, wherein the first photographing device comprises a camera, and the second photographing device comprises a mobile terminal.
The control device of claim 24, wherein the first target comprises a non-personal target, and the second target comprises a character target.
The control device according to claim 24, wherein the controlling the first photographing device to photograph the first target comprises:

controlling the first photographing device to photograph the first target, and performing target recognition according to the photographed image; and

The first target is tracked and photographed according to the recognition result.
The control device according to claim 24, wherein the controlling the first photographing device to photograph the first target comprises:

According to the preset composition position, the movement of the first photographing device is controlled by the pan/tilt so that the first target is located at the preset composition position, and the first target is photographed.
The control device of claim 29, wherein the processor is further configured to:

If a control instruction for controlling the rotation of the pan-tilt is detected, then the pan-tilt is controlled to rotate according to the control instruction to change the preset composition position of the first target in the first video data;

According to the changed preset composition position, the movement of the first photographing device is controlled by the pan/tilt so that the first target is located at the changed preset composition position, and the first target is photographed.
The control device according to claim 24, wherein the controlling the second photographing device to photograph the second target comprises:

acquiring shooting parameters when the first shooting device shoots the first target;

The shooting parameters of the second shooting device are determined based on the shooting parameters of the first shooting device, and the second target is shot according to the determined shooting parameters.
The control device according to claim 24, wherein the synthesizing the target image of the second target into the corresponding video frame image of the first video data comprises:

Obtain the image parameters of the corresponding video frame image of the first video data;

Adjust the image parameters of the target image of the second target according to the image parameters of the corresponding video frame images of the first video data, so that the image parameters of the target image of the second target are the same as the image parameters of the first video data. matching the image parameters of the corresponding video frame images; and

The adjusted target image of the second target is synthesized into the corresponding video frame image of the first video data.
The control device according to claim 32, wherein the image parameters include at least one of brightness, color temperature, exposure, contrast and saturation.
The control device according to claim 32, wherein after adjusting the image parameters of the target image of the second target according to the image parameters, the processor is further configured to:

obtaining the parameter adjustment amount corresponding to the image parameter of the target image for adjusting the second target;

The parameter adjustment amount is sent to the second photographing device, so that the second photographing device changes the photographing parameter according to the parameter adjustment amount to photograph the second target.
The control device according to claim 24, wherein the second photographing device comprises a display screen, and the processor is configured to:

The target video data is displayed through the display screen of the second photographing device.
The control device according to claim 24, wherein the synthesizing the target image of the second target into the corresponding video frame image of the first video data comprises:

acquiring synthesis parameters, wherein the synthesis parameters include at least position information of the target image in the corresponding video frame image in the first video data;

According to the synthesis parameter, the target image of the second target is synthesized into the corresponding video frame image of the first video data.
The control device according to claim 36, wherein the position information of the different target images in the corresponding video frame images of the first video data is different.
The control device according to claim 36, wherein the different position information forms a target movement trajectory of the second target.
The control device according to claim 36, wherein the different position information is determined according to the sliding track of the user on the display screen of the second photographing device.
The control device according to claim 24, wherein the synthesizing the target image of the second target into the corresponding video frame image of the first video data comprises:

Determine a first target video frame image from the video frame image of the first video data;

The target images in the multiple frames of video frame images of the second video data are synthesized into the first target video frame images.
The control device according to claim 24, wherein the synthesizing the target image of the second target into the corresponding video frame image of the first video data comprises:

Determine a second target video frame image from the video frame image of the second video data;

The target image in the second target video frame image is synthesized into multiple video frame images of the first video data.
The control device according to claim 40 or 41, wherein the first target video frame image and the second target video frame image are determined according to a user's selection operation.
The control device of claim 24, wherein the processor is configured to:

The target video data is output.
The control device according to claim 24, characterized in that before the control of the first photographing device to photograph the first target and the control of the second photographing device to photograph the second target, the processor Also used for:

Obtain a preset mode trigger instruction triggered by the user, and execute the control of the first shooting device to shoot the first target and the second shooting device to shoot the second target according to the preset mode trigger command. step.
The control device according to claim 44, wherein a mode button is provided on the photographing device; the processor is used for:

If it is detected that the user operates the mode button, the preset mode trigger instruction is generated.
The control device according to claim 44, wherein the display screen of the second shooting device displays a shooting control interface, and the shooting control interface includes a mode icon; the processor is configured to:

If it is detected that the user operates the mode icon, the preset mode trigger instruction is generated.
A photographing device, characterized in that the photographing device includes a memory and a processor, and at least further includes a first photographing device and a second photographing device;

the first photographing device and the second photographing device are used for photographing images;

the memory is used to store computer programs;

The processor is configured to execute the computer program and implement the steps of the photographing method according to any one of claims 1-23 when the computer program is executed.
The photographing device of claim 47, wherein the photographing device comprises a hand-held head.
A computer-readable storage medium, characterized in that, the computer-readable storage medium stores a computer program, and when the computer program is executed by a processor, the processor implements the process according to any one of claims 1 to 23 the steps of the shooting method.