CN111131706B

CN111131706B - Video picture processing method and electronic equipment

Info

Publication number: CN111131706B
Application number: CN201911393803.7A
Authority: CN
Inventors: 李镕镕
Original assignee: Vivo Mobile Communication Co Ltd
Current assignee: Vivo Mobile Communication Co Ltd
Priority date: 2019-12-30
Filing date: 2019-12-30
Publication date: 2022-04-01
Anticipated expiration: 2039-12-30
Also published as: CN111131706A

Abstract

The embodiment of the invention discloses a video picture processing method and electronic equipment, relates to the technical field of communication, and aims to solve the problem that the quality of a shot video picture is poor due to the fact that the existing mobile electronic equipment is easy to cause. The method comprises the following steps: splicing N first video pictures which are obtained by shooting through the N cameras at the same moment to obtain a second video picture; cutting the second video picture to obtain a target video picture, wherein a target object in the target video picture is positioned in the composition center of the target video picture; wherein N is an integer greater than 1.

Description

Video picture processing method and electronic equipment

Technical Field

The embodiment of the invention relates to the technical field of communication, in particular to a video picture processing method and electronic equipment.

Background

With the continuous development of terminal technology, electronic devices are more and more widely applied. For example, more and more users take videos with electronic devices.

Currently, in order to capture a video with a target object always located in a composition center of a video frame, a user needs to continuously move an electronic device (a camera of the mobile electronic device) to capture the video according to the movement of the target object. However, when a user moves the electronic device, the quality of a captured video picture is poor due to camera shake.

Therefore, the existing method for shooting the video with the target object always positioned in the composition center of the video picture easily causes poor quality of the video picture.

Disclosure of Invention

The embodiment of the invention provides a video picture processing method and electronic equipment, and aims to solve the problem that the picture quality of a video shot by the conventional mobile electronic equipment is poor easily.

In order to solve the technical problem, the present application is implemented as follows:

in a first aspect, an embodiment of the present invention provides a video picture processing method, which is applied to an electronic device including N cameras, where directions of pictures acquired by the N cameras are the same, and the method includes: splicing N first video pictures which are obtained by shooting through the N cameras at the same moment to obtain a second video picture; cutting the second video picture to obtain a target video picture, wherein a target object in the target video picture is positioned in the composition center of the target video picture; wherein N is an integer greater than 1.

In a second aspect, an embodiment of the present invention provides an electronic device, where the electronic device includes N cameras, and directions in which the N cameras collect pictures are the same, and the electronic device includes: a splicing module and a cutting module; the splicing module is used for splicing N first video pictures which are obtained by shooting through the N cameras at the same moment to obtain a second video picture; the cutting module is used for cutting the second video picture obtained by the splicing module to obtain a target video picture, and a target object in the target video picture is positioned in the composition center of the target video picture; wherein N is an integer greater than 1.

In a third aspect, an embodiment of the present invention provides an electronic device, which includes a processor, a memory, and a computer program stored in the memory and being executable on the processor, and when executed by the processor, the computer program implements the steps of the video picture processing method in the first aspect.

In a fourth aspect, an embodiment of the present invention provides a computer-readable storage medium, on which a computer program is stored, which, when executed by a processor, implements the steps of the video picture processing method as in the first aspect.

In the embodiment of the invention, the electronic equipment can splice N first video pictures which are obtained by shooting through the N cameras respectively at the same time to obtain a second video picture; cutting the second video picture to obtain a target video picture, wherein a target object in the target video picture is positioned in the composition center of the target video picture; wherein N is an integer greater than 1. By the scheme, the electronic equipment can obtain the target video picture of the target object positioned in the composition center of the video picture by splicing and cutting the N first video pictures shot by the N cameras at the same time, so that the target object can be shot and obtained to a certain extent and the video with better video picture quality is always positioned in the composition center of the video picture without moving the position of the electronic equipment.

Drawings

Fig. 1 is a schematic diagram of an architecture of a possible android operating system according to an embodiment of the present invention;

FIG. 2 is a flowchart of a video frame processing method according to an embodiment of the present invention;

FIG. 3 is a second flowchart of a video frame processing method according to an embodiment of the present invention;

FIG. 4 is a third flowchart of a video frame processing method according to an embodiment of the present invention;

FIG. 5 is a fourth flowchart of a video frame processing method according to an embodiment of the present invention;

FIG. 6 is a fifth flowchart of a video frame processing method according to an embodiment of the present invention;

FIG. 7 is a sixth flowchart of a video frame processing method according to an embodiment of the present invention;

fig. 8 is a schematic structural diagram of an electronic device according to an embodiment of the present invention;

fig. 9 is a hardware schematic diagram of an electronic device according to an embodiment of the present invention.

Detailed Description

The technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are some, but not all embodiments of the present application. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present application.

The term "and/or" herein is an association relationship describing an associated object, meaning that three relationships may exist, e.g., a and/or B, may mean: a exists alone, A and B exist simultaneously, and B exists alone. The symbol "/" herein denotes a relationship in which the associated object is or, for example, a/B denotes a or B.

The terms "first," "second," "third," and "fourth," etc. in the description and in the claims of the present application are used for distinguishing between different objects and not for describing a particular order of the objects. For example, the first input, the second input, the third input, the fourth input, etc. are used to distinguish between different inputs, rather than to describe a particular order of inputs.

In the embodiments of the present invention, words such as "exemplary" or "for example" are used to mean serving as examples, illustrations or descriptions. Any embodiment or design described as "exemplary" or "e.g.," an embodiment of the present invention is not necessarily to be construed as preferred or advantageous over other embodiments or designs. Rather, use of the word "exemplary" or "such as" is intended to present concepts related in a concrete fashion.

In the description of the embodiments of the present invention, unless otherwise specified, "a plurality" means two or more, for example, a plurality of processing units means two or more processing units; plural elements means two or more elements, and the like.

The embodiment of the invention provides a video picture processing method.A piece of electronic equipment can splice N first video pictures which are respectively obtained by shooting through N cameras at the same time to obtain a second video picture; cutting the second video picture to obtain a target video picture, wherein a target object in the target video picture is positioned in the composition center of the target video picture; wherein N is an integer greater than 1. By the scheme, the electronic equipment can obtain the target video picture of the target object positioned in the composition center of the video picture by splicing and cutting the N first video pictures shot by the N cameras at the same time, so that the target object can be shot and obtained to a certain extent and the video with better video picture quality is always positioned in the composition center of the video picture without moving the position of the electronic equipment.

The following describes a software environment applied to the video picture processing method provided by the embodiment of the present invention, taking an android operating system as an example.

Fig. 1 is a schematic diagram of an architecture of a possible android operating system according to an embodiment of the present invention. In fig. 1, the architecture of the android operating system includes 4 layers, which are respectively: an application layer, an application framework layer, a system runtime layer, and a kernel layer (specifically, a Linux kernel layer).

The application program layer comprises various application programs (including system application programs and third-party application programs) in an android operating system.

The application framework layer is a framework of the application, and a developer can develop some applications based on the application framework layer under the condition of complying with the development principle of the framework of the application.

The system runtime layer includes libraries (also called system libraries) and android operating system runtime environments. The library mainly provides various resources required by the android operating system. The android operating system running environment is used for providing a software environment for the android operating system.

The kernel layer is an operating system layer of an android operating system and belongs to the bottommost layer of an android operating system software layer. The kernel layer provides kernel system services and hardware-related drivers for the android operating system based on the Linux kernel.

Taking an android operating system as an example, in the embodiment of the present invention, a developer may develop a software program for implementing the video picture processing method provided in the embodiment of the present invention based on the system architecture of the android operating system shown in fig. 1, so that the video picture processing method may operate based on the android operating system shown in fig. 1. That is, the processor or the electronic device may implement the video picture processing method provided by the embodiment of the present invention by running the software program in the android operating system.

The electronic device in the embodiment of the invention can be a mobile electronic device or a non-mobile electronic device. The mobile electronic device may be a mobile phone, a tablet computer, a notebook computer, a palm computer, a vehicle-mounted terminal, a wearable device, an ultra-mobile personal computer (UMPC), a netbook or a Personal Digital Assistant (PDA), etc.; the non-mobile electronic device may be a Personal Computer (PC), a Television (TV), a teller machine, a self-service machine, or the like; the embodiments of the present invention are not particularly limited.

An execution main body of the video image processing method provided by the embodiment of the present invention may be the electronic device (including a mobile electronic device and a non-mobile electronic device), or may also be a functional module and/or a functional entity capable of implementing the method in the electronic device, which may be determined specifically according to actual use requirements, and the embodiment of the present invention is not limited. The following takes an electronic device as an example to exemplarily explain a video picture processing method provided by the embodiment of the present invention.

Referring to fig. 2, an embodiment of the present invention provides a video picture processing method, which is applied to an electronic device including N cameras, where the N cameras capture pictures in the same direction, and the method may include steps 201 to 202 described below.

Step 201, the electronic device splices N first video pictures obtained by shooting through the N cameras respectively at the same time to obtain a second video picture.

Wherein N is an integer greater than 1.

Optionally, the N cameras may be located on the same horizontal line of the electronic device, or the N cameras may not be located on the same horizontal line of the electronic device, which is not limited in the embodiment of the present invention.

It should be noted that, no matter the N cameras are located on the same horizontal line of the electronic device or not, any two adjacent cameras in the N cameras overlap the first video picture acquired at the same time, so that it is ensured that the second video picture obtained by splicing is continuous and uninterrupted.

In the embodiment of the invention, the positions of the N cameras on the electronic equipment are not limited. For example, the N cameras may include a camera located on a screen of the electronic device and a camera located on a side of the electronic device; for a retractable screen electronic device that includes a main screen and at least two secondary screens (retractable screens) located on both sides of the main screen, the N cameras can include a camera located on the main screen and a camera located on at least one of the secondary screens.

It can be understood that the N first video pictures are sequentially spliced according to the arrangement order of the N cameras, and specifically, the N first video pictures are sequentially spliced according to the arrangement order of the camera corresponding to each first video picture.

Exemplarily, N is 3, the electronic device includes 3 cameras that are located on the same horizontal line and have the same captured picture, which are camera 1, camera 2 and camera 3, respectively, and the electronic device sequentially splices 3 first video pictures that are captured by camera 1, camera 2 and camera 3 at the same time. The electronic equipment sequentially splices the first video picture 1, the first video picture 2 and the first video picture 3.

In the embodiment of the invention, frame image fusion and matching technology and the like are adopted to splice the video pictures shot by the N cameras, and the specific frame image fusion and matching technology can refer to any related technology, and the embodiment of the invention is not limited.

Step 202, the electronic device cuts the second video picture to obtain a target video picture.

The target object in the target video picture is located in the composition center of the target video picture.

It can be understood that the composition is a modeling art term, that is, the image to be expressed is properly organized to form a coordinated complete picture according to the requirements of the subject and the theme when drawing. The embodiment of the invention is applied to a shooting scene, namely a video picture with a prominent shooting subject and a definite shooting theme is shot, and the successful composition can lead the content of the shot work to be orderly arranged into chapters with clear primary and secondary and prominent theme, thereby being pleasing to the eyes.

Optionally, in the embodiment of the present invention, the composition center may be a preset position.

For example, a specific position in a video screen determined according to a preset operation by a user may be set as a composition center. For example, the user previously determines the geometric center of the video picture as the composition center, so that the electronic apparatus highlights the target object by controlling the target object to be located at the geometric center of the target video picture. It is understood that the user may preset any position in the screen as a composition center according to the requirement.

Illustratively, the visual center of the video frame, which refers to the center point of the human visual field in one plane, may be set as the composition center, and typically, the human visual center will be above the geometric center.

Optionally, in this embodiment of the present invention, the composition center may be a position determined according to a scene of the video image, that is, a composition scheme matched with the scene is determined according to scene information such as an object category and an environmental characteristic in the video image, and a position where a shooting subject needs to be located in the composition scheme is determined as the composition center.

It should be noted that, in the embodiment of the present invention, there are two possible cases in the positional relationship between the composition centers of two consecutive frames of video pictures (two frames of target video pictures) in a video: in the first possible case, the position of the composition center of any two consecutive frames of video pictures in the video is the same regardless of the scene change in the video. In a second possible case, it is determined whether the positions of the composition centers of two consecutive video frames in the video are the same according to the change of the scene in the video, that is, the positions of the composition centers of two consecutive video frames in the video may be the same (for example, for the same shooting scene (always being an outdoor shooting scene), the positions of the composition centers of two consecutive video frames in the video are the same), or may be different (for example, for different shooting scenes (from an outdoor scene to an indoor scene), the positions of the composition centers of two consecutive video frames in the video are different), which is not limited in the embodiment of the present invention.

The second video picture is obtained by shooting through a plurality of cameras, and the scene of the video picture is larger than that of the video picture obtained by shooting through one camera, so that the video of the target object always positioned in the composition center of the video picture can be obtained more easily to a certain extent through clipping processing, and the electronic equipment does not need to be moved in the shooting process, so that the quality of the shot video picture is better.

It can be understood that, in the embodiment of the present invention, when a user needs to shoot a video, the N cameras are simultaneously started to shoot, and the N video pictures shot at the same time are subjected to stitching processing and clipping processing, so that a video with a target object always located in a composition center of the video picture and a good video picture quality can be finally obtained.

It should be noted that, in the embodiment of the present invention, the N cameras may be at least two of multiple cameras, where the electronic device is located on the same horizontal line and the cameras have the same direction of acquiring a picture, and in an acquisition process, along with movement of the target object, the electronic device may start more cameras or switch cameras according to a requirement (when the target object moves to a position close to an edge of a video picture (a second video picture) obtained by splicing video pictures acquired by the N cameras), so as to obtain a target video picture of the target object located in a center of a composition. If the electronic equipment is the electronic equipment with the telescopic screen and the N cameras comprise cameras positioned on the auxiliary screen, the electronic equipment can also determine the extension length of the auxiliary screen according to actual use requirements so as to shoot a target video picture of a target object positioned in the composition center.

It should be noted that, in the embodiment of the present invention, the electronic device performs the processing in steps 201 to 202 on each frame of video frames in N videos captured by N cameras at the same time, so that a video in which the target object is always located in the composition center can be obtained.

Optionally, in the embodiment of the present invention, the electronic device may automatically detect the shooting subject (i.e., the target object) in the second video frame according to a preset rule, and the electronic device may also determine the shooting subject (i.e., the target object) in the second video frame according to an input of a user.

Exemplarily, in conjunction with fig. 2, as shown in fig. 3, before step 202, the video picture processing method provided by the embodiment of the present invention may further include step 203 described below.

And step 203, the electronic equipment determines the first object in the second video picture as the target object under the condition that the target condition is met.

Wherein the target condition comprises at least one of: receiving a first input of a first object by a user; detecting that the first object is a preset object; detecting that the first object is the only portrait in the second video picture; it is detected that the first object is located in the center of at least two portrait images comprised by the second video picture.

In the embodiment of the present invention, the first object may be an object that actively moves or passively moves, such as a person, an animal, a scene, a vehicle, and the like, and the embodiment of the present invention is not limited.

It can be understood that, in the embodiment of the present invention, in a case where the electronic device receives a first input to the first object by the user, the electronic device determines the first object in the second video picture as the target object.

It should be noted that, before step 201, the electronic device may receive a first input of the first object from the user, or after step 201, the electronic device may receive the first input of the first object from the user, which is not limited in the embodiment of the present invention.

For example, before shooting a video, the user may designate a first object as a target object through the first input, and during a subsequent shooting of the video, the electronic device may perform object tracking on the first object to determine the target object in each frame of the video. For a specific object tracking technology, reference may be made to the related art, and the embodiments of the present invention are not limited thereto.

It is to be understood that, for a case where a plurality of human figures are included in the second video screen, the electronic device may determine the target object from the plurality of human figures through the first input described above.

Optionally, the first input may be a click input or a slide input of the user on the preview image for the first object, the first input may also be an input of the user inputting the first object in the input box, and the first input may also be other feasibility inputs, which is not limited in the embodiment of the present invention.

Illustratively, the click input may be any number of click inputs or multi-finger click inputs, such as a single click input, a double click input, a three click input, a double-finger click input, or a three-finger click input; the slide input may be a slide input in an arbitrary direction or a multi-finger slide input, for example, an upward slide input, a downward slide input, a leftward slide input, a rightward slide input, a two-finger slide input, or a three-finger slide input.

It can be understood that, in the embodiment of the present invention, before shooting a video, an object to be shot (a shooting subject), that is, a preset object, may be preset. In the process of shooting the video, in the case that the electronic equipment detects that the first object is a preset object, the electronic equipment determines the first object in the second video picture as a target object.

It can be understood that, in the embodiment of the present invention, if the shooting mode is the portrait mode, in a case that the electronic device detects that the first object is the only portrait in the second video frame, the electronic device determines the first object in the second video frame as the target object.

It can be understood that, in the embodiment of the present invention, if the shooting mode is the portrait mode, in a case that the electronic device detects that the first object is located in the center of at least two portraits included in the second video frame, the electronic device determines the first object in the second video frame as the target object.

In the embodiment of the invention, a plurality of modes for determining the target object are provided, and a user can select the corresponding mode for determining the target object according to the actual use requirement so as to improve the efficiency of shooting the video required by the user.

Optionally, in an embodiment of the present invention, the composition center position of the target object in the video frame is mapped by a reference scale.

Exemplarily, in conjunction with fig. 3, as shown in fig. 4, the step 202 can be specifically realized by the following steps 202a to 202 c.

Step 202a, the electronic device determines a first distance and a second distance according to the reference proportion and the width of the target object.

The reference scale is a continuous ratio of a distance from a center of a second object to a first boundary, a width of the second object, and a distance from the center of the second object to a second boundary in the reference video picture, the second object is an object located at a composition center of the reference video picture, and the first boundary and the second boundary are two opposite boundaries in the reference video picture.

In the embodiment of the present invention, the reference video picture, i.e., the standard video picture, is a standard for measuring the corresponding target video picture, and is used for mapping the meaning of the reference scale, and the reference video picture may be a real one or a virtual one (not). The reference proportion may be preset or may be acquired in real time, so that the reference video picture may be preset or may be acquired in real time, and may be specifically determined according to actual use requirements, which is not limited in the embodiment of the present invention.

In the embodiment of the present invention, the width of the target object is the farthest distance in the arrangement direction (hereinafter referred to as the first direction) of the N cameras. The center of the target object is the geometric center of the target object in the first direction, and the center of the second object is the geometric center of the second object in the first direction.

It can be understood that, in the embodiment of the present invention, the electronic device may calculate the first distance and the second distance according to the reference ratio and the width of the target object. Specifically, the target object corresponds to a second object in the reference video picture, the first distance corresponds to a distance from a center of the second object in the reference video picture to the first boundary, the second distance corresponds to a distance from the center of the second object in the reference video picture to the second boundary, and the first boundary and the second boundary are two opposite boundaries in the reference video picture along the first direction. In summary, the connection ratio of the first distance, the width of the target object, and the second distance is equal to the reference ratio.

Step 202b, the electronic device determines a third boundary and a fourth boundary of the target video picture in the second video picture according to the first distance, the second distance and the center of the target object.

It can be understood that, in the embodiment of the present invention, the third boundary corresponds to the first boundary, the fourth boundary corresponds to the second boundary, the first distance is a distance from a center of the target object in the target video picture to the third boundary, the second distance is a distance from the center of the target object in the target video picture to the fourth boundary, and the third boundary and the fourth boundary are two opposite boundaries in the first direction in the target video picture.

Step 202c, the electronic device cuts the second video picture according to the third boundary and the fourth boundary to obtain the target video picture.

It can be understood that the electronic device clips the second video frame according to the third boundary and the fourth boundary, and a target video frame satisfying the reference scale can be obtained.

In the embodiment of the invention, the electronic equipment can cut the second video picture according to the reference proportion and the width of the target object, so that the target video picture of the target object positioned in the composition center can be obtained.

Alternatively, the electronic device may adjust the reference ratio to some extent in a case where it is detected that the target video picture satisfying the reference ratio is obtained by failing to crop the second video picture.

Illustratively, the steps 202a to 202b may be specifically realized by the steps 202a1 to 202b 1.

Step 202a1, the electronic device determines a fourth distance according to the third distance and the reference ratio when detecting that the third distance from the center of the target object to the target boundary of the second video picture is smaller than the target distance and greater than or equal to the preset distance.

Step 202b1, the electronic device determines a third boundary and a fourth boundary of the target video picture in the second video picture according to the third distance, the fourth distance and the center of the target object.

Wherein, when the target boundary is a boundary corresponding to a third boundary, the target distance is a first distance; when the target boundary is a boundary corresponding to the fourth boundary, the target distance is the second distance.

In the embodiment of the present invention, the preset distance may be determined according to actual use requirements, and the embodiment of the present invention is not limited.

It should be noted that, when the target distance is the first distance, and when the target distance is the second distance, the corresponding preset distances may be the same, or may not be the same, and the embodiment of the present invention is not limited thereto.

It can be understood that, in the embodiment of the present invention, in a case where the electronic device detects that the third distance from the center of the target object to the target boundary in the second video picture is less than the target distance and greater than or equal to the preset distance (i.e., in a case where the target object moves close to the edge of the second video picture), it is described that a target video picture satisfying the reference scale cannot be obtained through the cropping processing on the second video picture. At this time, the electronic device may calculate a fourth distance, that is, a ratio of the third distance to the fourth distance is equal to a ratio of a distance from the center of the second object to the first boundary to a distance from the center of the second object to the second boundary in the reference video picture, according to the third distance and the reference ratio. Therefore, the electronic equipment determines the third distance and the fourth distance by adjusting the reference proportion, then determines the third boundary and the fourth boundary according to the third distance and the fourth distance, and finally cuts the second video picture according to the third boundary and the fourth boundary to obtain the target video screen picture.

It should be noted that, since the reference ratio is adjusted without limitation, the size of the video frame in the first direction is too small, and the display effect of the video frame is poor. In order to ensure the display effect of the video image, the electronic device may adjust the reference ratio when the electronic device detects that the third distance from the center of the target object in the second video image to the target boundary is smaller than the target distance and greater than or equal to the preset distance, otherwise, the electronic device may not adjust and prompt the user to move the electronic device.

In the embodiment of the invention, the target video picture meeting the requirement can be obtained by adjusting the reference proportion to a certain degree.

Optionally, the electronic device needs to determine the reference ratio before step 202 a. The reference proportion may be preset or may be obtained in real time, and the embodiment of the present invention is not limited.

Exemplarily, in conjunction with fig. 4, as shown in fig. 5, before step 202a, the video picture processing method provided by the embodiment of the present invention may further include step 204 described below.

Step 204, the electronic device determines the reference ratio according to the background information in the second video frame.

It can be understood that, in the embodiment of the present invention, the electronic device may determine the corresponding composition mode according to the background information (background content) in the second video frame, and then determine the composition center position of the reference video frame according to the composition mode, and determine the reference scale. In the embodiment of the present invention, a method for determining a corresponding composition mode according to background information in the second video frame is not limited, and any related technology may be specifically referred to, and details thereof are not repeated herein.

In the embodiment of the invention, the electronic equipment determines the reference proportion in real time according to the background information in the second video picture, so that the central position of the composition can be better determined, and the display effect of the video picture is better.

Optionally, the electronic device crops a target video frame having a target size and a center of the target object located at the composition center.

Exemplarily, in conjunction with fig. 3, as shown in fig. 6, the step 202 can be specifically realized by the following step 202 d.

Step 202d, the electronic device cuts the second video frame into video frames with the size of the target size by taking the center of the target object as a composition center, so as to obtain the target video frame.

In the embodiment of the present invention, the target size may be set according to actual use requirements, and the embodiment of the present invention is not limited.

In the embodiment of the present invention, the electronic device may determine that the center of the target object is located at the composition center, and then crop the video frame with the size (in the first direction) as the target size to obtain the target video frame.

In the embodiment of the invention, the electronic equipment takes the center of the target object as a composition center, cuts the second video picture into the video picture with the size of the target size, and can quickly obtain the target video picture meeting the user requirement.

Optionally, the position of the composition center and the target size in the target video frame may be preset or may be obtained in real time.

Exemplarily, in conjunction with fig. 6, as shown in fig. 7, before step 202d, the video picture processing method provided by the embodiment of the present invention may further include step 205 described below.

Step 205, the electronic device determines the position of the composition center and the target size in the target video frame according to the background information in the second video frame.

It can be understood that, in the embodiment of the present invention, the electronic device may determine the corresponding composition mode according to the background information (background content) in the second video frame, and then determine the position of the composition center of the reference video frame according to the composition mode, so as to determine the target size. In the embodiment of the present invention, a method for determining a corresponding composition mode according to background information in the second video frame is not limited, and any related technology may be specifically referred to, and details thereof are not repeated herein.

In the embodiment of the invention, the electronic equipment determines the position of the composition center and the target size in the target video picture in real time according to the background information in the second video picture, so that the position of the composition center can be better determined, and the display effect of the video picture is better.

Optionally, after step 202, the video picture processing method provided by the embodiment of the present invention may further include step 206 described below.

And step 206, the electronic equipment displays the prompt information when detecting that the second video picture is cut and the target video picture cannot be obtained.

The prompt message is used for prompting the user to move the electronic equipment.

It can be understood that, when it is detected that the second video picture is cropped, and a target video picture satisfying the reference scale or having the target object center as the composition center and the target size cannot be obtained, the electronic device may prompt the user to move the electronic device through the prompt information.

In the embodiment of the present invention, the specific content of the prompt information is not limited.

In the embodiment of the invention, the user is prompted to move the electronic equipment through the prompt message, which is favorable for shooting to obtain the target video picture.

Optionally, the electronic device is a telescopic screen electronic device including a main screen and at least two sub-screens (telescopic screens) located at two sides of the main screen; after step 202, the video picture processing method provided by the embodiment of the present invention may further include step 207 described below.

And step 207, the electronic equipment displays the target video picture through the main screen and at least one screen of the at least two auxiliary screens.

In this embodiment of the present invention, the at least one screen may be a preset screen or a screen designated by a user through input, which is not limited in this embodiment of the present invention.

In the embodiment of the invention, the electronic equipment can display the target video picture on at least one screen after zooming the target video picture according to the sizes of the main screen and the at least two auxiliary screens.

In the embodiment of the invention, the electronic equipment can display the target video picture on at least one of the main screen and the at least two auxiliary screens according to the requirements of users.

The drawings in the embodiments of the present invention are all exemplified by the drawings in the independent embodiments, and when the embodiments of the present invention are specifically implemented, each of the drawings can also be implemented by combining any other drawings which can be combined, and the embodiments of the present invention are not limited. For example, referring to fig. 2, the step 202 may be specifically implemented by the steps 202a to 202 c.

As shown in fig. 8, an embodiment of the present invention provides an electronic device 120, where the electronic device 120 includes N cameras, and directions of pictures collected by the N cameras are the same, and the electronic device 120 includes: a stitching module 121 and a cropping module 122; the splicing module 121 is configured to splice N first video pictures obtained by shooting through the N cameras at the same time, respectively, to obtain a second video picture; the cropping module 122 is configured to crop the second video frame obtained by the splicing module 121 to obtain a target video frame, where a target object in the target video frame is located in a composition center of the target video frame; wherein N is an integer greater than 1.

Optionally, the electronic device 120 further includes: a determination module 123; the determining module 123 is configured to determine, before the cropping module 122 crops the second video frame to obtain the target video frame, the first object in the second video frame as the target object when a target condition is satisfied; wherein the target condition comprises at least one of: receiving a first input of a first object by a user; detecting that the first object is a preset object; detecting that the first object is the only portrait in the second video picture; it is detected that the first object is located in the center of at least two portrait images comprised by the second video picture.

Optionally, the cropping module 122 is specifically configured to determine a first distance and a second distance according to a reference ratio and a width of the target object, where the reference ratio is a continuous ratio of a distance from a center of a second object to a first boundary, a width of the second object, and a distance from the center of the second object to a second boundary in the reference video picture, the second object is an object located at a composition center of the reference video picture, and the first boundary and the second boundary are two opposite boundaries in the reference video picture; determining a third boundary and a fourth boundary of the target video picture in a second video picture according to the first distance, the second distance and the center of the target object; and cutting the second video picture according to the third boundary and the fourth boundary to obtain the target video picture.

Optionally, the electronic device 120 further includes: a determination module 123; the determining module 123 is configured to determine the reference ratio according to the background information in the second video frame before determining the first distance and the second distance according to the reference ratio and the width of the target object.

Optionally, the cropping module 122 is specifically configured to, when it is detected that a third distance from the center of the target object to the target boundary of the second video frame is smaller than the target distance and greater than or equal to a preset distance, determine a fourth distance according to the third distance and the reference ratio; determining a third boundary and a fourth boundary of the target video picture in a second video picture according to the third distance, the fourth distance and the center of the target object; wherein, when the target boundary is a boundary corresponding to a third boundary, the target distance is a first distance; when the target boundary is a boundary corresponding to the fourth boundary, the target distance is the second distance.

Optionally, the cropping module 122 is specifically configured to crop the second video frame obtained by the splicing module 121 into a video frame with a target size by taking the center of the target object as a composition center, so as to obtain the target video frame.

Optionally, the electronic device 120 further includes: a determination module 123; the determining module 123 is configured to determine, according to the background information in the second video frame, a position where a composition center in the target video frame is located and the target size before the cropping module 122 crops the second video frame to obtain the target video frame.

Optionally, the electronic device 120 further includes: a display module 124; the display module 124 is configured to display a prompt message for prompting the user to move the electronic device when it is detected that the target video frame cannot be obtained by performing cropping processing on the second video frame.

It should be noted that, as shown in fig. 8, the modules that are necessarily included in the electronic device 120 are indicated by solid line boxes, such as the splicing module 121 and the cropping module 122; modules that may or may not be included in the electronic device 120 are illustrated with dashed boxes, such as a determination module 123 and a display module 124.

The electronic device provided in the embodiment of the present invention is capable of implementing each process shown in any one of fig. 2 to 7 in the above method embodiments, and details are not described here again to avoid repetition.

The embodiment of the invention provides electronic equipment, which can splice N first video pictures which are respectively obtained by shooting through N cameras at the same time to obtain a second video picture; cutting the second video picture to obtain a target video picture, wherein a target object in the target video picture is positioned in the composition center of the target video picture; wherein N is an integer greater than 1. By the scheme, the electronic equipment can obtain the target video picture of the target object positioned in the composition center of the video picture by splicing and cutting the N first video pictures shot by the N cameras at the same time, so that the target object can be shot and obtained to a certain extent and the video with better video picture quality is always positioned in the composition center of the video picture without moving the position of the electronic equipment.

Fig. 9 is a schematic diagram of a hardware structure of an electronic device implementing various embodiments of the present application. As shown in fig. 9, the electronic device 100 includes but is not limited to: radio frequency unit 101, network module 102, audio output unit 103, input unit 104, sensor 105, display unit 106, user input unit 107, interface unit 108, memory 109, processor 110, and power supply 111. Those skilled in the art will appreciate that the electronic device configuration shown in fig. 9 does not constitute a limitation of the electronic device, and that the electronic device may include more or fewer components than shown, or some components may be combined, or a different arrangement of components. In the embodiment of the present invention, the electronic device includes, but is not limited to, a mobile phone, a tablet computer, a notebook computer, a palm computer, a vehicle-mounted electronic device, a wearable device, a pedometer, and the like.

The processor 110 is configured to splice N first video pictures obtained by shooting through the N cameras at the same time, respectively, to obtain a second video picture; cutting the second video picture to obtain a target video picture, wherein a target object in the target video picture is positioned in the composition center of the target video picture; wherein N is an integer greater than 1.

According to the electronic equipment provided by the embodiment of the invention, the electronic equipment can splice N first video pictures which are obtained by shooting through the N cameras respectively at the same time to obtain a second video picture; cutting the second video picture to obtain a target video picture, wherein a target object in the target video picture is positioned in the composition center of the target video picture; wherein N is an integer greater than 1. By the scheme, the electronic equipment can obtain the target video picture of the target object positioned in the composition center of the video picture by splicing and cutting the N first video pictures shot by the N cameras at the same time, so that the target object can be shot and obtained to a certain extent and the video with better video picture quality is always positioned in the composition center of the video picture without moving the position of the electronic equipment.

It should be understood that, in the embodiment of the present invention, the radio frequency unit 101 may be used for receiving and sending signals during a message transmission or call process, and specifically, after receiving downlink data from a base station, the downlink data is processed by the processor 110; in addition, the uplink data is transmitted to the base station. Typically, radio frequency unit 101 includes, but is not limited to, an antenna, at least one amplifier, a transceiver, a coupler, a low noise amplifier, a duplexer, and the like. In addition, the radio frequency unit 101 can also communicate with a network and other devices through a wireless communication system.

The electronic device provides wireless broadband internet access to the user via the network module 102, such as assisting the user in sending and receiving e-mails, browsing web pages, and accessing streaming media.

The audio output unit 103 may convert audio data received by the radio frequency unit 101 or the network module 102 or stored in the memory 109 into an audio signal and output as sound. Also, the audio output unit 103 may also provide audio output related to a specific function performed by the electronic apparatus 100 (e.g., a call signal reception sound, a message reception sound, etc.). The audio output unit 103 includes a speaker, a buzzer, a receiver, and the like.

The input unit 104 is used to receive an audio or video signal. The input Unit 104 may include a Graphics Processing Unit (GPU) 1041 and a microphone 1042, and the Graphics processor 1041 processes image data of a still picture or video obtained by an image capturing device (e.g., a camera) in a video capturing mode or an image capturing mode. The processed image frames may be displayed on the display unit 106. The image frames processed by the graphic processor 1041 may be stored in the memory 109 (or other storage medium) or transmitted via the radio frequency unit 101 or the network module 102. The microphone 1042 may receive sound and may be capable of processing such sound into audio data. The processed audio data may be converted into a format output transmittable to a mobile communication base station via the radio frequency unit 101 in case of a phone call mode.

The electronic device 100 also includes at least one sensor 105, such as a light sensor, motion sensor, and other sensors. Specifically, the light sensor includes an ambient light sensor that can adjust the brightness of the display panel 1061 according to the brightness of ambient light, and a proximity sensor that can turn off the display panel 1061 and/or the backlight when the electronic device 100 is moved to the ear. As one type of motion sensor, an accelerometer sensor can detect the magnitude of acceleration in each direction (generally three axes), detect the magnitude and direction of gravity when stationary, and can be used to identify the posture of an electronic device (such as horizontal and vertical screen switching, related games, magnetometer posture calibration), and vibration identification related functions (such as pedometer, tapping); the sensors 105 may also include fingerprint sensors, pressure sensors, iris sensors, molecular sensors, gyroscopes, barometers, hygrometers, thermometers, infrared sensors, etc., which are not described in detail herein.

The display unit 106 is used to display information input by a user or information provided to the user. The Display unit 106 may include a Display panel 1061, and the Display panel 1061 may be configured in the form of a Liquid Crystal Display (LCD), an Organic Light-Emitting Diode (OLED), or the like.

The user input unit 107 may be used to receive input numeric or character information and generate key signal inputs related to user settings and function control of the electronic device. Specifically, the user input unit 107 includes a touch panel 1071 and other input devices 1072. Touch panel 1071, also referred to as a touch screen, may collect touch operations by a user on or near the touch panel 1071 (e.g., operations by a user on or near touch panel 1071 using a finger, stylus, or any suitable object or attachment). The touch panel 1071 may include two parts of a touch detection device and a touch controller. The touch detection device detects the touch direction of a user, detects a signal brought by touch operation and transmits the signal to the touch controller; the touch controller receives touch information from the touch sensing device, converts the touch information into touch point coordinates, sends the touch point coordinates to the processor 110, and receives and executes commands sent by the processor 110. In addition, the touch panel 1071 may be implemented in various types, such as a resistive type, a capacitive type, an infrared ray, and a surface acoustic wave. In addition to the touch panel 1071, the user input unit 107 may include other input devices 1072. Specifically, other input devices 1072 may include, but are not limited to, a physical keyboard, function keys (e.g., volume control keys, switch keys, etc.), a trackball, a mouse, and a joystick, which are not described in detail herein.

Further, the touch panel 1071 may be overlaid on the display panel 1061, and when the touch panel 1071 detects a touch operation thereon or nearby, the touch panel 1071 transmits the touch operation to the processor 110 to determine the type of the touch event, and then the processor 110 provides a corresponding visual output on the display panel 1061 according to the type of the touch event. Although in fig. 9, the touch panel 1071 and the display panel 1061 are two independent components to implement the input and output functions of the electronic device, in some embodiments, the touch panel 1071 and the display panel 1061 may be integrated to implement the input and output functions of the electronic device, and is not limited herein.

The interface unit 108 is an interface for connecting an external device to the electronic apparatus 100. For example, the external device may include a wired or wireless headset port, an external power supply (or battery charger) port, a wired or wireless data port, a memory card port, a port for connecting a device having an identification module, an audio input/output (I/O) port, a video I/O port, an earphone port, and the like. The interface unit 108 may be used to receive input (e.g., data information, power, etc.) from an external device and transmit the received input to one or more elements within the electronic apparatus 100 or may be used to transmit data between the electronic apparatus 100 and the external device.

The memory 109 may be used to store software programs as well as various data. The memory 109 may mainly include a storage program area and a storage data area, wherein the storage program area may store an operating system, an application program required by at least one function (such as a sound playing function, an image playing function, etc.), and the like; the storage data area may store data (such as audio data, a phonebook, etc.) created according to the use of the cellular phone, and the like. Further, the memory 109 may include high speed random access memory, and may also include non-volatile memory, such as at least one magnetic disk storage device, flash memory device, or other volatile solid state storage device.

The processor 110 is a control center of the electronic device, connects various parts of the entire electronic device using various interfaces and lines, performs various functions of the electronic device and processes data by operating or executing software programs and/or modules stored in the memory 109 and calling data stored in the memory 109, thereby performing overall monitoring of the electronic device. Processor 110 may include one or more processing units; alternatively, the processor 110 may integrate an application processor, which primarily handles operating systems, user interfaces, applications, etc., and a modem processor, which primarily handles wireless communications. It will be appreciated that the modem processor described above may not be integrated into the processor 110.

The electronic device 100 may further include a power supply 111 (e.g., a battery) for supplying power to various components, and optionally, the power supply 111 may be logically connected to the processor 110 through a power management system, so as to implement functions of managing charging, discharging, and power consumption through the power management system.

In addition, the electronic device 100 includes some functional modules that are not shown, and are not described in detail herein.

Optionally, an embodiment of the present invention further provides an electronic device, which may include the processor 110 shown in fig. 9, the memory 109, and a computer program stored in the memory 109 and capable of being executed on the processor 110, where the computer program, when executed by the processor 110, implements each process of the video picture processing method shown in any one of fig. 2 to fig. 7 in the foregoing method embodiments, and can achieve the same technical effect, and details are not repeated here to avoid repetition.

An embodiment of the present invention further provides a computer-readable storage medium, where a computer program is stored on the computer-readable storage medium, and when the computer program is executed by a processor, the computer program implements each process of the video picture processing method shown in any one of fig. 2 to 7 in the foregoing method embodiments, and can achieve the same technical effect, and in order to avoid repetition, details are not repeated here. The computer-readable storage medium may be a Read-Only Memory (ROM), a Random Access Memory (RAM), a magnetic disk or an optical disk.

It should be noted that, in this document, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising an … …" does not exclude the presence of other like elements in a process, method, article, or apparatus that comprises the element.

Through the above description of the embodiments, those skilled in the art will clearly understand that the method of the above embodiments can be implemented by software plus a necessary general hardware platform, and certainly can also be implemented by hardware, but in many cases, the former is a better implementation manner. Based on such understanding, the technical solutions of the present application may be embodied in the form of a software product, which is stored in a storage medium (such as ROM/RAM, magnetic disk, optical disk) and includes instructions for enabling an electronic device (such as a mobile phone, a computer, a server, an air conditioner, or a network device) to execute the method according to the embodiments of the present application.

While the present embodiments have been described with reference to the accompanying drawings, it is to be understood that the invention is not limited to the precise embodiments described above, which are meant to be illustrative and not restrictive, and that various changes may be made therein by those skilled in the art without departing from the spirit and scope of the invention as defined by the appended claims.

Claims

1. A video picture processing method is applied to an electronic device comprising N cameras, and the directions of pictures collected by the N cameras are the same, and the method comprises the following steps:

shooting through the N cameras at the same time; splicing N first video pictures which are obtained by shooting through the N cameras at the same moment respectively to obtain a second video picture;

cutting the second video picture to obtain a target video picture, wherein a target object in the target video picture is positioned in the composition center of the target video picture; the composition center is determined based on a video picture scene in the second video picture; the target object is determined based on a first object in a second video picture;

at the same moment, shoot through N cameras, include:

in the shooting process, along with the movement of a target object in a video picture, adjusting the number of the N cameras so as to enable the target object to be positioned in the composition center of the target video picture;

wherein N is an integer greater than 1;

the cutting the second video picture to obtain a target video picture comprises:

under the condition that it is detected that a third distance from the center of the target object to a target boundary of the second video picture is smaller than a target distance and larger than or equal to a preset distance, determining a fourth distance according to the third distance and a reference proportion;

determining a third boundary and a fourth boundary of the target video picture in the second video picture according to the third distance, the fourth distance and the center of the target object;

the target distance is a first distance when the target boundary is a boundary corresponding to the third boundary; the target distance is a second distance when the target boundary is a boundary corresponding to the fourth boundary;

and clipping the second video picture according to the third boundary and the fourth boundary to obtain the target video picture.

2. The method of claim 1, wherein before cropping the second video picture to obtain the target video picture, the method further comprises:

determining a first object in the second video picture as the target object if a target condition is satisfied;

wherein the target condition comprises at least one of: receiving a first input of a user to the first object; detecting that the first object is a preset object; detecting that the first object is the only portrait in the second video picture; detecting that the first object is located in the center of at least two human figures included in the second video picture.

3. The method of claim 1, wherein said cropping said second video picture to obtain a target video picture comprises:

determining the first distance and the second distance according to the reference proportion and the width of the target object, wherein the reference proportion is a continuous ratio of the distance from the center of a second object to a first boundary, the width of the second object and the distance from the center of the second object to a second boundary in a reference video picture, the second object is an object located at the composition center of the reference video picture, and the first boundary and the second boundary are two opposite boundaries in the reference video picture;

determining a third boundary and a fourth boundary of the target video picture in the second video picture according to the first distance, the second distance and the center of the target object;

4. The method of claim 3, wherein prior to determining the first distance and the second distance based on the baseline proportion and the width of the target object, the method further comprises:

and determining the reference proportion according to the background information in the second video picture.

5. The method of claim 1, wherein said cropping said second video picture to obtain a target video picture comprises:

and cutting the second video picture into a video picture with the size of a target size by taking the center of the target object as a composition center to obtain the target video picture.

6. The method of claim 5, wherein before cropping the second video picture to obtain the target video picture, the method further comprises:

and determining the position of the composition center in the target video picture and the target size according to the background information in the second video picture.

7. The method of claim 1, further comprising:

and displaying prompt information under the condition that the second video picture is detected to be cut and a target video picture cannot be obtained, wherein the prompt information is used for prompting a user to move the electronic equipment.

8. The electronic equipment is characterized by comprising N cameras, wherein the N cameras acquire pictures in the same direction, and the electronic equipment comprises: the system comprises a splicing module, a cutting module and a determining module;

the splicing module is used for splicing N first video pictures which are obtained by shooting through the N cameras at the same time to obtain a second video picture;

the cutting module is used for cutting the second video picture obtained by the splicing module to obtain a target video picture, and a target object in the target video picture is positioned in the composition center of the target video picture; the composition center is determined based on a video picture scene in the second video picture; the target object is determined based on a first object in a second video picture;

the determining module is used for adjusting the number of the N cameras along with the movement of a target object in a video picture in the shooting process so as to enable the target object to be positioned in the composition center of the target video picture;

wherein N is an integer greater than 1;

the cropping module is specifically configured to determine a fourth distance according to a third distance and a reference ratio when it is detected that the third distance from the center of the target object to the target boundary of the second video picture is smaller than the target distance and greater than or equal to a preset distance; determining a third boundary and a fourth boundary of the target video picture in the second video picture according to the third distance, the fourth distance and the center of the target object;

the target distance is a first distance when the target boundary is a boundary corresponding to the third boundary; and when the target boundary is a boundary corresponding to the fourth boundary, the target distance is a second distance.

9. The electronic device of claim 8, wherein the determining module is further configured to determine a first object in the second video picture as the target object if a target condition is met before the cropping module crops the second video picture to obtain a target video picture;

10. The electronic device of claim 8, wherein the cropping module is specifically configured to determine the first distance and the second distance according to the reference scale and the width of the target object, the reference scale is a continuous ratio of a distance from a center of a second object to a first boundary, a width of the second object, and a distance from the center of the second object to a second boundary in a reference video picture, the second object is an object located at a composition center of the reference video picture, and the first boundary and the second boundary are two opposite boundaries in the reference video picture; determining a third boundary and a fourth boundary of the target video picture in the second video picture according to the first distance, the second distance and the center of the target object; and clipping the second video picture according to the third boundary and the fourth boundary to obtain the target video picture.

11. The electronic device of claim 10, further comprising: a determination module;

the determining module is configured to determine the reference ratio according to background information in the second video picture before determining the first distance and the second distance according to the reference ratio and the width of the target object.

12. The electronic device according to claim 8, wherein the cropping module is specifically configured to crop the second video frame obtained by the splicing module into a video frame with a target size by taking a center of the target object as a composition center, so as to obtain the target video frame.

13. The electronic device of claim 12, further comprising: a determination module;

and the determining module is used for determining the position of the composition center in the target video picture and the target size according to the background information in the second video picture before the cropping module crops the second video picture to obtain the target video picture.

14. The electronic device of claim 8, further comprising: a display module;

the display module is used for displaying prompt information under the condition that the second video picture is detected to be cut and a target video picture cannot be obtained, and the prompt information is used for prompting a user to move the electronic equipment.

15. An electronic device, comprising a processor, a memory and a computer program stored on the memory and executable on the processor, the computer program, when executed by the processor, implementing the steps of the video picture processing method according to any one of claims 1 to 7.

16. A computer-readable storage medium, on which a computer program is stored which, when being executed by a processor, carries out the steps of the video picture processing method according to any one of claims 1 to 7.