CN113766130A - Video shooting method, electronic equipment and device - Google Patents

Video shooting method, electronic equipment and device Download PDF

Info

Publication number
CN113766130A
CN113766130A CN202111070467.XA CN202111070467A CN113766130A CN 113766130 A CN113766130 A CN 113766130A CN 202111070467 A CN202111070467 A CN 202111070467A CN 113766130 A CN113766130 A CN 113766130A
Authority
CN
China
Prior art keywords
shooting
video
target
subject
image
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN202111070467.XA
Other languages
Chinese (zh)
Other versions
CN113766130B (en
Inventor
张波
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Vivo Mobile Communication Co Ltd
Original Assignee
Vivo Mobile Communication Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Vivo Mobile Communication Co Ltd filed Critical Vivo Mobile Communication Co Ltd
Priority to CN202111070467.XA priority Critical patent/CN113766130B/en
Publication of CN113766130A publication Critical patent/CN113766130A/en
Application granted granted Critical
Publication of CN113766130B publication Critical patent/CN113766130B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/80Camera processing pipelines; Components thereof

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Studio Devices (AREA)
  • Color Television Image Signal Generators (AREA)

Abstract

The application discloses a video shooting method, electronic equipment and a video shooting device, and belongs to the technical field of video shooting. The method comprises the following steps: converting the photographed image into a gray image; determining a video shooting object meeting a preset condition as a target shooting subject, and recovering the color of the target shooting subject in the gray-scale image; shooting a target video based on the target shooting subject; wherein the preset condition comprises at least one of the following: the motion displacement of the video shooting object exceeds a preset displacement threshold; the area where the video shooting object is located is an audio sounding area.

Description

Video shooting method, electronic equipment and device
Technical Field
The application belongs to the technical field of video shooting, and particularly relates to a video shooting method, electronic equipment and a device.
Background
With the development of computer technology, various terminal devices can provide video shooting functions so that users can shoot favorite videos. In the existing video shooting mode, a certain filter or special effect can be adopted to realize the special effect of the video, so that the user can carry out personalized video shooting. However, the video shooting effect by using the filter or the special effect is usually single, so that the video shooting effect is poor, and the shooting requirement of a user cannot be met.
Disclosure of Invention
The embodiment of the application aims to provide a video shooting method, electronic equipment and a video shooting device, and the problem that the shooting effect of the existing video shooting mode is poor can be solved.
In a first aspect, an embodiment of the present application provides a video shooting method, where the method includes:
converting the photographed image into a gray image;
determining a video shooting object meeting a preset condition as a target shooting subject, and recovering the color of the target shooting subject in the gray-scale image;
shooting a target video based on the target shooting subject;
wherein the preset condition comprises at least one of the following:
the motion displacement of the video shooting object exceeds a preset displacement threshold;
the area where the video shooting object is located is an audio sounding area.
In a second aspect, an embodiment of the present application provides a video shooting apparatus, including:
the conversion module is used for converting the shot image into a gray image;
the restoring module is used for determining a video shooting object meeting preset conditions as a target shooting subject and restoring the color of the target shooting subject in the gray level image;
the shooting module is used for shooting a target video based on the target shooting main body;
wherein the preset condition comprises at least one of the following:
the motion displacement of the video shooting object exceeds a preset displacement threshold;
the area where the video shooting object is located is an audio sounding area.
In a third aspect, an embodiment of the present application provides an electronic device, which includes a processor, a memory, and a program or instructions stored on the memory and executable on the processor, and when executed by the processor, the program or instructions implement the steps of the method according to the first aspect.
In a fourth aspect, embodiments of the present application provide a readable storage medium, on which a program or instructions are stored, which when executed by a processor implement the steps of the method according to the first aspect.
In a fifth aspect, an embodiment of the present application provides a chip, where the chip includes a processor and a communication interface, where the communication interface is coupled to the processor, and the processor is configured to execute a program or instructions to implement the method according to the first aspect.
In the embodiment of the application, the video shooting object meeting the preset conditions is determined as the target shooting subject, the target shooting subject can be determined in real time in the video shooting process, and the target shooting subject is subjected to targeted processing to complete the shooting of the target video, so that the flexibility and diversity of video shooting are improved; still through converting the image of shooing into grey level image to the colour of the target shooting main part in the recovery grey level image, and then can highlight the target shooting main part, improved the shooting effect of video shooting, also improved the abundant degree of video creation simultaneously, further promoted user experience.
Drawings
Fig. 1 is a schematic flowchart of a video shooting method provided in an embodiment of the present application;
FIG. 2 is a schematic flowchart of a video shooting method according to an embodiment of the present disclosure;
FIG. 3 is a schematic illustration of a cartoon-style interface to which a video capture method according to an embodiment of the present application is applied;
fig. 4 is a second schematic flowchart of a video shooting method according to an embodiment of the present application;
FIG. 5 is a block diagram of a video camera provided in an embodiment of the present application;
FIG. 6 is a schematic structural diagram of an electronic device according to an embodiment of the present application;
fig. 7 is a hardware structure diagram of an electronic device implementing an embodiment of the present application.
Detailed Description
The technical solutions in the embodiments of the present application will be described clearly below with reference to the drawings in the embodiments of the present application, and it is obvious that the described embodiments are some, but not all, embodiments of the present application. All other embodiments that can be derived by one of ordinary skill in the art from the embodiments given herein are intended to be within the scope of the present disclosure.
The terms first, second and the like in the description and in the claims of the present application are used for distinguishing between similar elements and not necessarily for describing a particular sequential or chronological order. It will be appreciated that the data so used may be interchanged under appropriate circumstances such that embodiments of the application may be practiced in sequences other than those illustrated or described herein, and that the terms "first," "second," and the like are generally used herein in a generic sense and do not limit the number of terms, e.g., the first term can be one or more than one. In addition, "and/or" in the specification and claims means at least one of connected objects, a character "/" generally means that a preceding and succeeding related objects are in an "or" relationship.
The video shooting method, the electronic device and the apparatus provided by the embodiments of the present application are described in detail below with reference to the accompanying drawings through specific embodiments and application scenarios thereof.
Fig. 1 is a schematic flowchart of a video shooting method according to an embodiment of the present application. Referring to fig. 1, an embodiment of the present application provides a video shooting method, which may include:
step 110, converting the shot image into a gray image;
step 120, determining a video shooting object meeting preset conditions as a target shooting subject, and recovering the color of the target shooting subject in the gray level image;
step 130, shooting a target video based on the target shooting subject;
wherein the preset condition comprises at least one of the following:
the motion displacement of the video shooting object exceeds a preset displacement threshold;
the area where the video shooting object is located is an audio sounding area.
It should be noted that an execution main body of the image processing method provided in the embodiment of the present application may be an intelligent electronic device or other devices with a shooting (or recording) function, such as a mobile phone, a tablet Computer, a notebook Computer, a palm Computer, a vehicle-mounted electronic device, a wearable device, a Personal Computer (PC), a smart television, and the like.
The following describes in detail a technical solution of the present application by taking a mobile phone as an execution subject to implement the video shooting method provided in the embodiments of the present application.
Optionally, in step 110, the user may enter a shooting preview interface through a camera function of the mobile phone or an application having a shooting function, and the user may perform a shooting start operation in the shooting preview interface to trigger the mobile phone to start video shooting. In the video shooting process, the mobile phone performs graying processing on the color preview image of the shooting preview interface, namely color elements of the color preview image are removed, only the grayscale data is reserved, a grayscale image is generated, and the grayscale image is displayed on the shooting preview interface.
The image graying processing mainly refers to a process of converting a color image into a grayscale image. The color image has a plurality of color coding methods, and common methods are RGB, CMY, CMYK, HSV, HIS and the like. The color preview image includes, but is not limited to, an RGB image. Taking an RGB image as an example, the color of each pixel in the image is determined by R, G, B three components, and each component preferably has 255 values. A grayscale image is an image with only one sample color per pixel, i.e., a special color image with R, G, B components being identical. The RGB image may be converted into a gray image by a floating point algorithm, an integer method, a shift method, an average value method, or the like. The gray scale processing method is not particularly limited in the present application.
Alternatively, in step 120, the video object may include sky, buildings, people, animals, plants, mountains and waters, or a combination of these objects. In the case where the video photographic subject satisfies the preset condition, the video photographic subject may be recognized as a target photographic subject. At this time, the frame can be used to select the target shooting subject frame in the shooting picture, so as to prompt the user that the object framed by the frame is the target shooting subject.
Alternatively, the preset condition may include both motion detection and audio detection. Whether the target shooting subject meets the preset condition or not can be judged through automatic detection, manual detection or a combination mode of the automatic detection and the manual detection. Taking automatic detection as an example, when the mobile phone detects that the motion displacement of the video shooting object exceeds a preset displacement threshold or the video shooting object is in an audio sounding area, the video shooting object is automatically identified as a target shooting subject. Taking manual detection as an example, the user can select any video shooting object on the shooting preview interface as the target shooting subject according to the requirement. By combining the two modes as an example, a certain video shooting object can be selected manually as a target shooting object, verification is performed through automatic detection, and finally the video shooting object meeting the preset conditions is determined as the target shooting object. The preset displacement threshold is a preset parameter, and the application is not limited specifically.
Optionally, after the target shooting subject is determined, the target shooting subject in the gray-scale image may be subjected to color restoration, or may be subjected to some specific color filter effects for beautification, which is not specifically limited in the present application; it is also possible to separate the subject of the color restoration from the entire gray-scale image, leaving only the subject of the object.
For example: a user shoots a video of a child running through a mobile phone, and firstly, a shot image of a whole video preview picture is converted into a gray image. And detecting the motion state of the child, identifying that the child runs and the motion displacement exceeds a preset displacement threshold value, and determining the child as a target shooting subject. And then carrying out color recovery on the pixel points of the gray level image area of the children.
Alternatively, in step 130, the current video preview screen may include the target photographic subject with the restored color and other video photographic subjects with no restored color, or may include only the target photographic subject with the restored color. The mobile phone can continue shooting or pause shooting until video recording is stopped. And the mobile phone sends the recorded video data to an encoder for encoding and generates a target video.
According to the video shooting method provided by the embodiment of the application, the video shooting object meeting the preset conditions is determined as the target shooting subject, the target shooting subject can be determined in real time in the video shooting process, and the target shooting subject is subjected to targeted processing to complete the shooting of the target video, so that the flexibility and diversity of video shooting are improved; still convert the image of shooing into grey level image to the colour of the target shooting main part in the recovery grey level image, and then can highlight the target shooting main part, can also improve the shooting effect that the video was shot, also improved the abundant degree of video creation simultaneously, further promoted user experience.
In one embodiment, in a case where the preset condition includes that the motion displacement of the video photographic subject exceeds a preset displacement threshold, the determining, as the target photographic subject, the video photographic subject that satisfies the preset condition includes:
carrying out motion detection on the video shooting object;
and determining the video shooting object with the motion displacement exceeding the preset displacement threshold value as a target shooting subject.
Optionally, the mobile phone starts motion detection in the video shooting process to detect a moving object. The detection of the moving object may be determined by detecting a motion displacement of the video photographic objects, which refers to a relative motion displacement between the video photographic objects. For example, a user shoots a video of a child running in front of a house through a mobile phone, the house is taken as a reference object, and a preset displacement threshold value is set to be 3 meters. When the movement displacement of the child relative to the house is 5 meters (exceeding a preset displacement threshold), the child is identified as the target shooting subject at the moment.
Optionally, under the condition that all the video shooting objects are in a motion state, a coordinate system can be established on the video preview interface by taking pixel points as units, motion displacement is obtained through coordinate displacement of each video shooting object and a video shooting proportion, and then the video shooting object with the motion displacement exceeding a preset displacement threshold can be determined as a target shooting object. For example, a user shoots a video played by a child and a puppy through a mobile phone, and the preset displacement threshold is set to be 3 meters. The actual movement displacement corresponding to the coordinate displacement of the child can be determined to be 1 meter (not exceeding a preset displacement threshold) through a coordinate system on a shooting preview interface, the actual movement displacement corresponding to the coordinate displacement of the puppy is 5 meters (exceeding the preset displacement threshold), and the puppy is identified as a target shooting subject at the moment.
According to the video shooting method provided by the embodiment of the application, the moving object can be identified through motion detection, the target shooting subject can be automatically identified and determined, and the identification accuracy of the target shooting subject can be improved; different target shooting subjects can be identified in different scenes, and the video shooting requirements of users are better met.
In one embodiment, in a case where the preset condition includes that the area where the video photographic subject is located is an audio sound emission area, the determining, as the target photographic subject, the video photographic subject that meets the preset condition includes:
determining orientation information of the audio signal;
determining the audio sounding area according to the azimuth information;
and determining the video shooting object in the audio sounding area as the target shooting subject.
Optionally, the mobile phone starts audio orientation detection during video shooting to detect orientation information generated by the audio signal. After the azimuth information is detected, the audio sounding area is determined. The sound production object, such as a human or an animal, of the audio sound production area is analyzed through an object recognition algorithm. The sound-producing object is determined as a target photographic subject. For example: the user shoots videos in which children sing songs are played through the mobile phone, and the audio direction detection can determine the direction information of a certain video shooting object and track an audio sounding area. And analyzing the sounding object in the audio sounding area through an object recognition algorithm, so that the child can be determined as the sounding video shooting object, and then the child is determined as the target shooting subject.
Alternatively, when a plurality of audio sound emission areas are detected simultaneously, a plurality of target photographic subjects may be determined, and the target photographic subjects may also be determined by the intensity of the audio signal. For example: the user shoots a video of singing a person under the waterfall through the mobile phone. Two audio sounding areas can be determined through audio detection, and waterfalls and man-made target shooting subjects can be determined through tracking azimuth information; the man-made target shooting subject can also be determined by judging that the strength of the audio signal of the man is greater than that of the waterfall.
According to the video shooting method provided by the embodiment of the application, the sound-starting object and the azimuth information thereof can be identified through audio detection, the target shooting main body can be automatically identified and determined, the identification accuracy of the target shooting main body can be improved, and meanwhile, the flexibility of video shooting is improved.
In one embodiment, the restoring the color of the target photographic subject in the grayscale image includes any one of:
restoring the color of the target photographic subject in the gray-scale image based on the outline of the target photographic subject; alternatively, the first and second electrodes may be,
firstly, restoring the color of the target photographic subject in the gray-scale image based on the outline of the target photographic subject, and then restoring the color of the rest part of the gray-scale image; alternatively, the first and second electrodes may be,
restoring the color of the whole gray image based on the outline of the video shooting object;
wherein the contour of the video photographic subject is determined based on the grayscale image.
Alternatively, the contour recognition of the gray-scale object is performed by an image contour recognition algorithm, the contour feature of each video shot object can be determined, the contour of each video shot object can be represented by a line, and the gray-scale image with the contour line is displayed on the video preview interface. The image contour recognition algorithm is not particularly limited in the present application.
Optionally, based on the contour of the target shooting subject, only the color of the target shooting subject in the grayscale image may be restored, or some specific color filter effects may be beautified, which is not specifically limited in this application.
For example: when a moving object or a sound-producing object exists in the gray-scale image, only the color of the moving object or the sound-producing object in the gray-scale image can be restored. When the moving object or the sound-producing object does not exist in the gray-scale image, whether the color of the moving object or the sound-producing object is restored or not can be selected according to requirements.
Optionally, based on the outline of the target shooting subject, color restoration may be performed on the entire gray scale image, and some specific color filter effects may also be performed for beautification, which is not specifically limited in this application. Among them, the manner of restoring the color of the entire gray image may be as follows.
The first method is as follows: based on the contour of the target photographic subject, the color of the target photographic subject in the gray-scale image can be restored first, and then the color of the rest of the gray-scale image can be restored.
The second method comprises the following steps: and directly recovering the color of the whole gray image based on the outline of the video shooting object.
For example: when a moving object or a sound-producing object exists in the gray-scale image, the color of the moving object or the sound-producing object can be restored in a first selection mode, then the color of the whole gray-scale image is gradually restored by spreading the moving object or the sound-producing object to the periphery, and the color of the whole gray-scale image can also be directly restored in a second selection mode.
Alternatively, when no moving object or sound object exists in the gray-scale image, whether to restore the color of the entire gray-scale image may be selected according to the requirement.
The video shooting method provided by the embodiment of the application improves the flexibility and diversity of video shooting by adopting different color recovery modes, simultaneously improves the abundance and interestingness of video creation, and greatly improves the user experience.
In one embodiment, the restoring the color of the target subject in the grayscale image further includes any one of:
under the condition that the target shooting subject stops generating the audio signal, restoring an image corresponding to the target shooting subject into a gray image;
and under the condition that the time for the target shooting subject to stop generating the audio signal exceeds a first time threshold, restoring the image corresponding to the target shooting subject into a gray image.
Alternatively, a plurality of target photographic subjects that uttered sounds may exist in the gradation image, and it is detected that the target photographic subjects uttered at different times or at the same time. In the video shooting process, the audio signal can be tracked, the color of the target shooting main body which is sounding can be recovered, and the specific color filter effect can be beautified, so that the method is not particularly limited. When a plurality of target photographic subjects vocalize at different times, the colors of the target photographic subjects who are vocalizing can be restored, that is, the target photographic subjects who are vocalizing can be highlighted. When a plurality of target shooting subjects sound at the same time, the colors of the target shooting subjects which are sounding can be restored at the same time, namely, all the target shooting subjects which are sounding can be highlighted.
Alternatively, in the case where the target photographic subject stops generating the audio signal, the image corresponding to the target photographic subject will be restored to the grayscale image, that is, the color image corresponding to the target photographic subject will be changed to the grayscale image at the time when the target photographic subject stops generating the audio signal. In the case that the time for the target photographic subject to stop generating the audio signal exceeds the first time threshold, the color image corresponding to the target photographic subject is restored to be a gray image. The color of the image of the subject photographed may be changed alternately in gray scale and in color in accordance with the generation of the audio signal.
The first time threshold may be set according to a user requirement, and may be set to a specific time period, for example, the first time threshold is set to 5 seconds, and after the target shooting subject stops generating the audio signal for 5 seconds, the color image corresponding to the target shooting subject will be restored to the grayscale image.
For example: the user photographs a video of a conversation between two persons through a mobile phone, that is, a subject photographed with a target having two utterances in a gray-scale image is defined as a person a and a person B. When the person A speaks, the audio sounding area can be tracked in the lower right corner, the target shooting main body is identified to be the person A in the lower right corner of the gray level image through an object identification algorithm, and color recovery is conducted on pixel points of the whole outline of the person A. Similarly, when the person B speaks, the audio sounding region can be tracked to the lower left corner, the target shooting main body is identified to be the person B in the lower left corner of the gray-scale image through an object identification algorithm, and color recovery is carried out on pixel points of the whole outline of the person B. Therefore, under the scene of chatting between the character A and the character B, the color of the talking character is recovered, so that the color of the target shooting main body can change along with the change of the talking character.
According to the video shooting method provided by the embodiment of the application, the audio signal is tracked, the color of the target shooting main body corresponding to the audio signal is recovered, the sounding target shooting main body can be highlighted, and therefore the creativity of video shooting is enriched.
In one embodiment, in a case where the preset condition includes that the motion displacement of the video shooting object exceeds a preset displacement threshold, the shooting of the target video based on the target shooting subject includes:
and stopping shooting of the target video when the time for which the target shooting subject leaves from the gray-scale image exceeds a second time threshold.
Optionally, when the target shooting subject is a video shooting subject with a motion displacement exceeding a preset displacement threshold, whether to end video recording may be determined by whether the target shooting subject leaves the grayscale image. And when the target shooting subject leaves the gray-scale image and does not return to the gray-scale image after the second time threshold, the video shooting is considered to be finished. The second time threshold is a preset parameter, and the application is not particularly limited.
For example: the user shoots a video of the child running through the mobile phone, and the second time threshold is set to 10 seconds. When the child runs out of the video shooting picture and does not return to the shooting picture within 10 seconds, the video shooting is automatically ended.
Optionally, the user may also trigger to end video shooting through a shooting control in the shooting preview interface, or trigger to end video shooting through voice input, or directly end video shooting through screen locking, which is not specifically limited in this application.
According to the video shooting method provided by the embodiment of the application, the judgment of ending the video shooting is realized by detecting whether the moving target shooting main body leaves the gray level image, so that the flexibility of the video shooting can be improved.
In one embodiment, in a case that the preset condition includes that the area where the video shooting object is located is an audio sound emitting area, the shooting of the target video based on the target shooting subject includes:
and stopping the shooting of the target video under the condition that the time for stopping the generation of the audio signal by the target shooting subject exceeds a third time threshold.
Optionally, when the target shooting subject is a video shooting subject whose area is an audio sound emitting area, whether to end video recording may be determined by whether the target shooting subject stops generating an audio signal. And when the target shooting subject stops generating the audio signal and does not sound again after the third time threshold, the video shooting is considered to be finished. The third time threshold is a preset parameter, and the application is not particularly limited.
For example: the user shoots a video of a child singing through the mobile phone, and the third time threshold is set to be 10 seconds. When the child stops singing and does not sound again within 10 seconds, the video shooting is automatically ended.
Optionally, the user may also trigger to end video shooting through a shooting control in the shooting preview interface, or trigger to end video shooting through voice input, or directly end video shooting through screen locking, which is not specifically limited in this application.
According to the video shooting method provided by the embodiment of the application, whether the sound-producing target shooting main body stops producing the audio signal or not is detected, the judgment of ending video shooting is achieved, and therefore the flexibility of video shooting can be improved.
In one embodiment, fig. 2 is a schematic flowchart of a video shooting method according to an embodiment of the present application. In this embodiment, the video shooting method is applied to a mobile phone video shooting process in a cartoon style, and may include:
step 210, opening a camera function in the mobile phone, and entering a video shooting mode of a cartoon style mode.
Step 211, removing color elements from the whole video preview image, retaining gray data, and identifying the boundary contour of each video shot object, so as to draw a cartoon style and display the cartoon style, as shown in fig. 3.
Step 212, starting motion detection, performing motion detection, and determining the motion object as a target shooting subject. If the moving object is detected, step 213 is entered, otherwise, step 211 is returned to, and the motion detection is continued.
Step 213, the detected color of the moving object is restored to the original state, the moving object is highlighted, and separation processing can also be performed from the cartoon background.
Step 214, judging whether recording is finished, if so, entering step 215, otherwise, returning to step 212 to continue moving object detection.
Step 215, sending the recorded video data to an encoder for encoding to generate a target video, namely completing video shooting.
According to the video shooting method provided by the embodiment of the application, through the combination of the cartoon style and the motion detection technology, when the video is shot, the whole picture is presented in the cartoon style mode, and meanwhile, the moving object detection is carried out. Recognizing that the moving object is a target shooting subject, and recovering the color of the moving object so as to highlight the subject of video shooting; the separation of the target shooting main body and the background can be realized, the creation and interestingness of cartoon style video recording are increased, and the user experience is improved.
In an embodiment, fig. 4 is a second flowchart illustrating a video shooting method according to an embodiment of the present application. In this embodiment, the video shooting method is applied to a mobile phone video shooting process in a cartoon style, and may include:
and step 410, opening a camera function in the mobile phone, and entering a video shooting mode of a cartoon style mode.
And 411, removing color elements from the whole video preview image, reserving gray data, and identifying the boundary contour of each video shooting object so as to draw a cartoon style and display the cartoon style.
Step 412, audio position tracking is turned on to track the position of the sounding object. If the sounding object is detected, the step 413 is performed, otherwise, the step 411 is performed again, and the audio tracking is continued.
And 413, analyzing the detected audio sounding area to obtain a person or an animal. And the analyzed person or animal is used as a target shooting subject, and the color of the target shooting subject is recovered for highlighting the shooting subject.
And step 414, judging whether recording is finished, if so, entering step 415, otherwise, returning to step 412 to continue tracking the audio azimuth.
And 415, sending the recorded video data to an encoder for encoding to generate a target video, namely finishing video shooting.
According to the video shooting method provided by the embodiment of the application, through the technology of combining the cartoon style and the audio tracking, when the video is shot, the whole picture is presented in the cartoon style mode, and meanwhile the audio tracking is carried out. After the sound production position is identified, the sound production object is determined to be the target shooting main body by combining an object identification algorithm, and the color of the sound production object is recovered, so that the target shooting main body is highlighted, the creation and interestingness of shooting videos in an audio scene are improved, and the user experience is improved.
It should be noted that, in the video shooting method provided in the embodiment of the present application, the execution subject may be a video shooting device, or a control module in the video shooting device for executing the video shooting method. In the embodiment of the present application, a video shooting method executed by a video shooting device is taken as an example, and the video shooting device provided in the embodiment of the present application is described.
Fig. 5 is a block diagram of a video camera according to an embodiment of the present disclosure. Referring to fig. 5, an embodiment of the present application provides a video camera, which may include:
a conversion module 510 for converting the photographed image into a gray image;
a restoring module 520, configured to determine a video shooting object meeting a preset condition as a target shooting subject, and restore a color of the target shooting subject in the grayscale image;
a shooting module 530, configured to shoot a target video based on the target shooting subject;
wherein the preset condition comprises at least one of the following:
the motion displacement of the video shooting object exceeds a preset displacement threshold;
the area where the video shooting object is located is an audio sounding area.
According to the video shooting device provided by the embodiment of the application, the video shooting object meeting the preset conditions is determined as the target shooting subject, the target shooting subject can be determined in real time in the video shooting process, and the target shooting subject is subjected to targeted processing to complete the shooting of the target video, so that the flexibility and diversity of video shooting are improved; still convert the image of shooing into grey level image to the colour of the target shooting main part in the recovery grey level image, and then can highlight the target shooting main part, can also improve the shooting effect that the video was shot, also improved the abundant degree of video creation simultaneously, further promoted user experience.
In one embodiment, the recovery module 520 includes:
a first determination module (not shown in the figure) for performing motion detection on the video photographic subject;
and determining the video shooting object with the motion displacement exceeding the preset displacement threshold value as a target shooting subject.
In one embodiment, the recovery module 520 includes:
a second determining module (not shown in the figure) for determining orientation information of the audio signal;
determining the audio sounding area according to the azimuth information;
and determining the video shooting object in the audio sounding area as the target shooting subject.
In an embodiment, the recovery module 520 is further specifically configured to:
restoring the color of the target photographic subject in the gray-scale image based on the outline of the target photographic subject; alternatively, the first and second electrodes may be,
firstly, restoring the color of the target photographic subject in the gray-scale image based on the outline of the target photographic subject, and then restoring the color of the rest part of the gray-scale image; alternatively, the first and second electrodes may be,
restoring the color of the whole gray image based on the outline of the video shooting object;
wherein the contour of the video photographic subject is determined based on the grayscale image.
In an embodiment, the recovery module 520 is further specifically configured to:
under the condition that the target shooting subject stops generating the audio signal, restoring an image corresponding to the target shooting subject into a gray image;
and under the condition that the time for the target shooting subject to stop generating the audio signal exceeds a first time threshold, restoring the image corresponding to the target shooting subject into a gray image.
In an embodiment, the capturing module 530 is further specifically configured to:
and stopping shooting of the target video when the time for which the target shooting subject leaves from the gray-scale image exceeds a second time threshold.
In an embodiment, the capturing module 530 is further specifically configured to:
and stopping the shooting of the target video under the condition that the time for stopping the generation of the audio signal by the target shooting subject exceeds a third time threshold.
The video shooting device in the embodiment of the present application may be a device, or may be a component, an integrated circuit, or a chip in a terminal. The device can be mobile electronic equipment or non-mobile electronic equipment. By way of example, the mobile electronic device may be a mobile phone, a tablet computer, a notebook computer, a palm top computer, a vehicle-mounted electronic device, a wearable device, an ultra-mobile personal computer (UMPC), a netbook or a Personal Digital Assistant (PDA), and the like, and the non-mobile electronic device may be a server, a Network Attached Storage (NAS), a Personal Computer (PC), a Television (TV), a teller machine or a self-service machine, and the like, and the embodiments of the present application are not particularly limited.
The video capture device in the embodiment of the present application may be a device having an operating system. The operating system may be an Android (Android) operating system, an ios operating system, or other possible operating systems, and embodiments of the present application are not limited specifically.
The video shooting device provided in the embodiment of the present application can implement each process implemented by the method embodiments of fig. 1 to 4, and is not described here again to avoid repetition.
Optionally, as shown in fig. 6, an electronic device 600 is further provided in this embodiment of the present application, and includes a processor 601, a memory 602, and a program or an instruction stored in the memory 602 and executable on the processor 601, where the program or the instruction is executed by the processor 601 to implement each process of the above-mentioned video shooting method embodiment, and can achieve the same technical effect, and in order to avoid repetition, details are not repeated here.
It should be noted that the electronic device in the embodiment of the present application includes the mobile electronic device and the non-mobile electronic device described above.
Fig. 7 is a hardware structure diagram of an electronic device implementing an embodiment of the present application.
The electronic device 700 includes, but is not limited to: a radio frequency unit 701, a network module 702, an audio output unit 703, an input unit 704, a sensor 705, a display unit 706, a user input unit 707, an interface unit 708, a memory 709, and a processor 710.
Those skilled in the art will appreciate that the electronic device 700 may also include a power supply (e.g., a battery) for powering the various components, and the power supply may be logically coupled to the processor 710 via a power management system, such that the functions of managing charging, discharging, and power consumption may be performed via the power management system. The electronic device structure shown in fig. 7 does not constitute a limitation of the electronic device, and the electronic device may include more or less components than those shown, or combine some components, or arrange different components, and thus, the description is omitted here.
The processor 710 is configured to convert the captured image into a grayscale image;
determining a video shooting object meeting a preset condition as a target shooting subject, and recovering the color of the target shooting subject in the gray-scale image;
shooting a target video based on the target shooting subject;
wherein the preset condition comprises at least one of the following:
the motion displacement of the video shooting object exceeds a preset displacement threshold;
the area where the video shooting object is located is an audio sounding area.
According to the electronic equipment provided by the embodiment of the application, the video shooting object meeting the preset conditions is determined as the target shooting subject, the target shooting subject can be determined in real time in the video shooting process, and the target shooting subject is subjected to targeted processing to complete the shooting of the target video, so that the flexibility and diversity of video shooting are improved; still convert the image of shooing into grey level image to the colour of the target shooting main part in the recovery grey level image, and then can highlight the target shooting main part, can also improve the shooting effect that the video was shot, also improved the abundant degree of video creation simultaneously, further promoted user experience.
Optionally, the processor 710 is further configured to, in a case that the preset condition includes that the motion displacement of the video capture object exceeds a preset displacement threshold, determine the video capture object meeting the preset condition as the target capture subject, including:
carrying out motion detection on the video shooting object;
and determining the video shooting object with the motion displacement exceeding the preset displacement threshold value as a target shooting subject.
Optionally, the processor 710 is further configured to, when the preset condition includes that the area where the video capture object is located is an audio sound emission area, determine the video capture object meeting the preset condition as a target capture subject, including:
determining orientation information of the audio signal;
determining the audio sounding area according to the azimuth information;
and determining the video shooting object in the audio sounding area as the target shooting subject.
Optionally, the processor 710 is further configured to restore the color of the target subject in the grayscale image, and includes any one of:
restoring the color of the target photographic subject in the gray-scale image based on the outline of the target photographic subject; alternatively, the first and second electrodes may be,
firstly, restoring the color of the target photographic subject in the gray-scale image based on the outline of the target photographic subject, and then restoring the color of the rest part of the gray-scale image; alternatively, the first and second electrodes may be,
restoring the color of the whole gray image based on the outline of the video shooting object;
wherein the contour of the video photographic subject is determined based on the grayscale image.
Optionally, the processor 710 is further configured to restore the color of the target subject in the grayscale image, and further includes any one of:
under the condition that the target shooting subject stops generating the audio signal, restoring an image corresponding to the target shooting subject into a gray image;
and under the condition that the time for the target shooting subject to stop generating the audio signal exceeds a first time threshold, restoring the image corresponding to the target shooting subject into a gray image.
Optionally, the processor 710 is further configured to, when the preset condition includes that the motion displacement of the video capture object exceeds a preset displacement threshold, perform capture of a target video based on the target capture subject, including:
and stopping shooting of the target video when the time for which the target shooting subject leaves from the gray-scale image exceeds a second time threshold.
Optionally, the processor 710 is further configured to, when the preset condition includes that the area where the video shooting object is located is an audio sound emitting area, perform shooting of a target video based on the target shooting subject, including:
and stopping the shooting of the target video under the condition that the time for stopping the generation of the audio signal by the target shooting subject exceeds a third time threshold.
It should be understood that in the embodiment of the present application, the input Unit 704 may include a Graphics Processing Unit (GPU) 7041 and a microphone 7042, and the Graphics Processing Unit 7041 processes image data of still pictures or videos obtained by an image capturing device (e.g., a camera) in a video capturing mode or an image capturing mode. The display unit 706 may include a display panel 7061, and the display panel 7061 may be configured in the form of a liquid crystal display, an organic light emitting diode, or the like. The user input unit 707 includes a touch panel 7071 and other input devices 7072. The touch panel 7071 is also referred to as a touch screen. The touch panel 7071 may include two parts of a touch detection device and a touch controller. Other input devices 7072 may include, but are not limited to, a physical keyboard, function keys (e.g., volume control keys, switch keys, etc.), a trackball, a mouse, and a joystick, which are not described in detail herein. Memory 709 may be used to store software programs as well as various data, including but not limited to applications and operating systems. Processor 710 may integrate an application processor, which primarily handles operating systems, user interfaces, applications, etc., and a modem processor, which primarily handles wireless communications. It will be appreciated that the modem processor described above may not be integrated into processor 710.
The embodiment of the present application further provides a readable storage medium, where a program or an instruction is stored on the readable storage medium, and when the program or the instruction is executed by a processor, the program or the instruction implements each process of the video shooting method embodiment, and can achieve the same technical effect, and in order to avoid repetition, details are not repeated here.
The processor is the processor in the electronic device described in the above embodiment. The readable storage medium includes a computer readable storage medium, such as a Read-Only Memory (ROM), a Random Access Memory (RAM), a magnetic disk or an optical disk, and so on.
The embodiment of the present application further provides a chip, where the chip includes a processor and a communication interface, the communication interface is coupled to the processor, and the processor is configured to run a program or an instruction to implement each process of the above video shooting method embodiment, and can achieve the same technical effect, and the details are not repeated here to avoid repetition.
It should be understood that the chips mentioned in the embodiments of the present application may also be referred to as system-on-chip, system-on-chip or system-on-chip, etc.
It should be noted that, in this document, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising an … …" does not exclude the presence of other like elements in a process, method, article, or apparatus that comprises the element. Further, it should be noted that the scope of the methods and apparatus of the embodiments of the present application is not limited to performing the functions in the order illustrated or discussed, but may include performing the functions in a substantially simultaneous manner or in a reverse order based on the functions involved, e.g., the methods described may be performed in an order different than that described, and various steps may be added, omitted, or combined. In addition, features described with reference to certain examples may be combined in other examples.
Through the above description of the embodiments, those skilled in the art will clearly understand that the method of the above embodiments can be implemented by software plus a necessary general hardware platform, and certainly can also be implemented by hardware, but in many cases, the former is a better implementation manner. Based on such understanding, the technical solutions of the present application may be embodied in the form of a computer software product, which is stored in a storage medium (such as ROM/RAM, magnetic disk, optical disk) and includes instructions for enabling a terminal (such as a mobile phone, a computer, a server, or a network device) to execute the method according to the embodiments of the present application.
While the present embodiments have been described with reference to the accompanying drawings, it is to be understood that the invention is not limited to the precise embodiments described above, which are meant to be illustrative and not restrictive, and that various changes may be made therein by those skilled in the art without departing from the spirit and scope of the invention as defined by the appended claims.

Claims (10)

1. A video capture method, comprising:
converting the photographed image into a gray image;
determining a video shooting object meeting a preset condition as a target shooting subject, and recovering the color of the target shooting subject in the gray-scale image;
shooting a target video based on the target shooting subject;
wherein the preset condition comprises at least one of the following:
the motion displacement of the video shooting object exceeds a preset displacement threshold;
the area where the video shooting object is located is an audio sounding area.
2. The video shooting method according to claim 1, wherein in a case where the preset condition includes that the movement displacement of the video shooting object exceeds a preset displacement threshold, the determining of the video shooting object satisfying the preset condition as the target shooting subject includes:
carrying out motion detection on the video shooting object;
and determining the video shooting object with the motion displacement exceeding the preset displacement threshold value as a target shooting subject.
3. The video shooting method according to claim 1, wherein in a case where the preset condition includes that the area where the video shooting object is located is an audio sound emission area, the determining that the video shooting object satisfying the preset condition is a target shooting subject includes:
determining orientation information of the audio signal;
determining the audio sounding area according to the azimuth information;
and determining the video shooting object in the audio sounding area as the target shooting subject.
4. The video shooting method according to claim 1, wherein the restoring the color of the target shooting subject in the grayscale image includes any one of:
restoring the color of the target photographic subject in the gray-scale image based on the outline of the target photographic subject; alternatively, the first and second electrodes may be,
firstly, restoring the color of the target photographic subject in the gray-scale image based on the outline of the target photographic subject, and then restoring the color of the rest part of the gray-scale image; alternatively, the first and second electrodes may be,
restoring the color of the whole gray image based on the outline of the video shooting object;
wherein the contour of the video photographic subject is determined based on the grayscale image.
5. The video shooting method according to claim 3, wherein the restoring the color of the target shooting subject in the grayscale image further includes any one of:
under the condition that the target shooting subject stops generating the audio signal, restoring an image corresponding to the target shooting subject into a gray image;
and under the condition that the time for the target shooting subject to stop generating the audio signal exceeds a first time threshold, restoring the image corresponding to the target shooting subject into a gray image.
6. The video shooting method according to claim 1, wherein in a case where the preset condition includes that a movement displacement of the video shooting object exceeds a preset displacement threshold, the shooting of the target video based on the target shooting subject includes:
and stopping shooting of the target video when the time for which the target shooting subject leaves from the gray-scale image exceeds a second time threshold.
7. The video shooting method according to claim 1, wherein in a case where the preset condition includes that the area where the video shooting object is located is an audio sound emission area, the shooting of the target video based on the target shooting subject includes:
and stopping the shooting of the target video under the condition that the time for stopping the generation of the audio signal by the target shooting subject exceeds a third time threshold.
8. A video camera, comprising:
the conversion module is used for converting the shot image into a gray image;
the restoring module is used for determining a video shooting object meeting preset conditions as a target shooting subject and restoring the color of the target shooting subject in the gray level image;
the shooting module is used for shooting a target video based on the target shooting main body;
wherein the preset condition comprises at least one of the following:
the motion displacement of the video shooting object exceeds a preset displacement threshold;
the area where the video shooting object is located is an audio sounding area.
9. An electronic device comprising a processor, a memory, and a program or instructions stored on the memory and executable on the processor, the program or instructions when executed by the processor implementing the steps of the video capture method of any of claims 1-7.
10. A readable storage medium, characterized in that it stores thereon a program or instructions which, when executed by a processor, implement the steps of the video shooting method according to any one of claims 1 to 7.
CN202111070467.XA 2021-09-13 2021-09-13 Video shooting method, electronic equipment and device Active CN113766130B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202111070467.XA CN113766130B (en) 2021-09-13 2021-09-13 Video shooting method, electronic equipment and device

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202111070467.XA CN113766130B (en) 2021-09-13 2021-09-13 Video shooting method, electronic equipment and device

Publications (2)

Publication Number Publication Date
CN113766130A true CN113766130A (en) 2021-12-07
CN113766130B CN113766130B (en) 2023-07-28

Family

ID=78795324

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202111070467.XA Active CN113766130B (en) 2021-09-13 2021-09-13 Video shooting method, electronic equipment and device

Country Status (1)

Country Link
CN (1) CN113766130B (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN116055869A (en) * 2022-05-30 2023-05-02 荣耀终端有限公司 Video processing method and terminal

Citations (16)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103873837A (en) * 2012-12-14 2014-06-18 三星泰科威株式会社 Apparatus and method for color restoration
CN105681627A (en) * 2016-03-03 2016-06-15 联想(北京)有限公司 Image shooting method and electronic equipment
CN106488215A (en) * 2015-09-01 2017-03-08 三星电子株式会社 Image processing method and equipment
CN106504274A (en) * 2016-10-10 2017-03-15 广东技术师范学院 A kind of visual tracking method and system based under infrared camera
CN107181891A (en) * 2016-03-10 2017-09-19 富士施乐株式会社 Image processing apparatus and image processing method
CN108230256A (en) * 2017-11-09 2018-06-29 珠海市魅族科技有限公司 Image processing method, device, computer installation and computer readable storage medium
CN109496423A (en) * 2018-10-15 2019-03-19 华为技术有限公司 Image display method and electronic equipment under a kind of photographed scene
CN209496378U (en) * 2018-12-13 2019-10-15 北京小米移动软件有限公司 Terminal
CN110378934A (en) * 2019-07-22 2019-10-25 Oppo广东移动通信有限公司 Subject detection method, apparatus, electronic equipment and computer readable storage medium
CN110557566A (en) * 2019-08-30 2019-12-10 维沃移动通信有限公司 Video shooting method and electronic equipment
CN111104920A (en) * 2019-12-27 2020-05-05 深圳市商汤科技有限公司 Video processing method and device, electronic equipment and storage medium
CN111432115A (en) * 2020-03-12 2020-07-17 浙江大华技术股份有限公司 Face tracking method based on voice auxiliary positioning, terminal and storage device
CN111866389A (en) * 2020-07-29 2020-10-30 努比亚技术有限公司 Video tracking shooting method and device and computer readable storage medium
CN112801922A (en) * 2021-04-01 2021-05-14 暨南大学 Color image-gray image-color image conversion method
US20210166416A1 (en) * 2019-11-29 2021-06-03 Ubtech Robotics Corp Ltd Robert climbing control method and device and storage medium and robot
CN112955712A (en) * 2020-04-28 2021-06-11 深圳市大疆创新科技有限公司 Target tracking method, device and storage medium

Patent Citations (17)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103873837A (en) * 2012-12-14 2014-06-18 三星泰科威株式会社 Apparatus and method for color restoration
CN106488215A (en) * 2015-09-01 2017-03-08 三星电子株式会社 Image processing method and equipment
CN105681627A (en) * 2016-03-03 2016-06-15 联想(北京)有限公司 Image shooting method and electronic equipment
CN107181891A (en) * 2016-03-10 2017-09-19 富士施乐株式会社 Image processing apparatus and image processing method
CN106504274A (en) * 2016-10-10 2017-03-15 广东技术师范学院 A kind of visual tracking method and system based under infrared camera
CN108230256A (en) * 2017-11-09 2018-06-29 珠海市魅族科技有限公司 Image processing method, device, computer installation and computer readable storage medium
CN112532869A (en) * 2018-10-15 2021-03-19 华为技术有限公司 Image display method in shooting scene and electronic equipment
CN109496423A (en) * 2018-10-15 2019-03-19 华为技术有限公司 Image display method and electronic equipment under a kind of photographed scene
CN209496378U (en) * 2018-12-13 2019-10-15 北京小米移动软件有限公司 Terminal
CN110378934A (en) * 2019-07-22 2019-10-25 Oppo广东移动通信有限公司 Subject detection method, apparatus, electronic equipment and computer readable storage medium
CN110557566A (en) * 2019-08-30 2019-12-10 维沃移动通信有限公司 Video shooting method and electronic equipment
US20210166416A1 (en) * 2019-11-29 2021-06-03 Ubtech Robotics Corp Ltd Robert climbing control method and device and storage medium and robot
CN111104920A (en) * 2019-12-27 2020-05-05 深圳市商汤科技有限公司 Video processing method and device, electronic equipment and storage medium
CN111432115A (en) * 2020-03-12 2020-07-17 浙江大华技术股份有限公司 Face tracking method based on voice auxiliary positioning, terminal and storage device
CN112955712A (en) * 2020-04-28 2021-06-11 深圳市大疆创新科技有限公司 Target tracking method, device and storage medium
CN111866389A (en) * 2020-07-29 2020-10-30 努比亚技术有限公司 Video tracking shooting method and device and computer readable storage medium
CN112801922A (en) * 2021-04-01 2021-05-14 暨南大学 Color image-gray image-color image conversion method

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN116055869A (en) * 2022-05-30 2023-05-02 荣耀终端有限公司 Video processing method and terminal
CN116055869B (en) * 2022-05-30 2023-10-20 荣耀终端有限公司 Video processing method and terminal

Also Published As

Publication number Publication date
CN113766130B (en) 2023-07-28

Similar Documents

Publication Publication Date Title
CN109992237B (en) Intelligent voice equipment control method and device, computer equipment and storage medium
WO2022227393A1 (en) Image photographing method and apparatus, electronic device, and computer readable storage medium
CN111583355B (en) Face image generation method and device, electronic equipment and readable storage medium
AU2020309094B2 (en) Image processing method and apparatus, electronic device, and storage medium
CN106127828A (en) The processing method of a kind of augmented reality, device and mobile terminal
CN114007099A (en) Video processing method and device for video processing
CN113806570A (en) Image generation method and generation device, electronic device and storage medium
CN113194253A (en) Shooting method and device for removing image reflection and electronic equipment
CN112580472A (en) Rapid and lightweight face recognition method and device, machine readable medium and equipment
CN113766130B (en) Video shooting method, electronic equipment and device
WO2020215776A1 (en) Multimedia data processing method and apparatus
CN112639964A (en) Method, system and computer readable medium for recognizing speech using depth information
CN112511743B (en) Video shooting method and device
CN112291480B (en) Tracking focusing method, tracking focusing device, electronic device and readable storage medium
CN113596574A (en) Video processing method, video processing apparatus, electronic device, and readable storage medium
CN109740557B (en) Object detection method and device, electronic equipment and storage medium
CN112700568A (en) Identity authentication method, equipment and computer readable storage medium
CN117152660A (en) Image display method and device
CN116193193A (en) Video processing method and device
CN112261321B (en) Subtitle processing method and device and electronic equipment
CN112532904B (en) Video processing method and device and electronic equipment
CN114220175A (en) Motion pattern recognition method, motion pattern recognition device, motion pattern recognition apparatus, motion pattern recognition medium, and motion pattern recognition product
CN113347356A (en) Shooting method, shooting device, electronic equipment and storage medium
CN112101387A (en) Salient element identification method and device
CN111770279A (en) Shooting method and electronic equipment

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant