CN114040248A - Video processing method and device and electronic equipment - Google Patents
Video processing method and device and electronic equipment Download PDFInfo
- Publication number
- CN114040248A CN114040248A CN202111393304.5A CN202111393304A CN114040248A CN 114040248 A CN114040248 A CN 114040248A CN 202111393304 A CN202111393304 A CN 202111393304A CN 114040248 A CN114040248 A CN 114040248A
- Authority
- CN
- China
- Prior art keywords
- video
- target
- image frame
- replacement
- information
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000003672 processing method Methods 0.000 title claims abstract description 23
- 239000000463 material Substances 0.000 claims abstract description 150
- 238000000034 method Methods 0.000 claims description 27
- 238000010586 diagram Methods 0.000 description 13
- 230000000694 effects Effects 0.000 description 9
- 241000208967 Polygala cruciata Species 0.000 description 7
- 230000006870 function Effects 0.000 description 6
- 238000004891 communication Methods 0.000 description 5
- 238000000605 extraction Methods 0.000 description 4
- 238000000354 decomposition reaction Methods 0.000 description 2
- 230000003287 optical effect Effects 0.000 description 2
- 230000004044 response Effects 0.000 description 2
- 238000001514 detection method Methods 0.000 description 1
- 238000007599 discharging Methods 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
- 230000004927 fusion Effects 0.000 description 1
- 239000010929 jewellery material Substances 0.000 description 1
- 239000004973 liquid crystal related substance Substances 0.000 description 1
- 238000004519 manufacturing process Methods 0.000 description 1
- 230000001960 triggered effect Effects 0.000 description 1
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/44—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs
- H04N21/44016—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs involving splicing one content stream with another content stream, e.g. for substituting a video clip
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/439—Processing of audio elementary streams
- H04N21/4394—Processing of audio elementary streams involving operations for analysing the audio stream, e.g. detecting features or characteristics in audio streams
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/44—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs
- H04N21/44008—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs involving operations for analysing video streams, e.g. detecting features or characteristics in the video stream
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Television Signal Processing For Recording (AREA)
Abstract
The application discloses a video processing method and device and electronic equipment, and belongs to the technical field of video processing. The video processing method comprises the following steps: displaying a video to be processed and a replacement material; receiving a first input of a user; responding to the first input, and replacing a target area of a target video image frame in the video to be processed according to the replacement material to obtain a target video; wherein the target video image frame is determined from first information comprising at least one of: audio information, subtitle information, voice information, motion information of a target object in a video image frame, the target region being determined from the replacement material.
Description
Technical Field
The application belongs to the technical field of video processing, and particularly relates to a video processing method and device and electronic equipment.
Background
The existing video clips are created and clipped manually based on video editing software, or drum marks are given according to music tracks, so that users can insert videos, for most users, the time cost for learning the video editing software and clipping the videos is high, for example, the video shooting places of common users are high in randomness, clothing props are not easy to obtain or the purchasing cost is high, and the users are more inclined to create on mobile phones so as to realize timely sharing and releasing; or, when the user wants to shoot a person to change the video, the user needs to purchase a plurality of pieces of clothing and try on, shoot a plurality of groups of video materials and manually edit the video and the music drum points, sometimes the selected music drum points are not very clear or too dense, so that the user needs to spend a long time to repeatedly modify the music drum points.
Disclosure of Invention
The embodiment of the application aims to provide a video processing method, a video processing device and electronic equipment, and can solve the problems that time cost and material cost consumed by users for shooting various videos are high in the related technology.
In a first aspect, an embodiment of the present application provides a video processing method, where the method includes:
displaying a video to be processed and a replacement material;
receiving a first input of a user;
responding to the first input, and replacing a target area of a target video image frame in the video to be processed according to the replacement material to obtain a target video;
wherein the target video image frame is determined from first information comprising at least one of: audio information, subtitle information, voice information, motion information of a target object in a video image frame, the target region being determined from the replacement material.
In a second aspect, an embodiment of the present application provides a video processing apparatus, including:
the first display module is used for displaying the video to be processed and the replacement material;
the first receiving module is used for receiving a first input of a user;
the first replacement module is used for responding to the first input and performing replacement processing on a target area of a target video image frame in the video to be processed according to the replacement material to obtain a target video;
wherein the target video image frame is determined from first information comprising at least one of: audio information, subtitle information, voice information, motion information of a target object in a video image frame, the target region being determined from the replacement material.
In a third aspect, an embodiment of the present application provides an electronic device, which includes a processor, a memory, and a program or instructions stored on the memory and executable on the processor, and when executed by the processor, the program or instructions implement the steps of the method according to the first aspect.
In a fourth aspect, embodiments of the present application provide a readable storage medium, on which a program or instructions are stored, which when executed by a processor implement the steps of the method according to the first aspect.
In a fifth aspect, an embodiment of the present application provides a chip, where the chip includes a processor and a communication interface, where the communication interface is coupled to the processor, and the processor is configured to execute a program or instructions to implement the method according to the first aspect.
In the embodiment of the application, the replacement materials can be independently determined by a user by displaying the video to be processed and the replacement materials, and the replacement materials are used for replacing the target area in the target video image frame in the video to be processed, so that the automatic clipping of the video to be processed is realized, the shooting cost of the video is reduced, the video clipping efficiency is improved, and the video clipping difficulty is reduced.
Drawings
Fig. 1 is a schematic flowchart of a video processing method according to an embodiment of the present application;
fig. 2 is a schematic diagram of a first video provided in an embodiment of the present application;
fig. 3 is a schematic diagram of a track of target audio and a material image according to an embodiment of the present disclosure;
fig. 4 is a schematic diagram illustrating matching between a drum point of a target audio and a target image according to an embodiment of the present application;
FIG. 5 is a schematic diagram of a target image template provided by an embodiment of the present application;
fig. 6 is a schematic structural diagram of a video processing apparatus according to an embodiment of the present application;
fig. 7 is a schematic structural diagram of an electronic device according to an embodiment of the present application;
fig. 8 is a schematic diagram of a hardware structure of an electronic device implementing an embodiment of the present application.
Detailed Description
The technical solutions in the embodiments of the present application will be described clearly below with reference to the drawings in the embodiments of the present application, and it is obvious that the described embodiments are some, but not all, embodiments of the present application. All other embodiments that can be derived by one of ordinary skill in the art from the embodiments given herein are intended to be within the scope of the present disclosure.
The terms first, second and the like in the description and in the claims of the present application are used for distinguishing between similar elements and not necessarily for describing a particular sequential or chronological order. It will be appreciated that the data so used may be interchanged under appropriate circumstances such that embodiments of the application may be practiced in sequences other than those illustrated or described herein, and that the terms "first," "second," and the like are generally used herein in a generic sense and do not limit the number of terms, e.g., the first term can be one or more than one. In addition, "and/or" in the specification and claims means at least one of connected objects, a character "/" generally means that a preceding and succeeding related objects are in an "or" relationship.
The following describes in detail a video processing method, an apparatus and an electronic device provided in the embodiments of the present application with reference to the accompanying drawings.
Referring to fig. 1, fig. 1 is a schematic flowchart illustrating a video processing method according to an embodiment of the present disclosure. As shown in fig. 1, an embodiment of the present application provides a video processing method, including the following steps:
step 101: displaying a video to be processed and a replacement material;
step 102: receiving a first input of a user;
step 103: responding to the first input, and replacing a target area of a target video image frame in the video to be processed according to the replacement material to obtain a target video;
wherein the target video image frame is determined from first information comprising at least one of: audio information, subtitle information, voice information, motion information of a target object in a video image frame, the target region being determined from the replacement material.
In the embodiment of the application, the video to be processed is the video to be edited, and the replacement materials can be extracted from files such as images and videos. After the video to be processed and the replacement material are displayed on the display interface of the electronic device, if a first input of a user is received, for example, the first input is an input of clicking a fusion control in the display interface, the electronic device will respond to the first input and process the video to be processed by using the replacement material to obtain a target video. For example, the electronic device may determine target video image frames in the video to be processed according to the first information, determine a target region in each target video image frame according to the replacement material, and then perform replacement processing on the target regions in the corresponding target video image frames by using the replacement material, thereby obtaining the target video.
Therefore, a user can rapidly realize automatic processing of the video to be processed by using the replacement material, the processing efficiency of the video is greatly improved, and various costs required by video production can be effectively reduced due to the wide source and easy acquisition of the replacement material.
The first information comprises at least one of audio information, subtitle information and voice information, for example, when a target image frame in the video to be processed is determined according to the audio information, the target image frame can be determined according to the drum point of the audio; when a target image frame in a video to be processed is determined according to the subtitle information, the corresponding image frame when a certain specific subtitle appears can be determined as the target image frame; when the target image frame in the video to be processed is determined by using the voice information, the corresponding image frame when a certain specific voice word appears can be determined as the target image frame; of course, the above manners may be combined arbitrarily to determine the target image frame, and the embodiment of the present application is not limited specifically.
In the embodiment of the application, the replacement materials can be independently determined by a user by displaying the video to be processed and the replacement materials, and the replacement materials are used for replacing the target area in the target video image frame in the video to be processed, so that the automatic clipping of the video to be processed is realized, the shooting cost of the video is reduced, the video clipping efficiency is improved, and the video clipping difficulty is reduced.
In some embodiments of the present application, the replacement material includes at least one of: background material, dressing material. The background material can be used for replacing the background in the target video image frame, so that the effect that the background in the video can be changed without actually changing a shooting field is achieved, the dressing material can be used for replacing the dressing of the figure in the target video image frame, and the effect that the dressing of the figure in the video can be changed without actually changing the dressing is achieved. Optionally, the dressing material may include clothing material, jewelry material, hat material, and the like.
In some embodiments of the present application, before displaying the replacement material, the method further includes:
obtaining a reference file, the reference file comprising at least one of: images, videos;
and generating a replacement material according to the reference file.
Illustratively, the user may select the reference file autonomously, wherein the obtained reference file may be all video files, all image files, or both, and the reference file has some content of interest to the user, such as people's clothing, image background, car, etc., so that the substitute material may be generated according to the reference file. For example, the electronic device may automatically perform image extraction on the acquired reference file, specifically, perform image extraction on any image frame in the video file and the region of interest in the image file to obtain the replacement material. Of course, in some embodiments, if the reference file itself can be used as the replacement story, then no extraction operation is required. In other embodiments, any image frame in the video file and the region of interest in the image file may be extracted, and then the extracted images may be combined to obtain the replacement material.
Referring to fig. 2, fig. 2 is a schematic diagram of a reference document provided in an embodiment of the present application. As shown in fig. 2, in some embodiments of the application, a video to be processed may be processed through short video software, specifically, a clipping interface of the short video software may be opened, an operation of selecting a reference file may be triggered in the clipping interface, and then a video selection interface 201 is displayed, a user may select any video 202 as a reference file in the video selection interface 201, for example, at least one video 202 may be clicked and selected as a reference file, and the electronic device may automatically generate a replacement material according to the reference file selected by the user, for example, the electronic device automatically performs image extraction on an area of interest of the reference file selected by the user to generate the replacement material.
In other embodiments of the present application, in a case that the first information is audio information, before performing replacement processing on a target area of a target video image frame in the video to be processed according to the replacement material, the method further includes:
acquiring audio information;
displaying at least one drum point of the audio information;
and determining a target video image frame in the video to be processed according to the at least one drum point.
Specifically, if the first information is audio information, before performing replacement processing on a target area of a target video image frame in a video to be processed according to a replacement material, the audio information may be acquired first, the audio information may be selected by a user, and then the electronic device automatically identifies and displays at least one drum point in the audio information, so that the electronic device may determine the target video image frame in the video to be processed according to the at least one drum point, that is, the electronic device may determine a video image frame, that is, a target video image frame, corresponding to each drum point of the audio information, in the video to be processed by using the audio information as background audio of the video to be processed.
Referring to fig. 3, fig. 3 is a schematic diagram of a track and alternative materials of audio information according to an embodiment of the present disclosure. As shown in fig. 3, in some embodiments of the present application, a video to be processed may be processed by short video software, and specifically, a clip interface 301 of the short video software may be opened, an audio track 302 of audio information and a plurality of replacement materials 303 are displayed on the clip interface 301, the plurality of replacement materials 303 are displayed below the audio track 302, a drum point of the audio information may be identified on the audio track 302 for a user to view, and the replacement materials may also be classified and displayed according to their contents, for example, into a jacket, trousers, a headwear, a shoe, and the like, and each of the classes is collectively displayed.
In this embodiment, the drum point of the audio information may be determined according to the frequency in the audio information.
In some embodiments of the present application, the determining the drumhead of the audio information according to the frequency level in the audio information includes:
carrying out frequency decomposition on the audio information, and decomposing the audio information in at least two different frequency range ranges;
and in each frequency band range, taking a frequency set with a peak value larger than a preset threshold value as a drum point of the audio information.
For example, after the audio information is obtained, the electronic device may perform frequency division on the audio information, decompose the audio information in at least two different frequency range, for example, in a first frequency range, a second frequency range, and a third frequency range, and then, in each frequency range, use a frequency set with a peak value greater than a preset threshold as a drum point of the audio information. That is to say, for an audio information, the drum points of the audio information may be identified by frequency division, for example, the drum points in the first frequency band range may be individually identified, and the drum points in the second frequency band range may also be individually identified, which are not in conflict with each other, so that the user may select the drum points in different frequency band ranges or select the drum points in the same frequency band range according to personal needs. The drum points in different frequency band ranges may correspond to the same target video image frame in the video to be processed, or may correspond to different target video image frames in the video to be processed.
In this embodiment of the application, optionally, before performing replacement processing on a target area of a target video image frame in the video to be processed according to the replacement material, the method further includes:
displaying at least one mark at a corresponding position of the at least one drum point;
receiving a second input of a target identifier in the at least one identifier from a user;
receiving a third input of a user to a target replacement material in the replacement materials;
and responding to the second input and the third input, and replacing a target area of a first target video image frame according to the target replacement material, wherein the first target video image frame is a target video image frame corresponding to the target identification.
That is, when displaying at least one drum point of the audio information, at least one identifier may be displayed at a corresponding position of each drum point, that is, the position of each drum point is marked on the track of the audio information by the identifier; and if a second input of the user to the target identifier in the at least one identifier and a third input of the user to the target replacement material in the replacement material are received, the electronic equipment responds to the second input and the third input, determines a first target video image frame in the video to be processed according to the target identifier, and then replaces a target area of the first target video image frame in the video to be processed by using the target replacement material.
In this embodiment, the second input and the third input are used to correspond the target identifier to the target replacement material; the second input may be an input of the click target identification, and the third input may also be an input of the click target replacement material.
In some embodiments of the present application, optionally, the target identifier may be a serial number, that is, each drum point of the audio information is numbered, the serial numbers corresponding to different drum points are different, and the replacement material may also be numbered, so that the drum points with the same serial number correspond to the replacement material, and replacement processing of the replacement material and the target area in the corresponding target video image frame is implemented. In some embodiments, the replacement materials or the drum points may not be numbered, but the replacement processing may be performed after the drum points and the replacement materials are in one-to-one correspondence according to the original sequence of the drum points and the original sequence of the replacement materials.
In other embodiments of the present application, the process of replacing the target area of the target video image frame in the video to be processed according to the replacement material may be automatically performed by the electronic device, and the electronic device may, for example, identify the area of interest according to the content of each target video image frame in the video to be processed, for example, and then find out the matched alternative material in the alternative material, for example, if the content of the interested area in a target video image frame of the video to be processed is background, if the background material also exists in the replacement material, the two materials can be automatically matched to complete the replacement processing, or if the content of the interested area in one target video image frame of the video to be processed is the whole person, and if the dressing material of the person exists in the replacing material, the two materials can be automatically matched.
In this embodiment of the application, optionally, because the drumhead of the audio information may be identified by frequency division, when the target area of the first target video image frame is replaced according to the target replacement material, only the target area of the first target video image frame determined by the drumhead in a certain frequency band range may be replaced, that is, the user may be allowed to replace the target area of the first target video image frame with the target replacement material according to the frequency band range of the drumhead. For example, when the audio information is frequency-decomposed, the decomposition is performed in the first frequency band range and the second frequency band range, and the target replacement material may be replaced by only the target area of the first target video image frame determined for the drum point within the first frequency band range. Of course, the frequency band range of the drum points may also be not considered, that is, the target replacement material is directly replaced for the target region of the first target video image frame determined by all the drum points (i.e., the drum points in each frequency band range), that is, the target replacement material is replaced for the target region of the first target video image frame determined by the drum points in the first frequency band range and the drum points in the second frequency band range at the same time, at this time, there may be a case that the first target video image frame matches different target replacement materials, that is, different target replacement materials are simultaneously superimposed and fused in the corresponding first target video image frame, so that the superimposition of different effects on the same image can be realized, and the video processing effect is enriched.
Referring to fig. 4, fig. 4 is a schematic diagram illustrating the numbers of the drumhead and the replacement material of the audio information according to the embodiment of the present application. As shown in fig. 4, in some embodiments of the present application, a video to be processed may be processed by short video software, and specifically, a clip interface 301 of the short video software may be opened, an audio track 302 of audio information and a plurality of replacement materials 303 are displayed on the clip interface 301, the plurality of replacement materials 303 are displayed below the audio track 302, a drum point of each audio information is identified on the audio track 302 by a number, and each replacement material is also numbered and displays the number at the lower right corner, and then the drum points with the same number correspond to the replacement materials, so as to implement replacement processing of the replacement materials and a target area in a corresponding target video image frame. Certainly, the user can drag a certain replacement material to the position of a certain drumhead, so that the corresponding matching of the two is realized. In addition, the user can also perform a combination operation on at least two replacement materials to obtain a new replacement material, for example, combine the replacement material with the content being a skirt with the replacement material with the content being a headwear to obtain the new replacement material, and then perform corresponding matching on the new replacement material and a certain drumhead point, that is, complete the corresponding matching of the replacement material and the corresponding target video image frame of the video to be processed.
Referring to fig. 5, fig. 5 is a schematic diagram of an alternative template according to an embodiment of the present disclosure. As shown in fig. 5, in some embodiments of the present application, a to-be-processed video may be processed by short video software, and specifically, a clipping interface 301 of the short video software may be opened, and an audio track 302 with audio information, an alternative template 501, and a to-be-processed video 502 are displayed on the clipping interface 301. Optionally, in this embodiment of the present application, all the replacement materials may be screened to obtain the replacement template 501, that is, the replacement template 501 includes the replacement materials to be replaced by the target areas in all the target video image frames in the video to be processed, when the replacement template 501 is applied, each replacement material in the replacement template 501 is automatically matched with the target areas in all the target video image frames in the video 502 to be processed, and the matching principle may be matched with the target areas of the target video image frames in the video 502 to be processed one by one according to the original sequence of the replacement materials in the replacement template 501, so as to implement the replacement processing. Therefore, in the embodiment of the application, by creating the replacement template, when similar videos to be processed are edited, a certain replacement template can be selected by clicking, and then the function of one-key editing processing of the videos to be processed is realized by applying the replacement materials in the replacement template, namely, the automatic editing effect of the videos to be processed is realized, and the processing efficiency of the videos is greatly improved.
In summary, in the embodiment of the application, the replacement materials can be determined by a user independently by displaying the video to be processed and the replacement materials, and the replacement materials are used for replacing the target area in the target video image frame in the video to be processed, so that the automatic clipping of the video to be processed is realized, the shooting cost of the video is reduced, the video clipping efficiency is improved, and the video clipping difficulty is reduced.
It should be noted that, in the video processing method provided in the embodiment of the present application, the execution subject may be a video processing apparatus, or a control module in the video processing apparatus for executing the video processing method. In the embodiment of the present application, a video processing apparatus executing a video processing method is taken as an example, and the video processing apparatus provided in the embodiment of the present application is described.
Referring to fig. 6, fig. 6 is a schematic structural diagram of a video processing apparatus according to an embodiment of the present disclosure. As shown in fig. 6, another embodiment of the present application further provides a video processing apparatus, where the apparatus 600 includes:
the first display module 601 is configured to display a video to be processed and a replacement material;
a first receiving module 602, configured to receive a first input of a user;
a first replacing module 603, configured to respond to the first input, and perform replacement processing on a target area of a target video image frame in the video to be processed according to the replacement material to obtain a target video;
wherein the target video image frame is determined from first information comprising at least one of: audio information, subtitle information, voice information, motion information of a target object in a video image frame, the target region being determined from the replacement material.
Optionally, the replacement material comprises at least one of: background material, dressing material.
Optionally, the apparatus further comprises:
a first obtaining module, configured to obtain a reference file, where the reference file includes at least one of: images, videos;
and the generating module is used for generating a replacing material according to the reference file.
Optionally, in a case that the first information is audio information, the apparatus further includes:
the second acquisition module is used for acquiring audio information;
the second display module is used for displaying at least one drum point of the audio information;
and the determining module is used for determining a target video image frame in the video to be processed according to the at least one drum point.
Optionally, the apparatus further comprises:
the third display module is used for displaying at least one mark at the corresponding position of the at least one drum point;
the second receiving module is used for receiving second input of a target identifier in the at least one identifier from a user;
the third receiving module is used for receiving a third input of a target replacing material in the replacing materials from a user;
and the second replacement module is used for responding to the second input and the third input, and performing replacement processing on a target area of a first target video image frame according to the target replacement material, wherein the first target video image frame is a target video image frame corresponding to the target identifier.
In the embodiment of the application, the replacement materials can be independently determined by a user by displaying the video to be processed and the replacement materials, and the replacement materials are used for replacing the target area in the target video image frame in the video to be processed, so that the automatic clipping of the video to be processed is realized, the shooting cost of the video is reduced, the video clipping efficiency is improved, and the video clipping difficulty is reduced.
The video processing apparatus in the embodiment of the present application may be an apparatus, or may be a component, an integrated circuit, or a chip in a terminal. The device can be mobile electronic equipment or non-mobile electronic equipment. By way of example, the mobile electronic device may be a mobile phone, a tablet computer, a notebook computer, a palm top computer, a vehicle-mounted electronic device, a wearable device, an ultra-mobile personal computer (UMPC), a netbook or a Personal Digital Assistant (PDA), and the like, and the non-mobile electronic device may be a Personal Computer (PC), a Television (TV), a teller machine, a self-service machine, and the like, and the embodiments of the present application are not particularly limited.
The video processing apparatus in the embodiment of the present application may be an apparatus having an operating system. The operating system may be an Android operating system (Android), an iOS operating system, or other possible operating systems, which is not specifically limited in the embodiments of the present application.
The video processing apparatus provided in the embodiment of the present application can implement each process implemented by the method embodiments of fig. 1 to fig. 5, achieve the same technical effect, and is not described herein again to avoid repetition.
Optionally, as shown in fig. 7, an electronic device 700 is further provided in this embodiment of the present application, and includes a processor 701, a memory 702, and a program or an instruction stored in the memory 702 and executable on the processor 701, where the program or the instruction is executed by the processor 701 to implement each process of the above-mentioned video processing method embodiment, and can achieve the same technical effect, and no further description is provided here to avoid repetition.
It should be noted that the electronic device in the embodiment of the present application includes the mobile electronic device and the non-mobile electronic device described above.
Fig. 8 is a schematic diagram of a hardware structure of an electronic device implementing an embodiment of the present application.
The electronic device 800 includes, but is not limited to: a radio frequency unit 801, a network module 802, an audio output unit 803, an input unit 804, a sensor 805, a display unit 806, a user input unit 807, an interface unit 808, a memory 809, and a processor 8010.
Those skilled in the art will appreciate that the electronic device 800 may further include a power source (e.g., a battery) for supplying power to the various components, and the power source may be logically connected to the processor 8010 via a power management system, so that the functions of managing charging, discharging, and power consumption may be implemented via the power management system. The electronic device structure shown in fig. 8 does not constitute a limitation of the electronic device, and the electronic device may include more or less components than those shown, or combine some components, or arrange different components, and thus, the description is omitted here.
The display unit 806 is configured to display the video to be processed and the replacement material;
a user input unit 807 for receiving a first input by a user;
the processor 8010 is configured to, in response to the first input, perform replacement processing on a target area of a target video image frame in the to-be-processed video according to the replacement material to obtain a target video;
wherein the target video image frame is determined from first information comprising at least one of: audio information, subtitle information, voice information, motion information of a target object in a video image frame, the target region being determined from the replacement material.
In the embodiment of the application, the replacement materials can be independently determined by a user by displaying the video to be processed and the replacement materials, and the replacement materials are used for replacing the target area in the target video image frame in the video to be processed, so that the automatic clipping of the video to be processed is realized, the shooting cost of the video is reduced, the video clipping efficiency is improved, and the video clipping difficulty is reduced.
Optionally, the replacement material comprises at least one of: background material, dressing material.
Optionally, the processor 8010 is further configured to obtain a reference file, the reference file comprising at least one of: images, videos;
and generating a replacement material according to the reference file.
Optionally, in a case that the first information is audio information, the processor 8010 is further configured to obtain the audio information;
a display unit 806, further configured to display at least one drum point of the audio information;
the processor 8010 is further configured to determine a target video image frame in the video to be processed according to the at least one drum point.
Optionally, the display unit 806 is further configured to display at least one identifier at a corresponding position of the at least one drum point;
a user input unit 807 for receiving a second input of a target identifier of the at least one identifier by a user;
a user input unit 807 for receiving a third input of a target one of the replacement materials by a user;
the processor 8010 is further configured to, in response to the second input and the third input, perform replacement processing on a target area of a first target video image frame according to the target replacement material, where the first target video image frame is a target video image frame corresponding to the target identifier.
In the embodiment of the application, the replacement materials can be independently determined by a user by displaying the video to be processed and the replacement materials, and the replacement materials are used for replacing the target area in the target video image frame in the video to be processed, so that the automatic clipping of the video to be processed is realized, the shooting cost of the video is reduced, the video clipping efficiency is improved, and the video clipping difficulty is reduced.
It should be understood that in the embodiment of the present application, the input Unit 804 may include a Graphics Processing Unit (GPU) 8041 and a microphone 8042, and the Graphics Processing Unit 8041 processes image data of a still picture or a video obtained by an image capturing device (such as a camera) in a video capturing mode or an image capturing mode. The display unit 806 may include a display panel 8061, and the display panel 8061 may be configured in the form of a liquid crystal display, an organic light emitting diode, or the like. The user input unit 807 includes a touch panel 8071 and other input devices 8072. A touch panel 8071, also referred to as a touch screen. The touch panel 8071 may include two portions of a touch detection device and a touch controller. Other input devices 8072 may include, but are not limited to, a physical keyboard, function keys (e.g., volume control keys, switch keys, etc.), a trackball, a mouse, and a joystick, which are not described in detail herein. The memory 809 may be used to store software programs as well as various data including, but not limited to, application programs and operating systems. The processor 8010 may integrate an application processor that handles primarily the operating system, user interface, and applications, etc., and a modem processor that handles primarily wireless communications. It will be appreciated that the modem processor described above may not be integrated into the processor 8010.
The embodiments of the present application further provide a readable storage medium, where a program or an instruction is stored on the readable storage medium, and when the program or the instruction is executed by a processor, the program or the instruction implements each process of the video processing method embodiment, and can achieve the same technical effect, and in order to avoid repetition, details are not repeated here.
The processor is the processor in the electronic device described in the above embodiment. The readable storage medium includes a computer readable storage medium, such as a Read-Only Memory (ROM), a Random Access Memory (RAM), a magnetic disk or an optical disk, and so on.
The embodiment of the present application further provides a chip, where the chip includes a processor and a communication interface, the communication interface is coupled to the processor, and the processor is configured to run a program or an instruction to implement each process of the above video processing method embodiment, and can achieve the same technical effect, and the details are not repeated here to avoid repetition.
It should be understood that the chips mentioned in the embodiments of the present application may also be referred to as system-on-chip, system-on-chip or system-on-chip, etc.
It should be noted that, in this document, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising an … …" does not exclude the presence of other like elements in a process, method, article, or apparatus that comprises the element. Further, it should be noted that the scope of the methods and apparatus of the embodiments of the present application is not limited to performing the functions in the order illustrated or discussed, but may include performing the functions in a substantially simultaneous manner or in a reverse order based on the functions involved, e.g., the methods described may be performed in an order different than that described, and various steps may be added, omitted, or combined. In addition, features described with reference to certain examples may be combined in other examples.
Through the above description of the embodiments, those skilled in the art will clearly understand that the method of the above embodiments can be implemented by software plus a necessary general hardware platform, and certainly can also be implemented by hardware, but in many cases, the former is a better implementation manner. Based on such understanding, the technical solutions of the present application may be embodied in the form of a computer software product, which is stored in a storage medium (such as ROM/RAM, magnetic disk, optical disk) and includes instructions for enabling a terminal (such as a mobile phone, a computer, a server, or a network device) to execute the method according to the embodiments of the present application.
While the present embodiments have been described with reference to the accompanying drawings, it is to be understood that the invention is not limited to the precise embodiments described above, which are meant to be illustrative and not restrictive, and that various changes may be made therein by those skilled in the art without departing from the spirit and scope of the invention as defined by the appended claims.
Claims (10)
1. A video processing method, comprising:
displaying a video to be processed and a replacement material;
receiving a first input of a user;
responding to the first input, and replacing a target area of a target video image frame in the video to be processed according to the replacement material to obtain a target video;
wherein the target video image frame is determined from first information comprising at least one of: audio information, subtitle information, voice information, motion information of a target object in a video image frame, the target region being determined from the replacement material.
2. The video processing method of claim 1, wherein the replacement material comprises at least one of: background material, dressing material.
3. The video processing method of claim 1, wherein prior to displaying the replacement material, further comprising:
obtaining a reference file, the reference file comprising at least one of: images, videos;
and generating a replacement material according to the reference file.
4. The video processing method according to claim 1, wherein in a case where the first information is audio information, before performing replacement processing on a target area of a target video image frame in the video to be processed according to the replacement material, the method further comprises:
acquiring audio information;
displaying at least one drum point of the audio information;
and determining a target video image frame in the video to be processed according to the at least one drum point.
5. The video processing method according to claim 4, wherein before performing replacement processing on the target area of the target video image frame in the video to be processed according to the replacement material, the method further comprises:
displaying at least one mark at a corresponding position of the at least one drum point;
receiving a second input of a target identifier in the at least one identifier from a user;
receiving a third input of a user to a target replacement material in the replacement materials;
and responding to the second input and the third input, and replacing a target area of a first target video image frame according to the target replacement material, wherein the first target video image frame is a target video image frame corresponding to the target identification.
6. A video processing apparatus, comprising:
the first display module is used for displaying the video to be processed and the replacement material;
the first receiving module is used for receiving a first input of a user;
the first replacement module is used for responding to the first input and performing replacement processing on a target area of a target video image frame in the video to be processed according to the replacement material to obtain a target video;
wherein the target video image frame is determined from first information comprising at least one of: audio information, subtitle information, voice information, motion information of a target object in a video image frame, the target region being determined from the replacement material.
7. The video processing apparatus of claim 6, wherein the replacement material comprises at least one of: background material, dressing material.
8. The video processing apparatus according to claim 6, further comprising:
a first obtaining module, configured to obtain a reference file, where the reference file includes at least one of: images, videos;
and the generating module is used for generating a replacing material according to the reference file.
9. The video processing apparatus according to claim 6, wherein in a case where the first information is audio information, the apparatus further comprises:
the second acquisition module is used for acquiring audio information;
the second display module is used for displaying at least one drum point of the audio information;
and the determining module is used for determining a target video image frame in the video to be processed according to the at least one drum point.
10. An electronic device comprising a processor, a memory, and a program or instructions stored on the memory and executable on the processor, the program or instructions when executed by the processor implementing the steps of the video processing method according to any one of claims 1 to 5.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202111393304.5A CN114040248A (en) | 2021-11-23 | 2021-11-23 | Video processing method and device and electronic equipment |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202111393304.5A CN114040248A (en) | 2021-11-23 | 2021-11-23 | Video processing method and device and electronic equipment |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN114040248A true CN114040248A (en) | 2022-02-11 |
Family
ID=80138482
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202111393304.5A Pending CN114040248A (en) | 2021-11-23 | 2021-11-23 | Video processing method and device and electronic equipment |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN114040248A (en) |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN115119054A (en) * | 2022-06-27 | 2022-09-27 | 平安银行股份有限公司 | Video virtual dressing and background processing method and device based on IOS (input/output system) |
| CN115396507A (en) * | 2022-08-29 | 2022-11-25 | 北京有竹居网络技术有限公司 | Material processing method and device, electronic equipment and readable storage medium |
Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20040049780A1 (en) * | 2002-09-10 | 2004-03-11 | Jeanette Gee | System, method, and computer program product for selective replacement of objectionable program content with less-objectionable content |
| CN108737891A (en) * | 2017-04-19 | 2018-11-02 | 合信息技术（北京）有限公司 | Video material processing method and processing device |
| CN109819313A (en) * | 2019-01-10 | 2019-05-28 | 腾讯科技（深圳）有限公司 | Method for processing video frequency, device and storage medium |
| CN110381371A (en) * | 2019-07-30 | 2019-10-25 | 维沃移动通信有限公司 | A kind of video clipping method and electronic equipment |
| CN111050203A (en) * | 2019-12-06 | 2020-04-21 | 腾讯科技（深圳）有限公司 | Video processing method and device, video processing equipment and storage medium |
| CN111739128A (en) * | 2020-07-29 | 2020-10-02 | 广州筷子信息科技有限公司 | Target video generation method and system |
| CN111835982A (en) * | 2020-07-02 | 2020-10-27 | 维沃移动通信有限公司 | Image acquisition method, image acquisition device, electronic device, and storage medium |
| WO2021114552A1 (en) * | 2019-12-11 | 2021-06-17 | 北京市商汤科技开发有限公司 | Information processing method and apparatus, electronic device and storage medium |
-
2021
- 2021-11-23 CN CN202111393304.5A patent/CN114040248A/en active Pending
Patent Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20040049780A1 (en) * | 2002-09-10 | 2004-03-11 | Jeanette Gee | System, method, and computer program product for selective replacement of objectionable program content with less-objectionable content |
| CN108737891A (en) * | 2017-04-19 | 2018-11-02 | 合信息技术（北京）有限公司 | Video material processing method and processing device |
| CN109819313A (en) * | 2019-01-10 | 2019-05-28 | 腾讯科技（深圳）有限公司 | Method for processing video frequency, device and storage medium |
| CN110381371A (en) * | 2019-07-30 | 2019-10-25 | 维沃移动通信有限公司 | A kind of video clipping method and electronic equipment |
| CN111050203A (en) * | 2019-12-06 | 2020-04-21 | 腾讯科技（深圳）有限公司 | Video processing method and device, video processing equipment and storage medium |
| WO2021114552A1 (en) * | 2019-12-11 | 2021-06-17 | 北京市商汤科技开发有限公司 | Information processing method and apparatus, electronic device and storage medium |
| CN111835982A (en) * | 2020-07-02 | 2020-10-27 | 维沃移动通信有限公司 | Image acquisition method, image acquisition device, electronic device, and storage medium |
| CN111739128A (en) * | 2020-07-29 | 2020-10-02 | 广州筷子信息科技有限公司 | Target video generation method and system |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN115119054A (en) * | 2022-06-27 | 2022-09-27 | 平安银行股份有限公司 | Video virtual dressing and background processing method and device based on IOS (input/output system) |
| CN115396507A (en) * | 2022-08-29 | 2022-11-25 | 北京有竹居网络技术有限公司 | Material processing method and device, electronic equipment and readable storage medium |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN111612873B (en) | GIF picture generation method and device and electronic equipment | |
| CN114040248A (en) | Video processing method and device and electronic equipment | |
| CN113596555B (en) | Video playing method and device and electronic equipment | |
| CN112860163A (en) | Image editing method and device | |
| CN111857460A (en) | Split screen processing method, split screen processing device, electronic equipment and readable storage medium | |
| CN112486444A (en) | Screen projection method, device, equipment and readable storage medium | |
| CN112269522A (en) | Image processing method, image processing device, electronic equipment and readable storage medium | |
| CN112306347A (en) | Image editing method, image editing device and electronic equipment | |
| CN112672061A (en) | Video shooting method and device, electronic equipment and medium | |
| CN112449110B (en) | Image processing method and device and electronic equipment | |
| CN112929494B (en) | Information processing method, information processing apparatus, information processing medium, and electronic device | |
| CN112734661A (en) | Image processing method and device | |
| CN111954076A (en) | Resource display method and device and electronic equipment | |
| CN112286616A (en) | Dynamic wallpaper setting method and device and electronic equipment | |
| CN112214774A (en) | Permission setting method, file playing method and device and electronic equipment | |
| CN112367487B (en) | Video recording method and electronic equipment | |
| CN114845171A (en) | Video editing method and device and electronic equipment | |
| CN114245193A (en) | Display control method and device and electronic equipment | |
| CN113986080A (en) | Multimedia file editing method and device and electronic equipment | |
| CN113868269A (en) | Screenshot method and device, electronic equipment and readable storage medium | |
| CN113190365A (en) | Information processing method and device and electronic equipment | |
| CN112887780A (en) | Video name display method and device | |
| CN113747230A (en) | Audio and video processing method and device, electronic equipment and readable storage medium | |
| CN112261483A (en) | Video output method and device | |
| CN112307238A (en) | Image management method and device and electronic equipment |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |