CN109151568B - Video processing method and related product - Google Patents
Video processing method and related product Download PDFInfo
- Publication number
- CN109151568B CN109151568B CN201810754804.9A CN201810754804A CN109151568B CN 109151568 B CN109151568 B CN 109151568B CN 201810754804 A CN201810754804 A CN 201810754804A CN 109151568 B CN109151568 B CN 109151568B
- Authority
- CN
- China
- Prior art keywords
- image
- video
- images
- target
- recall
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/47—End-user applications
- H04N21/472—End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content
- H04N21/47202—End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content for requesting content on demand, e.g. video on demand
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/44—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream, rendering scenes according to MPEG-4 scene graphs
- H04N21/44004—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream, rendering scenes according to MPEG-4 scene graphs involving video buffer management, e.g. video decoder buffer or video display buffer
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/47—End-user applications
- H04N21/485—End-user interface for client configuration
Abstract
The embodiment of the application discloses a video processing method and a related product, wherein the method comprises the following steps: if a memory video sharing request aiming at the third-party application is received, jumping to a memory video management page; if an editing instruction for a first recall video displayed in the recall video management page is received, editing the first recall video according to the editing instruction to obtain a second recall video; and uploading the second recall video. By the adoption of the method and the device, the editable recall video can be shared in the third-party application, and user experience is improved.
Description
Technical Field
The application relates to the technical field of electronic equipment, and mainly relates to a video processing method and a related product.
Background
With the development of electronic device technology, more and more users use electronic devices (such as mobile phones, tablet computers, and the like) to capture images. By means of shooting images or videos, the time, the place, the people, the scenery and the like corresponding to the current scene can be recorded. The information is recorded in the form of the image or the video, and the recall video is generated according to the image or the video, so that a user can conveniently recall corresponding scenes or share the scenes with friends in the social network according to the image displayed in the recall video.
Disclosure of Invention
The embodiment of the application provides a video processing method and a related product, which can be used for sharing editable recall videos in third-party application and improving user experience.
In a first aspect, an embodiment of the present application provides a video processing method, including:
if a memory video sharing request aiming at the third-party application is received, jumping to a memory video management page;
if an editing instruction for a first recall video displayed in the recall video management page is received, editing the first recall video according to the editing instruction to obtain a second recall video;
and uploading the second recall video.
In a second aspect, an embodiment of the present application provides a video processing apparatus, including:
the skipping unit is used for skipping to a recall video management page if a recall video sharing request aiming at the third-party application is received;
the editing unit is used for editing the first recall video according to an editing instruction if the editing instruction for the first recall video displayed in the recall video management page is received, so as to obtain a second recall video;
and the uploading unit is used for uploading the second recall video.
In a third aspect, an embodiment of the present application provides an electronic device, including a processor, a memory, and one or more programs, where the one or more programs are stored in the memory and configured to be executed by the processor, and the program includes instructions for some or all of the steps described in the first aspect.
In a fourth aspect, the present application provides a computer-readable storage medium, where the computer-readable storage medium stores a computer program, where the computer program makes a computer perform some or all of the steps as described in the first aspect of the present application.
In a fifth aspect, embodiments of the present application provide a computer program product, where the computer program product comprises a non-transitory computer-readable storage medium storing a computer program, the computer program being operable to cause a computer to perform some or all of the steps as described in the first aspect of embodiments of the present application. The computer program product may be a software installation package.
The embodiment of the application has the following beneficial effects:
after the video processing method and the related products are adopted, if the electronic equipment receives a memory video sharing request aiming at a third-party application, the electronic equipment jumps to a memory video management page, and if an editing instruction aiming at a first memory video displayed in the memory video management page is received, the electronic equipment carries out editing operation on the first memory video according to the editing instruction to obtain a second memory video and uploads the second memory video. Therefore, the editable recall video can be shared in the third-party application, and the user experience is improved.
Drawings
In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the drawings used in the description of the embodiments or the prior art will be briefly described below, it is obvious that the drawings in the following description are only some embodiments of the present application, and for those skilled in the art, other drawings can be obtained according to the drawings without creative efforts.
Wherein:
fig. 1A is a schematic flowchart of a video processing method according to an embodiment of the present disclosure;
fig. 1B is a schematic diagram of a recall video management page according to an embodiment of the present application;
fig. 2 is a schematic flowchart of another video processing method according to an embodiment of the present application;
fig. 3 is a schematic flowchart of another video processing method according to an embodiment of the present application;
fig. 4 is a schematic structural diagram of a video processing apparatus according to an embodiment of the present application;
fig. 5 is a schematic structural diagram of an electronic device according to an embodiment of the present application.
Detailed Description
In order to make the technical solutions of the present application better understood, the technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the drawings in the embodiments of the present application, and it is obvious that the described embodiments are only a part of the embodiments of the present application, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present application.
The terms "first," "second," and the like in the description and claims of the present application and in the above-described drawings are used for distinguishing between different objects and not for describing a particular order. Furthermore, the terms "include" and "have," as well as any variations thereof, are intended to cover non-exclusive inclusions. For example, a process, method, system, article, or apparatus that comprises a list of steps or elements is not limited to only those steps or elements listed, but may alternatively include other steps or elements not listed, or inherent to such process, method, article, or apparatus.
Reference herein to "an embodiment" means that a particular feature, structure, or characteristic described in connection with the embodiment can be included in at least one embodiment of the application. The appearances of the phrase in various places in the specification are not necessarily all referring to the same embodiment, nor are separate or alternative embodiments mutually exclusive of other embodiments. It is explicitly and implicitly understood by one skilled in the art that the embodiments described herein can be combined with other embodiments.
The electronic devices involved in the embodiments of the present application may include various handheld devices, vehicle-mounted devices, wearable devices, computing devices or other processing devices connected to a wireless modem with wireless communication functions, as well as various forms of User Equipment (UE), Mobile Stations (MS), terminal equipment (terminal device), and so on. For convenience of description, the above-mentioned devices are collectively referred to as electronic devices. The following describes embodiments of the present application in detail.
The embodiment of the application provides a video processing method and a related product, which can be used for sharing editable recall videos in third-party application and improving user experience.
Referring to fig. 1A, an embodiment of the present application provides a flow chart illustrating a video processing method. Specifically, as shown in fig. 1A, a video processing method includes:
s101: and if a memory video sharing request aiming at the third-party application is received, jumping to a memory video management page.
In the embodiment of the application, the electronic device classifies images or videos stored in an album in advance according to topics such as time, places, people and scenery to obtain recall atlas sets of different topics, and then generates the recall videos according to the recall atlas sets of different topics and corresponding preset playing strategies. If one of the images or videos meets a plurality of topics, the image or video can be stored in the recall atlas corresponding to the corresponding topic, that is, the images or videos are included in the plurality of topics.
The preset playing strategy comprises first configuration information and second configuration information, wherein the first configuration information comprises the following configuration information aiming at the target pictures: the second configuration information comprises the following configuration information aiming at each image: animation mode and display duration.
It should be noted that the recall video does not occupy the actual storage space, and is a file in a non-video format, similar to a slide. And recall that the atlas may include video in addition to images.
If the recall atlas contains a video, one or more frames of images in the video are extracted when the recall video is generated, so that the playing time is shortened. The method for extracting the image frame is not limited, the image frame can be extracted at intervals of a preset time length, the image frame can be extracted according to the image content of the image frame, and the like, so that the accuracy of image extraction can be improved, and the browsing experience of a user is improved.
The method for selecting the image or the video to obtain the recall atlas is not limited, and the evaluation value of the image or the video may be obtained and selected according to the evaluation value, where the evaluation dimension of the evaluation value may include color, exposure, definition, beauty effect, and the like, or may include the number of clicks by the user, the number of shares, whether the image or the video in the preference atlas is the image or the video in the preference atlas, or may be the number of praise obtained after the user uploads the image or the video to the social network, the evaluation information of the comment area, and the like, and is not limited herein.
In addition to the electronic device synthesizing the recall video according to the theme, the user may synthesize the recall video from a plurality of images or videos in the selected album, or delete or add images or videos in the recall video.
The editing operation of the recall video is not limited, and fig. 1B is a schematic diagram of a recall video management page provided by the application, and as shown in the left side of fig. 1B, the recall video management page can be returned to an image management page through a return component C7 in the recall video management page; the recall video can also be selected through a selection component C1 in the recall video management page, and then after the recall video management page is shown on the right, after the first recall video P1 is selected, a corresponding selection component C2 shows a 'check' and the non-selected selection components of the second recall video P2 and the third recall video P3 show no 'check', and the first recall video P1 corresponding to the selection operation can be deleted through a deletion component C3 in the recall video management page, or sent to friends or shared with social media through a sending component C4 in the recall video management page; the memory-back video may also be set, that is, the play parameters such as the total play duration, the play object of each image, the background music, the theme style, the cover image, the title content, etc., and the selected memory-back video may also be fused by the fusing component C5, or the selected memory-back video may be cancelled by the cancelling component C6, which is not limited herein.
In the embodiment of the present application, the third-party application is not limited, and may be an instant chat application, a social sharing application, an application including a video sharing plug-in, and the like.
The album management page displays photos and videos stored in the electronic device, and can perform functions of editing, deleting, sending, transferring and storing folders and the like on a selected object. The album management page includes a plurality of sub management pages, for example: an image management page, a recall video management page, a sharing management page, and the like.
The memory video management page displays a memory video generated in the electronic device, namely, when a target memory video is selected, the target memory video can be edited, deleted, sent, transferred to a storage folder and the like.
The memory video sharing request is used for indicating the electronic equipment to jump to a memory video management page, so that the memory video in the memory video sharing request is selected to be shared or cancelled. The method for sending the recall video sharing request is not limited, a functional component special for sharing the recall video can be arranged in a third-party application, and if a user selects the recall video sharing component, the user jumps to a recall video management page; or a third-party application can be adopted to share the components of the photos and the videos, if the user selects the components for sharing the photos and the videos, the user jumps to an album management page, and then selects a recall video management page from the album management page.
That is to say, when the electronic device runs the third-party application, if the electronic device receives a recall video sharing request sent by the user and jumps to a recall video management page, the user can search for a recall video to be shared on the recall video management page.
Optionally, the method further includes: if a return instruction aiming at the recall video management page is received, jumping to an image management page; if a selection instruction aiming at a plurality of designated images and designated videos displayed in the image management page is received, analyzing the designated videos into a plurality of frames of images; selecting at least one first image from the multiple frames of images; generating the first recall video according to a preset playing strategy, the designated images and the at least one frame of first image; and displaying the first recall video on the recall video management page.
In an alternative embodiment, the return instruction is used to instruct the electronic device to return to a page higher than the recall video management page, i.e., an image management page. The receiving method of the return instruction is not limited, and as shown in the left side of fig. 1B, if the touch operation of the user on the return component C7 is detected on the touch display screen of the electronic device, then the return instruction is generated and returned to the image management page.
The selection instruction is used for instructing the electronic device to combine the plurality of designated images and the designated video into the first recall video, and a receiving method of the return instruction is not limited, as shown in fig. 1B, a touch operation of a user on a selection component C1 may be detected on a touch display screen of the electronic device, then a touch operation of the user on a sending component C4 is detected, and then the selection instruction is generated, so that generation of the recall video corresponding to the plurality of designated images and the designated video is realized.
Parsing the designated video may use ffmpeg technology to divide the designated video into multiple frames of images, which is not limited herein. The method for selecting the first image from the multi-frame images is not limited, and discontinuous images can be selected from the multi-frame images as the first image; the selection can also be carried out according to time intervals or image types; it is also possible to acquire an image evaluation value of a plurality of frame images, and then take an image whose image evaluation value is larger than an evaluation threshold value as a first image, and so on.
In one example, the selecting at least one first image from the plurality of frames of images comprises: acquiring an image evaluation value of each image in the multi-frame images to obtain a plurality of image evaluation values; dividing the multi-frame image to obtain a plurality of image sets; determining an image corresponding to the maximum image evaluation value of each image set in the plurality of image sets according to the plurality of image evaluation values to obtain a plurality of second images; obtaining the similarity between each second image in the second images and each appointed image in the appointed images to obtain a plurality of similarity sets, wherein each similarity set corresponds to one second image; searching a similarity set of which each similarity is smaller than a similarity threshold in the plurality of similarity sets to obtain at least one target similarity set; and taking the image corresponding to the at least one target similarity set as the at least one first frame image.
In the application, the method for obtaining the image evaluation value is not limited, and multiple evaluation dimensions may be preset, each evaluation dimension corresponds to a preset weight, wherein the sum of the scoring weights corresponding to each dimension in the multiple dimensions is 1, and the scoring weights may be set or recommended according to the influence parameters of the image evaluation value. The evaluation value corresponding to each evaluation dimension is respectively obtained, and the image evaluation value is obtained by weighting and calculating the evaluation value corresponding to the evaluation dimension and the preset weight, so that the image is evaluated from multiple aspects, and the accuracy of determining the image evaluation value can be improved.
In an alternative embodiment, the evaluation dimensions for different image types may be preset, for example: a landscape type image whose evaluation dimensions are color, exposure, sharpness; an image of a person type whose evaluation dimension is color, focus, exposure, sharpness, and/or beauty effect; and a gourmet-type image whose evaluation dimension is color, exposure, sharpness, and/or beauty effect.
For example, if the multi-frame image includes a reference image and the image type of the reference image is a landscape type, assuming that the color evaluation weight is 0.3, the exposure evaluation weight is 0.2, and the sharpness evaluation weight is 0.5, when the color evaluation value is 80, the exposure evaluation value is 60, and the sharpness evaluation value is 80, the image evaluation value of the reference image is 76.
In addition, the image evaluation value can also obtain the evaluation value of the preset image evaluation algorithm to the reference image, the evaluation values of a plurality of objects such as users or friends uploaded to the social network to the reference image, different evaluation values are obtained due to different senses of different objects to image effects, the average value of the evaluation values corresponding to the reference image can be used as the image evaluation value of the reference image, and the evaluation values can be weighted according to the weights corresponding to different evaluation types to obtain the image evaluation value of the reference image, so that the accuracy of determining the image evaluation value is improved.
The method for dividing the image set is not limited, and the image set may be divided according to time, for example, if 2s is a time point, the multiple frames of images are arranged according to the time sequence, and the multiple image sets are divided from the earliest frame of image, the time interval of each image set is 2 s; and the images can be divided according to image types, so that an image set corresponding to the types of the group photo, the single person, the landscape, the food and the like is obtained.
The method for obtaining the similarity is not limited, and a similarity detection method can be carried out by referring to a histogram, Euclidean distance, a perceptual Hash value algorithm and the like; in the present application, a similarity threshold may be preset, that is, when the similarity between two images is smaller than the similarity threshold, the two images are determined to be dissimilar images.
It can be understood that the electronic device first obtains an image evaluation value of each image in multiple frames of images, divides the multiple frames of images to obtain multiple image sets, then selects an image corresponding to the maximum image evaluation value in each image set as a second image, then obtains a similarity between the second image and each designated image in the multiple designated images to obtain a similarity set corresponding to the second image, and if the similarities in the similarity sets are all smaller than a similarity threshold, determines that the second image corresponding to the similarity is at least one frame of the first image. Therefore, the plurality of second images are selected from the appointed video according to the image evaluation value, the image quality of the selected second images is improved, and at least one frame of first image is selected from the plurality of second images according to the similarity between the first image and the plurality of appointed images, so that the user is prevented from browsing similar images, and the user experience is improved.
In an alternative embodiment, the preset playing policy may refer to the description in step S101, and is not described herein again. It can be understood that if a user does not want to share a generated recall video in the electronic device, a return instruction for a recall video management page is sent, the user jumps to an image management page, then a selection instruction for a plurality of designated images and a designated video is sent, a first recall video is generated by a preset playing strategy, the plurality of designated images and at least one frame of first image extracted from the designated video, and the first recall video is displayed on the recall video management page, so that an editable first recall video is obtained. Thus, the flexibility of user selection is improved.
It should be noted that, in the embodiment of the present application, a plurality of designated images and a designated video are taken as an example for description, and if the selection instruction corresponds to the plurality of images, a first recall video is directly generated according to a preset play policy; if the selection instruction corresponds to a plurality of videos, referring to the method provided by the application, each video in the plurality of videos is analyzed to obtain a plurality of frames of images, at least one frame of first image, namely a plurality of frames of first images, is selected for the plurality of videos from the plurality of frames of images, and then a first recall video is generated according to a preset playing strategy and the plurality of frames of first images; if the selection instruction corresponds to the plurality of images and the plurality of videos, according to the method, the first recall video is generated according to the preset playing strategy, the plurality of images and the plurality of videos, so that the flexibility of user selection is improved, and the user experience is improved.
S102: and if an editing instruction aiming at a first recall video displayed in the recall video management page is received, editing the first recall video according to the editing instruction to obtain a second recall video.
In this embodiment of the application, the editing instruction is used to perform an editing operation on the first recall video, and the description in step S101 may be referred to for the editing operation of the first recall video, which is not described herein again.
That is to say, the editing instruction includes a plurality of target images corresponding to the first recall video and a target playback policy corresponding to the plurality of target images, where: the target play strategy includes, but is not limited to, one of the following: the video playing method comprises the following steps of video playing total time, playing sequence, title, cover, theme, video background music, animation mode of each target image and display time.
Optionally, the obtaining a second recall video by performing an editing operation on the first recall video according to the editing instruction includes: determining a plurality of target images corresponding to the first recall video and a target playing strategy corresponding to the plurality of target images according to the editing instruction; compressing the target images to obtain compressed images; and generating the second recall video according to the plurality of compressed images and the target playing strategy.
In an optional embodiment, the method for compressing the plurality of target images is not limited, and a screenshot of each target image can be acquired; a plurality of target images can be spliced on one compressed image; each target image may also be compressed according to a preset compression policy (e.g., reducing resolution, cropping images or filling pixels, etc.), and so on. By compressing the plurality of target images, the memory size of the second recall video can be reduced, so that the flow consumption is reduced, and the buffer speed for playing the second recall video is increased.
In one example, if the target playing policy includes a total video playing duration and video background music, the compressing the target images to obtain a plurality of compressed images includes: extracting a target video background music fragment in the video background music according to the total video playing duration; determining the target memory size of the target video background music fragment; taking the difference value between the pre-stored limited memory size and the target memory size as the residual memory size; taking the ratio of the residual memory size to the number of the target images as the average memory size; and compressing each target image in the plurality of target images according to the average memory size to obtain the plurality of compressed images.
In the application, the method for extracting the target video background music segment is not limited, the song title part, the climax part and the like in the video background music can be extracted when the playing time of the video background music is longer than the total video playing time, and the video background music can be played circularly or the song title part and the climax part in the video background music can be overlapped and the like when the playing time of the video background music is shorter than or equal to the total video playing time, so that the effectiveness of music playing is improved.
The memory size is limited to the memory size of the third-party application for limiting the uploading of the file, so that the network speed and the cache space occupied by the third-party application can be reduced, the flow consumption is reduced, and the buffer speed for playing the second recall video is increased.
It can be understood that the electronic device extracts the target video background music segments in the video background music according to the total video playing time, so that the music playing effectiveness can be improved. And then determining the target memory size of the target video background music fragment, taking the difference value between the pre-stored limited memory size and the target memory size as the residual memory size, taking the ratio between the residual memory size and the number of the multiple target images as the average memory size, and compressing each target image in the multiple target images according to the average memory size to obtain multiple compressed images. Therefore, the average memory size of each target image obtained through calculation is used for compressing the long target image, the memory size of the second recall video generated by a plurality of compressed images can be reduced, the network speed and the cache space uploaded to a third party application are reduced, and the buffer speed for playing the second recall video is improved.
In an optional embodiment, the step of generating the first recall video may be referred to for the description of generating the second recall video according to the target play policy and the plurality of compressed images, and is not described herein again.
It can be understood that the electronic device determines a plurality of target images corresponding to the first recall video and a plurality of target playing strategies corresponding to the plurality of target images according to the editing instruction, then compresses the plurality of target images to obtain a plurality of compressed images, generates a second recall video according to the plurality of compressed images and the target playing strategies, and then uploads the second recall video. Therefore, the network speed and the cache space uploaded to the third-party application can be reduced, the buffer speed for playing the second recall video is increased, the editable recall video can be shared in the third-party application, and the user experience is improved.
In the application, a second recall video generated by a plurality of target images and a target playing strategy can be uploaded, namely the second recall video plays original images which are not compressed, namely the original images are clearer compared with the compressed images, and therefore the browsing effect of a user is improved.
In the application, after the second recall video is obtained, the first recall video may be updated to the second recall video, or the first recall video and the second recall video may be stored in the recall video management page, which is not limited herein.
S103: and uploading the second recall video.
In this embodiment of the application, the uploading area of the second recall video is not limited, for example: uploading a second recall video on a chat page of the user and the chat object, so that a display component corresponding to the second recall video is displayed in the chat page, and the user and the chat object can browse the second recall video again by searching the chat history; and uploading the second recall video on the social network sharing page of the user, so that the user and friends in the social network can view display components corresponding to the second recall video on the social network page, the user can browse the second recall video again by searching the sharing history record corresponding to the user, and the user can browse the second recall video again by searching the sharing history record corresponding to the user when the friends in the social network have the viewing right of the sharing history record corresponding to the user.
The display component can play the second memory video without background music, namely displaying preview images of the second memory video according to the playing sequence; the second recall video may not be played, that is, a cover image of the second recall video and the like are displayed, which is not limited herein. When the display component corresponding to the second recall video is clicked, the second recall video with the background music is played, and therefore the browsing effect of the user is improved.
In the video processing method shown in fig. 1A, if an electronic device receives a recall video sharing request for a third-party application, the electronic device jumps to a recall video management page, and if an editing instruction for a first recall video displayed in the recall video management page is received, the electronic device performs an editing operation on the first recall video according to the editing instruction to obtain a second recall video, and uploads the second recall video. Therefore, the editable recall video can be shared in the third-party application, and the user experience is improved.
Referring to fig. 2, fig. 2 is a schematic flow chart of another video processing method according to an embodiment of the present application, and as shown in fig. 2, the video processing method includes:
s201: and if a memory video sharing request aiming at the third-party application is received, jumping to a memory video management page.
S202: if an editing instruction for a first recall video displayed in the recall video management page is received, determining a plurality of target images corresponding to the first recall video and a target playing strategy corresponding to the plurality of target images according to the editing instruction.
S203: and compressing the target images to obtain compressed images.
Optionally, the target playing policy includes a total video playing duration and video background music, and the compressing the multiple target images to obtain multiple compressed images includes: extracting a target video background music fragment in the video background music according to the total video playing duration; determining the target memory size of the target video background music fragment; taking the difference value between the pre-stored limited memory size and the target memory size as the residual memory size; taking the ratio of the residual memory size to the number of the target images as the average memory size; and compressing each target image in the plurality of target images according to the average memory size to obtain the plurality of compressed images.
It can be understood that the target video background music segment in the video background music is extracted according to the total playing time of the video, so that the effectiveness of music playing can be improved. And then determining the target memory size of the target video background music fragment, taking the difference value between the pre-stored limited memory size and the target memory size as the residual memory size, taking the ratio between the residual memory size and the number of the multiple target images as the average memory size, and compressing each target image in the multiple target images according to the average memory size to obtain multiple compressed images. Therefore, the average memory size of each target image obtained through calculation is used for compressing the long target image, the memory size of the second recall video generated by a plurality of compressed images can be reduced, the network speed and the cache space uploaded to a third party application are reduced, and the cache speed for playing the second recall video is improved.
S204: and generating a second recall video according to the plurality of compressed images and the target playing strategy.
S205: and uploading the second recall video.
In the video processing method shown in fig. 2, if an electronic device receives a recall video sharing request for a third-party application, it jumps to a recall video management page, and if an edit instruction for a first recall video displayed in the recall video management page is received, it determines multiple target images corresponding to the first recall video and target playing strategies corresponding to the multiple target images according to the edit instruction, then compresses the multiple target images to obtain multiple compressed images, generates a second recall video according to the multiple compressed images and the target playing strategies, and then uploads the second recall video. Therefore, the network speed and the cache space uploaded to the third-party application can be reduced, the buffer speed for playing the second recall video is increased, the editable recall video can be shared in the third-party application, and the user experience is improved.
Referring to fig. 3, fig. 3 is a schematic flow chart of another video processing method according to an embodiment of the present application, and as shown in fig. 3, the video processing method includes:
s301: and if a memory video sharing request aiming at the third-party application is received, jumping to a memory video management page.
S302: and if a return instruction aiming at the recall video management page is received, jumping to an image management page.
S303: and if a selection instruction aiming at a plurality of designated images and designated videos displayed in the image management page is received, analyzing the designated videos into a plurality of frames of images.
S304: and selecting at least one first image from the plurality of frames of images.
Optionally, the selecting at least one first image from the multiple frames of images includes: acquiring an image evaluation value of each image in the multi-frame images to obtain a plurality of image evaluation values; dividing the multi-frame image to obtain a plurality of image sets; determining an image corresponding to the maximum image evaluation value of each image set in the plurality of image sets according to the plurality of image evaluation values to obtain a plurality of second images; obtaining the similarity between each second image in the second images and each appointed image in the appointed images to obtain a plurality of similarity sets, wherein each similarity set corresponds to one second image; searching a similarity set of which each similarity is smaller than a similarity threshold in the plurality of similarity sets to obtain at least one target similarity set; and taking the image corresponding to the at least one target similarity set as the at least one first frame image.
It can be understood that an image evaluation value of each image in a plurality of images is obtained, the plurality of images are divided to obtain a plurality of image sets, then an image corresponding to the maximum image evaluation value in each image set is selected as a second image, then the similarity between the second image and each designated image in the plurality of designated images is obtained to obtain a similarity set corresponding to the second image, and if the similarities in the similarity set are all smaller than a similarity threshold, the second image corresponding to the similarity is determined to be at least one first image. Therefore, the plurality of second images are selected from the appointed video according to the image evaluation value, the image quality of the selected second images is improved, and at least one frame of first image is selected from the plurality of second images according to the similarity between the first image and the plurality of appointed images, so that the user is prevented from browsing similar images, and the user experience is improved.
S305: and generating a first recall video according to a preset playing strategy, the designated images and the at least one frame of first image.
S306: and displaying the first recall video on the recall video management page.
S307: and if an editing instruction aiming at the first recall video is received, editing the first recall video according to the editing instruction to obtain a second recall video.
S308: and uploading the second recall video.
In the video processing method shown in fig. 3, if an electronic device receives a recall video sharing request for a third-party application, it jumps to a recall video management page, if a return instruction for the recall video management page is received, it jumps to an image management page, if a selection instruction for a plurality of designated images and a designated video is received, it parses the designated video into a plurality of frames of images, selects at least one frame of first image from the plurality of frames of images, generates a first recall video according to a preset playing policy, the plurality of designated images and the at least one frame of first image extracted from the designated video, and displays the first recall video on the recall video management page, thereby obtaining an editable first recall video. Thus, the flexibility of user selection is improved. And if an editing instruction aiming at a first recall video displayed in the recall video management page is received, editing the first recall video according to the editing instruction to obtain a second recall video, and uploading the second recall video. Therefore, the editable recall video can be shared in the third-party application, and the user experience is improved.
Referring to fig. 4, fig. 4 is a schematic structural diagram of a video processing apparatus according to an embodiment of the present application, and as shown in fig. 4, the video processing apparatus 400 includes a jumping unit 401, an editing unit 402, and an uploading unit 403, where:
the skipping unit 401 is configured to skip to a recall video management page if a recall video sharing request for a third-party application is received;
an editing unit 402, configured to, if an editing instruction for a first recall video displayed in the recall video management page is received, perform an editing operation on the first recall video according to the editing instruction to obtain a second recall video;
and an uploading unit 403, configured to upload the second recall video.
It can be understood that if a memory video sharing request for a third-party application is received, the skipping unit 401 skips to a memory video management page, and if an editing instruction for a first memory video displayed in the memory video management page is received, the editing unit 402 performs an editing operation on the first memory video according to the editing instruction to obtain a second memory video, and the uploading unit 403 uploads the second memory video. Therefore, the editable recall video can be shared in the third-party application, and the user experience is improved.
In a possible example, in terms of obtaining a second recall video by performing an editing operation on the first recall video according to the editing instruction, the editing unit 402 is specifically configured to determine, according to the editing instruction, a plurality of target images corresponding to the first recall video and target play policies corresponding to the plurality of target images; compressing the target images to obtain compressed images; and generating the second recall video according to the plurality of compressed images and the target playing strategy.
In a possible example, the target playing policy includes a total video playing duration and video background music, and in terms of the compressing the multiple target images to obtain multiple compressed images, the editing unit 402 is specifically configured to extract a target video background music segment in the video background music according to the total video playing duration; determining the target memory size of the target video background music fragment; taking the difference value between the pre-stored limited memory size and the target memory size as the residual memory size; taking the ratio of the size of the residual content to the number of the target images as the average memory size; and compressing each target image in the plurality of target images according to the average memory size to obtain the plurality of compressed images.
In a possible example, the jumping unit 401 is further configured to jump to an image management page if a return instruction for the recall video management page is received;
the apparatus 400 further comprises:
an analyzing unit 404, configured to, if a selection instruction for a plurality of designated images and designated videos displayed in the recall video management page is received, analyze the designated videos into a plurality of frames of images;
a selecting unit 405, configured to select at least one frame of a first image from the multiple frames of images;
a generating unit 406, configured to generate the first recall video according to a preset playing policy, the multiple designated photos, and the at least one frame of first image;
a display unit 407, configured to display the first recall video on the recall video management page.
In one possible example, in the aspect of selecting at least one first image from the multiple images, the selecting unit 405 is specifically configured to obtain an image evaluation value of each image in the multiple images to obtain multiple image evaluation values; dividing the multi-frame image to obtain a plurality of image sets; determining an image corresponding to the maximum image evaluation value of each image set in the plurality of image sets according to the plurality of image evaluation values to obtain a plurality of second images; obtaining the similarity between each second image in the second images and each appointed image in the appointed images to obtain a plurality of similarity sets, wherein each similarity set corresponds to one second image; searching a similarity set of which each similarity is smaller than a similarity threshold in the plurality of similarity sets to obtain at least one target similarity set; and taking the image corresponding to the at least one target similarity set as the at least one first frame image.
Referring to fig. 5, fig. 5 is a schematic structural diagram of an electronic device according to an embodiment of the present disclosure. As shown in fig. 5, the electronic device 500 includes a processor 510, a memory 520, a communication interface 530, and one or more programs 540, wherein the one or more programs 540 are stored in the memory 520 and configured to be executed by the processor 510, and the programs 540 include instructions for:
if a memory video sharing request aiming at the third-party application is received, jumping to a memory video management page;
if an editing instruction for a first recall video displayed in the recall video management page is received, editing the first recall video according to the editing instruction to obtain a second recall video;
and uploading the second recall video.
It can be understood that if the electronic device 500 receives a recall video sharing request for a third-party application, it jumps to a recall video management page, and if an edit instruction for a first recall video displayed in the recall video management page is received, it performs an edit operation on the first recall video according to the edit instruction to obtain a second recall video, and uploads the second recall video. Therefore, the editable recall video can be shared in the third-party application, and the user experience is improved.
In a possible example, in terms of obtaining the second recall video by performing the editing operation on the first recall video according to the editing instruction, the instructions in the program 540 are specifically configured to perform the following operations:
determining a plurality of target images corresponding to the first recall video and a target playing strategy corresponding to the plurality of target images according to the editing instruction;
compressing the target images to obtain compressed images;
and generating the second recall video according to the plurality of compressed images and the target playing strategy.
In one possible example, the target playing policy includes a total playing duration of a video and background music of the video, and in terms of the compressing the multiple target images to obtain multiple compressed images, the instructions in the program 540 are specifically configured to perform the following operations:
extracting a target video background music fragment in the video background music according to the total video playing duration;
determining the target memory size of the target video background music fragment;
taking the difference value between the pre-stored limited memory size and the target memory size as the residual memory size;
taking the ratio of the residual memory size to the number of the target images as the average memory size;
and compressing each target image in the plurality of target images according to the average memory size to obtain the plurality of compressed images.
In one possible example, the instructions in the program 540 are further configured to:
if a return instruction aiming at the recall video management page is received, jumping to an image management page;
if a selection instruction aiming at a plurality of designated images and designated videos displayed in the image management page is received, analyzing the designated videos into a plurality of frames of images;
selecting at least one first image from the multiple frames of images;
generating the first recall video according to a preset playing strategy, the designated images and the at least one frame of first image;
and displaying the first recall video on the recall video management page.
In one possible example, in the aspect of selecting at least one first image from the plurality of images, the instructions in the program 540 are specifically configured to:
acquiring an image evaluation value of each image in the multi-frame images to obtain a plurality of image evaluation values;
dividing the multi-frame image to obtain a plurality of image sets;
determining an image corresponding to the maximum image evaluation value of each image set in the plurality of image sets according to the plurality of image evaluation values to obtain a plurality of second images;
obtaining the similarity between each second image in the second images and each appointed image in the appointed images to obtain a plurality of similarity sets, wherein each similarity set corresponds to one second image;
searching a similarity set of which each similarity is smaller than a similarity threshold in the plurality of similarity sets to obtain at least one target similarity set;
and taking the image corresponding to the at least one target similarity set as the at least one first frame image.
Embodiments of the present application also provide a computer storage medium, where the computer storage medium stores a computer program for causing a computer to execute a part or all of the steps of any one of the methods as described in the method embodiments, and the computer includes an electronic device.
Embodiments of the application also provide a computer program product comprising a non-transitory computer readable storage medium storing a computer program operable to cause a computer to perform some or all of the steps of any of the methods as recited in the method embodiments. The computer program product may be a software installation package and the computer comprises the electronic device.
It should be noted that, for simplicity of description, the above-mentioned method embodiments are described as a series of acts or combination of acts, but those skilled in the art will recognize that the present application is not limited by the order of acts described, as some steps may occur in other orders or concurrently depending on the application. Further, those skilled in the art will also appreciate that the embodiments described in this specification are presently preferred and that no particular act or mode of operation is required in the present application.
In the foregoing embodiments, the descriptions of the respective embodiments have respective emphasis, and for parts that are not described in detail in a certain embodiment, reference may be made to related descriptions of other embodiments.
In the embodiments provided in the present application, it should be understood that the disclosed apparatus may be implemented in other manners. For example, the above-described embodiments of the apparatus are merely illustrative, and for example, a division of a unit is merely a logical division, and an actual implementation may have another division, for example, a plurality of units or components may be combined or integrated into another system, or some features may be omitted, or not executed. In addition, the shown or discussed mutual coupling or direct coupling or communication connection may be an indirect coupling or communication connection of some interfaces, devices or units, and may be an electric or other form.
Units described as separate parts may or may not be physically separate, and parts displayed as units may or may not be physical units, may be located in one place, or may be distributed on a plurality of network units. Some or all of the units can be selected according to actual needs to achieve the purpose of the solution of the embodiment.
In addition, functional units in the embodiments of the present application may be integrated into one processing unit, or each unit may exist alone physically, or two or more units are integrated into one unit. The integrated unit can be realized in a hardware mode or a software program mode.
The integrated unit, if implemented in the form of a software program module and sold or used as a stand-alone product, may be stored in a computer readable memory. Based on such understanding, the technical solution of the present application may be substantially implemented or a part of or all or part of the technical solution contributing to the prior art may be embodied in the form of a software product stored in a memory, and including several instructions for causing a computer device (which may be a personal computer, a server, or a network device) to execute all or part of the steps of the method of the embodiments of the present application. And the aforementioned memory comprises: various media capable of storing program codes, such as a usb disk, a read-only memory (ROM), a Random Access Memory (RAM), a removable hard disk, a magnetic or optical disk, and the like.
Those skilled in the art will appreciate that all or part of the steps in the methods of the above embodiments may be implemented by associated hardware instructed by a program, which may be stored in a computer-readable memory, which may include: flash disk, ROM, RAM, magnetic or optical disk, and the like.
The foregoing detailed description of the embodiments of the present application has been presented to illustrate the principles and implementations of the present application, and the above description of the embodiments is only provided to help understand the method and the core concept of the present application; meanwhile, for a person skilled in the art, according to the idea of the present application, there may be variations in the specific embodiments and application scope, and in summary, the content of the present specification should not be construed as a limitation to the present application.
Claims (10)
1. A video processing method, comprising:
if a memory video sharing request aiming at the third-party application is received, jumping to a memory video management page;
if an editing instruction for a first recall video displayed in the recall video management page is received, editing the first recall video according to the editing instruction to obtain a second recall video, and the method comprises the following steps: determining a plurality of target images corresponding to the first recall video and a target playing strategy corresponding to the plurality of target images according to the editing instruction; compressing the target images to obtain compressed images; generating the second recall video according to the plurality of compressed images and the target playing strategy, wherein the target playing strategy comprises an animation mode and a display duration of each target image;
and uploading the second recall video.
2. The method according to claim 1, wherein the target playing strategy further includes a total video playing duration and video background music, and the compressing the plurality of target images to obtain a plurality of compressed images includes:
extracting a target video background music fragment in the video background music according to the total video playing duration;
determining the target memory size of the target video background music fragment;
taking the difference value between the pre-stored limited memory size and the target memory size as the residual memory size;
taking the ratio of the residual memory size to the number of the target images as the average memory size;
and compressing each target image in the plurality of target images according to the average memory size to obtain the plurality of compressed images.
3. The method according to any one of claims 1-2, further comprising:
if a return instruction aiming at the recall video management page is received, jumping to an image management page;
if a selection instruction aiming at a plurality of designated images and designated videos displayed in the image management page is received, analyzing the designated videos into a plurality of frames of images;
selecting at least one first image from the multiple frames of images;
generating the first recall video according to a preset playing strategy, the designated images and the at least one frame of first image;
and displaying the first recall video on the recall video management page.
4. The method according to claim 3, wherein said selecting at least one first image from said plurality of images comprises:
acquiring an image evaluation value of each image in the multi-frame images to obtain a plurality of image evaluation values;
dividing the multi-frame image to obtain a plurality of image sets;
determining an image corresponding to the maximum image evaluation value of each image set in the plurality of image sets according to the plurality of image evaluation values to obtain a plurality of second images;
acquiring the similarity between each second image in the second images and each designated image in the designated images to obtain a plurality of similarity sets, wherein each similarity set corresponds to one second image;
searching a similarity set of which each similarity is smaller than a similarity threshold in the plurality of similarity sets to obtain at least one target similarity set;
and taking the image corresponding to the at least one target similarity set as the at least one first frame image.
5. A video processing apparatus, comprising:
the skipping unit is used for skipping to a recall video management page if a recall video sharing request aiming at the third-party application is received;
the editing unit is used for editing the first recall video according to an editing instruction if the editing instruction for the first recall video displayed in the recall video management page is received, so as to obtain a second recall video;
the uploading unit is used for uploading the second recall video;
in the aspect of editing the first recall video according to the editing instruction to obtain a second recall video, the editing unit is specifically configured to determine, according to the editing instruction, a plurality of target images corresponding to the first recall video and target play strategies corresponding to the plurality of target images; compressing the target images to obtain compressed images; and generating the second recall video according to the plurality of compressed images and the target playing strategy, wherein the target playing strategy comprises an animation mode and a display duration of each target image.
6. The apparatus according to claim 5, wherein the target playback strategy includes a total video playback duration and video background music, and in the aspect of compressing the target images to obtain compressed images, the editing unit is specifically configured to extract target video background music segments in the video background music according to the total video playback duration; determining the target memory size of the target video background music fragment; taking the difference value between the pre-stored limited memory size and the target memory size as the residual memory size; taking the ratio of the residual memory size to the number of the target images as the average memory size; and compressing each target image in the plurality of target images according to the average memory size to obtain the plurality of compressed images.
7. The apparatus according to any one of claims 5 to 6, wherein the jumping unit is further configured to jump to an image management page if a return instruction for the recall video management page is received;
the device further comprises:
the analysis unit is used for analyzing the specified video into a plurality of frames of images if receiving selection instructions aiming at a plurality of specified images and specified videos displayed in the image management page;
the selecting unit is used for selecting at least one frame of first image from the multi-frame images;
the generating unit is used for generating the first recall video according to a preset playing strategy, the designated images and the at least one frame of first image;
and the display unit is used for displaying the first recall video on the recall video management page.
8. The apparatus according to claim 7, wherein in the selecting at least one first image from the plurality of images, the selecting unit is specifically configured to obtain an image evaluation value of each image in the plurality of images, and obtain a plurality of image evaluation values; dividing the multi-frame image to obtain a plurality of image sets; determining an image corresponding to the maximum image evaluation value of each image set in the plurality of image sets according to the plurality of image evaluation values to obtain a plurality of second images; acquiring the similarity between each second image in the second images and each designated image in the designated images to obtain a plurality of similarity sets, wherein each similarity set corresponds to one second image; searching a similarity set of which each similarity is smaller than a similarity threshold in the plurality of similarity sets to obtain at least one target similarity set; and taking the image corresponding to the at least one target similarity set as the at least one first frame image.
9. An electronic device comprising a processor, a memory, and one or more programs, wherein the one or more programs are stored in the memory and configured to be executed by the processor, the programs comprising instructions for performing the steps of the method of any of claims 1-4.
10. A computer-readable storage medium for storing a computer program, wherein the computer program causes a computer to perform the method according to any one of claims 1-4.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810754804.9A CN109151568B (en) | 2018-07-10 | 2018-07-10 | Video processing method and related product |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810754804.9A CN109151568B (en) | 2018-07-10 | 2018-07-10 | Video processing method and related product |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN109151568A CN109151568A (en) | 2019-01-04 |
| CN109151568B true CN109151568B (en) | 2021-04-06 |
Family
ID=64800340
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201810754804.9A Active CN109151568B (en) | 2018-07-10 | 2018-07-10 | Video processing method and related product |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN109151568B (en) |
Families Citing this family (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN114584716A (en) * | 2022-03-08 | 2022-06-03 | 北京字跳网络技术有限公司 | Picture processing method, device, equipment and storage medium |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2011002620A1 (en) * | 2009-07-02 | 2011-01-06 | Apple Inc. | Method and apparatus for protected content data processing |
| CN103942751A (en) * | 2014-04-28 | 2014-07-23 | 中央民族大学 | Method for extracting video key frame |
| CN104951495A (en) * | 2014-03-28 | 2015-09-30 | 韩国电子通信研究院 | Apparatus and method for managing representative video images |
| CN105872584A (en) * | 2015-11-25 | 2016-08-17 | 乐视网信息技术（北京）股份有限公司 | Intercepted video sharing method and device |
| CN106331869A (en) * | 2015-06-29 | 2017-01-11 | 北京金山安全软件有限公司 | Video-based picture re-editing method and device |
| WO2017218194A1 (en) * | 2016-06-12 | 2017-12-21 | Apple Inc. | User interfaces for retrieving contextually relevant media content |
-
2018
- 2018-07-10 CN CN201810754804.9A patent/CN109151568B/en active Active
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2011002620A1 (en) * | 2009-07-02 | 2011-01-06 | Apple Inc. | Method and apparatus for protected content data processing |
| CN104951495A (en) * | 2014-03-28 | 2015-09-30 | 韩国电子通信研究院 | Apparatus and method for managing representative video images |
| CN103942751A (en) * | 2014-04-28 | 2014-07-23 | 中央民族大学 | Method for extracting video key frame |
| CN106331869A (en) * | 2015-06-29 | 2017-01-11 | 北京金山安全软件有限公司 | Video-based picture re-editing method and device |
| CN105872584A (en) * | 2015-11-25 | 2016-08-17 | 乐视网信息技术（北京）股份有限公司 | Intercepted video sharing method and device |
| WO2017218194A1 (en) * | 2016-06-12 | 2017-12-21 | Apple Inc. | User interfaces for retrieving contextually relevant media content |
Non-Patent Citations (2)
| Title |
|---|
| 如何编辑苹果手机的新功能——回忆;jinzhuanzhuli;《百度经验，https://jingyan.baidu.com/article/ed2a5d1f666a9a09f6be179d.html》;20161026;全文 * |
| 苹果手机如何将回忆功能中的回忆保存为视频文件;jinzhuanzhuli;《百度经验，https://jingyan.baidu.com/article/ff42efa92123f0c19e220217.html》;20161020;全文 * |
Also Published As
| Publication number | Publication date |
|---|---|
| CN109151568A (en) | 2019-01-04 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| JP7252362B2 (en) | Method for automatically editing video and portable terminal | |
| US11317139B2 (en) | Control method and apparatus | |
| JP5092000B2 (en) | Video processing apparatus, method, and video processing system | |
| US8346014B2 (en) | Image processing apparatus and method and program | |
| CN108958592B (en) | Video processing method and related product | |
| JP4988011B2 (en) | Electronic apparatus and image processing method | |
| CN111447505B (en) | Video clipping method, network device, and computer-readable storage medium | |
| KR20150127070A (en) | Pictorial summary for video | |
| CN112118395B (en) | Video processing method, terminal and computer readable storage medium | |
| CN105874780A (en) | Method and apparatus for generating a text color for a group of images | |
| JP4988012B2 (en) | Electronic device and indexing control method | |
| EP4222740A1 (en) | Ad breakpoints in video within messaging system | |
| JP2022541358A (en) | Video processing method and apparatus, electronic device, storage medium, and computer program | |
| JP2006140559A (en) | Image reproducing apparatus and image reproducing method | |
| CN109167939B (en) | Automatic text collocation method and device and computer storage medium | |
| CN113038185B (en) | Bullet screen processing method and device | |
| US9779306B2 (en) | Content playback system, server, mobile terminal, content playback method, and recording medium | |
| CN109151568B (en) | Video processing method and related product | |
| JP4940333B2 (en) | Electronic apparatus and moving image reproduction method | |
| KR102069897B1 (en) | Method for generating user video and Apparatus therefor | |
| US20200092444A1 (en) | Playback method, playback device and computer-readable storage medium | |
| JP2012004747A (en) | Electronic equipment and image display method | |
| CN108882023B (en) | Video processing method and related product | |
| CN117014649A (en) | Video processing method and device and electronic equipment | |
| US9396759B2 (en) | Generating content data for a video file |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |