CN110941380B - Picture downloading method and device and computer readable storage medium - Google Patents

Picture downloading method and device and computer readable storage medium Download PDF

Info

Publication number
CN110941380B
CN110941380B CN201911142275.8A CN201911142275A CN110941380B CN 110941380 B CN110941380 B CN 110941380B CN 201911142275 A CN201911142275 A CN 201911142275A CN 110941380 B CN110941380 B CN 110941380B
Authority
CN
China
Prior art keywords
pictures
downloaded
terminal
selection
picture
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN201911142275.8A
Other languages
Chinese (zh)
Other versions
CN110941380A (en
Inventor
熊凯
袁建国
严肃
刘明
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Samsung Electronics China R&D Center
Samsung Electronics Co Ltd
Original Assignee
Samsung Electronics China R&D Center
Samsung Electronics Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Samsung Electronics China R&D Center, Samsung Electronics Co Ltd filed Critical Samsung Electronics China R&D Center
Priority to CN201911142275.8A priority Critical patent/CN110941380B/en
Publication of CN110941380A publication Critical patent/CN110941380A/en
Application granted granted Critical
Publication of CN110941380B publication Critical patent/CN110941380B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0484Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
    • G06F3/04842Selection of displayed objects or displayed text elements
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0481Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00Network arrangements or protocols for supporting network services or applications
    • H04L67/01Protocols
    • H04L67/06Protocols specially adapted for file transfer, e.g. file transfer protocol [FTP]

Landscapes

  • Engineering & Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Human Computer Interaction (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Signal Processing (AREA)
  • Information Transfer Between Computers (AREA)

Abstract

The embodiment of the invention discloses a picture downloading method, a picture downloading device and a computer readable storage medium. The method comprises the following steps: when the number of pictures to be downloaded of a terminal is larger than a preset value or the storage capacity of the pictures to be downloaded is larger than a storage limit value of the terminal, sending a prompt message containing a selection strategy option to the terminal; receiving a selection action aiming at the selection strategy option from a terminal, and determining a selected selection strategy based on the selection action; and selecting the pictures to be downloaded based on the selected selection strategy, and sending the selected pictures to be downloaded to the terminal. The embodiment of the invention improves the picture downloading efficiency, does not need to manually distinguish and delete the duplicate pictures, and also reduces the storage space requirement and the workload.

Description

Picture downloading method and device and computer readable storage medium
Technical Field
The present invention relates to the field of electronic communications technologies, and in particular, to a method and an apparatus for downloading a picture, and a computer-readable storage medium.
Background
The cloud (cloud) storage space can be used for storing relevant data of users, and pressure caused by small storage space of the user terminal can be relieved to a certain extent. With the continuous development and popularization of cloud services, more and more users store pictures in a cloud server, so that the personal storage space is saved, and file data can be conveniently downloaded and recovered on various devices. When the storage space of the local device is insufficient and a user downloads a large number of pictures at one time, how to select pictures which are not downloaded becomes an operation-difficult and time-consuming behavior.
Currently, it is common to deselect pictures based on manual operations by the user. The deselected picture will not be downloaded.
However, when the number of pictures to be downloaded is large, manual operation to deselect has the disadvantage of being inefficient. Moreover, some duplicate photos may exist in the picture to be downloaded, and the duplicate photos need to be manually identified and deleted after downloading, so that the workload is further increased.
Disclosure of Invention
The invention provides a picture downloading method, a picture downloading device and a computer readable storage medium, which are used for improving the picture downloading efficiency.
The technical scheme of the embodiment of the invention is as follows:
a picture downloading method comprises the following steps:
when the number of pictures to be downloaded of a terminal is larger than a preset value or the storage capacity of the pictures to be downloaded is larger than a storage limit value of the terminal, sending a prompt message containing a selection strategy option to the terminal;
receiving a selection action aiming at the selection strategy option from a terminal, and determining a selected selection strategy based on the selection action;
and selecting the pictures to be downloaded based on the selected selection strategy, and sending the selected pictures to be downloaded to the terminal.
In one embodiment, the selected selection policy is a de-header selection policy;
the selecting from the pictures to be downloaded based on the selected selection policy comprises:
ordering the pictures to be downloaded based on the shooting time;
and selecting one or more pictures with old shooting time from the pictures to be downloaded based on the sequencing result, wherein the number of the selected pictures to be downloaded is less than or equal to the preset value or the storage capacity of the selected pictures to be downloaded is less than or equal to the storage limit value of the terminal.
In one embodiment, the selected selection policy is a tailgating selection policy;
the selecting from the pictures to be downloaded based on the selected selection policy comprises:
ordering the pictures to be downloaded based on the shooting time;
and selecting one or more pictures with new shooting time from the pictures to be downloaded based on the sequencing result, wherein the number of the selected pictures to be downloaded is less than or equal to the preset value or the storage capacity of the selected pictures to be downloaded is less than or equal to the storage limit value of the terminal.
In one embodiment, the selected selection policy is a random selection policy;
the selecting from the pictures to be downloaded based on the selected selection policy comprises:
randomly selecting pictures from the pictures to be downloaded, wherein the number of the selected pictures to be downloaded is less than or equal to the preset value or the storage capacity of the selected pictures to be downloaded is less than or equal to the storage limit value of the terminal.
In one embodiment, the selected selection policy is a de-duplication selection policy;
the selecting from the pictures to be downloaded based on the selected selection policy comprises:
determining a non-repeated picture from the pictures to be downloaded based on picture similarity operation;
and selecting one or more non-repeated pictures from the pictures to be downloaded, wherein the number of the selected pictures to be downloaded is less than or equal to the preset value or the storage capacity of the selected pictures to be downloaded is less than or equal to the storage limit value of the terminal.
In one embodiment, the selected selection policy is an intelligent selection policy;
the selecting from the pictures to be downloaded based on the selected selection policy comprises:
selecting all pictures to be downloaded, and carrying out scene classification on the pictures to be downloaded;
for each scene, deselecting a secondary picture in the scene based on a predetermined secondary picture determination reference;
fusing the residual pictures in each scene to obtain a residual picture set;
and based on a preset time interval, one or more pictures are deselected from the remaining picture set, wherein the number of the deselected and remaining selected pictures to be downloaded is less than or equal to the preset value or the storage capacity of the deselected and remaining selected pictures to be downloaded is less than or equal to the storage limit value of the terminal.
A picture downloading apparatus comprising:
the prompting module is used for sending a prompting message containing a selection strategy option to the terminal when the number of pictures to be downloaded of the terminal is larger than a preset value or the storage capacity of the pictures to be downloaded is larger than a storage limit value of the terminal;
the strategy determining module is used for receiving a selection action aiming at the selection strategy option from the terminal and determining a selected selection strategy based on the selection action;
and the selection module is used for selecting from the pictures to be downloaded based on the selected selection strategy and sending the selected pictures to be downloaded to the terminal.
In one embodiment, the selected selection policy is a de-header selection policy;
the selection module is used for sequencing the pictures to be downloaded based on the shooting time; and selecting one or more pictures with old shooting time from the pictures to be downloaded, wherein the number of the selected pictures to be downloaded is less than or equal to the preset value or the storage capacity of the selected pictures to be downloaded is less than or equal to the storage limit value of the terminal.
In one embodiment, the selected selection policy is a tailgating selection policy;
the selection module is used for sequencing the pictures to be downloaded based on the shooting time; and selecting one or more pictures with new shooting time from the pictures to be downloaded based on the sequencing result, wherein the number of the selected pictures to be downloaded is less than or equal to the preset value or the storage capacity of the selected pictures to be downloaded is less than or equal to the storage limit value of the terminal.
In one embodiment, the selected selection policy is a random selection policy;
and the selection module is used for randomly selecting pictures from the pictures to be downloaded, wherein the number of the selected pictures to be downloaded is less than or equal to the preset value or the storage capacity of the selected pictures to be downloaded is less than or equal to the storage limit value of the terminal.
In one embodiment, the selected selection policy is a de-duplication selection policy;
the selection module is used for determining a non-repeated picture from the pictures to be downloaded based on picture similarity operation; and selecting one or more non-repeated pictures from the pictures to be downloaded, wherein the number of the selected pictures to be downloaded is less than or equal to the preset value or the storage capacity of the selected pictures to be downloaded is less than or equal to the storage limit value of the terminal.
In one embodiment, the selected selection policy is an intelligent selection policy;
the selection module is used for selecting all pictures to be downloaded and carrying out scene classification on the pictures to be downloaded; for each scene, deselecting a secondary picture in the scene based on a predetermined secondary picture determination reference; fusing the residual pictures in each scene to obtain a residual picture set; and based on a preset time interval, one or more pictures are deselected from the remaining picture set, wherein the number of the deselected and remaining selected pictures to be downloaded is less than or equal to the preset value or the storage capacity of the deselected and remaining selected pictures to be downloaded is less than or equal to the storage limit value of the terminal.
A picture downloading device comprises a processor and a memory;
the memory stores an application program executable by the processor, and the application program is used for causing the processor to execute the picture downloading method.
A computer readable storage medium having stored therein computer readable instructions for performing the picture downloading method as described in any one of the above.
According to the technical scheme, in the embodiment of the invention, when the number of the pictures to be downloaded of the terminal is greater than a preset value or the storage capacity of the pictures to be downloaded is greater than the storage limit value of the terminal, a prompt message containing a selection strategy option is sent to the terminal; receiving a selection action aiming at the selection strategy option from the terminal, and determining a selected selection strategy based on the selection action; and selecting from the pictures to be downloaded based on the selected selection strategy, and sending the selected pictures to be downloaded to the terminal. Therefore, the pictures can be automatically selected based on the selection strategy without manual operation of a user, and therefore the picture downloading efficiency can be improved.
Moreover, the implementation mode of the invention has multiple selection strategies of head removal, tail removal, randomness, weight removal, intelligence and the like, and the user selectable range is wide.
In addition, the embodiment of the invention can automatically select the non-repeated pictures without manually distinguishing and deleting the repeated pictures, thereby reducing the workload and saving the storage space.
Drawings
Fig. 1 is a flowchart of a picture downloading method according to the present invention.
FIG. 2 is a process schematic of a deheading selection strategy according to the present invention.
FIG. 3 is a process diagram of a tailgating selection strategy according to the present invention.
Fig. 4 is a process diagram of a random selection strategy according to the present invention.
FIG. 5 is a process diagram of a de-duplication selection strategy according to the present invention.
FIG. 6 is a process diagram of an intelligent selection strategy according to the present invention.
Fig. 7 is a block diagram of a picture downloading device according to the present invention.
FIG. 8 is a block diagram of a picture downloading device having a memory-processor architecture according to the present invention.
Detailed Description
In order to make the objects, technical solutions and advantages of the present invention more apparent, the present invention is further described in detail with reference to the accompanying drawings.
For simplicity and clarity of description, the invention will be described below by describing several representative embodiments. Numerous details of the embodiments are set forth to provide an understanding of the principles of the invention. It will be apparent, however, that the invention may be practiced without these specific details. Some embodiments are not described in detail, but rather are merely provided as frameworks, in order to avoid unnecessarily obscuring aspects of the invention. Hereinafter, "including" means "including but not limited to", "according to … …" means "at least according to … …, but not limited to … … only". In view of the language convention of chinese, the following description, when it does not specifically state the number of a component, means that the component may be one or more, or may be understood as at least one.
The invention discloses a technical scheme for automatically selecting a part of pictures to only download the part of pictures when the storage space is insufficient or in order to save the storage space, or automatically deselecting the part of pictures to not download the part of pictures after all pictures to be downloaded are selected by default.
Fig. 1 is a flowchart of a picture downloading method according to the present invention. The method is suitable for the cloud end, such as a cloud server arranged at the cloud end. When a user browses pictures through a cloud album or other applications, the cloud server acquires cloud picture information including picture types, download addresses, file sizes and the like.
As shown in fig. 1, the method includes:
step 101: and when the number of the pictures to be downloaded of the terminal is greater than a preset value or the storage capacity of the pictures to be downloaded is greater than a storage limit value of the terminal, sending a prompt message containing a selection strategy option to the terminal.
Here, the terminal calculates a free storage space of itself in advance, determines a storage limit value (for example, 80% of the free storage space) based on the free storage space, and transmits the storage limit value to the cloud server. Among them, the terminal may include but is not limited to: a feature phone, a smart phone, a palm top, a Personal Computer (PC), a tablet or a Personal Digital Assistant (PDA), etc. The terminal can be applied to any intelligent device operating system, and specific applicable operating systems include but are not limited to: android (Android), Palm OS, Symbian (Saiban), Windows mobile, Linux, Android (Android), iPhone (apple) OS, Black Berry (blackberry) OS 6.0, Windows Phone series, and so forth.
Although specific examples of the terminal have been set forth in detail above, those skilled in the art will appreciate that this list is for illustrative purposes only and is not intended to limit the scope of embodiments of the present invention.
When a terminal user selects pictures in batches for downloading, the cloud server counts the number and the storage capacity of the pictures to be downloaded of the terminal. Wherein: and when the number of the pictures to be downloaded of the terminal is greater than a preset value or the storage capacity of the pictures to be downloaded is greater than a storage limit value of the terminal, sending a prompt message containing a selection strategy option to the terminal. The selection policy options may include one or more, where each selection policy corresponds to a respective execution policy for automatically selecting a portion of the pictures to download only the selected portion of the pictures, or a respective execution policy for selecting all of the pictures to be downloaded by default and then automatically deselecting a portion of the pictures to not download the portion of the pictures.
Step 102: and receiving a selection action aiming at the selection strategy option from the terminal, and determining the selected selection strategy based on the selection action.
For example, a prompt message is presented on a display interface of the terminal, and the prompt message includes a selection policy option having a plurality of selection policies. The end-user browses the display interface and issues a selection action to select an employed selection policy from a plurality of selection policies contained in the prompting message (e.g., clicks to select a particular selection policy from the selection policy options). The cloud server receives the selection action from the terminal, and determines a selected selection strategy based on the selection action.
Step 103: and selecting from the pictures to be downloaded based on the selected selection strategy, and sending the selected pictures to be downloaded to the terminal.
Here, the cloud server selects pictures from the pictures to be downloaded based on the selected selection policy, and transmits the selected pictures to be downloaded to the terminal.
Therefore, the method and the device can select the pictures sent to the terminal based on the selection strategy without manual operation of a user, so that the picture downloading efficiency can be improved.
The selection policy may have various embodiments. For example, the selection policy includes:
(1) de-heading selection strategy
In the de-header selection strategy: the method comprises the steps that a certain number of pictures are deselected to be downloaded by calculating the size of available space from the beginning of the sorting by the picture shooting time so as to meet the requirement of storage space; or, starting from the end of the sorting by the picture taking time, a certain number of pictures are selected to be downloaded to meet the requirement of the storage space by calculating the size of the available space.
(2) Selection strategy for tailing
In the tail-out selection strategy: from the tail of the ordering by the picture shooting time, canceling the selection of a certain number of pictures for downloading by calculating the size of the available space so as to meet the requirement of a storage space; or, starting from the beginning of the picture shooting time sequence, selecting a certain number of pictures to download by calculating the size of the available space so as to meet the requirement of the storage space.
(3) Random selection strategy
In the random selection strategy, random positions of pictures are obtained by using a random function, and a certain number of pictures at the random positions are selected for downloading so as to meet the requirement of a storage space.
(4) Deduplication strategy
In the duplication elimination strategy, image downloading with close similarity is cancelled in modes such as OpenCV or machine learning model, so as to meet the requirement of storage space.
(5) Intelligent selection strategy
In the intelligent selection strategy, the pictures to be downloaded are inferred in a machine learning mode and the like to obtain a scene, key pictures in the scene are selected, and downloading of secondary pictures (such as defective pictures, closed-eye pictures and the like) is cancelled.
The above exemplary descriptions are typical examples of selection strategies, and those skilled in the art will appreciate that such descriptions are merely exemplary and are not intended to limit the scope of the embodiments of the present invention.
In one embodiment, the selection strategy is a de-header selection strategy; the selecting from the pictures to be downloaded in step 103 based on the selected selection policy includes: ordering the pictures to be downloaded based on the shooting time; and selecting one or more pictures with old shooting time from the pictures to be downloaded based on the sequencing result, wherein the number of the selected pictures to be downloaded is less than or equal to the preset value or the storage capacity of the selected pictures to be downloaded is less than or equal to the storage limit value of the terminal.
FIG. 2 is a process schematic of a deheading selection strategy according to the present invention. In the deheading selection strategy, users tend to download pictures taken earlier.
In the upper part of fig. 2, the results of ordering the pictures to be downloaded selected by the terminal user in batch according to the shooting time are presented, wherein each picture to be downloaded is identified by a tick mark indicating that the initial default is selected. The shooting time of the first row of pictures to be downloaded is newer than that of the second row of pictures to be downloaded, the shooting time of the second row of pictures to be downloaded is newer than that of the third row of pictures to be downloaded, and the shooting time of the third row of pictures to be downloaded is newer than that of the fourth row of pictures to be downloaded. In addition, in each row of pictures to be downloaded, the picture to be downloaded at the left position is newer than the shooting time of the picture to be downloaded at the right position.
The cloud server deselects one or more new pictures with the shooting time from the pictures to be downloaded until the number of the deselected pictures to be downloaded is less than or equal to a preset value or the storage capacity of the deselected pictures to be downloaded is less than or equal to the storage limit value of the terminal. Here, it is assumed that after the 4 pictures to be downloaded in the first row are deselected, it may be satisfied that the number of pictures to be downloaded is equal to or less than a predetermined value or the storage amount of the deselected pictures to be downloaded is equal to or less than the storage limit value of the terminal.
In the lower part of fig. 2, a presentation result of the picture to be downloaded after the cloud server performs the deselection is presented. It can be seen that the 4 pictures to be downloaded in the first row are no longer identified by a tick mark, i.e. deselected. Therefore, the cloud server will not send the first row of 4 pictures to be downloaded to the terminal.
In one embodiment, the selected selection policy is a tailgating selection policy; the selecting from the pictures to be downloaded in step 103 based on the selected selection policy includes: ordering the pictures to be downloaded based on the shooting time; and selecting one or more pictures with new shooting time from the pictures to be downloaded based on the sequencing result, wherein the number of the selected pictures to be downloaded is less than or equal to the preset value or the storage capacity of the selected pictures to be downloaded is less than or equal to the storage limit value of the terminal.
FIG. 3 is a process diagram of a tailgating selection strategy according to the present invention. In the tailgating strategy, the user tends to download pictures taken at the latest time.
In the upper part of fig. 3, the results of ordering the pictures to be downloaded selected by the end user in batch according to the shooting time are presented, wherein each picture to be downloaded is identified by a tick mark indicating that the initial default is selected. The shooting time of the first row of pictures to be downloaded is newer than that of the second row of pictures to be downloaded, the shooting time of the second row of pictures to be downloaded is newer than that of the third row of pictures to be downloaded, and the shooting time of the third row of pictures to be downloaded is newer than that of the fourth row of pictures to be downloaded. In addition, in each row of pictures to be downloaded, the picture to be downloaded at the left position is newer than the shooting time of the picture to be downloaded at the right position.
The cloud server deselects one or more pictures with old shooting time from the pictures to be downloaded until the number of the deselected pictures to be downloaded is less than or equal to a preset value or the storage capacity of the deselected pictures to be downloaded is less than or equal to the storage limit value of the terminal. Here, it is assumed that after 2 pictures to be downloaded at the right position of the third row and the fourth row are deselected, it may be satisfied that the number of pictures to be downloaded is equal to or less than a predetermined value or the storage amount of the deselected pictures to be downloaded is equal to or less than the storage limit value of the terminal.
In the lower part of fig. 3, a presentation result of the picture to be downloaded after the cloud server performs the deselection is presented. It can be seen that the 2 pictures to be downloaded at the right position of the third row and the fourth row are no longer marked with a tick mark, i.e. deselected. Therefore, the cloud server will not send the 2 pictures to be downloaded at the right position of the third row and the pictures to be downloaded at the fourth row to the terminal.
In one embodiment, the selected selection policy is a random selection policy; the selecting from the pictures to be downloaded based on the selected selection policy in step 103 includes: randomly selecting pictures from the pictures to be downloaded, wherein the number of the selected pictures to be downloaded is less than or equal to the preset value or the storage capacity of the selected pictures to be downloaded is less than or equal to the storage limit value of the terminal. Optionally, all the pictures to be downloaded may be initially selected by default, one or more pictures may be randomly deselected, and the remaining pictures to be downloaded are sent to the terminal.
Fig. 4 is a process diagram of a random selection strategy according to the present invention. In the random selection strategy, the user deselects the picture to be downloaded in a random manner.
In the upper part of fig. 4, a presentation of the pictures to be downloaded selected by the end user in bulk is presented, wherein each picture to be downloaded is identified by a tick mark indicating that the initial default was selected.
The cloud server randomly deselects one or more pictures from the pictures to be downloaded until the number of the deselected pictures to be downloaded is less than or equal to a preset value or the storage capacity of the deselected pictures to be downloaded is less than or equal to a storage limit value of the terminal. Here, it is assumed that after the random selection of the first to-be-downloaded picture in the first row from left to right, the last to-be-downloaded picture in the second row from left to right, and the third row is deselected, it may be satisfied that the number of the to-be-downloaded pictures is less than or equal to a predetermined value or the storage amount of the deselected to-be-downloaded pictures is less than or equal to a storage limit value of the terminal.
In the lower part of fig. 4, a presentation result of the picture to be downloaded after the cloud server performs the deselection is presented. It can be seen that the first to-be-downloaded picture in the first row from left to right, the last to-be-downloaded picture in the second row from left to right, and the to-be-downloaded picture in the third row are not marked with a tick mark any more, i.e., are deselected. Therefore, the cloud server does not send the first to-be-downloaded picture in the first row from left to right, the last to-be-downloaded picture in the second row from left to right, and the to-be-downloaded picture in the third row to the terminal.
In one embodiment, the selected selection policy is a de-duplication selection policy; the selecting from the pictures to be downloaded in step 103 based on the selected selection policy includes: determining a non-repeated picture from the pictures to be downloaded based on picture similarity operation; and selecting one or more non-repeated pictures from the pictures to be downloaded, wherein the number of the selected pictures to be downloaded is less than or equal to the preset value or the storage capacity of the selected pictures to be downloaded is less than or equal to the storage limit value of the terminal. Optionally, all the pictures to be downloaded may be initially selected by default, a non-repetitive picture is determined from the pictures to be downloaded based on picture similarity operation, and then one or more repetitive pictures are deselected from the pictures to be downloaded, wherein the number of the deselected pictures to be downloaded is less than or equal to the predetermined value or the storage capacity of the deselected pictures to be downloaded is less than or equal to the storage limit value of the terminal.
Specifically, the similarity of all the pictures to be downloaded is first calculated to determine the similar pictures therein, a predetermined number (for example, one similar picture) of the similar pictures is reserved for being selected for the terminal to download, and the rest similar pictures are deselected not to be downloaded by the terminal. Preferably, the algorithm for calculating the picture similarity may include, but is not limited to: a histogram; matching the pattern templates; peak Signal to Noise Ratio (PSNR) Structural Similarity (Structural Similarity Index Measure, SSIM); perceptual hashing algorithms, and the like.
FIG. 5 is a process diagram of a de-duplication selection strategy according to the present invention. In the deduplication selection strategy, the user tends not to download the duplicate pictures with high similarity.
In fig. 5, a display result of the pictures to be downloaded selected in batch by the terminal user is presented, wherein each picture to be downloaded is identified by a tick mark, which indicates that the picture to be downloaded is selected.
In the upper part of fig. 5, a display result of the pictures to be downloaded selected in batch by the terminal user is presented, wherein each picture to be downloaded is identified by a tick mark indicating that it is selected as a picture to be downloaded.
The cloud server determines that the pictures to be downloaded in the first row are similar pictures of the first type together based on a picture similarity algorithm, and the pictures to be downloaded in the second row and the pictures to be downloaded in the third row are similar pictures of the other type. The cloud server selects the picture to be downloaded at the middle position of the first row as the picture to be downloaded by the terminal from the first similar pictures, and the pictures to be downloaded at the rest positions of the first row are deselected not to be downloaded by the terminal; and the cloud server selects the second row of pictures to be downloaded at the first position from left to right from the second similar pictures as the pictures to be downloaded by the terminal, and the pictures to be downloaded at the rest positions of the second row and the pictures to be downloaded at the third row are deselected from the second similar pictures so as not to be downloaded by the terminal.
In the lower part of fig. 5, a presentation result of the picture to be downloaded after the cloud server performs the deselection is presented. It can be seen that the other pictures to be downloaded except the middle position of the first row and the first position from left to right of the second row are not marked with checkmarks any more, i.e. deselected. Therefore, the cloud server only sends the pictures to be downloaded to the terminal except for the middle position of the first row and the first position of the second row from left to right.
In one embodiment, the selected selection policy is an intelligent selection policy; the selecting from the pictures to be downloaded in the selected selection policy in step 103 includes: selecting all pictures to be downloaded, and carrying out scene classification on the pictures to be downloaded; for each scene, deselecting a secondary picture in the scene based on a predetermined secondary picture determination reference; fusing the residual pictures in each scene to obtain a residual picture set; and based on a preset time interval, one or more pictures are deselected from the remaining picture set, wherein the number of the deselected pictures to be downloaded remaining after deselection is less than or equal to a preset value or the storage capacity of the deselected pictures to be downloaded remaining after deselection is less than or equal to a storage limit value of the terminal.
Specifically, when the intelligent selection policy is selected, all the pictures to be downloaded are initially selected by default. Moreover, the cloud server performs scene recognition operations (such as, but not limited to, using machine learning models) separately for all pictures to be downloaded to recognize one or more scenes. In the scene recognition operation, it is preferable to determine the relationship between the person and the background in each picture, for example, by defining the maximum time for a scene in one day, based on the time axis, and if the person in the picture is fixed to one or more persons or a fixed number of persons among the plurality of persons and the background tends to be one type (for example, landscape, architecture, etc.), it is determined that the series of pictures is one scene. Moreover, for each scene, the cloud server retains the key pictures in the scene and cancels the secondary picture download. If some pictures in the scene cannot be screened from key pictures or secondary pictures through the machine learning model, an interface is provided to display the pictures, so that a user can select and determine which pictures are deselected.
Further, the operation of deselecting similar pictures is performed for the remaining pictures in each scene being fused. And when the similar pictures are cancelled and the storage space requirement can not be met, the pictures are cancelled and selected at certain time intervals. For example, key pictures in each scene at certain intervals in the time axis are extracted, and temporally close pictures are preferentially cancelled. For example, the interval is 1/2 first, then 1/4, 1/8, and so on.
For example, assume that there are 9 pictures in the residual picture set obtained by fusing the residual pictures in each scene. Based on the shooting time ordering, the 9 pictures are respectively numbered as 123456789.
The remaining pictures after the first round of deselection are: 12346789
That is, number 5 at the middle position (1/2) of all numbers is deselected.
The remaining pictures after the second round of deselection are: 134689
That is, the cancellation of the numbers 2 and 7 is continued, i.e., the selection of the numbers 2 and 7 at the 1/4 positions of all the numbers is cancelled.
The remaining pictures after the third round of deselection are: 49
That is, the numbers 1, 3, 6 and 8 are continuously deselected, i.e., the numbers 1, 3, 6 and 8 at the 1/8 position of all numbers are deselected.
The above exemplary descriptions are typical examples of the intelligent selection strategy, and those skilled in the art will appreciate that such descriptions are merely exemplary and are not intended to limit the scope of the embodiments of the present invention.
In the embodiment of the invention, when all pictures are cancelled and the local storage limit cannot be met, the prompt message is displayed to inform the user. And when the terminal finishes downloading the selected pictures, if the local storage space is still free, displaying the pictures which are not downloaded for the user to select whether to download or not.
FIG. 6 is a process diagram of an intelligent selection strategy according to the present invention.
In the upper part of fig. 6, a display result of the pictures to be downloaded selected in batch by the terminal user is presented, wherein each picture to be downloaded is identified by a tick mark indicating that it is selected as a picture to be downloaded.
The cloud server respectively executes scene recognition operation on all the pictures to be downloaded to recognize one or more scenes, wherein the pictures to be downloaded identified as A belong to the scene A, and the pictures to be downloaded identified as B belong to the scene B. The cloud server identifies secondary pictures (for example, overexposed pictures at positions 3-4 from left to right in the third row) from the pictures to be downloaded of the scene A, and deselects the secondary pictures belonging to the scene A so as not to be downloaded by the terminal. Moreover, the cloud server identifies secondary pictures (for example, overexposed pictures at the second row of the 2 nd position from left to right, and closed-eye pictures at the third row of the second position from left to right) from the pictures to be downloaded of the scene B, and deselects the secondary pictures belonging to the scene B so as not to be downloaded by the terminal.
In the lower part of fig. 6, a presentation result of the picture to be downloaded after the cloud server performs the deselection is presented. It can be seen that the pictures at the 2 nd position from left to right in the second row and the 2 nd to 4 nd positions from left to right in the third row are not marked with a tick mark any more, that is, the pictures are deselected. Therefore, the cloud server can send pictures to the terminal except for the second row from the left to the right and the 2 nd position from the left to the right and the 2 nd to 4 th positions from the left to the right in the third row.
Further, the cloud server can also perform the operation of deselecting similar pictures for fusing the remaining pictures (pictures except for the second row of 2 nd positions from left to right and the third row of 2 nd to 4 th positions from left to right) in each scene. And when the similar pictures are cancelled and the storage space requirement cannot be met, the cloud server cancels the selection of the pictures at certain time intervals. For example, key pictures in each scene at certain intervals in the time axis are extracted, and temporally close pictures are preferentially cancelled.
Based on the above description, the embodiment of the invention further provides a picture downloading device.
Fig. 7 is a block diagram of a picture downloading device according to the present invention.
As shown in fig. 7, the apparatus includes:
the prompting module 701 is used for sending a prompting message containing a selection policy option to the terminal when the number of pictures to be downloaded of the terminal is greater than a preset value or the storage capacity of the pictures to be downloaded is greater than a storage limit value of the terminal;
a policy determination module 702, configured to receive a selection action for the selection policy option from the terminal, and determine a selected selection policy based on the selection action;
a selecting module 703, configured to select from the pictures to be downloaded based on the selected selection policy, and send the selected pictures to be downloaded to the terminal.
In one embodiment, the selected selection policy is a de-header selection policy; a selecting module 703, configured to sort the pictures to be downloaded based on the shooting time; and selecting one or more pictures with old shooting time from the pictures to be downloaded, wherein the number of the selected pictures to be downloaded is less than or equal to the preset value or the storage capacity of the selected pictures to be downloaded is less than or equal to the storage limit value of the terminal.
In one embodiment, the selected selection policy is a tailgating selection policy; a selecting module 703, configured to sort the pictures to be downloaded based on the shooting time; and selecting one or more pictures with new shooting time from the pictures to be downloaded based on the sequencing result, wherein the number of the selected pictures to be downloaded is less than or equal to the preset value or the storage capacity of the selected pictures to be downloaded is less than or equal to the storage limit value of the terminal.
In one embodiment, the selected selection policy is a random selection policy; a selecting module 703, configured to randomly select pictures from the pictures to be downloaded, where the number of the selected pictures to be downloaded is less than or equal to the predetermined value or the storage capacity of the selected pictures to be downloaded is less than or equal to the storage limit value of the terminal.
In one embodiment, the selected selection policy is a de-duplication selection policy; a selecting module 703, configured to determine a non-duplicate picture from the pictures to be downloaded based on picture similarity calculation; and selecting one or more non-repeated pictures from the pictures to be downloaded, wherein the number of the selected pictures to be downloaded is less than or equal to the preset value or the storage capacity of the selected pictures to be downloaded is less than or equal to the storage limit value of the terminal.
In one embodiment, the selected selection policy is an intelligent selection policy; a selecting module 703, configured to select all pictures to be downloaded, and perform scene classification on the pictures to be downloaded; for each scene, deselecting a secondary picture in the scene based on a predetermined secondary picture determination reference; fusing the residual pictures in each scene to obtain a residual picture set; and based on a preset time interval, one or more pictures are deselected from the remaining picture set, wherein the number of the deselected and remaining selected pictures to be downloaded is less than or equal to the preset value or the storage capacity of the deselected and remaining selected pictures to be downloaded is less than or equal to the storage limit value of the terminal.
The embodiment of the invention also provides a picture downloading device with the memory-processor architecture.
FIG. 8 is a block diagram of a picture downloading device having a memory-processor architecture according to the present invention.
As shown in fig. 8, the picture downloading apparatus having a memory-processor architecture includes: a processor 801 and a memory 802; in which the memory 802 stores an application program executable by the processor 801 for causing the processor 801 to perform a picture downloading method as described in any one of the above.
The memory 802 may be embodied as various storage media such as an Electrically Erasable Programmable Read Only Memory (EEPROM), a Flash memory (Flash memory), and a Programmable Read Only Memory (PROM). The processor 801 may be implemented to include one or more central processors or one or more field programmable gate arrays that integrate one or more central processor cores. In particular, the central processor or central processor core may be implemented as a CPU or MCU.
It should be noted that not all steps and modules in the above flows and structures are necessary, and some steps or modules may be omitted according to actual needs. The execution order of the steps is not fixed and can be adjusted as required. The division of each module is only for convenience of describing adopted functional division, and in actual implementation, one module may be divided into multiple modules, and the functions of multiple modules may also be implemented by the same module, and these modules may be located in the same device or in different devices.
The hardware modules in the various embodiments may be implemented mechanically or electronically. For example, a hardware module may include a specially designed permanent circuit or logic device (e.g., a special purpose processor such as an FPGA or ASIC) for performing specific operations. A hardware module may also include programmable logic devices or circuits (e.g., including a general-purpose processor or other programmable processor) that are temporarily configured by software to perform certain operations. The implementation of the hardware module in a mechanical manner, or in a dedicated permanent circuit, or in a temporarily configured circuit (e.g., configured by software), may be determined based on cost and time considerations.
The present invention also provides a machine-readable storage medium storing instructions for causing a machine to perform a method as described herein. Specifically, a system or an apparatus equipped with a storage medium on which a software program code that realizes the functions of any of the embodiments described above is stored may be provided, and a computer (or a CPU or MPU) of the system or the apparatus is caused to read out and execute the program code stored in the storage medium. Further, part or all of the actual operations may be performed by an operating system or the like operating on the computer by instructions based on the program code. The functions of any of the above-described embodiments may also be implemented by writing the program code read out from the storage medium to a memory provided in an expansion board inserted into the computer or to a memory provided in an expansion unit connected to the computer, and then causing a CPU or the like mounted on the expansion board or the expansion unit to perform part or all of the actual operations based on the instructions of the program code.
Examples of the storage medium for supplying the program code include floppy disks, hard disks, magneto-optical disks, optical disks (e.g., CD-ROMs, CD-R, CD-RWs, DVD-ROMs, DVD-RAMs, DVD-RWs, DVD + RWs), magnetic tapes, nonvolatile memory cards, and ROMs. Alternatively, the program code may be downloaded from a server computer or the cloud by a communication network.
"exemplary" means "serving as an example, instance, or illustration" herein, and any illustration, embodiment, or steps described as "exemplary" herein should not be construed as a preferred or advantageous alternative. For the sake of simplicity, the drawings are only schematic representations of the parts relevant to the invention, and do not represent the actual structure of the product. In addition, in order to make the drawings concise and understandable, components having the same structure or function in some of the drawings are only schematically illustrated or only labeled. In this document, "a" does not mean that the number of the relevant portions of the present invention is limited to "only one", and "a" does not mean that the number of the relevant portions of the present invention "more than one" is excluded. In this document, "upper", "lower", "front", "rear", "left", "right", "inner", "outer", and the like are used only to indicate relative positional relationships between relevant portions, and do not limit absolute positions of the relevant portions.
The above description is only a preferred embodiment of the present invention, and is not intended to limit the scope of the present invention. Any modification, equivalent replacement, or improvement made within the spirit and principle of the present invention should be included in the protection scope of the present invention.

Claims (12)

1. A picture downloading method is applicable to a cloud server arranged at a cloud end, and comprises the following steps:
receiving a storage limit value from a terminal;
counting the number and storage capacity of pictures to be downloaded of the terminal;
when the terminal selects pictures in batch for downloading and the number of the pictures to be downloaded of the terminal is larger than a preset value or the storage capacity of the pictures to be downloaded is larger than a storage limit value of the terminal, sending a prompt message containing selection strategy options to the terminal, wherein each selection strategy corresponds to a respective execution strategy for automatically selecting a part of pictures to only download the selected part of pictures, or selecting all the pictures to be downloaded by default and then automatically deselecting a part of pictures to not download the part of pictures;
receiving a selection action aiming at the selection strategy option from a terminal, and determining a selected selection strategy based on the selection action;
selecting from the pictures to be downloaded based on the selected selection strategy, and sending the selected pictures to be downloaded to the terminal;
the selected selection strategy is an intelligent selection strategy;
the selecting from the pictures to be downloaded based on the selected selection policy comprises:
selecting all pictures to be downloaded, and carrying out scene classification on the pictures to be downloaded;
for each scene, deselecting a secondary picture in the scene based on a predetermined secondary picture determination reference;
fusing the residual pictures in each scene to obtain a residual picture set;
and based on a preset time interval, one or more pictures are deselected from the remaining picture set, wherein the number of the deselected and remaining selected pictures to be downloaded is less than or equal to the preset value or the storage capacity of the deselected and remaining selected pictures to be downloaded is less than or equal to the storage limit value of the terminal.
2. The picture downloading method of claim 1, wherein the selected selection policy is a decapsulation selection policy;
the selecting from the pictures to be downloaded based on the selected selection policy comprises:
ordering the pictures to be downloaded based on the shooting time;
and selecting one or more pictures with old shooting time from the pictures to be downloaded based on the sequencing result, wherein the number of the selected pictures to be downloaded is less than or equal to the preset value or the storage capacity of the selected pictures to be downloaded is less than or equal to the storage limit value of the terminal.
3. The picture downloading method of claim 1, wherein the selected selection policy is a tailgating selection policy;
the selecting from the pictures to be downloaded based on the selected selection policy comprises:
ordering the pictures to be downloaded based on the shooting time;
and selecting one or more pictures with new shooting time from the pictures to be downloaded based on the sequencing result, wherein the number of the selected pictures to be downloaded is less than or equal to the preset value or the storage capacity of the selected pictures to be downloaded is less than or equal to the storage limit value of the terminal.
4. The picture downloading method of claim 1, wherein the selected selection policy is a random selection policy;
the selecting from the pictures to be downloaded based on the selected selection policy comprises:
randomly selecting pictures from the pictures to be downloaded, wherein the number of the selected pictures to be downloaded is less than or equal to the preset value or the storage capacity of the selected pictures to be downloaded is less than or equal to the storage limit value of the terminal.
5. The picture downloading method of claim 1, wherein the selected selection policy is a de-duplication selection policy;
the selecting from the pictures to be downloaded based on the selected selection policy comprises:
determining a non-repeated picture from the pictures to be downloaded based on picture similarity operation;
and selecting one or more non-repeated pictures from the pictures to be downloaded, wherein the number of the selected pictures to be downloaded is less than or equal to the preset value or the storage capacity of the selected pictures to be downloaded is less than or equal to the storage limit value of the terminal.
6. A picture downloading device, which is suitable for a cloud server disposed in a cloud end, the device comprising:
a receiving module for receiving the storage limit value from the terminal;
the statistical module is used for counting the number and the storage capacity of the pictures to be downloaded of the terminal;
the prompting module is used for sending a prompting message containing selection strategy options to the terminal when the terminal selects pictures in batches for downloading and the number of the pictures to be downloaded of the terminal is greater than a preset value or the storage capacity of the pictures to be downloaded is greater than a storage limit value of the terminal, wherein each selection strategy corresponds to a respective execution strategy for automatically selecting a part of pictures to only download the selected part of the pictures, or a respective execution strategy for selecting all the pictures to be downloaded by default and then automatically deselecting a part of the pictures to not download the part of the pictures is selected;
the strategy determining module is used for receiving a selection action aiming at the selection strategy option from the terminal and determining a selected selection strategy based on the selection action;
the selection module is used for selecting from the pictures to be downloaded based on the selected selection strategy and sending the selected pictures to be downloaded to the terminal;
the selected selection strategy is an intelligent selection strategy;
the selection module is used for selecting all pictures to be downloaded and carrying out scene classification on the pictures to be downloaded; for each scene, deselecting a secondary picture in the scene based on a predetermined secondary picture determination reference; fusing the residual pictures in each scene to obtain a residual picture set; and based on a preset time interval, one or more pictures are deselected from the remaining picture set, wherein the number of the deselected and remaining selected pictures to be downloaded is less than or equal to the preset value or the storage capacity of the deselected and remaining selected pictures to be downloaded is less than or equal to the storage limit value of the terminal.
7. The picture downloading device of claim 6, wherein the selected selection policy is a decapsulation selection policy;
the selection module is used for sequencing the pictures to be downloaded based on the shooting time; and selecting one or more pictures with old shooting time from the pictures to be downloaded, wherein the number of the selected pictures to be downloaded is less than or equal to the preset value or the storage capacity of the selected pictures to be downloaded is less than or equal to the storage limit value of the terminal.
8. The picture downloading device of claim 6, wherein the selected selection policy is a tailgating selection policy;
the selection module is used for sequencing the pictures to be downloaded based on the shooting time; and selecting one or more pictures with new shooting time from the pictures to be downloaded based on the sequencing result, wherein the number of the selected pictures to be downloaded is less than or equal to the preset value or the storage capacity of the selected pictures to be downloaded is less than or equal to the storage limit value of the terminal.
9. The picture downloading device of claim 6, wherein the selected selection policy is a random selection policy;
and the selection module is used for randomly selecting pictures from the pictures to be downloaded, wherein the number of the selected pictures to be downloaded is less than or equal to the preset value or the storage capacity of the selected pictures to be downloaded is less than or equal to the storage limit value of the terminal.
10. The picture downloading device of claim 6, wherein the selected selection policy is a de-duplication selection policy;
the selection module is used for determining a non-repeated picture from the pictures to be downloaded based on picture similarity operation; and selecting one or more non-repeated pictures from the pictures to be downloaded, wherein the number of the selected pictures to be downloaded is less than or equal to the preset value or the storage capacity of the selected pictures to be downloaded is less than or equal to the storage limit value of the terminal.
11. A picture downloading device is characterized by comprising a processor and a memory;
the memory stores an application program executable by the processor for causing the processor to execute the picture downloading method according to any one of claims 1 to 5.
12. A computer-readable storage medium having computer-readable instructions stored therein for performing the picture downloading method according to any one of claims 1 to 5.
CN201911142275.8A 2019-11-20 2019-11-20 Picture downloading method and device and computer readable storage medium Active CN110941380B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201911142275.8A CN110941380B (en) 2019-11-20 2019-11-20 Picture downloading method and device and computer readable storage medium

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201911142275.8A CN110941380B (en) 2019-11-20 2019-11-20 Picture downloading method and device and computer readable storage medium

Publications (2)

Publication Number Publication Date
CN110941380A CN110941380A (en) 2020-03-31
CN110941380B true CN110941380B (en) 2022-02-22

Family

ID=69907931

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201911142275.8A Active CN110941380B (en) 2019-11-20 2019-11-20 Picture downloading method and device and computer readable storage medium

Country Status (1)

Country Link
CN (1) CN110941380B (en)

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1852431A (en) * 2005-12-23 2006-10-25 华为技术有限公司 System and method for realizing video frequency information sharing
CN103023996A (en) * 2012-11-30 2013-04-03 江苏乐买到网络科技有限公司 Cloud data storage system
CN105227598A (en) * 2014-06-11 2016-01-06 腾讯科技(深圳)有限公司 A kind of resource sharing method, device and system stored based on cloud
CN109743317A (en) * 2018-12-30 2019-05-10 湖北知本信息科技有限公司 One kind being based on the self-destructed cloud storage data download method of data

Family Cites Families (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US9405767B2 (en) * 2013-05-01 2016-08-02 Microsoft Technology Licensing, Llc Streaming content and placeholders
CN105786539B (en) * 2014-12-24 2020-03-27 阿里巴巴集团控股有限公司 File downloading method and device

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1852431A (en) * 2005-12-23 2006-10-25 华为技术有限公司 System and method for realizing video frequency information sharing
CN103023996A (en) * 2012-11-30 2013-04-03 江苏乐买到网络科技有限公司 Cloud data storage system
CN105227598A (en) * 2014-06-11 2016-01-06 腾讯科技(深圳)有限公司 A kind of resource sharing method, device and system stored based on cloud
CN109743317A (en) * 2018-12-30 2019-05-10 湖北知本信息科技有限公司 One kind being based on the self-destructed cloud storage data download method of data

Also Published As

Publication number Publication date
CN110941380A (en) 2020-03-31

Similar Documents

Publication Publication Date Title
EP3125135B1 (en) Picture processing method and device
CN106155789B (en) Application freezing method and mobile terminal
CN109359091B (en) File management method, device, terminal and computer readable storage medium
CN112714359B (en) Video recommendation method and device, computer equipment and storage medium
CN109976668A (en) Data-erasure method, data deletion apparatus and computer readable storage medium
US20160092441A1 (en) File Acquiring Method and Device
CN111198856A (en) File management method and device, computer equipment and storage medium
CN111598176B (en) Image matching processing method and device
CN110580508A (en) video classification method and device, storage medium and mobile terminal
CN109408469A (en) Stale data document handling method, device, electronic device and storage medium
CN110727810B (en) Image processing method, device, electronic equipment and storage medium
CN108958592B (en) Video processing method and related product
CN109034242B (en) Grading method, device and system of image processing algorithm
CN110941380B (en) Picture downloading method and device and computer readable storage medium
CN109246280B (en) Address book cloud processing method and device, computer equipment and readable storage medium
CN104424109B (en) Information processing method and electronic equipment
CN111625166B (en) Picture display method and device
CN111444143A (en) Picture centralized picture display method and device and mobile terminal
CN103093213A (en) Video file classification method and terminal
CN109255214B (en) Authority configuration method and device
CN111353063B (en) Picture display method, device and storage medium
CN108763395B (en) Document processing method and related product
CN110471793B (en) Data backup method, data recovery method, first terminal and second terminal
CN106874285B (en) Photo file processing method and terminal equipment
CN111639634B (en) OCR (optical character recognition) method and electronic equipment

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant