CN107153712B - Personalized customized picture management method supporting time-space association of mobile terminal - Google Patents

Personalized customized picture management method supporting time-space association of mobile terminal Download PDF

Info

Publication number
CN107153712B
CN107153712B CN201710383223.4A CN201710383223A CN107153712B CN 107153712 B CN107153712 B CN 107153712B CN 201710383223 A CN201710383223 A CN 201710383223A CN 107153712 B CN107153712 B CN 107153712B
Authority
CN
China
Prior art keywords
time
picture
cluster
geohash
pictures
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN201710383223.4A
Other languages
Chinese (zh)
Other versions
CN107153712A (en
Inventor
窦万春
刘心雨
刘祥
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Nanjing University
Original Assignee
Nanjing University
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Nanjing University filed Critical Nanjing University
Priority to CN201710383223.4A priority Critical patent/CN107153712B/en
Publication of CN107153712A publication Critical patent/CN107153712A/en
Application granted granted Critical
Publication of CN107153712B publication Critical patent/CN107153712B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/50—Information retrieval; Database structures therefor; File system structures therefor of still image data
    • G06F16/51—Indexing; Data structures therefor; Storage structures
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/50—Information retrieval; Database structures therefor; File system structures therefor of still image data
    • G06F16/58—Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually
    • G06F16/5866—Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually using information manually generated, e.g. tags, keywords, comments, manually generated location and time information

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Data Mining & Analysis (AREA)
  • Databases & Information Systems (AREA)
  • Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Software Systems (AREA)
  • Library & Information Science (AREA)
  • Television Signal Processing For Recording (AREA)
  • Studio Devices (AREA)

Abstract

本发明公开了支持移动终端的时间空间关联的个性化定制图片管理方法，包括：步骤1，确定旅行的开始时间，在完成旅行时确定结束时间；步骤2，确定移动终端相册文件夹中在上述时间段内拍摄的图片；步骤3，计算所有图片的Geohash编码值并保存到本地缓存；步骤4，初始化地图显示比例与图片簇在移动终端地图界面上的显示；步骤5，确定Geohash编码前缀长度；步骤6，比较图片簇的Geohash编码前缀长度与新生成的前缀长度大小，对图片簇进行聚集或者分裂，并计算每个新图片簇显示的时间信息；步骤7，更新移动终端地图界面的图片簇标记、时间信息和“箭头”标记。

Figure 201710383223

The invention discloses a personalized customized picture management method supporting time-space association of a mobile terminal, comprising: step 1, determining the start time of the trip, and determining the end time when the trip is completed; step 2, determining the mobile terminal album folder in the above-mentioned The pictures taken in the time period; Step 3, calculate the Geohash code values of all pictures and save them to the local cache; Step 4, initialize the display of the map display scale and the picture cluster on the map interface of the mobile terminal; Step 5, determine the length of the Geohash code prefix ; Step 6, compares the Geohash coding prefix length of the picture cluster and the newly generated prefix length, gathers or splits the picture cluster, and calculates the time information displayed by each new picture cluster; Step 7, update the picture of the mobile terminal map interface Cluster markers, time information, and "arrow" markers.

Figure 201710383223

Description

Personalized customized picture management method supporting time-space association of mobile terminal
Technical Field
The invention relates to the field of Internet mobile terminal software application, in particular to a personalized customized picture management method supporting time-space association of a mobile terminal.
Background
With the rapid development of the internet and mobile terminal technology, the mobile terminal has a strong processing capability, and the mobile terminal is changing from a simple conversation tool to an integrated information processing platform, which also increases a wider development space for the mobile terminal.
The mobile terminal refers to a computer device that can be used in mobile, and broadly includes a mobile phone, a notebook, a tablet computer, and other devices. Mobile terminals have been developed as simple communication devices with mobile communications for decades. From 2007, the gene mutation of the mobile terminal is intelligently triggered, and the traditional positioning of the terminal as a mobile network terminal is fundamentally changed. The subversive change caused by the mobile intelligent terminal opens the sequence of mobile internet industry development and opens a new technical industry period. With the continuous development of the mobile intelligent terminal, the influence of the mobile intelligent terminal is more extensive than that of a shoulder radio, a television and the internet (PC), and the mobile intelligent terminal becomes a 4 th terminal product which has wide penetration, rapid popularization and great influence and can reach the aspects of human social life historically.
Today's mobile terminals can not only communicate, take pictures, listen to music, play games, but also realize rich functions including positioning, information processing, bar code scanning, IC card scanning, etc., and the mobile terminals have been deeply integrated into our economic and social lives, and are greatly changing people's daily life style.
On the other hand, as the living standard and consumption standard of people are improved, more and more people choose to go out to travel to get a rest from busy work and develop their own visual field. In the process of traveling, mobile terminal devices such as tablets and mobile phones are widely used for taking pictures in the process of traveling due to the characteristics of convenience in carrying, relatively low price, simplicity in operation and the like. The expansion of the capacity and power of mobile terminals makes the number of pictures taken by the terminals during travel increasingly large, which makes the time overhead for managing these pictures at the end of travel greater. Considering that the mobile terminal itself often has certain computing power, it becomes possible to automatically manage the travel pictures in a local intelligent way.
At present, a plurality of methods for managing pictures of the mobile terminal have achieved some achievements. Chinese patent "photo management method and apparatus and mobile terminal", application number: CN201510346832.3, grant bulletin number CN104933146A discloses a photo management method for mobile terminals. The method comprises the following steps: and acquiring a label corresponding to the shot picture according to a preset label, adding a label to the picture, and storing the picture according to the label. The method aims to manage the photos according to the tags of the photos, the storage mode is rich, in addition, in the storage mode, the photos can be quickly and accurately searched according to the tags when being searched, and the photo searching efficiency is very high.
However, the above-mentioned picture management method does not introduce information such as picture position and shooting time, and performs automatic management by associating the space and time of the picture. However, under the current situation of increasingly higher living standard, more and more people often choose to go out for travel, and the hidden information is often of particular significance.
Disclosure of Invention
The purpose of the invention is as follows: the invention provides a space-time associated personalized picture management method aiming at the picture management of a mobile terminal and combining picture shooting position information and time information, and is convenient for people to check the information such as the picture shooting time and position while checking the picture.
Aiming at the defects of the prior art, the invention provides a personalized customized picture management method supporting time-space association of a mobile terminal.
In order to solve the technical problem, the invention discloses a personalized customized picture management method supporting time-space association of a mobile terminal, which comprises the following steps:
step 1, before a trip starts, a user clicks a mobile terminal to determine the starting time of the trip, and determines the ending time of the trip when the trip is finished;
step 2, traversing a local album folder on the mobile terminal, and finding out the picture with the shooting time in the period according to the time range in the step 1;
step 3, calculating the Geohash code values of all the pictures in the step 2 and storing the Geohash code values into a local cache;
step 4, determining the initial scaling of the map according to the Geohash coding values of all the pictures, initializing the map and marks of the picture clusters on the map, and enabling a user to click the picture clusters to view the pictures in the picture clusters;
step 5, determining the Geohash coding prefix length when each operation is finished according to the zooming gesture of the user on the map;
step 6, comparing the Geohash coding prefix length of the current picture cluster with the Geohash coding prefix length newly generated in the step 5, if the former is larger, some picture clusters need to be gathered, and if the latter is larger, each picture cluster needs to be traversed and some picture clusters need to be split; if the two lengths are equal, the picture cluster is not changed. For a newly generated picture cluster, the displayed time information of the picture cluster needs to be updated;
and 7, updating and displaying the user operation result on a map interface of the mobile terminal, wherein the updating and displaying result comprises the mark of the picture cluster on the map, the display of the picture cluster time information and the addition of an arrow mark between the picture clusters, and the user can view the pictures in the picture cluster by clicking the picture cluster.
In step 2 of the present invention, when a user starts a trip, it is necessary to determine a trip start time on the mobile terminal, which is recorded as time _ start, and when the trip ends, it is also necessary to determine a trip end time on the mobile terminal, which is recorded as time _ end. After the travel is finished, it is necessary to extract the picture taken during the travel according to the picture taking time. Traversing a local folder on the mobile terminal, extracting the shooting time _ taken of each picture file, and if the conditions are met: and time _ start is less than or equal to time _ taken is less than or equal to time _ end, which indicates that the picture is shot in the period, and then the picture is recorded. The set of pictures p ═ { p } taken during the trip can then be obtained1,p2,…,pNAnd (5) taking the number of the pictures shot in the period as N, taking the value of N as a natural number, and using time _ takentRepresenting the t-th picture pt(1. ltoreq. t. ltoreq.N).
In step 3 of the invention, a Geohash code with base32 coding length of 9 is adopted, the coding mode converts two-dimensional longitude and latitude into character strings, and 32 letters of 0-9 and b-z (a, i, l and o are removed) are used for carrying out base32 coding. When the coding length is 9, the maximum positioning precision can be theoretically reached to be about 2 meters. For a Geohash code, the approximate longitude and latitude before coding can be obtained by decoding.
In the present invention, for the set P ═ P1,p2,…,pNEach picture p int(1. ltoreq. t. ltoreq.N), the longitude lng of the shooting position thereof can be extractedtAnd latitude lattCalculating the Geohash code value geohtAnd the data is stored in a cache of the mobile terminal and can be directly accessed, so that repeated calculation is avoided.
In the invention, a plurality of picture clusters are displayed on a map of the mobile terminal, and each picture cluster is a set of a plurality of pictures. In step 4, the set of all the picture clusters is denoted as C ═ C1,c2,…,cmAnd (4) defining a set C to store all picture clusters, wherein only one picture cluster is stored at the beginning, namely all pictures are stored in the same picture cluster, and then the picture cluster is aggregated or split, and the number of the picture clusters is m, namely m is the most openInitially 1. c. C1Represents the first picture cluster, wherein the ith picture cluster is represented as
Figure BDA0001305657210000031
Wherein
Figure BDA0001305657210000032
Represents the ith picture cluster ciJ is more than or equal to 1 and is less than or equal to n in the jth picturei，niRepresenting a cluster of pictures ciThe number of the middle pictures, i is more than or equal to 1 and less than or equal to m, m is a natural number, and ciHaving four attribute values (geolen)i,timei,geoh_commoni,time_firstiTherein, geoleniDenotes ciThe Geohash codes the prefix length and timeiDenotes ciTime information of display, geoh _ commoniDenotes ciGeohash encoding, time _ firstiDenotes ciThe time of the earliest taken picture in the group;
in step 4 of the invention, when the user views the travel album, the map of the mobile terminal needs to be initialized first. All pictures are stored in the same picture cluster, i.e. C ═ C1}，c1＝{p1,p2,...,pNAre multiplied by
Figure BDA0001305657210000041
Wherein geolen1Denotes c1Geohash of (c) encodes a prefix length, geoh _ common1Denotes c1Time first, time _ first1Denotes c1Time of the earliest taken picture.
In step 4 of the invention, a picture cluster c needs to be calculated1Corresponding time information time needing to be displayed1. If c is1Only one picture or a plurality of pictures are taken but the shooting time is completely the same, the time is set1The format is set to "xx minutes xx seconds at xx according to the shooting time of the picture. Otherwise, according to c1The most specific same shooting time of all pictures (the most specific same shooting time meansThe same shooting time of the finest granularity of all pictures in the same picture cluster is acquired through a mobile terminal) is divided into 6 different situations:
(1) the most specific same shooting time is 'year', the time is set1Is arranged in a format of "xx years",
(2) the most specific same shooting time is 'month', then the time is set1Set in the format "xx months in xx years",
(3) the most specific same shooting time is 'day', the time is set1Arranged in the format of "xx months xx days xx years",
(4) the most specific same shooting time is 'time', the time is set1Set to the format "xx month xx day xx hour",
(5) the most specific same shooting time is divided into minutes, and then the time is determined1Is set to be in a format of "xx days xx hours xx minutes",
(6) otherwise, the time is set1Set to an empty string.
In step 4 of the invention, the map magnification levels of the mobile terminal are set to be k in total from 1 to k (considering that the magnification levels of common maps are all larger than 10, k is set to be larger than or equal to 10), and the number increase represents the map magnification. The picture cluster c needs to be marked on the map during initialization1And displaying c above the picture cluster1Time attribute of (2)1. At initialization, the map magnification level is set to 1, and the Geohash is coded as geoh _ common on the map1Mark a cluster of pictures c1While c is displayed above the mark1Time attribute of (2)1。
In step 5 of the present invention, after initialization, since the user may perform an operation of zooming in or zooming out on the map of the mobile terminal, the original image clusters may be split or aggregated. After the user operation is finished, the map amplification level is d, d is more than or equal to 1 and less than or equal to k, and the Geohash coding prefix length geolen _ new of the new picture cluster is calculated by the following formula:
Figure BDA0001305657210000042
where k is the map magnification level.
In step 6 of the present invention, when the zoom operation of the user on the map is finished, the cluster of pictures is C ═ C1,c2,...,cmComparing the Geohash coding prefix length of each picture cluster in the set C with the Geohash coding prefix length obtained in the step 5, and aggregating or splitting the picture clusters according to the sizes of geolen _ new and geolen, wherein three conditions exist:
(1) geolen _ new is smaller than geolen, when c is clustered for any picturei(i is more than or equal to 1 and less than or equal to m), mixing the geoh _ commoniMerging the picture clusters with the prefixes with the same Geohash _ new length into a new picture cluster, deleting a plurality of picture clusters before merging, updating the Geohash coding prefix length geolen of the new picture cluster to be geolen _ new, and updating the Geohash coding geoh _ common of the new picture cluster to be the longest common prefix of all the picture Geohash codes;
(2) geolen _ new is greater than geolen, when clustering for each picture
Figure BDA0001305657210000051
To ciAny picture in (1)
Figure BDA0001305657210000052
The Geohash coded value of
Figure BDA0001305657210000053
Will have the same geolen _ new length prefix
Figure BDA0001305657210000054
If a plurality of picture clusters are formed, the original picture cluster is divided into a plurality of new picture clusters, finally, for each picture cluster, the Geohash coding prefix length geolen of the new picture cluster is updated to be geolen _ new, and the Geohash coding geoh _ connon of the new picture cluster is updated to be the longest public prefix of the Geohash coding of all the pictures;
(3) geolen _ new equals Geolen, arbitrary Picture Cluster ci(1. ltoreq. i. ltoreq.m) without any change.
In step 6 of the present invention, when a new picture cluster is generated due to a user operation, the displayed time information time of each new picture cluster needs to be updated. If the picture cluster has only one picture or a plurality of pictures but the shooting time is completely the same, the time is set to be in the format of xx minutes xx seconds at xx according to the shooting time of the pictures. Otherwise, dividing the pictures into 6 different conditions according to the most specific same shooting time of all the pictures in the picture cluster:
(1) the most specific same photographing time is "year", the time is set in the format of "xx year",
(2) the most specific same photographing time is "month", time is set in the format of "xx months in xx",
(3) the most specific same shooting time is "day", time is set in the format of "xx month xx day xx year",
(4) the most specific same shooting time is "time", the time is set in the format of "xx month xx day xx time",
(5) the most specific same shooting time is "minute", time is set in the format "xx minutes on xx days xx",
(6) otherwise, time is set to the null string.
In step 7 of the present invention, when the user finishes zooming the map, the picture cluster needs to be displayed on the map of the terminal. Setting the map to a magnification level d and marking all clusters of pictures c on the mapi(1 ≦ i ≦ m) Geohash encoding of the marker position to geoh _ commoniWhile c is displayed above the markiTime attribute of (2)i。
In step 7 of the invention, for different picture clusters, each picture cluster represents pictures shot at different places, so that the picture clusters have a temporal precedence relationship, and the arrow marks are added among the picture clusters according to the invention. When all the picture clusters are C ═ C1,c2,…,cmFind out any picture cluster
Figure BDA0001305657210000061
Time _ first of the earliest captured picture in the picturei(1≤i≤m), the calculation formula is:
Figure BDA0001305657210000062
wherein
Figure BDA0001305657210000063
Represents a cluster ciTime of taking the jth picture, niIs a cluster ciThe number of the middle pictures, and then according to the picture cluster ciTime _ first of the earliest captured picture in the pictureiThe picture clusters are sorted from small to large, and the marks of 'arrows' pointing from the former to the latter are added among the corresponding picture clusters on the map according to the sorted order.
In the invention, the pictures recorded in the picture cluster can be checked by clicking the picture cluster. Meanwhile, the user can customize the time information and the arrow mark of whether the picture cluster needs to be displayed.
The idea of the invention is as follows: firstly, finding out pictures shot during the travel in a file manager of the mobile terminal according to the travel starting time and the travel ending time determined by a user; then calculating a Geohash coding value for each picture and storing the Geohash coding value in a cache to avoid repeated calculation; then initializing the display of a mobile terminal map and a picture cluster; and finally, determining the prefix length of the current Geohash code according to the zooming operation of a user on the map of the mobile terminal, splitting or aggregating the picture clusters, calculating the time information displayed above the new picture cluster mark, and adding an arrow mark representing the sequence of the picture clusters. Clicking on a picture cluster can view the pictures in the picture cluster.
Compared with the prior art, the invention has the beneficial effects that:
(1) the information such as the position, the shooting time and the like of the picture is introduced, the space and the time of the picture are associated for automatic management, and people can conveniently check the information such as the shooting time, the position and the like of the picture while checking the picture.
(2) The picture shooting time sequence relation is included, and the user can be helped to recall the experience of the trip and the travel.
(3) The display of the time information of the picture cluster can ensure the maximum granularity as much as possible, and a user can view more specific time information.
(4) The user can personalize the time information and the "arrow" mark whether to display the picture cluster.
Drawings
The foregoing and other advantages of the invention will become more apparent from the following detailed description of the invention when taken in conjunction with the accompanying drawings.
FIG. 1 is a flow chart of the steps of the present invention.
FIG. 2 is a flow chart of an embodiment of the present invention.
Detailed Description
The invention is further explained below with reference to the drawings and the embodiments.
The invention discloses a personalized customized picture management method supporting time-space association of a mobile terminal, which comprises the following steps:
step 1, before a trip starts, a user clicks a mobile terminal to determine the starting time of the trip, and determines the ending time of the trip when the trip is finished;
firstly, the user determines the starting time as time _ start and the ending time as time _ end at the terminal when the user moves.
Step 2, traversing a local album folder on the mobile terminal, and finding out the picture with the shooting time in the period according to the time range in the step 1;
then, the system traverses the local folder on the mobile terminal, extracts the shooting time _ taken of each picture file, and if the conditions are met: and time _ start is less than or equal to time _ taken is less than or equal to time _ end, which indicates that the picture is a picture shot in the period, and the picture is recorded. The picture set P ═ { P } taken during travel can be obtained1,p2,…,pNN is the number of pictures taken during this period, time _ takentRepresents ptThe shooting time (t is more than or equal to 1 and less than or equal to N).
Step 3, calculating the Geohash code values of all the pictures in the step 2 and storing the Geohash code values into a local cache;
second, for set P ═ P1,p2,…,pNEach picture p int(1. ltoreq. i.ltoreq.N), the longitude lng of the shooting position thereof can be extractedtAnd latitude lattCalculating the Geohash code value geohtAnd the data is stored in a cache of the mobile terminal and can be directly accessed, so that repeated calculation is avoided.
Step 4, determining the initial scaling of the map according to the Geohash coding values of all the pictures, initializing the map and marks of the picture clusters on the map, and enabling a user to click the picture clusters to view the pictures in the picture clusters;
then, a map interface of the mobile terminal is initialized. All pictures are stored in the same picture cluster, i.e. C ═ C1}，c1＝{p1,p2,...,pNAre multiplied by
Figure BDA0001305657210000071
Wherein geolen1Denotes c1Geohash of (c) encodes a prefix length, geoh _ common1Denotes c1Time first, time _ first1Denotes c1Time of the earliest taken picture.
At the same time, the picture cluster c needs to be calculated1Corresponding time information time needing to be displayed1. If c is1Only one picture or a plurality of pictures are taken but the shooting time is completely the same, the time is set1The format is set to "xx minutes xx seconds at xx according to the shooting time of the picture. Otherwise, according to c1The most specific same shooting time of all the pictures is divided into 6 different cases:
(1) the most specific same shooting time is 'year', the time is set1Is arranged in a format of "xx years",
(2) the most specific same shooting time is 'month', then the time is set1Set in the format "xx months in xx years",
(3) the most specific same shooting time is day", then time will be1Arranged in the format of "xx months xx days xx years",
(4) the most specific same shooting time is 'time', the time is set1Set to the format "xx month xx day xx hour",
(5) the most specific same shooting time is divided into minutes, and then the time is determined1Is set to be in a format of "xx days xx hours xx minutes",
(6) otherwise, the time is set1Set to an empty string.
You can initialize the map interface of the mobile terminal by setting the map zoom level to 1 and Geohash coding as Geoh _ common on the map1Mark a cluster of pictures c1While c is displayed above the mark1Time attribute of (2)1。
Step 5, determining the Geohash coding prefix length when each operation is finished according to the zooming gesture of the user on the map;
and finally, the map interface of the mobile terminal continuously responds to the gesture operation of the user, so the step 5-7 is a circulating process until the user exits the map interface of the mobile terminal and the circulation is finished.
In step 5 of the invention, after the user operation is finished, if the map magnification level is d (d is more than or equal to 1 and less than or equal to k), the Geohash coding prefix length geolen _ new of the new picture cluster is calculated, and the calculation formula is as follows:
Figure BDA0001305657210000081
where k is the map magnification level.
And 6, comparing the Geohash coding prefix length of the current picture cluster with the Geohash coding prefix length newly generated in the step 5, if the Geohash coding prefix length is larger, gathering some picture clusters, and if the Geohash coding prefix length is larger, traversing each picture cluster and splitting some picture clusters, otherwise, the picture clusters are not changed. For a newly generated picture cluster, the displayed time information of the picture cluster needs to be updated;
in step 6 of the present invention, first, it is necessary to first prepare the gelSize of en _ new and geolen, clustering or splitting picture cluster, where C ═ C1,c2,…,cmThere are three cases:
(1) geolen _ new is smaller than geolen, when c is clustered for any picturei(i is more than or equal to 1 and less than or equal to m), mixing the geoh _ commoniMerging the picture clusters with the prefixes with the same Geohash _ new length into a new picture cluster, deleting a plurality of picture clusters before merging, updating the Geohash coding prefix length geolen of the new picture cluster to be geolen _ new, and updating the Geohash coding geoh _ common of the new picture cluster to be the longest common prefix of all the picture Geohash codes;
(2) geolen _ new is greater than geolen, when clustering for each picture
Figure BDA0001305657210000082
To ciAny picture in (1)
Figure BDA0001305657210000091
The Geohash coded value of
Figure BDA0001305657210000092
Will have the same geolen _ new length prefix
Figure BDA0001305657210000093
If a plurality of picture clusters are formed, the original picture cluster is divided into a plurality of new picture clusters, finally, for each picture cluster, the Geohash coding prefix length geolen of the new picture cluster is updated to be geolen _ new, and the Geohash coding geoh _ common of the new picture cluster is updated to be the longest common prefix of all the Geohash codes of the pictures;
(3) geolen _ new equals Geolen, arbitrary Picture Cluster ci(1. ltoreq. i. ltoreq.m) without any change.
In step 6 of the present invention, the time attribute time of each new picture cluster needs to be updated. If the picture cluster has only one picture or a plurality of pictures but the shooting time is completely the same, the time is set to be in the format of xx minutes xx seconds at xx according to the shooting time of the pictures. Otherwise, dividing the pictures into 6 different conditions according to the most specific same shooting time of all the pictures in the picture cluster:
(1) the most specific same photographing time is "year", the time is set in the format of "xx year",
(2) the most specific same photographing time is "month", time is set in the format of "xx months in xx",
(3) the most specific same shooting time is "day", time is set in the format of "xx month xx day xx year",
(4) the most specific same shooting time is "time", the time is set in the format of "xx month xx day xx time",
(5) the most specific same shooting time is "minute", time is set in the format "xx minutes on xx days xx",
(6) otherwise, time is set to the null string.
And 7, updating and displaying the operation result of the user on a map interface of the mobile terminal, wherein the updating and displaying comprises the mark of the picture cluster on the map, the display of the time information of the picture cluster and the addition of the arrow mark between the picture clusters, and the user can check the pictures in the picture cluster by clicking the picture cluster.
In step 7 of the present invention, when the user finishes zooming the map, the picture cluster needs to be displayed on the map of the terminal. Setting the map to zoom level j and marking all picture clusters c on the mapi(1 ≦ i ≦ m) Geohash encoding of the marker position to geoh _ commoniWhile c is displayed above the markiTime attribute of (2)i. In addition, for different picture clusters, each picture cluster represents pictures shot at different places, so that the picture clusters have a temporal precedence relationship, and an arrow mark is added between the picture clusters. When all the picture clusters are C ═ C1,c2,…,cmFind out any picture cluster
Figure BDA0001305657210000094
Time _ first of the earliest captured picture in the picturei(i is more than or equal to 1 and less than or equal to m), and the calculation formula is as follows:
Figure BDA0001305657210000095
wherein
Figure BDA0001305657210000101
Represents a cluster ciTime of taking the jth picture, niIs a cluster ciThe number of middle pictures, and then the time _ firsti(1 ≦ i ≦ m) ordered from small to large, with the addition of "arrow" marks from the former straight to the latter between the clusters of pictures that they represent.
Examples
The present embodiment uses a data set where a traveler plays on Zhongshan mountain on 28/12/2016 and randomly takes several pictures along the way using a smartphone to perform experiments.
Before travel, a traveler determines that the travel start time is 2016, 12, 28, 9, 12, 13, minutes and 13 seconds (the Unix timestamp is 1482887533 seconds), and when the travel ends, the traveler determines that the travel end time is 2016, 12, 28, 17, 16, 11, minutes and 11 seconds (the Unix timestamp is 1482916571 seconds).
After the travel is finished, a certain traveler wants to check the pictures shot in the travel, opens the mobile phone album, selects the travel, and jumps to the map interface. Firstly, the mobile phone system traverses a local album folder and searches for a picture with shooting time t (represented by a Unix timestamp) of 1482887533-1482916571.
Then, the system extracts the longitude and latitude of the shooting place of the pictures, calculates the Geohash code of each picture and stores the Geohash code in the mobile phone cache to obtain the pictures and the corresponding Geohash codes and other information, as shown in Table 1.
TABLE 1 information of pictures taken during travel
Figure BDA0001305657210000102
Figure BDA0001305657210000111
Then, initialize the map interface of the smart phone: the map enlargement level has 16 levels (the larger the number is, the map enlargement is), namely k is 16, and C is { C { (C) } in the case that k is 161}，c1＝{p1,p2,…,p20And is obtained from the formula (1)
Figure BDA0001305657210000112
Then calculate the time1Is "2016, 12 months, 28 days". The system sets the map magnification level to 1, marking c at the geo-hash code of "wtsw 2" (i.e., the longitude and latitude are 118.82814646, 32.03615427, respectively) of the map1While the time "2016, 12, and 28 days" is noted above the marker.
And finally, the map interface of the mobile terminal continuously responds to the gesture operation of the user. For example, when the user zooms in the map and the zoom level of the map is 11, the Geohash encoding prefix length is 6 at this time, and C ═ C is calculated by equation (2)1Will be split into three new clusters of pictures, c respectively1＝{p1,p2,…,p5}，c2＝{p6,p7,…,p17}，c3＝{p18,p19,p20}. At this time, C ═ C1,c2,c3H, update c1,c2,c3The Geohash code prefix length of 6, update c1,c2,c3The Geohash codes of (1) are "wtsw 26", "wtsw 2 s" and "wtsw 2 t", respectively. At the same time, c is calculated1,c2,c3Time of (1) are "10 hours on 28 th 12 month", "28 days on 12 month 2016", and "15 hours on 28 th 12 month 12".
At this time, the map of the mobile terminal will be set to a zoom level of 11, and a mark c is marked on the map where the geo-hash is coded as "wtsw 26" (i.e. the longitude and latitude are 118.83913279 and 32.04714060, respectively)1On the map, mark c is marked at the position where Geohash is coded as 'wtsw 2 s' (namely, the position where longitude and latitude are 118.85011911 and 32.05812693 respectively)2On the map, mark c is marked at the position where Geohash is coded as 'wtsw 2 t' (namely, the position where longitude and latitude are 118.85011911 and 32.06362009 respectively)3At c, in1,c2,c3The times "12 month, 28 days 10", "2016 year, 12 month, 28 days" and "12 month, 28 days, 15" are indicated above the marks. Then find out c respectively1,c2,c3Calculating the time of the earliest shot picture by using a formula (3) to obtain the time _ first1,time_first2,time_first31482891165, 1482895822 and 1482909225, respectively, and thus c is added1Point of direction c2And from c2Point of direction c3Is marked by the "arrow".
The map interface of the mobile terminal can respond to the gesture operation of the user circularly until the user exits the map album.
The present invention provides a personalized customized picture management method supporting temporal spatial correlation of a mobile terminal, and a method and a way for implementing the technical solution are many, and the above description is only a preferred embodiment of the present invention, and it should be noted that, for those skilled in the art, a plurality of improvements and embellishments can be made without departing from the principle of the present invention, and these improvements and embellishments should also be regarded as the protection scope of the present invention. All the components not specified in the present embodiment can be realized by the prior art.

Claims (7)

1.支持移动终端的时间空间关联的个性化定制图片管理方法，其特征在于，包括以下步骤：1. the personalized custom picture management method supporting the time-space association of the mobile terminal, is characterized in that, comprises the following steps: 步骤1，在旅行开始之前，确定旅行的开始时间time_start，在完成旅行时确定旅行结束时间time_end，得到时间范围；Step 1: Before the start of the trip, determine the start time time_start of the trip, and determine the end time time_end of the trip when the trip is completed to obtain the time range; 步骤2，遍历移动终端上的本地相册，根据步骤1中的时间范围查询出拍摄时间在此范围的图片；Step 2, traverse the local albums on the mobile terminal, and query the pictures whose shooting time is in this range according to the time range in Step 1; 步骤3，对步骤2中的所有图片计算其Geohash编码值并保存；Step 3, calculate its Geohash code value for all pictures in step 2 and save; 步骤4，根据所有图片的Geohash编码值确定地图初始缩放比例，初始化地图以及图片簇在地图上的标记；Step 4, determine the initial zoom ratio of the map according to the Geohash coding value of all the pictures, initialize the map and the mark of the picture cluster on the map; 步骤5，确定用户每次操作完成时Geohash编码前缀长度；Step 5: Determine the length of the Geohash encoding prefix when the user completes each operation; 步骤6，将当前图片簇的Geohash编码前缀长度与步骤5新生成的Geohash编码前缀长度进行对比，如果前者更大，则对图片簇进行聚集；如果后者更大，则遍历每个图片簇并对图片簇进行分裂；如果两者长度相等，则图片簇不发生变化；对于新生成的图片簇，更新其显示的时间信息；Step 6: Compare the Geohash coding prefix length of the current picture cluster with the newly generated Geohash coding prefix length in Step 5. If the former is larger, the picture clusters are aggregated; if the latter is larger, traverse each picture cluster and Split the picture cluster; if the lengths of the two are equal, the picture cluster will not change; for the newly generated picture cluster, update the time information displayed; 步骤7，在移动终端的地图界面更新显示结果；Step 7, update the display result on the map interface of the mobile terminal; 步骤2包括：遍历移动终端上的本地相册，对每一个图片文件，提取它的拍摄时间time_taken，如果满足time_start≤time_taken≤time_end，表示该图片是此期间拍摄的图片，则记录该图片；遍历本地相册后得到图片集合P＝{p1，p2，...，pN}，其中N为在此期间拍摄的图片的个数，N取值为自然数，用time_takent表示第t个图片pt的拍摄时间，1≤t≤N；Step 2 includes: traversing the local albums on the mobile terminal, extracting its shooting time time_taken for each picture file, and if time_start≤time_taken≤time_end is satisfied, indicating that the picture is a picture taken during this period, then recording the picture; traversing the local After the album, a set of pictures P={p 1 , p 2 , ..., p N } is obtained, where N is the number of pictures taken during this period, N is a natural number, and time_taken t represents the t-th picture p The shooting time of t , 1≤t≤N; 步骤3包括：采用base32编码长度为9的Geohash编码，遍历图片集合户中的每个图片，提取其拍摄位置的经度和纬度，计算出Geohash编码值，并保存到移动终端的缓存中，第t个图片pt拍摄位置的经度记为lngt、纬度记为latt、Geohash编码值记为geoht；Step 3 includes: adopting Geohash encoding with base32 encoding length of 9, traversing each picture in the picture collection household, extracting the longitude and latitude of its shooting location, calculating the Geohash encoding value, and saving it into the cache of the mobile terminal, the t th The longitude of the shooting position of each picture p t is recorded as lng t , the latitude is recorded as lat t , and the Geohash code value is recorded as geoh t ; 步骤4包括：Step 4 includes: 所有图片簇的集合记为C＝{c1，c2，...，cm}，其中第i个图片簇表示为
Figure FDA0002388892010000011
Figure FDA0002388892010000012
其中
Figure FDA0002388892010000013
表示第i个图片簇ci中第j个图片，1≤j≤ni，ni表示图片簇ci中图片个数，1≤i≤m，m取值为自然数，且ci具有四个属性值{geoleni，timei，geoh_commoni，time_firsti}，其中，geoleni表示ci的Geohash编码前缀长度、timei表示ci显示的时间信息、geoh_commoni表示ci的Geohash编码、time_firsti表示ci中最早拍摄的图片的时间；The set of all picture clusters is denoted as C={c 1 , c 2 , ..., cm }, where the i -th picture cluster is denoted as
Figure FDA0002388892010000011
Figure FDA0002388892010000012
in
Figure FDA0002388892010000013
Indicates the j-th picture in the i-th picture cluster c i , 1≤j≤n i , n i indicates the number of pictures in the picture cluster c i , 1≤i≤m, m is a natural number, and c i has four attribute values {geolen i , time i , geoh_common i , time_first i }, where geolen i represents the Geohash encoding prefix length of ci, time i represents the time information displayed by ci , geoh_common i represents the Geohash encoding of ci, time_first i represents the time of the earliest picture taken in c i ; 初始化地图时，所有图片保存在同一个图片簇中，即C＝{c1}，c1＝{p1，p2，...，pN}，且：When initializing the map, all pictures are stored in the same picture cluster, ie C={c 1 }, c 1 ={p 1 , p 2 , . . . , p N }, and:
Figure FDA0002388892010000021
Figure FDA0002388892010000021
 其中geolen1表示c1的Geohash编码前缀长度，geoh_common1表示c1的Geohash编码，time_first1表示c1的最早拍摄的图片的时间。Among them, geolen 1 represents the Geohash encoding prefix length of c 1 , geoh_common 1 represents the Geohash encoding of c 1 , and time_first 1 represents the time of the earliest captured picture of c 1 . 2.根据权利要求1所述的方法，其特征在于，步骤4中，需要确定图片簇c1对应的需要显示的时间信息time1，如果c1仅有一张图片或者两张以上图片但是拍摄时间完全相同，则将time1根据图片的拍摄时间设置成格式为xx时xx分xx秒；否则，根据c1中所有图片最具体的相同拍摄时间分为以下6种不同情况：2. method according to claim 1, is characterized in that, in step 4, need to determine the time information time 1 that needs to be displayed corresponding to picture cluster c 1 , if c 1 has only one picture or more than two pictures but shooting time If they are exactly the same, then set time 1 to the format of xx hours xx minutes xx seconds according to the shooting time of the pictures; otherwise, according to the most specific same shooting time of all pictures in c 1 , it is divided into the following 6 different situations: 如果最具体的相同拍摄时间为年，则将time1设置成格式为xx年；If the most specific same shooting time is year, set time 1 to format xx year; 如果最具体的相同拍摄时间为月，则将time1设置成格式为xx年xx月；If the most specific same shooting time is month, then set time 1 to the format of xx year xx month; 如果最具体的相同拍摄时间为日，则将time1设置成格式为xx年xx月xx日；If the most specific same shooting time is day, then set time 1 to the format of xx year xx month xx day; 如果最具体的相同拍摄时间为时，则将time1设置成格式为xx月xx日xx时；If the most specific same shooting time is , then set time 1 to the format of xx month xx day xx o'clock; 如果最具体的相同拍摄时间为分，则将time1设置成格式为xx日xx时xx分；If the most specific same shooting time is minutes, then set time 1 to the format of xx day xx hour xx minute; 其它情况下，则将time1设置为空字符串。Otherwise, set time 1 to the empty string. 3.根据权利要求2所述的方法，其特征在于，步骤4中，设定地图放大级别为1到k共k种，且数字增加代表地图放大，将地图放大级别初始化为1，并在地图上Geohash编码为geoh_common1处标记图片簇c1，同时在标记上方显示c1的时间属性time1。3. The method according to claim 2, characterized in that, in step 4, the map zoom level is set to be 1 to k in a total of k types, and the increase in the number represents map zoom, the map zoom level is initialized to 1, and the map zoom level is initialized to 1, and the map zoom level is The above Geohash code is geoh_common 1 to mark the picture cluster c 1 , and at the same time, the time attribute time 1 of c 1 is displayed above the mark. 4.根据权利要求3所述的方法，其特征在于，步骤5中，当用户进行地图放大或缩小操作时，记用户操作结束后地图放大级别为d，1≤d≤k，则通过如下公式计算出新的图片簇的Geohash编码前缀长度geolen_new：4. The method according to claim 3, wherein in step 5, when the user performs a map zoom-in or zoom-out operation, the map zoom level after the user operation is recorded as d, 1≤d≤k, then by the following formula Calculate the Geohash encoding prefix length geolen_new of the new image cluster:
Figure FDA0002388892010000022
Figure FDA0002388892010000022
 5.根据权利要求4所述的方法，其特征在于，步骤6包括：将集合C中每一个图片簇的Geohash编码前缀长度与步骤5得到的Geohash编码前缀长度进行对比，对图片簇进行聚集或分裂，分为以下三种情况：5. The method according to claim 4, wherein step 6 comprises: comparing the Geohash coding prefix length of each picture cluster in the set C with the Geohash coding prefix length obtained in step 5, and gathering or collecting the picture clusters. Split, divided into the following three cases: 如果新的图片簇的Geohash编码前缀长度geolen_new小于当前图片簇的Geohash编码前缀长度，此时对任意图片簇ci，将其Geohash编码geoh_commoni具有geolen_new长度相同前缀的图片簇合并成一个新图片簇，并删除掉合并之前的图片簇，更新新图片簇的Geohash编码前缀长度geolen为geolen_new，更新新图片簇的Geohash编码geoh_common为所有图片Geohash编码的最长公共前缀；If the Geohash coding prefix length geolen_new of the new picture cluster is smaller than the Geohash coding prefix length of the current picture cluster, at this time, for any picture cluster c i , merge the picture clusters whose Geohash coding geoh_common i has the same prefix of geolen_new length into a new picture cluster , and delete the image cluster before merging, update the Geohash encoding prefix length geolen of the new image cluster to geolen_new, and update the Geohash encoding geoh_common of the new image cluster to be the longest common prefix of all images Geohash encoding; 如果新的图片簇的Geohash编码前缀长度geolen_new大于当前图片簇的Geohash编码前缀长度，此时对每个图片簇
Figure FDA0002388892010000031
对ci中的任意图片
Figure FDA0002388892010000032
的Geohash编码值
Figure FDA0002388892010000033
将具有相同geolen_new长度前缀的
Figure FDA0002388892010000034
的图片保存到同一个图片簇中，如果形成两个以上图片簇，则原图片簇分裂成对应的两个以上新的图片簇，最后对每个图片簇，更新新图片簇的Geohash编码前缀长度geolen为geolen_new，更新新图片簇Geohash编码geoh_common为所有图片Geohash编码的最长公共前缀；If the Geohash coding prefix length geolen_new of the new picture cluster is greater than the Geohash coding prefix length of the current picture cluster, at this time, for each picture cluster
Figure FDA0002388892010000031
for any picture in c i
Figure FDA0002388892010000032
Geohash encoded value
Figure FDA0002388892010000033
will have the same geolen_new length prefix
Figure FDA0002388892010000034
The pictures are stored in the same picture cluster. If more than two picture clusters are formed, the original picture cluster is split into two or more corresponding new picture clusters. Finally, for each picture cluster, the Geohash coding prefix length of the new picture cluster is updated. geolen is geolen_new, update the new image cluster Geohash code geoh_common is the longest common prefix of all image Geohash codes; 如果新的图片簇的Geohash编码前缀长度geolen_new等于当前图片簇的Geohash编码前缀长度，任意图片簇不发生任何变化。If the Geohash coding prefix length geolen_new of the new picture cluster is equal to the Geohash coding prefix length of the current picture cluster, no change will occur to any picture cluster. 6.根据权利要求5所述的方法，其特征在于，步骤6中，需要更新每个新图片簇的显示的时间信息time，如果图片簇仅有一张图片或者两张以上图片但是拍摄时间完全相同，则将time根据图片的拍摄时间设置成格式为xx时xx分xx秒；否则，根据图片簇中所有图片最具体的相同拍摄时间分为以下6种不同情况：6. method according to claim 5, is characterized in that, in step 6, need to update the time information time of the display of each new picture cluster, if picture cluster only has one picture or more than two pictures but shooting time is exactly the same , then set the time according to the shooting time of the picture into the format of xx hours xx minutes xx seconds; otherwise, according to the most specific same shooting time of all pictures in the picture cluster, it is divided into the following 6 different situations: 如果最具体的相同拍摄时间为年，则将time设置成格式为xx年，If the most specific same shooting time is year, then set time to format xx year, 如果最具体的相同拍摄时间为月，则将time设置成格式为xx年xx月，If the most specific same shooting time is month, then set time to format xx year xx month, 如果最具体的相同拍摄时间为日，则将time设置成格式为xx年xx月xx日，If the most specific same shooting time is day, then set time to the format of xx year xx month xx day, 如果最具体的相同拍摄时间为时，则将time设置成格式为xx月xx日xx时，If the most specific same shooting time is time, set the time to the format of xx month xx day xx hour, 如果最具体的相同拍摄时间为分，则将time设置成格式为xx日xx时xx分，If the most specific same shooting time is minutes, then set the time to the format of xx day xx hour xx minute, 其它情况下，则将time设置为空字符串。Otherwise, set time to an empty string. 7.根据权利要求6所述的方法，其特征在于，步骤7包括：7. The method according to claim 6, wherein step 7 comprises: 步骤7-1，将地图设置为放大级别d，并在地图上标记所有图片簇ci，标记位置的Geohash编码为geoh_commoni，同时在标记上方显示ci的时间属性timei；Step 7-1, set the map to magnification level d, and mark all image clusters c i on the map, the Geohash code of the marked position is geoh_common i , and at the same time display the time attribute time i of c i above the mark; 步骤7-2，根据图片簇中图片的拍摄时间添加图片簇之间的箭头标记，此时所有图片簇为C＝{c1，c2，...，cm}，找出任意图片簇
Figure FDA0002388892010000035
中最早拍摄的图片的时间time_firsti，计算公式为：Step 7-2, according to the shooting time of the pictures in the picture clusters, add the arrow marks between the picture clusters. At this time, all picture clusters are C={c 1 , c 2 , . . . , c m }, and find any picture cluster
Figure FDA0002388892010000035
The time time_first i of the earliest photographed picture in , the calculation formula is:
Figure FDA0002388892010000041
Figure FDA0002388892010000041
 其中
Figure FDA0002388892010000042
表示图片簇ci中第j张图片的拍摄时间，然后按照图片簇ci中最早拍摄的图片的时间time_firsti从小到大对图片簇排序。in
Figure FDA0002388892010000042
Indicates the shooting time of the jth picture in the picture cluster c i , and then sorts the picture clusters according to the time time_first i of the earliest picture in the picture cluster c i from small to large.
CN201710383223.4A 2017-05-26 2017-05-26 Personalized customized picture management method supporting time-space association of mobile terminal Active CN107153712B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201710383223.4A CN107153712B (en) 2017-05-26 2017-05-26 Personalized customized picture management method supporting time-space association of mobile terminal

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201710383223.4A CN107153712B (en) 2017-05-26 2017-05-26 Personalized customized picture management method supporting time-space association of mobile terminal

Publications (2)

Publication Number Publication Date
CN107153712A CN107153712A (en) 2017-09-12
CN107153712B true CN107153712B (en) 2020-04-24

Family

ID=59792798

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201710383223.4A Active CN107153712B (en) 2017-05-26 2017-05-26 Personalized customized picture management method supporting time-space association of mobile terminal

Country Status (1)

Country Link
CN (1) CN107153712B (en)

Families Citing this family (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN109688431B (en) * 2018-11-16 2021-02-12 康玉龙 Method for calibrating time-space stamp of article by using third-party element
CN114911787B (en) * 2022-05-31 2023-10-27 南京大学 Multi-source POI data cleaning method integrating position and semantic constraint

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102929956A (en) * 2012-10-09 2013-02-13 广东欧珀移动通信有限公司 Image display method and device
CN104219262A (en) * 2013-05-30 2014-12-17 好看科技（深圳）有限公司 Media resource sharing system and method, server cluster and video player
CN104699382A (en) * 2013-12-10 2015-06-10 上海携图信息科技有限公司 Realization method for electronic dynamic travel notes

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102929956A (en) * 2012-10-09 2013-02-13 广东欧珀移动通信有限公司 Image display method and device
CN104219262A (en) * 2013-05-30 2014-12-17 好看科技（深圳）有限公司 Media resource sharing system and method, server cluster and video player
CN104699382A (en) * 2013-12-10 2015-06-10 上海携图信息科技有限公司 Realization method for electronic dynamic travel notes

Also Published As

Publication number Publication date
CN107153712A (en) 2017-09-12

Similar Documents

Publication Publication Date Title
US12001475B2 (en) Mobile image search system
US11249620B2 (en) Electronic device for playing-playing contents and method thereof
CN104239408B (en) Data access based on content of images recorded by a mobile device
US9483500B2 (en) Automatic discovery of popular landmarks
US8270684B2 (en) Automatic media sharing via shutter click
WO2019109245A1 (en) Method and device for displaying story album
WO2017129018A1 (en) Picture processing method and apparatus, and smart terminal
US20220383053A1 (en) Ephemeral content management
WO2017107672A1 (en) Information processing method and apparatus, and apparatus for information processing
WO2017067485A1 (en) Picture management method and device, and terminal
CN108171267A (en) User group partitioning method and device, information push method and device
WO2018152822A1 (en) Method and device for generating album, and mobile terminal
US20130343618A1 (en) Searching for Events by Attendants
CN105243084A (en) Photographed image file storage method and system and photographed image file search method and system
CN105159976A (en) Image file processing method and system
CN109408652A (en) A kind of image searching method, device and equipment
CN103577400A (en) Location information providing method and system
CN105743771A (en) Photo sharing method, photo sharing device and electronic equipment
CN107153712B (en) Personalized customized picture management method supporting time-space association of mobile terminal
CN111611491A (en) Search word recommendation method, apparatus, device, and readable storage medium
CN109657143B (en) Method, device and equipment for pushing exhibit information and storage medium
JP5708868B1 (en) Program, information processing apparatus and method
CN112084359B (en) Picture retrieval method and device and electronic equipment
CN111611265B (en) APP icon updating system
Zhang et al. Tap-to-search: Interactive and contextual visual search on mobile devices

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant