WO2016161807A1 - 相册显示方法及装置 - Google Patents

相册显示方法及装置 Download PDF

Info

Publication number
WO2016161807A1
WO2016161807A1 PCT/CN2015/095185 CN2015095185W WO2016161807A1 WO 2016161807 A1 WO2016161807 A1 WO 2016161807A1 CN 2015095185 W CN2015095185 W CN 2015095185W WO 2016161807 A1 WO2016161807 A1 WO 2016161807A1
Authority
WO
WIPO (PCT)
Prior art keywords
face
album
photo
identifier
information
Prior art date
Application number
PCT/CN2015/095185
Other languages
English (en)
French (fr)
Inventor
余军
王恒
蔡经伟
Original Assignee
小米科技有限责任公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 小米科技有限责任公司 filed Critical 小米科技有限责任公司
Priority to RU2016126469A priority Critical patent/RU2647681C2/ru
Priority to KR1020167007569A priority patent/KR101820781B1/ko
Priority to MX2016004111A priority patent/MX359407B/es
Priority to JP2016515944A priority patent/JP2017520809A/ja
Publication of WO2016161807A1 publication Critical patent/WO2016161807A1/zh

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/50Information retrieval; Database structures therefor; File system structures therefor of still image data
    • G06F16/58Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually
    • G06F16/583Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually using metadata automatically derived from the content
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/50Information retrieval; Database structures therefor; File system structures therefor of still image data
    • G06F16/54Browsing; Visualisation therefor
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/50Information retrieval; Database structures therefor; File system structures therefor of still image data
    • G06F16/51Indexing; Data structures therefor; Storage structures
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F18/00Pattern recognition
    • G06F18/20Analysing
    • G06F18/23Clustering techniques
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/16Human faces, e.g. facial parts, sketches or expressions
    • G06V40/172Classification, e.g. identification

Definitions

  • the present disclosure relates to the field of graphic image technology, and in particular, to a method and device for displaying an album.
  • the photo album program is one of the most commonly used programs on mobile terminals such as smartphones and tablets.
  • the photo album program is used to manage and display pictures in the mobile terminal.
  • the photo album program in the mobile phone classifies different albums according to different sources of the pictures, for example, the pictures obtained by taking pictures are classified into one album, the pictures from the A program are classified into another album, and the pictures from the B program are classified as another album. .
  • Each album is sorted by time.
  • the present disclosure provides a method and device for displaying an album.
  • the technical solution is as follows:
  • a method for displaying an album comprising:
  • the face recognition information of the n photos is obtained from the server, and the face recognition information includes: a photo identifier and an album identifier of the face album to which the photo belongs, and the face album to which the photo belongs is similar clustering by the server according to the face in the photo. Obtained, n is a positive integer;
  • obtaining face recognition information of n photos from a server includes:
  • the server is used for face recognition of n photos and clustering the recognized faces according to a preset clustering algorithm to obtain a face album and a face album to which the photos belong Album identification;
  • the face recognition information further includes a face identifier corresponding to each face in the photo
  • the method also includes:
  • the first photo is one of n photos
  • the first face album is one of the face albums
  • the first photo is removed from the first face album, and the association relationship between the associated face identifier in the first photo and the album identifier of the first face album is deleted, and the associated face identifier is the server a face identifier of a face used when a photo is clustered to the first face album;
  • the removal information is used to indicate that the association relationship between the associated face identifier and the album identifier of the first face album is deleted, and the server is configured to use the first photo according to the first photo
  • the photo identification and removal information adjusts the preset clustering algorithm.
  • the face recognition information further includes a face identifier corresponding to each face in the photo
  • the method also includes:
  • the adding information is used to indicate establishing an association relationship between the face identifier in the second photo and the album identifier of the second face album, and the server is configured to use the second photo according to the second photo
  • the photo identification and adding information adjust the preset clustering algorithm.
  • displaying a face album includes:
  • the person name information is displayed as attribute information of the face album.
  • the method further includes:
  • the face albums corresponding to the at least two person name information are combined according to the merge operation to generate a merged album.
  • the face albums corresponding to the at least two person name information are combined according to the merging operation to generate a merged album, including:
  • Photo merge rules include:
  • At least a face corresponding to the designated person name information in the at least two person name information At least a face corresponding to the designated person name information in the at least two person name information
  • the method further includes:
  • the selected contact is associated with the face album corresponding to the person name information.
  • the selected contact is associated with a face album corresponding to the person name information, including:
  • an album display device comprising:
  • the obtaining module is configured to obtain face recognition information of n photos from the server, the face recognition information includes: a photo identifier and an album identifier of the face album to which the photo belongs, and the face album to which the photo belongs is a server according to the person in the photo After the face is similarly clustered, n is a positive integer;
  • Adding a module configured to add n photos to the corresponding face album according to the album identifier corresponding to each photo
  • a display module configured to display a face album.
  • the obtaining module comprises:
  • a lookup submodule configured to look up a photo of the stored photo from the absence of face recognition information
  • the sending submodule is configured to send the found n photos to the server, and the server is configured to perform face recognition on the n photos and cluster the recognized faces according to a preset clustering algorithm to obtain the photo belongs to Face album and album logo of face album;
  • the receiving submodule is configured to receive the face recognition information sent by the server.
  • the face recognition information further includes a face identifier corresponding to each face in the photo
  • the device also includes:
  • the first receiving module is configured to receive a removal operation of removing the first photo from the associated first face album, the first photo is one of n photos, and the first face album is a face album one of the;
  • And removing the module configured to remove the first photo from the first face album, and delete the association relationship between the associated face identifier in the first photo and the album identifier of the first face album, and associate
  • the face identifier is a face identifier of a face used by the server to cluster the first photo to the first face album;
  • the first sending module is configured to send the photo identification and removal information of the first photo to the server, and the removal information is used to delete the association relationship between the associated face identifier and the album identifier of the first face album.
  • the server is configured to adjust the preset clustering algorithm according to the photo identification and the removal information of the first photo.
  • the face recognition information further includes a face identifier corresponding to each face in the photo
  • the device also includes:
  • a second receiving module configured to receive an adding operation of adding a second photo to the second face album, where the second face album is one of the face albums;
  • Adding a module configured to add a second photo to the second face album, and establish an association relationship between the face identifier in the second photo and the album identifier of the second face album;
  • the second sending module is configured to send the photo identification and the adding information of the second photo to the server, and the adding information is used to indicate that the relationship between the face identifier in the second photo and the album identifier of the second face album is established.
  • server used The preset clustering algorithm is adjusted according to the photo identification and the added information of the second photo.
  • the display module includes:
  • Obtaining a sub-module configured to obtain a name information corresponding to each face album
  • the display sub-module is configured to display the person name information as attribute information of the face album.
  • the apparatus further includes:
  • a third receiving module configured to receive a merge operation of merging face albums corresponding to the at least two person name information
  • the merging module is configured to merge the face albums corresponding to the at least two person name information according to the merging operation to generate a merged album.
  • the merging module comprises:
  • a rule acquisition submodule configured to obtain a photo merge rule according to the merge operation
  • the merging sub-module is configured to merge the photos in the face album corresponding to the at least two person name information and the photo merge rule into a merged album;
  • Photo merge rules include:
  • At least a face corresponding to the designated person name information in the at least two person name information At least a face corresponding to the designated person name information in the at least two person name information
  • the apparatus further includes:
  • a lookup module configured to look up contacts from the contacts application that match the name information
  • Selecting a display module configured to display a selection interface of the found contacts
  • the association module is configured to associate the selected contact with a face album corresponding to the person name information.
  • the association module is configured to provide an access portal of the face album in the information interface corresponding to the contact in the address book application; or set the photo in the face album as the contact avatar; Or, in the photo sharing options of the face album, provide sharing options for direct sharing to contacts.
  • an album display apparatus comprising:
  • a memory for storing processor executable instructions
  • processor is configured to:
  • the face recognition information of the n photos is obtained from the server, and the face recognition information includes: a photo identifier and an album identifier of the face album to which the photo belongs, and the face album to which the photo belongs is similar clustering by the server according to the face in the photo. Obtained, n is a positive integer;
  • Different face albums are obtained by clustering according to faces in the photos, so that photos in the mobile terminal can be managed and displayed according to different faces.
  • the problem that the photo album program in the related art can only manage and display photos according to the image source, time or place is solved, and the effect that the photo album program can manage and display the photos according to the face is achieved.
  • FIG. 1 is a flowchart of an album display method according to an exemplary embodiment.
  • FIG. 2A is a flowchart of an album display method according to another exemplary embodiment.
  • FIG. 2B is a schematic diagram showing the principle of an album display method according to the exemplary embodiment shown in FIG. 2A.
  • FIG. 2C is an interface diagram of an album display method illustrated in accordance with the exemplary embodiment illustrated in FIG. 2A.
  • FIG. 3A is a flowchart of an album display method according to another exemplary embodiment.
  • FIG. 3B is an interface diagram of an album display method illustrated in accordance with the exemplary embodiment illustrated in FIG. 3A.
  • FIG. 4A is a flowchart of an album display method according to another exemplary embodiment.
  • FIG. 4B is an interface diagram of an album display method illustrated in accordance with the exemplary embodiment illustrated in FIG. 4A.
  • FIG. 5A is a flowchart of an album display method according to another exemplary embodiment.
  • FIG. 5B is an interface diagram of an album display method illustrated in accordance with the exemplary embodiment illustrated in FIG. 5A.
  • FIG. 6 is a flowchart of an album display method according to another exemplary embodiment.
  • FIG. 7 is a flowchart of an album display method according to another exemplary embodiment.
  • FIG. 8A is a flowchart of an album display method according to another exemplary embodiment.
  • FIG. 8B is an interface diagram showing an album display method according to the exemplary embodiment shown in FIG. 8A.
  • FIG. 9 is a block diagram of an album display device, according to an exemplary embodiment.
  • FIG. 10 is a block diagram of an album display device according to another exemplary embodiment.
  • FIG. 11 is a block diagram of an album display device according to another exemplary embodiment.
  • the mobile terminal in this article can be a mobile phone, a tablet computer, an e-book reader, an MP3 player (Moving Picture) Experts Group Audio Layer III, dynamic video experts compress standard audio layer 3), MP4 (Moving Picture Experts Group Audio Layer IV), portable laptops and desktop computers.
  • MP3 player Moving Picture
  • MP4 Moving Picture Experts Group Audio Layer IV
  • FIG. 1 is a flowchart of a method for displaying an album according to an exemplary embodiment. This embodiment is exemplified by the application of the album display method to a mobile terminal. The method includes:
  • the face recognition information of the n photos is obtained from the server, and the face recognition information includes: a photo identifier and an album identifier of the face album to which the photo belongs, and n is a positive integer.
  • a photo ID is an identifier used to distinguish the current photo from other photos.
  • the photo ID of each photo is unique among all photo IDs.
  • the album identifier is an identifier used to distinguish the current face album from other face albums.
  • Each album ID is unique among all album IDs.
  • the face album to which the current photo belongs is obtained by the server performing similar clustering according to the face in the photo, that is, several photos whose face similarity exceeds the threshold are clustered to the same face album.
  • n photos are respectively added to the corresponding face album according to the album identifier corresponding to each photo.
  • the photo may be directly added to the face album; if the mobile terminal does not have a face album corresponding to the album identifier , a new face album is created according to the album identifier, and the photo is added to the face album.
  • step 106 a face album is displayed.
  • the album display method provided by the embodiment obtains different face albums by clustering according to the faces in the photos, so that the photos in the mobile terminal can be managed and displayed according to different faces.
  • the problem that the photo album program in the related art can only manage and display photos according to the image source, time or place is solved, and the effect that the photo album program can manage and display the photos according to the face is achieved.
  • FIG. 2A is a flowchart of a method for displaying an album according to another exemplary embodiment. The embodiment continues to be illustrated by applying the album display method to a mobile terminal. The method includes the following steps.
  • step 201 a photo of the face recognition information is not found from the stored photos.
  • the photos in the mobile terminal will continue to increase as the user uses them.
  • the mobile terminal searches for photos that do not have face recognition information from the locally stored photos every predetermined time interval; or, the mobile terminal searches for the face recognition information that does not exist from the locally stored photos during the idle period of the processor.
  • the photo or, the mobile terminal searches for a photo of the face recognition information that does not yet exist from the locally stored photo each time the photographing program is used and closed.
  • the mobile terminal searches for photos that do not have face recognition information from locally stored photos every night at 11:00.
  • step 202 the n photos that are found are sent to the server, and the server is used to perform facial recognition on n photos.
  • the clustered faces are clustered according to a preset clustering algorithm to obtain an album identifier, where n is a positive integer.
  • the mobile terminal After finding out that there are no face recognition information for n photos, the mobile terminal sends the n photos found to the server.
  • the server receives the n photos.
  • the server performs face recognition on the photo to obtain a face in the photo.
  • the face is represented by a face identifier and a face feature information.
  • the recognized face is clustered according to a preset clustering algorithm, and the face album to which the photo belongs and the album identifier of the face album are obtained.
  • the process of processing the photo by the server can be referred to FIG. 2B.
  • the face identifier is an identifier used to distinguish the current face from other faces.
  • Each face in the same photo has a different face identifier.
  • the faces of the same person in different photos also have different face identifiers, that is, each face in each photo has a unique face identifier.
  • one photo corresponds to one photo identifier; one photo corresponds to n personal face identifier, and n is a positive integer, that is, if there are n personal faces in the photo, corresponding to n personal face identifiers.
  • One photo corresponds to n album identifiers; each face ID in a photo corresponds to one face album, that is, each face identifier corresponds to one album identifier, without considering the merged album.
  • step 203 the face recognition information sent by the server is received, and the face recognition information includes: a photo identifier, a face identifier of each face in the photo, and an album identifier of the face album to which the photo belongs.
  • the face album to which each photo belongs is obtained by the server performing similar clustering based on the faces in the photos, and n is a positive integer.
  • the mobile terminal receives face recognition information of n photos sent by the server.
  • the face recognition information includes: a photo identification, a face identification of each face in the photo, and an album identification of the face album to which the photo belongs.
  • the face recognition information further includes location information of each face in the photo.
  • n photos are respectively added to the corresponding face album according to the album identifier corresponding to each photo.
  • the mobile terminal adds the photo 001 to the face album C01 according to the face recognition information; adding the photo 002 To face album C01 and face album C02; add photo 003 to face album C01, face album C02 and face album C03; add photo 004 to face album C03.
  • the photo may be directly added to the face album; if the mobile terminal does not have a face album corresponding to the album identifier , a new face album is created according to the album identifier, and the photo is added to the face album.
  • step 205 the name information corresponding to each face album is obtained.
  • Each face album can correspond to a person name information. However, since there are different people having the same person name, the same personal name information may correspond to a plurality of face albums.
  • the mobile terminal can receive the name of the person entered by the user for each face album.
  • step 206 the person name information is displayed as attribute information of the face album.
  • the mobile terminal displays the face album
  • the mobile terminal displays the person name information corresponding to each face album as the attribute information of the face album.
  • This attribute information can be an album name.
  • Each face album can be displayed as a picture folder, and each picture folder can also be provided with a cover photo.
  • the mobile terminal can adopt such as “new face 1", “new face 2", “unknown person 1", “unknown person 2”, “stranger 1", “new face”
  • the default album name such as album 20150303.
  • the mobile terminal displays the name information corresponding to each face album as the album name of the face album.
  • the face album can coexist with other display modes as a new display mode.
  • the album display method provided by the embodiment obtains different face albums by clustering according to the faces in the photos, so that the photos in the mobile terminal can be managed and displayed according to different faces.
  • the problem that the photo album program in the related art can only manage and display photos according to the image source, time or place is solved, and the effect that the photo album program can manage and display the photos according to the face is achieved.
  • the mobile terminal generates operation information according to the deletion operation or the adding operation of the photo in the face album by the user, and sends the operation information to the server.
  • the server is configured to adjust the preset clustering algorithm according to the operation information. That is, the preset clustering algorithm is a learning algorithm that performs clustering based on the sample learning process, and the preset clustering algorithm can be continuously optimized by the operation information generated by the user during use.
  • step 206 the following steps are further included, as shown in FIG. 3A:
  • step 207 a removal operation of removing the first photo from the associated first face album is received, the first photo being one of n photos, and the first face album is one of the face albums .
  • the first photo is removed from the first face album, and the association relationship between the associated face identifier in the first photo and the album identifier of the first face album is deleted, and the face is associated.
  • the identifier is a face identifier of the face used by the server to cluster the first photo to the first face album.
  • step 209 the photo identification and removal information of the first photo is sent to the server, and the deletion information is used to delete the association relationship between the associated face identifier and the album identifier of the first face album.
  • the photo identification and removal information of the slice adjusts the preset clustering algorithm.
  • the user finds that the photo 002 should not belong to the current face album, and the mobile terminal receives the deletion operation that the user deletes the photo 002 from the current face album.
  • the mobile terminal deletes the photo 002 from the face album C01, and deletes the association relationship between the face ID 002001 and the album identifier C01 in the face recognition information.
  • the mobile terminal sends the photo identification and deletion information of the photo 002 to the server, so that the server adjusts the preset clustering algorithm according to the photo identification and the deletion information.
  • step 206 the following steps are further included, as shown in FIG. 4A:
  • step 210 an adding operation of adding a second photo to the second face album is received, the second face album being one of the face albums.
  • step 211 the second photo is added to the second face album, and an association relationship between the face identifier in the second photo and the album identifier of the second face album is established.
  • step 212 the photo identification and the addition information of the second photo are sent to the server, and the adding information is used to indicate that the association relationship between the face identifier in the second photo and the album identifier of the second face album is established, and the server uses The preset clustering algorithm is adjusted according to the photo identification and the added information of the second photo.
  • the user finds that the photo 005 should belong to the face album yoyo, and the mobile terminal receives the adding operation of the user adding the photo 005 to the face album yoyo.
  • the mobile terminal adds the photo 005 to the face album yoyo, and establishes an association relationship between the face identifier 005001 of the photo 005 and the album identifier.
  • the mobile terminal then sends the photo identification and the addition information of the photo 005 to the server, so that the server adjusts the preset clustering algorithm according to the photo identification and the added information.
  • the mobile terminal sends the album identifier of the second photo and the second face album to the server, so that the server according to the second photo and the first
  • the album identification of the two-face album adjusts the preset clustering algorithm.
  • the album display method provided by the embodiment is to utilize the operation information generated by the normal use process of the user, so that the manual labeling sample can be reduced as much as possible.
  • the clustering accuracy of the preset clustering algorithm is increased, and the operation burden of the user is not increased.
  • the mobile terminal can mark a number of photos of the same person and send them to the server according to the user's operation.
  • the server is used to adjust the preset clustering algorithm based on these labeled photos.
  • Step 206 further includes the following steps, as shown in FIG. 5A:
  • step 213 a merge operation of merging the face albums corresponding to the at least two person name information is received.
  • the merge operation may be triggered to the mobile terminal.
  • the user can trigger the merge operation by adding other person name information to a face album.
  • step 214 the face albums corresponding to the at least two person name information are combined according to the merge operation to generate a merged album.
  • the mobile terminal merges the face albums corresponding to the at least two person name information into a new merged album according to the user's merge operation.
  • the album ID of the new merged album is automatically generated by the mobile terminal.
  • the mobile terminal can continue to be retained.
  • the user merges the face album "yoyo" with the face album "I” to generate a new merged album "yoyo and me”.
  • step 214 can be replaced with step 214a and step 214b, as shown in FIG. 6:
  • step 214a a photo merge rule is obtained according to the merge operation.
  • the photo merge rule includes any of the following four types:
  • a face corresponding to any one of the at least two person name information is included.
  • the face corresponding to all the person name information in the at least two person name information is included.
  • At least the face corresponding to the specified person name information in the at least two person name information is included.
  • step 214b the photos in accordance with the photo merge rule in the face album corresponding to the at least two person name information are merged into a merged album.
  • the current photo is added to the merged album as long as the current photo contains a face corresponding to any one of the at least two person name information. For example, as long as the current photo includes the face of any one of the person name 1, the person name 2, and the person name 3, it is merged into the merged album.
  • the current photo is added to the merged album only if the current photo contains the face corresponding to all the person name information in the at least two person name information.
  • the current photo includes both the person name 1, the person name 2, and the face of three people in the person name 3, and is merged into the merged album.
  • the current photo may include other faces corresponding to the name information.
  • the current photo includes at least the face corresponding to the specified person name information in the at least two person name information, and the current photo is added to the merged album.
  • the current photo at least including the face of the person name 1 and the person name 2 will be merged into the merged album.
  • the current photo may also include a face corresponding to the name 3 or other person name information.
  • the current photo is added to the merged album only if the current photo contains and only includes the face corresponding to all the person name information in the at least two person name information. For example, only the face of the current photo including and including only three of the person name 1, the person name 2, and the person name 3 is merged into the merged album. The current photo may no longer include the face corresponding to other person name information.
  • the album display method provided by the embodiment provides a user-defined merged album on the mobile terminal side, so that the user can merge the merged album on the basis of the single-person face album according to the needs of the user.
  • the user can also merge the merged albums of different presentation forms.
  • the mobile terminal can also associate the face album with the address book application.
  • the following steps may also be included, as shown in FIG. 7:
  • step 215 a contact matching the person name information is looked up from the contacts application.
  • the mobile terminal searches for a contact that matches or partially matches the person name information from the address book application.
  • the embodiment of the present disclosure does not limit the type of the address book application, and the address book application including the address book function or the multi-function application including the address book function can be regarded as the address book application.
  • the mobile terminal finds the contacts "Zhang San”, “Three Brothers”, and "Zhang Ge” from the address book application as the contacts matching the person name information.
  • step 216 a selection interface for the found contacts is displayed.
  • the mobile terminal can display a selection interface of the found contacts.
  • the user can select a contact in the selection interface as the contact that matches the person name information. For example, select the contact "third brother" as the contact that matches the name information.
  • step 217 the selected contact is associated with the face album corresponding to the person name information.
  • step 217 can be replaced with step 217a or step 217b or step 217c, as shown in FIG. 8A:
  • step 217a an access portal of the face album is provided in the information interface corresponding to the contact in the address book application.
  • the mobile terminal provides a shortcut button in the information interface of "Three Brothers".
  • the shortcut button is an access portal 80 of the face album corresponding to the person name information "Zhang San”.
  • step 217b the photo in the face album is set as the avatar of the contact.
  • the mobile terminal may also set a cover photo in the face album as the avatar of the contact; or set a randomly selected photo in the face album as the avatar of the contact; or, the user in the face album
  • the selected photo is set as the contact's avatar; or, the photo selected by the user in the face album is set as the contact's avatar; or, the most recently taken photo in the face album, As the avatar of the contact; or, the photo in the face album is generated as a dynamic avatar as the avatar of the contact.
  • step 217c in the photo sharing option of the face album, a sharing option to directly share to the contact is provided.
  • the photo sharing options provided by the related art may include: sharing by email, sending to my computer, sharing to Weibo, and the like.
  • a sharing option of an email, a short message, an instant messaging account, or a social application account directly shared with the contact may also be provided.
  • the album display method provided by the embodiment further associates the face album with the address book application. Realize quick access to face albums, dynamic updates of contact avatars, and quick sharing of photos, so that the photo album program is no longer a stand-alone application, but can be run in conjunction with other applications, allowing users to use face albums or
  • the address book application is more convenient.
  • FIG. 9 is a block diagram of an album display device provided according to an exemplary embodiment of the present disclosure.
  • the album display device can be implemented as all or part of the mobile terminal by software, hardware or a combination of both.
  • the album display device includes:
  • the obtaining module 920 is configured to acquire face recognition information of n photos from the server, where the face recognition information includes: a photo identifier and an album identifier of the face album to which the photo belongs, and the face album to which the photo belongs is determined by the server according to the photo.
  • the face is similarly clustered, and n is a positive integer.
  • the adding module 940 is configured to add n photos to the corresponding face albums according to the album identifier corresponding to each photo.
  • the display module 960 is configured to display a face album.
  • the album display device obtained in this embodiment obtains different face albums by clustering according to the faces in the photos, so that the photos in the mobile terminal can be managed and displayed according to different faces.
  • the problem that the photo album program in the related art can only manage and display photos according to the image source, time or place is solved, and the effect that the photo album program can manage and display the photos according to the face is achieved.
  • FIG. 10 is a block diagram of an album display device provided according to another exemplary embodiment of the present disclosure.
  • the album display device can be implemented as all or part of the mobile terminal by software, hardware or a combination of both.
  • the album display device includes:
  • the obtaining module 920 is configured to acquire face recognition information of n photos from the server, where the face recognition information includes: a photo identifier and an album identifier of the face album to which the photo belongs, and the face album to which the photo belongs is determined by the server according to the photo.
  • the face is similarly clustered, and n is a positive integer.
  • the adding module 940 is configured to add n photos to the corresponding face albums according to the album identifier corresponding to each photo.
  • the display module 960 is configured to display a face album.
  • the obtaining module 920 includes:
  • the finding sub-module 922 is configured to search for a photo of the stored photo that does not have face recognition information
  • the sending sub-module 924 is configured to send the n photos that are found to the server, and the server is configured to perform face recognition on the n photos and cluster the recognized faces according to a preset clustering algorithm to obtain a photo. Face album and album logo of face album;
  • the receiving submodule 926 is configured to receive the face recognition information sent by the server.
  • the face recognition information further includes a face identifier corresponding to each face in the photo
  • the device also includes:
  • the first receiving module 932 is configured to receive a removal operation of removing the first photo from the associated first face album, the first photo being one of n photos, the first face album being a face One of the albums.
  • the removing module 934 is configured to remove the first photo from the first face album, and delete the association relationship between the associated face identifier in the first photo and the album identifier of the first face album,
  • the associated face identifier is a face identifier of a face that is used when the server clusters the first photo to the first face album.
  • the first sending module 936 is configured to send the photo identification and removal information of the first photo to the server, and the removal information is used to indicate that the association relationship between the associated face identifier and the album identifier of the first face album is performed.
  • the server is configured to adjust the preset clustering algorithm according to the photo identification and removal information of the first photo.
  • the face recognition information further includes a face identifier corresponding to each face in the photo
  • the device also includes:
  • the second receiving module 952 is configured to receive an adding operation of adding the second photo to the second face album, where the second face album is one of the face albums.
  • the adding module 954 is configured to add the second photo to the second face album, and establish an association relationship between the face identifier in the second photo and the album identifier of the second face album.
  • the second sending module 956 is configured to send the photo identification and the addition information of the second photo to the server, and the adding information is used to indicate that the association between the face identifier in the second photo and the album identifier of the second face album is established.
  • the relationship is used by the server to adjust the preset clustering algorithm according to the photo identification and the added information of the second photo.
  • the display module 960 includes:
  • the obtaining submodule 962 is configured to obtain the name information corresponding to each face album.
  • the display sub-module 964 is configured to display the person name information as attribute information of the face album.
  • the device further includes:
  • the third receiving module 972 is configured to receive a merge operation of merging the face albums corresponding to the at least two person name information.
  • the merging module 974 is configured to merge the face albums corresponding to the at least two person name information according to the merging operation to generate a merged album.
  • the merging module 974 includes:
  • the rule acquisition submodule 974a is configured to obtain a photo merge rule according to the merge operation
  • the merging sub-module 974b is configured to merge the photos that meet the photo merge rule in the face album corresponding to the at least two person name information into a merged album;
  • Photo merge rules include:
  • At least a face corresponding to the designated person name information in the at least two person name information At least a face corresponding to the designated person name information in the at least two person name information
  • the device further includes:
  • the lookup module 982 is configured to look up a contact that matches the person name information from the address book application;
  • the selection display module 984 is configured to display a selection interface of the found contacts
  • the association module 986 is configured to associate the selected contact with a face album corresponding to the person name information.
  • the association module 986 is configured to provide an access portal of the face album in the information interface corresponding to the contact in the address book application; or set the photo in the face album as the contact avatar; or In the photo sharing options of the face album, provide sharing options for direct sharing to contacts.
  • An exemplary embodiment of the present disclosure provides an album display device capable of implementing the album display method provided by the present disclosure, the album display device comprising: a processor, a memory for storing processor executable instructions;
  • processor is configured to:
  • the face recognition information of the n photos is obtained from the server, and the face recognition information includes: a photo identifier and an album identifier of the face album to which the photo belongs, and the face album to which the photo belongs is similar clustering by the server according to the face in the photo. Obtained, n is a positive integer;
  • FIG. 11 is a block diagram of an album display device according to an exemplary embodiment.
  • device 1100 can be a mobile phone, a computer, a digital broadcast terminal, a messaging device, a gaming console, a tablet device, a medical device, a fitness device, a personal digital assistant, and the like.
  • apparatus 1100 can include one or more of the following components: processing component 1102, memory 1104, power component 1106, multimedia component 1108, audio component 1110, input/output (I/O) interface 1112, sensor component 1114, and Communication component 1116.
  • Processing component 1102 typically controls the overall operation of device 1100, such as operations associated with display, telephone calls, data communications, camera operations, and recording operations.
  • Processing component 1102 can include one or more processors 1118 to execute instructions to perform all or part of the steps of the above described methods.
  • processing component 1102 can include one or more modules to facilitate interaction between component 1102 and other components.
  • the processing component 1102 can include a multimedia module to facilitate interaction between the multimedia component 1108 and the processing component 1102.
  • Memory 1104 is configured to store various types of data to support operation at device 1100. Examples of these data Instructions including any application or method for operation on device 1100, contact data, phone book data, messages, pictures, videos, and the like.
  • the memory 1104 can be implemented by any type of volatile or non-volatile storage device, or a combination thereof, such as static random access memory (SRAM), electrically erasable programmable read only memory (EEPROM), erasable.
  • SRAM static random access memory
  • EEPROM electrically erasable programmable read only memory
  • EPROM Programmable Read Only Memory
  • PROM Programmable Read Only Memory
  • ROM Read Only Memory
  • Magnetic Memory Flash Memory
  • Disk Disk or Optical Disk.
  • Power component 1106 provides power to various components of device 1100.
  • Power component 1106 can include a power management system, one or more power sources, and other components associated with generating, managing, and distributing power for device 1100.
  • the multimedia component 1108 includes a screen between the device 1100 and the user that provides an output interface.
  • the screen can include a liquid crystal display (LCD) and a touch panel (TP). If the screen includes a touch panel, the screen can be implemented as a touch screen to receive input signals from the user.
  • the touch panel includes one or more touch sensors to sense touches, slides, and gestures on the touch panel. The touch sensor can sense not only the boundaries of the touch or sliding action, but also the duration and pressure associated with the touch or slide operation.
  • the multimedia component 1108 includes a front camera and/or a rear camera. When the device 1100 is in an operation mode, such as a shooting mode or a video mode, the front camera and/or the rear camera can receive external multimedia data. Each front and rear camera can be a fixed optical lens system or have focal length and optical zoom capabilities.
  • the audio component 1110 is configured to output and/or input an audio signal.
  • the audio component 1110 includes a microphone (MIC) that is configured to receive an external audio signal when the device 1100 is in an operational mode, such as a call mode, a recording mode, and a voice recognition mode.
  • the received audio signal may be further stored in memory 1104 or transmitted via communication component 1116.
  • the audio component 1110 also includes a speaker for outputting an audio signal.
  • the I/O interface 1112 provides an interface between the processing component 1102 and a peripheral interface module, which may be a keyboard, a click wheel, a button, or the like. These buttons may include, but are not limited to, a home button, a volume button, a start button, and a lock button.
  • Sensor assembly 1114 includes one or more sensors for providing a status assessment of various aspects to device 1100.
  • the sensor assembly 1114 can detect an open/closed state of the device 1100, the relative positioning of the components, such as a display and a keypad of the device 1100, and the sensor component 1114 can also detect a change in position of a component of the device 1100 or device 1100, the user The presence or absence of contact with device 1100, device 1100 orientation or acceleration/deceleration and temperature change of device 1100.
  • Sensor assembly 1114 can include a proximity sensor configured to detect the presence of nearby objects without any physical contact.
  • Sensor assembly 1114 may also include a light sensor, such as a CMOS or CCD image sensor, for use in imaging applications.
  • the sensor assembly 1114 can also include an acceleration sensor, a gyro sensor, a magnetic sensor, a pressure sensor, or a temperature sensor.
  • Communication component 1116 is configured to facilitate wired or wireless communication between device 1100 and other devices.
  • the device 1100 can access a wireless network based on a communication standard, such as Wi-Fi, 2G or 3G, or a combination thereof.
  • communication component 1116 receives broadcast signals or broadcast associated information from an external broadcast management system via a broadcast channel.
  • communication component 1116 also includes a near field communication (NFC) module to facilitate short range communication.
  • NFC near field communication
  • the NFC module can be based on radio frequency identification (RFID) technology, infrared data association (IrDA) technology, ultra-wideband (UWB) Technology, Bluetooth (BT) technology and other technologies to achieve.
  • RFID radio frequency identification
  • IrDA infrared data association
  • UWB ultra-wideband
  • Bluetooth Bluetooth
  • apparatus 1100 may be implemented by one or more application specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), field programmable A gate array (FPGA), controller, microcontroller, microprocessor or other electronic component implementation for performing the above described album display method.
  • ASICs application specific integrated circuits
  • DSPs digital signal processors
  • DSPDs digital signal processing devices
  • PLDs programmable logic devices
  • FPGA field programmable A gate array
  • controller microcontroller, microprocessor or other electronic component implementation for performing the above described album display method.
  • non-transitory computer readable storage medium comprising instructions, such as a memory 1104 comprising instructions executable by processor 1118 of apparatus 1100 to perform the album display method described above.
  • the non-transitory computer readable storage medium can be a ROM, a random access memory (RAM), a CD-ROM, a magnetic tape, a floppy disk, and an optical data storage device.

Abstract

本公开揭示了一种相册显示方法及装置,属于图形图像技术领域。该方法包括:从服务器获取n张照片的人脸识别信息,人脸识别信息包括:照片标识和照片所属的人脸相册的相册标识,n为正整数;根据每个照片对应的相册标识,将n张照片分别添加至对应的人脸相册中;显示人脸相册。本公开通过根据照片中的人脸来进行聚类得到不同的人脸相册,使得能够根据不同的人脸来管理和显示移动终端中的照片。解决了相关技术中的相册程序只能依靠图片来源、时间或地点来管理和显示照片的问题,达到了相册程序可以根据人脸来管理和显示照片的效果。

Description

相册显示方法及装置
本申请基于申请号为201510164076.2、申请日为2015年4月8日的中国专利申请提出,并要求该中国专利申请的优先权,该中国专利申请的全部内容在此引入本申请作为参考。
技术领域
本公开涉及图形图像技术领域,特别涉及一种相册显示方法及装置。
背景技术
相册程序是诸如智能手机、平板电脑之类的移动终端上最为常用的程序之一。相册程序用来管理和显示移动终端中的图片。
目前,手机中的相册程序按照图片的不同来源归类出不同的相册,比如拍照得到的图片归为一个相册,来自A程序的图片归为另一个相册,来自B程序的图片归为再一个相册。每个相册中再按照时间进行排序。
发明内容
本公开提供一种相册显示方法及装置。所述技术方案如下:
根据本公开实施例的第一方面,提供一种相册显示方法,该方法包括:
从服务器获取n张照片的人脸识别信息,人脸识别信息包括:照片标识和照片所属的人脸相册的相册标识,照片所属的人脸相册是服务器根据照片中的人脸进行相似聚类后得到的,n为正整数;
根据每个照片对应的相册标识,将n张照片分别添加至对应的人脸相册中;
显示人脸相册。
在一个实施例中,从服务器获取n张照片的人脸识别信息,包括:
从已存储的照片中查找不存在人脸识别信息的照片;
将查找出的n张照片发送给服务器,服务器用于对n张照片进行人脸识别并根据预设聚类算法对识别出的人脸进行聚类,得到照片所属的人脸相册以及人脸相册的相册标识;
接收服务器发送的人脸识别信息。
在一个实施例中,人脸识别信息中还包括有照片中每个人脸所对应的人脸标识;
该方法还包括:
接收将第一照片从所属的第一人脸相册中进行移除的移除操作,第一照片是n张照片中的一个,第一人脸相册是人脸相册中的一个;
将第一照片从第一人脸相册进行移除,且将第一照片中的关联人脸标识与第一人脸相册的相册标识之间的关联关系进行删除,关联人脸标识是服务器将第一照片聚类至第一人脸相册时所采用的人脸的人脸标识;
将第一照片的照片标识和移除信息发送给服务器,移除信息用于表示将关联人脸标识与第一人脸相册的相册标识之间的关联关系进行删除,服务器用于根据第一照片的照片标识和移除信息调整预设聚类算法。
在一个实施例中,人脸识别信息中还包括有照片中每个人脸所对应的人脸标识;
该方法还包括:
接收将第二照片添加至第二人脸相册的添加操作,第二人脸相册是人脸相册中的一个;
将第二照片添加至从第二人脸相册,且建立第二照片中的人脸标识与第二人脸相册的相册标识之间的关联关系;
将第二照片的照片标识和添加信息发送给服务器,添加信息用于表示建立第二照片中的人脸标识与第二人脸相册的相册标识之间的关联关系,服务器用于根据第二照片的照片标识和添加信息调整预设聚类算法。
在一个实施例中,显示人脸相册,包括:
获取每个人脸相册所对应的人名信息;
将人名信息作为人脸相册的属性信息进行显示。
在一个实施例中,该方法还包括:
接收将至少两个人名信息所对应的人脸相册进行合并的合并操作;
根据合并操作将至少两个人名信息所对应的人脸相册进行合并,生成合并相册。
在一个实施例中,根据合并操作将至少两个人名信息所对应的人脸相册进行合并,生成合并相册,包括:
根据合并操作获取照片合并规则;
将至少两个人名信息所对应的人脸相册中,符合照片合并规则的照片合并为合并相册;
照片合并规则包括:
包含至少两个人名信息中的至少一个人名信息所对应的人脸;
或,
包含至少两个人名信息中的全部人名信息所对应的人脸;
或,
至少包含至少两个人名信息中的指定人名信息所对应的人脸;
或,
只包含至少两个人名信息所对应的人脸。
在一个实施例中,该方法还包括:
从通讯录应用中查找与人名信息匹配的联系人;
显示查找出的联系人的选择界面;
将被选择的联系人与人名信息所对应的人脸相册进行关联。
在一个实施例中,将被选择的联系人与人名信息所对应的人脸相册进行关联,包括:
在通讯录应用中与联系人对应的信息界面中,提供人脸相册的访问入口;
或,
将人脸相册中的照片设置为联系人的头像;
或,
在人脸相册的照片分享选项中,提供直接分享至联系人的分享选项
根据本公开的第二方面,提供了一种相册显示装置,该装置,包括:
获取模块,被配置为从服务器获取n张照片的人脸识别信息,人脸识别信息包括:照片标识和照片所属的人脸相册的相册标识,照片所属的人脸相册是服务器根据照片中的人脸进行相似聚类后得到的,n为正整数;
添加模块,被配置为根据每个照片对应的相册标识,将n张照片分别添加至对应的人脸相册中;
显示模块,被配置为显示人脸相册。
在一个实施例中,获取模块,包括:
查找子模块,被配置为从已存储的照片中查找不存在人脸识别信息的照片;
发送子模块,被配置为将查找出的n张照片发送给服务器,服务器用于对n张照片进行人脸识别并根据预设聚类算法对识别出的人脸进行聚类,得到照片所属的人脸相册以及人脸相册的相册标识;
接收子模块,被配置为接收服务器发送的人脸识别信息。
在一个实施例中,人脸识别信息中还包括有照片中每个人脸所对应的人脸标识;
该装置还包括:
第一接收模块,被配置为接收将第一照片从所属的第一人脸相册中进行移除的移除操作,第一照片是n张照片中的一个,第一人脸相册是人脸相册中的一个;
移除模块,被配置为将第一照片从第一人脸相册进行移除,且将第一照片中的关联人脸标识与第一人脸相册的相册标识之间的关联关系进行删除,关联人脸标识是服务器将第一照片聚类至第一人脸相册时所采用的人脸的人脸标识;
第一发送模块,被配置为将第一照片的照片标识和移除信息发送给服务器,移除信息用于表示将关联人脸标识与第一人脸相册的相册标识之间的关联关系进行删除,服务器用于根据第一照片的照片标识和移除信息调整预设聚类算法。
在一个实施例中,人脸识别信息中还包括有照片中每个人脸所对应的人脸标识;
该装置还包括:
第二接收模块,被配置为接收将第二照片添加至第二人脸相册的添加操作,第二人脸相册是人脸相册中的一个;
添加模块,被配置为将第二照片添加至从第二人脸相册,且建立第二照片中的人脸标识与第二人脸相册的相册标识之间的关联关系;
第二发送模块,被配置为将第二照片的照片标识和添加信息发送给服务器,添加信息用于表示建立第二照片中的人脸标识与第二人脸相册的相册标识之间的关联关系,服务器用于 根据第二照片的照片标识和添加信息调整预设聚类算法。
在一个实施例中,显示模块,包括:
获取子模块,被配置为获取每个人脸相册所对应的人名信息;
显示子模块,被配置为将人名信息作为人脸相册的属性信息进行显示。
在一个实施例中,装置还包括:
第三接收模块,被配置为接收将至少两个人名信息所对应的人脸相册进行合并的合并操作;
合并模块,被配置为根据合并操作将至少两个人名信息所对应的人脸相册进行合并,生成合并相册。
在一个实施例中,合并模块,包括:
规则获取子模块,被配置为根据合并操作获取照片合并规则;
合并子模块,被配置为将至少两个人名信息所对应的人脸相册中,符合照片合并规则的照片合并为合并相册;
照片合并规则包括:
包含至少两个人名信息中的至少一个人名信息所对应的人脸;
或,
包含至少两个人名信息中的全部人名信息所对应的人脸;
或,
至少包含至少两个人名信息中的指定人名信息所对应的人脸;
或,
只包含至少两个人名信息所对应的人脸。
在一个实施例中,装置还包括:
查找模块,被配置为从通讯录应用中查找与人名信息匹配的联系人;
选择显示模块,被配置为显示查找出的联系人的选择界面;
关联模块,被配置为将被选择的联系人与人名信息所对应的人脸相册进行关联。
在一个实施例中,关联模块,被配置为在通讯录应用中与联系人对应的信息界面中,提供人脸相册的访问入口;或,将人脸相册中的照片设置为联系人的头像;或,在人脸相册的照片分享选项中,提供直接分享至联系人的分享选项。
根据本公开的第三方面,提供了一种相册显示装置,该装置包括:
处理器;
用于存储处理器可执行指令的存储器;
其中,处理器被配置为:
从服务器获取n张照片的人脸识别信息,人脸识别信息包括:照片标识和照片所属的人脸相册的相册标识,照片所属的人脸相册是服务器根据照片中的人脸进行相似聚类后得到的,n为正整数;
根据每个照片对应的相册标识,将n张照片分别添加至对应的人脸相册中;
显示人脸相册。
本公开的实施例提供的技术方案可以包括以下有益效果:
通过根据照片中的人脸来进行聚类得到不同的人脸相册,使得能够根据不同的人脸来管理和显示移动终端中的照片。解决了相关技术中的相册程序只能依靠图片来源、时间或地点来管理和显示照片的问题,达到了相册程序可以根据人脸来管理和显示照片的效果。
应当理解的是,以上的一般描述和后文的细节描述仅是示例性的,并不能限制本公开。
附图说明
此处的附图被并入说明书中并构成本说明书的一部分,示出了符合本公开的实施例,并于说明书一起用于解释本公开的原理。
图1是根据一示例性实施例示出的相册显示方法的流程图。
图2A是根据另一示例性实施例示出的相册显示方法的流程图。
图2B是根据图2A所示的示例性实施例示出的相册显示方法的原理示意图。
图2C是根据图2A所示的示例性实施例示出的相册显示方法的界面示意图。
图3A是根据另一示例性实施例示出的相册显示方法的流程图。
图3B是根据图3A所示的示例性实施例示出的相册显示方法的界面示意图。
图4A是根据另一示例性实施例示出的相册显示方法的流程图。
图4B是根据图4A所示的示例性实施例示出的相册显示方法的界面示意图。
图5A是根据另一示例性实施例示出的相册显示方法的流程图。
图5B是根据图5A所示的示例性实施例示出的相册显示方法的界面示意图。
图6是根据另一示例性实施例示出的相册显示方法的流程图。
图7是根据另一示例性实施例示出的相册显示方法的流程图。
图8A是根据另一示例性实施例示出的相册显示方法的流程图。
图8B是根据图8A所示的示例性实施例示出的相册显示方法的界面示意图。
图9是根据一示例性实施例示出的相册显示装置的框图。
图10是根据另一示例性实施例示出的相册显示装置的框图。
图11是根据另一示例性实施例示出的相册显示装置的框图。
具体实施方式
这里将详细地对示例性实施例进行说明,其示例表示在附图中。下面的描述涉及附图时,除非另有表示,不同附图中的相同数字表示相同或相似的要素。以下示例性实施例中所描述的实施方式并不代表与本公开相一致的所有实施方式。相反,它们仅是与如所附权利要求书中所详述的、本公开的一些方面相一致的装置和方法的例子。
本文中的移动终端可以是手机、平板电脑、电子书阅读器、MP3播放器(Moving Picture  Experts Group Audio Layer III,动态影像专家压缩标准音频层面3)、MP4(Moving Picture Experts Group Audio Layer IV,动态影像专家压缩标准音频层面4)播放器、膝上型便携计算机和台式计算机等等。
图1是根据一示例性实施例示出的一种相册显示方法的流程图。本实施例以该相册显示方法应用于移动终端来中举例说明。该方法包括:
在步骤102中,从服务器获取n张照片的人脸识别信息,人脸识别信息包括:照片标识和该照片所属的人脸相册的相册标识,n为正整数。
照片标识是用来将当前照片与其它照片进行区分的标识。每个照片的照片标识在所有照片标识中具有唯一性。
相册标识是用来将当前人脸相册与其它人脸相册进行区分的标识。每个相册标识在所有相册标识中具有唯一性。
当前照片所属的人脸相册是服务器根据照片中的人脸进行相似聚类后得到的,也即,人脸相似度超过阈值的若干张照片会被聚类至同一人脸相册。
在步骤104中,根据每个照片对应的相册标识,将n张照片分别添加至对应的人脸相册中。
对于每个相册标识,若移动终端已经具有与该相册标识对应的人脸相册,则直接将照片添加至该人脸相册即可;若移动终端中还未具有与该相册标识对应的人脸相册,则根据该相册标识新建一个人脸相册,再将照片添加至该人脸相册。
在步骤106中,显示人脸相册。
综上所述,本实施例提供的相册显示方法,通过根据照片中的人脸来进行聚类得到不同的人脸相册,使得能够根据不同的人脸来管理和显示移动终端中的照片。解决了相关技术中的相册程序只能依靠图片来源、时间或地点来管理和显示照片的问题,达到了相册程序可以根据人脸来管理和显示照片的效果。
图2A是根据另一示例性实施例示出的一种相册显示方法的流程图,本实施例继续以该相册显示方法应用于移动终端来中举例说明。该方法包括以下步骤。
在步骤201中,从已存储的照片中查找不存在人脸识别信息的照片。
移动终端中的照片会随着用户的使用而不断地增加。
移动终端每隔预定时间间隔从本地存储的照片中查找尚不存在人脸识别信息的照片;或,移动终端在处理器的空闲时段,从本地存储的照片中查找尚不存在人脸识别信息的照片;或,移动终端在拍照程序每次被使用并关闭后,从本地存储的照片中查找尚不存在人脸识别信息的照片。
比如,移动终端每天晚上11:00从本地存储的照片中查找尚不存在人脸识别信息的照片。
在步骤202中,将查找出的n张照片发送给服务器,服务器用于对n张照片进行人脸识 别并根据预设聚类算法对识别出的人脸进行聚类,得到相册标识,n为正整数。
在查找出n张照片不存在人脸识别信息后,移动终端将查找出的n张照片发送给服务器。
对应地,服务器接收该n张照片。对于n张照片中的每个照片,服务器对该照片进行人脸识别,得到该照片中的人脸。可选地,该人脸采用人脸标识和人脸特征信息表示。然后,根据预设聚类算法对识别出的人脸进行聚类,得到该照片所属的人脸相册以及该人脸相册的相册标识。
服务器对照片的处理过程可以参考图2B所示。
其中,人脸标识是用来将当前人脸与其它人脸进行区分的标识。同一照片中的每个人脸具有不同的人脸标识。而且,由于同一个人在两次拍摄时的人脸,也会有大小、颜色和亮度上的差异。可选地,同一个人在不同照片中的人脸,也具有不同的人脸标识,也即每个照片中的每个人脸都具有唯一的人脸标识。
其中,一张照片对应一个照片标识;一张照片对应n个人脸标识,n为正整数,也即,照片中有n个人脸,则对应n个人脸标识。一张照片对应n个相册标识;在不考虑合并相册的前提下,一张照片中的每个人脸标识对应一个人脸相册,也即每个人脸标识对应一个相册标识。
在步骤203中,接收服务器发送的人脸识别信息,人脸识别信息包括:照片标识、照片中每个人脸的人脸标识和照片所属的人脸相册的相册标识。
每个照片所属的人脸相册是服务器根据照片中的人脸进行相似聚类后得到的,n为正整数。
移动终端接收服务器发送的n张照片的人脸识别信息。人脸识别信息包括:照片标识、照片中每个人脸的人脸标识和照片所属的人脸相册的相册标识。
可选地,人脸识别信息还包括有照片中每个人脸的位置信息。
结合图2B,一种示意性的人脸识别信息如下表一所示:
Figure PCTCN2015095185-appb-000001
表一
在步骤204中,根据每个照片对应的相册标识,将n张照片分别添加至对应的人脸相册中。
比如,移动终端根据人脸识别信息,将照片001添加至人脸相册C01;将照片002添加 至人脸相册C01和人脸相册C02;将照片003添加至人脸相册C01、人脸相册C02和人脸相册C03;将照片004添加至人脸相册C03。
但需要说明的是,若移动终端已经具有与该相册标识对应的人脸相册,则直接将照片添加至该人脸相册即可;若移动终端中还未具有与该相册标识对应的人脸相册,则根据该相册标识新建一个人脸相册,再将照片添加至该人脸相册。
在步骤205中,获取每个人脸相册所对应的人名信息。
每个人脸相册可以对应一个人名信息。但由于存在不同的人具有相同的人名的情况,同一个人名信息可以对应多个人脸相册。
移动终端可以接收用户为每个人脸相册所输入的人名。
在步骤206中,将人名信息作为人脸相册的属性信息进行显示。
移动终端在显示人脸相册时,将每个人脸相册对应的人名信息作为人脸相册的属性信息进行显示。该属性信息可以是相册名。各个人脸相册可以作为一个图片文件夹显示,每个图片文件夹还可以设置有封面照片。
在人脸相册是新建人脸相册时,移动终端可以采用诸如“新面孔1”、“新面孔2”、“未知人物1”、“未知人物2”、“陌生人1”、“新建人脸相册20150303”之类的默认相册名。
比如,参考图2C,移动终端将每个人脸相册对应的人名信息作为人脸相册的相册名进行显示。其中,人脸相册可以作为新增的一种显示模式与其它显示模式共存。
综上所述,本实施例提供的相册显示方法,通过根据照片中的人脸来进行聚类得到不同的人脸相册,使得能够根据不同的人脸来管理和显示移动终端中的照片。解决了相关技术中的相册程序只能依靠图片来源、时间或地点来管理和显示照片的问题,达到了相册程序可以根据人脸来管理和显示照片的效果。
可选地,移动终端根据用户对人脸相册中的照片的删除操作或添加操作生成操作信息,将该操作信息发送给服务器。服务器用于根据该操作信息调整预设聚类算法。也即,预设聚类算法是基于样本学习过程来进行聚类的学习型算法,通过用户在使用过程中产生的操作信息可以不断对预设聚类算法优化。
作为一种可能的实现方式,步骤206之后,还包括如下步骤,如图3A所示:
在步骤207中,接收将第一照片从所属的第一人脸相册中进行移除的移除操作,第一照片是n张照片中的一个,第一人脸相册是人脸相册中的一个。
在步骤208中,将第一照片从第一人脸相册进行移除,且将第一照片中的关联人脸标识与第一人脸相册的相册标识之间的关联关系进行删除,关联人脸标识是服务器将第一照片聚类至第一人脸相册时所采用的人脸的人脸标识。
在步骤209中,将第一照片的照片标识和移除信息发送给服务器,删除信息用于表示将关联人脸标识与第一人脸相册的相册标识之间的关联关系进行删除,服务器用于根据第一照 片的照片标识和移除信息调整预设聚类算法。
比如,参考图3B所示,用户发现照片002并不应该属于当前人脸相册,移动终端接收用户将照片002从当前人脸相册中进行删除的删除操作。移动终端将照片002从人脸相册C01中删除,并且将人脸识别信息中的人脸标识002001与相册标识C01之间的关联关系进行删除。然后移动终端向服务器发送照片002的照片标识和删除信息,以便服务器根据该照片标识和删除信息对预设聚类算法进行调整。
作为另一种可能的实现方式,步骤206之后,还包括如下步骤,如图4A所示:
在步骤210中,接收将第二照片添加至第二人脸相册的添加操作,第二人脸相册是人脸相册中的一个。
在步骤211中,将第二照片添加至从第二人脸相册,且建立第二照片中的人脸标识与第二人脸相册的相册标识之间的关联关系。
在步骤212中,将第二照片的照片标识和添加信息发送给服务器,添加信息用于表示建立第二照片中的人脸标识与第二人脸相册的相册标识之间的关联关系,服务器用于根据第二照片的照片标识和添加信息调整预设聚类算法。
比如,如图4B所示,用户发现照片005应该属于人脸相册yoyo,移动终端接收用户将照片005添加至人脸相册yoyo的添加操作。移动终端将照片005添加至人脸相册yoyo,并且建立照片005的人脸标识005001与相册标识之间的关联关系。然后移动终端向服务器发送照片005的照片标识和添加信息,以便服务器根据该照片标识和添加信息对预设聚类算法进行调整。
存在一种可能的情况是:第二照片尚不存在对应的人脸识别信息,则移动终端将该第二照片和第二人脸相册的相册标识发送给服务器,以便服务器根据第二照片和第二人脸相册的相册标识调整预设聚类算法。
综上所述,与相关技术中需要专门地手工标注样本相比,本实施例提供的相册显示方法是利用用户的正常使用过程所产生的操作信息,所以,能够在尽可能减少手工标注样本的工作量的前提下,增加预设聚类算法的聚类准确性,而且不会增加用户的操作负担。
需要补充说明的是,在刚启用人脸相册时,移动终端可以根据用户的操作,将同一个人的若干张照片标注后,发送给服务器。服务器用于根据这些标注后的照片对预设聚类算法进行调整。
可选地,用户还可能存在将至少两个人脸相册进行合并的需求,步骤206之后还包括如下步骤,如图5A所示:
在步骤213中,接收将至少两个人名信息所对应的人脸相册进行合并的合并操作。
当用户希望将至少两个人名信息所对应的人脸相册进行合并时,可以向移动终端触发合并操作。
用户可以通过向一个人脸相册中增加其它人名信息的方式来触发合并操作。
在步骤214中,根据合并操作将至少两个人名信息所对应的人脸相册进行合并,生成合并相册。
移动终端根据用户的合并操作,将至少两个人名信息所对应的人脸相册进行合并为新的合并相册。新的合并相册的相册标识由移动终端自动生成。
对于合并之前的人脸相册,移动终端可以继续保留。
比如,参考图5B所示,用户将人脸相册“yoyo”和人脸相册“我”合并,生成新的合并相册“yoyo和我”。
由于用户将至少两个人脸相册进行合并时,可能有不同的合并需求。可选地,步骤214可以替换为步骤214a和步骤214b,如图6所示:
在步骤214a中,根据合并操作获取照片合并规则。
用户在触发合并操作时,还可选设置照片合并规则。照片合并规则包括如下四种中的任意一种:
第一,包含至少两个人名信息中的任意一个人名信息所对应的人脸。
第二,包含至少两个人名信息中的全部人名信息所对应的人脸。
第三,至少包含至少两个人名信息中的指定人名信息所对应的人脸。
第四,只包含至少两个人名信息所对应的人脸。
在步骤214b中,将至少两个人名信息所对应的人脸相册中,符合照片合并规则的照片合并为合并相册。
以至少两个人名信息包括:人名1、人名2、人名3为例。
对于第一种规则,只要当前照片包含至少两个人名信息中的任意一个人名信息所对应的人脸,则将当前照片添加至合并相册。比如,只要当前照片包括人名1、人名2和人名3中任意一个人的人脸,则合并至合并相册。
对于第二种规则,只有当前照片包含至少两个人名信息中的全部人名信息所对应的人脸,才将当前照片添加至合并相册。比如,只有当前照片同时包括人名1、人名2和人名3中三个人的人脸,才被合并至合并相册。当然,当前照片中可能还包括其它人名信息所对应的人脸。
对于第三种规则,当前照片至少包含至少两个人名信息中的指定人名信息所对应的人脸,才将当前照片添加至合并相册。比如,当前照片至少包括有人名1和人名2的人脸,才会被合并至合并相册。当然,当前照片中可能还包括人名3或其它人名信息所对应的人脸。
对于第四种规则,只有当前照片包含且仅包含至少两个人名信息中的全部人名信息所对应的人脸,才将当前照片添加至合并相册。比如,只有当前照片同时包括且仅包括人名1、人名2和人名3中三个人的人脸,才被合并至合并相册。当前照片不可以再包括其它人名信息所对应的人脸。
综上所述,本实施例提供的相册显示方法,通过在移动终端一侧提供用户自定义的合并相册,使得用户可以根据自身的需求在单人人脸相册基础上合并出合并相册。同时,通过提供照片合并规则,还可以使用户合并出不同展现形式的合并相册。
可选地,移动终端还可以将人脸相册与通信录应用实现关联。上述步骤206之后,还可以包括如下步骤,如图7所示:
在步骤215中,从通讯录应用中查找与人名信息匹配的联系人。
对于某一人名信息对应的人脸相册,移动终端从通讯录应用中查找与该人名信息全部匹配或部分匹配的联系人。本公开实施例对通讯录应用的类型不做限定,不论是仅包括通讯录功能的通讯录应用,还是包括有通讯录功能的多功能应用程序,均可认为是通讯录应用。
比如,对于“张三”对应的人脸相册,移动终端从通讯录应用中查找出联系人“张三”、“三哥”、“张哥”作为与该人名信息匹配的联系人。
在步骤216中,显示查找出的联系人的选择界面。
移动终端可以显示查找出的联系人的选择界面。
对应地,用户可以在选择界面中选择一个联系人作为与人名信息匹配的联系人。比如,选择联系人“三哥”作为与该人名信息匹配的联系人。
在步骤217中,将被选择的联系人与该人名信息所对应的人脸相册进行关联。
移动终端将被选择的联系人与该人名信息所对应的人脸相册进行关联的方式,包括但不限于如下三种中的任意一种。也即,上述步骤217可被替换为步骤217a或步骤217b或步骤217c,如图8A所示:
在步骤217a中,在通讯录应用中与联系人对应的信息界面中,提供人脸相册的访问入口。
如图8B所示,移动终端在“三哥”的信息界面中,提供一个快捷按钮。该快捷按钮是与人名信息“张三”对应的人脸相册的访问入口80。
在步骤217b中,将人脸相册中的照片设置为联系人的头像。
移动终端还可以将人脸相册中的封面照片设置为该联系人的头像;或者,将人脸相册中随机选择的一张照片设置为该联系人的头像;或者,将人脸相册中被用户选择的一张照片设置为该联系人的头像;或者,将人脸相册中被用户选择的一张照片设置为该联系人的头像;或者,将人脸相册中的最近拍摄的一张照片,作为该联系人的头像;或者,将人脸相册中的照片生成为动态头像,作为该联系人的头像。
在步骤217c中,在人脸相册的照片分享选项中,提供直接分享至联系人的分享选项。
相关技术提供的照片分享选项可以包括:通过电子邮件分享、发送到我的电脑、分享到微博等。
在本实施例中,在上述照片分享选项的基础上,还可以提供直接分享至联系人的邮件、短信息、即时通信帐号或社交类应用帐号的分享选项。
综上所述,本实施例提供的相册显示方法,还通过将人脸相册和通讯录应用进行关联, 实现人脸相册的快速访问、联系人头像的动态更新和照片的快速分享,使得相册程序不再是独立运行的应用程序,而是可以与其它应用程序协同运行,使得用户在使用人脸相册或通讯录应用时更加便捷的效果。
本领域技术人员可以根据上述各个实施例再自行组合出其它实施例,本公开对此不再赘述。
下述为本公开装置实施例,可以用于执行本公开方法实施例。对于本公开装置实施例中未披露的细节,请参照本公开方法实施例。
图9是根据本公开一示例性实施例提供的相册显示装置的框图。该相册显示装置可以通过软件、硬件或者两者的结合实现成为移动终端的全部或部分。该相册显示装置包括:
获取模块920,被配置为从服务器获取n张照片的人脸识别信息,人脸识别信息包括:照片标识和照片所属的人脸相册的相册标识,照片所属的人脸相册是服务器根据照片中的人脸进行相似聚类后得到的,n为正整数。
添加模块940,被配置为根据每个照片对应的相册标识,将n张照片分别添加至对应的人脸相册中。
显示模块960,被配置为显示人脸相册。
综上所述,本实施例提供的相册显示装置,通过根据照片中的人脸来进行聚类得到不同的人脸相册,使得能够根据不同的人脸来管理和显示移动终端中的照片。解决了相关技术中的相册程序只能依靠图片来源、时间或地点来管理和显示照片的问题,达到了相册程序可以根据人脸来管理和显示照片的效果。
图10是根据本公开另一示例性实施例提供的相册显示装置的框图。该相册显示装置可以通过软件、硬件或者两者的结合实现成为移动终端的全部或部分。该相册显示装置包括:
获取模块920,被配置为从服务器获取n张照片的人脸识别信息,人脸识别信息包括:照片标识和照片所属的人脸相册的相册标识,照片所属的人脸相册是服务器根据照片中的人脸进行相似聚类后得到的,n为正整数。
添加模块940,被配置为根据每个照片对应的相册标识,将n张照片分别添加至对应的人脸相册中。
显示模块960,被配置为显示人脸相册。
可选地,获取模块920,包括:
查找子模块922,被配置为从已存储的照片中查找不存在人脸识别信息的照片;
发送子模块924,被配置为将查找出的n张照片发送给服务器,服务器用于对n张照片进行人脸识别并根据预设聚类算法对识别出的人脸进行聚类,得到照片所属的人脸相册以及人脸相册的相册标识;
接收子模块926,被配置为接收服务器发送的人脸识别信息。
可选地,人脸识别信息中还包括有照片中每个人脸所对应的人脸标识;
该装置还包括:
第一接收模块932,被配置为接收将第一照片从所属的第一人脸相册中进行移除的移除操作,第一照片是n张照片中的一个,第一人脸相册是人脸相册中的一个。
移除模块934,被配置为将第一照片从第一人脸相册进行移除,且将第一照片中的关联人脸标识与第一人脸相册的相册标识之间的关联关系进行删除,关联人脸标识是服务器将第一照片聚类至第一人脸相册时所采用的人脸的人脸标识。
第一发送模块936,被配置为将第一照片的照片标识和移除信息发送给服务器,移除信息用于表示将关联人脸标识与第一人脸相册的相册标识之间的关联关系进行删除,服务器用于根据第一照片的照片标识和移除信息调整预设聚类算法。
可选地,人脸识别信息中还包括有照片中每个人脸所对应的人脸标识;
该装置还包括:
第二接收模块952,被配置为接收将第二照片添加至第二人脸相册的添加操作,第二人脸相册是人脸相册中的一个。
添加模块954,被配置为将第二照片添加至从第二人脸相册,且建立第二照片中的人脸标识与第二人脸相册的相册标识之间的关联关系。
第二发送模块956,被配置为将第二照片的照片标识和添加信息发送给服务器,添加信息用于表示建立第二照片中的人脸标识与第二人脸相册的相册标识之间的关联关系,服务器用于根据第二照片的照片标识和添加信息调整预设聚类算法。
可选地,显示模块960,包括:
获取子模块962,被配置为获取每个人脸相册所对应的人名信息。
显示子模块964,被配置为将人名信息作为人脸相册的属性信息进行显示。
可选地,该装置还包括:
第三接收模块972,被配置为接收将至少两个人名信息所对应的人脸相册进行合并的合并操作。
合并模块974,被配置为根据合并操作将至少两个人名信息所对应的人脸相册进行合并,生成合并相册。
可选地,合并模块974,包括:
规则获取子模块974a,被配置为根据合并操作获取照片合并规则;
合并子模块974b,被配置为将至少两个人名信息所对应的人脸相册中,符合照片合并规则的照片合并为合并相册;
照片合并规则包括:
包含至少两个人名信息中的至少一个人名信息所对应的人脸;
或,
包含至少两个人名信息中的全部人名信息所对应的人脸;
或,
至少包含至少两个人名信息中的指定人名信息所对应的人脸;
或,
只包含至少两个人名信息所对应的人脸。
可选地,该装置还包括:
查找模块982,被配置为从通讯录应用中查找与人名信息匹配的联系人;
选择显示模块984,被配置为显示查找出的联系人的选择界面;
关联模块986,被配置为将被选择的联系人与人名信息所对应的人脸相册进行关联。
可选地,关联模块986,被配置为在通讯录应用中与联系人对应的信息界面中,提供人脸相册的访问入口;或,将人脸相册中的照片设置为联系人的头像;或,在人脸相册的照片分享选项中,提供直接分享至联系人的分享选项。
关于上述实施例中的装置,其中各个模块执行操作的具体方式已经在有关该方法的实施例中进行了详细描述,此处将不做详细阐述说明。
本公开一示例性实施例提供了一种相册显示装置,能够实现本公开提供的相册显示方法,该相册显示装置包括:处理器、用于存储处理器可执行指令的存储器;
其中,处理器被配置为:
从服务器获取n张照片的人脸识别信息,人脸识别信息包括:照片标识和照片所属的人脸相册的相册标识,照片所属的人脸相册是服务器根据照片中的人脸进行相似聚类后得到的,n为正整数;
根据每个照片对应的相册标识,将n张照片分别添加至对应的人脸相册中;
显示人脸相册。
图11是根据一示例性实施例示出的一种相册显示装置的框图。例如,装置1100可以是移动电话,计算机,数字广播终端,消息收发设备,游戏控制台,平板设备,医疗设备,健身设备,个人数字助理等。
参照图11,装置1100可以包括以下一个或多个组件:处理组件1102,存储器1104,电源组件1106,多媒体组件1108,音频组件1110,输入/输出(I/O)接口1112,传感器组件1114,以及通信组件1116。
处理组件1102通常控制装置1100的整体操作,诸如与显示,电话呼叫,数据通信,相机操作和记录操作相关联的操作。处理组件1102可以包括一个或多个处理器1118来执行指令,以完成上述的方法的全部或部分步骤。此外,处理组件1102可以包括一个或多个模块,便于处理组件1102和其他组件之间的交互。例如,处理组件1102可以包括多媒体模块,以方便多媒体组件1108和处理组件1102之间的交互。
存储器1104被配置为存储各种类型的数据以支持在装置1100的操作。这些数据的示例 包括用于在装置1100上操作的任何应用程序或方法的指令,联系人数据,电话簿数据,消息,图片,视频等。存储器1104可以由任何类型的易失性或非易失性存储设备或者它们的组合实现,如静态随机存取存储器(SRAM),电可擦除可编程只读存储器(EEPROM),可擦除可编程只读存储器(EPROM),可编程只读存储器(PROM),只读存储器(ROM),磁存储器,快闪存储器,磁盘或光盘。
电源组件1106为装置1100的各种组件提供电力。电源组件1106可以包括电源管理系统,一个或多个电源,及其他与为装置1100生成、管理和分配电力相关联的组件。
多媒体组件1108包括在装置1100和用户之间的提供一个输出接口的屏幕。在一些实施例中,屏幕可以包括液晶显示器(LCD)和触摸面板(TP)。如果屏幕包括触摸面板,屏幕可以被实现为触摸屏,以接收来自用户的输入信号。触摸面板包括一个或多个触摸传感器以感测触摸、滑动和触摸面板上的手势。触摸传感器可以不仅感测触摸或滑动动作的边界,而且还检测与触摸或滑动操作相关的持续时间和压力。在一些实施例中,多媒体组件1108包括一个前置摄像头和/或后置摄像头。当装置1100处于操作模式,如拍摄模式或视频模式时,前置摄像头和/或后置摄像头可以接收外部的多媒体数据。每个前置摄像头和后置摄像头可以是一个固定的光学透镜系统或具有焦距和光学变焦能力。
音频组件1110被配置为输出和/或输入音频信号。例如,音频组件1110包括一个麦克风(MIC),当装置1100处于操作模式,如呼叫模式、记录模式和语音识别模式时,麦克风被配置为接收外部音频信号。所接收的音频信号可以被进一步存储在存储器1104或经由通信组件1116发送。在一些实施例中,音频组件1110还包括一个扬声器,用于输出音频信号。
I/O接口1112为处理组件1102和外围接口模块之间提供接口,上述外围接口模块可以是键盘,点击轮,按钮等。这些按钮可包括但不限于:主页按钮、音量按钮、启动按钮和锁定按钮。
传感器组件1114包括一个或多个传感器,用于为装置1100提供各个方面的状态评估。例如,传感器组件1114可以检测到装置1100的打开/关闭状态,组件的相对定位,例如组件为装置1100的显示器和小键盘,传感器组件1114还可以检测装置1100或装置1100一个组件的位置改变,用户与装置1100接触的存在或不存在,装置1100方位或加速/减速和装置1100的温度变化。传感器组件1114可以包括接近传感器,被配置用来在没有任何的物理接触时检测附近物体的存在。传感器组件1114还可以包括光传感器,如CMOS或CCD图像传感器,用于在成像应用中使用。在一些实施例中,该传感器组件1114还可以包括加速度传感器,陀螺仪传感器,磁传感器,压力传感器或温度传感器。
通信组件1116被配置为便于装置1100和其他设备之间有线或无线方式的通信。装置1100可以接入基于通信标准的无线网络,如Wi-Fi,2G或3G,或它们的组合。在一个示例性实施例中,通信组件1116经由广播信道接收来自外部广播管理系统的广播信号或广播相关信息。在一个示例性实施例中,通信组件1116还包括近场通信(NFC)模块,以促进短程通信。例如,在NFC模块可基于射频识别(RFID)技术,红外数据协会(IrDA)技术,超宽带(UWB) 技术,蓝牙(BT)技术和其他技术来实现。
在示例性实施例中,装置1100可以被一个或多个应用专用集成电路(ASIC)、数字信号处理器(DSP)、数字信号处理设备(DSPD)、可编程逻辑器件(PLD)、现场可编程门阵列(FPGA)、控制器、微控制器、微处理器或其他电子元件实现,用于执行上述相册显示方法。
在示例性实施例中,还提供了一种包括指令的非临时性计算机可读存储介质,例如包括指令的存储器1104,上述指令可由装置1100的处理器1118执行以完成上述相册显示方法。例如,非临时性计算机可读存储介质可以是ROM、随机存取存储器(RAM)、CD-ROM、磁带、软盘和光数据存储设备等。
本领域技术人员在考虑说明书及实践这里公开的发明后,将容易想到本公开的其它实施方案。本申请旨在涵盖本公开的任何变型、用途或者适应性变化,这些变型、用途或者适应性变化遵循本公开的一般性原理并包括本公开未公开的本技术领域中的公知常识或惯用技术手段。说明书和实施例仅被视为示例性的,本公开的真正范围和精神由下面的权利要求指出。
应当理解的是,本公开并不局限于上面已经描述并在附图中示出的精确结构,并且可以在不脱离其范围进行各种修改和改变。本公开的范围仅由所附的权利要求来限制。

Claims (19)

  1. 一种相册显示方法,其特征在于,所述方法包括:
    从服务器获取n张照片的人脸识别信息,所述人脸识别信息包括:照片标识和所述照片所属的人脸相册的相册标识,所述照片所属的人脸相册是所述服务器根据所述照片中的人脸进行相似聚类后得到的,n为正整数;
    根据每个照片对应的所述相册标识,将所述n张照片分别添加至对应的所述人脸相册中;
    显示所述人脸相册。
  2. 根据权利要求1所述的方法,其特征在于,所述从服务器获取n张照片的人脸识别信息,包括:
    从已存储的照片中查找不存在所述人脸识别信息的照片;
    将查找出的所述n张照片发送给所述服务器,所述服务器用于对所述n张照片进行人脸识别并根据预设聚类算法对识别出的人脸进行聚类,得到所述照片所属的所述人脸相册以及所述人脸相册的相册标识;
    接收所述服务器发送的所述人脸识别信息。
  3. 根据权利要求2所述的方法,其特征在于,所述人脸识别信息中还包括有所述照片中每个人脸所对应的人脸标识;
    所述方法还包括:
    接收将第一照片从所属的第一人脸相册中进行移除的移除操作,所述第一照片是所述n张照片中的一个,所述第一人脸相册是所述人脸相册中的一个;
    将所述第一照片从所述第一人脸相册进行移除,且将所述第一照片中的关联人脸标识与所述第一人脸相册的相册标识之间的关联关系进行删除,所述关联人脸标识是所述服务器将所述第一照片聚类至所述第一人脸相册时所采用的人脸的人脸标识;
    将所述第一照片的照片标识和移除信息发送给所述服务器,所述移除信息用于表示将所述关联人脸标识与所述第一人脸相册的相册标识之间的关联关系进行删除,所述服务器用于根据所述第一照片的照片标识和所述移除信息调整所述预设聚类算法。
  4. 根据权利要求2所述的方法,其特征在于,所述人脸识别信息中还包括有所述照片中每个人脸所对应的人脸标识;
    所述方法还包括:
    接收将第二照片添加至第二人脸相册的添加操作,所述第二人脸相册是所述人脸相册中的一个;
    将所述第二照片添加至从所述第二人脸相册,且建立所述第二照片中的人脸标识与所述第二人脸相册的相册标识之间的关联关系;
    将所述第二照片的照片标识和添加信息发送给所述服务器,所述添加信息用于表示建立所述第二照片中的人脸标识与所述第二人脸相册的相册标识之间的关联关系,所述服务器用于根据所述第二照片的照片标识和所述添加信息调整所述预设聚类算法。
  5. 根据权利要求1至4任一所述的方法,其特征在于,所述显示所述人脸相册,包括:
    获取每个所述人脸相册所对应的人名信息;
    将所述人名信息作为所述人脸相册的属性信息进行显示。
  6. 根据权利要求5所述的方法,其特征在于,所述方法还包括:
    接收将至少两个人名信息所对应的人脸相册进行合并的合并操作;
    根据所述合并操作将所述至少两个人名信息所对应的人脸相册进行合并,生成合并相册。
  7. 根据权利要求6所述的方法,其特征在于,所述根据所述合并操作将所述至少两个人名信息所对应的人脸相册进行合并,生成合并相册,包括:
    根据所述合并操作获取照片合并规则;
    将所述至少两个人名信息所对应的人脸相册中,符合所述照片合并规则的照片合并为所述合并相册;
    所述照片合并规则包括:
    包含所述至少两个人名信息中的至少一个人名信息所对应的人脸;
    或,
    包含所述至少两个人名信息中的全部人名信息所对应的人脸;
    或,
    至少包含所述至少两个人名信息中的指定人名信息所对应的人脸;
    或,
    只包含所述至少两个人名信息所对应的人脸。
  8. 根据权利要求5所述的方法,其特征在于,所述方法还包括:
    从通讯录应用中查找与所述人名信息匹配的联系人;
    显示查找出的所述联系人的选择界面;
    将被选择的所述联系人与所述人名信息所对应的人脸相册进行关联。
  9. 根据权利要求8所述的方法,其特征在于,所述将被选择的所述联系人与所述人名信息所对应的人脸相册进行关联,包括:
    在所述通讯录应用中与所述联系人对应的信息界面中,提供所述人脸相册的访问入口;
    或,
    将所述人脸相册中的照片设置为所述联系人的头像;
    或,
    在所述人脸相册的照片分享选项中,提供直接分享至所述联系人的分享选项。
  10. 一种相册显示装置,其特征在于,所述装置,包括:
    获取模块,被配置为从服务器获取n张照片的人脸识别信息,所述人脸识别信息包括:照片标识和所述照片所属的人脸相册的相册标识,所述照片所属的人脸相册是所述服务器根据所述照片中的人脸进行相似聚类后得到的,n为正整数;
    添加模块,被配置为根据每个照片对应的所述相册标识,将所述n张照片分别添加至对应的所述人脸相册中;
    显示模块,被配置为显示所述人脸相册。
  11. 根据权利要求10所述的装置,其特征在于,所述获取模块,包括:
    查找子模块,被配置为从已存储的照片中查找不存在所述人脸识别信息的照片;
    发送子模块,被配置为将查找出的所述n张照片发送给所述服务器,所述服务器用于对所述n张照片进行人脸识别并根据预设聚类算法对识别出的人脸进行聚类,得到所述照片所属的所述人脸相册以及所述人脸相册的相册标识;
    接收子模块,被配置为接收所述服务器发送的所述人脸识别信息。
  12. 根据权利要求11所述的装置,其特征在于,所述人脸识别信息中还包括有所述照片中每个人脸所对应的人脸标识;
    所述装置还包括:
    第一接收模块,被配置为接收将第一照片从所属的第一人脸相册中进行移除的移除操作,所述第一照片是所述n张照片中的一个,所述第一人脸相册是所述人脸相册中的一个;
    移除模块,被配置为将所述第一照片从所述第一人脸相册进行移除,且将所述第一照片中的关联人脸标识与所述第一人脸相册的相册标识之间的关联关系进行删除,所述关联人脸标识是所述服务器将所述第一照片聚类至所述第一人脸相册时所采用的人脸的人脸标识;
    第一发送模块,被配置为将所述第一照片的照片标识和移除信息发送给所述服务器,所述移除信息用于表示将所述关联人脸标识与所述第一人脸相册的相册标识之间的关联关系进行删除,所述服务器用于根据所述第一照片的照片标识和所述移除信息调整所述预设聚类算法。
  13. 根据权利要求11所述的装置,其特征在于,所述人脸识别信息中还包括有所述照片中每个人脸所对应的人脸标识;
    所述装置还包括:
    第二接收模块,被配置为接收将第二照片添加至第二人脸相册的添加操作,所述第二人脸相册是所述人脸相册中的一个;
    添加模块,被配置为将所述第二照片添加至从所述第二人脸相册,且建立所述第二照片中的人脸标识与所述第二人脸相册的相册标识之间的关联关系;
    第二发送模块,被配置为将所述第二照片的照片标识和添加信息发送给所述服务器,所述添加信息用于表示建立所述第二照片中的人脸标识与所述第二人脸相册的相册标识之间的关联关系,所述服务器用于根据所述第二照片的照片标识和所述添加信息调整所述预设聚类算法。
  14. 根据权利要求10至13任一所述的装置,其特征在于,所述显示模块,包括:
    获取子模块,被配置为获取每个所述人脸相册所对应的人名信息;
    显示子模块,被配置为将所述人名信息作为所述人脸相册的属性信息进行显示。
  15. 根据权利要求14所述的装置,其特征在于,所述装置还包括:
    第三接收模块,被配置为接收将至少两个人名信息所对应的人脸相册进行合并的合并操作;
    合并模块,被配置为根据所述合并操作将所述至少两个人名信息所对应的人脸相册进行合并,生成合并相册。
  16. 根据权利要求15所述的装置,其特征在于,所述合并模块,包括:
    规则获取子模块,被配置为根据所述合并操作获取照片合并规则;
    合并子模块,被配置为将所述至少两个人名信息所对应的人脸相册中,符合所述照片合并规则的照片合并为所述合并相册;
    所述照片合并规则包括:
    包含所述至少两个人名信息中的至少一个人名信息所对应的人脸;
    或,
    包含所述至少两个人名信息中的全部人名信息所对应的人脸;
    或,
    至少包含所述至少两个人名信息中的指定人名信息所对应的人脸;
    或,
    只包含所述至少两个人名信息所对应的人脸。
  17. 根据权利要求14所述的装置,其特征在于,所述装置还包括:
    查找模块,被配置为从通讯录应用中查找与所述人名信息匹配的联系人;
    选择显示模块,被配置为显示查找出的所述联系人的选择界面;
    关联模块,被配置为将被选择的所述联系人与所述人名信息所对应的人脸相册进行关联。
  18. 根据权利要求17所述的装置,其特征在于,所述关联模块,被配置为在所述通讯录应用中与所述联系人对应的信息界面中,提供所述人脸相册的访问入口;或,将所述人脸相册中的照片设置为所述联系人的头像;或,在所述人脸相册的照片分享选项中,提供直接分享至所述联系人的分享选项。
  19. 一种相册显示装置,其特征在于,所述装置包括:
    处理器;
    用于存储所述处理器可执行指令的存储器;
    其中,所述处理器被配置为:
    从服务器获取n张照片的人脸识别信息,所述人脸识别信息包括:照片标识和所述照片所属的人脸相册的相册标识,所述照片所属的人脸相册是所述服务器根据所述照片中的人脸进行相似聚类后得到的,n为正整数;
    根据每个照片对应的所述相册标识,将所述n张照片分别添加至对应的所述人脸相册中;
    显示所述人脸相册。
PCT/CN2015/095185 2015-04-08 2015-11-20 相册显示方法及装置 WO2016161807A1 (zh)

Priority Applications (4)

Application Number Priority Date Filing Date Title
RU2016126469A RU2647681C2 (ru) 2015-04-08 2015-11-20 Способ и устройство отображения альбома
KR1020167007569A KR101820781B1 (ko) 2015-04-08 2015-11-20 앨범 표시 방법 및 장치
MX2016004111A MX359407B (es) 2015-04-08 2015-11-20 Metodo y aparato para despliegue de albumes.
JP2016515944A JP2017520809A (ja) 2015-04-08 2015-11-20 アルバム表示方法及び装置

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201510164076.2 2015-04-08
CN201510164076.2A CN104820675B (zh) 2015-04-08 2015-04-08 相册显示方法及装置

Publications (1)

Publication Number Publication Date
WO2016161807A1 true WO2016161807A1 (zh) 2016-10-13

Family

ID=53730972

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2015/095185 WO2016161807A1 (zh) 2015-04-08 2015-11-20 相册显示方法及装置

Country Status (8)

Country Link
US (1) US9953212B2 (zh)
EP (1) EP3079082B1 (zh)
JP (1) JP2017520809A (zh)
KR (1) KR101820781B1 (zh)
CN (1) CN104820675B (zh)
MX (1) MX359407B (zh)
RU (1) RU2647681C2 (zh)
WO (1) WO2016161807A1 (zh)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US11167129B2 (en) 2014-07-25 2021-11-09 Saluda Medical Pty Ltd Neural stimulation dosing

Families Citing this family (38)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104820675B (zh) * 2015-04-08 2018-11-06 小米科技有限责任公司 相册显示方法及装置
CN105468675A (zh) * 2015-11-13 2016-04-06 四川长虹电器股份有限公司 一种结合人物识别与节假日信息的照片展示系统及方法
CN105426485A (zh) * 2015-11-20 2016-03-23 小米科技有限责任公司 图像合并方法和装置、智能终端和服务器
CN106776662B (zh) * 2015-11-25 2020-03-03 腾讯科技(深圳)有限公司 一种照片的分类整理方法和装置
CN105260732A (zh) * 2015-11-26 2016-01-20 小米科技有限责任公司 图片处理方法及装置
CN105577917B (zh) * 2015-11-27 2019-02-19 小米科技有限责任公司 照片显示方法和装置、智能终端
CN105468760B (zh) * 2015-12-01 2018-09-11 北京奇虎科技有限公司 对人脸图片进行标注的方法和装置
CN106156347A (zh) * 2016-07-21 2016-11-23 北京奇虎科技有限公司 云相册分类展示方法、装置及服务器
CN106657608A (zh) * 2016-11-21 2017-05-10 努比亚技术有限公司 一种相册处理方法、装置及终端
CN106776821B (zh) * 2016-11-25 2019-03-26 维沃移动通信有限公司 一种相册生成方法及终端
WO2018179310A1 (ja) * 2017-03-31 2018-10-04 本田技研工業株式会社 アルバム生成装置、アルバム生成システム及びアルバム生成方法
US10403016B2 (en) 2017-06-02 2019-09-03 Apple Inc. Face syncing in distributed computing environment
CN107247549A (zh) * 2017-06-16 2017-10-13 北京小米移动软件有限公司 获取用户头像的方法、装置、终端及存储介质
CN109218599B (zh) * 2017-07-05 2021-06-01 宏碁股份有限公司 全景图像的显示方法及其电子装置
WO2019051797A1 (zh) * 2017-09-15 2019-03-21 广东欧珀移动通信有限公司 图像处理方法和装置、计算机设备、计算机可读存储介质
CN107729391B (zh) * 2017-09-15 2020-01-10 Oppo广东移动通信有限公司 图像处理方法、装置、计算机可读存储介质和移动终端
WO2019051795A1 (zh) * 2017-09-15 2019-03-21 广东欧珀移动通信有限公司 图像处理方法、装置、终端、服务器和计算机可读存储介质
WO2019051799A1 (zh) * 2017-09-15 2019-03-21 广东欧珀移动通信有限公司 图像处理方法、装置、移动终端、服务器和存储介质
CN107977674B (zh) * 2017-11-21 2020-02-18 Oppo广东移动通信有限公司 图像处理方法、装置、移动终端及计算机可读存储介质
CN108022274B (zh) * 2017-11-29 2021-10-01 Oppo广东移动通信有限公司 图像处理方法、装置、计算机设备和计算机可读存储介质
CN107992770A (zh) * 2017-12-20 2018-05-04 维沃移动通信有限公司 一种相册处理方法及移动终端
CN108875522B (zh) * 2017-12-21 2022-06-10 北京旷视科技有限公司 人脸聚类方法、装置和系统及存储介质
CN108228852A (zh) * 2018-01-10 2018-06-29 上海展扬通信技术有限公司 电子相册封面生成的方法、装置及计算机可读存储介质
CN108763254B (zh) * 2018-04-02 2020-09-29 维沃移动通信有限公司 一种获取信息的方法及终端
WO2019206251A1 (en) * 2018-04-27 2019-10-31 Shanghai Truthvision Information Technology Co., Ltd. Systems and methods for image archiving
US20190370282A1 (en) * 2018-06-03 2019-12-05 Apple Inc. Digital asset management techniques
KR102172079B1 (ko) * 2018-08-10 2020-10-30 정기홍 어린이 통학 안심 서비스 시스템
CN109145131A (zh) * 2018-08-23 2019-01-04 北京小米移动软件有限公司 相册创建方法及装置
US20200151453A1 (en) * 2018-11-08 2020-05-14 International Business Machines Corporation Reducing overlap among a collection of photographs
CN109934978B (zh) * 2019-03-15 2020-12-11 上海华铭智能终端设备股份有限公司 闸机设备的控制方法、终端、闸机设备及系统
CN110147461A (zh) * 2019-04-30 2019-08-20 维沃移动通信有限公司 图像显示方法、装置、终端设备及计算机可读存储介质
CN110147458A (zh) * 2019-05-24 2019-08-20 涂哲 一种照片筛选方法、系统及电子终端
CN117032527A (zh) * 2019-11-04 2023-11-10 华为终端有限公司 一种选择图片的方法和电子设备
US20220398298A1 (en) * 2019-11-15 2022-12-15 Raghav Arvindkumar AGGARWAL Systems and methods for selective access of a digital content
CN112953989A (zh) * 2019-12-10 2021-06-11 中移雄安信息通信科技有限公司 一种图像共享方法、通信设备及介质
KR102242621B1 (ko) * 2020-06-17 2021-04-20 정기홍 어린이 통학 안심 서비스 방법
CN112462990A (zh) * 2020-11-27 2021-03-09 维沃移动通信有限公司 图像发送方法、装置及电子设备
CN114489427A (zh) * 2021-05-21 2022-05-13 荣耀终端有限公司 图片分享或分类方法、电子设备及存储介质

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102682111A (zh) * 2012-05-11 2012-09-19 广东欧珀移动通信有限公司 一种图片检索方法
CN103369031A (zh) * 2013-05-20 2013-10-23 华为技术有限公司 终端设备、电子相册服务器、照片分享系统及方法
CN104168378A (zh) * 2014-08-19 2014-11-26 上海天奕达电子科技有限公司 一种基于人脸识别的图片分组方法及装置
CN104284252A (zh) * 2014-09-10 2015-01-14 康佳集团股份有限公司 一种自动生成电子相册的方法
US20150026209A1 (en) * 2012-06-29 2015-01-22 Huawei Device Co., Ltd. Method And Terminal For Associating Information
CN104820675A (zh) * 2015-04-08 2015-08-05 小米科技有限责任公司 相册显示方法及装置

Family Cites Families (17)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7035467B2 (en) * 2002-01-09 2006-04-25 Eastman Kodak Company Method and system for processing images for themed imaging services
KR100601997B1 (ko) 2004-10-12 2006-07-18 삼성전자주식회사 인물기반 디지털 사진 클러스터링 방법 및 장치와 이를이용한 인물기반 디지털 사진 앨버밍 방법 및 장치
JP4842572B2 (ja) * 2005-06-30 2011-12-21 マイクロソフト コーポレーション 連絡先情報管理装置、連絡先情報提供方法、コンピュータプログラムおよびコンピュータ読み取り可能な記憶媒体
US8600174B2 (en) * 2005-09-28 2013-12-03 Facedouble, Inc. Method and system for attaching a metatag to a digital image
US7796779B1 (en) * 2006-08-24 2010-09-14 SugarSync, Inc. Efficient synchronization of changes to images
US8189880B2 (en) * 2007-05-29 2012-05-29 Microsoft Corporation Interactive photo annotation based on face clustering
RU2345414C1 (ru) * 2007-08-10 2009-01-27 Общество с ограниченной ответственностью "Рекогмишн" Способ построения системы индексирования для поиска объектов на цифровых изображениях
GB2467578A (en) * 2009-02-06 2010-08-11 Sony Corp Determining, based on the status of a handheld device, users of other network devices who the user of the handheld device may be interested in contacting.
JP5503921B2 (ja) * 2009-08-21 2014-05-28 ソニーモバイルコミュニケーションズ, エービー 情報端末、情報端末の情報制御方法及び情報制御プログラム
JP2013140475A (ja) * 2012-01-04 2013-07-18 Mitsubishi Electric Corp 映像検索装置
JP5924114B2 (ja) 2012-05-15 2016-05-25 ソニー株式会社 情報処理装置、情報処理方法、コンピュータプログラムおよび画像表示装置
JP2014139733A (ja) 2013-01-21 2014-07-31 Sony Corp 情報処理装置および方法、並びにプログラム
JP2014229178A (ja) 2013-05-24 2014-12-08 株式会社東芝 電子機器および表示制御方法、プログラム
JP2015041234A (ja) * 2013-08-21 2015-03-02 キヤノン株式会社 画像分類装置、撮影装置、画像分類方法、及びプログラム
KR101479260B1 (ko) * 2013-09-10 2015-01-09 부산대학교 산학협력단 사진 기반 인물 친밀도 검색 방법
US20150085146A1 (en) * 2013-09-23 2015-03-26 Nvidia Corporation Method and system for storing contact information in an image using a mobile device
JPWO2016006090A1 (ja) * 2014-07-10 2017-05-25 株式会社東芝 電子機器、方法及びプログラム

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102682111A (zh) * 2012-05-11 2012-09-19 广东欧珀移动通信有限公司 一种图片检索方法
US20150026209A1 (en) * 2012-06-29 2015-01-22 Huawei Device Co., Ltd. Method And Terminal For Associating Information
CN103369031A (zh) * 2013-05-20 2013-10-23 华为技术有限公司 终端设备、电子相册服务器、照片分享系统及方法
CN104168378A (zh) * 2014-08-19 2014-11-26 上海天奕达电子科技有限公司 一种基于人脸识别的图片分组方法及装置
CN104284252A (zh) * 2014-09-10 2015-01-14 康佳集团股份有限公司 一种自动生成电子相册的方法
CN104820675A (zh) * 2015-04-08 2015-08-05 小米科技有限责任公司 相册显示方法及装置

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US11167129B2 (en) 2014-07-25 2021-11-09 Saluda Medical Pty Ltd Neural stimulation dosing

Also Published As

Publication number Publication date
MX2016004111A (es) 2017-04-11
EP3079082B1 (en) 2021-07-28
MX359407B (es) 2018-09-27
US20160300101A1 (en) 2016-10-13
EP3079082A1 (en) 2016-10-12
KR101820781B1 (ko) 2018-01-23
JP2017520809A (ja) 2017-07-27
CN104820675A (zh) 2015-08-05
RU2647681C2 (ru) 2018-03-16
US9953212B2 (en) 2018-04-24
CN104820675B (zh) 2018-11-06
KR20160132810A (ko) 2016-11-21

Similar Documents

Publication Publication Date Title
WO2016161807A1 (zh) 相册显示方法及装置
EP3179408B1 (en) Picture processing method and apparatus, computer program and recording medium
WO2017031875A1 (zh) 在聊天界面更改表情符号的方法、装置及终端设备
WO2018000585A1 (zh) 界面主题的推荐方法、装置、终端及服务器
WO2018032271A1 (zh) 信息搜索方法、装置、电子设备及服务器
US20170154206A1 (en) Image processing method and apparatus
WO2016095448A1 (zh) 设备联网方法及装置
WO2017016148A1 (zh) 基于图像的通信方法及装置
WO2021036382A1 (zh) 图像处理方法及装置、电子设备和存储介质
WO2017016149A1 (zh) 联系人信息推荐方法及装置
JP2017531975A (ja) 写真共有方法、装置、プログラム及び記録媒体
JP2017531330A (ja) ピクチャ処理方法および装置
US11281363B2 (en) Method and device for setting identity image
WO2016011717A1 (zh) 用于轻应用的消息推送方法、装置、终端及服务器
WO2017088247A1 (zh) 输入处理方法、装置及设备
CN107423386B (zh) 生成电子卡片的方法及装置
WO2017020476A1 (zh) 关联用户的确定方法及装置
WO2017080084A1 (zh) 字体添加方法及装置
WO2016173246A1 (zh) 基于云名片的电话呼叫方法及装置
WO2015176483A1 (zh) 标签创建方法、装置及终端
WO2016082461A1 (zh) 推荐信息获取方法、终端及服务器
WO2015180382A1 (zh) 管理即时消息的方法和装置
CN104268151A (zh) 联系人分组方法及装置
WO2016197549A1 (zh) 一种进行搜索的方法和装置
CN105260088B (zh) 信息分类展示处理的方法及装置

Legal Events

Date Code Title Description
ENP Entry into the national phase

Ref document number: 20167007569

Country of ref document: KR

Kind code of ref document: A

Ref document number: 2016515944

Country of ref document: JP

Kind code of ref document: A

WWE Wipo information: entry into national phase

Ref document number: MX/A/2016/004111

Country of ref document: MX

ENP Entry into the national phase

Ref document number: 2016126469

Country of ref document: RU

Kind code of ref document: A

REG Reference to national code

Ref country code: BR

Ref legal event code: B01A

Ref document number: 112016011338

Country of ref document: BR

121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 15888356

Country of ref document: EP

Kind code of ref document: A1

ENP Entry into the national phase

Ref document number: 112016011338

Country of ref document: BR

Kind code of ref document: A2

Effective date: 20160519

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 15888356

Country of ref document: EP

Kind code of ref document: A1