WO2019109245A1 - 一种故事相册的显示方法及装置 - Google Patents

一种故事相册的显示方法及装置 Download PDF

Info

Publication number
WO2019109245A1
WO2019109245A1 PCT/CN2017/114607 CN2017114607W WO2019109245A1 WO 2019109245 A1 WO2019109245 A1 WO 2019109245A1 CN 2017114607 W CN2017114607 W CN 2017114607W WO 2019109245 A1 WO2019109245 A1 WO 2019109245A1
Authority
WO
WIPO (PCT)
Prior art keywords
image
terminal
images
album
story album
Prior art date
Application number
PCT/CN2017/114607
Other languages
English (en)
French (fr)
Inventor
唐忠樑
蒋华
李汤锁
陈绍君
杜明亮
Original Assignee
华为技术有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 华为技术有限公司 filed Critical 华为技术有限公司
Priority to PCT/CN2017/114607 priority Critical patent/WO2019109245A1/zh
Priority to US16/769,849 priority patent/US11386140B2/en
Priority to CN201780003499.3A priority patent/CN108235765B/zh
Priority to EP17933949.4A priority patent/EP3706015A4/en
Publication of WO2019109245A1 publication Critical patent/WO2019109245A1/zh

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/40—Information retrieval; Database structures therefor; File system structures therefor of multimedia data, e.g. slideshows comprising image and additional audio data
    • G06F16/43—Querying
    • G06F16/438—Presentation of query results
    • G06F16/4387—Presentation of query results by the use of playlists
    • G06F16/4393—Multimedia presentations, e.g. slide shows, multimedia albums
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/50—Information retrieval; Database structures therefor; File system structures therefor of still image data
    • G06F16/51—Indexing; Data structures therefor; Storage structures
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/50—Information retrieval; Database structures therefor; File system structures therefor of still image data
    • G06F16/53—Querying
    • G06F16/535—Filtering based on additional data, e.g. user or group profiles
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/50—Information retrieval; Database structures therefor; File system structures therefor of still image data
    • G06F16/54—Browsing; Visualisation therefor
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/50—Information retrieval; Database structures therefor; File system structures therefor of still image data
    • G06F16/55—Clustering; Classification
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/50—Information retrieval; Database structures therefor; File system structures therefor of still image data
    • G06F16/58—Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/50—Information retrieval; Database structures therefor; File system structures therefor of still image data
    • G06F16/58—Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually
    • G06F16/583—Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually using metadata automatically derived from the content
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/50—Information retrieval; Database structures therefor; File system structures therefor of still image data
    • G06F16/58—Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually
    • G06F16/587—Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually using geographical or spatial information, e.g. location

Definitions

  • the embodiments of the present invention relate to the field of communications technologies, and in particular, to a method and an apparatus for displaying a story album.
  • the story album function is an automatic aggregation of images in the terminal gallery to create one or more story albums, allowing users to quickly and easily view photos of past important events.
  • the terminal can aggregate photos taken at a certain time period or a certain location according to the shooting position or shooting time of each image in the gallery, and create a story album in the form of a short video.
  • a photo collection taken in Yanqing District from 2017-11-4 to 2017-11-5 is made into a story album A, as shown in FIG. 1, a photo can be selected in the story album A as the story album A.
  • the album cover 11 on which the description information 12 for reflecting the characteristics of each photo in the story album A can be displayed.
  • the above description information 12 is generally used to reflect the specific shooting position or shooting time information.
  • the number of images in the gallery grows, it will become increasingly difficult to find images that are valuable and interesting to the user in the gallery by simply taking the location or shooting time. If the user forgets the exact time or location, it becomes difficult and time consuming to search for a large number of images in the gallery, which makes the image management efficiency of the terminal to the gallery lower.
  • the embodiment of the present application provides a method and a device for displaying a story album, which can generate a story album with a theme to improve the image management efficiency of the terminal to the gallery.
  • an embodiment of the present application provides a method for displaying a story album, including: the terminal aggregates N (N>1) in the library according to the first dimension (the first dimension includes a shooting time and/or a shooting location). An image; the terminal displays an album cover of the story album, the story album including M (M ⁇ N) images among the N images, the M images being associated with the theme of the story album.
  • the M images having the subjectivity can be selected in the N images, thereby creating the M images as the story album. Displayed to the user.
  • the story album generated in this way has a distinct theme, and the user can select a desired image from the corresponding story album according to the theme, thereby improving the efficiency of the subsequent terminal to manage the image in the gallery.
  • the theme of the above story album may specifically include at least one of a birthday, a party, a wedding, a sports, a graduation, a holiday, a night scene, a local tour, and a foreign tour.
  • the album cover includes a title of the story album, and the title is associated with at least one of the determined theme, the shooting time of the N images, and the shooting location of the N images. In this way, the user can know the basic information of the image in the story album in time through the title displayed on the cover of the album.
  • the method further includes: removing, by the terminal, the invalid image in the N images, and obtaining the story album composed of the M images, the invalid
  • the image includes an image with an invalid tag or one or more images with an image similarity greater than a threshold. That is, The terminal may remove the invalid image in the initial story album that does not match the theme, so that the association between the images in the created story album is strong.
  • the method further includes: determining, by the terminal, the theme associated with the M images according to the second dimension. Obtaining a theme of the story album, the second dimension including image features of at least one of the M images.
  • the terminal may further identify the theme scene of the N images according to the specific image features of each image, that is, in the dimension of the image feature (implemented in the present application) In the example, it is referred to as the second dimension to identify the image content, thereby determining the theme scene of the story album, so that the terminal realizes multi-dimensional understanding of the image when creating the story album, so that the theme scene that the terminal can recognize is centered. Aggregate to generate a thematic story album to improve the efficiency of the terminal management of images in the gallery.
  • the method further includes: modifying, by the terminal, the theme of the story album according to the third dimension, the The three dimensions include associated information in the target application that is associated with the topic of the story album.
  • the terminal can process the image in the gallery to identify the image in the gallery in the three dimensions of the attribute information of the image, the image feature of the image, and the target application associated with the image.
  • Theme scenes which aggregate the thematic images into story albums, creating theme story albums that are more interesting or of higher value to users.
  • the first dimension includes a shooting time, wherein the terminal aggregates the N images in the library according to the first dimension, including: the image generated by the terminal in each time period of the Z time segments Aggregating into a set of images, obtaining Z image sets, the Z image sets are in one-to-one correspondence with the Z time periods, Z ⁇ 2; when the time interval between adjacent image sets is less than the interval threshold, the terminal uses the phase The neighboring image collection is aggregated.
  • the first dimension further includes a shooting location, wherein when the shooting locations of the adjacent image collections are not preset locations, it indicates that the user is likely to travel long distances in a very resident place.
  • Setting the interval threshold to be a larger first preset value; and when the shooting locations of the adjacent image sets are all preset locations, the second preset value may be set to be smaller, thereby continuously shooting The images are aggregated together to create a story album.
  • the terminal determines the theme associated with the M images according to the second dimension, and obtains the theme of the story album, including: comparing, by the terminal, the label distribution of the M images with each preset The label distribution of the candidate topic; when the label distribution of the M images conforms to the label distribution of the first candidate topic, the terminal determines the first candidate topic as the subject of the story album.
  • the terminal removes the invalid image in the N images, including: the terminal displays X images whose similarities are greater than the threshold value identified from the N images, X ⁇ 2; The target image selected in the X images, the terminal retains the target image in the story album, and removes the remaining images of the X images except the target image.
  • the terminal removes the invalid image in the story album, including: the terminal displays the Y tags identified from the N images, and the label of each image is used to reflect the image feature of the image. Y ⁇ 2; in response to the user selecting a target tag from the Y tags, the terminal retains an image having the target tag in the story album, and removes an image that does not have the target tag.
  • the method further includes: the terminal playing the story album, wherein, when playing the first image in the story album, the terminal displays the shooting of the first image Time and / or location. This can help the user to quickly recall the information related to the current playback image during the process of playing the story album, thereby improving the user experience when using the story album.
  • the first dimension further includes at least one of a character appearing in the story album, a playing duration of the story album, a number of images in the story album, and a theme of the story album;
  • the method further includes: the terminal receiving the target time period input by the user to create the story album, the target shooting location, the target person, the target playing duration, the target image number, and the target theme. At least one of them.
  • the terminal may prompt the user to select one or more conditions of the album theme of the story album, the included characters, the shooting time, the shooting location, the playing duration, the number of images, and the related images according to the conditions selected by the user, thereby Create a story album that matches your expectations.
  • an embodiment of the present application provides a method for displaying a story album, including: receiving, by the terminal, schedule information input by a user in a target application; the terminal creates N (N>1) images in the gallery as a story album; The terminal displays the album cover of the story album, and the title on the cover of the album is associated with the schedule information described above, so that a theme story album with more interest or higher value of the user can be created.
  • the target application includes at least one of a memo, a calendar, a mail, a notepad, a phone, a text message, and a contact.
  • an embodiment of the present application provides a terminal, including: an aggregation unit, configured to aggregate N images in a library according to a first dimension, where the first dimension includes a shooting time and/or a shooting location, where N>1; a display unit, configured to display an album cover of the story album, the story album including M images of the N images, the M images being associated with the theme of the story album, M ⁇ N.
  • the method further includes: a removing unit, configured to remove the invalid image in the N images, and obtain the story album composed of M images, the invalid image including an image with an invalid label or image similarity One or more images that are larger than the threshold.
  • a removing unit configured to remove the invalid image in the N images, and obtain the story album composed of M images, the invalid image including an image with an invalid label or image similarity One or more images that are larger than the threshold.
  • the method further includes: a determining unit, configured to determine, according to the second dimension, a theme associated with the M images to obtain a theme of the story album, where the second dimension includes at least the M images An image feature of an image.
  • the method further includes: a correction unit, configured to modify the theme of the story album according to a third dimension, where the third dimension includes association information associated with the theme of the story album in the target application.
  • the first dimension includes a shooting time
  • the aggregation unit is specifically configured to: aggregate images generated in each of the Z time segments into one image set, and obtain Z images.
  • the set, the Z image sets are in one-to-one correspondence with the Z time periods, Z ⁇ 2; when the time interval between adjacent image sets is less than the interval threshold, the adjacent image sets are aggregated.
  • the first dimension further includes a shooting location, wherein when the shooting locations of the adjacent image collections are not preset locations, the interval threshold is a first preset value; when adjacent When the shooting locations of the image collection are all preset locations, the interval threshold is a second preset value, and the second preset value is smaller than the first preset value.
  • the determining unit is specifically configured to: compare label distribution of the M images The case is different from the preset label distribution of each candidate topic; when the label distribution of the M images conforms to the label distribution of the first candidate topic, the first candidate topic is determined as the subject of the story album.
  • the display unit is further configured to display X images whose similarities are greater than a threshold value, which are identified by the N images, X ⁇ 2; the removing unit is specifically configured to: respond to the user The target image selected from the X images is retained in the story album, and the remaining images other than the target image among the X images are removed.
  • the display unit is further configured to display Y tags identified from the N images, and the labels of each image are used to reflect image features of the image, Y ⁇ 2;
  • the unit is specifically configured to: in response to the target label selected by the user from the Y labels, retain an image having the target label in the story album, and remove an image that does not have the target label.
  • the display unit is further configured to play the story album, wherein when playing the first image in the story album, the terminal displays the shooting time and/or the shooting location of the first image.
  • the first dimension further includes at least one of a character appearing in the story album, a playing duration of the story album, a number of images in the story album, and a theme of the story album;
  • the terminal further The method includes: an obtaining unit, configured to receive at least one of a target time period, a target shooting location, a target person, a target playing duration, a target image number, and a target theme input by the user to create a story album.
  • an embodiment of the present application provides a terminal, including: an acquiring unit, configured to receive schedule information input by a user in a target application, and a creating unit, configured to create N images in the gallery as a story album, where , N>1; a display unit for displaying an album cover of the story album, the album cover including a title of the story album, the title being associated with the schedule information.
  • an embodiment of the present application provides a terminal, including: a processor, a memory, a bus, and a communication interface; the memory is configured to store a computer execution instruction, and the processor is connected to the memory through the bus, when the terminal is running The processor executes the computer-executed instructions stored in the memory to cause the terminal to execute the display method of any one of the above-mentioned story albums.
  • an embodiment of the present application provides a computer readable storage medium, where the computer readable storage medium stores an instruction, when the instruction is run on any of the foregoing terminals, causing the terminal to execute any one of the above story albums. Display method.
  • the embodiment of the present application provides a computer program product including instructions, when the terminal runs on any of the above terminals, causing the terminal to execute the display method of any one of the above-mentioned story albums.
  • the names of the foregoing terminals are not limited to the devices themselves, and in actual implementation, the devices may appear under other names. As long as the functions of the respective devices are similar to the embodiments of the present application, they are within the scope of the claims and their equivalents.
  • FIG. 1 is an application scenario of displaying a story album in the prior art
  • FIG. 2 is a schematic structural diagram 1 of a terminal according to an embodiment of the present application.
  • FIG. 3 is a schematic diagram of a photographing principle of a camera according to an embodiment of the present application.
  • FIG. 4 is a schematic structural diagram of an EXIF format image according to an embodiment of the present application.
  • FIG. 5 is a schematic flowchart of a method for displaying a story album according to an embodiment of the present application
  • FIG. 6 is a schematic diagram 1 of a scenario for creating a story album according to an embodiment of the present application.
  • FIG. 7 is a second schematic diagram of a scenario for creating a story album according to an embodiment of the present application.
  • FIG. 8 is a schematic diagram 3 of a scenario for creating a story album according to an embodiment of the present application.
  • FIG. 9 is a schematic diagram 4 of a scenario for creating a story album according to an embodiment of the present application.
  • FIG. 10 is a schematic diagram 5 of a scenario for creating a story album according to an embodiment of the present application.
  • FIG. 11 is a schematic diagram 6 of a scenario for creating a story album according to an embodiment of the present application.
  • FIG. 12 is a schematic diagram 7 of a scenario for creating a story album according to an embodiment of the present application.
  • FIG. 13 is a schematic diagram 8 of a scenario for creating a story album according to an embodiment of the present application.
  • FIG. 14 is a schematic diagram 9 of a scenario for creating a story album according to an embodiment of the present application.
  • 15 is a schematic diagram 10 of a scenario for creating a story album according to an embodiment of the present application.
  • 16 is a schematic diagram 11 of a scenario for creating a story album according to an embodiment of the present application.
  • FIG. 17 is a schematic diagram 12 of a scenario for creating a story album according to an embodiment of the present application.
  • FIG. 18 is a schematic diagram of a scene for creating a story album according to an embodiment of the present application.
  • FIG. 19 is a schematic diagram of a scene for creating a story album according to an embodiment of the present application.
  • FIG. 20 is a schematic diagram of a scene for creating a story album according to an embodiment of the present application.
  • FIG. 21 is a schematic diagram 16 of a scenario for creating a story album according to an embodiment of the present application.
  • FIG. 22 is a schematic diagram of a scenario for creating a story album according to an embodiment of the present application.
  • FIG. 23 is a schematic structural diagram 2 of a terminal according to an embodiment of the present disclosure.
  • FIG. 24 is a schematic structural diagram 3 of a terminal according to an embodiment of the present disclosure.
  • FIG. 25 is a schematic structural diagram 4 of a terminal according to an embodiment of the present disclosure.
  • first and second are used for descriptive purposes only, and are not to be construed as indicating or implying a relative importance or implicitly indicating the number of technical features indicated. Thus, features defining “first” and “second” may include one or more of the features either explicitly or implicitly. In the description of the embodiments of the present application, “multiple” means two or more unless otherwise stated.
  • a method for displaying a story album provided by an embodiment of the present application can be applied to a mobile phone, a tablet computer, a wearable device, an augmented reality (AR), a virtual reality (VR) device, a notebook computer, a super mobile personal.
  • Any terminal having a display function such as an ultra-mobile personal computer (UMPC), a netbook, a personal digital assistant (PDA), an in-vehicle device, and the like, is not limited in this embodiment.
  • the terminal in the embodiment of the present application may be the mobile phone 100.
  • the embodiment will be specifically described below by taking the mobile phone 100 as an example. It should be understood that the illustrated mobile phone 100 is only one example of the above terminal, and the mobile phone 100 may have more or fewer components than those shown in the figure, two or more components may be combined, or Has a different component configuration.
  • the mobile phone 110 may specifically include: a processor 101, a radio frequency (RF) circuit 102, a memory 103, a touch screen 104, a Bluetooth device 105, one or more sensors 106, and wireless-fidelity. , Wi-Fi device 107, positioning device 108, audio circuit 109, peripheral interface 110 And components such as the power supply system 111. These components can communicate over one or more communication buses or signal lines (not shown in Figure 2). It will be understood by those skilled in the art that the hardware structure shown in FIG. 2 does not constitute a limitation to a mobile phone, and the mobile phone 110 may include more or less components than those illustrated, or may combine certain components, or different component arrangements.
  • RF radio frequency
  • the processor 101 is a control center of the mobile phone 110, and connects various parts of the mobile phone 110 using various interfaces and lines, and executes the mobile phone 110 by running or executing an application stored in the memory 103 and calling data stored in the memory 103.
  • the processor 101 may include one or more processing units; for example, the processor 101 may be a Kirin 960 chip manufactured by Huawei Technologies Co., Ltd., or may be a Qualcomm Snapdragon 820 chip.
  • the processor 101 may further include a fingerprint verification chip for verifying the collected fingerprint.
  • the radio frequency circuit 102 can be used to receive and transmit wireless signals during transmission or reception of information or calls.
  • the radio frequency circuit 102 can process the downlink data of the base station and then process it to the processor 101; in addition, transmit the data related to the uplink to the base station.
  • radio frequency circuits include, but are not limited to, an antenna, at least one amplifier, a transceiver, a coupler, a low noise amplifier, a duplexer, and the like.
  • the radio frequency circuit 102 can also communicate with other devices through wireless communication.
  • the wireless communication can use any communication standard or protocol, including but not limited to global mobile communication systems, general packet radio services, code division multiple access, wideband code division multiple access, long term evolution, email, short message service, and the like.
  • the memory 103 is used to store applications and data, and the processor 101 executes various functions of the mobile phone 110 and data processing by running applications and data stored in the memory 103.
  • the memory 103 mainly includes a storage program area and a storage data area, wherein the storage program area can store an operating system, an application required for at least one function (such as a sound playing function, an image playing function, etc.); the storage data area can be stored according to the use of the mobile phone. Data created at 110 o'clock (such as audio data, phone book, etc.).
  • the memory 103 may include a high speed random access memory (RAM), and may also include a nonvolatile memory such as a magnetic disk storage device, a flash memory device, or other volatile solid state storage device.
  • the memory 103 can store various operating systems, for example, iOS developed by Apple Inc. Operating system, Android developed by Google Inc. Operating system, etc.
  • the above memory 103 may be independent and connected to the processor 101 via the above communication bus; the memory 103 may also be integrated with the processor 101.
  • the touch screen 104 may specifically include a touch panel 104-1 and a display 104-2.
  • the touch panel 104-1 can collect touch events on or near the user of the mobile phone 110 (such as the user using a finger, a stylus, or the like on the touch panel 104-1 or on the touchpad 104.
  • the operation near -1), and the collected touch information is sent to other devices (for example, processor 101).
  • the touch event of the user in the vicinity of the touch panel 104-1 may be referred to as a hovering touch; the hovering touch may mean that the user does not need to directly touch the touchpad in order to select, move or drag a target (eg, an icon, etc.) And only the user is located near the terminal in order to perform the desired function.
  • the touch panel 104-1 can be implemented in various types such as resistive, capacitive, infrared, and surface acoustic waves.
  • a display (also referred to as display) 104-2 can be used to display information entered by the user or information provided to the user as well as various menus of the handset 110.
  • the display 104-2 can be configured in the form of a liquid crystal display, an organic light emitting diode, or the like.
  • the touchpad 104-1 can be overlaid on the display 104-2 when the touchpad 104-1 detects it Upon or near a touch event, the processor 101 is transmitted to determine the type of touch event, and the processor 101 can then provide a corresponding visual output on the display 104-2 depending on the type of touch event.
  • touchpad 104-1 and display 104-2 are implemented as two separate components to implement the input and output functions of handset 110, in some embodiments, touchpad 104- 1 is integrated with the display 104-2 to implement the input and output functions of the handset 110.
  • the touch screen 104 is formed by stacking a plurality of layers of materials. In the embodiment of the present application, only the touch panel (layer) and the display screen (layer) are shown, and other layers are not described in the embodiment of the present application. .
  • the touch panel 104-1 may be disposed on the front surface of the mobile phone 110 in the form of a full-board
  • the display screen 104-2 may also be disposed on the front surface of the mobile phone 110 in the form of a full-board, so that the front side of the mobile phone can be borderless. Structure.
  • the mobile phone 110 may also include a Bluetooth device 105 for enabling data exchange between the handset 110 and other short-range terminals (eg, mobile phones, smart watches, etc.).
  • the Bluetooth device in the embodiment of the present application may be an integrated circuit or a Bluetooth chip or the like.
  • the handset 110 may also include at least one sensor 106, such as a fingerprint acquisition device, a light sensor, a motion sensor, and other sensors.
  • the fingerprint collection device can be configured on the back of the handset 110 (eg, below the rear camera) or on the front side of the handset 110 (eg, below the touch screen 104).
  • the fingerprint collection device may be configured in the touch screen 104 to implement the fingerprint recognition function, that is, the fingerprint collection device may be integrated with the touch screen 104 to implement the fingerprint recognition function of the mobile phone 110;
  • the light sensor may include an ambient light sensor and a proximity sensor, wherein The ambient light sensor can adjust the brightness of the display of the touch screen 104 according to the brightness of the ambient light, and the proximity sensor can turn off the power of the display when the mobile phone 110 moves to the ear.
  • the accelerometer sensor can detect the magnitude of acceleration in all directions (usually three axes). When it is stationary, it can detect the magnitude and direction of gravity.
  • the mobile phone 110 can be used to identify the gesture of the mobile phone (such as horizontal and vertical screen switching, related Game, magnetometer attitude calibration), vibration recognition related functions (such as pedometer, tapping), etc.
  • the mobile phone 110 can also be configured with gyroscopes, barometers, hygrometers, thermometers, infrared sensors and other sensors, here Let me repeat.
  • the Wi-Fi device 107 is configured to provide the mobile phone 110 with network access complying with the Wi-Fi related standard protocol, and the mobile phone 110 can access the Wi-Fi access point through the Wi-Fi device 107, thereby helping the user to send and receive emails. Browsing web pages and accessing streaming media, etc., it provides users with wireless broadband Internet access.
  • the Wi-Fi device 107 can also function as a Wi-Fi wireless access point, and can provide Wi-Fi network access to other terminals.
  • the positioning device 108 is configured to provide a geographic location for the mobile phone 110. It can be understood that the positioning device 108 can be specifically a receiver of a positioning system such as a global positioning system (GPS) or a Beidou satellite navigation system, and a Russian GLONASS. After receiving the geographical location transmitted by the positioning system, the positioning device 108 sends the information to the processor 101 for processing, or sends it to the memory 103 for storage. In still other embodiments, the positioning device 108 may also be an assisted global positioning system (AGPS) receiver, and the AGPS system assists the positioning device 108 in performing ranging and positioning services by acting as an auxiliary server.
  • AGPS assisted global positioning system
  • the secondary location server provides location assistance over a wireless communication network in communication with a location device 108 (i.e., a GPS receiver) of the terminal, such as handset 110.
  • a location device 108 i.e., a GPS receiver
  • the positioning device 108 can also be a Wi-Fi access point based positioning technology.
  • each Wi-Fi access point has a globally unique media access control (MAC) location Address
  • the terminal can scan and collect the broadcast signal of the surrounding Wi-Fi access point when Wi-Fi is turned on, so the MAC address broadcasted by the Wi-Fi access point can be obtained; the terminal can mark these Wi -
  • the data of the Fi access point (for example, the MAC address) is sent to the location server through the wireless communication network, and the location server retrieves the geographic location of each Wi-Fi access point and combines the strength of the Wi-Fi broadcast signal.
  • the geographic location of the terminal is calculated and sent to the location device 108 of the terminal.
  • the audio circuit 109, the speaker 113, and the microphone 114 can provide an audio interface between the user and the handset 110.
  • the audio circuit 109 can transmit the converted electrical data of the received audio data to the speaker 113 for conversion to the sound signal output by the speaker 113; on the other hand, the microphone 114 converts the collected sound signal into an electrical signal by the audio circuit 109. After receiving, it is converted into audio data, and then the audio data is output to the RF circuit 102 for transmission to, for example, another mobile phone, or the audio data is output to the memory 103 for further processing.
  • the peripheral interface 110 is used to provide various interfaces for external input/output devices (such as a keyboard, a mouse, an external display, an external memory, a subscriber identity module card, etc.). For example, it is connected to the mouse through a universal serial bus (USB) interface, and is connected with a subscriber identification module (SIM) card provided by the telecommunication operator through a metal contact on the card slot of the subscriber identification module. . Peripheral interface 110 can be used to couple the external input/output peripherals described above to processor 101 and memory 103.
  • USB universal serial bus
  • SIM subscriber identification module
  • the mobile phone 110 may further include a power supply device 111 (such as a battery and a power management chip) that supplies power to the various components.
  • the battery may be logically connected to the processor 101 through the power management chip to manage charging, discharging, and power management through the power supply device 111. And other functions.
  • the mobile phone 110 may further include a camera 112.
  • the camera 112 may be a front camera or a rear camera.
  • the camera 112 generally includes a lens and an image sensor, and the image sensor may be a CCD (Charge-coupled Device) or a CMOS (Complementary Metal Oxide Semiconductor). Any photosensitive device such as an oxide semiconductor.
  • CCD Charge-coupled Device
  • CMOS Complementary Metal Oxide Semiconductor
  • the (Digital Signal Processing) module performs digital signal processing to obtain a digital digital image.
  • the digital image can be output on the handset 100 via the display 104-2, or the digital image can be stored in the memory 103.
  • the above-mentioned DSP module may be integrated in the processor 101 in the form of a function module, or may be independently disposed in the mobile phone 100 in the form of a chip.
  • the digital image generated by the DSP module can be stored in the memory 103 in an exchangeable image file (EXIF) format.
  • EXIF exchangeable image file
  • the target image in the EXIF format may be composed of image information and EXIF information.
  • the image information includes information of each pixel in the target image, such as a grayscale value of the pixel.
  • the head of the image information adds some attribute information about the target image, for example, time, location, shutter, aperture, white balance, sensitivity, focal length, camera and/or lens brand, model, etc. when the target image is captured. It can be referred to as EXIF information in the application embodiment.
  • the processor 101 instructs the camera 112 to capture a target image
  • the system time of the terminal at this time is made.
  • the sensor such as the positioning device 108 is triggered to acquire the EXIF information such as the shooting location of the terminal at this time, and the EXIF information is added to the head of the image information of the target image, and finally the EXIF information and the image information of the target image are saved to In the memory 103.
  • the processor 101 can acquire attribute information such as the shooting time of the target image and the shooting location. Then, when creating a story album for the user, the processor 101 can read the EXIF information of each image in the gallery, aggregate the images generated at a certain time period and/or a certain location, and then make the aggregated image into a story.
  • the album is shown to the user.
  • the shooting time and/or shooting location of the image in the story album can be superimposed on the cover of the album, so that the user can select a valuable or interesting story album to watch.
  • a method for displaying a story album provided by an embodiment of the present application is as shown in FIG. 5, and the method includes:
  • the terminal reads attribute information of each image in the gallery.
  • the terminal can read the EXIF information of each of the plurality of images stored in the gallery, thereby obtaining the shooting time of the image from the EXIF information of each image. Attribute information such as shooting location.
  • the creation of a story album may be automatically triggered by the terminal without the user's perception.
  • the terminal may automatically create a story album for the user periodically, or when the number of images in the gallery is greater than the preset period.
  • the terminal can also be triggered to automatically create a story album.
  • the creation of a story album can also be manually triggered by the user.
  • the user can select a certain number of images after entering the library of the terminal, and then trigger the terminal to create a story album according to the images.
  • the terminal may display the thumbnail of the image in the gallery from the time dimension to the user, as shown in FIG. 6, when the thumbnail of the image generated during the time period of Saturday-Sunday is displayed, the terminal may also be set to create A shortcut key 601 corresponding to the story album of this time period of Saturday-Sunday. Then, when detecting that the user clicks the shortcut key 601, the terminal can be triggered to read the EXIF information of each image in the time period of Saturday-Sunday, and obtain attribute information such as the shooting time and the shooting location of the images.
  • the terminal aggregates the N images in the gallery into the initial story album according to the attribute information, where N>1.
  • the terminal may aggregate the N images in the gallery into the initial story album according to the time dimension according to the shooting time in the attribute information. For example, an image generated from November 4th to November 5th is aggregated into an initial story album.
  • the terminal may further aggregate the N images in the gallery into the initial story album according to the geographic location dimension according to the shooting location in the attribute information.
  • the images generated in the Chaoyang District of Beijing are aggregated into an initial story album; for example, the terminal may pre-set geographical location information of one or more locations, for example, the user's place of residence, work place, school, frequent place, etc. .
  • the terminal may be on a business trip or travel, and therefore, the terminal Images taken at locations that are not pre-set can be aggregated into an initial story album.
  • the terminal may first aggregate multiple images generated in a short time into a plurality of image sets according to the shooting time. For example, as shown in FIG. 7, the terminal may use a density-based spatial clustering of applications (DBSCAN) algorithm to take a K1 (K1 ⁇ 1) image taken on the afternoon of November 4 as an image set 1, which will be November. The K2 (K2 ⁇ 1) images taken on the morning of the 4th were used as the image collection 2, and the K3 (K3 ⁇ 1) images taken on the morning of November 3 were taken as the image collection 3. Further, the terminal may aggregate the plurality of image sets into an initial story album according to a time interval between two adjacent image sets.
  • DBSCAN density-based spatial clustering of applications
  • the terminal can aggregate the image set 1 and the image set 2 into one initial story album A. If the time interval T2 between the image collection 2 and the image collection 3 is also less than 4 hours, the terminal may continue to aggregate the image collection 1, the image collection 2, and the image collection 3 into one initial story album B. In this way, in the time dimension, the terminal can obtain the initial story album to be created according to the shooting frequency of the image in the gallery.
  • the threshold of the time interval may be adjusted according to the shooting location of the image in the image set.
  • the terminal Since the terminal is pre-set with geographical location information of the user's place of residence, work place, school, frequent place, and the like. Then, when the shooting locations of the images in the two adjacent image sets do not belong to any of the preset locations described above, indicating that the user is likely to travel long distances in a very resident place, the terminal may increase the time interval to perform aggregation of the image sets.
  • the image collection 3 is taken in Shanghai on November 3, and the image collection 2 and the image collection 1 are both taken in Shanghai on November 4, and the user's preset residence is located in Beijing. Therefore, the terminal can set the time interval threshold used in the aggregation to 2 days, and then aggregate the image set 1, the image set 2, and the image set 3 into one.
  • An initial story album to ensure that images generated by users during long-distance travel in the field can be merged into one album.
  • the terminal may adjust the threshold of the time interval according to the input operation of the user.
  • the terminal may display the distribution of the images in the gallery at each time node in the form of a progress bar, and then the user may perform a gesture operation on the progress bar ( For example, pinch or tap the selection operation) to change the number of images in the initial story album.
  • the default initial story album of the terminal includes only two images generated in the time period of 11.3-11.4, and the user can expand the image collection at different time points waiting for aggregation by the pinch operation, that is, Manually increase the time interval threshold used in the aggregation.
  • the user adjusts the time span of the image in the initial story album from 11.3-11.4 to 10.28-11.5, and the terminal can adjust The thumbnails of the four images generated within the time span of 10.28-11.5 are displayed in the current display interface, which is convenient for the user to confirm whether the adjusted time span is appropriate.
  • the terminal can also select to aggregate images of different shooting locations into an initial story album according to the user's input operation.
  • the terminal may display the four shooting locations of Beijing, Shanghai, Shenzhen, and Xi'an as candidate options in the current display interface.
  • the user can select one or more of these candidate options as a basis for aggregating the initial story album. For example, if the user selects Beijing and Shenzhen among the four shooting locations, the terminal can aggregate the images in the attribute information to Beijing or Shenzhen as the initial story album.
  • the terminal when creating a story album, the terminal may be in the gallery according to the attribute information such as the shooting time and/or the shooting location of the image in the dimension of the attribute information (referred to as the first dimension in the embodiment of the present application).
  • the images are understood and aggregated to generate an initial story album that is constrained by the time of the shoot and/or the location of the shot.
  • the manner in which the terminal aggregates the initial story album according to the shooting time of the image and/or the shooting location may be various, and a person skilled in the art may set this according to the actual application scenario or actual experience, and the embodiment of the present application does not impose any restrictions on this. .
  • the terminal can further identify whether the shooting time is a special day such as a holiday or a commemoration day. For example, when the shooting time of the image 1 is October 1st, the terminal can recognize that the shooting time of the image 1 is during the National Day, then the terminal can take N photos taken during the legal holiday from October 1st to October 7th. The image is aggregated into an initial story album. For another example, when the shooting time of the image 2 is September 12, the terminal can recognize that the shooting time of the image 2 is the user's birthday, then the terminal can take N images taken on September 12 of each year in the gallery. Aggregate as an initial story album, as a collection of user's birthday images.
  • a special day such as a holiday or a commemoration day.
  • the shooting time of the image 1 is October 1st
  • the terminal can recognize that the shooting time of the image 1 is during the National Day, then the terminal can take N photos taken during the legal holiday from October 1st to October 7th.
  • the image is aggregated into an initial story album
  • the terminal may obtain information such as the holiday, the anniversary, or the birthday of the user record from the installed calendar application, for example, the terminal reads the holiday calendar or the corresponding date in the birthday calendar, and the like, and details are not described herein.
  • the terminal may shoot at the alma mater at different times in the gallery.
  • the N images are aggregated into an initial story album, as a collection of images of the user at the alma mater.
  • the terminal after the terminal reads the attribute information such as the shooting time and/or the shooting location of the image, the terminal can further understand the attribute information of the image, for example, whether the shooting time is a special day. It is recognized whether the shooting location is a preset location or the like, so that the images in the gallery are aggregated based on the understanding result in the first dimension related to the attribute information to obtain an initial story album.
  • the terminal may further according to other image attributes in the read attribute information, such as sensitivity, The focal length and the camera brand and the like aggregate the N images in the gallery into the initial story album, which is not limited in this embodiment of the present application.
  • the terminal removes the invalid image in the initial story album, and obtains a target story album composed of M images, N ⁇ M.
  • the terminal may perform further screening on the image in the initial story album, and remove the similar image or the image that is different from other images in the initial story album (ie, the invalid image) to obtain M
  • the target story album composed of images makes the association between the images in the created story albums stronger. It should be noted that, when the terminal determines that the initial story album does not include an invalid image, the number M of images in the obtained target story album is equal to the number N of images in the initial story album.
  • the terminal can identify the content of each image in the initial story album, for example, by using pHash (Perceptual Hash Algorithm) to identify the hamming distance between any two images.
  • pHash Perceptual Hash Algorithm
  • the two images may be determined as similar images.
  • the terminal can also adjust the Hamming distance threshold according to the shooting time of the image.
  • the shooting time interval of the two images is small (for example, within 10 seconds), the probability of occurrence of similar images is high, so the appropriate The value of the clear distance threshold is set larger, and when the shooting time interval between the two images is large (for example, within 5 minutes), the probability of occurrence of similar images is low, so the value of the Hamming distance threshold can be appropriately set. of Smaller.
  • the terminal may randomly select one of the plurality of similar images, or select an image quality or a user expression from the plurality of similar images by an algorithm such as smile recognition and definition recognition. A better image and the remaining similar images are removed from the initial story album as invalid images.
  • the terminal may display the identified plurality of similar images (for example, the image 901-image 904 in FIG. 11) to the user, and the user manually selects the favorite one.
  • An image eg, image 901 in FIG. 11
  • the remaining similar images eg, image 902-image 904 in FIG. 11
  • the terminal can add a label to the image according to its image characteristics when storing each image, for example, flowers, sun, house, dog, badminton, screen shot, and the like. Then, in step S503, the terminal may further remove the outlier image with a large difference in image tags in the initial story album as the invalid image according to the label of each image in the initial story album.
  • the story album is generally used to record the daily life of the user, some labels that are not common or unnecessary in daily life, such as scissors, keyboards, screen shots, etc., may be pre-set in the terminal as an invalid tag list.
  • the terminal may determine whether the label of each image in the initial story album appears in the invalid label list, and if the label of the image appears in the invalid label list, the image is likely to be uncommon in daily life or An unwanted image, therefore, the terminal can remove the image with the invalid label as an invalid image from the initial story album.
  • the terminal may also display the label of the image in the initial story album to the user, as shown in FIG. 12, the label with higher frequency in the initial story album includes characters, badminton, lights, running. And the dog, then, the user can manually select the tag of interest (such as the character in Figure 12, the badminton to run the 3 tags), and keep the images with the 3 tags in the target story album, leaving the rest of the other The tag acts as an invalid tag and the image with the invalid tag is removed from the initial story album as an invalid image.
  • the tag of interest such as the character in Figure 12, the badminton to run the 3 tags
  • the terminal may further determine whether the tags selected by the user and the invalid tags in the invalid tag list preset by the terminal are A conflict has occurred. For example, the user selects an image with the label "badminton" in the target story album in FIG. 12, and also includes a "badminton” label in the invalid label list, indicating that the terminal presets the invalid label list and the user. The usage habits do not match. Therefore, the terminal can delete the "badminton" label in the invalid label list, that is, the subsequent terminal can retain the image with the "badminton” label as a valid image in the target image. In this way, the terminal can continuously correct the preset invalid tag list according to the user's usage habit, so that the invalid tag in the invalid tag list matches the user's usage habit, and realizes the customized experience when creating the story album.
  • the terminal may also display the preset invalid tag list to the user, and then the user may manually perform each invalid tag in the invalid tag list. For example, the user may delete the tag of interest in the invalid tag list, or the user may add a tag that is not of interest to the invalid tag list, so that the invalid tag in the invalid tag list matches the user's usage habit.
  • a customized experience when creating a story album when the user uses the terminal for the first time, or uses the story album function on the terminal for the first time, the terminal may also display the preset invalid tag list to the user, and then the user may manually perform each invalid tag in the invalid tag list. For example, the user may delete the tag of interest in the invalid tag list, or the user may add a tag that is not of interest to the invalid tag list, so that the invalid tag in the invalid tag list matches the user's usage habit.
  • the terminal may collect user behavior data of the user on the terminal, for example, a webpage browsed by the user. Type, type of video viewed by the user, etc., and further, through these user behavior data terminals, tags that are of interest or not of interest to the user can be identified. Then, the terminal can correct the preset invalid tag list according to the identified tag that the user is interested or not interested in, so that the invalid tag in the invalid tag list matches the user's usage habit, and the customization is realized when the story album is created. Experience.
  • the terminal may also send the foregoing user behavior data to the server, and after the server performs big data statistics on the user behavior data, determine tags that the user is interested or not interested in, and periodically push the tags that are of interest or not of interest to the user. The terminal, so that the terminal corrects the preset invalid tag list.
  • the terminal may further determine whether to delete the invalid tag for the initial story album according to the number of images having the invalid tag. For example, the terminal presets the headlight as an invalid label, but the number of images having the label of the headlight in the initial story album is greater than five, indicating that the user pays more attention to the headlight, and therefore, for the initial story album, The label of the headlight changes from an invalid label to a valid label, and the image with the label of the headlight is retained in the target story album to avoid accidentally deleting the image of interest to the user from the initial story album.
  • each of the images has one label
  • the label is a keyword as an example to describe the generation process of the target story album.
  • each image can have multiple tags, for example, the tags of image 1 are: characters and leaves.
  • the label of the image may be a one or more sentence descriptions of the image content.
  • the label of the image 1 is: the user A is reading a book, and the like, and the embodiment of the present application does not impose any limitation.
  • the terminal may determine whether to use the image as an invalid image according to the proportion of the invalid tags in the plurality of tags.
  • the label of the image 2 includes: a character, a scissors, a mobile phone, and a door.
  • the scissors, the mobile phone, and the door are all invalid labels, that is, 75% of the labels of the image 2 are
  • the tag is an invalid tag
  • the preset threshold of the terminal is 60%, that is, when more than 60% of the tags of the image are invalid tags, the image can be regarded as an invalid image.
  • the proportion of invalid tags in image 2 is greater than the ratio threshold of 60%, so the terminal can take image 2 as an invalid image and remove image 2 from its original story album.
  • the terminal determines an album theme of the target story album according to image features of each image in the target story album.
  • the album theme of the entire target story album may be determined according to the image features of each image, for example, a sports theme, a wedding theme, a birthday theme, a travel theme, and the like.
  • the terminal can adjust the granularity of the album theme.
  • the motion theme can be further divided into a water sports theme, a ball sports theme, and the like, and the travel theme is further divided into a local tour theme and a foreign tour theme.
  • the terminal may use the theme corresponding to the label as The album theme of the target story album. For example, there are 20 images in the target story album, of which 15 images are all sports, that is, 75% of the images in the target story album are sports labels, then the terminal can use the motion as the album theme of the target story album. .
  • a label distribution model of different album themes may be set in advance in the terminal, that is, a label distribution of each image in the corresponding story album under a specific album theme. Then, the terminal can take step S503 The label distribution of each image in the target story album obtained in the comparison is compared with the label distribution model of the different album theme described above, and the album theme with the highest similarity among the comparison results is used as the album theme of the target story album.
  • the terminal may use the matrix B to represent a label distribution model of different album topics.
  • the M elements of each column in the matrix B reflect the label distribution of the image under one album theme, and the terminal may
  • each element in the matrix C is used to indicate the scene probability of the target story album under the corresponding album theme.
  • the terminal can use the album theme corresponding to the element with the highest scene probability in the matrix C as the album theme of the target story album.
  • the terminal may also modify the label distribution model (ie, matrix B) by a classification model such as a naive Bayes classifier to improve the accuracy of the album topic recognition.
  • the terminal may also modify the label distribution model (ie, the matrix B) according to the user's manual modification of the subject of the album. The embodiment of the present application does not impose any limitation on this.
  • the terminal may count the frequency of occurrence of each image tag in the target story album, and then use the album theme corresponding to the tag with the highest frequency as the album theme of the target story album.
  • the terminal may also identify the high frequency vocabulary appearing in each label by semantic analysis, for example, 8 of the 10 images of the target story album The word "birthday” appears in the labels of the images, and the terminal can use the high-frequency vocabulary "birthday” as the album theme of the target story album.
  • an album theme associated with different high frequency words may be preset in the terminal.
  • the album theme associated with the album is: birthday; when in the label
  • the theme of the album associated with it is: wedding.
  • the album theme associated with the high frequency vocabulary may be further determined according to the above association relationship.
  • the theme of the album that is recognized by the terminal may specifically include at least one of a birthday, a party, a wedding, a sports, a graduation, a holiday, a night view, a local tour, and a foreign tour.
  • the shooting location of the image in the target story album is a preset location, such as the resident of the user, if the image includes the scenery and the human face, the theme of the target story album may be a local tour;
  • the terminal can set the theme of the target story album according to the distance between the shooting location and the resident location of the user.
  • the theme of the target story album can be set as the night tour; when the image in the target story album is recognized to contain the cake, Set the theme of the target story album as a birthday; when recognizing that the image in the target story album contains food and face, the theme of the target story album can be set as a party; when the image in the target story album is recognized to include basketball or When playing badminton, you can set the theme of the target story album to sports; when you identify the map in the target story album When contained wedding, you can target the story of the album is set to the theme wedding.
  • the terminal may further identify the initial story album (or target according to the specific image feature of each image).
  • the theme scene of the story album that is, the image content in the initial story album (or the target story album) is identified on the dimension of the image feature (referred to as the second dimension in the embodiment of the present application), thereby determining the story album
  • the theme scene enables the terminal to realize multi-dimensional understanding of the image when creating the story album, so that the theme scene that the terminal can recognize is the central aggregation to generate a thematic story album with clear theme, and improve the efficiency of the terminal to manage the image in the gallery.
  • the terminal acquires association information associated with the target story album from the target application.
  • the terminal corrects the album theme according to the related information.
  • the terminal may also obtain association information associated with the target story album from the target application related to the user schedule, such as a memo, a calendar, a mail, a notepad, a phone, a short message, and a contact. For example, if the target story album is taken on November 4th, then the terminal can read the memo on November 4th and determine the related information of November 4th as the mother's birthday.
  • association information associated with the target story album from the target application related to the user schedule, such as a memo, a calendar, a mail, a notepad, a phone, a short message, and a contact.
  • the terminal may further process the album topic of the target story album on the dimension associated with the target application (referred to as the third dimension in the embodiment of the present application), thereby The album theme determined in step S504 is corrected.
  • the album theme determined in step S504 is “party”
  • the terminal can obtain the related information associated with the target story album by using the memo information in the memo or the schedule information in the calendar: the mother’s birthday, the terminal can It is determined that the image of the mother's birthday is recorded in the target story album, and then the terminal can correct the theme of the target story album to "mother's birthday party”.
  • the album theme determined in step S504 is “Gourmet”, and the terminal can obtain the associated information associated with the target story album by using the short message content in the short message or the calendar information in the calendar: when the boyfriend is dating, the terminal can It is determined that the image recorded in the target story album is the food of the date when the boyfriend is dated, and then the terminal can correct the theme of the target story album to "date and food”.
  • the terminal can process the image in the gallery to identify the image in the attribute information of the image, the image feature of the image, and the associated information recorded in the target application associated with the image.
  • the theme scene of the image in the gallery is used to aggregate the thematic images into a story album, creating a theme story album that is more interesting or of higher value to the user.
  • the terminal may also directly determine one or more images associated with the schedule information according to the schedule information input by the user in the target application, and then aggregate the one or more images into the target story album. For example, if the user inputs the calendar on the day of September 12 of the calendar application: take the cake, then after the terminal reads the schedule information, the photo taken on September 12 can be aggregated into the target story album.
  • the terminal may set the title of the target story album to a title associated with the schedule information of “take the cake”, such as “birthday”, “happy birthday”, etc., to create a user more interested or A more valuable theme story album.
  • the terminal superimposes a title for reflecting the theme of the album on the album cover of the target story album.
  • the title of the target story album superimposed and displayed on the album cover is associated with the album theme recognized in the above embodiment.
  • the theme of the album recognized by the terminal is "birthday”, then “birthday” can be used.
  • the title of the target story album is displayed on the album cover, that is, the title of the target story album is the same as the recognized album theme; of course, the title of the target story album may also be other descriptions similar or related to the meaning of "birthday", this application
  • the embodiment does not impose any restrictions on this.
  • the terminal may preset some corresponding candidate titles. For example, for the birthday theme, "warm birthday”, “birthday party”, “happy birthday”, and “grown up again” may be preset. "four years old” these four candidate titles. Further, the terminal may select one of the candidate titles for generating a title of the target story album. For example, when the album theme of the target story album is a mother's birthday, the terminal may select a candidate title of "birthday party” and generate "mother's birthday party” as the title of the target story album.
  • the terminal may select one or more images in the created target story album as the album cover 1201 of the target story album, and superimpose and display the "mother's birthday party" on the album cover 1201.
  • This title is 1202.
  • the terminal displays the title of the story album, the font and the font size can be randomly selected for display, thereby increasing the interest of the story album.
  • the terminal may also confirm to the user whether to use the title.
  • the terminal may also confirm to the user whether to use the title.
  • the terminal may also confirm to the user whether to use the title.
  • the terminal may also confirm to the user whether to use the title.
  • the terminal may also confirm to the user whether to use the title.
  • the terminal may also confirm to the user whether to use the title.
  • the terminal modifies the title, the terminal superimposes the modified title of the user on the album cover. For example, the user modifies the title of "Mother's Birthday Party" determined by the terminal to "Birthday Carnival", then the title 1202 that the terminal finally superimposes on the album cover 1201 is "Birthday Carnival".
  • the terminal can save the title of "birthday carnival” input by the user as a candidate title of the album theme of "birthday”, and then the terminal can be preferred when the terminal recognizes that the album theme of the created story album is birthday.
  • the candidate title "Birthday Carnival” that the user has set is selected as the title of the story album.
  • the terminal may further add information about the shooting time and/or the shooting location in the title 1202 of the target story album, so that the user can quickly according to at least one of the album theme, the shooting time, or the shooting location. Lock the story album you are interested in.
  • the method for displaying the story album provided by the embodiment of the present application is illustrated by taking the birthday theme as an example. It can be understood that when the terminal generates a story album of other topics by multi-dimensional understanding of the image, the method can be The title corresponding to the album theme is superimposed on the album cover of the story album.
  • the terminal when the terminal recognizes that the theme of the album A is a wedding theme, the title of “happy moment” corresponding to the wedding theme may be added to the album cover of the album A; when the terminal recognizes the album
  • the theme of B is a sports theme
  • the title of "love sports” corresponding to the sports theme may be added to the album cover of the album B; when the terminal recognizes that the theme of the album D is a graduation theme, the album cover of the album D may be Adding the title of “Graduation Season” corresponding to the graduation theme;
  • the terminal recognizes that the shooting time of the album E is May Day, the terminal can add the corresponding “Labor Day” to the album cover of the album E in conjunction with the shooting location Lhasa.
  • the title in Lhasa when the terminal recognizes that the theme of the album A is a wedding theme, the title of “happy moment” corresponding to the wedding theme may be added to the album cover of the album A; when the terminal recognizes the album When the theme of B is a sports theme
  • the terminal may add the read shooting time and/or shooting location of the album as a title to the story as shown in the album C and the album F in FIG. 16 .
  • the embodiment of the present application does not impose any limitation on the album cover of the album.
  • the terminal plays the above target story album.
  • the trigger terminal automatically starts playing each story album in the preview interface.
  • the terminal can play the album A to the album F in sequence, or automatically play the album displayed at a certain position (for example, the upper left corner) of the display interface according to the sliding operation when the user browses the preview interface.
  • the user may click on the story album of the story that is of interest according to the title of each story album.
  • the terminal may jump to the play interface to The images in the album are played to the user in the form of short videos.
  • the terminal when the terminal plays each image in the target story album, the terminal may also display information such as the shooting time, the shooting location, or the image theme of the image on one or more images.
  • the shooting time and the shooting location of the image A can be superimposed on the image A as "2016- 11-4, Hangzhou", when the terminal plays the image B in the story album, as shown in (b) of FIG.
  • the terminal can superimpose the shooting time of the image B on the image B and the shooting location is "2017" -11-4, Beijing", which helps the user to quickly recall the information related to the current playback image during the process of playing the story album, thereby improving the user experience when using the story album.
  • the playback effect (eg, music background, screen effects, filters, editing order, etc.) when the terminal plays the above-mentioned target story album may also be associated with the recognized album theme.
  • the playback effect can also be determined by the user.
  • the visually significant area in the image A (or the image B) can be avoided (for example, the face is included, the contrast is strong, or the contour line is more
  • the area of the display element ie, the shooting time and the shooting location described above
  • the terminal may also arrange the title 1102 in the non-visually significant area of the album cover 1101.
  • This embodiment of the present application does not impose any limitation.
  • the user can also adjust the image in the target story album, for example, adding a new image to the target story album, deleting the existing image in the target story album, and modifying the target story.
  • the label of an image in the album, etc. As shown in FIG. 18, when the user manually adjusts the image in the target story album, the terminal may correct the label distribution model (ie, matrix B) shown in FIG. 13 according to the adjusted target story album, for example, the target story album.
  • the terminal may modify the column vector in the matrix B for indicating the wedding theme according to the added image, so as to improve the recognition accuracy of the subsequent terminal to the wedding theme.
  • the terminal may also provide a function for the user to manually create a story album.
  • the terminal may be in the gallery according to the shooting time, shooting location, image content, and album theme (eg, birthday, party, wedding, sports, graduation, holiday, night scene, local tour, and field tour) manually selected by the user.
  • An image that satisfies the above conditions is aggregated into a story album, thereby customizing a story album that meets the user's expectations.
  • the terminal may set a shortcut 191 for creating a new story album in the display interface of the story album.
  • the terminal detects that the user triggers the shortcut 191, as shown in FIG.
  • the terminal can provide the user with one or more album themes for the user to select, for example, birthday, party, wedding, sports, graduation, holiday, night scene, local tour, and field tour.
  • the N images related to “birthday” in the gallery may be aggregated into an initial story album.
  • the terminal can aggregate the image of the image as a birthday or cake into an initial story album.
  • the terminal may aggregate a set of images having the same or similar label distribution as the preset "birthday” theme into an initial story album.
  • the terminal may prompt the user to select an image within a certain time span to create a story album of the "birthday” theme; for example, as shown in (b) of FIG.
  • the terminal may prompt the user to select an image taken at one or more shooting locations to create a story album of the "birthday” theme.
  • the terminal can filter the N images in the initial story album according to the time span and/or the shooting location selected by the user. For example, if the user chooses to use the images taken in Beijing and Shanghai in 2014.11-2017.11 to create the above-mentioned "birthday" theme story album, then the terminal can take images outside the shooting time of 2014.11-2017.11, and the shooting location is not Beijing and Shanghai.
  • the image is removed from the initial story album described above, and a target story album composed of M images is obtained.
  • the terminal can still display the title related to the "birthday” theme on the album cover of the target story album by using the method of steps S507-S508 described above, and play the target story album.
  • the terminal may perform face detection on each image in the initial story album, and prompt the detected one or more faces to the user, so that the terminal may select according to subsequent users.
  • the target face is removed from the image of the initial story album that does not include the target face, and the target story album is obtained.
  • the terminal may prompt the user to set the playing duration or the number of images of the target story album, so that the terminal may remove redundant images according to the target playing duration or the number of target images set by the subsequent user. Remove from the initial story album and get the target story album.
  • the terminal may first prompt the user to select a target face from the identified plurality of faces, and then aggregate the image including the target face in the gallery into an initial story album, and subsequently The terminal may generate a target story album according to one or more factors of the album theme, the shooting time, and the shooting location input by the user.
  • the terminal may prompt the user to select one or more conditions of the album theme of the story album, the included characters, the shooting time, the shooting location, the number of images, and the like, and filter the related images according to the conditions selected by the user, thereby creating a matching user.
  • the terminal may prompt the user to select one or more conditions of the album theme of the story album, the included characters, the shooting time, the shooting location, the number of images, and the like, and filter the related images according to the conditions selected by the user, thereby creating a matching user.
  • Expected story album the terminal may prompt the user to select one or more conditions of the album theme of the story album, the included characters, the shooting time, the shooting location, the number of images, and the like.
  • a sharing shortcut key 221 for sharing the story album may be provided in the display interface of the story album.
  • the user may further select to share one or more story albums that have been created to other applications or other terminals, which is not limited in this embodiment.
  • the above terminal and the like include hardware structures and/or software modules corresponding to each function.
  • the embodiments of the present application can be implemented in hardware or hardware and computer software in combination with the elements and algorithm steps of the various examples described in the embodiments disclosed herein. Combined with the form to achieve. Whether a function is implemented in hardware or computer software to drive hardware depends on the specific application and design constraints of the solution. A person skilled in the art can use different methods to implement the described functions for each particular application, but such implementation should not be considered to be beyond the scope of the embodiments of the present application.
  • the embodiment of the present application may perform the division of the function modules on the terminal or the like according to the foregoing method example.
  • each function module may be divided according to each function, or two or more functions may be integrated into one processing module.
  • the above integrated modules can be implemented in the form of hardware or in the form of software functional modules. It should be noted that the division of the module in the embodiment of the present application is schematic, and is only a logical function division, and the actual implementation may have another division manner.
  • FIG. 23 is a schematic diagram of a possible structure of a terminal involved in the foregoing embodiment, where the terminal includes: an obtaining unit 2301, an aggregating unit 2302, and a removing unit 2303.
  • the obtaining unit 2301 is configured to support the terminal to perform the processes 501 and 505 in FIG. 5; the aggregating unit 2302 is configured to support the terminal to perform the process 502 in FIG. 5; the removing unit 2303 is configured to support the terminal to execute the process 503 in FIG. 5; the determining unit 2304 The supporting unit performs the process 504 in FIG. 5; the correcting unit 2305 is configured to support the terminal to execute the process 506 in FIG. 5; and the display unit 2306 is configured to support the terminal to execute the processes 507-508 in FIG. 5. All the related content of the steps involved in the foregoing method embodiments may be referred to the functional descriptions of the corresponding functional modules, and details are not described herein again.
  • the above-described aggregation unit 2302, removal unit 2303, determination unit 2304, and correction unit 2305 may be integrated into a processing module, the acquisition unit 2301 is used as an input module, and the display unit 2306 is used as a display module.
  • the terminal may also include a storage module.
  • the processing module 2402 is configured to perform control management on the action of the terminal.
  • the input module 2403 is configured to support receiving information input by the user.
  • the storage module 2401 is configured to save program codes and data of the terminal.
  • the display module 2404 is for displaying information input by the user or information provided to the user and various menus of the terminal.
  • the processing module 2402 may be a processor or a controller, for example, may be a central processing unit (CPU), a GPU, a general-purpose processor, a digital signal processor (DSP), an application specific integrated circuit. (Application-Specific Integrated Circuit, ASIC), Field Programmable Gate Array (FPGA) or other programmable logic device, transistor logic device, hardware component, or any combination thereof. It is possible to implement or carry out the various illustrative logical blocks, modules and circuits described in connection with the present disclosure.
  • the processor may also be a combination of computing functions, for example, including one or more microprocessor combinations, a combination of a DSP and a microprocessor, and the like.
  • the input module 2403 may be a device for receiving information input by a user, such as a touch screen, a microphone, or the like.
  • the memory module 2401 may be a memory, which may include a high speed random access memory (RAM), and may also include a nonvolatile memory such as a magnetic disk storage device, a flash memory device, or other volatile solid state storage device.
  • RAM high speed random access memory
  • nonvolatile memory such as a magnetic disk storage device, a flash memory device, or other volatile solid state storage device.
  • the display module 2404 can be a display, and specifically can be configured in the form of a liquid crystal display, an organic light emitting diode, or the like.
  • a touch panel can be integrated on the display for collecting touch events on or near the display, and transmitting the collected touch information to other devices (such as a processor, etc.).
  • the processing module 2402 is a processor
  • the input module 2403 is a touch panel
  • the storage module 2401 is a memory
  • the display module 2404 is a display
  • the terminal structure provided by the embodiment of the present application is as shown in FIG. 25.
  • At least N (N>1) images are stored in the memory 2501, and the processor 2502 can aggregate N images in the memory 2501 according to the first dimension, the first dimension including the shooting time and / or shooting location; further, the processor 2502 can instruct the display 2504 to display an album cover of the story album, the story album including M (M ⁇ N) images of the N images, the M images and the The theme of the story album is associated.
  • the processor 2502 may further remove the invalid images in the N images to obtain the story album composed of M images, where the invalid The image includes an image with an invalid tag or one or more images with an image similarity greater than a threshold.
  • the processor 2502 may further determine the theme associated with the M images according to the second dimension. Obtaining a theme of the story album, the second dimension comprising image features of at least one of the M images.
  • the processor 2502 may further correct the theme of the story album according to the third dimension.
  • the third dimension includes association information associated with the theme of the story album in the target application.
  • the foregoing first dimension includes the shooting time.
  • the processor 2502 aggregates the N images in the library according to the first dimension, and specifically includes: the processor 2502 will each time period of Z (Z ⁇ 2) time segments.
  • the internally generated images are aggregated into one image set, and Z image sets are obtained, and the Z image sets are in one-to-one correspondence with the Z time segments; when the time interval between adjacent image sets is less than the interval threshold, the processor 2502 aggregates the set of adjacent images.
  • the processor 2502 determines the theme associated with the M images according to the second dimension, and obtains the theme of the story album, specifically: the processor 2502 compares the label distribution of the M images with a preset The label distribution of each candidate topic; when the label distribution of the M images conforms to the label distribution of the first candidate topic, the processor 2502 determines the first candidate topic as the subject of the story album.
  • the processor 2502 removes the invalid image in the N images, and specifically includes: the display 2504 displays X (X ⁇ 2) images whose similarities are greater than the threshold value identified from the N images; the touch panel 2503 Receiving a target image selected by the user from the X images, then, in response to a target image selected by the user from the X images, the processor 2502 retains the target image in the story album, and The remaining images of the X images except the target image are removed.
  • the processor 2502 removes the invalid image in the story album, and specifically includes: the display 2504 displays Y (Y ⁇ 2) tags identified from the N images, and the label of each image is used to reflect the An image feature of the image; the touchpad 2503 receives a target tag selected by the user from the Y tags; in response to the user selecting a target tag from the Y tags, the processor 2502 retains the image having the target tag In the story album, an image that does not have the target tag is removed.
  • the display 2504 displays Y (Y ⁇ 2) tags identified from the N images, and the label of each image is used to reflect the An image feature of the image
  • the touchpad 2503 receives a target tag selected by the user from the Y tags
  • the processor 2502 retains the image having the target tag In the story album, an image that does not have the target tag is removed.
  • the display 2504 can also play the story album, wherein when the first image in the story album is played, the terminal displays the shooting of the first image. Time and / or location.
  • the first dimension may further include at least one of a character appearing in the story album, a playing duration of the story album, a number of images in the story album, and a theme of the story album;
  • the touchpad 2503 can also receive the target time period input by the user to create the story album, the target shooting location, the target person, the target playing duration, and the target image. At least one of the quantity and the target topic.
  • At least N (N>1) images are stored in the memory 2501, and the touchpad 2503 can receive the user in the target application (eg, memo, calendar, mail, notepad, phone, The schedule information input in the short message and the contact, etc.; further, the processor 2502 creates the N images in the memory 2501 as a story album; and instructs the display 2504 to display the album cover of the story album, where the album cover includes The title of the story album is described, and the title is associated with the schedule information.
  • the target application eg, memo, calendar, mail, notepad, phone, The schedule information input in the short message and the contact, etc.
  • the processor 2502 creates the N images in the memory 2501 as a story album
  • instructs the display 2504 to display the album cover of the story album, where the album cover includes The title of the story album is described, and the title is associated with the schedule information.
  • the computer program product includes one or more computer instructions.
  • the computer can be a general purpose computer, a special purpose computer, a computer network, or other programmable device.
  • the computer instructions can be stored in a computer readable storage medium or transferred from one computer readable storage medium to another computer readable storage medium, for example, the computer instructions can be from a website site, computer, server or data center Transfer to another website site, computer, server, or data center by wire (eg, coaxial cable, fiber optic, digital subscriber line (DSL), or wireless (eg, infrared, wireless, microwave, etc.).
  • the computer readable storage medium can be any available media that can be accessed by a computer or a data storage device such as a server, data center, or the like that includes one or more available media.
  • the usable medium may be a magnetic medium (eg, a floppy disk, a hard disk, a magnetic tape), an optical medium (eg, a DVD), or a semiconductor medium (such as a solid state disk (SSD)).

Abstract

本申请的实施例提供一种故事相册的显示方法及装置，涉及通信技术领域，可生成具有主题性的故事相册，以提高终端对图库的图像管理效率。该方法包括：终端按照第一维度聚合图库中的N个图像，所述第一维度包括拍摄时间和/或拍摄地点，N＞≥1；所述终端显示故事相册的相册封面，所述故事相册包括所述N个图像中的M个图像，所述M个图像与目标相册所述故事相册的主题相关联，M＜N。

Description

一种故事相册的显示方法及装置 技术领域
本申请实施例涉及通信技术领域，尤其涉及一种故事相册的显示方法及装置。
背景技术
故事相册(story album)功能是指对终端图库中的图像进行自动聚合，从而制作成的一个或多个故事相册，使用户可以快速简便的回看过往某些重要事件的照片。
目前，终端可根据图库中每一张图像的拍摄位置或拍摄时间，将某一时间段或某一地点处拍摄的照片进行聚合，并以短视频的形式制作成故事相册。例如，将2017-11-4至2017-11-5日在延庆区拍摄的照片集合制作为故事相册A，如图1所示，可在该故事相册A中选择一张照片作为故事相册A的相册封面11，该相册封面11上可显示用于反映该故事相册A内各个照片特点的描述信息12。
由于上述故事相册A是根据拍摄位置或拍摄时间聚合得到的，因此，上述描述信息12一般用于反映具体的拍摄位置或拍摄时间信息。但是，随着图库中图像数量的增长，单一地通过摄位置或拍摄时间在图库中查找对用户有价值和感兴趣的图像将变得越来越困难。如果用户忘记了准确时间或者地点，在图库中搜寻大量图像就变得困难和费时，使得终端对图库的图像管理效率降低。
发明内容
本申请的实施例提供一种故事相册的显示方法及装置，可生成具有主题性的故事相册，以提高终端对图库的图像管理效率。
为达到上述目的，本申请的实施例采用如下技术方案：
第一方面，本申请的实施例提供一种故事相册的显示方法，包括：终端按照第一维度(该第一维度包括拍摄时间和/或拍摄地点)聚合图库中的N(N＞1)个图像；终端显示故事相册的相册封面，该故事相册包括上述N个图像中的M(M＜N)个图像，这M个图像与该故事相册的主题相关联。
也就是说，终端根据拍摄时间和/或拍摄地点聚合了图库中的N个图像后，可在这N个图像中筛选出具有主体性的M个图像，从而将这M个图像创建为故事相册显示给用户。这样生成的故事相册具有鲜明的主题性，用户可按照主题从相应故事相册中选择所需的图像，从而提高后续终端对图库中图像的管理效率。
示例性的，上述故事相册的主题具体可以包括生日、聚会、婚礼、运动、毕业、节假日、夜景、本地游以及外地游中的至少一项。
在一种可能的设计方法中，上述相册封面上包括上述故事相册的标题，该标题与确定出的主题、上述N个图像的拍摄时间和上述N个图像的拍摄地点中的至少一个相关联。这样用户通过相册封面上显示的标题及时了解该故事相册中图像的基本信息。
在一种可能的设计方法中，在终端按照第一维度聚合图库中的N个图像之后，还包括：终端去除该N个图像中的无效图像，得到M个图像组成的该故事相册，该无效图像包括具有无效标签的图像或图像相似度大于阈值的一个或多个图像。也就是说， 终端可以将初始故事相册中与主题不符的无效图像去除，使得创建出的故事相册中的图像之间的关联性较强。
在一种可能的设计方法中，在终端去除该N个图像中的无效图像，得到M个图像组成的该故事相册之后，还包括：终端按照第二维度确定与该M个图像相关联的主题，得到该故事相册的主题，该第二维度包括该M个图像中至少一个图像的图像特征。
也就是说，在终端基于第一维度聚合得到的N个图像的基础上，终端可进一步根据各图像的具体图像特征识别该N个图像的主题场景，即在图像特征这一维度(本申请实施例中将其称为第二维度)上对图像内容进行识别，从而确定故事相册的主题场景，使得终端在创建故事相册时实现了对图像的多维理解，这样终端可以识别出的主题场景为中心聚合生成主题性鲜明的故事相册，提高终端对图库中图像的管理效率。
在一种可能的设计方法中，在终端按照第二维度确定与该M个图像相关联的该故事相册的主题之后，还包括：终端按照第三维度对该故事相册的主题进行修正，该第三维度包括目标应用中与该故事相册的主题相关联的关联信息。
可以看出，本申请实施例中终端可在图像的属性信息、图像的图像特征，以及与图像关联的目标应用这三个维度上，对图库中的图像进行处理，以识别出图库中图像的主题场景，从而将主题性较强的图像聚合为故事相册，创建用户更加感兴趣或价值更高的主题性故事相册。
在一种可能的设计方法中，该第一维度中包括拍摄时间，其中，终端按照第一维度聚合图库中的N个图像，包括：终端将Z个时间段中每个时间段内生成的图像聚合为一个图像集合，得到Z个图像集合，该Z个图像集合与该Z个时间段一一对应，Z≥2；当相邻图像集合之间的时间间隔小于间隔阈值时，终端将该相邻图像集合进行聚合。
在一种可能的设计方法中，该第一维度中还包括拍摄地点，其中，当相邻图像集合的拍摄地点均不是预先设置的地点时，说明用户很可能在非常驻地长途旅行，此时可设置该间隔阈值为较大的第一预设值；而当相邻图像集合的拍摄地点均为预先设置的地点时，可设置该间隔阈值为较小的第二预设值，从而将连续拍摄的图像聚合在一起，以便创建故事相册。
在一种可能的设计方法中，终端按照第二维度确定与该M个图像相关联的主题，得到该故事相册的主题，包括：终端对比该M个图像的标签分布情况与预先设置的每一个候选主题的标签分布情况；当该M个图像的标签分布情况符合第一候选主题的标签分布情况时，终端将该第一候选主题确定为该故事相册的主题。
在一种可能的设计方法中，终端去除该N个图像中的无效图像，包括：终端显示从该N个图像中识别出的X个相似度大于阈值的图像，X≥2；响应于用户从该X个图像中选择的目标图像，终端将该目标图像保留在该故事相册中，并将该X个图像中除该目标图像外的其余图像去除。
在一种可能的设计方法中，终端去除该故事相册中的无效图像，包括：终端显示从该N个图像中识别出的Y个标签，每个图像的标签用于反映该图像的图像特征，Y≥2；响应于用户从该Y个标签中选择的目标标签，终端将具有该目标标签的图像保留在该故事相册中，将不具有该目标标签的图像去除。
在一种可能的设计方法中，在终端显示故事相册的相册封面之后，还包括：终端播放该故事相册，其中，在播放该故事相册中的第一图像时，终端显示该第一图像的拍摄时间和/或拍摄地点。这样可以在播放故事相册的过程中帮助用户快速回忆与当前的播放图像相关的信息，提高了用户使用故事相册时的使用体验。
在一种可能的设计方法中，该第一维度还包括该故事相册中出现的人物、该故事相册的播放时长、该故事相册中的图像数量以及该故事相册的主题中的至少一项；其中，在终端按照第一维度聚合图库中的N个图像之前，还包括：终端接收用户对待创建的故事相册输入的目标时间段、目标拍摄地点、目标人物、目标播放时长、目标图像数量以及目标主题中的至少一项。
也就是说，终端可以提示用户选择故事相册的相册主题、包含的人物、拍摄时间、拍摄地点、播放时长、图像数量等一项或多项条件，并根据用户选择的条件筛选相关的图像，从而创建符合用户期望的故事相册。
第二方面，本申请的实施例提供一种故事相册的显示方法，包括：终端接收用户在目标应用中输入的日程信息；终端将图库中的N(N＞1)个图像创建为故事相册；终端显示该故事相册的相册封面，该相册封面上的标题与上述日程信息相关联，这样可以创建用户更加感兴趣或价值更高的主题性故事相册。
在一种可能的设计方法中，该目标应用包括：备忘录、日历、邮件、记事本、电话、短信以及联系人中的至少一个。
第三方面，本申请的实施例提供一种终端，包括：聚合单元，用于按照第一维度聚合图库中的N个图像，该第一维度包括拍摄时间和/或拍摄地点，N＞1；显示单元，用于显示故事相册的相册封面，该故事相册包括该N个图像中的M个图像，该M个图像与该故事相册的主题相关联，M＜N。
在一种可能的设计方法中，还包括：去除单元，用于去除该N个图像中的无效图像，得到M个图像组成的该故事相册，该无效图像包括具有无效标签的图像或图像相似度大于阈值的一个或多个图像。
在一种可能的设计方法中，还包括：确定单元，用于按照第二维度确定与该M个图像相关联的主题，得到该故事相册的主题，该第二维度包括该M个图像中至少一个图像的图像特征。
在一种可能的设计方法中，还包括：修正单元，用于按照第三维度对该故事相册的主题进行修正，该第三维度包括目标应用中与该故事相册的主题相关联的关联信息。
在一种可能的设计方法中，该第一维度中包括拍摄时间，该聚合单元，具体用于：将Z个时间段中每个时间段内生成的图像聚合为一个图像集合，得到Z个图像集合，该Z个图像集合与该Z个时间段一一对应，Z≥2；当相邻图像集合之间的时间间隔小于间隔阈值时，将该相邻图像集合进行聚合。
在一种可能的设计方法中，该第一维度中还包括拍摄地点，其中，当相邻图像集合的拍摄地点均不是预先设置的地点时，该间隔阈值为第一预设值；当相邻图像集合的拍摄地点均为预先设置的地点时，该间隔阈值为第二预设值，该第二预设值小于该第一预设值。
在一种可能的设计方法中，该确定单元，具体用于：对比该M个图像的标签分布 情况与预先设置的每一个候选主题的标签分布情况；当该M个图像的标签分布情况符合第一候选主题的标签分布情况时，将该第一候选主题确定为该故事相册的主题。
在一种可能的设计方法中，该显示单元，还用于显示从该N个图像中识别出的X个相似度大于阈值的图像，X≥2；该去除单元，具体用于：响应于用户从该X个图像中选择的目标图像，将该目标图像保留在该故事相册中，并将该X个图像中除该目标图像外的其余图像去除。
在一种可能的设计方法中，该显示单元，还用于显示从该N个图像中识别出的Y个标签，每个图像的标签用于反映该图像的图像特征，Y≥2；该去除单元，具体用于：响应于用户从该Y个标签中选择的目标标签，将具有该目标标签的图像保留在该故事相册中，将不具有该目标标签的图像去除。
在一种可能的设计方法中，该显示单元，还用于播放该故事相册，其中，在播放该故事相册中的第一图像时，终端显示该第一图像的拍摄时间和/或拍摄地点。
在一种可能的设计方法中，该第一维度还包括该故事相册中出现的人物、该故事相册的播放时长、故事相册中的图像数量以及该故事相册的主题中的至少一项；终端还包括：获取单元，用于接收用户对待创建的故事相册输入的目标时间段、目标拍摄地点、目标人物、目标播放时长、目标图像数量以及目标主题中的至少一项。
第四方面，本申请的实施例提供一种终端，包括：获取单元，用于接收用户在目标应用中输入的日程信息；创建单元，用于将图库中的N个图像创建为故事相册，其中，N＞1；显示单元，用于显示该故事相册的相册封面，该相册封面上包括该故事相册的标题，该标题与该日程信息相关联。
第五方面，本申请的实施例提供一种终端，包括：处理器、存储器、总线和通信接口；该存储器用于存储计算机执行指令，该处理器与该存储器通过该总线连接，当终端运行时，该处理器执行该存储器存储的该计算机执行指令，以使终端执行上述任一项故事相册的显示方法。
第六方面，本申请实施例提供一种计算机可读存储介质，该计算机可读存储介质中存储有指令，当该指令在上述任一项终端上运行时，使得终端执行上述任一项故事相册的显示方法。
第七方面，本申请实施例提供一种包含指令的计算机程序产品，当其在上述任一项终端上运行时，使得终端执行上述任一项故事相册的显示方法。
本申请的实施例中，上述终端的名字对设备本身不构成限定，在实际实现中，这些设备可以以其他名称出现。只要各个设备的功能和本申请的实施例类似，即属于本申请权利要求及其等同技术的范围之内。
另外，第二方面至第七方面中任一种设计方式所带来的技术效果可参见上述第一方面中不同设计方法所带来的技术效果，此处不再赘述。
附图说明
图1为现有技术中显示故事相册的应用场景；
图2为本申请实施例提供的一种终端的结构示意图一；
图3为本申请实施例提供的一种摄像头的拍摄原理示意图；
图4为本申请实施例提供的一种EXIF格式图像的结构示意图；
图5为本申请实施例提供的一种故事相册的显示方法的流程示意图；
图6为本申请实施例提供的一种创建故事相册的场景示意图一；
图7为本申请实施例提供的一种创建故事相册的场景示意图二；
图8为本申请实施例提供的一种创建故事相册的场景示意图三；
图9为本申请实施例提供的一种创建故事相册的场景示意图四；
图10为本申请实施例提供的一种创建故事相册的场景示意图五；
图11为本申请实施例提供的一种创建故事相册的场景示意图六；
图12为本申请实施例提供的一种创建故事相册的场景示意图七；
图13为本申请实施例提供的一种创建故事相册的场景示意图八；
图14为本申请实施例提供的一种创建故事相册的场景示意图九；
图15为本申请实施例提供的一种创建故事相册的场景示意图十；
图16为本申请实施例提供的一种创建故事相册的场景示意图十一；
图17为本申请实施例提供的一种创建故事相册的场景示意图十二；
图18为本申请实施例提供的一种创建故事相册的场景示意图十三；
图19为本申请实施例提供的一种创建故事相册的场景示意图十四；
图20为本申请实施例提供的一种创建故事相册的场景示意图十五；
图21为本申请实施例提供的一种创建故事相册的场景示意图十六；
图22为本申请实施例提供的一种创建故事相册的场景示意图十七；
图23为本申请实施例提供的一种终端的结构示意图二；
图24为本申请实施例提供的一种终端的结构示意图三；
图25为本申请实施例提供的一种终端的结构示意图四。
具体实施方式
以下，术语“第一”、“第二”仅用于描述目的，而不能理解为指示或暗示相对重要性或者隐含指明所指示的技术特征的数量。由此，限定有“第一”、“第二”的特征可以明示或者隐含地包括一个或者更多个该特征。在本申请实施例的描述中，除非另有说明，“多个”的含义是两个或两个以上。
本申请实施例提供的一种故事相册的显示方法可以应用于手机、平板电脑、可穿戴设备、增强现实(augmented reality，AR)\虚拟现实(virtual reality，VR)设备、笔记本电脑、超级移动个人计算机(ultra-mobile personal computer，UMPC)、上网本、个人数字助理(personal digital assistant，PDA)、车载设备等具有显示功能的任意终端，本申请实施例对此不作任何限制。
如图2所示，本申请实施例中的终端可以为手机100。下面以手机100为例对实施例进行具体说明。应该理解的是，图示手机100仅是上述终端的一个范例，并且手机100可以具有比图中所示出的更多的或者更少的部件，可以组合两个或更多的部件，或者可以具有不同的部件配置。
如图2所示，手机110具体可以包括：处理器101、射频(radio frequency，RF)电路102、存储器103、触摸屏104、蓝牙装置105、一个或多个传感器106、无线保真(wireless-fidelity，Wi-Fi)装置107、定位装置108、音频电路109、外设接口110 以及电源系统111等部件。这些部件可通过一根或多根通信总线或信号线(图2中未示出)进行通信。本领域技术人员可以理解，图2中示出的硬件结构并不构成对手机的限定，手机110可以包括比图示更多或更少的部件，或者组合某些部件，或者不同的部件布置。
下面结合图2对手机110的各个部件进行具体的介绍：
处理器101是手机110的控制中心，利用各种接口和线路连接手机110的各个部分，通过运行或执行存储在存储器103内的应用程序，以及调用存储在存储器103内的数据，执行手机110的各种功能和处理数据。在一些实施例中，处理器101可包括一个或多个处理单元；举例来说，处理器101可以是华为技术有限公司制造的麒麟960芯片，也可以为高通骁龙820芯片。在本申请一些实施例中，上述处理器101还可以包括指纹验证芯片，用于对采集到的指纹进行验证。
射频电路102可用于在收发信息或通话过程中，无线信号的接收和发送。特别地，射频电路102可以将基站的下行数据接收后，给处理器101处理；另外，将涉及上行的数据发送给基站。通常，射频电路包括但不限于天线、至少一个放大器、收发信机、耦合器、低噪声放大器、双工器等。此外，射频电路102还可以通过无线通信和其他设备通信。所述无线通信可以使用任一通信标准或协议，包括但不限于全球移动通讯系统、通用分组无线服务、码分多址、宽带码分多址、长期演进、电子邮件、短消息服务等。
存储器103用于存储应用程序以及数据，处理器101通过运行存储在存储器103的应用程序以及数据，执行手机110的各种功能以及数据处理。存储器103主要包括存储程序区以及存储数据区，其中，存储程序区可存储操作系统、至少一个功能所需的应用程序(比如声音播放功能、图像播放功能等)；存储数据区可以存储根据使用手机110时所创建的数据(比如音频数据、电话本等)。此外，存储器103可以包括高速随机存取存储器(random access memory，RAM)，还可以包括非易失存储器，例如磁盘存储器件、闪存器件或其他易失性固态存储器件等。存储器103可以存储各种操作系统，例如，苹果公司所开发的iOS
Figure PCTCN2017114607-appb-000001
操作系统，谷歌公司所开发的Android
Figure PCTCN2017114607-appb-000002
操作系统等。上述存储器103可以是独立的，通过上述通信总线与处理器101相连接；存储器103也可以和处理器101集成在一起。
触摸屏104具体可以包括触控板104-1和显示器104-2。
其中，触控板104-1可采集手机110的用户在其上或附近的触摸事件(比如用户使用手指、触控笔等任何适合的物体在触控板104-1上或在触控板104-1附近的操作)，并将采集到的触摸信息发送给其他器件(例如处理器101)。其中，用户在触控板104-1附近的触摸事件可以称之为悬浮触控；悬浮触控可以是指，用户无需为了选择、移动或拖动目标(例如图标等)而直接接触触控板，而只需用户位于终端附近以便执行所想要的功能。此外，可以采用电阻式、电容式、红外线以及表面声波等多种类型来实现触控板104-1。
显示器(也可称为显示屏)104-2可用于显示由用户输入的信息或提供给用户的信息以及手机110的各种菜单。可以采用液晶显示器、有机发光二极管等形式来配置显示器104-2。触控板104-1可以覆盖在显示器104-2之上，当触控板104-1检测到在其 上或附近的触摸事件后，传送给处理器101以确定触摸事件的类型，随后处理器101可以根据触摸事件的类型在显示器104-2上提供相应的视觉输出。虽然在图2中，触控板104-1与显示屏104-2是作为两个独立的部件来实现手机110的输入和输出功能，但是在某些实施例中，可以将触控板104-1与显示屏104-2集成而实现手机110的输入和输出功能。
可以理解的是，触摸屏104是由多层的材料堆叠而成，本申请实施例中只展示出了触控板(层)和显示屏(层)，其他层在本申请实施例中不予记载。另外，触控板104-1可以以全面板的形式配置在手机110的正面，显示屏104-2也可以以全面板的形式配置在手机110的正面，这样在手机的正面就能够实现无边框的结构。
手机110还可以包括蓝牙装置105，用于实现手机110与其他短距离的终端(例如手机、智能手表等)之间的数据交换。本申请实施例中的蓝牙装置可以是集成电路或者蓝牙芯片等。
手机110还可以包括至少一种传感器106，比如指纹采集器件、光传感器、运动传感器以及其他传感器。具体地，可以在手机110的背面(例如后置摄像头的下方)配置指纹采集器件，或者在手机110的正面(例如触摸屏104的下方)配置指纹采集器件。又例如，可以在触摸屏104中配置指纹采集器件来实现指纹识别功能，即指纹采集器件可以与触摸屏104集成在一起来实现手机110的指纹识别功能；光传感器可包括环境光传感器及接近传感器，其中，环境光传感器可根据环境光线的明暗来调节触摸屏104的显示器的亮度，接近传感器可在手机110移动到耳边时，关闭显示器的电源。作为运动传感器的一种，加速计传感器可检测各个方向上(一般为三轴)加速度的大小，静止时可检测出重力的大小及方向，可用于识别手机姿态的应用(比如横竖屏切换、相关游戏、磁力计姿态校准)、振动识别相关功能(比如计步器、敲击)等；至于手机110还可配置的陀螺仪、气压计、湿度计、温度计、红外线传感器等其他传感器，在此不再赘述。
Wi-Fi装置107，用于为手机110提供遵循Wi-Fi相关标准协议的网络接入，手机110可以通过Wi-Fi装置107接入到Wi-Fi接入点，进而帮助用户收发电子邮件、浏览网页和访问流媒体等，它为用户提供了无线的宽带互联网访问。在其他一些实施例中，该Wi-Fi装置107也可以作为Wi-Fi无线接入点，可以为其他终端提供Wi-Fi网络接入。
定位装置108，用于为手机110提供地理位置。可以理解的是，该定位装置108具体可以是全球定位系统(global positioning system，GPS)或北斗卫星导航系统、俄罗斯GLONASS等定位系统的接收器。定位装置108在接收到上述定位系统发送的地理位置后，将该信息发送给处理器101进行处理，或者发送给存储器103进行保存。在另外的一些实施例中，该定位装置108还可以是辅助全球卫星定位系统(assisted global positioning system，AGPS)的接收器，AGPS系统通过作为辅助服务器来协助定位装置108完成测距和定位服务，在这种情况下，辅助定位服务器通过无线通信网络与终端例如手机110的定位装置108(即GPS接收器)通信而提供定位协助。在另外的一些实施例中，该定位装置108也可以是基于Wi-Fi接入点的定位技术。由于每一个Wi-Fi接入点都有一个全球唯一的媒体介入控制(media access control，MAC)地 址，终端在开启Wi-Fi的情况下即可扫描并收集周围的Wi-Fi接入点的广播信号，因此可以获取到Wi-Fi接入点广播出来的MAC地址；终端将这些能够标示Wi-Fi接入点的数据(例如MAC地址)通过无线通信网络发送给位置服务器，由位置服务器检索出每一个Wi-Fi接入点的地理位置，并结合Wi-Fi广播信号的强弱程度，计算出该终端的地理位置并发送到该终端的定位装置108中。
音频电路109、扬声器113、麦克风114可提供用户与手机110之间的音频接口。音频电路109可将接收到的音频数据转换后的电信号，传输到扬声器113，由扬声器113转换为声音信号输出；另一方面，麦克风114将收集的声音信号转换为电信号，由音频电路109接收后转换为音频数据，再将音频数据输出至RF电路102以发送给比如另一手机，或者将音频数据输出至存储器103以便进一步处理。
外设接口110，用于为外部的输入/输出设备(例如键盘、鼠标、外接显示器、外部存储器、用户识别模块卡等)提供各种接口。例如通过通用串行总线(universal serial bus，USB)接口与鼠标连接，通过用户识别模块卡卡槽上的金属触点与电信运营商提供的用户识别模块卡(subscriber identification module，SIM)卡进行连接。外设接口110可以被用来将上述外部的输入/输出外围设备耦接到处理器101和存储器103。
手机110还可以包括给各个部件供电的电源装置111(比如电池和电源管理芯片)，电池可以通过电源管理芯片与处理器101逻辑相连，从而通过电源装置111实现管理充电、放电、以及功耗管理等功能。
如图2所示，手机110还可以包括摄像头112，该摄像头112可以是前置摄像头也可以是后置摄像头，本申请实施例对此不做任何限制。
具体的，如图3所示，摄像头112一般包括镜头(lens)和图像传感器(sensor)，该图像传感器可以为CCD(Charge-coupled Device，电荷耦合元件)或者CMOS(Complementary Metal Oxide Semiconductor，互补金属氧化物半导体)等任意感光器件。
在拍摄过程中，景物的反射光线经过镜头后生成光学图像，该光学图像投射到图像传感器上，图像传感器将接收到的光信号转换为电信号，进而，摄像头112将得到的电信号发送至DSP(Digital Signal Processing，数字信号处理)模块进行数字信号处理，最终得到数字的数字图像。该数字图像可通过显示器104-2在手机100上输出，也可以将该数字图像存储在存储器103中。
其中，上述DSP模块可以以功能模块的形式集成在处理器101中，也可以以芯片的形式独立设置在手机100中，本申请实施例对此不做任何限制。
示例性的，DSP模块生成的数字图像可以以可交换图像文件(exchangeable image file，EXIF)格式存储在存储器103中。
如图4所示，EXIF格式的目标图像可由图像信息和EXIF信息组成。其中，该图像信息中包括目标图像内每个像素点的信息，例如像素点的灰阶值等。该图像信息的头部增加了一些有关目标图像的属性信息，例如，拍摄目标图像时的时间、地点、快门、光圈、白平衡、感光度、焦距、相机和/或镜头品牌、型号等，本申请实施例中可将其称其为EXIF信息。
具体的，处理器101指示摄像头112拍摄目标图像时，将此时终端的系统时间作 为拍摄时间，触发上述定位装置108等传感器获取此时终端的拍摄地点等EXIF信息，并将这些EXIF信息添加至目标图像的图像信息的头部，最终将目标图像的EXIF信息和图像信息保存至存储器103中。
这样，处理器101通过读取目标图像的EXIF信息，可以获取到目标图像的拍摄时间以及拍摄地点等属性信息。那么，在为用户创建故事相册时，处理器101可以读取图库中各个图像的EXIF信息，将某一时间段和/或某一地点生成的图像进行聚合，进而将聚合后的图像制作成故事相册展示给用户。
在展示制作完的故事相册时，可在其相册封面上叠加显示该故事相册内图像的拍摄时间和/或拍摄地点，方便用户选择有价值或感兴趣的故事相册观看。
但是，随着图库中图像数量的增长，单一地通过拍摄位置或拍摄时间查找故事相册中对用户有价值和感兴趣的图像将变得越来越困难。如果用户忘记了准确时间或者地点，在故事相册中搜寻特定图像就变得困难和费时，使得终端对图库的图像管理效率降低。
对此，本申请实施例提供的一种故事相册的显示方法，如图5所示，该方法包括：
S501、终端读取图库中各个图像的属性信息。
以EXIF格式的图像为例，当需要创建故事相册时，终端可读取图库中已存储的多个图像中每个图像的EXIF信息，从而从每个图像的EXIF信息中得到该图像的拍摄时间、拍摄地点等属性信息。
其中，一个故事相册的创建可以是在用户无感知的情况下由终端自动触发的，例如，终端可周期性的自动为用户创建故事相册，或者，当一段时间内图库中的图像增长数量大于预设值时，也可触发终端自动创建故事相册。
当然，一个故事相册的创建也可以是由用户手动触发的，例如，用户进入终端的图库后可选中一定数量的图像，进而触发终端根据这些图像创建故事相册。
示例性的，终端可以将图库中图像的缩略图从时间维度上展示给用户，如图6所示，在展示周六-周日这个时间段内生成的图像的缩略图时，还可以设置创建对应于周六-周日这个时间段的故事相册的快捷键601。那么，当检测到用户点击该快捷键601时，可触发终端读取周六-周日这个时间段内每一张图像的EXIF信息，得到这些图像的拍摄时间、拍摄地点等属性信息。
S502、终端按照上述属性信息将图库中的N个图像聚合为初始故事相册，此处，N＞1。
在一种可能的设计方法中，终端可根据上述属性信息中的拍摄时间，按照时间维度将图库中的N个图像聚合为初始故事相册。例如，将11月4日至11月5日生成的图像聚合为初始故事相册。
在另一种可能的设计方法中，终端还可以根据上述属性信息中的拍摄地点，按照地理位置维度将图库中的N个图像聚合为初始故事相册。例如，将在北京朝阳区内生成的图像聚合为初始故事相册；又例如，终端可以预先设置一个或多个地点的地理位置信息，例如，用户的居住地、工作地点、学校、常去场所等。那么，当终端判断出上述拍摄地点不是上述用户预先设置的地点时，用户可能在出差或旅游，因此，终端 可以将在非预先设置的地点拍摄的图像聚合为初始故事相册。
在另一种可能的设计方法中，终端可以先按照拍摄时间，将短时间内生成的多个图像聚合为多个图像集合。例如，如图7所示，终端可采用聚类算法(density-based spatial clustering of applications，DBSCAN)算法将11月4日下午拍摄的K1(K1≥1)张图像作为图像集合1，将11月4日上午拍摄的K2(K2≥1)张图像作为图像集合2，将11月3日上午拍摄的K3(K3≥1)张图像作为图像集合3。进而，终端可根据相邻两个图像集合之间的时间间隔将多个图像集合聚合为初始故事相册。
仍如图7所示，如果图像集合1与图像集合2之间的时间间隔T1小于4个小时，则终端可将图像集合1与图像集合2聚合为一个初始故事相册A。如果图像集合2与图像集合3之间的时间间隔T2也小于4个小时，则终端可继续将图像集合1、图像集合2以及图像集合3聚合为一个初始故事相册B。这样，在时间维度上终端可根据图库中图像的拍摄频率获取到待创建的初始故事相册。
进一步地，终端在根据相邻两个图像集合之间的时间间隔对上述图像集合进行聚合时，还可以根据图像集合中图像的拍摄地点调整上述时间间隔的阈值。
由于终端预先设置有用户的居住地、工作地点、学校、常去场所等地点的地理位置信息。那么，当相邻两个图像集合中图像的拍摄地均不属于上述任意预设地点时，说明用户很可能在非常驻地长途旅行，那么，终端可增加上述时间间隔进行图像集合的聚合。
如图8所示，图像集合3为终端于11月3日在上海拍摄的，图像集合2和图像集合1均为终端于11月4日在上海拍摄的，而用户预设的居住地位于北京，因此，终端可将聚合时使用的时间间隔阈值设置为2天，进而将图像集合1、图像集合2以及图像集合3聚合为一
个初始故事相册，从而保证用户在外地长途旅行时生成的图像能融合为一个相册。
又或者，终端还可以根据用户的输入操作调整上述时间间隔的阈值。示例性的，如图9所示，在制作故事相册时，终端可以以进度条的形式向用户展现图库中图像在各时间节点上的分布情况，那么，用户可以在进度条上通过手势操作(例如捏合或点按选择操作)改变初始故事相册中的图像数目。
如图9中的(a)所示，终端默认的初始故事相册中仅包括11.3-11.4这个时间段内生成的2个图像，用户通过捏合操作可扩大等待聚合的不同时间点的图像集合，即手动增加聚合时使用的时间间隔阈值，此时，如图9中的(b)所示，用户将初始故事相册中图像的时间跨度从11.3-11.4调整为10.28-11.5，同时，终端可将调整后的10.28-11.5这一时间跨度内生成的4个图像的缩略图显示在当前的显示界面中，方便用户确认调整后的时间跨度是否合适。
当然，终端也可以根据用户的输入操作选择将不同拍摄地点的图像聚合为初始故事相册。示例性的，如图10所示，在制作故事相册时，终端可以将读取到的北京市、上海市、深圳市以及西安市这4个拍摄地点作为候选选项显示在当前的显示界面中，用户可以从这些候选选项中选择一个或多个作为聚合初始故事相册时的依据。例如，用户在这4个拍摄地点中选择了北京市和深圳市，则终端可将属性信息中拍摄地点为北京市或深圳市的图像聚合为初始故事相册。
也就是说，终端在创建故事相册时，可根据图像的拍摄时间和/或拍摄地点等属性信息，在属性信息这一维度(本申请实施例中将其称为第一维度)上对图库中的图像进行理解和聚合，生成以拍摄时间和/或拍摄地点为约束条件的初始故事相册。
当然，终端根据图像的拍摄时间和/或拍摄地点聚合初始故事相册的方式可以有多种，本领域技术人员可以根据实际应用场景或实际经验对此进行设置，本申请实施例对此不作任何限制。
示例性的，终端读取图像的拍摄时间后，可进一步识别该拍摄时间是否为节假日或纪念日等特殊日子。例如，当图像1的拍摄时间为10月1日时，终端可识别出图像1的拍摄时间处于国庆节期间，那么，终端可以将10月1日-10月7日法定节假日内拍摄的N张图像聚合为初始故事相册。又例如，当图像2的拍摄时间为9月12日时，终端可识别出该图像2的拍摄时间为用户的生日，那么，终端可将图库中每一年9月12日拍摄的N张图像聚合为初始故事相册，作为用户的生日图像锦集。
终端可以从已安装的日历应用中获取上述节假日、纪念日或用户记录的生日等信息，例如，终端读取节假日日历或者生日日历中的相应日期等，此处不予赘述。
又或者，终端读取图像的拍摄地点后，如果识别出该拍摄地点为用户预先设置的地点之一，例如，图像3的拍摄地点为用户的母校，则终端可以将图库中不同时间在母校拍摄的N张图像聚合为初始故事相册，作为用户在母校的图像锦集。
可以看出，在本申请实施例中，终端读取到图像的拍摄时间和/或拍摄地点等属性信息后，可进一步对图像的属性信息进行理解，例如，识别其拍摄时间是否为特殊日子，识别其拍摄地点是否为预先设置的地点等，从而在与属性信息相关的第一维度上基于理解结果对图库中的图像进行聚合，得到初始故事相册。
需要说明的是，上述实施例中仅以拍摄时间和/或拍摄地点作为属性信息进行举例说明，可以理解的是，终端还可以根据读取到的属性信息中的其他图像属性，例如感光度、焦距以及相机品牌等将图库中的N个图像聚合为初始故事相册，本申请实施例对此不做任何限制。
S503(可选的)、终端去除上述初始故事相册中的无效图像，得到M个图像组成的目标故事相册，N≥M。
可选的，在步骤S503中，终端可对上述初始故事相册中的图像进行进一步的筛选，将相似图像或者与初始故事相册中其他图像差异较大的图像(即无效图像)去除，得到M个图像组成的目标故事相册，使得创建出的故事相册中的图像之间的关联性较强。需要说明的是，当终端确定出上述初始故事相册中不包含无效图像时，得到的目标故事相册中图像的数量M等于初始故事相册中图像的数量N。
在一种可能的设计方法中，终端可对初始故事相册中每个图像的内容进行识别，例如，通过pHash(感知哈希算法)识别任意两个图像之间的汉明距离(hamming distance)，当两个图像的汉明距离小于预设的汉明距离阈值时，可将这两个图像确定为相似图像。另外，终端还可根据图像的拍摄时间调整上述汉明距离阈值，例如，当两个图像的拍摄时间间隔较小(例如10秒内)时，出现相似图像的几率较高，因此可适当将汉明距离阈值的取值设置的大一些，而当两个图像的拍摄时间间隔较大(例如5分钟内)时，出现相似图像的几率较低，因此可适当将汉明距离阈值的取值设置的 小一些。
那么，对于识别出的多张相似图像，终端可随机从这多张相似图像中选取一张，或者通过笑脸识别、清晰度识别等算法从这多张相似图像中选择图像质量较优或者用户表情较好的图像，并将剩余的相似图像作为无效图像从上述初始故事相册中去除。
又或者，如图11所示，在创建故事相册的过程中，终端可以将识别出的多张相似图像(例如图11中的图像901-图像904)展示给用户，由用户手动选择自己喜欢的图像(例如图11中的图像901)保留在目标故事相册中，剩余的相似图像(例如图11中的图像902-图像904)作为无效图像从上述初始故事相册中去除。
在另一种可能的设计方法中，终端在存储每一张图像时均可根据其图像特征为该图像添加标签，例如，鲜花，太阳、房子、狗、羽毛球、截屏图像等。那么，在步骤S503中，终端还可以根据初始故事相册中每个图像的标签，将初始故事相册中图像标签差异较大的离群图像作为无效图像去除。
示例性的，由于故事相册一般用于记录用户的日常生活，因此，可将一些在日常生活中不常见或不需要的标签，例如，剪刀、键盘、截屏图像等作为无效标签列表预先设置在终端内。那么，终端可确定初始故事相册中每个图像的标签是否出现在上述无效标签列表中，如果某一图像的标签出现在上述无效标签列表中，则说明该图像很可能是日常生活中不常见或不需要的图像，因此，终端可将该具有无效标签的图像作为无效图像从初始故事相册中去除。
又或者，在创建故事相册的过程中，终端还可以将初始故事相册中图像的标签展示给用户，如图12所示，初始故事相册中出现频率较高的标签包括人物、羽毛球、灯、跑步以及狗，那么，可由用户手动选择自己感兴趣的标签(例如图12中人物、羽毛球以跑步这3个标签)，并将具有这3个标签的图像保留在目标故事相册中，将剩余的其他标签作为无效标签，并将具有无效标签的图像作为无效图像从上述初始故事相册中去除。
进一步地，用户手动在图12所示的候选标签中选择了需要在目标故事相册中保留的标签后，终端还可以判断用户选择保留的这些标签与终端预先设置的无效标签列表内的无效标签是否发生冲突。例如，用户在图12中选择了在目标故事相册中保留具有“羽毛球”这一标签的图像，而在无效标签列表中也包括“羽毛球”这一标签，说明终端预设的无效标签列表与用户的使用习惯不符，因此，终端可将无效标签列表中“羽毛球”这一标签删除，即后续终端可将具有“羽毛球”这一标签的图像作为有效图像保留在目标图像中。这样，终端可以根据用户的使用习惯不断修正预先设置的无效标签列表，使得无效标签列表中的无效标签与用户的使用习惯相匹配，实现创建故事相册时的定制化体验。
又或者，用户在首次使用终端，或者首次使用终端上的故事相册功能时，终端也可以将预先设置的无效标签列表展示给用户，那么，用户可以对无效标签列表中的各个无效标签进行手动的修正，例如，用户可以删除无效标签列表中自身感兴趣的标签，或者用户可以向无效标签列表中添加自身不感兴趣的标签等，使得无效标签列表中的无效标签与用户的使用习惯相匹配，实现创建故事相册时的定制化体验。
又或者，终端还可以收集用户在终端上的用户行为数据，例如，用户浏览的网页 类型，用户观看的视频类型等，进而，通过这些用户行为数据终端可识别出用户感兴趣或不感兴趣的标签。那么，终端根据识别出的用户感兴趣或不感兴趣的标签可对预先设置的无效标签列表进行修正，使得无效标签列表中的无效标签与用户的使用习惯相匹配，实现创建故事相册时的定制化体验。当然，终端还可以将上述用户行为数据发送给服务器，由服务器对这些用户行为数据进行大数据统计后，确定用户感兴趣或不感兴趣的标签，并定期将用户感兴趣或不感兴趣的标签推送给终端，以便终端对预先设置的无效标签列表进行修正。
另外，在去除具有无效标签的图像时，终端还可以进一步根据具有该无效标签的图像数量确定针对上述初始故事相册是否将该无效标签删除。例如，终端预先设置车灯为无效标签，但在上述初始故事相册中具有车灯这一标签的图像数目大于5张，则说明用户对车灯较为关注，因此，针对该初始故事相册，可将车灯这一标签从无效标签转变为有效标签，并将具有车灯这一标签的图像保留在目标故事相册中，避免从初始故事相册中误删除用户感兴趣的图像。
需要说明的是，上述实施例中均以每个图像具有一个标签，且该标签为一个关键词为例说明上述目标故事相册的生成过程。可以理解的是，每个图像可以具有多个标签，例如，图像1的标签为：人物和落叶。又或者，图像的标签还可以是对图像内容的一句或多句描述，例如，图像1的标签为：用户A在看书等，本申请实施例对此不作任何限制。
那么，当图像的标签有多个时，终端可以根据这多个标签中无效标签所占的比例确定是否将该图像作为无效图像。示例性的，图像2的标签包括：人物、剪刀、手机和门，通过与预先设置的无效图像列表对比，可确定剪刀、手机和门均为无效标签，即图像2的标签中有75％的标签为无效标签，而终端预设的比例阈值为60％，即图像的多个标签中有大于60％的标签为无效标签时可将该图像作为无效图像。显然，图像2中无效标签的比例大于比例阈值为60％，因此，终端可将图像2作为无效图像，将图像2从其所在的初始故事相册中去除。
S504、终端按照上述目标故事相册中各个图像的图像特征，确定该目标故事相册的相册主题。
在步骤S504中，终端得到目标故事相册中的M个图像后，可根据每个图像的图像特征确定整个目标故事相册的相册主题，例如，运动主题、婚礼主题、生日主题、旅游主题等。当然，终端可以对相册主题的划分粒度进行调整，例如，可将运动主题进一步划分为水上运动主题、球类运动主题等，将旅游主题进一步划分为本地游主题和外地游主题等。
由于每个图像的标签可反映出该图像的图像特征，那么，当具有某一标签的图像数量在上述M个图像中所占的比例大于预设比例时，终端可将该标签对应的主题作为目标故事相册的相册主题。例如，在目标故事相册中共包含20张图像，其中有15张图像的标签均为运动，即目标故事相册中有75％的图像均为运动标签，则终端可将运动作为目标故事相册的相册主题。
又例如，还可以预先在终端内设置不同相册主题的标签分布模型，即在某一特定相册主题下，其对应的故事相册中各个图像的标签分布情况。那么，终端可将步骤S503 中获取到的目标故事相册中各个图像的标签分布情况，与上述不同相册主题的标签分布模型进行对比，将对比结果中相似度最大的相册主题作为该目标故事相册的相册主题。
示例性的，终端可使用矩阵B表示不同相册主题的标签分布模型，如图13所示，矩阵B中的每一列的M个元素反映了一个相册主题下图像的标签分布情况，而终端可将目标故事相册中M个图像的标签通过一个一行M列的矩阵A表示，即A＝[a11a12…a1M]。那么，将矩阵A乘以矩阵
Figure PCTCN2017114607-appb-000003
后，可以得到矩阵C＝[c11c12…c1W]。
其中，仍如图13所示，矩阵C中的每一个元素用于指示目标故事相册在对应的相册主题下的场景概率。这样，终端可以将矩阵C中场景概率最高的元素所对应的相册主题作为目标故事相册的相册主题。
另外，终端还可以通过朴素贝叶斯分类器等分类模型对上述标签分布模型(即矩阵B)进行修正，以提高相册主题识别的准确率。当然，终端也可以根据用户手动对相册主题的修改，对上述标签分布模型(即矩阵B)进行修正，本申请实施例对此不作任何限制。
当然，本申请实施例中对相册主题的具体识别方法不做限定。例如，终端可以统计目标故事相册中各个图像标签的出现频率，进而将出现频率最高的标签所对应的相册主题作为目标故事相册的相册主题。
又或者，当目标故事相册中图像的标签包括对图像内容的句段描述时，终端还可以通过语义分析识别出各个标签中出现的高频词汇，例如，目标故事相册的10个图像中有8个图像的标签中都出现了“生日”一词，则终端可将“生日”这一高频词汇作为该目标故事相册的相册主题。
进一步地，终端内还可以预先设置与不同高频词汇相关联的相册主题，例如，当标签中的高频词汇包括蛋糕、蜡烛或者礼物时，与其关联的相册主题为：生日；当标签中的高频词汇包括戒指、婚纱或者手捧花时，与其关联的相册主题为：婚礼。那么，当终端通过语义分析识别出了标签中的高频词汇后，可进一步根据上述关联关系确定与高频词汇关联的相册主题。
一般，终端识别出的相册主题具体可以包括：生日、聚会、婚礼、运动、毕业、节假日、夜景、本地游以及外地游中的至少一项，本申请实施例对此不做任何限制。
示例性的，当目标故事相册中图像的拍摄地点为预先设置的地点，例如用户的常驻地时，如果识别到图像中包含风景和人脸时，目标故事相册的主题可以为本地游；当目标故事相册中图像的拍摄地点为用户的非常驻地时，如果识别到图像中包含风景、人脸或地标建筑时，终端结合拍摄地点与用户常驻地的距离，可将目标故事相册的主题设置为周边游、短途游或者远途游；当识别出目标故事相册中的图像为夜景时，可将目标故事相册的主题设置为夜游；当识别出目标故事相册中的图像包含蛋糕时，可将目标故事相册的主题设置为生日；当识别出目标故事相册中的图像包含美食和人脸时，可将目标故事相册的主题设置为聚会；当识别出目标故事相册中的图像包含打篮球或打羽毛球时，可将目标故事相册的主题设置为运动；当识别出目标故事相册中的图像包含婚纱时，可将目标故事相册的主题设置为婚礼。
也就是说，在终端基于图像的属性信息这一第一维度处理得到的初始故事相册(或目标故事相册)的基础上，终端可进一步根据各图像的具体图像特征识别该初始故事相册(或目标故事相册)的主题场景，即在图像特征这一维度(本申请实施例中将其称为第二维度)上对初始故事相册(或目标故事相册)中的图像内容进行识别，从而确定故事相册的主题场景，使得终端在创建故事相册时实现了对图像的多维理解，这样终端可以识别出的主题场景为中心聚合生成主题性鲜明的故事相册，提高终端对图库中图像的管理效率。
S505(可选的)、终端从目标应用中获取与上述目标故事相册关联的关联信息。
S506(可选的)、终端根据上述关联信息修正上述相册主题。
在步骤S505中，终端还可以从备忘录、日历、邮件、记事本、电话、短信以及联系人等涉及用户日程安排的目标应用中获取与上述目标故事相册关联的关联信息。例如，目标故事相册的拍摄时间为11月4日，那么，终端可以读取11月4日的备忘录，确定11月4日为妈妈生日这一关联信息。
这样，在步骤S506中，终端可以在关联信息这一与目标应用关联的维度(本申请实施例中将其称为第三维度)上，对上述目标故事相册的相册主题进行进一步的处理，从而对步骤S504中确定的相册主题进行修正。
例如，步骤S504中确定的相册主题为“聚会”，而终端通过备忘录中的备忘信息或日历中的日程信息，可获取到与目标故事相册关联的关联信息为：妈妈的生日，则终端可以确定该目标故事相册中记录的是妈妈过生日的图像，那么，终端可将目标故事相册的主题修正为“妈妈的生日聚会”。
又例如，步骤S504中确定的相册主题为“美食”，而终端通过短信中的短信内容或日历中的日程信息，可获取到与目标故事相册关联的关联信息为：与男友约会，则终端可以确定该目标故事相册中记录的是与男友约会时美食的图像，那么，终端可将目标故事相册的主题修正为“约会和美食”。
可以看出，本申请实施例中终端可在图像的属性信息、图像的图像特征，以及与图像关联的目标应用中记录的关联信息这三个维度上，对图库中的图像进行处理，以识别出图库中图像的主题场景，从而将主题性较强的图像聚合为故事相册，创建用户更加感兴趣或价值更高的主题性故事相册。
当然，终端也可以直接根据用户在目标应用中输入的日程信息，确定与该日程信息关联的一张或多张图像，进而将这一张或多张图像聚合为目标故事相册。例如，用户在日历应用的9月12日这一天输入的日程为：取蛋糕，那么，终端读取到这一日程信息后，可将9月12日拍摄的照片聚合为目标故事相册。
那么，在显示该目标故事相册时，终端可将目标故事相册的标题设置为与“取蛋糕”这一日程信息关联的标题，例如“生日”、“生日快乐”等，创建用户更加感兴趣或价值更高的主题性故事相册。
S507、终端在上述目标故事相册的相册封面上叠加显示用于反映其相册主题的标题。
也就是说，在相册封面上叠加显示的目标故事相册的标题是与上述实施例中识别出的相册主题相关联的。例如，终端识别出的相册主题为“生日”，则可将“生日” 作为目标故事相册的标题显示在相册封面上，即目标故事相册的标题与识别出的相册主题相同；当然，目标故事相册的标题也可以是与“生日”含义相似或相关的其他描述，本申请实施例对此不做任何限制。
示例性的，对于不同的主题，终端可预先设置一些对应的候选标题，例如，对于生日主题可预先设置“温馨的生日”、“生日party”、“开心过生日”以及“又长大了一岁”这四个候选标题。进而，终端可从这些候选标题中选择一个用于生成目标故事相册的标题。例如，当目标故事相册的相册主题为妈妈生日时，终端可选择“生日派对”这一候选标题，生成“妈妈的生日party”作为目标故事相册的标题。
此时，如图14所示，终端可在创建好的目标故事相册中选择一张或多张图像作为该目标故事相册的相册封面1201，并在相册封面1201上叠加显示“妈妈的生日party”这一标题1202。终端在显示故事相册的标题时，可以随机选择字体和字号来显示，从而增加故事相册的趣味性。
另外，当终端通过上述步骤S501-S507生成目标故事相册，并确定出目标故事相册的标题后，如图15所示，终端还可以向用户确认是否使用该标题。此时，如果用户修改该标题，则终端将用户修改后的标题叠加显示在相册封面上。例如，用户将终端确定的“妈妈的生日party”这一标题修改为“生日狂欢”，那么，终端最终在相册封面1201上叠加显示的标题1202为“生日狂欢”。
同时，终端可以将用户输入的“生日狂欢”这一标题作为“生日”这一相册主题的一个候选标题进行保存，后续当终端再次识别出创建的故事相册的相册主题为生日时，终端可优选选择用户曾经设置的“生日狂欢”这一候选标题作为该故事相册的标题。
当然，仍如图14所示，终端还可以在目标故事相册的标题1202中增加拍摄时间和/或拍摄地点的相关信息，使得用户可以根据相册主题、拍摄时间或拍摄地点中的至少一项快速锁定自己感兴趣的故事相册。
上述实施例中仅以生日主题为例阐述本申请实施例提供的故事相册的显示方法，可以理解的是，当终端通过对图像的多维理解生成其他主题的故事相册时，均可按照上述方法在故事相册的相册封面中叠加显示与相册主题对应的标题。
示例性的，如图14所示，当终端识别出相册A的主题为婚礼主题时，可在相册A的相册封面上添加与婚礼主题对应的“幸福时刻”这一标题；当终端识别出相册B的主题为运动主题时，可在相册B的相册封面上添加与运动主题对应的“爱运动”这一标题；当终端识别出相册D的主题为毕业主题时，可在相册D的相册封面上添加与毕业主题对应的“毕业季”这一标题；当终端识别出相册E的拍摄时间为五一劳动节时，终端可结合拍摄地点拉萨在相册E的相册封面上添加对应的“劳动节在拉萨”这一标题。
相应的，如果终端没有识别出故事相册的相册主题，则如图16中的相册C和相册F所示，终端可将读取到的该相册的拍摄时间和/或拍摄地点作为标题添加至故事相册的相册封面上，本申请实施例对此不做任何限制。
S508(可选的)、终端播放上述目标故事相册。
示例性的，当终端进入如图14或图16所示的故事相册功能的预览界面时，便可 触发终端自动开始播放预览界面中的各个故事相册。如图16所示，终端可以依次播放相册A至相册F，也可以根据用户浏览该预览界面时的滑动操作自动播放位于显示界面某一位置(例如左上角)处显示的相册。
又或者，用户还可根据各个故事相册的标题点击自己感兴趣的故事相册，此时，如果终端检测到用户针对上述目标故事相册的输入操作，则终端可跳转至播放界面，将上述目标故事相册中的图像以短视频的形式播放给用户。
在本申请实施例中，终端在播放目标故事相册中的各个图像时，还可以在一张或多张图像上显示该图像的拍摄时间、拍摄地点或者图像主题等信息。如图17中的(a)所示，终端在播放标题为“妈妈的生日”这一故事相册中的图像A时，可在图像A上叠加显示图像A的拍摄时间和拍摄地点为“2016-11-4，杭州”，当终端播放至该故事相册中的图像B时，如图17中的(b)所示，终端可在图像B上叠加显示图像B的拍摄时间和拍摄地点为“2017-11-4，北京”，从而在播放故事相册的过程中帮助用户快速回忆与当前的播放图像相关的信息，提高了用户使用故事相册时的使用体验。
当然，终端播放上述目标故事相册时的播放效果(例如，音乐背景、画面特效、滤镜，剪辑顺序等)也可以与识别出的相册主题关联。例如，当识别出目标故事相册的相册主题为“生日”时，可在播放该目标故事相册时使用生日快乐歌作为音乐背景；当识别出目标故事相册的相册主题为“旧时光”时，可在播放该目标故事相册时对目标故事相册中的图像叠加做旧的滤镜等。此外，播放效果还可以由用户确定。
其中，终端在图像A(或图像B)上叠加显示拍摄时间和拍摄地点时，可避开图像A(或图像B)中的视觉显著区域(例如包含人脸、对比度较强或者轮廓线条较多的区域)，将叠加显示的显示元素(即上述拍摄时间和拍摄地点)布局在非视觉显著区域中显示，避免显示元素与图像A(或图像B)产生视觉冲突。
当然，在相册封面1101上叠加显示标题1102时，终端也可将标题1102布局在相册封面1101的非视觉显著区域，本申请实施例对此不做任何限制。
另外，当上述目标故事相册创建完成之后，用户还可以对目标故事相册中的图像进行调整，例如，向目标故事相册中添加新的图像，将目标故事相册中已有的图像删除，修改目标故事相册中某一图像的标签等。如图18所示，当用户手动调整目标故事相册中的图像时，终端可根据调整后的目标故事相册，对图13所示的标签分布模型(即矩阵B)进行修正，例如，目标故事相册为婚礼主题，用户向目标故事相册中添加了新的图像时，终端可根据添加的图像修改矩阵B中用于指示婚礼主题的列向量，以提高后续终端对婚礼主题的识别准确率。
在本申请的另一些实施例中，终端还可以提供用户手动创建故事相册的功能。具体的，终端可根据用户手动选择的拍摄时间、拍摄地点、图像内容以及相册主题(例如，生日、聚会、婚礼、运动、毕业、节假日、夜景、本地游以及外地游)等条件，在图库中将满足上述条件的图像聚合为故事相册，从而为用户定制满足用户期望的故事相册。
示例性的，如图19中的(a)所示，终端可以在故事相册的显示界面中设置用于创建新故事相册的快捷方式191。当终端检测到用户触发该快捷方式191时，如图19 中的(b)所示，终端可以为用户提供一个或多个相册主题供用户选择，例如，生日、聚会、婚礼、运动、毕业、节假日、夜景、本地游以及外地游等。
以用户选择“生日”这一相册主题为例，终端检测到用户输入的相册主题为“婚礼”时，可将图库中与“生日”相关的N个图像聚合为初始故事相册。例如，终端可以将图像的标签为生日或蛋糕的图像聚合为初始故事相册。又例如，与上述矩阵B中各个预设主题的标签分布对应的，终端可以将与预设的“生日”主题的标签分布相同或相似的一组图像聚合为初始故事相册。
进一步地，如图20中的(a)所示，终端可提示用户选择某一时间跨度内的图像制作该“生日”主题的故事相册；又例如，如图20中的(b)所示，终端可提示用户选择在一个或多个拍摄地点拍摄的图像制作该“生日”主题的故事相册。
那么，终端可以根据用户选择的时间跨度和/或拍摄地点对初始故事相册中的N个图像进行筛选。例如，用户选择使用2014.11-2017.11内拍摄地点为北京和上海的图像制作上述“生日”主题的故事相册，那么，终端可以将拍摄时间在2014.11-2017.11以外的图像，以及拍摄地点不是北京和上海的图像从上述初始故事相册中去除，得到M个图像组成的目标故事相册。
后续，终端仍可沿用上述步骤S507-S508的方法在目标故事相册的相册封面上显示与“生日”主题相关的标题，并播放该目标故事相册。
当然，终端在生成上述目标故事相册中的M个图像时，还可以考虑人物、图像数量、相册播放时长等因素。例如，如图21中的(a)所示，终端可以对初始故事相册中的每个图像进行人脸检测，将检测到的一个或多个人脸提示给用户，这样，终端可以根据后续用户选择的目标人脸，将初始故事相册中不包括该目标人脸的图像去除，得到目标故事相册。又例如，如图21中的(b)所示，终端可以提示用户设置目标故事相册的播放时长或者图像数量，这样，终端可以根据后续用户设置的目标播放时长或者目标图像数量将多余的图像从初始故事相册中去除，得到目标故事相册。
另外，当终端检测到用户触发上述快捷方式191时，终端也可以先提示用户从识别出的多个人脸中选择目标人脸，进而将图库中包含目标人脸的图像聚合为初始故事相册，后续，终端可根据用户输入的相册主题、拍摄时间、以及拍摄地点中的一个或多个因素生成目标故事相册。
也就是说，终端可以提示用户选择故事相册的相册主题、包含的人物、拍摄时间、拍摄地点、图像数量等一项或多项条件，并根据用户选择的条件筛选相关的图像，从而创建符合用户期望的故事相册。
另外，当终端创建完成上述目标故事相册后，如图22中的(a)所示，还可以在故事相册的显示界面中提供分享故事相册的分享快捷键221，用户触发该分享快捷键221后，如图22中的(b)所示，用户可进一步选择将已创建的一个或多个故事相册分享至其他应用或其他终端，本申请实施例对此不做任何限制。
可以理解的是，上述终端等为了实现上述功能，其包含了执行各个功能相应的硬件结构和/或软件模块。本领域技术人员应该很容易意识到，结合本文中所公开的实施例描述的各示例的单元及算法步骤，本申请实施例能够以硬件或硬件和计算机软件的 结合形式来实现。某个功能究竟以硬件还是计算机软件驱动硬件的方式来执行，取决于技术方案的特定应用和设计约束条件。专业技术人员可以对每个特定的应用来使用不同方法来实现所描述的功能，但是这种实现不应认为超出本申请实施例的范围。
本申请实施例可以根据上述方法示例对上述终端等进行功能模块的划分，例如，可以对应各个功能划分各个功能模块，也可以将两个或两个以上的功能集成在一个处理模块中。上述集成的模块既可以采用硬件的形式实现，也可以采用软件功能模块的形式实现。需要说明的是，本申请实施例中对模块的划分是示意性的，仅仅为一种逻辑功能划分，实际实现时可以有另外的划分方式。
在采用对应各个功能划分各个功能模块的情况下，图23示出了上述实施例中所涉及的终端的一种可能的结构示意图，该终端包括：获取单元2301、聚合单元2302、去除单元2303、确定单元2304、修正单元2305以及显示单元2306。
获取单元2301用于支持终端执行图5中的过程501和505；聚合单元2302用于支持终端执行图5中的过程502；去除单元2303用于支持终端执行图5中的过程503；确定单元2304用于支持终端执行图5中的过程504；修正单元2305用于支持终端执行图5中的过程506；显示单元2306用于支持终端执行图5中的过程507-508。其中，上述方法实施例涉及的各步骤的所有相关内容均可以援引到对应功能模块的功能描述，在此不再赘述。
在采用集成的单元的情况下，可将上述聚合单元2302、去除单元2303、确定单元2304以及修正单元2305集成为处理模块，将获取单元2301作为输入模块，将显示单元2306作为显示模块。当然，终端还可以包括存储模块。
此时，如图24所示，示出了上述实施例中所涉及的终端的一种可能的结构示意图。其中，处理模块2402用于对终端的动作进行控制管理。输入模块2403用于支持接收用户输入的信息。存储模块2401用于保存终端的程序代码和数据。显示模块2404用于显示由用户输入的信息或提供给用户的信息以及终端的各种菜单。
示例性的，处理模块2402可以是处理器或控制器，例如可以是中央处理器(Central Processing Unit，CPU)，GPU，通用处理器，数字信号处理器(Digital Signal Processor，DSP)，专用集成电路(Application-Specific Integrated Circuit，ASIC)，现场可编程门阵列(Field Programmable Gate Array，FPGA)或者其他可编程逻辑器件、晶体管逻辑器件、硬件部件或者其任意组合。其可以实现或执行结合本申请公开内容所描述的各种示例性的逻辑方框，模块和电路。所述处理器也可以是实现计算功能的组合，例如包含一个或多个微处理器组合，DSP和微处理器的组合等等。
输入模块2403可以是触摸屏、麦克风等用于接收用户输入的信息的器件。
存储模块2401可以是存储器，该存储器可以包括高速随机存取存储器(RAM)，还可以包括非易失存储器，例如磁盘存储器件、闪存器件或其他易失性固态存储器件等。
显示模块2404可以为显示器，具体可以采用液晶显示器、有机发光二极管等形式来配置显示器。另外，显示器上还可以集成触控板，用于采集在其上或附近的触摸事件，并将采集到的触摸信息发送给其他器件(例如处理器等)。
当处理模块2402为处理器，输入模块2403为触控板，存储模块2401为存储器， 显示模块2404为显示器时，本申请实施例所提供的终端结构如图25所示。
在一种可能的设计方法中，存储器2501中存储有至少N(N＞1)个图像，处理器2502可按照第一维度聚合存储器2501中的N个图像，所述第一维度包括拍摄时间和/或拍摄地点；进而，处理器2502可指示显示器2504显示故事相册的相册封面，所述故事相册包括所述N个图像中的M(M＜N)个图像，所述M个图像与所述故事相册的主题相关联。
进一步地，在处理器2502按照第一维度聚合图库中的N个图像之后，处理器2502还可去除所述N个图像中的无效图像，得到M个图像组成的所述故事相册，所述无效图像包括具有无效标签的图像或图像相似度大于阈值的一个或多个图像。
进一步地，在处理器2502去除所述N个图像中的无效图像，得到M个图像组成的所述故事相册之后，处理器2502还可按照第二维度确定与所述M个图像相关联的主题，得到所述故事相册的主题，所述第二维度包括所述M个图像中至少一个图像的图像特征。
进一步地，在处理器2502按照第二维度确定与所述M个图像相关联的主题，得到所述故事相册的主题之后，处理器2502还可按照第三维度对所述故事相册的主题进行修正，所述第三维度包括目标应用中与所述故事相册的主题相关联的关联信息。
进一步地，上述第一维度中包括拍摄时间，那么，处理器2502按照第一维度聚合图库中的N个图像，具体包括：处理器2502将Z(Z≥2)个时间段中每个时间段内生成的图像聚合为一个图像集合，得到Z个图像集合，所述Z个图像集合与所述Z个时间段一一对应；当相邻图像集合之间的时间间隔小于间隔阈值时，处理器2502将该相邻图像集合进行聚合。
进一步地，处理器2502按照第二维度确定与所述M个图像相关联的主题，得到所述故事相册的主题，具体包括：处理器2502对比所述M个图像的标签分布情况与预先设置的每一个候选主题的标签分布情况；当所述M个图像的标签分布情况符合第一候选主题的标签分布情况时，处理器2502将第一候选主题确定为所述故事相册的主题。
进一步地，处理器2502去除所述N个图像中的无效图像，具体包括：显示器2504显示从上述N个图像中识别出的X(X≥2)个相似度大于阈值的图像；触控板2503接收用户从所述X个图像中选择的目标图像，那么，响应于用户从所述X个图像中选择的目标图像，处理器2502将所述目标图像保留在所述故事相册中，并将所述X个图像中除所述目标图像外的其余图像去除。
进一步地，处理器2502去除所述故事相册中的无效图像，具体包括：显示器2504显示从上述述N个图像中识别出的Y(Y≥2)个标签，每个图像的标签用于反映该图像的图像特征；触控板2503接收用户从所述Y个标签中选择的目标标签；响应于用户从所述Y个标签中选择的目标标签，处理器2502将具有所述目标标签的图像保留在所述故事相册中，将不具有所述目标标签的图像去除。
进一步地，在显示器2504显示故事相册的相册封面之后，显示器2504还可播放所述故事相册，其中，在播放所述故事相册中的第一图像时，所述终端显示所述第一图像的拍摄时间和/或拍摄地点。
进一步地，上述第一维度还可以包括所述故事相册中出现的人物、所述故事相册的播放时长、所述故事相册中的图像数量以及所述故事相册的主题中的至少一项；此时，在处理器2502按照第一维度聚合图库中的N个图像之前，触控板2503还可接收用户对待创建的故事相册输入的目标时间段、目标拍摄地点、目标人物、目标播放时长、目标图像数量以及目标主题中的至少一项。
在另一种可能的设计方法中，存储器2501中存储有至少N(N＞1)个图像，触控板2503可接收到用户在目标应用(例如，备忘录、日历、邮件、记事本、电话、短信以及联系人等)中输入的日程信息；进而，处理器2502将存储器2501中的N个图像创建为故事相册；并指示显示器2504显示所述故事相册的相册封面，所述相册封面上包括所述故事相册的标题，所述标题与所述日程信息相关联。
在上述实施例中，可以全部或部分的通过软件，硬件，固件或者其任意组合来实现。当使用软件程序实现时，可以全部或部分地以计算机程序产品的形式出现。所述计算机程序产品包括一个或多个计算机指令。在计算机上加载和执行所述计算机程序指令时，全部或部分地产生按照本申请实施例所述的流程或功能。所述计算机可以是通用计算机、专用计算机、计算机网络、或者其他可编程装置。所述计算机指令可以存储在计算机可读存储介质中，或者从一个计算机可读存储介质向另一个计算机可读存储介质传输，例如，所述计算机指令可以从一个网站站点、计算机、服务器或数据中心通过有线(例如同轴电缆、光纤、数字用户线(DSL))或无线(例如红外、无线、微波等)方式向另一个网站站点、计算机、服务器或数据中心传输。所述计算机可读存储介质可以是计算机能够存取的任何可用介质或者是包含一个或多个可用介质集成的服务器、数据中心等数据存储设备。该可用介质可以是磁性介质，(例如，软盘，硬盘、磁带)、光介质(例如，DVD)或者半导体介质(例如固态硬盘Solid State Disk(SSD))等。
以上所述，仅为本申请的具体实施方式，但本申请的保护范围并不局限于此，任何在本申请揭露的技术范围内的变化或替换，都应涵盖在本申请的保护范围之内。因此，本申请的保护范围应以所述权利要求的保护范围为准。

Claims (30)

  1. 一种故事相册的显示方法，其特征在于，包括：
    终端按照第一维度聚合图库中的N个图像，所述第一维度包括拍摄时间和/或拍摄地点，N＞1；
    所述终端显示故事相册的相册封面，所述故事相册包括所述N个图像中的M个图像，所述M个图像与所述故事相册的主题相关联，M＜N。
  2. 根据权利要求1所述的方法，其特征在于，所述故事相册的主题包括生日、聚会、婚礼、运动、毕业、节假日、夜景、本地游以及外地游中的至少一项。
  3. 根据权利要求1或2所述的方法，其特征在于，所述相册封面上包括所述故事相册的标题，所述标题与所述故事相册的主题、所述N个图像的拍摄时间和所述N个图像的拍摄地点中的至少一个相关联。
  4. 根据权利要求1-3中任一项所述的方法，其特征在于，在终端按照第一维度聚合图库中的N个图像之后，还包括：
    所述终端去除所述N个图像中的无效图像，得到M个图像组成的所述故事相册，所述无效图像包括具有无效标签的图像或图像相似度大于阈值的一个或多个图像。
  5. 根据权利要求4所述的方法，其特征在于，在所述终端去除所述N个图像中的无效图像，得到M个图像组成的所述故事相册之后，还包括：
    所述终端按照第二维度确定与所述M个图像相关联的主题，得到所述故事相册的主题，所述第二维度包括所述M个图像中至少一个图像的图像特征。
  6. 根据权利要求5所述的方法，其特征在于，在所述终端按照第二维度确定与所述M个图像相关联的主题，得到所述故事相册的主题之后，还包括：
    所述终端按照第三维度对所述故事相册的主题进行修正，所述第三维度包括目标应用中与所述故事相册的主题相关联的关联信息。
  7. 根据权利要求1-6中任一项所述的方法，其特征在于，所述第一维度中包括拍摄时间，
    其中，终端按照第一维度聚合图库中的N个图像，包括：
    所述终端将Z个时间段中每个时间段内生成的图像聚合为一个图像集合，得到Z个图像集合，所述Z个图像集合与所述Z个时间段一一对应，Z≥2；
    当相邻图像集合之间的时间间隔小于间隔阈值时，所述终端将该相邻图像集合进行聚合。
  8. 根据权利要求7所述的方法，其特征在于，所述第一维度中还包括拍摄地点，其中，当相邻图像集合的拍摄地点均不是预先设置的地点时，所述间隔阈值为第一预设值；当相邻图像集合的拍摄地点均为预先设置的地点时，所述间隔阈值为第二预设值，所述第二预设值小于所述第一预设值。
  9. 根据权利要求5-8中任一项所述的方法，其特征在于，所述终端按照第二维度确定与所述M个图像相关联的主题，得到所述故事相册的主题，包括：
    所述终端对比所述M个图像的标签分布情况与预先设置的每一个候选主题的标签分布情况；
    当所述M个图像的标签分布情况符合第一候选主题的标签分布情况时，所述终端将所述第一候选主题确定为所述故事相册的主题。
  10. 根据权利要求4-9中任一项所述的方法，其特征在于，所述终端去除所述N个图像中的无效图像，包括：
    所述终端显示从所述N个图像中识别出的X个相似度大于阈值的图像，X≥2；
    响应于用户从所述X个图像中选择的目标图像，所述终端将所述目标图像保留在所述故事相册中，并将所述X个图像中除所述目标图像外的其余图像去除。
  11. 根据权利要求4-10中任一项所述的方法，其特征在于，所述终端去除所述故事相册中的无效图像，包括：
    所述终端显示从所述N个图像中识别出的Y个标签，每个图像的标签用于反映该图像的图像特征，Y≥2；
    响应于用户从所述Y个标签中选择的目标标签，所述终端将具有所述目标标签的图像保留在所述故事相册中，将不具有所述目标标签的图像去除。
  12. 根据权利要求1-11中任一项所述的方法，其特征在于，在所述终端显示故事相册的相册封面之后，还包括：
    所述终端播放所述故事相册，其中，在播放所述故事相册中的第一图像时，所述终端显示所述第一图像的拍摄时间和/或拍摄地点。
  13. 根据权利要求1-12中任一项所述的方法，其特征在于，所述第一维度还包括所述故事相册中出现的人物、所述故事相册的播放时长、所述故事相册中的图像数量以及所述故事相册的主题中的至少一项；
    其中，在终端按照第一维度聚合图库中的N个图像之前，还包括：
    所述终端接收用户对待创建的故事相册输入的目标时间段、目标拍摄地点、目标人物、目标播放时长、目标图像数量以及目标主题中的至少一项。
  14. 一种故事相册的显示方法，其特征在于，包括：
    终端接收用户在目标应用中输入的日程信息；
    所述终端将图库中的N个图像创建为故事相册，其中，N＞1；
    所述终端显示所述故事相册的相册封面，所述相册封面上包括所述故事相册的标题，所述标题与所述日程信息相关联。
  15. 根据权利要求14所述的方法，其特征在于，所述目标应用包括：备忘录、日历、邮件、记事本、电话、短信以及联系人中的至少一个。
  16. 一种终端，其特征在于，包括：
    聚合单元，用于按照第一维度聚合图库中的N个图像，所述第一维度包括拍摄时间和/或拍摄地点，N＞1；
    显示单元，用于显示故事相册的相册封面，所述故事相册包括所述N个图像中的M个图像，所述M个图像与所述故事相册的主题相关联，M＜N。
  17. 根据权利要求16所述的终端，其特征在于，还包括：
    去除单元，用于去除所述N个图像中的无效图像，得到M个图像组成的所述故事相册，所述无效图像包括具有无效标签的图像或图像相似度大于阈值的一个或多个图像。
  18. 根据权利要求17所述的终端，其特征在于，还包括：
    确定单元，用于按照第二维度确定与所述M个图像相关联的主题，得到所述故事相册的主题，所述第二维度包括所述M个图像中至少一个图像的图像特征。
  19. 根据权利要求18所述的终端，其特征在于，还包括：
    修正单元，用于按照第三维度对所述故事相册的主题进行修正，所述第三维度包括目标应用中与所述故事相册的主题相关联的关联信息。
  20. 根据权利要求16-19中任一项所述的终端，其特征在于，所述第一维度中包括拍摄时间，
    所述聚合单元，具体用于：将Z个时间段中每个时间段内生成的图像聚合为一个 图像集合，得到Z个图像集合，所述Z个图像集合与所述Z个时间段一一对应，Z≥2；当相邻图像集合之间的时间间隔小于间隔阈值时，将该相邻图像集合进行聚合。
  21. 根据权利要求20所述的终端，其特征在于，所述第一维度中还包括拍摄地点，其中，当相邻图像集合的拍摄地点均不是预先设置的地点时，所述间隔阈值为第一预设值；当相邻图像集合的拍摄地点均为预先设置的地点时，所述间隔阈值为第二预设值，所述第二预设值小于所述第一预设值。
  22. 根据权利要求18-21中任一项所述的终端，其特征在于，
    所述确定单元，具体用于：对比所述M个图像的标签分布情况与预先设置的每一个候选主题的标签分布情况；当所述M个图像的标签分布情况符合第一候选主题的标签分布情况时，将所述第一候选主题确定为所述故事相册的主题。
  23. 根据权利要求17-22中任一项所述的终端，其特征在于，
    所述显示单元，还用于显示从所述N个图像中识别出的X个相似度大于阈值的图像，X≥2；
    所述去除单元，具体用于：响应于用户从所述X个图像中选择的目标图像，将所述目标图像保留在所述故事相册中，并将所述X个图像中除所述目标图像外的其余图像去除。
  24. 根据权利要求17-23中任一项所述的终端，其特征在于，
    所述显示单元，还用于显示从所述N个图像中识别出的Y个标签，每个图像的标签用于反映该图像的图像特征，Y≥2；
    所述去除单元，具体用于：响应于用户从所述Y个标签中选择的目标标签，将具有所述目标标签的图像保留在所述故事相册中，将不具有所述目标标签的图像去除。
  25. 根据权利要求16-24中任一项所述的终端，其特征在于，
    所述显示单元，还用于播放所述故事相册，其中，在播放所述故事相册中的第一图像时，所述终端显示所述第一图像的拍摄时间和/或拍摄地点。
  26. 根据权利要求16-25中任一项所述的终端，其特征在于，所述第一维度还包括所述故事相册中出现的人物、所述故事相册的播放时长、所述故事相册中的图像数量以及所述故事相册的主题中的至少一项；所述终端还包括：
    获取单元，用于接收用户对待创建的故事相册输入的目标时间段、目标拍摄地点、目标人物、目标播放时长、目标图像数量以及目标主题中的至少一项。
  27. 一种终端，其特征在于，包括：
    获取单元，用于接收用户在目标应用中输入的日程信息；
    创建单元，用于将图库中的N个图像创建为故事相册，其中，N＞1；
    显示单元，用于显示所述故事相册的相册封面，所述相册封面上包括所述故事相册的标题，所述标题与所述日程信息相关联。
  28. 一种终端，其特征在于，包括：处理器、显示器、存储器、总线和通信接口；
    所述存储器用于存储计算机执行指令，所述处理器与所述存储器通过所述总线连接，当所述终端运行时，所述处理器执行所述存储器存储的所述计算机执行指令，以使所述终端执行如权利要求1-13或14-15中任一项所述的故事相册的显示方法。
  29. 一种计算机可读存储介质，所述计算机可读存储介质中存储有指令，其特征在于，当所述指令在终端上运行时，使得所述终端执行如权利要求1-13或14-15中任一项所述的故事相册的显示方法。
  30. 一种包含指令的计算机程序产品，其特征在于，当所述计算机程序产品在终端上运行时，使得所述终端执行如权利要求1-13或14-15中任一项所述的故事相册的显示方法。
PCT/CN2017/114607 2017-12-05 2017-12-05 一种故事相册的显示方法及装置 WO2019109245A1 (zh)

Priority Applications (4)

Application Number Priority Date Filing Date Title
PCT/CN2017/114607 WO2019109245A1 (zh) 2017-12-05 2017-12-05 一种故事相册的显示方法及装置
US16/769,849 US11386140B2 (en) 2017-12-05 2017-12-05 Story album display method and apparatus
CN201780003499.3A CN108235765B (zh) 2017-12-05 2017-12-05 一种故事相册的显示方法及装置
EP17933949.4A EP3706015A4 (en) 2017-12-05 2017-12-05 METHOD AND DEVICE FOR DISPLAYING A STORY ALBUM

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/CN2017/114607 WO2019109245A1 (zh) 2017-12-05 2017-12-05 一种故事相册的显示方法及装置

Publications (1)

Publication Number Publication Date
WO2019109245A1 true WO2019109245A1 (zh) 2019-06-13

Family

ID=62645523

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2017/114607 WO2019109245A1 (zh) 2017-12-05 2017-12-05 一种故事相册的显示方法及装置

Country Status (4)

Country Link
US (1) US11386140B2 (zh)
EP (1) EP3706015A4 (zh)
CN (1) CN108235765B (zh)
WO (1) WO2019109245A1 (zh)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110377378A (zh) * 2019-06-18 2019-10-25 平安科技（深圳）有限公司 图片悬浮显示方法、装置、终端和存储介质

Families Citing this family (16)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US10891526B2 (en) * 2017-12-22 2021-01-12 Google Llc Functional image archiving
CN111566639A (zh) * 2018-02-09 2020-08-21 华为技术有限公司 一种图像分类方法及设备
CN109033273A (zh) * 2018-07-10 2018-12-18 Oppo广东移动通信有限公司 播放帧数设置方法及相关设备
CN110162643B (zh) * 2018-09-13 2023-08-25 腾讯科技（深圳）有限公司 电子相册报告生成方法、装置及存储介质
JP7053422B2 (ja) * 2018-09-19 2022-04-12 富士フイルム株式会社 画像処理装置，画像処理方法および画像処理プログラム
CN109409423A (zh) * 2018-10-15 2019-03-01 珠海格力电器股份有限公司 一种图像识别方法、装置、终端及可读存储介质
CN109543639B (zh) * 2018-11-29 2021-12-24 上海芯爱智能科技有限公司 一种信息显示方法、系统、服务器和存储介质
CN109902759B (zh) * 2019-03-12 2021-03-30 恒睿(重庆)人工智能技术研究院有限公司 图片集描述方法及装置
CN110032700B (zh) * 2019-04-04 2021-09-07 网易（杭州）网络有限公司 信息发布控制方法、装置、存储介质及电子设备
CN110413817B (zh) * 2019-07-30 2023-06-16 腾讯科技（武汉）有限公司 用于对图片进行聚类的方法和设备
US11409788B2 (en) * 2019-09-05 2022-08-09 Albums Sas Method for clustering at least two timestamped photographs
CN111010611A (zh) * 2019-12-03 2020-04-14 北京达佳互联信息技术有限公司 电子相册的获取方法、装置、计算机设备和存储介质
CN112988671A (zh) * 2019-12-13 2021-06-18 北京字节跳动网络技术有限公司 媒体文件处理方法、装置、可读介质及电子设备
CN112269891A (zh) * 2020-10-26 2021-01-26 深圳市雷鸟网络传媒有限公司 动态影集生成方法、服务器、显示终端及可读存储介质
US11416138B2 (en) 2020-12-11 2022-08-16 Huawei Technologies Co., Ltd. Devices and methods for fast navigation in a multi-attributed search space of electronic devices
CN117150067A (zh) * 2023-01-13 2023-12-01 荣耀终端有限公司 相册处理方法和相关装置

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101740086A (zh) * 2008-11-11 2010-06-16 三星电子株式会社 辑录内容的设备和方法
CN102158628A (zh) * 2006-03-07 2011-08-17 富士胶片株式会社 影集制作装置、影集制作方法
US20160110355A1 (en) * 2014-10-17 2016-04-21 Verizon Patent And Licensing Inc. Automated image organization techniques
CN105528444A (zh) * 2015-12-23 2016-04-27 北京奇虎科技有限公司 一种相册生成方法和装置
CN106055624A (zh) * 2016-05-26 2016-10-26 努比亚技术有限公司 一种基于图片聚类的照片整理方法和移动终端
US20170192625A1 (en) * 2015-12-31 2017-07-06 Young Kim Data managing and providing method and system for the same

Family Cites Families (36)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6389181B2 (en) 1998-11-25 2002-05-14 Eastman Kodak Company Photocollage generation and modification using image recognition
JP2006293985A (ja) 2005-03-15 2006-10-26 Fuji Photo Film Co Ltd アルバム作成装置、アルバム作成方法、及びプログラム
US7614837B2 (en) 2006-12-01 2009-11-10 Shutterfly, Inc. Manufacturing system for personalized photo books
US8014572B2 (en) 2007-06-08 2011-09-06 Microsoft Corporation Face annotation framework with partial clustering and interactive labeling
US8611677B2 (en) 2008-11-19 2013-12-17 Intellectual Ventures Fund 83 Llc Method for event-based semantic classification
US9244941B2 (en) 2009-03-18 2016-01-26 Shutterfly, Inc. Proactive creation of image-based products
WO2010119548A1 (ja) 2009-04-16 2010-10-21 株式会社ビジョナリスト 電子アルバム表示システム及び電子アルバム表示プログラム
US20120027293A1 (en) * 2010-07-27 2012-02-02 Cok Ronald S Automated multiple image product method
JP5739428B2 (ja) 2010-08-04 2015-06-24 パナソニック インテレクチュアル プロパティ コーポレーション オブアメリカＰａｎａｓｏｎｉｃ Ｉｎｔｅｌｌｅｃｔｕａｌ Ｐｒｏｐｅｒｔｙ Ｃｏｒｐｏｒａｔｉｏｎ ｏｆ Ａｍｅｒｉｃａ 画像分類装置、方法、プログラム、プログラムを記録する記録媒体及び集積回路
US8886576B1 (en) 2012-06-22 2014-11-11 Google Inc. Automatic label suggestions for albums based on machine learning
US9411831B2 (en) 2013-03-01 2016-08-09 Facebook, Inc. Photo clustering into moments
CN103369031A (zh) * 2013-05-20 2013-10-23 华为技术有限公司 终端设备、电子相册服务器、照片分享系统及方法
US20160196478A1 (en) * 2013-09-03 2016-07-07 Samsung Electronics Co., Ltd. Image processing method and device
CN103838484A (zh) 2014-02-21 2014-06-04 联想(北京)有限公司 一种删除冗余图像的方法以及一种电子设备
CN104866501B (zh) 2014-02-24 2021-06-25 腾讯科技（深圳）有限公司 电子旅行相册生成方法和系统
US8923551B1 (en) * 2014-07-16 2014-12-30 Interactive Memories, Inc. Systems and methods for automatically creating a photo-based project based on photo analysis and image metadata
CN104331509A (zh) 2014-11-21 2015-02-04 深圳市中兴移动通信有限公司 照片管理方法及装置
CN107408212B (zh) 2015-02-11 2021-09-21 爱维士软件有限责任公司 用于识别存储在设备上的不需要的照片的系统和方法
JP2016189522A (ja) 2015-03-30 2016-11-04 富士フイルム株式会社 画像処理装置、画像処理方法、プログラムおよび記録媒体
CN104933146A (zh) 2015-06-19 2015-09-23 深圳天珑无线科技有限公司 照片管理方法和装置及移动终端
CN106326908A (zh) * 2015-06-30 2017-01-11 中兴通讯股份有限公司 一种图片的管理方法、装置及终端设备
CN105022802A (zh) 2015-07-02 2015-11-04 深圳市金立通信设备有限公司 一种照片分类方法及终端
US10140516B2 (en) 2015-12-16 2018-11-27 Samsung Electronics Co., Ltd. Event-based image management using clustering
CN105528450A (zh) 2015-12-23 2016-04-27 北京奇虎科技有限公司 一种相册命名方法和装置
CN105955995A (zh) 2016-04-19 2016-09-21 乐视控股（北京）有限公司 图片的分组方法和装置
CN106055554A (zh) * 2016-04-25 2016-10-26 珠海格力电器股份有限公司 一种电子相册分类方法、系统及终端
CN106021573A (zh) 2016-05-31 2016-10-12 北京小米移动软件有限公司 图片分类方法及装置、电子设备
EP3465479A1 (en) * 2016-06-02 2019-04-10 Kodak Alaris Inc. Method for proactive interactions with a user
CN106202392A (zh) 2016-07-07 2016-12-07 珠海市魅族科技有限公司 一种照片分类方法及终端
EP3475848B1 (en) * 2016-09-05 2019-11-27 Google LLC Generating theme-based videos
CN106446950B (zh) 2016-09-27 2020-04-10 腾讯科技（深圳）有限公司 一种图像处理方法及装置
CN106776821B (zh) 2016-11-25 2019-03-26 维沃移动通信有限公司 一种相册生成方法及终端
CN107193941A (zh) 2017-05-19 2017-09-22 北京金山安全软件有限公司 基于图片内容的故事生成方法和装置
CN107357815A (zh) 2017-06-07 2017-11-17 上海斐讯数据通信技术有限公司 一种图片内容的识别方法及系统
CN107341710A (zh) 2017-06-12 2017-11-10 武汉渡人网络技术有限公司 一种三维全景信息互动影息技术
US10762126B2 (en) * 2017-09-27 2020-09-01 Shutterfly, Llc System and method for reducing similar photos for display and product design

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102158628A (zh) * 2006-03-07 2011-08-17 富士胶片株式会社 影集制作装置、影集制作方法
CN101740086A (zh) * 2008-11-11 2010-06-16 三星电子株式会社 辑录内容的设备和方法
US20160110355A1 (en) * 2014-10-17 2016-04-21 Verizon Patent And Licensing Inc. Automated image organization techniques
CN105528444A (zh) * 2015-12-23 2016-04-27 北京奇虎科技有限公司 一种相册生成方法和装置
US20170192625A1 (en) * 2015-12-31 2017-07-06 Young Kim Data managing and providing method and system for the same
CN106055624A (zh) * 2016-05-26 2016-10-26 努比亚技术有限公司 一种基于图片聚类的照片整理方法和移动终端

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
See also references of EP3706015A4 *

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110377378A (zh) * 2019-06-18 2019-10-25 平安科技（深圳）有限公司 图片悬浮显示方法、装置、终端和存储介质

Also Published As

Publication number Publication date
US20210011940A1 (en) 2021-01-14
EP3706015A4 (en) 2020-09-23
CN108235765B (zh) 2021-10-15
EP3706015A1 (en) 2020-09-09
US11386140B2 (en) 2022-07-12
CN108235765A (zh) 2018-06-29

Similar Documents

Publication Publication Date Title
WO2019109245A1 (zh) 一种故事相册的显示方法及装置
US11249620B2 (en) Electronic device for playing-playing contents and method thereof
EP2892208B1 (en) Method and apparatus for operating electronic device
US20180314390A1 (en) User Interface, Method and System for Crowdsourcing Event Notification Sharing Using Mobile Devices
US9239849B2 (en) Mobile device access of location specific images from a remote database
EP2750054A1 (en) Content recommendation method
RU2703956C1 (ru) Способ управления мультимедийными файлами, электронное устройство и графический пользовательский интерфейс
US20120124125A1 (en) Automatic journal creation
CN105451846A (zh) 用于对内容进行分类的方法和装置
WO2018171047A1 (zh) 一种拍摄引导方法、设备及系统
US11550754B2 (en) Electronic apparatus and control method thereof
KR102065029B1 (ko) 전자 장치의 데이터 공유 방법 및 그 전자 장치
KR20160111756A (ko) 이동 단말기 및 그의 사진 관리방법
CN105159976A (zh) 图像文件的处理方法和系统
US20220215050A1 (en) Picture Search Method and Device
US9600478B2 (en) Display control apparatus, display control method, and program
KR20170098113A (ko) 전자 장치의 이미지 그룹 생성 방법 및 그 전자 장치
KR100868174B1 (ko) 맵 기반 동영상 분류 및 검색 시스템 그리고 그 방법.
KR102078858B1 (ko) 웹툰 제공 장치 및 휴대 단말의 동작 방법
WO2019109223A1 (zh) 一种生成相册标题的方法及设备
US20180267971A1 (en) Multimedia playing method and system for moving vehicle
KR102289293B1 (ko) 전자장치에서 콘텐츠 재생 방법 및 장치
KR102264428B1 (ko) 전자 장치의 동작 방법 및 장치
KR102050594B1 (ko) 전자장치에서 콘텐츠 재생 방법 및 장치
KR20190133653A (ko) 전자장치에서 콘텐츠 재생 방법 및 장치

Legal Events

Date Code Title Description
NENP Non-entry into the national phase

Ref country code: DE

ENP Entry into the national phase

Ref document number: 2017933949

Country of ref document: EP

Effective date: 20200706

121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 17933949

Country of ref document: EP

Kind code of ref document: A1