EP4027252A1 - Procédé et dispositif de recherche d'image - Google Patents

Procédé et dispositif de recherche d'image Download PDF

Info

Publication number
EP4027252A1
EP4027252A1 EP20868936.4A EP20868936A EP4027252A1 EP 4027252 A1 EP4027252 A1 EP 4027252A1 EP 20868936 A EP20868936 A EP 20868936A EP 4027252 A1 EP4027252 A1 EP 4027252A1
Authority
EP
European Patent Office
Prior art keywords
picture
age
search
electronic device
person
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
EP20868936.4A
Other languages
German (de)
English (en)
Other versions
EP4027252A4 (fr
Inventor
Xin Zhang
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Huawei Technologies Co Ltd
Original Assignee
Huawei Technologies Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Huawei Technologies Co Ltd filed Critical Huawei Technologies Co Ltd
Publication of EP4027252A1 publication Critical patent/EP4027252A1/fr
Publication of EP4027252A4 publication Critical patent/EP4027252A4/fr
Pending legal-status Critical Current

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/50—Information retrieval; Database structures therefor; File system structures therefor of still image data
    • G06F16/58—Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually
    • G06F16/5866—Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually using information manually generated, e.g. tags, keywords, comments, manually generated location and time information
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/50—Information retrieval; Database structures therefor; File system structures therefor of still image data
    • G06F16/53—Querying
    • G06F16/532—Query formulation, e.g. graphical querying
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/50—Information retrieval; Database structures therefor; File system structures therefor of still image data
    • G06F16/54—Browsing; Visualisation therefor
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/50—Information retrieval; Database structures therefor; File system structures therefor of still image data
    • G06F16/55—Clustering; Classification
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04M—TELEPHONIC COMMUNICATION
    • H04M1/00—Substation equipment, e.g. for use by subscribers
    • H04M1/72—Mobile telephones; Cordless telephones, i.e. devices for establishing wireless links to base stations without route selection
    • H04M1/724—User interfaces specially adapted for cordless or mobile telephones
    • H04M1/72403—User interfaces specially adapted for cordless or mobile telephones with means for local support of applications that increase the functionality

Definitions

  • Embodiments of this application relate to the field of terminal technologies, and in particular, to a picture search method and a device.
  • a picture management function and a picture search function are configured in a "Photo” application or another similar application on the terminal.
  • the "Photo” application on the terminal may classify pictures on the terminal based on information such as photographing times and photographing locations of the pictures to generate albums. The user can search for information such as a time and a location to view a related picture.
  • This application provides a picture search method and a device to increase dimensions of picture search, so that a user can view a picture of an age by using a simple operation.
  • this application provides a picture search method.
  • the picture search method is used to search for a picture stored in an electronic device.
  • the electronic device displays a search interface of an application, the search interface includes a search input box, the application is used to manage a gallery of the electronic device, and the gallery includes a first picture and a second picture.
  • the first picture includes an image of a first person.
  • an age of the first person is a first age.
  • the second picture includes an image of a second person.
  • an age of the second person is the first age.
  • the electronic device obtains, from the gallery in response to a first search keyword that includes the first age and that is entered by a user in the search input box, the first picture and the second picture that match the first search keyword, and displays the first picture and the second picture.
  • the age of the person in the first picture is the first age and the age of the person in the second picture is also the first age. Therefore, after the user enters the first age, the electronic device can obtain, from the gallery, the first picture and the second picture that are related to the first age, and display the first picture and the second picture.
  • the user can view the picture of the first age by using a simple operation. Therefore, better experience is provided for the user.
  • the search interface further includes one or more age options.
  • that "the electronic device obtains, from the gallery in response to a first search keyword entered by a user in the search input box, the first picture and the second picture that match the first search keyword" in the method includes: The electronic device obtains, from the gallery in response to a selection operation of the user on a first age option, the first picture and the second picture that match the first age. Information about the first age option is the first age, and the first age option is one of the one or more age options.
  • the user may directly enter the first search keyword in the search input box, or may input the first search keyword by tapping the age option.
  • the picture search method provided in this application further includes: The electronic device obtains, from the gallery in response to a second search keyword entered by the user in the search input box, the first picture matching the second search keyword, where the second search keyword includes the first age and a name of the first person.
  • the electronic device may further search for a picture by using an age and a name of a person as dimensions.
  • the picture search method provided in this application further includes: The electronic device obtains, from the gallery in response to a third search keyword entered by the user in the search input box, the second picture matching the third search keyword, where the third search keyword includes the first age, a name of the second person, and a first location; and a photographing location of the second picture is the first location.
  • the electronic device may further search for a picture by using an age, a name of a person, and a photographing location as dimensions.
  • the electronic device further stores a first mapping relationship, where the first mapping relationship includes a correspondence between the first age and the first picture and a correspondence between the first age and the second picture.
  • the electronic device obtains, from the gallery, the first picture and the second picture that match the first search keyword includes: The electronic device obtains, from the gallery based on the first mapping relationship, the first picture and the second picture that match the first age.
  • the electronic device further stores a second mapping relationship, where the second mapping relationship includes a correspondence between the first age, the name of the first person, and the first picture.
  • the "obtaining, from the gallery in response to a second search keyword entered by the user in the search input box, the first picture matching the second search keyword" in the method includes: The electronic device obtains, from the gallery based on the second mapping relationship, the first picture matching the first age and the name of the first person.
  • the electronic device further stores a third mapping relationship, where the third mapping relationship includes a correspondence between the first age, the name of the second person, the first location, and the second picture.
  • the "obtaining, from the gallery in response to a third search keyword entered by the user in the search input box, the second picture matching the third search keyword" in the method includes: The electronic device obtains, from the gallery based on the third mapping relationship, the second picture matching the first age, the name of the second person, and the first location.
  • this application provides an electronic device.
  • the electronic device includes a display, a memory, and one or more processors.
  • the display and the memory are coupled to the processor.
  • the memory is configured to store computer program code.
  • the computer program code includes computer instructions.
  • the processor executes the computer instructions, the electronic device performs the picture search method according to any one of the first aspect or the possible design manners of the first aspect.
  • this application provides a chip system, where the chip system is used in an electronic device including a touchscreen; the chip system includes one or more interface circuits and one or more processors; the interface circuit and the processor are interconnected through a line; the interface circuit is configured to receive a signal from a memory of the electronic device, and send the signal to the processor, where the signal includes computer instructions stored in the memory; and when the processor executes the computer instructions, the electronic device performs the picture search method according to any one of the first aspect and possible design manners of the first aspect.
  • this application provides a computer storage medium, where the computer storage medium includes computer instructions, and when the computer instructions are run on an electronic device, the electronic device is enabled to perform the picture search method according to any one of the first aspect and possible design manners of the first aspect.
  • this application provides a computer program product.
  • the computer program product runs on a computer, the computer is enabled to perform the picture search method according to any one of the first aspect and the possible design manners of the first aspect.
  • beneficial effects that can be achieved by the electronic device provided in the second aspect, the chip system in the third aspect, the computer storage medium in the fourth aspect, and the computer program product in the fifth aspect refer to the beneficial effects in any one of the first aspect and possible design manners of the first aspect. Details are not described herein again.
  • first and second are merely intended for a purpose of description, and shall not be understood as an indication or implication of relative importance or implicit indication of a quantity of indicated technical features. Therefore, a feature limited by “first” or “second” may explicitly or implicitly include one or more features. In the descriptions of this application, unless otherwise stated, "a plurality of' means two or more than two.
  • Embodiments of this application provide a picture search method and a device, which may be used in a process in which a user searches a gallery for a picture, and specifically, may be used in the process in which the user searches the gallery for the picture that includes a person and in which an age of the person is a first age.
  • the gallery includes a plurality of pictures.
  • the plurality of pictures may include: a photo photographed by a device, a picture downloaded by the device from a server, a picture transmitted (for example, transmitted through Bluetooth) by another device to the device, a picture transmitted by a social application (for example, WeChat or QQ) to the device, a picture obtained by screenshot, and the like.
  • the pictures in the gallery may be grouped based on different dimensions (for example, a photographing time, a portrait, a photographing location, an age, and a picture source) or dimension combinations. Each group of pictures form an album or a video.
  • grouping pictures based on portraits means that the pictures are grouped based on specific persons, and each picture group obtained after grouping corresponds to one person.
  • the pictures after grouping include a picture group of a user A and a picture group of a user B.
  • an age is used to represent an age of a person in a picture including the person.
  • the device may identify pictures including persons in the gallery, and divide the pictures including the persons into a plurality of picture groups based on ages. Different picture groups correspond to different ages. For example, photos including persons are divided into a picture group of one year old, a picture group of two years old, and a picture group of three years old.
  • the device may classify the pictures in the gallery based on the dimension of age. After receiving, from the user, an operation of searching for a picture of the first age, the device obtains, from the gallery, the picture matching the first age, and displays the obtained picture. In this way, the user can view a picture of a specific age, diversity of picture search is improved, and user experience is further improved.
  • the device may alternatively classify the pictures in the gallery based on ages and another dimension.
  • the device classifies the pictures in the gallery based on two dimensions: ages and portraits, or classifies the pictures in the gallery based two dimensions: ages and photographing locations (which may also be referred to as photographing locations), or classifies the pictures in the gallery based on three dimensions: ages, portraits, and photographing locations.
  • An example in which the device classifies the pictures including persons (which are briefly referred to as pictures below) in the gallery based on two dimensions: ages and portraits is mainly used for description.
  • the device may be a terminal device such as a mobile phone (for example, a mobile phone 100 shown in FIG. 1 ), a tablet computer, a personal computer (Personal Computer, PC), a personal digital assistant (personal digital assistant, PDA), a netbook, or a wearable electronic device.
  • a mobile phone for example, a mobile phone 100 shown in FIG. 1
  • a tablet computer for example, a mobile phone 100 shown in FIG. 1
  • PC Personal Computer
  • PDA personal digital assistant
  • netbook a wearable electronic device.
  • the device may be configured to manage a picture stored in the device, perform the picture search method provided in the embodiments of this application, obtain the picture of the first age in response to a search operation of the user, and display the picture of the first age.
  • a client used to manage a picture may be installed in the device (for example, "Baby Album” or "Google Album”). After logging in to a picture management account, the client may manage a picture stored on a cloud server.
  • the client may further be used to perform the picture search method provided in the embodiments of this application, obtain the picture of the first age in response to a search operation of the user, and display the picture of the first age.
  • the client used to manage a picture may be an embedded application (that is, a system application on the device) installed in the device or a downloadable application.
  • the embedded application is an application provided as a part of the device (for example, a mobile phone).
  • the downloadable application is an application that can provide an internet protocol multimedia subsystem (internet protocol multimedia subsystem, IMS) connection of the downloadable application.
  • IMS internet protocol multimedia subsystem
  • the downloadable application may be an application pre-installed on a device or a third- party application that is downloaded by a user and installed on a device.
  • the client used to manage a picture may be "Photo”, “Album”, or “Gallery”, and the method may be applied to a process in which a user searches for a picture in "Photo”, “Album”, or “Gallery”.
  • the application may be "Baby album”.
  • the method may be applied to a process in which a user searches for a picture in "Baby album”.
  • the client used to manage a picture in this application may alternatively be in another form. Details are not described herein.
  • the device may alternatively be a cloud server configured to store and manage a picture.
  • the cloud server may receive a picture uploaded by a terminal, then perform the picture search method provided in the embodiments of this application, obtain the picture of the first age in response to a search operation of the user, and display the picture of the first age.
  • a specific form of the device is not particularly limited in the embodiments of this application.
  • the device is the mobile phone 100 shown in FIG. 1 .
  • the mobile phone 100 may specifically include components such as a processor 101, a radio frequency (Radio Frequency, RF) circuit 102, a memory 103, a touchscreen 104, a Bluetooth apparatus 105, one or more sensors 106, a Wi-Fi apparatus 107, a positioning apparatus 108, an audio circuit 109, a peripheral interface 110, and a power supply apparatus 111. These components may communicate with each other through one or more communications buses or signal lines (not shown in FIG. 1 ).
  • a hardware structure shown in FIG. 1 does not constitute a limitation on the mobile phone, and the mobile phone 100 may include more or fewer components than those shown in the figure, or some components may be combined, or some components may be split, or there may be a different component arrangement.
  • the processor 101 is a control center of the mobile phone 100.
  • the processor 101 is connected to all components of the mobile phone 100 through various interfaces and lines, and performs various functions of the mobile phone 100 and data processing by running or executing an application stored in the memory 103 and invoking data stored in the memory 103.
  • the processor 101 may include one or more processing units.
  • the processor 101 may further include a fingerprint verification chip, configured to perform verification on a collected fingerprint.
  • the radio frequency circuit 102 may be configured to receive and send a radio signal in an information receiving/sending process or a call process. Particularly, after receiving downlink data from a base station, the radio frequency circuit 102 may send the downlink data to the processor 101 for processing, and send related uplink data to the base station.
  • the radio frequency circuit usually includes but is not limited to an antenna, at least one amplifier, a transceiver, a coupler, a low noise amplifier, a duplexer, and the like.
  • the radio frequency circuit 102 may further communicate with another device through wireless communication.
  • the wireless communication may use any communication standard or protocol, including but not limited to a global system for mobile communications, a general packet radio service, code division multiple access, wideband code division multiple access, long term evolution, an e-mail, a short message service, and the like.
  • the memory 103 is configured to store the application and the data.
  • the processor 101 performs the various functions of the mobile phone 100 and the data processing by running the application and the data that are stored in the memory 103.
  • the memory 103 mainly includes a program storage area and a data storage area.
  • the program storage area may store an operating system, and an application required by at least one function (for example, a sound play function and an image display function).
  • the data storage area may store data (for example, audio data and a phonebook) created based on usage of the mobile phone 100.
  • the memory 103 may include a high speed random access memory (RAM), and may further include a non-volatile memory, such as a magnetic disk storage device, a flash memory, or another volatile solid-state storage device.
  • the memory 103 may store various operating systems such as an iOS ® operating system and an Android ® operating system.
  • the memory 103 may be independent, and is connected to the processor 101 through the communications bus; or the memory 103 may be integrated into the processor 101.
  • the touchscreen 104 may specifically include a touchpad 104-1 and a display 104-2.
  • the touchpad 104-1 may collect a touch event (for example, an operation performed by a user on the touchpad 104-1 or near the touchpad 104-1 by using any appropriate object such as a finger or a stylus) performed by the user of the mobile phone 100 on or near the touchpad 104-1, and send collected touch information to another component (for example, the processor 101).
  • the touch event performed by the user near the touchpad 104-1 may be referred to as a floating touch.
  • the floating touch may indicate that the user does not need to directly touch the touchpad to select, move, or drag an object (for example, an icon), and the user only needs to be near a device to perform a desired function.
  • the touchpad 104-1 may be implemented in a plurality of types such as a resistive type, a capacitive type, an infrared type, and a surface acoustic wave type.
  • the display 104-2 may be configured to display information entered by the user, information provided for the user, and various menus of the mobile phone 100.
  • the display 104-2 may be configured in a form of a liquid crystal display, an organic light-emitting diode, or the like.
  • the touchpad 104-1 may cover the display 104-2. After detecting a touch event on or near the touchpad 104-1, the touchpad 104-1 transfers the touch event to the processor 101 to determine a type of the touch event. Then, the processor 101 may provide a corresponding visual output on the display 104-2 based on the type of the touch event.
  • the touchpad 104-1 and the display 104-2 are used as two independent components to implement input and output functions of the mobile phone 100, in some embodiments, the touchpad 104-1 and the display 104-2 may be integrated to implement the input and output functions of the mobile phone 100. It may be understood that the touchscreen 104 is formed by stacking a plurality of layers of materials. In the embodiments of this application, only the touchpad (layer) and the display (layer) are displayed, and another layer is not described in the embodiments of this application.
  • the touchpad 104-1 may be disposed on a front side of the mobile phone 100 in a full panel form.
  • the display 104-2 may also be disposed on the front side of the mobile phone 100 in a full panel form. In this way, a bezel-less structure can be implemented on the front side of the mobile phone.
  • the mobile phone 100 may further have a fingerprint recognition function.
  • a fingerprint collection device 112 may be disposed on the back of the mobile phone 100 (for example, below a rear- facing camera), or a fingerprint collection device 112 may be disposed on the front of the mobile phone 100 (for example, below the touchscreen 104).
  • a fingerprint collection device 112 may be disposed on the touchscreen 104 to implement the fingerprint recognition function.
  • the fingerprint collection device 112 may be integrated into the touchscreen 104 to implement the fingerprint recognition function of the mobile phone 100.
  • the fingerprint collection device 112 is disposed on the touchscreen 104, and may be a part of the touchscreen 104, or may be disposed on the touchscreen 104 in another manner.
  • a main component of the fingerprint collection device 112 in the embodiments of this application is a fingerprint sensor.
  • the fingerprint sensor may use any type of sensing technology, including but not limited to an optical sensing technology, a capacitive sensing technology, a piezoelectric sensing technology, an ultrasonic sensing technology, and the like.
  • the mobile phone 100 may further include the Bluetooth apparatus 105, configured to implement data exchange between the mobile phone 100 and another short-distance device (for example, a mobile phone or a smartwatch).
  • the Bluetooth apparatus may be an integrated circuit, a Bluetooth chip, or the like.
  • the mobile phone 100 may further include at least one type of sensor 106, such as a light sensor, a motion sensor, or another sensor.
  • the light sensor may include an ambient light sensor and a proximity sensor.
  • the ambient light sensor may adjust luminance of the display of the touchscreen 104 based on intensity of ambient light.
  • the proximity sensor may power off the display when the mobile phone 100 moves to an ear.
  • an accelerometer sensor may detect for a value of an acceleration in various directions (there are usually three axes), may detect for a value and a direction of gravity when the mobile phone is still, and may be applied to an application (for example, landscape/portrait mode switching, a related game, or magnetometer posture calibration) for recognizing a posture of the mobile phone, a function (for example, a pedometer or a keystroke) related to vibration recognition, and the like.
  • an application for example, landscape/portrait mode switching, a related game, or magnetometer posture calibration
  • a function for example, a pedometer or a keystroke
  • the wireless fidelity (Wireless Fidelity, Wi-Fi) apparatus 107 is configured to provide, for the mobile phone 100, network access that complies with a Wi-Fi-related standard protocol.
  • the mobile phone 100 may access a Wi-Fi access point through the Wi-Fi apparatus 107, to help the user receive and send an email, browse a web page, access streaming media, and the like.
  • the Wi-Fi apparatus 107 provides wireless broadband Internet access for the user.
  • the Wi-Fi apparatus 107 may alternatively be used as a Wi-Fi wireless access point, and may provide Wi-Fi network access for another device.
  • the positioning apparatus 108 is configured to provide a geographical location for the mobile phone 100. It can be understood that the positioning apparatus 108 may be specifically a receiver of a positioning system such as a global positioning system (global positioning system, GPS), a BeiDou navigation satellite system, or a Russian GLONASS. After receiving the geographical location sent by the positioning system, the positioning apparatus 108 sends the information to the processor 101 for processing, or sends the information to the memory 103 for storage. In some other embodiments, the positioning apparatus 108 may further be a receiver of an assisted global positioning system (assisted global positioning system, AGPS). The AGPS system serves as an assisted server to assist the positioning apparatus 108 in completing ranging and positioning services.
  • AGPS assisted global positioning system
  • the assisted positioning server communicates, by using a wireless communications network, with the positioning apparatus 108 (a receiver of the GPS) of the device such as the mobile phone 100 and provides positioning assistance.
  • the positioning apparatus 108 may alternatively be a positioning technology based on a Wi-Fi access point. Because each Wi-Fi access point has a globally unique media access control (media access control, MAC) address, if Wi-Fi is enabled, the device may scan and collect broadcast signals near the Wi-Fi access point. Therefore, the MAC address broadcast by the Wi-Fi access point may be obtained.
  • the device sends, to a location server through the wireless communications network, data (for example, the MAC address) that can be used to mark the Wi-Fi access point.
  • the location server finds a geographical location of each Wi-Fi access point, and bases on strength of the Wi-Fi broadcast signal to calculate a geographical location of the device and send the geographical location to the positioning apparatus 108 of the device.
  • the audio circuit 109, a speaker 113, and a microphone 114 may provide an audio interface between the user and the mobile phone 100.
  • the audio circuit 109 may convert received audio data into an electrical signal and then transmit the electrical signal to the speaker 113, and the speaker 113 converts the electrical signal into a sound signal for output.
  • the microphone 114 converts a collected sound signal into an electrical signal.
  • the audio circuit 109 receives the electrical signal, converts the electrical signal into audio data, and then outputs the audio data to the RF circuit 102, to send the audio data to, for example, another mobile phone, or outputs the audio data to the memory 103 for further processing.
  • the peripheral interface 110 is configured to provide various interfaces for an external input/output device (for example, a keyboard, a mouse, an external display, an external memory, or a subscriber identification module card).
  • an external input/output device for example, a keyboard, a mouse, an external display, an external memory, or a subscriber identification module card.
  • the mobile phone 100 is connected to the mouse by using a universal serial bus (universal serial bus, USB) interface, and the mobile phone 100 is connected, by using a metal contact on a card slot of the subscriber identification module card, to the subscriber identification module (subscriber identification module, SIM) card provided by a telecommunications operator.
  • the peripheral interface 110 may be configured to couple the external input/output peripheral device to the processor 101 and the memory 103.
  • the mobile phone 100 may communicate with another device in a device group through the peripheral interface 110.
  • the mobile phone 100 may receive, through the peripheral interface 110, display data sent by another device, and display the display data, and the like. This is not limited in the embodiments of this application.
  • the mobile phone 100 may further include the power supply apparatus 111 (for example, a battery and a power management chip) that supplies power to the components.
  • the battery may be logically connected to the processor 101 through the power management chip, to implement functions such as charging management, discharging management, and power consumption management by using the power supply apparatus 111.
  • the mobile phone 100 may further include a camera.
  • the camera may be a front-facing camera or a rear-facing camera. This is not limited in this embodiment of this application.
  • the camera generally includes a lens (lens) and an image sensor (sensor).
  • the image sensor may be any photosensitive device such as a charge-coupled device (charge-coupled device, CCD) or a complementary metal oxide semiconductor (complementary metal oxide semiconductor, CMOS).
  • CCD charge-coupled device
  • CMOS complementary metal oxide semiconductor
  • reflected light of a scene object passes through the lens to generate an optical image, the optical image is projected onto an image sensor, the image sensor converts a received optical signal into an electrical signal, and the camera sends the obtained electrical signal to a digital signal processing (digital signal processing, DSP) module for digital signal processing to finally obtain a digital image.
  • DSP digital signal processing
  • the digital image may be output on the mobile phone 100 by the display 104-2, or the digital image may be stored in the memory 103.
  • the DSP module may be integrated into the processor 101 in a form of a function module, or may be independently disposed in the mobile phone 100 in a form of a chip. This is not limited in the embodiments of this application.
  • the digital image generated by the DSP module may be stored in the memory 103 in an exchangeable image file (exchangeable image file, EXIF) format.
  • exchangeable image file exchangeable image file, EXIF
  • a picture in the EXIF format may include picture information and EXIF information.
  • the picture information includes information about each pixel in the picture, for example, a grayscale value of the pixel.
  • the EXIF information includes attribute information of the picture, for example, a time, a location, a shutter, an aperture, white balance, sensitivity, a focal length, a brand and/or a model of a camera and/or a lens when the picture is taken.
  • the processor 101 uses a current system time of the mobile phone 100 as a photographing time, triggers a sensor such as the positioning apparatus 108 to obtain the EXIF information such as a current photographing location of the mobile phone 100, and stores the EXIF information and the picture information of the picture in the memory 103.
  • the processor 101 may further identify the portrait in the picture by using a neural network model or another face recognition technology, and use the recognized portrait as attribute information of the picture.
  • the processor 101 may further obtain, from another application (such as a calendar application), information such as a birthday recorded by the user, further determine an age of a person in the picture with reference to a photographing time, and use the determined age as attribute information of the picture.
  • the processor 101 may obtain, by reading the EXIF information of the picture, the attribute information such as the portrait in the picture and an age of a person indicated by the portrait.
  • the processor 101 may read EXIF information of each picture in the gallery, divide pictures of a portrait and/or an age into a group, then make an album by using the pictures divided into the group, and present the album to the user.
  • the mobile phone 100 may further include a flashlight, a micro projection apparatus, a near field communication (near field communication, NFC) apparatus, and the like. Details are not described herein.
  • the picture search method provided in this embodiment of this application may be performed by a picture search apparatus.
  • the apparatus may be a device (for example, the mobile phone 100 shown in FIG. 1 ) configured to manage a picture, a central processing unit (central processing unit, CPU) of the device, a control module configured to search for a picture in the device, or a client configured to manage and search for a picture in the device.
  • a device for example, the mobile phone 100 shown in FIG. 1
  • CPU central processing unit
  • control module configured to search for a picture in the device
  • a client configured to manage and search for a picture in the device.
  • FIG. 3 is a schematic diagram of a principle frame of a picture search method according to an embodiment of this application.
  • a mobile phone 100 may obtain attribute information of each of a plurality of pictures (including pictures such as a picture a, a picture b, a picture c, and a picture d) shown in 301 in FIG. 3 .
  • the attribute information of the picture a shown in FIG. 3 may include: four years old and a person 1;
  • the attribute information of the picture b shown in FIG. 3 may include: five years old, XX park, and the person 1;
  • the attribute information of the picture c shown in FIG. 3 may include: five years old, XX square, and the person 1;
  • the attribute information of the picture d shown in FIG. 3 may include: four years old, XX park, and the person 1.
  • the attribute information of the picture further includes format information (for example, a joint photographic experts group (joint photographic experts group, JPEG) format), a picture source (for example, selfie, WeChat, and Bluetooth), and the like of the picture.
  • format information for example, a joint photographic experts group (joint photographic experts group, JPEG) format
  • a picture source for example, selfie, WeChat, and Bluetooth
  • the attribute information of the picture a may further include a format of the picture a: JPEG
  • the attribute information of the picture b may further include a format of the picture b: JPEG
  • the attribute information of the picture c may further include a format of the picture c: JPEG
  • the attribute information of the picture d may further include a format of the picture d: JPEG.
  • the mobile phone 100 may group the plurality of pictures based on portraits and ages to obtain at least one picture group. For example, the mobile phone 100 groups the plurality of pictures shown in 301 in FIG. 3 based on ages and portraits to obtain a picture group 1 and a picture group 2.
  • the picture group 1 includes pictures in which the age of the person 1 is four years old, to be specific, the picture group 1 includes the picture a and the picture d.
  • the picture group 2 includes pictures in which the age of the person 1 is five years old, to be specific, the picture group 2 includes the picture b and the picture c.
  • the mobile phone 100 generates a mapping relationship between a portrait, an age, a picture group, and a picture, and stores the mapping relationship.
  • the mapping relationship refer to 303 in FIG. 3 .
  • the mapping relationship may further include other attribute information of each picture, for example, a photographing location, and a picture format.
  • the mobile phone 100 After receiving an operation, entered by the user, of searching for the first age of the person 1, the mobile phone 100 obtains and displays the picture matching the first age of the person 1. For example, as shown in FIG. 3 , if a search keyword entered by the user is the person 1 and four years old, the mobile phone 100 finds, based on a mapping relationship 303, that pictures matching the person 1 and four years old are the picture a and the picture d, and the device displays the picture a and the picture d.
  • mapping relationships stored in the mobile phone 100 are different.
  • the mobile phone 100 may store a first mapping relationship, where the first mapping relationship includes a correspondence between an age and a picture; may store a second mapping relationship, where the second mapping relationship includes a correspondence between an age, a name of a person, and a picture; and may further store a third mapping relationship, where the third mapping relationship includes a correspondence between an age, a name of a person, a photographing location, and a picture.
  • the picture search method provided in the embodiments of this application includes a process in which the mobile phone 100 groups a plurality of pictures in a gallery based on two dimensions of portraits and ages to generate at least one album and a process of obtaining and displaying, in response to a search operation entered by a user, a picture matching a search keyword entered by the user.
  • the process in which the mobile phone 100 groups the plurality of pictures in the gallery based on the two dimensions of portraits and ages to generate the at least one album is described first.
  • FIG. 4 is a schematic flowchart of a picture search method according to an embodiment of this application. As shown in FIG. 4 , the picture search method provided in this embodiment of this application includes the following steps.
  • a mobile phone 100 obtains attribute information of a picture in a gallery, where the attribute information includes a portrait and an age.
  • the mobile phone 100 may perform S401 and a subsequent method procedure without being perceived by a user, to generate at least one sub-album. For example, the mobile phone 100 may periodically and automatically perform S401 and the subsequent method procedure to generate the at least one sub-album; or the mobile phone 100 periodically detects a quantity of newly added pictures in the mobile phone 100, and when the quantity of newly added pictures exceeds a preset picture threshold, performs S401 and the subsequent method procedure to generate the at least one sub-album.
  • the mobile phone 100 may alternatively perform S401 and the subsequent method procedure in response to an operation of the user, to generate the at least one sub-album.
  • the operation of the user may be a tap operation performed by the user on a function key or a function button that is in the mobile phone 100 and that is used to manage a picture.
  • a display interface 502 of a "Discovery” option includes a function button 503 used to control the mobile phone 100 to group the plurality of pictures in the gallery based on different dimensions, for example, a "Start" button 503.
  • the mobile phone 100 may perform S401 and the subsequent method procedure in response to the tapping operation of the user.
  • the mobile phone 100 obtains a portrait and an age.
  • the mobile phone 100 in this embodiment of this application may obtain, by using any one of the following implementations, information such as a portrait and an age in a picture including the portrait:
  • Implementation 1 In a photographing process, the mobile phone 100 uses a label template (such as a watermark template) that has been set by the user to photograph and store a picture.
  • the label template that has been set by the user includes an age of a person.
  • the mobile phone 100 may determine and store the attribute information of an age of a person in the picture by identifying information about the label template in the picture.
  • the mobile phone 100 obtains the attribute information of the age of the person in the picture from a memory 103.
  • the label template that has been set by the user may further include information such as a name (or a nickname) of a person, and a brand and a model of the mobile phone 100.
  • the mobile phone 100 may determine and store the attribute information such as a name (or a nickname) of a person in the picture, and a brand and a model of a photographing device by identifying information about the label template in the picture.
  • the mobile phone 100 obtains the name (or the nickname) of the person in the picture from the memory 103.
  • a name (or a nickname) of a person stored in the device uniquely corresponds to one portrait. Therefore, the name (or the nickname) of the person in this embodiment of this application is used to uniquely indicate one portrait. Further, the mobile phone 100 may further use a face recognition technology to recognize a portrait in a picture, and establish and store a mapping relationship between the portrait and a name (or a nickname). In the attribute information of the picture in this embodiment of this application, the portrait and the name may be replaced with each other.
  • the watermark template that has been set by the user includes a name "Lan Lan”, an age “four years old”, a brand “HUAWEI” of the mobile phone 100, and a mobile phone model "P30".
  • the mobile phone 100 After the user clicks a photographing key 601 shown in FIG. 6(a) , the mobile phone 100 stores a picture shown in FIG. 6(b) , and the picture includes label information "Lan Lan, four years old, HUAWEI P30". Subsequently, the mobile phone 100 may obtain the two pieces of attribute information of the picture, that is, the portrait and the age, from the watermark template.
  • the mobile phone 100 may recognize the portrait in the picture by using a face recognition technology and store the portrait. In addition, the mobile phone 100 further establishes and stores a mapping relationship between a portrait and a name.
  • Implementation 2 After a picture is captured, the mobile phone 100 prompts the user whether to add a label. If a label needs to be added, the user enters the label. After receiving the label information entered by the user, the mobile phone 100 adds the label to the captured picture, and stores the picture with the label.
  • the label information includes the age of the person. In this way, when storing the picture, the mobile phone 100 may determine and store the attribute information of an age of a person in the picture by identifying the label in the picture. Correspondingly, the mobile phone 100 obtains the attribute information of the age of the person in the picture from the memory 103.
  • the label information may further include information such as a name (or a nickname) of a person.
  • the mobile phone 100 may determine and store a name (or a nickname) of a person in the picture by identifying the label in the picture.
  • the mobile phone 100 obtains the name (or the nickname) of the person in the picture from the memory 103.
  • the mobile phone 100 displays an interface 702 shown in FIG. 7(b) .
  • the interface 702 includes a picture captured by the mobile phone 100, a control 703 for manually entering label information, and a control 704 for entering label information by using a keyboard.
  • the mobile phone 100 displays an interface 705 shown in FIG. 7(c) , where the interface 705 includes a label information input box 707.
  • the user may enter label information "a photo of Xiao Qi taken at 10 years old" in the input box 707, and taps a "Complete" button 706 in the interface 705.
  • the mobile phone 100 In response to the tap operation performed by the user on the "Complete” button 706, the mobile phone 100 displays an interface 708 shown in FIG. 7(d) .
  • the picture with the label information "a photo of Xiao Qi taken at 10 years old" is displayed in the interface 708.
  • the mobile phone 100 stores the picture displayed in the interface 708, and stores the label information "a photo of Xiao Qi taken at 10 years old" in the picture. In this way, the mobile phone 100 may directly obtain the two pieces of attribute information of the picture, that is, the portrait and the age, from the memory.
  • a step performed by the mobile phone 100 is similar to the foregoing step. Details are not described herein again.
  • Implementation 3 After capturing a picture, the mobile phone 100 stores the picture. Subsequently, the user adds note information including an age to the picture. Correspondingly, the mobile phone 100 further stores the note information of the picture. In this way, the mobile phone 100 obtains information such as an age in the picture from the memory 103.
  • the note information may further include information such as a name (or a nickname) of a person.
  • the mobile phone 100 may further store the name (or the nickname) of the person in the picture.
  • the mobile phone 100 obtains the name (or the nickname) of the person in the picture from the memory 103.
  • the mobile phone 100 displays an interface 802 shown in FIG. 8(b) .
  • the interface 802 includes controls for managing pictures, such as adding notes 803, renaming, setting as, and rotating.
  • the mobile phone 100 displays an interface 805 shown in FIG. 8(c) , where the interface 805 includes a pop-up box 804. The user may enter note information "five years old" in an input box of the pop-up box 804, and taps a "Confirm" button in the pop-up box 804.
  • the mobile phone 100 In response to the tap operation performed by the user on the "Confirm” button, the mobile phone 100 stores the note information "five years old" in the picture shown in FIG. 8(a) . In this way, the mobile phone 100 may directly obtain the attribute information of the picture, that is, the age, from the memory.
  • the note information may further include information such as a name or a nickname.
  • the note information added by the user is not displayed in the picture.
  • the mobile phone 100 obtains a date of birth of a person, subsequently, identifies, by using a face recognition technology, pictures including a same portrait, calculates an age of the person in each picture based on a photographing time of each picture and the obtained date of birth, and stores the two pieces of attribute information, that is, the portrait and the age, in each picture. Then, the mobile phone 100 obtains the portrait and the age in the picture from the memory 103.
  • the user may tap a control "New album" 901 in an interface shown in FIG. 9(a) .
  • the mobile phone 100 displays an interface 902 shown in FIG. 9(b) .
  • the interface 902 includes a pop-up box 903 of a newly created album.
  • the user may enter a name of the newly created album in the pop-up box 903. If the newly created album is a portrait album, the user may further enter a date of birth of a person in the pop-up box 903. For example, an album name entered by the user is "Lan Lan", and a date of birth is "2014-10-1".
  • the mobile phone 100 displays an interface 904 shown in FIG. 9(c) .
  • the interface 904 displays all pictures in the gallery, so that the user selects a picture for the album "Lan Lan".
  • the user may select only one picture as a reference picture in the album, or may select all pictures to be classified into the album "Lan Lan”.
  • FIG. 9(c) an example in which the user selects the Fig 1 is used for description.
  • the mobile phone 100 may display an interface 906 shown in FIG. 9(d) .
  • the album "Lan Lan" has been successfully created.
  • the mobile phone 100 may recognize/obtain all pictures including the portrait (for example, pictures including Lan Lan) selected by the user, calculate an age of the person in each picture based on a photographing time of each picture and the obtained date of birth, and store the portrait and the age in each picture in the memory.
  • the portrait for example, pictures including Lan Lan
  • the mobile phone 100 may further determine that another picture including the portrait in the gallery also belongs to the album. Subsequently, if a picture of the portrait is newly added in the mobile phone 100, the mobile phone 100 may also determine that the newly added picture belongs to the album, and calculate and store an age of the person in the newly added picture.
  • the user selects the Fig 1 as the reference picture of the album "Lan Lan”. Subsequently, the mobile phone 100 may recognize all pictures of Lan Lan in the gallery, calculate an age of Lan Lan in each picture, and store the portrait "Lan Lan” and the age in each picture. Next, after the mobile phone 100 recaptures a picture of Lan Lan, the mobile phone 100 may recognize that a portrait in the picture is Lan Lan, determine that the picture belongs to the album "Lan Lan", and calculate and store an age of Lan Lan in the picture.
  • the mobile phone 100 may further obtain the two pieces of attribute information, that is, the portrait and the age, of the picture including the portrait in another manner. Details are not described herein.
  • the mobile phone 100 may further obtain, from another installed application, such as a calendar application or a memo application, a user's date of birth recorded by the user.
  • another installed application such as a calendar application or a memo application
  • the mobile phone 100 may determine an age of a person in the picture based on information recorded in another application.
  • the user records “Lan Lan's date of birth: October 1, 2014” in the memo, and the mobile phone 100 reads the information in the memo to obtain “Lan Lan's date of birth: October 1, 2014".
  • the watermark template that has been set by the user includes “Lan Lan”, and the brand “HUAWEI” and the mobile phone model "P30" of the mobile phone 100
  • the mobile phone 100 obtains "Lan Lan's date of birth: October 1, 2014” based on "Lan Lan” in the watermark template and a photographing time, and determines an age of the person in the picture.
  • the mobile phone 100 can store the two pieces of attribute information, that is, the portrait and the age, of the picture.
  • the information entered in the label information/the note information/the newly created album only includes “Lan Lan”
  • the mobile phone 100 obtains "Lan Lan's date of birth: October 1, 2014” based on the information "Lan Lan” entered in the label information/the note information/the newly created album and a photographing time, and determines an age of the person in the picture.
  • the mobile phone 100 can store the two pieces of attribute information, that is, the portrait and the age, of the picture.
  • a device capturing the picture may obtain and store the two pieces of attribute information, that is, the portrait and the age, of the picture by using any one of the foregoing implementations.
  • the two pieces of attribute information, that is, the portrait and the age, of the picture is also transmitted to the mobile phone 100.
  • the attribute information of the picture obtained by the mobile phone 100 includes the portrait and the age.
  • the mobile phone 100 groups pictures based on portraits and ages to generate and display a person album of each portrait and at least one age album of each portrait.
  • the mobile phone 100 may divide pictures of a same portrait into one group, and these groups of pictures form a person album.
  • the mobile phone 100 further divides pictures of a same portrait into at least one group based on ages.
  • each group of pictures form an age album.
  • the mobile phone 100 further stores a mapping relationship between a portrait, an age, a picture group (that is, an album), and a picture.
  • a mapping relationship For the mapping relationship, refer to FIG. 3 .
  • the mobile phone 100 may display pictures in the album in descending order or ascending order of photographing times. Certainly, the user may further adjust a display sequence of the pictures in the album as required.
  • the mobile phone 100 may display a display interface 502 of the "Discovery” option shown in FIG. 5A(b).
  • the interface 502 includes a function button 503 used to control the mobile phone 100 to group the plurality of pictures in the gallery based on different dimensions, for example a "Start" button 503.
  • the mobile phone 100 may perform S401 and S402 in response to the tapping operation of the user, and generate and display an interface 504 shown in FIG. 5A(c) .
  • the interface 504 includes an icon of each person album.
  • the icon may be displayed as any picture in the album, or may be displayed as a picture that is set by the user as a cover.
  • the interface 504 shown in FIG. 5A(c) includes an icon 505a of an album of a person 1 and an icon 505b of an album of a person 2.
  • the interface 504 may further display another album generated through division based on another dimension such as a photographing location.
  • the mobile phone 100 displays a next level of album, that is, an age album, of the album of the person 1 shown by the icon 505a, and the mobile phone 100 displays an interface 506 shown in FIG. 5A(d) .
  • the interface 506 includes an icon 507 of the album of the person 1 at four years old and an icon of the album of the person 1 at five years old. Further, after the user taps the icon 507, the mobile phone displays an interface 508 in response to the tapping operation on the icon 507, and the interface 508 displays the pictures of the person 1 at four years old in a sequence of photographing times.
  • the user may further tap an icon 520 that is in the interface 504 and that is used to view more person albums.
  • the mobile phone displays an interface 521 shown in FIG. 5B(c'') .
  • the interface 521 displays icons of all person albums generated by the mobile phone 100.
  • the user may tap an icon of any person album in the interface 521, so that the mobile phone 100 displays a next level of album of the person album.
  • FIG. 5B(c'') refer to the description of FIG. 5A(a) to FIG. 5A(e) . Details are not described herein again.
  • FIG. 5B(a) FIG.
  • FIG. 5B(b) , FIG. 5B(d) , and FIG. 5B(e) refer to the descriptions of FIG. 5A(a) , FIG. 5A(b) , FIG. 5A(d) , and FIG. 5A(e) . Details are not described herein again.
  • the mobile phone 100 performs S401 and S402 without being perceived by the user, to generate a person album of each portrait and at least one age album of each portrait.
  • the mobile phone 100 may display a display interface 1002 of an "Album" option shown in FIG. 10(b) .
  • the interface 1002 includes an icon of each person album.
  • the icon may be displayed as any picture in the album, or may be displayed as a picture that is set by the user as a cover.
  • the interface 1002 shown in FIG. 10(b) includes an icon 1003 of an album of a person 1 and an icon 1005 of an album of a person 2.
  • the interface 1002 may further display another album generated through division based on another dimension such as a photographing location.
  • the mobile phone 100 may display the interface shown in FIG. 5A(d) .
  • the mobile phone 100 may display the interface shown in FIG. 5A(e) .
  • an age album generated by the mobile phone 100 may alternatively include pictures at a plurality of ages of a same portrait (for example, an age group).
  • age albums of a user A that are generated by the mobile phone 100 include: a kindergarten album, an elementary school album, a junior high school album, a high school album, and a college album.
  • the mobile phone 100 may divide the pictures in the gallery based only on ages, to generate age albums.
  • Each age album may include an album of different portraits at a same age.
  • the mobile phone 100 may divide the pictures in the gallery based on photographing locations of the pictures and ages. Specifically, pictures of a same photographing location and different ages are classified as one group, to generate a story album/commemorative album as a collection of pictures of the user at the photographing location. For example, if the user takes photos at a location A every year, the mobile phone 100 classifies the photos into one group, to generate a story album. The user can view the story album, and can feel the change of years.
  • the mobile phone 100 may determine whether a photographing time of a picture is a specific date, for example, a birthday. If the photographing time of the picture is a specific date, the mobile phone 100 may classify all pictures taken on the specific date into one group, to generate an album of the specific date, for example, a birthday album.
  • the mobile phone 100 may further display, in a manner such as a video, pictures classified into one group.
  • the mobile phone 100 may further divide the pictures in the gallery based on another dimension, and generate an album/video by using the pictures divided into one group. Details are not described one by one in the embodiments of this application.
  • the mobile phone 100 may obtain attribute information such as a portrait and an age of the picture, and establish a mapping relationship between the picture and one or more established albums based on the attribute information such as the portrait and the age of the picture, to add the picture to the one or more albums.
  • the mobile phone 100 may divide the pictures in the gallery based on ages, to generate at least one age album. By viewing the age album, the user can experience the changes of features such as dress and portrait as time passes by.
  • the user may trigger the mobile phone 100 to search for a picture corresponding to a first age or search for a picture of a first portrait at a first age.
  • FIG. 11 is a schematic flowchart of a picture search method according to an embodiment of this application. As shown in FIG. 11 , the picture search method provided in this embodiment of this application includes the following steps.
  • a mobile phone 100 displays a first interface of a picture management application.
  • the picture management application may be a "Photo” application, "Baby album”, “Google album”, and another application used to manage a picture, which are not listed one by one herein.
  • the first interface (corresponding to a search interface in the embodiments of this application) includes a search input box.
  • the search input box is used by a user to enter attribute information of a picture, for example, a name and an age.
  • the first interface may further include at least one option, where the at least one option is used to represent a dimension used by the mobile phone 100 to divide pictures in a gallery, for example, a photographing time option, a portrait (displayed by using a picture) option, a photographing location option, or an age option; and may further include a historical search information option of the user.
  • the user may enter text information in the search input box, or may tap an option displayed in the first interface. When the user taps the option displayed in the first interface, the mobile phone 100 displays, in the search input box, information about the option tapped by the user.
  • the first interface is an interface 1201 shown in FIG. 12(a) .
  • the interface 1201 includes a search input box 1202 and an option that is used to represent a dimension used by the mobile phone 100 to divide the pictures in the gallery, for example, a photographing time option (for example, a "National Day” option, a "Last week” option, or a "Last month” option), a portrait (which may be displayed by using a picture) option, a photographing location option (for example, an "XX park” option, an "XX square” option), an age option (for example, a "Four years old” option, or a "Five years old” option).
  • a photographing time option for example, a "National Day” option, a "Last week” option, or a "Last month” option
  • a portrait which may be displayed by using a picture
  • a photographing location option for example, an "XX park” option, an "XX square” option
  • an age option for
  • the first interface is an interface 1203 shown in FIG. 12(b) .
  • the interface 1203 includes a search input box 1204, at least one historical search information option, and an option that is used to represent a dimension used by the mobile phone 100 to divide the pictures in the gallery, for example, a "National Day” option, an "Identification photo” option, a "Four years old” option, or a "Lan Lan” option.
  • the mobile phone 100 may display the first interface in response to a second operation of the user in a second interface.
  • the second operation may be a tapping operation performed by the user on a search control in the second interface.
  • the user taps a search control 509 shown in FIG. 5A(c) , a search control 510 shown in FIG. 5A(d) , a search control 511 shown in FIG. 5A(e) , a search control 522 shown in FIG. 5B(c'') , a search control 511 shown in FIG. 5B(e) , a search icon shown in FIG. 9(a) to FIG. 9(d) , or a search control 1004 shown in FIG. 10(b) .
  • the mobile phone displays the first interface 1201 or the first interface 1203.
  • the mobile phone 100 obtains, in response to a first operation of the user, a picture corresponding to a search keyword (for example, a portrait 1 and four years old) entered by the user, and displays the obtained picture.
  • a search keyword for example, a portrait 1 and four years old
  • the first operation of the user may be an operation of tapping to search after the user enters the search keyword in the search input box.
  • the search input box displays a cursor used to indicate that the user may start to enter information.
  • the user may start to enter the information in the search input box.
  • the mobile phone 100 does not include or have a physical keyboard
  • the mobile phone 100 may invoke an input method program in the mobile phone 100 to display a virtual keyboard used to enter information.
  • the user may start to enter information (where the information is the search keyword) in the search input box.
  • the user taps search after finishing entering.
  • the mobile phone 100 searches, based on a mapping relationship (as shown in FIG. 3 ), for a picture matching the information entered by the user.
  • the first interface may be an interface 1301 shown in FIG. 13A(a) .
  • the interface 1301 includes a search input box 1302.
  • the search input box 1302 is used to input attribute information of a to-be-searched picture (for example, a name or an age of a portrait).
  • the mobile phone 100 may receive a tapping operation performed by the user on the search input box 1302.
  • the mobile phone 100 displays a cursor in the search input box 1302, and displays a virtual keyboard.
  • the user may tap a search icon in the virtual keyboard (that is, the first operation).
  • the mobile phone 100 determines, from a mapping relationship in the memory in response to an operation of tapping the search icon by the user, a picture whose attribute information of an age is four years old in the gallery. If the mobile phone 100 includes a plurality of age albums of four years old, the mobile phone 100 displays each age album of four years old, and specifically, displays a cover picture of each age album of four years old. As shown in FIG.
  • the mobile phone 100 displays a cover picture of an age album of "Lan Lan” at four years old and a cover picture of an age album of "Yuan Yuan” at four years old.
  • the cover picture of the age album of "Lan Lan” at four years old and the cover picture of the age album of "Yuan Yuan” at four years old may respectively correspond to a first picture and a second picture in the embodiments of this application.
  • the mobile phone 100 directly displays all pictures in the age album.
  • the mobile phone 100 displays a cursor in the search input box 1302, and displays a virtual keyboard.
  • the user may tap a search icon in the virtual keyboard (that is, the first operation).
  • the mobile phone 100 determines, from a mapping relationship in the memory in response to an operation of tapping the search icon by the user, a picture whose attribute information of an age is four years old and whose attribute information of a portrait is Lan Lan in the gallery.
  • the mobile phone 100 may display a cover picture of an age album of "Lan Lan” at four years old, or may display all pictures of "Lan Lan” at four years old.
  • the mobile phone 100 displays all pictures of "Lan Lan” at four years old.
  • each picture of Lan Lan at four years old shown in FIG. 13B(c) is a picture matching the second search keyword.
  • FIG. 13B(a) is the same as FIG. 13A(a) . Details are not described herein again.
  • the first operation of the user is a tapping operation of the user on one or more options in the first interface.
  • the first interface may include at least one option. After the user taps any one/more options in the at least one option (where information about the option tapped by the user is considered as a search keyword entered by the user in the search input box), the mobile phone 100 displays, in the search input box, the information about the option tapped by the user, searches for a picture matching the information about the option tapped by the user, and displays the found picture.
  • the mobile phone 100 may display "four years old" in the search input box in response to the tapping operation of the user on "four years old", search for a picture matching "four years old", and display the found picture. If the mobile phone 100 includes a plurality of age albums of four years old, the mobile phone 100 displays each age album of four years old, and specifically, displays a cover picture of each age album of four years old. As shown in FIG. 14(a) , after the user taps "four years old" (corresponding to the first age in the first search keyword in the embodiments of this application), the mobile phone 100 may display "four years old" in the search input box in response to the tapping operation of the user on "four years old", search for a picture matching "four years old", and display the found picture. If the mobile phone 100 includes a plurality of age albums of four years old, the mobile phone 100 displays each age album of four years old, and specifically, displays a cover picture of each age album of four years old. As shown in FIG.
  • the mobile phone 100 displays a cover picture of an age album of "Lan Lan” at four years old and a cover picture of an age album of "Yuan Yuan” at four years old.
  • each picture shown in FIG. 14(b) is a picture matching the first search keyword.
  • the mobile phone 100 directly displays all pictures in the age album.
  • the mobile phone 100 may display "four years old” and “Lan Lan” in the search input box in response to the tapping operation of the user on “four years old” and “Lan Lan”, search for a picture matching "four years old” and “Lan Lan”, and display the found picture.
  • the mobile phone 100 may display a cover picture of an age album of "Lan Lan” at four years old, or may display all pictures of "Lan Lan” at four years old. As shown in FIG.
  • the mobile phone 100 displays a cover picture of an age album of "Lan Lan” at four years old.
  • each picture of Lan Lan at four years old shown in FIG. 15(b) is a picture matching the second search keyword.
  • the mobile phone 100 may display "four years old”, “Lan Lan”, and “park” in the search input box in response to the tapping operation of the user on “four years old", “Lan Lan”, and “park”, search for a picture matching "four years old", “Lan Lan”, and “park”, and display the found picture.
  • the mobile phone 100 may display a cover picture of a commemorative album of "Lan Lan” at four years old in the park, or may display all pictures of "Lan Lan” at four years old in the park.
  • the mobile phone 100 displays all pictures of "Lan Lan” at four years old in the park.
  • each picture of Lan Lan at four years old in the park shown in FIG. 16(b) is a picture matching the third search keyword.
  • the mobile phone 100 may further determine whether a tapping operation of the user on another option is further received within preset duration. If the mobile phone 100 has not received a tapping operation of the user on another option within the preset duration, the mobile phone 100 searches for and displays a picture matching the information about the option tapped by the user.
  • a search keyword (a search keyword entered by the user/the information about the option tapped by the user) obtained by the mobile phone 100 may be related information of the another dimension, for example, an age + a photographing location, or an age + a portrait + a holiday, for example, specifically, four years old park, or four years old Lan Lan children's day. This is not listed herein. If the mobile phone 100 makes pictures classified into one group as a video and an obtained search keyword corresponds to the video, the mobile phone 100 may alternatively directly display the video and/or all pictures in the video.
  • the mobile phone 100 divides the pictures in the gallery based on portraits and ages and generates at least one age album of each portrait, the user may enter the first portrait and the first age, and correspondingly, the mobile phone 100 searches for and displays an age album corresponding to the first portrait and the first age.
  • the mobile phone 100 provides a new search dimension, that is, an age, for the user.
  • the user can view a picture of the first age by using a simple operation. In this way, better experience is provided for the user.
  • the electronic device may include a display, a memory, and one or more processors.
  • the display and the memory are coupled to the processor.
  • the memory is configured to store computer program code, where the computer program code includes computer instructions.
  • the processor executes the computer instructions, the electronic device may perform functions or steps performed by the electronic device in the foregoing method embodiments.
  • a structure of the electronic device refer to the structure of the mobile phone 100 shown in FIG. 1 .
  • the chip system includes at least one processor 1701 and at least one interface circuit 1702.
  • the processor 1701 and the interface circuit 1702 may be interconnected through a line.
  • the interface circuit 1702 may be configured to receive a signal from another apparatus (for example, a memory of the electronic device).
  • the interface circuit 1702 may be configured to send a signal to another apparatus (for example, the processor 1701 or the display screen of the electronic device).
  • the interface circuit 1702 may read instructions stored in the memory, and send the instructions to the processor 1701.
  • the electronic device may be enabled to perform each step in the foregoing embodiments.
  • the chip system may further include another discrete component. This is not specifically limited in this embodiment of this application.
  • An embodiment of this application further provides a computer storage medium.
  • the computer storage medium includes computer instructions, and when the computer instructions are run on the foregoing electronic device, the electronic device is enabled to perform functions or steps performed by the electronic device in the foregoing method embodiments.
  • An embodiment of this application further provides a computer program product.
  • the computer program product When the computer program product is run on a computer, the computer is enabled to perform the functions or steps performed by the electronic device in the foregoing method embodiments.
  • the disclosed system, apparatus, and method may be implemented in another manner.
  • the described apparatus embodiment is merely an example.
  • division into the modules or units is merely logical function division and may be other division in actual implementation.
  • a plurality of units or components may be combined or integrated into another system, or some features may be ignored or not performed.
  • the displayed or discussed mutual couplings or direct couplings or communication connections may be implemented through some interfaces.
  • the indirect couplings or communication connections between the apparatuses or units may be implemented in electronic, mechanical, or other forms.
  • the units described as separate parts may or may not be physically separate, and parts displayed as units may or may not be physical units, and may be located in one position, or may be distributed on a plurality of network units. A part or all of the units may be selected based on actual requirements to achieve the objectives of the solutions of the embodiments.
  • function units in each of the embodiments may be integrated into one processing unit, or each of the units may exist alone physically, or two or more units may be integrated into one unit.
  • the integrated unit may be implemented in a form of hardware, or may be implemented in a form of a software function unit.
  • the integrated unit When the integrated unit is implemented in the form of a software function unit and sold or used as an independent product, the integrated unit may be stored in a computer-readable storage medium.
  • the computer software product is stored in a storage medium and includes several instructions for instructing a computer device (which may be a personal computer, a server, a network device, or the like) or a processor to perform all or some of the steps of the methods in the embodiments.
  • the foregoing storage medium includes: any medium that can store program code, such as a flash memory, a removable hard disk, a read-only memory, a random access memory, a magnetic disk, or an optical disc.

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • Databases & Information Systems (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Data Mining & Analysis (AREA)
  • Library & Information Science (AREA)
  • Mathematical Physics (AREA)
  • Human Computer Interaction (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Signal Processing (AREA)
  • User Interface Of Digital Computer (AREA)
EP20868936.4A 2019-09-26 2020-09-02 Procédé et dispositif de recherche d'image Pending EP4027252A4 (fr)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201910917611.5A CN110851637A (zh) 2019-09-26 2019-09-26 一种图片搜索方法及设备
PCT/CN2020/113095 WO2021057421A1 (fr) 2019-09-26 2020-09-02 Procédé et dispositif de recherche d'image

Publications (2)

Publication Number Publication Date
EP4027252A1 true EP4027252A1 (fr) 2022-07-13
EP4027252A4 EP4027252A4 (fr) 2022-10-12

Family

ID=69597072

Family Applications (1)

Application Number Title Priority Date Filing Date
EP20868936.4A Pending EP4027252A4 (fr) 2019-09-26 2020-09-02 Procédé et dispositif de recherche d'image

Country Status (4)

Country Link
US (1) US20220215050A1 (fr)
EP (1) EP4027252A4 (fr)
CN (1) CN110851637A (fr)
WO (1) WO2021057421A1 (fr)

Families Citing this family (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110851637A (zh) * 2019-09-26 2020-02-28 华为技术有限公司 一种图片搜索方法及设备
CN113763005B (zh) * 2020-09-23 2024-06-18 北京沃东天骏信息技术有限公司 图片广告推送方法、电子设备及计算机可读存储介质

Family Cites Families (15)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20030128389A1 (en) * 2001-12-26 2003-07-10 Eastman Kodak Company Method for creating and using affective information in a digital imaging system cross reference to related applications
JP4547214B2 (ja) * 2004-09-10 2010-09-22 富士フイルム株式会社 電子アルバム表示システム、電子アルバム表示方法、及びプログラム
US7716157B1 (en) * 2006-01-26 2010-05-11 Adobe Systems Incorporated Searching images with extracted objects
US20140237395A1 (en) * 2007-12-08 2014-08-21 John W. Ogilvie User Editing and Approval of an Intergenerational Historic Snapshot Message
JP4924742B2 (ja) * 2010-06-30 2012-04-25 カシオ計算機株式会社 画像処理装置及び方法、並びにプログラム
CN104050285B (zh) * 2014-06-27 2018-04-27 广州猎豹网络科技有限公司 一种照片存储方法及装置
CN104063465A (zh) * 2014-06-27 2014-09-24 广州金山网络科技有限公司 一种照片存储方法及装置
US20160125476A1 (en) * 2014-11-03 2016-05-05 Paula Stewart System, device, and method for selfie-enabled product promotion
CN105138681A (zh) * 2015-09-15 2015-12-09 成都品果科技有限公司 基于空间坐标定位的图片搜索方法及系统
CN105488111A (zh) * 2015-11-20 2016-04-13 小米科技有限责任公司 图像搜索方法及装置
CN106919604A (zh) * 2015-12-25 2017-07-04 北京奇虎科技有限公司 电子相册管理方法和装置
CN107832420A (zh) * 2017-11-10 2018-03-23 维沃移动通信有限公司 照片管理方法及移动终端
CN107908770A (zh) * 2017-11-30 2018-04-13 维沃移动通信有限公司 一种照片搜索方法及移动终端
US20210209700A1 (en) * 2018-06-06 2021-07-08 Mama K Best Ltd. System, device, and method of match-making
CN110851637A (zh) * 2019-09-26 2020-02-28 华为技术有限公司 一种图片搜索方法及设备

Also Published As

Publication number Publication date
CN110851637A (zh) 2020-02-28
US20220215050A1 (en) 2022-07-07
WO2021057421A1 (fr) 2021-04-01
EP4027252A4 (fr) 2022-10-12

Similar Documents

Publication Publication Date Title
CN109891874B (zh) 一种全景拍摄方法及装置
US9584694B2 (en) Predetermined-area management system, communication method, and computer program product
CN109156041B (zh) 分享图像的方法及电子设备
CN108924737B (zh) 定位方法、装置、设备及计算机可读存储介质
CN111164983B (zh) 互联终端出借本地处理能力
CN111327953B (zh) 直播投票方法及装置、存储介质
CN108886574B (zh) 一种拍摄引导方法、设备及系统
US20210160431A1 (en) Shooting Control Method and Terminal
US20220215050A1 (en) Picture Search Method and Device
CN110059686B (zh) 字符识别方法、装置、设备及可读存储介质
WO2018184260A1 (fr) Procédé et dispositif de correction pour image de document
US20230284000A1 (en) Mobile information terminal, information presentation system and information presentation method
CN110457571B (zh) 获取兴趣点信息的方法、装置、设备及存储介质
CN112764608A (zh) 消息处理方法、装置、设备及存储介质
CN112119623A (zh) 基于帐户组共享内容的方法和执行该方法的电子装置
CN113190307A (zh) 控件添加方法、装置、设备及存储介质
CN110837557B (zh) 摘要生成方法、装置、设备及介质
CN110929159B (zh) 资源投放方法、装置、设备及介质
CN109547847B (zh) 添加视频信息的方法、装置及计算机可读存储介质
CN102893295A (zh) 存储卡
WO2019153286A1 (fr) Procédé et dispositif de classification d'images
JPH10243263A (ja) 画像データ処理システムおよび画像処理装置
WO2016123743A1 (fr) Procédé d'appariement intelligent pour filtre et terminal
US20200265614A1 (en) Method of providing augmented reality contents and elecronic device therefor
CN110990728A (zh) 兴趣点信息的管理方法、装置、设备及存储介质

Legal Events

Date Code Title Description
STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: THE INTERNATIONAL PUBLICATION HAS BEEN MADE

PUAI Public reference made under article 153(3) epc to a published international application that has entered the european phase

Free format text: ORIGINAL CODE: 0009012

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: REQUEST FOR EXAMINATION WAS MADE

17P Request for examination filed

Effective date: 20220408

AK Designated contracting states

Kind code of ref document: A1

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

REG Reference to a national code

Ref country code: DE

Ref legal event code: R079

Free format text: PREVIOUS MAIN CLASS: G06F0016580000

Ipc: G06F0016532000

A4 Supplementary search report drawn up and despatched

Effective date: 20220912

RIC1 Information provided on ipc code assigned before grant

Ipc: G06F 16/58 20190101ALI20220906BHEP

Ipc: G06F 16/532 20190101AFI20220906BHEP

DAV Request for validation of the european patent (deleted)
DAX Request for extension of the european patent (deleted)
STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: EXAMINATION IS IN PROGRESS

17Q First examination report despatched

Effective date: 20230906