WO2020259522A1 - 一种内容查找方法、相关设备及计算机可读存储介质 - Google Patents

一种内容查找方法、相关设备及计算机可读存储介质 Download PDF

Info

Publication number
WO2020259522A1
WO2020259522A1 PCT/CN2020/097847 CN2020097847W WO2020259522A1 WO 2020259522 A1 WO2020259522 A1 WO 2020259522A1 CN 2020097847 W CN2020097847 W CN 2020097847W WO 2020259522 A1 WO2020259522 A1 WO 2020259522A1
Authority
WO
WIPO (PCT)
Prior art keywords
classification
pictures
picture
album list
list
Prior art date
Application number
PCT/CN2020/097847
Other languages
English (en)
French (fr)
Inventor
黄丽薇
王守诚
Original Assignee
华为技术有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 华为技术有限公司 filed Critical 华为技术有限公司
Publication of WO2020259522A1 publication Critical patent/WO2020259522A1/zh

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/50Information retrieval; Database structures therefor; File system structures therefor of still image data
    • G06F16/54Browsing; Visualisation therefor
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/50Information retrieval; Database structures therefor; File system structures therefor of still image data
    • G06F16/55Clustering; Classification
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0481Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
    • G06F3/0482Interaction with lists of selectable items, e.g. menus

Definitions

  • the present invention relates to the field of computer technology, in particular to a content search method, related equipment and computer-readable storage media.
  • the embodiment of the invention discloses a content search method, related equipment and a computer-readable storage medium, which can quickly find a picture that you want to search.
  • an embodiment of the present application provides a content search method, which includes:
  • the pictures in the album list are classified according to preset rules to obtain at least two classification sets and display classification labels corresponding to the at least two classification sets, where one classification set corresponds to one classification label;
  • At least one picture in the target classification set is displayed according to the selection operation.
  • the device first obtains the classification operation for the album list, and then classifies the pictures in the album list according to preset rules based on the classification operation, so that the user can select the desired classification based on at least two displayed classification sets.
  • a preliminary selection is made for the searched picture, and then the desired searched picture is searched in detail from the target classification set. It can be seen that the user only needs to focus on the search target classification, instead of searching one by one from the massive pictures contained in the album list, which significantly improves the efficiency of searching pictures.
  • the displaying at least one picture in the target classification set according to the selection operation includes: redisplaying the album according to the selection operation A list, wherein the picture being displayed in the re-displayed album display list includes at least one picture in the target classification set.
  • the device that executes the above method displays the album list, and after the execution of the above method, the device displays the album list, except for the pictures being displayed in the album list. Changes have taken place; if compared with the prior art, the prior art is equivalent to gradually turning the pages of the album list, while the embodiment of this application flips the pages and jumps directly to the location of the picture that needs to be found. Or near the location. Because all the album lists are displayed before and after the execution of the above method, there is no jump to other pages, which reduces the complexity of human-computer interaction.
  • the above described selection operation displays at least one picture in the target category set. Specifically, the list corresponding to the target classification set is displayed according to the selection operation. When there are fewer pictures in the target classification set, they can be displayed all at once. When there are more pictures in the target classification set, some of them are currently active. Show, another part to be shown. The parts to be displayed can be gradually displayed by scrolling (such as sliding on the touch screen, or clicking the slide bar with the mouse) corresponding to the target classification set (correspondingly, the previously displayed pictures will be hidden).
  • redisplaying the previous picture arrangement order in the pixel list, and redisplaying The sequence of the pictures in the subsequent pixel lists is the same. It can be seen that after the execution of the above method, only the vicinity of the picture that the user is looking for is quickly located, without any modification to the album list, which further reduces the complexity of human-computer interaction.
  • the obtaining of the classification operation for the album list includes:
  • N times of scrolling operations for the album list received within a preset time period are categorization operations for the album list, and N is greater than or equal to 2;
  • the scroll operation is used to update the pictures being displayed in the album list. That is to say, in this way, the device automatically and intelligently determines whether to categorize the album list according to the user's normal operation, and the user experience is better and the execution efficiency is higher.
  • N is greater than or equal to 2
  • the classification operation will not occur, because the user may be able to find the picture they want to find after a small amount of scrolling.
  • the classification operation is generated, which will cause the way to find the picture to become complicated; therefore, this application only generates the classification operation when there are many scrolling operations, making the originally difficult-to-find picture become It's easier to find.
  • the preset rule is used to classify pictures with similar screens into the same Classification is concentrated.
  • the list of albums is listed according to preset rules according to the classification operation Classify the pictures in to obtain at least two classification sets and display the classification labels corresponding to the at least two classification sets, including:
  • the classification labels corresponding to the at least two classification sets are displayed.
  • the fingerprint information of each picture in the album list is compared to the album
  • the pictures in the list are classified, and before at least two classification sets are obtained, it also includes:
  • NxM N is greater than or equal to 4, and M is greater than or equal to 4;
  • the fingerprint mark of the pixel is a second value, and the first pixel is any pixel in the first picture;
  • the list of albums is listed according to preset rules according to the classification operation. Classify the pictures in to obtain at least two classification sets and display the classification labels corresponding to the at least two classification sets, including:
  • the similarity matching model is obtained by training based on a large number of pictures and their respective category labels of;
  • the classification labels corresponding to the at least two classification sets are displayed.
  • the preset rule is used to meet the pre-determined location and/or time of picture generation. Suppose that pictures with similar conditions are classified into the same classification set.
  • an embodiment of the present application provides a content search device, which includes a processor, a memory, an input component, and a display component, wherein the memory is used to store a computer program, and the processor is used to call the computer program To perform the following operations:
  • the pictures in the album list are classified according to preset rules, at least two classification sets are obtained, and the classification labels corresponding to the at least two classification sets are displayed through the display component, of which, one The classification set corresponds to a classification label;
  • At least one picture in the target classification set is displayed through the display component according to the selection operation.
  • the device first obtains the classification operation for the album list, and then classifies the pictures in the album list according to preset rules based on the classification operation, so that the user can select the desired classification based on at least two displayed classification sets.
  • a preliminary selection is made for the searched picture, and then the desired searched picture is searched in detail from the target classification set. It can be seen that the user only needs to focus on the search target classification, instead of searching one by one from the massive pictures contained in the album list, which significantly improves the efficiency of searching pictures.
  • the displaying at least one picture in the target classification set through the display component according to the selection operation includes: according to the selection operation The album list is re-displayed through the display component, wherein the picture being displayed in the re-displayed album display list includes at least one picture in the target classification set.
  • the device that executes the above method displays the album list, and after the execution of the above method, the device displays the album list, except for the pictures being displayed in the album list. Changes have taken place; if compared with the prior art, the prior art is equivalent to gradually turning the pages of the album list, while the embodiment of this application flips the pages and jumps directly to the location of the picture that needs to be found. Or near the location. Because all the album lists are displayed before and after the execution of the above method, there is no jump to other pages, which reduces the complexity of human-computer interaction.
  • the above described selection operation displays at least one picture in the target category set. Specifically, the list corresponding to the target classification set is displayed according to the selection operation. When there are fewer pictures in the target classification set, they can be displayed all at once. When there are more pictures in the target classification set, some of them are currently active. Show, another part to be shown. The parts to be displayed can be gradually displayed by scrolling (such as sliding on the touch screen, or clicking the slide bar with the mouse) corresponding to the target classification set (correspondingly, the previously displayed pictures will be hidden).
  • redisplaying the previous picture arrangement order in the pixel list, and redisplaying The sequence of the pictures in the subsequent pixel lists is the same. It can be seen that after executing the above method, it only quickly locates the nearby location of the picture that the user is looking for, and does not make any modification to the album list, which further reduces the complexity of human-computer interaction.
  • the obtaining of the classification operation for the album list includes:
  • N times of scrolling operations for the album list received within a preset time period are categorization operations for the album list, and N is greater than or equal to 2;
  • the scroll operation is used to update the pictures being displayed in the album list. That is to say, in this way, the device automatically and intelligently determines whether to categorize the album list according to the user's normal operation, and the user experience is better and the execution efficiency is higher.
  • N is greater than or equal to 2
  • the classification operation will not occur, because the user may be able to find the picture they want to find after a small amount of scrolling.
  • the classification operation is generated, which will cause the way to find the picture to become complicated; therefore, this application only generates the classification operation when there are many scrolling operations, making the originally difficult-to-find picture become It's easier to find.
  • the preset rule is used to classify pictures with similar pictures into the same Classification is concentrated.
  • the list of albums is listed according to preset rules according to the classification operation. Classify the pictures in to obtain at least two classification sets and display the classification labels corresponding to the at least two classification sets through the display component, including:
  • the classification labels corresponding to the at least two classification sets are displayed through the display component.
  • the said album is checked according to the fingerprint information of each picture in the album list.
  • the pictures in the list are classified, and before at least two classification sets are obtained, it also includes:
  • NxM N is greater than or equal to 4, and M is greater than or equal to 4;
  • the fingerprint mark of the pixel is a second value, and the first pixel is any pixel in the first picture;
  • the list of albums is listed according to preset rules according to the classification operation. Classify the pictures in to obtain at least two classification sets and display the classification labels corresponding to the at least two classification sets through the display component, including:
  • the similarity matching model is obtained by training based on a large number of pictures and their respective category labels of;
  • the classification labels corresponding to the at least two classification sets are displayed through the display component.
  • the preset rule is used to meet the pre-determined location and/or time of picture generation. Suppose that pictures with similar conditions are classified into the same classification set.
  • an embodiment of the present application provides a content search device, which includes all or part of the functional units used to execute the first aspect or any one of the possible implementations of the first aspect.
  • an embodiment of the present application provides a computer-readable storage medium in which a computer program is stored, and when it runs on a processor, it implements the first aspect or any one of the first aspect.
  • a computer program is stored, and when it runs on a processor, it implements the first aspect or any one of the first aspect.
  • the device first obtains the classification operation for the album list, and then based on the classification operation, it classifies the pictures in the album list according to preset rules, so that the user can according to the displayed At least two classification sets make a preliminary selection of the picture that you want to find, and then search for the picture you need to find in detail from the target classification set. It can be seen that the user only needs to focus on the search target classification, instead of searching one by one from the massive pictures contained in the album list, which significantly improves the efficiency of searching pictures.
  • Figure 1 is a schematic structural diagram of a device provided by an embodiment of the present invention.
  • FIG. 2 is a schematic diagram of the architecture of an operating system provided by an embodiment of the present invention.
  • FIG. 3 is a schematic flowchart of a content search method provided by an embodiment of the present invention.
  • FIG. 4A is a schematic diagram of a display effect provided by an embodiment of the present invention.
  • 4B is another schematic diagram of the display effect provided by the embodiment of the present invention.
  • 4C is another schematic diagram of the display effect provided by the embodiment of the present invention.
  • 4D is another schematic diagram of the display effect provided by the embodiment of the present invention.
  • Fig. 5 is a schematic structural diagram of another device provided by an embodiment of the present invention.
  • FIG. 1 is a schematic structural diagram of a device 100 applied in an embodiment of the present invention.
  • the device may include handheld devices with picture display functions (e.g., mobile phones, tablets, palmtop computers, etc.), vehicle-mounted devices (e.g., cars, bicycles, electric vehicles, airplanes, ships, etc.), wearable devices (e.g., smart watches ( Such as iWatch, etc.), smart bracelets, pedometers, etc.), smart home devices (for example, refrigerators, TVs, air conditioners, electric meters, etc.), smart robots, etc.
  • picture display functions e.g., mobile phones, tablets, palmtop computers, etc.
  • vehicle-mounted devices e.g., cars, bicycles, electric vehicles, airplanes, ships, etc.
  • wearable devices e.g., smart watches ( Such as iWatch, etc.), smart bracelets, pedometers, etc.
  • smart home devices for example, refrigerators, TVs, air conditioners, electric meters, etc.
  • smart robots etc.
  • the device 100 includes a memory 180, a processor 150, and a display device 140.
  • the memory 180 stores computer programs.
  • the computer programs include an operating system program 182 and an application program 181, among which the application program 181 includes an album program.
  • the processor 150 is used to read the computer program in the memory 180, and then execute the method defined by the computer program.
  • the processor 150 reads the operating system program 182 to run the operating system on the device 100 and implement various functions of the operating system.
  • read one or more application programs 181 to run the application on the device for example, read the photo album program to run the photo album client (it can be built in the operating system of the device, or it can be installed later in the operation) On the system).
  • the processor 150 may include one or more processors, for example, the processor 150 may include one or more central processors. When the processor 150 includes multiple processors, the multiple processors may be integrated on the same chip, or each may be an independent chip.
  • a processor may include one or more processing cores. The following embodiments all take multi-core as an example to introduce, but the content search method provided in the embodiments of the present invention may also be applied to a single-core processor.
  • the memory 180 also stores other data 183 in addition to the computer program.
  • the other data 183 may include data generated after the operating system 182 or the application program 181 is run.
  • the data includes system data (such as operating system configuration parameters) and User data, such as picture data in an album, can be regarded as user data.
  • the storage 180 generally includes internal memory and external storage.
  • the memory can be random access memory (RAM), read only memory (ROM), and cache (CACHE), etc.
  • External storage can be hard disk, CD, USB disk, floppy disk or tape drive, etc.
  • Computer programs are usually stored on external memory, and the processor loads the computer programs from external memory to memory before executing processing.
  • the picture in the embodiment of the present invention can be stored on the external memory, and when it needs to be displayed, it can be loaded into the memory.
  • the operating system program 182 includes a computer program that can implement the content search method provided by the embodiment of the present invention, so that after the processor 150 reads the operating system program 182 and runs the operating system, the operating system can be equipped with the implementation of the present invention.
  • the content search function provided by the example. Further, the operating system can open the calling interface of the content search function to the upper application. After the processor 150 reads the application 181 from the memory 180 and runs the application, the application can call the operating system through the calling interface. Content search provided in to help users find pictures quickly.
  • the device 100 may also include an input device 130 (also called an input component) for receiving input digital information, character information or contact touch operations/non-contact gestures, and generating signals related to user settings and function control of the device 100 Input etc.
  • the input device 130 may include a touch panel 131.
  • the touch panel 131 also called a touch screen, can collect the user's touch operations on or near it (for example, the user uses any suitable objects or accessories such as fingers, stylus, etc.) on the touch panel 131 or on the touch panel 131 ), and drive the corresponding connection device according to the preset program.
  • the touch panel 131 may include two parts: a touch detection device and a touch controller.
  • the touch detection device detects the user's touch position, detects the signal brought by the touch operation, and transmits the signal to the touch controller; the touch controller receives the touch information from the touch detection device, converts it into contact coordinates, and then sends it To the processor 150, and can receive and execute the commands sent by the processor 150.
  • the user clicks a virtual button with a finger on the touch panel 131 the touch detection device detects the signal brought about by this click, and then transmits the signal to the touch controller, and the touch controller transmits the signal
  • the converted coordinates are sent to the processor 150, and the processor 150 executes a content search function according to the coordinates and the type of the signal (click or double click), and displays the searched picture on the display panel 141.
  • the touch panel 131 can be implemented in multiple types such as resistive, capacitive, infrared, and surface acoustic wave.
  • the input device 130 may also include other input devices 132.
  • Other input devices 132 may include, but are not limited to, a physical keyboard, function keys (such as volume control buttons, switch buttons, etc.), trackball, mouse, joystick, etc. One or more of.
  • the device 100 may also include a display device 140 (also called a display component).
  • the display device 140 includes a display panel 141 for displaying information input by the user or information provided to the user, as well as various menu interfaces of the device 100, etc.
  • the embodiment of the invention is mainly used to display pictures in the album list.
  • the display device 140 may include a display panel 141.
  • it may be configured in the form of a liquid crystal display (English: Liquid Crystal Display, abbreviation: LCD) or an organic light emitting diode (English: Organic Light-Emitting Diode, abbreviation: OLED), etc.
  • Display panel 141 In some other embodiments, the touch panel 131 may cover the display panel 141 to form a touch screen.
  • the device 100 may also include a power supply 190 for powering other modules, a camera 160 for taking photos or videos, a positioning module (such as GPS) 161 for acquiring the geographic location of the device, and 161 for acquiring the placement posture of the device. (Such as angle, azimuth, etc.) gyroscope 162, timer 163 for recording time; among them, the pictures in the album in the embodiment of the present invention may include those taken by the camera 160, or may include pictures obtained by other means, such as Pictures obtained through screenshots, downloads, etc.; the device 100 may also include one or more sensors 120, such as acceleration sensors, light sensors, and so on.
  • the device 100 may also include a radio frequency (RF) circuit 110 for performing network communication with wireless network devices, and may also include a WiFi module 170 for performing WiFi communication with other devices.
  • RF radio frequency
  • the above mainly introduces the specific process of the method provided by the embodiment of the present invention.
  • the following takes the Android operating system as an example in conjunction with FIG. 2 to introduce the implementation location and runtime state of the method provided by the embodiment of the present invention.
  • FIG. 2 is a schematic structural diagram of a device 200 according to an embodiment of the present invention.
  • the device 200 may be the device of the embodiment of the present invention.
  • the device 200 includes an application layer 210 and an operating system layer 250, and the operating system may be an Android operating system.
  • the operating system layer 250 is further divided into a framework layer 220, a core library layer 230, and a driver layer 240.
  • the operating system layer 250 in FIG. 2 may be considered as a specific implementation of the operating system 182 in FIG. 1
  • the application layer 210 in FIG. 2 may be considered as a specific implementation of the application program 181 in FIG. 1.
  • the driver layer 240 includes a CPU driver 241, a GPU driver 242, a display controller driver 243, a positioning module driver 244, a gyroscope driver 245, a timer driver 246, and so on.
  • the core library layer 230 is the core part of the operating system, including input/output service 231, core service 232, media service 234, etc.
  • the media service 243 includes JPEG format picture library 1, PNG format picture library 2 and other formats A picture library.
  • the media service 243 also includes an algorithm library for storing algorithms related to picture processing in the present invention, for example, an algorithm for selecting a first picture, an algorithm for selecting a reference picture, and so on.
  • the framework layer 220 may include a graphic service (Graphic Service) 224, a system service (System service) 221, a web service (Web Service) 222, and a user service (Customer Service) 223, etc.; the graphic service 224 may include, for example, image coding Codec, Video coding Codec and audio coding Codec, etc., the solution of the present invention is applied to the image coding.
  • the application layer 210 may include a gallery 211, a media player (Media Player) 212, a browser (Browser) 213, and so on.
  • the computer system 200 further includes a hardware layer 250.
  • the hardware layer of the computer system 200 may include a central processing unit (CPU) 251 and a graphics processing unit (GPU) 252 (equivalent to a specific implementation of the processor 150 in FIG. 1), and It may include a memory 253 (equivalent to the memory 180 in FIG. 1), including memory and external memory, and may also include a positioning module 254 (equivalent to the positioning module 161 in FIG. 1) and a gyroscope 255 (equivalent to the display in FIG. 1
  • the device 162) may also include a timer 256 (equivalent to the timer 163 in FIG.
  • the hardware layer 250 may also include the power supply, camera, RF circuit, and WiFi module shown in FIG. 1, and may also include other hardware modules not shown in FIG. 1, such as a memory controller and display control. ⁇
  • FIG. 3 is a schematic flowchart of a content search method provided by an embodiment of the present invention.
  • the method can be implemented based on the device shown in FIG. 1 or devices with other structures.
  • the method includes but is not limited to the following steps :
  • Step S301 The device obtains the classification operation for the album list.
  • the album list includes the pictures being displayed and the pictures to be displayed. image.
  • the picture being displayed here can be an original picture or a thumbnail.
  • the album list usually displays one picture at the same time.
  • the album list usually displays at least at the same time. Two pictures. Regardless of whether the thumbnail or the original image is displayed, the user can gradually display the unshown pictures in the album list by scrolling. When the unshown pictures in the album list are displayed, the originally displayed pictures will gradually be hidden.
  • the scrolling operation here can be specifically a sliding operation, for example, the user sliding on the touch screen of the device; the scrolling operation can also be an operation of pulling a scroll bar, and the position of the scroll bar on the track is different, the pictures displayed in the album list are also different .
  • the scrolling operation may also be other forms of operations, and other forms of operations will not be given as examples here.
  • the pictures in the album list are assumed to be saved in the mDatas data list.
  • the pictures in the album list are a complete set, and the view displayed by the pictures is mGridView.
  • Android system Will bind mGridView with mDatas.
  • the obtaining of the classification operation for the album list may be specifically: receiving N scroll operations for the album list within a preset time period, and the received operations for the album list within the preset time period N times of scrolling operations of the album list are categorization operations for the album list, and N is greater than or equal to 2; the scrolling operation is used to update the pictures being displayed in the album list.
  • the preset time period here can be 3 seconds, or 5 seconds, or 6 seconds, or another short period of time. It is understandable that if the user performs N scrolling in this short period of time Operation, you can determine that the user is scrolling through the album list quickly and continuously.
  • the device automatically and intelligently determines whether to categorize the album list according to the user's normal operation, and the user experience is better and the execution efficiency is higher.
  • N is greater than or equal to 2, that is, when the user scrolls the album list a few times, the classification operation will not occur, because the user may be able to find the picture they want to find after a small amount of scrolling.
  • the classification operation is generated, which will cause the way of searching for pictures to become complicated; therefore, the embodiment of the present application only generates the classification operation when there are many scrolling operations.
  • a virtual (or physical) operation button is also displayed on the screen.
  • Step S302 The device classifies the pictures in the album list according to preset rules according to the classification operation, obtains at least two classification sets, and displays classification labels corresponding to the at least two classification sets.
  • one classification set corresponds to one classification label.
  • classification criteria are some examples of classification criteria:
  • the first criterion is to classify images according to the similarity of pictures, and pictures with high similarity are classified into the same category.
  • Solution 1 First, all the pictures in the album list are scaled to a size of NxM, where N is greater than or equal to 4, and M is greater than or equal to 4. Then, the average gray value of the pixels in the first picture is calculated, and the first The picture is any picture in the album list; then, the difference between the pixel value of the first pixel in the first picture and the average gray value, the difference is greater than or equal to zero, the fingerprint of the first pixel is marked as the first If the difference is less than zero, the fingerprint of the first pixel is marked as a second value, and the first pixel is any pixel in the first picture; after that, it is adjusted according to the arrangement of the pixels in the first picture The fingerprints of the pixels in the first picture are arranged to obtain fingerprint information of the first picture, and further, the pictures in the album list are classified according to the fingerprint information of the pictures in the album list to obtain at least Two classification sets, where pictures with fingerprint information reaching a preset similarity condition are used to be classified into the same classification set. The higher the fingerprint information similar
  • step1 reduce the size: reduce each picture in the album list to the size of 8x8 (pixel matrix), a total of 64 pixels.
  • the function of this step is to remove the details of the picture, only retain basic information such as structure/shading, and discard the picture differences caused by different sizes/proportions; the above data size is 8x8 or other sizes, which can be adjusted by specific software parameters.
  • step2 simplify the color: convert the reduced picture to 64-level grayscale, that is, for a picture, all pixels in it have only 64 colors in total.
  • Step3 calculate the average value: Calculate the average gray value of all 64 pixels in a picture.
  • step4 compare the grayscale of pixels: compare the grayscale of each pixel in the picture with the average value. If it is greater than or equal to the average value, the fingerprint of the corresponding pixel is recorded as 1, and if it is less than the average value, the corresponding pixel's fingerprint The fingerprint is recorded as 0;
  • Step5 Calculate the hash value: Combine the comparison results of the previous step (ie the fingerprints of each pixel in the picture) together to form a 64-bit integer, which is the fingerprint of the picture.
  • the order of the combination is not important, as long as all pictures are in the same order.
  • Step6 After getting the fingerprint information of this picture, we can use the same principle to get the fingerprint information of other pictures, and then compare the fingerprint information of different pictures to see how many bits of the 64 bits are different, we can set A threshold value defines the similarity; for example, the threshold value can be set to 50. If two pictures have the same number of bits greater than or equal to 50, the two pictures are considered similar, so the two pictures are classified as the same Classification is concentrated.
  • classification set A As shown in Fig. 4A, three classification sets classified according to similarity are schematically shown, namely, classification set A, classification set B, and classification set C.
  • Solution 2 First, input the pictures in the album list into a similar matching model to generate a picture category label for each picture in the album list; the similar matching model is based on a large number of pictures and each of the large number of pictures.
  • the category labels of are obtained through training; then, the pictures with the same category labels are classified into the same classification set to obtain at least two classification sets.
  • use machine learning to intelligently classify images Generally speaking, the more samples used to train the similar matching model and the more reasonable the model parameter configuration, the better the classification effect.
  • the second criterion is to classify the pictures according to the similarity of the generation time of the pictures, and the pictures with close generation times are classified into the same category.
  • a time span threshold can be pre-configured, and when the time interval between the generation (for example, shooting) times of any two pictures does not exceed the time span threshold, the two pictures can be classified into a classification set.
  • the time span threshold can be set to 1 hour, half an hour, 2 hours, etc., which can be specifically set as required.
  • the third criterion is to classify the pictures according to the similarity of the places where the pictures are generated, and pictures with similar places to be generated are classified into the same category.
  • a distance span threshold can be pre-configured, and when the distance between the generation (for example, shooting) positions of any two pictures does not exceed the distance span threshold, the two pictures can be classified into a classification set.
  • the distance span threshold can be set to 5 kilometers, 10 kilometers, 20 kilometers, etc., which can be specifically set as required.
  • the fourth criterion is classified according to the similarity of the time when the pictures are generated and the similarity of the places where the pictures are generated.
  • the specific implementation can refer to the second criterion and the third criterion, which will not be further described here.
  • the device after the device obtains at least two classification sets in the above manner, it displays the classification labels (also referred to as "classification indexes") corresponding to the at least two classification sets.
  • the classification label of any classification set is information that can indicate the characteristics of the classification set to the user, for example, a thumbnail of a picture (for example, the first picture) in the classification set, or can describe the classification set A piece of text information with corresponding characteristics of the corresponding feature, and so on.
  • the first picture in the classification set is selected as the classification label of the classification set.
  • the effect of displaying the respective classification labels of the above classification set A, classification set B, and classification set C can be as shown in FIG. 4C.
  • These classification labels can also have other display methods, and no examples are given here.
  • the Android operating system When the user scrolls through the content displayed in the album list in rapid succession, the system will receive the onFling callback operation. At this time, you can get the classification label list mDataIndexs, and immediately set the data bound to the view mGridView For mDataIndexs, the interface view display format may be as shown in Figure 4C.
  • Step S303 The device receives a selection operation for a classification label of a target classification set in the at least two classification sets.
  • the user can perform a selection operation on the classification label of any one of the at least two classification sets.
  • the user performs the selection operation on the classification label of which classification set, then which classification set is here The target classification set.
  • the way of performing the selection operation may specifically be clicking on the classification label displayed on the touch display screen.
  • the device correspondingly receives the selection and selection operation for the classification label of the target classification set.
  • Step S304 The device displays at least one picture in the target classification set according to the selection operation.
  • the device can display one or more pictures in the classification set A on the display screen; if the device receives a classification label for classification set B, then the device One or more pictures in the classification set B can be displayed on the display screen; if the device receives a classification label for the classification set C, the device can display one or more pictures in the classification set C on the display screen.
  • the displaying at least one picture in the target category set according to the selection operation may specifically be: returning to displaying the album list according to the selection operation, wherein, redisplaying The picture being displayed in the album display list includes at least one picture in the target classification set.
  • the device that executes the above method displays the album list, and after the execution of the above method, the device displays the album list, except for the pictures being displayed in the album list. Changes have taken place; if compared with the prior art, the prior art is equivalent to gradually turning the pages of the album list, while the embodiment of this application flips the pages and jumps directly to the location of the picture that needs to be found. Or near the location. Because all the album lists are displayed before and after the execution of the above method, there is no jump to other pages, which reduces the complexity of human-computer interaction.
  • the arrangement order of the pictures in the pixel list before the redisplay is the same as the arrangement order of the pictures in the pixel list after the redisplay. It can be seen that after the execution of the above method, only the vicinity of the picture that the user is looking for is quickly located, without any modification to the album list, which further reduces the complexity of human-computer interaction.
  • the displaying at least one picture in the target classification set according to the selection operation may be specifically displaying a list corresponding to the target classification set according to the selection operation, when the When there are few pictures in the target classification set, they can be displayed all at once. When there are many pictures in the target classification set, one part is being displayed and the other part is to be displayed. The parts to be displayed can be gradually displayed by scrolling (such as sliding on the touch screen, or clicking the slide bar with the mouse) corresponding to the target classification set (correspondingly, the previously displayed pictures will be hidden).
  • the device first obtains the classification operation for the album list, and then based on the classification operation, the pictures in the album list are classified according to preset rules, so that the user can display at least two
  • the classification set makes a preliminary selection of the picture that you want to find, and then searches the desired picture in detail from the target classification set. It can be seen that the user only needs to focus on the search target classification, instead of searching one by one from the massive pictures contained in the album list, which significantly improves the efficiency of searching pictures.
  • FIG. 5 is a schematic structural diagram of a content search device 50 provided by an embodiment of the present invention.
  • the device 50 may include an obtaining unit 501, a classification unit 502, a receiving unit 503, and a display unit 504. The description of each unit as follows.
  • the obtaining unit 501 is configured to obtain a categorization operation for an album list, the album list including pictures being displayed and pictures to be displayed;
  • the categorization unit 502 is configured to categorize the pictures in the album list according to preset rules according to the categorization operation to obtain at least two classification sets and display the classification labels corresponding to the at least two classification sets, where , A classification set corresponds to a classification label;
  • the receiving unit 503 is configured to receive a selection operation for a classification label of a target classification set in the at least two classification sets;
  • the display unit 504 is configured to display at least one picture in the target classification set according to the selection operation.
  • the device first obtains the classification operation for the album list, and then classifies the pictures in the album list according to preset rules based on the classification operation, so that the user can select the desired classification based on at least two displayed classification sets.
  • a preliminary selection is made for the searched picture, and then the desired searched picture is searched in detail from the target classification set. It can be seen that the user only needs to focus on the search target classification, instead of searching one by one from the massive pictures contained in the album list, which significantly improves the efficiency of searching pictures.
  • the display unit is specifically configured to: redisplay the album list according to the selection operation, wherein: The picture being displayed in the redisplayed album display list includes at least one picture in the target category set.
  • the device that executes the above method displays the album list, and after the execution of the above method, the device displays the album list, except for the pictures being displayed in the album list. Changes have taken place; if compared with the prior art, the prior art is equivalent to gradually turning the pages of the album list, while the embodiment of this application flips the pages and jumps directly to the location of the picture that needs to be found. Or near the location. Because all the album lists are displayed before and after the execution of the above method, there is no jump to other pages, which reduces the complexity of human-computer interaction.
  • the above described selection operation displays at least one picture in the target category set. Specifically, the list corresponding to the target classification set is displayed according to the selection operation. When there are fewer pictures in the target classification set, they can be displayed all at once. When there are more pictures in the target classification set, some of them are currently active. Show, another part to be shown. The parts to be displayed can be gradually displayed by scrolling (such as sliding on the touch screen, or clicking the slide bar with the mouse) corresponding to the target classification set (correspondingly, the previously displayed pictures will be hidden).
  • the arrangement order of the pictures in the pixel list before the redisplay is the same as the arrangement order of the pictures in the pixel list after the redisplay. It can be seen that after the execution of the above method, only the vicinity of the picture that the user is looking for is quickly located, without any modification to the album list, which further reduces the complexity of human-computer interaction.
  • the obtaining unit is specifically configured to:
  • N times of scrolling operations for the album list received within a preset time period are categorization operations for the album list, and N is greater than or equal to 2;
  • the scroll operation is used to update the pictures being displayed in the album list. That is to say, in this way, the device automatically and intelligently determines whether to categorize the album list according to the user's normal operation, and the user experience is better and the execution efficiency is higher.
  • N is greater than or equal to 2
  • the classification operation will not occur, because the user may be able to find the picture they want to find after a small amount of scrolling.
  • the classification operation is generated, which will cause the way to find the picture to become complicated; therefore, this application only generates the classification operation when there are many scrolling operations, making the originally difficult-to-find picture become It's easier to find.
  • the preset rule is used to classify pictures with similar pictures into the same classification set.
  • the pictures in the album list are classified according to preset rules according to the classification operation to obtain at least two classification sets and display the corresponding
  • the classification unit is specifically configured to: classify the pictures in the album list according to their respective fingerprint information in the album list to obtain at least two classification sets, wherein the fingerprint information reaches a preset value
  • the pictures with similar conditions are used to be classified into the same classification set. The higher the fingerprint information similarity of any two pictures, the more similar the pictures of any two pictures; the classification labels corresponding to the at least two classification sets are displayed .
  • the device further includes a fingerprint generation unit, configured to classify the pictures in the album list according to their respective fingerprint information in the album list to obtain at least two Before the classification set, perform the following operations:
  • NxM N is greater than or equal to 5
  • M is greater than or equal to 5
  • the fingerprint mark of the pixel is a second value, and the first pixel is any pixel in the first picture;
  • the pictures in the album list are classified according to preset rules according to the classification operation to obtain at least two classification sets and display the classifications corresponding to the at least two classification sets Label, the classification unit is specifically used for:
  • the similarity matching model is obtained by training based on a large number of pictures and their respective category labels of;
  • the classification labels corresponding to the at least two classification sets are displayed.
  • the preset rule is used to classify the pictures whose place and/or time the picture is generated meets a preset similarity condition into the same classification set.
  • each unit may also correspond to the corresponding description of the method embodiment shown in FIG. 3.
  • the device first obtains the categorization operation for the album list, and then based on the categorization operation, it classifies the pictures in the album list according to preset rules, so that the user can according to the displayed At least two classification sets make a preliminary selection of the picture that you want to find, and then search for the picture you need to find in detail from the target classification set. It can be seen that the user only needs to focus on the search target classification, instead of searching one by one from the massive pictures contained in the album list, which significantly improves the efficiency of searching pictures.
  • An embodiment of the present invention also provides a chip system, the chip system includes at least one processor, a memory, and an interface circuit.
  • the memory, the transceiver, and the at least one processor are interconnected by wires, and the at least one memory
  • a computer program is stored therein; when the computer program is executed by the processor, the method flow shown in FIG. 3 is realized.
  • the embodiment of the present invention also provides a computer-readable storage medium in which a computer program is stored, and when it runs on a processor, the method flow shown in FIG. 3 is implemented.
  • the embodiment of the present invention also provides a computer program product, which implements the method flow shown in FIG. 3 when the computer program product runs on the processor.
  • the device first obtains the classification operation for the album list, and then classifies the pictures in the album list according to preset rules based on the classification operation, so that the user can according to the displayed at least
  • the two classification sets make a preliminary selection of the pictures you want to find, and then find the pictures you need to find from the target classification set in detail. It can be seen that the user only needs to focus on the search target classification, instead of searching one by one from the massive pictures contained in the album list, which significantly improves the efficiency of searching pictures.
  • the process can be completed by a computer program and computer program-related hardware.
  • the computer program can be stored in a computer readable storage medium.
  • the computer program During execution, it may include the processes of the foregoing method embodiments.
  • the aforementioned storage media include: ROM or random storage RAM, magnetic disks or optical disks and other media that can store computer program codes.

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Data Mining & Analysis (AREA)
  • Databases & Information Systems (AREA)
  • Human Computer Interaction (AREA)
  • Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
  • User Interface Of Digital Computer (AREA)
  • Processing Or Creating Images (AREA)

Abstract

本发明实施例提供一种内容查找方法、相关设备及计算机可读存储介质,该方法包括:获取针对相册列表的归类操作,所述相册列表包括正在展示的图片和待展示的图片;根据所述归类操作按照预设规则对所述相册列表中的图片进行归类,得到至少两个分类集并展示所述至少两个分类集对应的分类标签,其中,一个分类集对应一个分类标签;接收针对所述至少两个分类集中的目标分类集的分类标签的选择操作;根据所述选择操作展示所述目标分类集中的至少一张图片。采用本发明实施例,能够快速找到想要查找的图片。

Description

一种内容查找方法、相关设备及计算机可读存储介质
本申请要求在2019年6月26日提交中国国家知识产权局、申请号为201910564958.6的中国专利申请的优先权,发明名称为“一种内容查找方法、相关设备及计算机可读存储介质”的中国专利申请的优先权,其全部内容通过引用结合在本申请中。
技术领域
本发明涉及计算机技术领域,尤其涉及一种内容查找方法、相关设备及计算机可读存储介质。
背景技术
目前电子设备(例如手机、iWatch、ipad等)已经非常普及,人们可以通过电子设备进行购物、阅读、听音乐、观看视频、拍摄照片,其中,拍摄照片是电子设备的一项非常重要的功能,无论是在一些难忘的时刻,还是在一些优美的景色中,用户都喜欢拍摄大量的照片。随着手机的存储能力不断提高,很多手机能够存储好几年拍摄的照片,数量高达几百、几千。
当用户从海量照片中寻找某一张特定的照片时,通常需要从图片列表中一页页的翻阅,如果是较久远的照片那就需要花很多时间来逐一翻阅,耗时非常漫长。因此,如何快速从图片列表中找到特定的图片是本领域的技术人员正在研究的技术问题。
发明内容
本发明实施例公开了一种内容查找方法、相关设备及计算机可读存储介质,能够快速找到想要查找的图片。
第一方面,本申请实施例提供一种内容查找方法,该方法包括:
获取针对相册列表的归类操作,所述相册列表包括正在展示的图片和待展示的图片;
根据所述归类操作按照预设规则对所述相册列表中的图片进行归类,得到至少两个分类集并展示所述至少两个分类集对应的分类标签,其中,一个分类集对应一个分类标签;
接收针对所述至少两个分类集中的目标分类集的分类标签的选择操作;
根据所述选择操作展示所述目标分类集中的至少一张图片。
上述方法中,设备首先获取到针对相册列表的归类操作,然后基于该归类操作将相册列表中的图片按照预设规则进行分类,这样用户就可以根据显示的至少两个分类集对想要查找的图片进行一个初步的选择,之后再从该目标分类集中详细查找所需要查找的图片。可以看出来,用户只需要将主要的精力放在查找目标分类集中即可,而无需从该相册列表包含的海量图片中逐一查找,显著提高了查找图片的效率。
结合第一方面,在第一方面的第一种可能的实现方式中,所述根据所述选择操作展示所述目标分类集中的至少一张图片,包括:根据所述选择操作重新展示所述相册列表,其中,重新展示的所述相册展示列表中正在展示的图片包括所述目标分类集中的至少一张图片。
也即是说,在执行上述方法的起始时刻,执行上述方法的设备显示的是相册列表,在上述方法执行完之后该设备显示的还是该相册列表,只不过该相册列表中正在展示的图片发生了改变;如果跟现有技术相比的话,现有技术相当于要对相册列表逐渐的翻页,而本申请实施例是跳跃性地翻页,直接跳到需要找的图片的所在的位置或所在位置的附近。由于上述方法执行前后显示的都是相册列表,没有跳到其他页面,降低了人机交互的复杂度。
需要说明的是,以上方式讲述的是设备执行上述方法之后还是回到该相册列表,实际应用中还存在其他可能性,例如,上述根据所述选择操作展示所述目标分类集中的至少一张图片具体是,根据所述选择操作展示所述目标分类集对应的列表,当该目标分类集中的图片较少时,可以一次性全部展示出来,当该目标分类集中的图片较多时,就有一部分正在展示,另一部分待展示。可以通过滚动(如在触摸屏上滑动,或者鼠标点击滑动条等)目标分类集对应的列表来使得待展示的部分逐渐展示出来(相应的,先前展示的图片就会隐藏起来)。
结合第一方面,或者第一方面的上述任一种可能的实现方式,在第一方面的第二种可能的实现方式中,重新展示之前的所述像素列表中的图片排列顺序,与重新展示之后的所述像素列表中的图片排列顺序相同。可以看出,执行完上述方法之后仅仅是快速定位到了用户要找的图片的附近位置,而并未对相册列表做任何修改,进一步降低了人机交互的复杂度。
结合第一方面,或者第一方面的上述任一种可能的实现方式,在第一方面的第三种可能的实现方式中,所述获取针对相册列表的归类操作,包括:
在预设时间段内接收针对相册列表的N次滚动操作,所述预设时间段内接收的针对所述相册列表的N次滚动操作为针对所述相册列表的归类操作,N大于或等于2;所述滚动操作用于对所述相册列表中正在展示的图片进行更新。也即是说,该方式由设备根据用户的常规操作自动智能化确定是否对相册列表进行归类,用户体验更好且执行效率更高。另外,由于N大于或等于2,即当用户滚动相册列表的次数不多的时候不会产生归类操作,因为用户进行少量的滚动操作有可能就能够找到想要找的图片,如果在少量滚动操作的情况下就产生归类操作,那么就会导致将查找图片的方式变得复杂了;因此本申请仅在滚动操作较多的情况下才产生归类操作,使得原本难查找的图片变得更容易查找了。
结合第一方面,或者第一方面的上述任一种可能的实现方式,在第一方面的第四种可能的实现方式中,所述预设规则用于将画面相近的图片归类到同一个分类集中。
结合第一方面,或者第一方面的上述任一种可能的实现方式,在第一方面的第五种可能的实现方式中,所述根据所述归类操作按照预设规则对所述相册列表中的图片进行归类,得到至少两个分类集并展示所述至少两个分类集对应的分类标签,包括:
根据所述相册列表中图片各自的指纹信息对所述相册列表中的图片进行归类,得到至少两个分类集,其中,指纹信息达到预设的相似条件的图片用于归类到同一个分类集,任意两张图片的指纹信息相似度越高则所述任意两张图片的画面越相近;
展示所述至少两个分类集对应的分类标签。
结合第一方面,或者第一方面的上述任一种可能的实现方式,在第一方面的第六种可能的实现方式中,所述根据所述相册列表中图片各自的指纹信息对所述相册列表中的图片进行归类,得到至少两个分类集之前,还包括:
将所述相册列表中的图片均缩放为NxM尺寸,N大于或等于4,M大于或等于4;
计算第一图片中的像素的平均灰度值,所述第一图片为所述相册列表中的任意一张图片;
将所述第一图片中的第一像素的像素值与所述平均灰度值作差,差大于或等于零则所述第一像素的指纹标记为第一数值,差小于零则所述第一像素的指纹标记为第二数值,所述第一像素为所述第一图片中的任意一个像素;
根据所述第一图片中的像素的排列情况对所述第一图片中的像素的指纹进行排列,得到所述第一图片的指纹信息。
结合第一方面,或者第一方面的上述任一种可能的实现方式,在第一方面的第七种可能的实现方式中,所述根据所述归类操作按照预设规则对所述相册列表中的图片进行归类,得 到至少两个分类集并展示所述至少两个分类集对应的分类标签,包括:
将所述相册列表中的图片输入到相似匹配模型中,以生成所述相册列表中每张图片的图片类别标签;所述相似匹配模型为根据大量图片及所述大量图片各自的类别标签训练得到的;
将所述类别标签相同的图片归类到同一个分类集,得到至少两个分类集;
展示所述至少两个分类集对应的分类标签。
结合第一方面,或者第一方面的上述任一种可能的实现方式,在第一方面的第八种可能的实现方式中,所述预设规则用于将图片生成地点和/或时间满足预设相似条件的图片归类到同一个分类集中。
第二方面,本申请实施例提供一种内容查找设备,该设备包括处理器、存储器、输入组件、显示组件,其中,所述存储器用于存储计算机程序,所述处理器用于调用所述计算机程序来执行如下操作:
获取针对相册列表的归类操作,所述相册列表包括正在展示的图片和待展示的图片;
根据所述归类操作按照预设规则对所述相册列表中的图片进行归类,得到至少两个分类集并通过所述显示组件展示所述至少两个分类集对应的分类标签,其中,一个分类集对应一个分类标签;
通过所述输入组件接收针对所述至少两个分类集中的目标分类集的分类标签的选择操作;
根据所述选择操作通过所述显示组件展示所述目标分类集中的至少一张图片。
上述方法中,设备首先获取到针对相册列表的归类操作,然后基于该归类操作将相册列表中的图片按照预设规则进行分类,这样用户就可以根据显示的至少两个分类集对想要查找的图片进行一个初步的选择,之后再从该目标分类集中详细查找所需要查找的图片。可以看出来,用户只需要将主要的精力放在查找目标分类集中即可,而无需从该相册列表包含的海量图片中逐一查找,显著提高了查找图片的效率。
结合第二方面,在第二方面的第一种可能的实现方式中,所述根据所述选择操作通过所述显示组件展示所述目标分类集中的至少一张图片,包括:根据所述选择操作通过所述显示组件重新展示所述相册列表,其中,重新展示的所述相册展示列表中正在展示的图片包括所述目标分类集中的至少一张图片。
也即是说,在执行上述方法的起始时刻,执行上述方法的设备显示的是相册列表,在上述方法执行完之后该设备显示的还是该相册列表,只不过该相册列表中正在展示的图片发生了改变;如果跟现有技术相比的话,现有技术相当于要对相册列表逐渐的翻页,而本申请实施例是跳跃性地翻页,直接跳到需要找的图片的所在的位置或所在位置的附近。由于上述方法执行前后显示的都是相册列表,没有跳到其他页面,降低了人机交互的复杂度。
需要说明的是,以上方式讲述的是设备执行上述方法之后还是回到该相册列表,实际应用中还存在其他可能性,例如,上述根据所述选择操作展示所述目标分类集中的至少一张图片具体是,根据所述选择操作展示所述目标分类集对应的列表,当该目标分类集中的图片较少时,可以一次性全部展示出来,当该目标分类集中的图片较多时,就有一部分正在展示,另一部分待展示。可以通过滚动(如在触摸屏上滑动,或者鼠标点击滑动条等)目标分类集对应的列表来使得待展示的部分逐渐展示出来(相应的,先前展示的图片就会隐藏起来)。
结合第二方面,或者第二方面的上述任一种可能的实现方式,在第二方面的第二种可能的实现方式中,重新展示之前的所述像素列表中的图片排列顺序,与重新展示之后的所述像素列表中的图片排列顺序相同。可以看出,执行完上述方法之后仅仅是快速定位到了用户要 找的图片的附近位置,而并未对相册列表做任何修改,进一步降低了人机交互的复杂度。
结合第二方面,或者第二方面的上述任一种可能的实现方式,在第二方面的第三种可能的实现方式中,所述获取针对相册列表的归类操作,包括:
在预设时间段内接收针对相册列表的N次滚动操作,所述预设时间段内接收的针对所述相册列表的N次滚动操作为针对所述相册列表的归类操作,N大于或等于2;所述滚动操作用于对所述相册列表中正在展示的图片进行更新。也即是说,该方式由设备根据用户的常规操作自动智能化确定是否对相册列表进行归类,用户体验更好且执行效率更高。另外,由于N大于或等于2,即当用户滚动相册列表的次数不多的时候不会产生归类操作,因为用户进行少量的滚动操作有可能就能够找到想要找的图片,如果在少量滚动操作的情况下就产生归类操作,那么就会导致将查找图片的方式变得复杂了;因此本申请仅在滚动操作较多的情况下才产生归类操作,使得原本难查找的图片变得更容易查找了。
结合第二方面,或者第二方面的上述任一种可能的实现方式,在第二方面的第四种可能的实现方式中,所述预设规则用于将画面相近的图片归类到同一个分类集中。
结合第二方面,或者第二方面的上述任一种可能的实现方式,在第二方面的第五种可能的实现方式中,所述根据所述归类操作按照预设规则对所述相册列表中的图片进行归类,得到至少两个分类集并通过所述显示组件展示所述至少两个分类集对应的分类标签,包括:
根据所述相册列表中图片各自的指纹信息对所述相册列表中的图片进行归类,得到至少两个分类集,其中,指纹信息达到预设的相似条件的图片用于归类到同一个分类集,任意两张图片的指纹信息相似度越高则所述任意两张图片的画面越相近;
通过所述显示组件展示所述至少两个分类集对应的分类标签。
结合第二方面,或者第二方面的上述任一种可能的实现方式,在第二方面的第六种可能的实现方式中,所述根据所述相册列表中图片各自的指纹信息对所述相册列表中的图片进行归类,得到至少两个分类集之前,还包括:
将所述相册列表中的图片均缩放为NxM尺寸,N大于或等于4,M大于或等于4;
计算第一图片中的像素的平均灰度值,所述第一图片为所述相册列表中的任意一张图片;
将所述第一图片中的第一像素的像素值与所述平均灰度值作差,差大于或等于零则所述第一像素的指纹标记为第一数值,差小于零则所述第一像素的指纹标记为第二数值,所述第一像素为所述第一图片中的任意一个像素;
根据所述第一图片中的像素的排列情况对所述第一图片中的像素的指纹进行排列,得到所述第一图片的指纹信息。
结合第二方面,或者第二方面的上述任一种可能的实现方式,在第二方面的第七种可能的实现方式中,所述根据所述归类操作按照预设规则对所述相册列表中的图片进行归类,得到至少两个分类集并通过所述显示组件展示所述至少两个分类集对应的分类标签,包括:
将所述相册列表中的图片输入到相似匹配模型中,以生成所述相册列表中每张图片的图片类别标签;所述相似匹配模型为根据大量图片及所述大量图片各自的类别标签训练得到的;
将所述类别标签相同的图片归类到同一个分类集,得到至少两个分类集;
通过所述显示组件展示所述至少两个分类集对应的分类标签。
结合第二方面,或者第二方面的上述任一种可能的实现方式,在第二方面的第八种可能的实现方式中,所述预设规则用于将图片生成地点和/或时间满足预设相似条件的图片归类到同一个分类集中。
第三方面,本申请实施例提供一种内容查找设备,该设备包括用于执行第一方面或者第 一方面的任意一种可能的实现方式所描述的方法的全部或者部分功能单元。
第四方面,本申请实施例提供一种计算机可读存储介质,所述计算机可读存储介质中存储有计算机程序,当其在处理器上运行时,实现第一方面或者第一方面的任意一种可能的实现方式所描述的方法。
综上所述,通过实施本发明实施例,设备首先获取到针对相册列表的归类操作,然后基于该归类操作将相册列表中的图片按照预设规则进行分类,这样用户就可以根据显示的至少两个分类集对想要查找的图片进行一个初步的选择,之后再从该目标分类集中详细查找所需要查找的图片。可以看出来,用户只需要将主要的精力放在查找目标分类集中即可,而无需从该相册列表包含的海量图片中逐一查找,显著提高了查找图片的效率。
附图说明
以下对本发明实施例用到的附图进行介绍。
图1是本发明实施例提供的一种设备的结构示意图;
图2是本发明实施例提供的一种操作系统的架构示意图;
图3是本发明实施例提供的一种内容查找方法的流程示意图;
图4A是本发明实施例提供的一种展示效果示意图;
图4B是本发明实施例提供的又一种展示效果示意图;
图4C是本发明实施例提供的又一种展示效果示意图;
图4D是本发明实施例提供的又一种展示效果示意图;
图5是本发明实施例提供的又一种设备的结构示意图。
具体实施方式
下面结合本发明实施例中的附图对本发明实施例进行描述。
请参见图1,为本发明实施例应用的设备100的结构示意图。该设备可以包括具有图片展示功能的手持设备(例如,手机、平板电脑、掌上电脑等)、车载设备(例如,汽车、自行车、电动车、飞机、船舶等)、可穿戴设备(例如智能手表(如iWatch等)、智能手环、计步器等)、智能家居设备(例如,冰箱、电视、空调、电表等)、智能机器人等。
该设备100包括存储器180、处理器150以及显示设备140。存储器180存储计算机程序,计算机程序包括操作系统程序182和应用程序181等,其中,应用程序181包括相册程序。处理器150用于读取存储器180中的计算机程序,然后执行计算机程序定义的方法,例如处理器150读取操作系统程序182从而在该设备100上运行操作系统以及实现操作系统的各种功能,或读取一种或多种应用程序181,从而在该设备上运行应用,例如,读取相册程序来运行相册客户端(可以是设备的操作系统自带的,也可以是后期安装在该操作系统上的)。
处理器150可以包括一个或多个处理器,例如,处理器150可以包括一个或多个中央处理器。当处理器150包括多个处理器时,这多个处理器可以集成在同一块芯片上,也可以各自为独立的芯片。一个处理器可以包括一个或多个处理核,以下实施例均以多核为例来介绍,但是本发明实施例提供的内容查找方法也可以应用于单核处理器。
另外,存储器180还存储有除计算机程序之外的其他数据183,其他数据183可包括操作系统182或应用程序181被运行后产生的数据,该数据包括系统数据(例如操作系统的配置参数)和用户数据,例如相册中的图片数据可看作是用户数据。
存储器180一般包括内存和外存。内存可以为随机存储器(RAM),只读存储器(ROM), 以及高速缓存(CACHE)等。外存可以为硬盘、光盘、USB盘、软盘或磁带机等。计算机程序通常被存储在外存上,处理器在执行处理前会将计算机程序从外存加载到内存。本发明实施例中的图片可以存储在外存上,当需要对其进行显示时,可以将其加载到内存。
操作系统程序182中包含了可实现本发明实施例提供的内容查找方法的计算机程序,从而使得处理器150读取到该操作系统程序182并运行该操作系统后,该操作系统可具备本发明实施例提供的内容查找功能。进一步的,该操作系统可以向上层的应用开放该内容查找功能的调用接口,处理器150从存储器中180中读取应用程序181并运行该应用后,该应用就可以通过该调用接口调用操作系统中提供的内容查找,从而帮助用户快速找到图片。
设备100还可以包括输入设备130(也称输入组件),用于接收输入的数字信息、字符信息或接触式触摸操作/非接触式手势,以及产生与设备100的用户设置以及功能控制有关的信号输入等。本发明实施例中,可选的,该输入设备130可以包括触控面板131。触控面板131,也称为触摸屏,可收集用户在其上或附近的触摸操作(比如用户使用手指、触笔等任何适合的物体或附件在触控面板131上或在触控面板131的操作),并根据预先设定的程式驱动相应的连接装置。可选的,触控面板131可包括触摸检测装置和触摸控制器两个部分。其中,触摸检测装置检测用户的触摸方位,并检测触摸操作带来的信号,将信号传送给触摸控制器;触摸控制器从触摸检测装置上接收触摸信息,并将它转换成触点坐标,再送给该处理器150,并能接收处理器150发来的命令并加以执行。例如,用户在触控面板131上用手指单击某个虚拟按钮,触摸检测装置检测到此次单击带来的这个信号,然后将该信号传送给触摸控制器,触摸控制器再将这个信号转换成坐标发送给处理器150,处理器150根据该坐标和该信号的类型(单击或双击)执行内容查找功能,并将查找的图片显示在显示面板141上。
触控面板131可以采用电阻式、电容式、红外线以及表面声波等多种类型实现。除了触控面板131,输入设备130还可以包括其他输入设备132,其他输入设备132可以包括但不限于物理键盘、功能键(比如音量控制按键、开关按键等)、轨迹球、鼠标、操作杆等中的一种或多种。
设备100还可以包括显示设备140(也称显示组件),显示设备140,包括显示面板141,用于显示由用户输入的信息或提供给用户的信息以及设备100的各种菜单界面等,在本发明实施例中主要用于显示相册列表中的图片。该显示设备140可包括显示面板141,可选的,可以采用液晶显示器(英文:Liquid Crystal Display,简称:LCD)或有机发光二极管(英文:Organic Light-Emitting Diode,简称:OLED)等形式来配置显示面板141。在其他一些实施例中,触控面板131可覆盖显示面板141上,形成触摸显示屏。
除以上之外,设备100还可以包括用于给其他模块供电的电源190以及用于拍摄照片或视频的摄像头160、获取设备的地理位置的定位模块(如GPS)161、获取设备的摆放姿态(如角度、方位等)的陀螺仪162、记录时间的定时器163;其中,本发明实施例中相册中的图片可以包括通过摄像头160拍摄得到的,也可以包括通过其他方式获得的图片,例如通过截图、下载等方式获得的图片;设备100还可以包括一个或多个传感器120,例如加速度传感器、光传感器等。设备100还可以包括无线射频(Radio Frequency,RF)电路110,用于与无线网络设备进行网络通信,还可以包括WiFi模块170,用于与其他设备进行WiFi通信。
以上主要介绍了本发明实施例提供的方法的具体流程,下面结合图2以Android操作系统为例,介绍本发明实施例提供的方法的实现位置和运行时状态,更具体的方法流程可参考前述实施例所述。
请参阅图2,为本发明实施例提供的设备200的结构示意图。该设备200可以本发明实 施例的设备。该设备200包括应用层210和操作系统层250,该操作系统可以为Android操作系统。操作系统层250又分为框架层220、核心库层230和驱动层240。其中,图2中的操作系统层250可以认为是图1中操作系统182的一种具体实现,图2中的应用层210可以认为是图1中应用程序181的一种具体实现。驱动层240包括CPU驱动241、GPU驱动242、显示控制器驱动243、定位模块驱动244、陀螺仪驱动245和定时器驱动246等。核心库层230是操作系统的核心部分,包括输入/输出服务231、核心服务232、媒体服务234等,该媒体服务243中包含JPEG格式的图片库1、PNG格式的图片库2以及其他格式的图片库,该媒体服务243还包括算法库,该算法库用于存储本发明中与图片处理相关的算法,例如,选择第一图片的算法,选择参考图片的算法等。框架层220可包括图形服务(Graphic Service)224、系统服务(System service)221、网页服务(Web Service)222和用户服务(Customer Service)223等;图形服务224中,可包括如图像编码Codec、视频编码Codec以及音频编码Codec等,本发明方案应用到了该图像编码。应用层210可包括图库211、媒体播放器(Media Player)212以及浏览器(Browser)213等。
另外,在驱动层240之下,该计算机系统200还包括硬件层250。该计算机系统200的硬件层可以包括中央处理器(Central Processing Unit,CPU)251和图形处理器(Graphic Processing Unit,GPU)252(相当于图1中的处理器150的一种具体实现),还可以包括存储器253(相当于图1中的存储器180),包括内存和外存,还可以包括定位模块254(相当于图1中的定位模块161)、陀螺仪255(相当于图1中的显示设备162),还可以包括定时器256(相当于图1中的定时器163),还可以包括一个或多个传感器,(相当于图1中的传感器120)。当然除此之外,硬件层250还可以包括图1中示出的电源、摄像头、RF电路和WiFi模块,还可以包括图1中也没有示出的其他硬件模块,例如内存控制器和显示控制器等。
请参见图3,图3是本发明实施例提供的一种内容查找方法的流程示意图,该方法可以基于图1所示的设备,或者其他结构的设备来实现,该方法包括但不限于如下步骤:
步骤S301:设备获取针对相册列表的归类操作。
具体地,由于相册列表中往往有大量的图片,而设备的显示屏的大小有限,因此该相册列表中的图片再同一时刻无法全部显示,因此所述相册列表包括正在展示的图片和待展示的图片。这里正在展示的图片可以是原始图,也可以是缩略图,当为原始图时,相册列表中在同一个时刻通常显示一张图片,当为缩略图时,相册列表在同一个时刻通常显示至少两张图片。无论显示的是缩略图还是原始图,用户都可以通过滚动操作使得相册列表逐渐将未展示的图片展示出来,当相册列表中未展示的图片展示出来时,原先已展示的图片也会逐渐隐藏。
这里的滚动操作可以具体为滑动操作,例如,用户在设备的触摸显示屏上滑动;该滚动操作还可以是拉动滚动条的操作,滚动条在轨迹上的位子不同则相册列表展示的图片也不同。该滚动操作还可以是其他形式的操作,其他形式的操作此处不再一一举例。
以Android操作系统为例,当显示界面呈现相册列表时,相册列表中的图片假设保存在mDatas数据列表中,此时相册列表中的图片是一个完整的集合,图片显示的视图是mGridView,Android系统会把mGridView跟mDatas进行绑定。
在第一种方式中,所述获取针对相册列表的归类操作,可以具体为:在预设时间段内接收针对相册列表的N次滚动操作,所述预设时间段内接收的针对所述相册列表的N次滚动操作为针对所述相册列表的归类操作,N大于或等于2;所述滚动操作用于对所述相册列表中正在展示的图片进行更新。需要说明的是,这里的预设时间段可以为3秒、或者5秒、或者 6秒、或者其他的一个较短时间,可以理解的是,如果用户在该较短时间内执行了N次滚动操作,就可以判定用户在进行快速、连续的滚动相册列表的操作。
可以看出,该方式由设备根据用户的常规操作自动智能化确定是否对相册列表进行归类,用户体验更好且执行效率更高。另外,由于N大于或等于2,即当用户滚动相册列表的次数不多的时候不会产生归类操作,因为用户进行少量的滚动操作有可能就能够找到想要找的图片,如果在少量滚动操作的情况下就产生归类操作,那么会导致将查找图片的方式变得复杂了;因此本申请实施例仅在滚动操作较多的情况下才产生归类操作。
在第二种方式中,在设备显示相册列表的同时,也在屏幕中显示了一个虚拟(或者实体)操作按钮,用户点击(或者双击,或者其他的独立操作或者组合操作)该虚拟操作按钮,那么设备检测到针对该虚拟操作按钮的操作时,就相当于获取了针对相册列表的归类操作。
还存在其他的获取针对相册列表的归类操作的方式,此处不一一举例。
步骤S302:设备根据所述归类操作按照预设规则对所述相册列表中的图片进行归类,得到至少两个分类集并展示所述至少两个分类集对应的分类标签。
具体地,一个分类集对应一个分类标签。下面例举几种归类的准则:
第一准则,按照图片相似度来归类,相似度高的图片归类到同一类。
方案一,首先,将所述相册列表中的图片均缩放为NxM尺寸,N大于或等于4,M大于或等于4;然后,计算第一图片中的像素的平均灰度值,所述第一图片为相册列表中的任意一张图片;接着,将第一图片中的第一像素的像素值与所述平均灰度值作差,差大于或等于零则所述第一像素的指纹标记为第一数值,差小于零则所述第一像素的指纹标记为第二数值,所述第一像素为所述第一图片中的任意一个像素;之后,根据第一图片中的像素的排列情况对所述第一图片中的像素的指纹进行排列,得到所述第一图片的指纹信息,进一步,根据所述相册列表中图片各自的指纹信息对所述相册列表中的图片进行归类,得到至少两个分类集,其中,指纹信息达到预设的相似条件的图片用于归类到同一个分类集,任意两张图片的指纹信息相似度越高则所述任意两张图片的画面越相近。下面以感知哈希算法为例进行说明。
step1,缩小尺寸:将相册列表中的每张图片缩小到8x8的尺寸(像素矩阵),总共64个像素。这一步的作用是去除图片的细节,只保留结构/明暗等基本信息,摒弃不同尺寸/比例带来的图片差异;以上数据大小是8x8还是别的尺寸,可以由具体的软件参数调整。
step2,简化色彩:将缩小后的图片,转为64级灰度,即对于一张图片而言,其中所有像素点总共只有64种颜色。
step3,计算平均值:计算一张图片中所有64个像素的灰度平均值。
step4,比较像素的灰度:将该一张图片中每个像素的灰度,与平均值进行比较,大于或等于平均值则将对应像素的指纹记为1,小于平均值则将相应像素的指纹记为0;
step5,计算哈希值:将上一步的比较结果(即该一张图片中各个像素各自的指纹),组合在一起,就构成了一个64位的整数,这就是该一张图片的指纹。组合的次序并不重要,只要保证所有图片都采用同样次序就行了。
step6,得到该一张图片的指纹信息以后,就可以采用同样的原理得到其他图片的指纹信息,然后对比不同的图片的指纹信息,看看64位中有多少位是不一样的,我们可以设置一个门限值来定义相似度;例如,该门限值可以设置为50,如果两张图片相同的位数大于或者等于50位就认为两种图片相似,因此将这两张图片归类到同一分类集中。
如图4A所示,示意性地展示了根据相似度的方式归类出的3个分类集,分别为分类集A、分类集B和分类集C。
方案二,首先,将所述相册列表中的图片输入到相似匹配模型中,以生成所述相册列表中每张图片的图片类别标签;所述相似匹配模型为根据大量图片及所述大量图片各自的类别标签训练得到的;然后,将所述类别标签相同的图片归类到同一个分类集,得到至少两个分类集。也即是说,采用机器学习的方式智能化完成对图片的归类。通常来说,训练该相似匹配模型所用的样本越多,模型参数配置越合理则其分类效果越好。
第二准则,按照图片生成时间的相似度来归类,生成时间接近的图片归类到同一类。
可选的,可以预先配置一个时间跨度阈值,当任意两张图片的生成(如拍摄)时间之间的间隔不超过该时间跨度阈值时,可以将这两张图片归类到一个分类集中。例如,该时间跨度阈值可以设置为1小时,半小时,2小时等等,具体可以根据需要进行设定。
第三准则,按照图片生成地点的相似度来归类,生成地点相近的图片归类到同一类。
可选的,可以预先配置一个距离跨度阈值,当任意两张图片的生成(如拍摄)位置之间的距离不超过该距离跨度阈值时,可以将这两张图片归类到一个分类集中。例如,该距离跨度阈值可以设置为5公里,10公里,20公里等等,具体可以根据需要进行设定。
第四准则,按照图片生成时间的相似度和图片生成地点的相似度来归类,具体实现可以参照第二准则和第三准则,此处不再展开说明。
本申请实施例中,设备采用上述方式得到至少两个分类集之后,展示所述至少两个分类集对应的分类标签(也可以称为“分类索引”)。可选的,该任意一个分类集的分类标签是能够向用户表明该分类集的特点的信息,例如,该分类集中的一张图片(例如第一张)的缩略图,或者能够描述该分类集的相应特征的一段文字信息,等等。举例来说,如图4B所示,选择分类集中的第一张图片作为该分类集的分类标签。以上分类集A、分类集B和分类集C各自的分类标签展示出来的效果可以如图4C所示,这些分类标签还可以有其他展示方式,此处不一一举例。
同样以Android操作系统为例,当用户快速连续滚动相册列表中显示的内容时,系统会收到onFling的回调操作,此时可以获取到分类标签列表mDataIndexs,并立即把视图mGridView绑定的数据设置为mDataIndexs,界面视图显示格式可能如图4C所示。
步骤S303:设备接收针对所述至少两个分类集中的目标分类集的分类标签的选择操作。
具体地,用户可以针对该至少两个分类集中的任意一个分类集的分类标签执行选择操作,本申请实施例中,用户对哪个分类集的分类标签执行了选择操作,则哪个分类集就为这里的目标分类集。例如,执行选择操作的方式可以具体为对触摸显示屏显示的分类标签进行点击。相应的,用户接收到针对目标分类集的分类标签的选择选择操作时,该设备相应地接收到该针对目标分类集的分类标签的选择选择操作。
步骤S304:设备根据所述选择操作展示所述目标分类集中的至少一张图片。
举例来说,如果设备接收到针对分类集A的分类标签,那么设备可以通过显示屏显示该分类集A中的一张或者多张图片;如果设备接收到针对分类集B的分类标签,那么设备可以通过显示屏显示该分类集B中的一张或者多张图片;如果设备接收到针对分类集C的分类标签,那么设备可以通过显示屏显示该分类集C中的一张或者多张图片。
在一种可选的方案中,所述根据所述选择操作展示所述目标分类集中的至少一张图片,可以具体为:根据所述选择操作重新返回到展示所述相册列表,其中,重新展示的所述相册展示列表中正在展示的图片包括所述目标分类集中的至少一张图片。
也即是说,在执行上述方法的起始时刻,执行上述方法的设备显示的是相册列表,在上述方法执行完之后该设备显示的还是该相册列表,只不过该相册列表中正在展示的图片发生 了改变;如果跟现有技术相比的话,现有技术相当于要对相册列表逐渐的翻页,而本申请实施例是跳跃性地翻页,直接跳到需要找的图片的所在的位置或所在位置的附近。由于上述方法执行前后显示的都是相册列表,没有跳到其他页面,降低了人机交互的复杂度。
可选的,重新展示之前的所述像素列表中的图片排列顺序,与重新展示之后的所述像素列表中的图片排列顺序相同。可以看出,执行完上述方法之后仅仅是快速定位到了用户要找的图片的附近位置,而并未对相册列表做任何修改,进一步降低了人机交互的复杂度。
同样以Android操作系统为例,可选的,假设分类集A、分类集B和分类集C中的图片数量分别是m1,m2,m3;当用户点击分类集A的分类标签(即分类索引)时,mGridView立即绑定mDatas数据,并调用mGridView的setSelect(0),光标定位分类集A的第一张图片;当用户点击分类结合B的分类标签时,mGridView立即绑定mDatas数据,并调用mGridView的setSelect(m1),光标定位分类集B的第一张图片;当用户点击分类集C的分类标签时,mGridView立即绑定mDatas数据,并调用mGridView的setSelect(m1+m2),光标定位分类集C的第一张图片;依次类推,用户根据分类集的分类标签可以快速定位到该分类集中的第一张图片,提高了图片搜索效率。
在又一种可选的方案中,所述根据所述选择操作展示所述目标分类集中的至少一张图片,可以具体为,根据所述选择操作展示所述目标分类集对应的列表,当该目标分类集中的图片较少时,可以一次性全部展示出来,当该目标分类集中的图片较多时,就有一部分正在展示,另一部分待展示。可以通过滚动(如在触摸屏上滑动,或者鼠标点击滑动条等)目标分类集对应的列表来使得待展示的部分逐渐展示出来(相应的,先前展示的图片就会隐藏起来)。
在图3所描述的方法中,设备首先获取到针对相册列表的归类操作,然后基于该归类操作将相册列表中的图片按照预设规则进行分类,这样用户就可以根据显示的至少两个分类集对想要查找的图片进行一个初步的选择,之后再从该目标分类集中详细查找所需要查找的图片。可以看出来,用户只需要将主要的精力放在查找目标分类集中即可,而无需从该相册列表包含的海量图片中逐一查找,显著提高了查找图片的效率。
上述详细阐述了本发明实施例的方法,下面提供了本发明实施例的装置。
请参见图5,图5是本发明实施例提供的一种内容查找设备50的结构示意图,该设备50可以包括获取单元501、归类单元502、接收单元503和展示单元504,各个单元的描述如下。
获取单元501,用于获取针对相册列表的归类操作,所述相册列表包括正在展示的图片和待展示的图片;
归类单元502,用于根据所述归类操作按照预设规则对所述相册列表中的图片进行归类,得到至少两个分类集并展示所述至少两个分类集对应的分类标签,其中,一个分类集对应一个分类标签;
接收单元503,用于接收针对所述至少两个分类集中的目标分类集的分类标签的选择操作;
展示单元504,用于根据所述选择操作展示所述目标分类集中的至少一张图片。
上述方法中,设备首先获取到针对相册列表的归类操作,然后基于该归类操作将相册列表中的图片按照预设规则进行分类,这样用户就可以根据显示的至少两个分类集对想要查找的图片进行一个初步的选择,之后再从该目标分类集中详细查找所需要查找的图片。可以看出来,用户只需要将主要的精力放在查找目标分类集中即可,而无需从该相册列表包含的海量图片中逐一查找,显著提高了查找图片的效率。
在一种可能的实现方式中,在根据所述选择操作展示所述目标分类集中的至少一张图片方面,所述展示单元具体用于:根据所述选择操作重新展示所述相册列表,其中,重新展示的所述相册展示列表中正在展示的图片包括所述目标分类集中的至少一张图片。
也即是说,在执行上述方法的起始时刻,执行上述方法的设备显示的是相册列表,在上述方法执行完之后该设备显示的还是该相册列表,只不过该相册列表中正在展示的图片发生了改变;如果跟现有技术相比的话,现有技术相当于要对相册列表逐渐的翻页,而本申请实施例是跳跃性地翻页,直接跳到需要找的图片的所在的位置或所在位置的附近。由于上述方法执行前后显示的都是相册列表,没有跳到其他页面,降低了人机交互的复杂度。
需要说明的是,以上方式讲述的是设备执行上述方法之后还是回到该相册列表,实际应用中还存在其他可能性,例如,上述根据所述选择操作展示所述目标分类集中的至少一张图片具体是,根据所述选择操作展示所述目标分类集对应的列表,当该目标分类集中的图片较少时,可以一次性全部展示出来,当该目标分类集中的图片较多时,就有一部分正在展示,另一部分待展示。可以通过滚动(如在触摸屏上滑动,或者鼠标点击滑动条等)目标分类集对应的列表来使得待展示的部分逐渐展示出来(相应的,先前展示的图片就会隐藏起来)。
在一种可能的实现方式中,重新展示之前的所述像素列表中的图片排列顺序,与重新展示之后的所述像素列表中的图片排列顺序相同。可以看出,执行完上述方法之后仅仅是快速定位到了用户要找的图片的附近位置,而并未对相册列表做任何修改,进一步降低了人机交互的复杂度。
在一种可能的实现方式中,在获取针对相册列表的归类操作,所述获取单元具体用于:
在预设时间段内接收针对相册列表的N次滚动操作,所述预设时间段内接收的针对所述相册列表的N次滚动操作为针对所述相册列表的归类操作,N大于或等于2;所述滚动操作用于对所述相册列表中正在展示的图片进行更新。也即是说,该方式由设备根据用户的常规操作自动智能化确定是否对相册列表进行归类,用户体验更好且执行效率更高。另外,由于N大于或等于2,即当用户滚动相册列表的次数不多的时候不会产生归类操作,因为用户进行少量的滚动操作有可能就能够找到想要找的图片,如果在少量滚动操作的情况下就产生归类操作,那么就会导致将查找图片的方式变得复杂了;因此本申请仅在滚动操作较多的情况下才产生归类操作,使得原本难查找的图片变得更容易查找了。
在一种可能的实现方式中,所述预设规则用于将画面相近的图片归类到同一个分类集中。
在一种可能的实现方式中,所述在根据所述归类操作按照预设规则对所述相册列表中的图片进行归类,得到至少两个分类集并展示所述至少两个分类集对应的分类标签,所述归类单元具体用于:根据所述相册列表中图片各自的指纹信息对所述相册列表中的图片进行归类,得到至少两个分类集,其中,指纹信息达到预设的相似条件的图片用于归类到同一个分类集,任意两张图片的指纹信息相似度越高则所述任意两张图片的画面越相近;展示所述至少两个分类集对应的分类标签。
在一种可能的实现方式中,所述设备还包括指纹生成单元,用于在所述根据所述相册列表中图片各自的指纹信息对所述相册列表中的图片进行归类,得到至少两个分类集之前,执行如下操作:
将所述相册列表中的图片均缩放为NxM尺寸,N大于或等于5,M大于或等于5;
计算第一图片中的像素的平均灰度值,所述第一图片为所述相册列表中的任意一张图片;
将所述第一图片中的第一像素的像素值与所述平均灰度值作差,差大于或等于零则所述第一像素的指纹标记为第一数值,差小于零则所述第一像素的指纹标记为第二数值,所述第 一像素为所述第一图片中的任意一个像素;
根据所述第一图片中的像素的排列情况对所述第一图片中的像素的指纹进行排列,得到所述第一图片的指纹信息。
在一种可能的实现方式中,在根据所述归类操作按照预设规则对所述相册列表中的图片进行归类,得到至少两个分类集并展示所述至少两个分类集对应的分类标签,所述归类单元具体用于:
将所述相册列表中的图片输入到相似匹配模型中,以生成所述相册列表中每张图片的图片类别标签;所述相似匹配模型为根据大量图片及所述大量图片各自的类别标签训练得到的;
将所述类别标签相同的图片归类到同一个分类集,得到至少两个分类集;
展示所述至少两个分类集对应的分类标签。
在一种可能的实现方式中,所述预设规则用于将图片生成地点和/或时间满足预设相似条件的图片归类到同一个分类集中。
需要说明的是,各个单元的实现还可以对应参照图3所示的方法实施例的相应描述。
在图5所描述的内容查找设备50中,设备首先获取到针对相册列表的归类操作,然后基于该归类操作将相册列表中的图片按照预设规则进行分类,这样用户就可以根据显示的至少两个分类集对想要查找的图片进行一个初步的选择,之后再从该目标分类集中详细查找所需要查找的图片。可以看出来,用户只需要将主要的精力放在查找目标分类集中即可,而无需从该相册列表包含的海量图片中逐一查找,显著提高了查找图片的效率。
本发明实施例还提供一种芯片系统,所述芯片系统包括至少一个处理器,存储器和接口电路,所述存储器、所述收发器和所述至少一个处理器通过线路互联,所述至少一个存储器中存储有计算机程序;所述计算机程序被所述处理器执行时,实现图3所示的方法流程。
本发明实施例还提供一种计算机可读存储介质,所述计算机可读存储介质中存储有计算机程序,当其在处理器上运行时,实现图3所示的方法流程。
本发明实施例还提供一种计算机程序产品,当所述计算机程序产品在处理器运行时实现图3所示的方法流程。
综上所述,本申请实施例中,设备首先获取到针对相册列表的归类操作,然后基于该归类操作将相册列表中的图片按照预设规则进行分类,这样用户就可以根据显示的至少两个分类集对想要查找的图片进行一个初步的选择,之后再从该目标分类集中详细查找所需要查找的图片。可以看出来,用户只需要将主要的精力放在查找目标分类集中即可,而无需从该相册列表包含的海量图片中逐一查找,显著提高了查找图片的效率。
本领域普通技术人员可以理解实现上述实施例方法中的全部或部分流程,该流程可以由计算机程序来计算机程序相关的硬件完成,该计算机程序可存储于计算机可读取存储介质中,该计算机程序在执行时,可包括如上述各方法实施例的流程。而前述的存储介质包括:ROM或随机存储记忆体RAM、磁碟或者光盘等各种可存储计算机程序代码的介质。

Claims (20)

  1. 一种内容查找方法,其特征在于,包括:
    获取针对相册列表的归类操作,所述相册列表包括正在展示的图片和待展示的图片;
    根据所述归类操作按照预设规则对所述相册列表中的图片进行归类,得到至少两个分类集并展示所述至少两个分类集对应的分类标签,其中,一个分类集对应一个分类标签;
    接收针对所述至少两个分类集中的目标分类集的分类标签的选择操作;
    根据所述选择操作展示所述目标分类集中的至少一张图片。
  2. 根据权利要求1所述的方法,其特征在于,所述根据所述选择操作展示所述目标分类集中的至少一张图片,包括:
    根据所述选择操作重新展示所述相册列表,其中,重新展示的所述相册展示列表中正在展示的图片包括所述目标分类集中的至少一张图片。
  3. 根据权利要求2所述的方法,其特征在于,重新展示之前的所述像素列表中的图片排列顺序,与重新展示之后的所述像素列表中的图片排列顺序相同。
  4. 根据权利要求1-3任一项所述的方法,其特征在于,所述获取针对相册列表的归类操作,包括:
    在预设时间段内接收针对相册列表的N次滚动操作,所述预设时间段内接收的针对所述相册列表的N次滚动操作为针对所述相册列表的归类操作,N大于或等于2;所述滚动操作用于对所述相册列表中正在展示的图片进行更新。
  5. 根据权利要求1-4任一项所述的方法,其特征在于,所述预设规则用于将画面相近的图片归类到同一个分类集中。
  6. 根据权利要求1-5任一项所述的方法,其特征在于,所述根据所述归类操作按照预设规则对所述相册列表中的图片进行归类,得到至少两个分类集并展示所述至少两个分类集对应的分类标签,包括:
    根据所述相册列表中图片各自的指纹信息对所述相册列表中的图片进行归类,得到至少两个分类集,其中,指纹信息达到预设的相似条件的图片用于归类到同一个分类集,任意两张图片的指纹信息相似度越高则所述任意两张图片的画面越相近;
    展示所述至少两个分类集对应的分类标签。
  7. 根据权利要求6所述的方法,其特征在于,所述根据所述相册列表中图片各自的指纹信息对所述相册列表中的图片进行归类,得到至少两个分类集之前,还包括:
    将所述相册列表中的图片均缩放为NxM尺寸,N大于或等于4,M大于或等于4;
    计算第一图片中的像素的平均灰度值,所述第一图片为所述相册列表中的任意一张图片;
    将所述第一图片中的第一像素的像素值与所述平均灰度值作差,差大于或等于零则所述第一像素的指纹标记为第一数值,差小于零则所述第一像素的指纹标记为第二数值,所述第一像素为所述第一图片中的任意一个像素;
    根据所述第一图片中的像素的排列情况对所述第一图片中的像素的指纹进行排列,得到所述第一图片的指纹信息。
  8. 根据权利要求1-4任一项所述的方法,其特征在于,所述根据所述归类操作按照预设规则对所述相册列表中的图片进行归类,得到至少两个分类集并展示所述至少两个分类集对应的分类标签,包括:
    将所述相册列表中的图片输入到相似匹配模型中,以生成所述相册列表中每张图片的图片类别标签;所述相似匹配模型为根据大量图片及所述大量图片各自的类别标签训练得到的;
    将所述类别标签相同的图片归类到同一个分类集,得到至少两个分类集;
    展示所述至少两个分类集对应的分类标签。
  9. 根据权利要求1-4任一项所述的方法,其特征在于,所述预设规则用于将图片生成地点和/或时间满足预设相似条件的图片归类到同一个分类集中。
  10. 一种内容查找设备,其特征在于,包括处理器、存储器、输入组件、显示组件,其中,所述存储器用于存储计算机程序,所述处理器用于调用所述计算机程序来执行如下操作:
    获取针对相册列表的归类操作,所述相册列表包括正在展示的图片和待展示的图片;
    根据所述归类操作按照预设规则对所述相册列表中的图片进行归类,得到至少两个分类集并通过所述显示组件展示所述至少两个分类集对应的分类标签,其中,一个分类集对应一个分类标签;
    通过所述输入组件接收针对所述至少两个分类集中的目标分类集的分类标签的选择操作;
    根据所述选择操作通过所述显示组件展示所述目标分类集中的至少一张图片。
  11. 根据权利要求10所述的设备,其特征在于,所述根据所述选择操作通过所述显示组件展示所述目标分类集中的至少一张图片,包括:
    根据所述选择操作通过所述显示组件重新展示所述相册列表,其中,重新展示的所述相册展示列表中正在展示的图片包括所述目标分类集中的至少一张图片。
  12. 根据权利要求11所述的设备,其特征在于,重新展示之前的所述像素列表中的图片排列顺序,与重新展示之后的所述像素列表中的图片排列顺序相同。
  13. 根据权利要求10-12任一项所述的设备,其特征在于,所述获取针对相册列表的归类操作,包括:
    在预设时间段内接收针对相册列表的N次滚动操作,所述预设时间段内接收的针对所述相册列表的N次滚动操作为针对所述相册列表的归类操作,N大于或等于2;所述滚动操作用于对所述相册列表中正在展示的图片进行更新。
  14. 根据权利要求10-13任一项所述的设备,其特征在于,所述预设规则用于将画面相近的图片归类到同一个分类集中。
  15. 根据权利要求10-14任一项所述的设备,其特征在于,所述根据所述归类操作按照 预设规则对所述相册列表中的图片进行归类,得到至少两个分类集并通过所述显示组件展示所述至少两个分类集对应的分类标签,包括:
    根据所述相册列表中图片各自的指纹信息对所述相册列表中的图片进行归类,得到至少两个分类集,其中,指纹信息达到预设的相似条件的图片用于归类到同一个分类集,任意两张图片的指纹信息相似度越高则所述任意两张图片的画面越相近;
    通过所述显示组件展示所述至少两个分类集对应的分类标签。
  16. 根据权利要求15所述的设备,其特征在于,所述根据所述相册列表中图片各自的指纹信息对所述相册列表中的图片进行归类,得到至少两个分类集之前,还包括:
    将所述相册列表中的图片均缩放为NxM尺寸,N大于或等于4,M大于或等于4;
    计算第一图片中的像素的平均灰度值,所述第一图片为所述相册列表中的任意一张图片;
    将所述第一图片中的第一像素的像素值与所述平均灰度值作差,差大于或等于零则所述第一像素的指纹标记为第一数值,差小于零则所述第一像素的指纹标记为第二数值,所述第一像素为所述第一图片中的任意一个像素;
    根据所述第一图片中的像素的排列情况对所述第一图片中的像素的指纹进行排列,得到所述第一图片的指纹信息。
  17. 根据权利要求10-13任一项所述的设备,其特征在于,所述根据所述归类操作按照预设规则对所述相册列表中的图片进行归类,得到至少两个分类集并通过所述显示组件展示所述至少两个分类集对应的分类标签,包括:
    将所述相册列表中的图片输入到相似匹配模型中,以生成所述相册列表中每张图片的图片类别标签;所述相似匹配模型为根据大量图片及所述大量图片各自的类别标签训练得到的;
    将所述类别标签相同的图片归类到同一个分类集,得到至少两个分类集;
    通过所述显示组件展示所述至少两个分类集对应的分类标签。
  18. 根据权利要求10-13任一项所述的设备,其特征在于,所述预设规则用于将图片生成地点和/或时间满足预设相似条件的图片归类到同一个分类集中。
  19. 一种内容查找设备,其特征在于,包括用于执行权利要求1-9任一项所述的方法的全部或者部分单元。
  20. 一种计算机可读存储介质,其特征在于,所述计算机可读存储介质中存储有计算机程序,当其在处理器上运行时,实现权利要求1-9任一所述的方法。
PCT/CN2020/097847 2019-06-26 2020-06-24 一种内容查找方法、相关设备及计算机可读存储介质 WO2020259522A1 (zh)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201910564958.6 2019-06-26
CN201910564958.6A CN110377772A (zh) 2019-06-26 2019-06-26 一种内容查找方法、相关设备及计算机可读存储介质

Publications (1)

Publication Number Publication Date
WO2020259522A1 true WO2020259522A1 (zh) 2020-12-30

Family

ID=68250722

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2020/097847 WO2020259522A1 (zh) 2019-06-26 2020-06-24 一种内容查找方法、相关设备及计算机可读存储介质

Country Status (2)

Country Link
CN (1) CN110377772A (zh)
WO (1) WO2020259522A1 (zh)

Families Citing this family (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110377772A (zh) * 2019-06-26 2019-10-25 华为技术有限公司 一种内容查找方法、相关设备及计算机可读存储介质
CN117032527A (zh) * 2019-11-04 2023-11-10 华为终端有限公司 一种选择图片的方法和电子设备
CN113132531B (zh) * 2020-01-14 2022-06-24 北京小米移动软件有限公司 照片展示方法、装置及存储介质
CN113453056B (zh) * 2020-03-27 2022-08-09 聚好看科技股份有限公司 一种相册控件的显示方法及显示设备
CN112131511A (zh) * 2020-09-29 2020-12-25 中国银行股份有限公司 撮合活动中洽谈信息的展示方法及装置

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20110199511A1 (en) * 2008-10-20 2011-08-18 Camelot Co., Ltd. Image photographing system and image photographing method
CN104615769A (zh) * 2015-02-15 2015-05-13 小米科技有限责任公司 图片分类方法及装置
CN105447150A (zh) * 2015-11-26 2016-03-30 小米科技有限责任公司 基于面孔相册的音乐播放方法、装置和终端设备
CN107015998A (zh) * 2016-01-28 2017-08-04 阿里巴巴集团控股有限公司 一种图片处理方法、装置和智能终端
CN107315781A (zh) * 2017-06-07 2017-11-03 上海斐讯数据通信技术有限公司 一种相册标签的管理系统和实现方法
CN110377772A (zh) * 2019-06-26 2019-10-25 华为技术有限公司 一种内容查找方法、相关设备及计算机可读存储介质

Family Cites Families (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106776821B (zh) * 2016-11-25 2019-03-26 维沃移动通信有限公司 一种相册生成方法及终端
US10318846B2 (en) * 2016-12-28 2019-06-11 Ancestry.Com Operations Inc. Clustering historical images using a convolutional neural net and labeled data bootstrapping
CN107566907B (zh) * 2017-09-20 2019-08-30 Oppo广东移动通信有限公司 视频剪辑方法、装置、存储介质及终端
CN108121762A (zh) * 2017-11-24 2018-06-05 努比亚技术有限公司 一种图片处理方法、移动终端以及计算机存储介质
CN108241752B (zh) * 2018-01-30 2021-01-29 江苏优钒信息科技有限公司 照片显示方法、移动终端及计算机可读存储介质

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20110199511A1 (en) * 2008-10-20 2011-08-18 Camelot Co., Ltd. Image photographing system and image photographing method
CN104615769A (zh) * 2015-02-15 2015-05-13 小米科技有限责任公司 图片分类方法及装置
CN105447150A (zh) * 2015-11-26 2016-03-30 小米科技有限责任公司 基于面孔相册的音乐播放方法、装置和终端设备
CN107015998A (zh) * 2016-01-28 2017-08-04 阿里巴巴集团控股有限公司 一种图片处理方法、装置和智能终端
CN107315781A (zh) * 2017-06-07 2017-11-03 上海斐讯数据通信技术有限公司 一种相册标签的管理系统和实现方法
CN110377772A (zh) * 2019-06-26 2019-10-25 华为技术有限公司 一种内容查找方法、相关设备及计算机可读存储介质

Also Published As

Publication number Publication date
CN110377772A (zh) 2019-10-25

Similar Documents

Publication Publication Date Title
WO2020259522A1 (zh) 一种内容查找方法、相关设备及计算机可读存储介质
US11157577B2 (en) Method for searching and device thereof
CA3016921C (en) System and method for deep learning based hand gesture recognition in first person view
CN107533360B (zh) 一种显示、处理的方法及相关装置
US9256355B1 (en) Accelerated panning user interface interaction
KR102161230B1 (ko) 멀티미디어 콘텐츠 검색을 위한 사용자 인터페이스 방법 및 장치
EP2720139B1 (en) Display apparatus and method of controlling display operation
US11934640B2 (en) User interfaces for record labels
US20160203194A1 (en) User terminal for displaying image and image display method thereof
CN106462354A (zh) 管理多个显示窗口的设备、方法和图形用户界面
US20160055134A1 (en) Method and apparatus for providing summarized content to users
US20150339348A1 (en) Search method and device
KR102125212B1 (ko) 전자 필기 운용 방법 및 이를 지원하는 전자 장치
US11734370B2 (en) Method for searching and device thereof
US9805096B2 (en) Processing apparatus
WO2018120169A1 (zh) 自动设置壁纸的方法、终端设备和图形用户界面
CN112269853A (zh) 检索处理方法、装置及存储介质
US20230244363A1 (en) Screen capture method and apparatus, and electronic device
WO2020221121A1 (zh) 视频查询方法、装置、设备及存储介质
KR102019975B1 (ko) 디아비스 및 그의 컨텐츠 검색 방법
TWI748266B (zh) 搜索方法、電子裝置及非暫時性電腦可讀記錄媒體
US20150293686A1 (en) Apparatus and method for controlling home screen
CN111399724B (zh) 系统设置项的显示方法、装置、终端及存储介质
JP2014146248A (ja) 表示制御装置、表示制御方法およびプログラム
JP2023519389A (ja) スクラッチパッド作成方法及び電子機器

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 20833443

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 20833443

Country of ref document: EP

Kind code of ref document: A1