WO2023272659A1 - Method and apparatus for recognizing cover image, storage medium, and recognition device - Google Patents

Method and apparatus for recognizing cover image, storage medium, and recognition device Download PDF

Info

Publication number
WO2023272659A1
WO2023272659A1 PCT/CN2021/103865 CN2021103865W WO2023272659A1 WO 2023272659 A1 WO2023272659 A1 WO 2023272659A1 CN 2021103865 W CN2021103865 W CN 2021103865W WO 2023272659 A1 WO2023272659 A1 WO 2023272659A1
Authority
WO
WIPO (PCT)
Prior art keywords
image
gallery
cover
predetermined area
images
Prior art date
Application number
PCT/CN2021/103865
Other languages
French (fr)
Chinese (zh)
Inventor
张明云
Original Assignee
东莞市小精灵教育软件有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 东莞市小精灵教育软件有限公司 filed Critical 东莞市小精灵教育软件有限公司
Priority to PCT/CN2021/103865 priority Critical patent/WO2023272659A1/en
Publication of WO2023272659A1 publication Critical patent/WO2023272659A1/en

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V20/00Scenes; Scene-specific elements
    • G06V20/30Scenes; Scene-specific elements in albums, collections or shared content, e.g. social network photos or video
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V30/00Character recognition; Recognising digital ink; Document-oriented image-based pattern recognition
    • G06V30/40Document-oriented image-based pattern recognition
    • G06V30/41Analysis of document content
    • G06V30/418Document matching, e.g. of document images
    • GPHYSICS
    • G09EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09BEDUCATIONAL OR DEMONSTRATION APPLIANCES; APPLIANCES FOR TEACHING, OR COMMUNICATING WITH, THE BLIND, DEAF OR MUTE; MODELS; PLANETARIA; GLOBES; MAPS; DIAGRAMS
    • G09B5/00Electrically-operated educational appliances
    • G09B5/02Electrically-operated educational appliances with visual presentation of the material to be studied, e.g. using film strip

Definitions

  • the present application relates to the technical field of data processing, and in particular to a cover image recognition method, device, storage medium and recognition equipment.
  • the current reading materials are related, such as the first volume and the second volume of the reading material.
  • the difference is often only the words "first volume” and "second volume”, so they are related.
  • the readings have a high similarity.
  • the electronic device recognizes the cover of the reading, it recognizes it according to the similarity between the cover image of the reading in the database and the current cover image of the reading. The page turning of the reading material cannot be continued, and the user cannot continue to read the reading material.
  • the first aspect of the present invention provides a method for identifying a cover image, the method comprising: acquiring a cover image to be identified, a first gallery and a second gallery, the first gallery contains all sample cover images that have been collected, and the second gallery includes The second gallery contains at least one set of predetermined area images of sample cover images, and the sample cover images corresponding to each set of predetermined area images have a correlation, and the sample cover images with the correlation include a series of sample covers The image, or, includes a set of sample cover images in multiple languages; search for a sample cover image that matches the cover image to be identified in the first gallery; determine whether the sample cover image searched in the first gallery is compatible with Other sample cover images are relevant; if so, each block image of the cover image to be identified is obtained, the predetermined area image identical to the block image is searched in the second gallery, and the image to be identified is The cover image is identified as the sample cover image corresponding to the predetermined area image found in the second gallery; if not, the cover image to be identified is identified as the sample cover
  • the image of the predetermined area contained in the second gallery also has a first label of length and width; the obtaining of each block image of the cover image to be recognized includes: obtaining each block of the cover image to be recognized block position; using the length and width included in the first tag, intercepting each block of the cover image to be recognized to generate a block image.
  • the predetermined area image contained in the second gallery also has a second label, and the second label includes the first image characteristic information and the first text characteristic information of the predetermined area image; the method further includes: When obtaining each block image of the cover image to be recognized, the second image feature information and the second text feature information of the block image are also obtained; the searching in the second gallery is related to the block image the same predetermined area image, and identifying the cover image to be identified as a sample cover image corresponding to the predetermined area image searched in the second gallery includes: searching for the block in the second gallery The first image characteristic information of the image and the predetermined area image represented by the second label with the same first text feature information; identifying the cover image to be recognized as a sample cover image corresponding to the predetermined area image searched in the second gallery .
  • the method also includes: pre-establishing a second gallery; the establishment method of the second gallery includes: acquiring the first gallery, and generating a blank gallery; screening samples with the same correlation in the first gallery Cover image; take a screenshot of the predetermined area on the screened sample cover image to obtain the predetermined area image; obtain the length and width of the predetermined area image, and use the length and width to generate the first label of the predetermined area image; extract the predetermined area image The first image feature information and the first text feature information of the predetermined area image, and use the first image feature information and the first text feature information to generate the second label of the predetermined area image; The predetermined area image of the second label is allocated in the predetermined area of the blank gallery to generate a second gallery.
  • the correlation between the sample cover images of each predetermined area is the same, and different predetermined areas Between , the correlation between the sample cover images is different.
  • the method further includes: generating a pre-search result for the sample cover image searched in the first gallery in advance, and performing a search on the pre-search result for the sample cover image searched in the first gallery and other sample cover images Marking; the judging whether the sample cover image searched in the first gallery is related to other sample cover images includes: obtaining the sample cover image that matches the cover image to be identified by searching in the first gallery , to obtain the same search result as the pre-search result; identify whether there is a mark in the pre-search result corresponding to the search result; if so, determine that the sample cover image searched in the first gallery is associated with other sample cover images sex.
  • the cover image to be identified is the cover image of a picture book; the method for obtaining the first gallery and the second gallery includes: reading local storage, or/and, reading cloud storage, obtaining the first gallery and the second gallery Describe the second gallery.
  • both the predetermined area image and the block image include at least the name and serial number of the corresponding sample cover image.
  • the second aspect of the present invention provides a cover image recognition device, including: a data acquisition module, used to obtain the cover image to be recognized, the first gallery and the second gallery, the first gallery of the cover image to be recognized contains all the collected Sample cover images, the second gallery includes at least a set of predetermined area images of sample cover images, the sample cover images corresponding to each set of predetermined area images have a correlation, and the sample cover images with the correlation , including a series of sample cover images, or, including a set of multilingual sample cover images; a first search module, configured to search the first gallery for sample cover images that match the cover images to be identified; The judging module is used to judge whether the sample cover image searched in the first gallery is related to other sample cover images; the second searching module obtains each block image of the cover image to be identified, Search the same predetermined area image as the block image in the second gallery, and identify the cover image to be identified as a sample cover image corresponding to the predetermined area image searched in the second gallery; an output module for If the judgment of the judging module is
  • a third aspect of the present invention provides a computer-readable storage medium, which stores a computer program, and when the computer program is executed by a processor, the processor performs the following steps:
  • the cover image to be identified the first gallery and the second gallery
  • the first gallery contains all the sample cover images that have been included
  • the second gallery contains at least one set of predetermined area images of the sample cover images, and each set of predetermined
  • the sample cover images corresponding to the region images have a correlation, and the sample cover images with the correlation include a series of sample cover images, or include a group of multilingual sample cover images; in the first Search for a sample cover image matching the cover image to be identified in the gallery; judge whether the sample cover image searched in the first gallery is associated with other sample cover images; if so, obtain the image of the cover image to be identified For each block image, search for a predetermined area image identical to the block image in the second gallery, and identify the to-be-recognized cover image as the one found in the second gallery and corresponding to the predetermined area image A sample cover image; if not, identifying the to-be-recognized cover image as the sample cover image found in the first gallery.
  • a fourth aspect of the present invention provides a cover image recognition device, including a memory and a processor, the memory stores a computer program, and when the computer program is executed by the processor, the processor performs the following steps:
  • the cover image to be identified the first gallery and the second gallery
  • the first gallery contains all the sample cover images that have been included
  • the second gallery contains at least one set of predetermined area images of the sample cover images, and each set of predetermined
  • the sample cover images corresponding to the region images have a correlation, and the sample cover images with the correlation include a series of sample cover images, or include a group of multilingual sample cover images; in the first Search for a sample cover image matching the cover image to be identified in the gallery; judge whether the sample cover image searched in the first gallery is associated with other sample cover images; if so, obtain the image of the cover image to be identified For each block image, search for a predetermined area image identical to the block image in the second gallery, and identify the to-be-recognized cover image as the one found in the second gallery and corresponding to the predetermined area image A sample cover image; if not, identifying the to-be-recognized cover image as the sample cover image found in the first gallery.
  • Adopting the embodiment of the present invention has the following beneficial effects: firstly, it can be judged whether the searched sample cover image in the first gallery is related to other sample cover images, and the correlation indicates that the searched sample cover image is related to other samples
  • the cover image of the reading material has a higher similarity, so when there is relevance, the present invention searches the second gallery for the cover image to be recognized, and when searching, it uses a block with ten times the cover image
  • the image is matched with the image in the predetermined area in the second gallery, the matching area is reduced, and the difference between the cover image to be recognized and the sample cover image can be searched more accurately, thereby reducing the probability of confusing recognition and reducing the reading time.
  • Fig. 1 is the flowchart of the recognition method of cover image in an embodiment
  • Fig. 2 is the flow chart of obtaining each block image of the cover image to be identified in the identification method of the cover image in one embodiment
  • Fig. 3 is a method for identifying a cover image in an embodiment, searching for an image of a predetermined area identical to a block image in the second gallery, and identifying the cover image to be recognized as the one searched in the second gallery and corresponding to the image of the predetermined area Schematic diagram of the process for a sample cover image;
  • Fig. 4 is a flowchart of a method for generating a second gallery of a cover image recognition method in an embodiment
  • Fig. 5 is a flow chart of judging whether the sample cover image searched in the first gallery is associated with other sample cover images in the cover image recognition method in one embodiment
  • Fig. 6 is a schematic block diagram of a cover image recognition device in an embodiment
  • Fig. 7 is a schematic block diagram of the structure of a computer device in an embodiment.
  • an embodiment of the present invention provides a method for identifying a cover image, including:
  • step S105 identify the cover image to be recognized as a sample cover image found in the first gallery.
  • the cover image to be identified is the cover image of the picture book
  • the first gallery contains sample cover images of all picture books that have been included
  • the second gallery contains at least one set of predetermined area images of sample cover images, each set of predetermined area
  • the sample cover images corresponding to the images are associated, and the associated sample cover images include a series of sample cover images, or include a group of multilingual sample cover images.
  • the relevant sample cover image may be a sample cover image of a series of picture books, such as the cover images of the first volume, the second volume, and the third volume of the picture book, and for example the first volume and the second volume of the picture book , Volume 2, etc.; a sample cover image of a related picture book, or a set of sample cover images of multilingual picture books, such as the cover image of a Chinese version of a picture book, the cover image of an English version of a picture book, or the Japanese version of a picture book with the same content The cover image, etc.; and the cover image is related, which means that the picture book corresponding to the cover image is related.
  • a sample cover image of a series of picture books such as the cover images of the first volume, the second volume, and the third volume of the picture book, and for example the first volume and the second volume of the picture book , Volume 2, etc.
  • a sample cover image of a related picture book or a set of sample cover images of multilingual picture books, such as the cover image of a Chinese
  • step S102 due to the matching, the picture book corresponding to the sample cover image searched in the first library is most likely to be the same as the picture book corresponding to the cover image to be recognized, so further judgment as in step S103 is required.
  • step S103 if it is judged that the sample cover image searched in the first library is not related to other sample cover images, it means that the searched sample cover image does not have a high similarity with other picture book sample cover images Therefore, the identification is correct in this case, and step S105 can be executed directly.
  • step S103 if it is determined that the searched sample cover image in the first gallery is related to other sample cover images, it indicates that the searched sample cover image has a high degree of similarity with some other related cover images , so if the search is only performed in the first gallery, there may be confusion and recognition. Therefore, in this case, step S104 is performed to search for the same predetermined area image as the block image in the second gallery, which can more accurately Search for the cover image to be recognized.
  • the image of the predetermined area and the block image mentioned above, for example in step S104 both include at least the name and serial number of the picture book corresponding to the cover image of the picture book.
  • the present invention searches for the cover image to be recognized in the second gallery, and when searching, uses the block image of the real-time cover to match the predetermined area image in the second gallery, reduces the matching area, and can be more accurate
  • the difference between the cover image to be recognized and the sample cover image can be accurately searched, thereby reducing the probability of confusion and recognition, and also reducing the probability that the page turning of the reading material cannot continue, and the user cannot continue reading the reading material.
  • the image of the predetermined area contained in the second gallery also has a first label of length and width.
  • each block image of the cover image to be recognized is obtained, including:
  • the block image contains the picture book name and serial number corresponding to the picture book cover image
  • the serial number can be a number or a text
  • the serial number can be 1, 2, 3, then the picture book name and serial number indicate A specific picture book among multiple related picture books; for example, the serial number can also be Volume 1, Volume 2, Volume 2, etc., and the name and serial number of the picture book can also indicate the specific one among multiple picture books that are related Picture book; for example, the serial number can also be a version number, such as the first edition, second edition, third edition, etc.
  • the picture book name and serial number can also indicate a specific picture book among the multiple picture books that are related. Therefore, it can be understood that, in the case of the same picture book title, the information that can distinguish different picture books can be used as the serial number in the above.
  • step S104 since the position of each block of the cover image of the picture book is generally fixed, at the position above, in the middle, or below the middle of the cover image, according to the length and width contained in the first label, in these to-be Recognize these positions of the cover image and perform multiple screenshots to obtain multiple block images, and each block image is searched in the second gallery to find the block image with the same predetermined area image in the second gallery, then in The picture book cover corresponding to the predetermined area image found in the second gallery is the same as the real-time picture book cover.
  • the predetermined area image contained in the second gallery further has a second label, and the second label includes the first image characteristic information and the first text characteristic information of the predetermined area image;
  • the identification method of the cover image further includes: when obtaining each block image of the cover image to be identified, also obtaining the second image feature information and the second text feature information of the block image;
  • step S104 search for the same predetermined area image as the block image in the second gallery, and identify the cover image to be identified as the sample cover image corresponding to the predetermined area image searched in the second gallery ,include:
  • the second label contains the second image feature information and the second text feature information of the predetermined area image, so if the first image feature information and the first text feature information are the same as the second label, it means that the predetermined area image It is the same as the text information and image information of the block image.
  • the sample cover image represented by the predetermined area image is the cover image to be recognized represented by the block image.
  • the method for identifying the cover image further includes: establishing a second gallery.
  • the method for establishing the second gallery includes:
  • step S1016 in each predetermined area of the second gallery, the correlations between the sample cover images in each predetermined area are the same, and the correlations between the sample cover images are different in different predetermined areas.
  • step S104 By making a gallery and distributing the predetermined area images of the associated picture book sample cover images into the predetermined area of the gallery, it is possible to make the picture books corresponding to each predetermined area image in the second gallery have associated picture books, Therefore, when the search is performed in step S104, unrelated picture books will not be searched, thereby reducing the search amount and improving the search speed.
  • the method for identifying a cover image further includes: generating pre-search results for the picture books corresponding to the sample cover images searched in the first gallery in advance, and searching for the picture books corresponding to the sample cover images searched in the first gallery and Other picture books are marked with relevant pre-search results.
  • step S103 to determine whether the picture book corresponding to the sample cover image searched in the first gallery is related to other picture books, including:
  • the present invention pre-stores the pre-search results of all sample cover images, and each pre-search result corresponds to a search result. Therefore, the corresponding pre-search result can be obtained through the search result through step S1031.
  • step S1032 After the identification in step S1032, if there is a mark in the pre-search result, it means that the picture book corresponding to the searched sample cover image is related to the picture book corresponding to other sample cover images. Correspondingly, if there is no mark in the search result, It means that the picture book corresponding to the searched sample cover image is not associated with other picture books corresponding to the sample cover image, so it can be determined whether the picture book corresponding to the sample cover image searched in the first gallery is related to other picture books.
  • the method for acquiring the first gallery and the second gallery includes: reading local storage, or/and, reading cloud storage, and acquiring the first gallery and the second gallery.
  • both the first gallery and the second gallery are deployed in the cloud, and by requesting data from the cloud, the cloud storage is read to obtain the first gallery and the second gallery.
  • This method can reduce the number of users The memory occupation of the terminal is reduced, and when the first library and the second library need to be updated or maintained, the user does not need to download an update package, thereby facilitating the update and maintenance of the first library and the second library.
  • the second gallery and the second gallery can also be deployed in local storage, which can reduce the time for users to request data from the Internet.
  • the second aspect of the embodiment of the present application provides a cover image recognition device, please refer to Figure 6, the device includes: a data acquisition module 1, a first search module 2, a judgment module 3, a second search module 4 and an output module 5;
  • Obtaining module 1 is used to obtain the cover image to be identified, the first gallery and the second gallery, the first gallery contains all sample cover images that have been included, the second gallery contains at least one set of predetermined area images of sample cover images, and each set of predetermined areas
  • the sample cover images corresponding to the images are related, and the sample cover images with correlation include a series of sample cover images, or include a group of multilingual sample cover images;
  • the first search module 2 is used to search in the first gallery Search for a sample cover image that matches the cover image to be identified;
  • Judgment module 3 is used to judge whether the sample cover image searched out in the first gallery is associated with other sample cover images; If the judgment of 3 is yes, each block image of the cover image to be identified is obtained, the predetermined area image identical to the block
  • the cover image identification device provided in this embodiment can first judge whether the picture book corresponding to the sample cover image searched in the first gallery is related to other picture books, and if there is a relationship, it means that the searched sample cover image is related to some other pictures.
  • the cover image of the related picture book has a high similarity, so when there is a relationship, the present invention searches the cover image to be recognized in the second gallery, and when searching, it uses the block image of the real-time cover and The images in the predetermined area in the second gallery are matched, the matching area is reduced, and the difference between the cover image to be recognized and the sample cover image can be searched more accurately, thereby reducing the probability of confusion and recognition, and also reducing the need for reading. Odds that the page will not continue and the user will not be able to continue reading the book.
  • the image of the predetermined area contained in the second gallery also has a first label of length and width.
  • the second search module 4 includes: a block position acquisition unit and a block image generation unit; the block position acquisition unit is used to obtain the block positions of each block of the cover image to be identified; the block image generation unit is used to use the first The length and width contained in a label, each block of the cover image to be recognized is intercepted, and a block image is generated.
  • the image of the predetermined area included in the second gallery further has a second label
  • the second label includes the first image characteristic information and the first text characteristic information of the image of the predetermined area.
  • the identification device of the cover image further includes an information acquisition module for acquiring the second image feature information and the second text feature information of the block images when the second search module 4 acquires each block image of the cover image to be recognized.
  • the second search module 4 further includes: a predetermined area image search unit and a cover image recognition unit;
  • the predetermined area image search unit is used to search the predetermined area image represented by the second label that is the same as the first image characteristic information and the first text characteristic information of the block image in the second gallery;
  • the cover image recognition unit is configured to identify the cover image to be recognized as a sample cover image corresponding to the predetermined area image searched in the second gallery.
  • the data acquisition module 1 includes: a first gallery acquisition unit, a blank gallery generation unit, a screening unit, a screenshot unit, a first label generation unit, a feature information extraction unit, and a second gallery generation unit;
  • the first gallery acquisition The unit is used to obtain the first gallery;
  • the blank gallery generation unit is used to generate a blank gallery;
  • the screening unit is used to screen sample cover images with the same relevance in the first gallery;
  • the screenshot unit is used to pre-order the screened sample cover images A screenshot of the area to obtain an image of the predetermined area;
  • the first label generation unit is used to obtain the length and width of the image of the predetermined area, and uses the length and width to generate the first label of the image of the predetermined area;
  • the feature information extraction unit is used to extract the image of the predetermined area The first image feature information and the first text feature information, and use the first image feature information and the first text feature information to generate the second label of the predetermined area image;
  • the second gallery generation unit is used to use all the first label and the
  • the predetermined area images are distributed in the predetermined areas of the blank gallery, and a second gallery is generated.
  • the correlation between the sample cover images in each predetermined area is the same, and between different predetermined areas, the relationship between the sample cover images The correlation between them is different.
  • the cover image recognition device further includes: a pre-search result generation and marking module, which is used to generate a pre-search result for the picture book corresponding to the sample cover image searched in the first gallery in advance, and search for the picture book corresponding to the sample cover image in the first gallery.
  • the picture book corresponding to the searched sample cover image is marked with the pre-search results that are related to other picture books.
  • the judging module 3 includes: a sample cover image acquisition unit, a mark recognition unit, and a relevance judgment unit; the sample cover image acquisition unit is used to acquire a sample cover that matches the cover image to be identified by searching in the first gallery image, to obtain the same search result as the pre-search result; the tag recognition unit is used to identify whether there is a tag in the pre-search result corresponding to the search result;
  • the relevance judging unit is configured to determine that the sample cover images searched in the first gallery are related to picture books corresponding to other sample cover images if the tag recognition unit recognizes that the pre-search results corresponding to the search results have tags.
  • Figure 7 shows a diagram of the internal structure of a computer device in one embodiment.
  • the computer device may be a terminal or a server.
  • the computer device includes a processor, a memory, and a network interface connected through a system bus.
  • the memory includes a non-volatile storage medium and an internal memory.
  • the non-volatile storage medium of the computer device stores an operating system, and may also store a computer program.
  • the processor can realize the method for identifying the cover image.
  • a computer program may also be stored in the internal memory, and when the computer program is executed by the processor, the processor may execute the recognition method of the cover image.
  • FIG. 7 is only a block diagram of a part of the structure related to the solution of this application, and does not constitute a limitation to the computer equipment on which the solution of this application is applied.
  • the specific computer equipment can be More or fewer components than shown in the figures may be included, or some components may be combined, or have a different arrangement of components.
  • the embodiment of the present application also provides a computer-readable storage medium, which stores a computer program, and when the computer program is executed by the processor, the processor performs the following steps:
  • the cover image to be identified the first gallery and the second gallery
  • the first gallery contains all sample cover images that have been included
  • the second gallery contains at least one set of predetermined area images of sample cover images
  • the sample cover corresponding to each set of predetermined area images The images are related, and the sample cover images with relevance include a series of sample cover images, or include a group of multilingual sample cover images; search for sample cover images that match the cover images to be identified in the first gallery ; Judging whether the sample cover image searched out in the first gallery is related to other sample cover images; area image, and identify the cover image to be identified as the sample cover image corresponding to the predetermined area image searched out in the second gallery; if not, identify the cover image to be identified as the sample cover image searched out in the first gallery .
  • the embodiment of the present application also provides a picture book recognition device, including a memory and a processor, the memory stores a computer program, and when the computer program is executed by the processor, the processor is made to perform the following steps:
  • the cover image to be identified the first gallery and the second gallery
  • the first gallery contains all sample cover images that have been included
  • the second gallery contains at least one set of predetermined area images of sample cover images
  • the sample cover corresponding to each set of predetermined area images The images are related, and the sample cover images with relevance include a series of sample cover images, or include a group of multilingual sample cover images; search for sample cover images that match the cover images to be identified in the first gallery ; Judging whether the sample cover image searched out in the first gallery is related to other sample cover images; area image, and identify the cover image to be identified as the sample cover image corresponding to the predetermined area image searched out in the second gallery; if not, identify the cover image to be identified as the sample cover image searched out in the first gallery .
  • Nonvolatile memory can include read only memory (ROM), programmable ROM (PROM), electrically programmable ROM (EPROM), electrically erasable programmable ROM (EEPROM), or flash memory.
  • Volatile memory can include random access memory (RAM) or external cache memory.
  • RAM is available in many forms such as Static RAM (SRAM), Dynamic RAM (DRAM), Synchronous DRAM (SDRAM), Double Data Rate SDRAM (DDRSDRAM), Enhanced SDRAM (ESDRAM), Synchronous Chain Synchlink DRAM (SLDRAM), memory bus (Rambus) direct RAM (RDRAM), direct memory bus dynamic RAM (DRDRAM), and memory bus dynamic RAM (RDRAM), etc.
  • SRAM Static RAM
  • DRAM Dynamic RAM
  • SDRAM Synchronous DRAM
  • DDRSDRAM Double Data Rate SDRAM
  • ESDRAM Enhanced SDRAM
  • SLDRAM Synchronous Chain Synchlink DRAM
  • Rambus direct RAM
  • DRAM direct memory bus dynamic RAM
  • RDRAM memory bus dynamic RAM

Abstract

Disclosed in embodiments of the present invention are a method and apparatus for recognizing a cover image, a storage medium, and a recognition device. The method comprises: acquiring a cover image to be recognized, a first gallery, and a second gallery; searching the first gallery for a sample cover image that matches the cover image to be recognized; determining whether the sample cover image found in the first gallery is associated with another sample cover; if so, acquiring block images of the cover image to be recognized, searching the second gallery for a predetermined area image the same as a block image, and recognizing the cover image to be recognized as a sample cover image found in the second gallery and corresponding to the predetermined area image; if not, recognizing the cover image to be to be recognized as a sample cover image found in the first gallery. The present application can reduce the probability of mistaken recognition and also reduce the probability of a situation in which page-turning of a picture book cannot be continued and a child cannot continue to read the picture book.

Description

封面图像的识别方法、装置、存储介质及识别设备Cover image recognition method, device, storage medium and recognition equipment 技术领域technical field
本申请涉及数据处理技术领域,尤其涉及一种封面图像的识别方法、装置、存储介质及识别设备。The present application relates to the technical field of data processing, and in particular to a cover image recognition method, device, storage medium and recognition equipment.
背景技术Background technique
随着科技的发展,现在有一些电子设备能够识别一些读物的封面,例如绘本的封面,电子设备在读取绘本的封面后,能够以电子版的形式展示绘本的文本信息,以音频的方式实现绘本的翻页即读功能,从而降低孩子阅读绘本的难度,减少家长引导和辅助孩子阅读绘本的时间。With the development of science and technology, some electronic devices can now recognize the covers of some reading materials, such as the covers of picture books. After reading the covers of picture books, electronic devices can display the text information of picture books in the form of electronic version, which is realized by audio The page-reading function of picture books reduces the difficulty for children to read picture books and reduces the time for parents to guide and assist children in reading picture books.
技术问题technical problem
但是,现在的读物,有些具有关联性,例如读物的上册和下册,两册读物封面图像的区别点较少,区别往往仅是“上册”和“下册”两个字,因此具有关联性的读物相似度较高,电子设备在识别读物的封面时,是根据数据库中的读物封面图像,与当前的读物封面图像的相似度来识别的,因此电子设备会出现混淆识别的情况,从而导致读物的翻页无法继续进行、用户无法继续阅读读物的情况发生。However, some of the current reading materials are related, such as the first volume and the second volume of the reading material. There are few differences between the cover images of the two reading materials. The difference is often only the words "first volume" and "second volume", so they are related. The readings have a high similarity. When the electronic device recognizes the cover of the reading, it recognizes it according to the similarity between the cover image of the reading in the database and the current cover image of the reading. The page turning of the reading material cannot be continued, and the user cannot continue to read the reading material.
技术解决方案technical solution
本发明第一方面提供一种封面图像的识别方法,所述方法包括:获取待识别封面图像、第一图库及第二图库,所述第一图库包含已收录的所有样本封面图像,所述第二图库至少包含一组样本封面图像的预定区域图像,每组所述预定区域图像对应的所述样本封面图像具有关联性,具有所述关联性的所述样本封面图像,包括一个系列的样本封面图像,或,包括一组多语种的样本封面图像;在所述第一图库内搜索与所述待识别封面图像相匹配的样本封面图像;判断在第一图库内搜索出的样本封面图像是否与其他样本封面图像具有关联性;若是,则获取所述待识别封面图像的各个区块图像,在所述第二图库内搜索与所述区块图像相同的预定区域图像,并将所述待识别封面图像识别为在所述第二图库搜索出的,预定区域图像对应的样本封面图像;若否,则将所述待识别封面图像识别为在所述第一图库内搜索出的所述样本封面图像。The first aspect of the present invention provides a method for identifying a cover image, the method comprising: acquiring a cover image to be identified, a first gallery and a second gallery, the first gallery contains all sample cover images that have been collected, and the second gallery includes The second gallery contains at least one set of predetermined area images of sample cover images, and the sample cover images corresponding to each set of predetermined area images have a correlation, and the sample cover images with the correlation include a series of sample covers The image, or, includes a set of sample cover images in multiple languages; search for a sample cover image that matches the cover image to be identified in the first gallery; determine whether the sample cover image searched in the first gallery is compatible with Other sample cover images are relevant; if so, each block image of the cover image to be identified is obtained, the predetermined area image identical to the block image is searched in the second gallery, and the image to be identified is The cover image is identified as the sample cover image corresponding to the predetermined area image found in the second gallery; if not, the cover image to be identified is identified as the sample cover searched in the first gallery image.
其中,所述第二图库包含的所述预定区域图像还具有长度和宽度的第一标签;所述获取所述待识别封面图像的各个区块图像,包括:获取待识别封面图像的各个区块的区块位置;使用所述第一标签包含的长度和宽度,截取所述待识别封面图像的各个区块,生成区块图像。Wherein, the image of the predetermined area contained in the second gallery also has a first label of length and width; the obtaining of each block image of the cover image to be recognized includes: obtaining each block of the cover image to be recognized block position; using the length and width included in the first tag, intercepting each block of the cover image to be recognized to generate a block image.
其中,所述第二图库包含的所述预定区域图像还具有第二标签,第二标签包括所述预定区域图像的第一图像特性信息及第一文字特征信息;所述方法还包括:在所述获取所述待识别封面图像的各个区块图像时,还获取所述区块图像的第二图像特征信息及第二文字特征信息;所述在所述第二图库内搜索与所述区块图像相同的预定区域图像,并将所述待识别封面图像识别为在所述第二图库搜索出的,预定区域图像对应的样本封面图像,包括:在所述第二图库内搜索与所述区块图像的第一图像特性信息及第一文字特征信息相同的第二标签代表的预定区域图像;将所述待识别封面图像识别为在所述第二图库搜索出的,预定区域图像对应的样本封面图像。Wherein, the predetermined area image contained in the second gallery also has a second label, and the second label includes the first image characteristic information and the first text characteristic information of the predetermined area image; the method further includes: When obtaining each block image of the cover image to be recognized, the second image feature information and the second text feature information of the block image are also obtained; the searching in the second gallery is related to the block image the same predetermined area image, and identifying the cover image to be identified as a sample cover image corresponding to the predetermined area image searched in the second gallery includes: searching for the block in the second gallery The first image characteristic information of the image and the predetermined area image represented by the second label with the same first text feature information; identifying the cover image to be recognized as a sample cover image corresponding to the predetermined area image searched in the second gallery .
其中,所述方法还包括:预先建立第二图库;所述第二图库的建立方法包括:获取所述第一图库,并生成空白图库;在所述第一图库内筛选具有相同关联性的样本封面图像;对筛选出的样本封面图像进行预定区域的截图,得到预定区域图像;获取所述预定区域图像的长度和宽度,并使用长度和宽度生成所述预定区域图像的第一标签;提取所述预定区域图像的第一图像特征信息及第一文字特征信息,并使用所述第一图像特征信息及所述第一文字特征信息生成所述预定区域图像的第二标签;将所有具有第一标签及第二标签的预定区域图像分配在所述空白图库的预定区域,生成第二图库,所述第二图库的各个预定区域中,每个预定区域样本封面图像之间的关联性相同,不同预定区域之间,样本封面图像之间的关联性不同。Wherein, the method also includes: pre-establishing a second gallery; the establishment method of the second gallery includes: acquiring the first gallery, and generating a blank gallery; screening samples with the same correlation in the first gallery Cover image; take a screenshot of the predetermined area on the screened sample cover image to obtain the predetermined area image; obtain the length and width of the predetermined area image, and use the length and width to generate the first label of the predetermined area image; extract the predetermined area image The first image feature information and the first text feature information of the predetermined area image, and use the first image feature information and the first text feature information to generate the second label of the predetermined area image; The predetermined area image of the second label is allocated in the predetermined area of the blank gallery to generate a second gallery. In each predetermined area of the second gallery, the correlation between the sample cover images of each predetermined area is the same, and different predetermined areas Between , the correlation between the sample cover images is different.
其中,所述方法还包括:预先对在第一图库内搜索出样本封面图像生成预搜索结果,并对第一图库内搜索出的样本封面图像与其他样本封面图像具有关联性的预搜索结果进行标记;所述判断在第一图库内搜索出的样本封面图像是否与其他样本封面图像具有关联性,包括:获取在所述第一图库内搜索与所述待识别封面图像相匹配的样本封面图像,得到与所述预搜索结果相同的搜索结果;识别所述搜索结果对应的预搜索结果中是否具有标记;若有,则判断在第一图库内搜索出样本封面图像与其他样本封面图像具有关联性。Wherein, the method further includes: generating a pre-search result for the sample cover image searched in the first gallery in advance, and performing a search on the pre-search result for the sample cover image searched in the first gallery and other sample cover images Marking; the judging whether the sample cover image searched in the first gallery is related to other sample cover images includes: obtaining the sample cover image that matches the cover image to be identified by searching in the first gallery , to obtain the same search result as the pre-search result; identify whether there is a mark in the pre-search result corresponding to the search result; if so, determine that the sample cover image searched in the first gallery is associated with other sample cover images sex.
其中,所述待识别封面图像为绘本的封面图像;获取所述第一图库及第二图库的方法包括:读取本地存储,或/和,读取云端存储,获取所述第一图库及所述第二图库。Wherein, the cover image to be identified is the cover image of a picture book; the method for obtaining the first gallery and the second gallery includes: reading local storage, or/and, reading cloud storage, obtaining the first gallery and the second gallery Describe the second gallery.
其中,所述预定区域图像及所述区块图像,均至少包括对应样本封面图像的名称和序号。Wherein, both the predetermined area image and the block image include at least the name and serial number of the corresponding sample cover image.
本发明第二方面提供一种封面图像的识别装置,包括:数据获取模块,用于获取待识别封面图像、第一图库及第二图库,待识别封面图像所述第一图库包含已收录的所有样本封面图像,所述第二图库至少包含一组样本封面图像的预定区域图像,每组所述预定区域图像对应的所述样本封面图像具有关联性,具有所述关联性的所述样本封面图像,包括一个系列的样本封面图像,或,包括一组多语种的样本封面图像;第一搜索模块,用于在所述第一图库内搜索与所述待识别封面图像相匹配的样本封面图像;判断模块,用于判断在第一图库内搜索出的样本封面图像是否与其他样本封面图像具有关联性;第二搜索模块,则获取所述待识别封面图像的各个区块图像,在所述第二图库内搜索与所述区块图像相同的预定区域图像,并将所述待识别封面图像识别为在所述第二图库搜索出的,预定区域图像对应的样本封面图像;输出模块,用于若所述判断模块的判断为否,则将所述待识别封面图像识别为在所述第一图库内搜索出的所述样本封面图像。The second aspect of the present invention provides a cover image recognition device, including: a data acquisition module, used to obtain the cover image to be recognized, the first gallery and the second gallery, the first gallery of the cover image to be recognized contains all the collected Sample cover images, the second gallery includes at least a set of predetermined area images of sample cover images, the sample cover images corresponding to each set of predetermined area images have a correlation, and the sample cover images with the correlation , including a series of sample cover images, or, including a set of multilingual sample cover images; a first search module, configured to search the first gallery for sample cover images that match the cover images to be identified; The judging module is used to judge whether the sample cover image searched in the first gallery is related to other sample cover images; the second searching module obtains each block image of the cover image to be identified, Search the same predetermined area image as the block image in the second gallery, and identify the cover image to be identified as a sample cover image corresponding to the predetermined area image searched in the second gallery; an output module for If the judgment of the judging module is negative, the cover image to be recognized is recognized as the sample cover image found in the first gallery.
本发明第三方面提供一种计算机可读存储介质,存储有计算机程序,所述计算机程序被处理器执行时,使得所述处理器执行以下步骤:A third aspect of the present invention provides a computer-readable storage medium, which stores a computer program, and when the computer program is executed by a processor, the processor performs the following steps:
获取待识别封面图像、第一图库及第二图库,所述第一图库包含已收录的所有样本封面图像,所述第二图库至少包含一组样本封面图像的预定区域图像,每组所述预定区域图像对应的所述样本封面图像具有关联性,具有所述关联性的所述样本封面图像,包括一个系列的样本封面图像,或,包括一组多语种的样本封面图像;在所述第一图库内搜索与所述待识别封面图像相匹配的样本封面图像;判断在第一图库内搜索出的样本封面图像是否与其他样本封面图像具有关联性;若是,则获取所述待识别封面图像的各个区块图像,在所述第二图库内搜索与所述区块图像相同的预定区域图像,并将所述待识别封面图像识别为在所述第二图库搜索出的,预定区域图像对应的样本封面图像;若否,则将所述待识别封面图像识别为在所述第一图库内搜索出的所述样本封面图像。Obtain the cover image to be identified, the first gallery and the second gallery, the first gallery contains all the sample cover images that have been included, the second gallery contains at least one set of predetermined area images of the sample cover images, and each set of predetermined The sample cover images corresponding to the region images have a correlation, and the sample cover images with the correlation include a series of sample cover images, or include a group of multilingual sample cover images; in the first Search for a sample cover image matching the cover image to be identified in the gallery; judge whether the sample cover image searched in the first gallery is associated with other sample cover images; if so, obtain the image of the cover image to be identified For each block image, search for a predetermined area image identical to the block image in the second gallery, and identify the to-be-recognized cover image as the one found in the second gallery and corresponding to the predetermined area image A sample cover image; if not, identifying the to-be-recognized cover image as the sample cover image found in the first gallery.
本发明第四方面提供一种封面图像的识别设备,包括存储器和处理器,所述存储器存储有计算机程序,所述计算机程序被所述处理器执行时,使得所述处理器执行以下步骤:A fourth aspect of the present invention provides a cover image recognition device, including a memory and a processor, the memory stores a computer program, and when the computer program is executed by the processor, the processor performs the following steps:
获取待识别封面图像、第一图库及第二图库,所述第一图库包含已收录的所有样本封面图像,所述第二图库至少包含一组样本封面图像的预定区域图像,每组所述预定区域图像对应的所述样本封面图像具有关联性,具有所述关联性的所述样本封面图像,包括一个系列的样本封面图像,或,包括一组多语种的样本封面图像;在所述第一图库内搜索与所述待识别封面图像相匹配的样本封面图像;判断在第一图库内搜索出的样本封面图像是否与其他样本封面图像具有关联性;若是,则获取所述待识别封面图像的各个区块图像,在所述第二图库内搜索与所述区块图像相同的预定区域图像,并将所述待识别封面图像识别为在所述第二图库搜索出的,预定区域图像对应的样本封面图像;若否,则将所述待识别封面图像识别为在所述第一图库内搜索出的所述样本封面图像。Obtain the cover image to be identified, the first gallery and the second gallery, the first gallery contains all the sample cover images that have been included, the second gallery contains at least one set of predetermined area images of the sample cover images, and each set of predetermined The sample cover images corresponding to the region images have a correlation, and the sample cover images with the correlation include a series of sample cover images, or include a group of multilingual sample cover images; in the first Search for a sample cover image matching the cover image to be identified in the gallery; judge whether the sample cover image searched in the first gallery is associated with other sample cover images; if so, obtain the image of the cover image to be identified For each block image, search for a predetermined area image identical to the block image in the second gallery, and identify the to-be-recognized cover image as the one found in the second gallery and corresponding to the predetermined area image A sample cover image; if not, identifying the to-be-recognized cover image as the sample cover image found in the first gallery.
有益效果Beneficial effect
采用本发明实施例,具有如下有益效果:能够先判断第一图库内搜索出的样本封面图像与其他样本封面图像是否有关联性,有关联性则表明搜索出的样本封面图像与其他一些有关联性的读物的封面图像具有较高的相似度,因此在有关联性时,本发明通过对待识别封面图像在第二图库内进行搜索,并且搜索时,使用的是带十倍封面图像的区块图像与第二图库内的预定区域图像相匹配,减少了匹配区域,能够更加准确地搜索到待识别封面图像和样本封面图像的区别,从而降低了混淆识别的情况发生的几率,也降低了读物的翻页无法继续进行、用户无法继续阅读读物的情况发生的几率。Adopting the embodiment of the present invention has the following beneficial effects: firstly, it can be judged whether the searched sample cover image in the first gallery is related to other sample cover images, and the correlation indicates that the searched sample cover image is related to other samples The cover image of the reading material has a higher similarity, so when there is relevance, the present invention searches the second gallery for the cover image to be recognized, and when searching, it uses a block with ten times the cover image The image is matched with the image in the predetermined area in the second gallery, the matching area is reduced, and the difference between the cover image to be recognized and the sample cover image can be searched more accurately, thereby reducing the probability of confusing recognition and reducing the reading time. The probability that the page turning cannot continue and the user cannot continue reading the book.
附图说明Description of drawings
为了更清楚地说明本申请实施例或现有技术中的技术方案,下面将对实施例或现有技术描述中所需要使用的附图作简单地介绍,显而易见地,下面描述中的附图仅仅是本申请的一些实施例,对于本领域普通技术人员来讲,在不付出创造性劳动的前提下,还可以根据这些附图获得其他的附图。In order to more clearly illustrate the technical solutions in the embodiments of the present application or the prior art, the following will briefly introduce the drawings that need to be used in the description of the embodiments or the prior art. Obviously, the accompanying drawings in the following description are only These are some embodiments of the present application. Those skilled in the art can also obtain other drawings based on these drawings without creative work.
其中:in:
图1为一个实施例中封面图像的识别方法的流程图;Fig. 1 is the flowchart of the recognition method of cover image in an embodiment;
图2为一个实施例中封面图像的识别方法的获取待识别封面图像的各个区块图像的流程图;Fig. 2 is the flow chart of obtaining each block image of the cover image to be identified in the identification method of the cover image in one embodiment;
图3为一个实施例中封面图像的识别方法的在第二图库内搜索与区块图像相同的预定区域图像,并将待识别封面图像识别为在第二图库搜索出的,预定区域图像对应的样本封面图像的流程示意图;Fig. 3 is a method for identifying a cover image in an embodiment, searching for an image of a predetermined area identical to a block image in the second gallery, and identifying the cover image to be recognized as the one searched in the second gallery and corresponding to the image of the predetermined area Schematic diagram of the process for a sample cover image;
图4为一个实施例中封面图像的识别方法的第二图库的生成方法的流程图;Fig. 4 is a flowchart of a method for generating a second gallery of a cover image recognition method in an embodiment;
图5为一个实施例中封面图像的识别方法的判断在第一图库内搜索出的样本封面图像是否与其他样本封面图像具有关联性的流程图;Fig. 5 is a flow chart of judging whether the sample cover image searched in the first gallery is associated with other sample cover images in the cover image recognition method in one embodiment;
图6为一个实施例中封面图像的识别装置的结构示意框图;Fig. 6 is a schematic block diagram of a cover image recognition device in an embodiment;
图7为一个实施例中计算机设备的结构示意框图。Fig. 7 is a schematic block diagram of the structure of a computer device in an embodiment.
本发明的实施方式Embodiments of the present invention
下面将结合本申请实施例中的附图,对本申请实施例中的技术方案进行清楚、完整地描述,显然,所描述的实施例仅仅是本申请一部分实施例,而不是全部的实施例。基于本申请中的实施例,本领域普通技术人员在没有作出创造性劳动前提下所获得的所有其他实施例,都属于本申请保护的范围。The following will clearly and completely describe the technical solutions in the embodiments of the application with reference to the drawings in the embodiments of the application. Apparently, the described embodiments are only some of the embodiments of the application, not all of them. Based on the embodiments in this application, all other embodiments obtained by persons of ordinary skill in the art without creative efforts fall within the protection scope of this application.
请参阅图1,本发明实施例提供一种封面图像的识别方法,包括:Referring to Fig. 1, an embodiment of the present invention provides a method for identifying a cover image, including:
S101、获取待识别封面图像、第一图库及第二图库;S101. Obtain the cover image to be identified, the first gallery and the second gallery;
S102、在第一图库内搜索与待识别封面图像相匹配的样本封面图像;S102. Search for a sample cover image matching the cover image to be identified in the first gallery;
S103、判断在第一图库内搜索出的样本封面图像是否与其他样本封面图像具有关联性;S103. Determine whether the sample cover image searched in the first gallery is related to other sample cover images;
S104、若是,则获取待识别封面图像的各个区块图像,在第二图库内搜索与区块图像相同的预定区域图像,并将待识别封面图像识别为在第二图库搜索出的,预定区域图像对应的样本封面图像;S104. If so, obtain each block image of the cover image to be identified, search for an image of a predetermined area identical to the block image in the second gallery, and identify the cover image to be identified as the predetermined area searched in the second gallery The sample cover image corresponding to the image;
S105、若否,则将待识别封面图像识别为在第一图库内搜索出的样本封面图像。其中,在步骤S101中,待识别封面图像为绘本的封面图像,第一图库包含已收录的所有绘本的样本封面图像,第二图库至少包含一组样本封面图像的预定区域图像,每组预定区域图像对应的样本封面图像具有关联性,具有关联性的样本封面图像,包括一个系列的样本封面图像,或,包括一组多语种的样本封面图像。S105. If not, identify the cover image to be recognized as a sample cover image found in the first gallery. Wherein, in step S101, the cover image to be identified is the cover image of the picture book, the first gallery contains sample cover images of all picture books that have been included, and the second gallery contains at least one set of predetermined area images of sample cover images, each set of predetermined area The sample cover images corresponding to the images are associated, and the associated sample cover images include a series of sample cover images, or include a group of multilingual sample cover images.
在步骤S101中,具有关联性的样本封面图像,可以是一个系列绘本的样本封面图像,例如绘本的第一册、第二册、第三册等的封面图像,再例如绘本的上册、中册、下册等封面图像;具有关联性的绘本的样本封面图像,也可以是一组多语种绘本的样本封面图像,例如具有相同内容的中文版本绘本封面图像、英文版本绘本封面图像、日文版本绘本封面图像等;且封面图像具有关联性,即表示封面图像对应的绘本具有关联性。In step S101, the relevant sample cover image may be a sample cover image of a series of picture books, such as the cover images of the first volume, the second volume, and the third volume of the picture book, and for example the first volume and the second volume of the picture book , Volume 2, etc.; a sample cover image of a related picture book, or a set of sample cover images of multilingual picture books, such as the cover image of a Chinese version of a picture book, the cover image of an English version of a picture book, or the Japanese version of a picture book with the same content The cover image, etc.; and the cover image is related, which means that the picture book corresponding to the cover image is related.
在步骤S102中,由于相匹配,因此在第一图库内搜索出的样本封面图像对应的绘本,最有可能与待识别封面图像对应的绘本相同,因此还需要如步骤S103的进一步判断。In step S102, due to the matching, the picture book corresponding to the sample cover image searched in the first library is most likely to be the same as the picture book corresponding to the cover image to be recognized, so further judgment as in step S103 is required.
在步骤S103中,若判断出第一图库内搜索出的样本封面图像,不与其他样本封面图像具有关联性,则表示搜索出的样本封面图像与其他绘本的样本封面图像不具有较高的相似度,因此这种情况下识别是正确的,直接执行步骤S105即可。In step S103, if it is judged that the sample cover image searched in the first library is not related to other sample cover images, it means that the searched sample cover image does not have a high similarity with other picture book sample cover images Therefore, the identification is correct in this case, and step S105 can be executed directly.
在步骤S103中,若判断出第一图库内搜索出的样本封面图像与其他样本封面图像具有关联性,则表明搜索出的样本封面图像与其他一些有关联性的封面图像具有较高的相似度,因此若只在第一图库内进行搜索,则可能出现混淆识别的情况,因此这种情况下,执行步骤S104,在第二图库内搜索与区块图像相同的预定区域图像,能够更精确地对待识别封面图像进行搜索。In step S103, if it is determined that the searched sample cover image in the first gallery is related to other sample cover images, it indicates that the searched sample cover image has a high degree of similarity with some other related cover images , so if the search is only performed in the first gallery, there may be confusion and recognition. Therefore, in this case, step S104 is performed to search for the same predetermined area image as the block image in the second gallery, which can more accurately Search for the cover image to be recognized.
在本实施例中,上述中例如步骤S104提到的预定区域图像及所区块图像,均至少包括对应绘本封面图像的绘本名称和序号。In this embodiment, the image of the predetermined area and the block image mentioned above, for example in step S104 , both include at least the name and serial number of the picture book corresponding to the cover image of the picture book.
因此,本发明通过对待识别封面图像在第二图库内进行搜索,并且搜索时,使用的是实时封面的区块图像与第二图库内的预定区域图像相匹配,减少了匹配区域,能够更加准确地搜索到待识别封面图像和样本封面图像的区别,从而降低了混淆识别的情况发生的几率,也降低了读物的翻页无法继续进行、用户无法继续阅读读物的情况发生的几率。Therefore, the present invention searches for the cover image to be recognized in the second gallery, and when searching, uses the block image of the real-time cover to match the predetermined area image in the second gallery, reduces the matching area, and can be more accurate The difference between the cover image to be recognized and the sample cover image can be accurately searched, thereby reducing the probability of confusion and recognition, and also reducing the probability that the page turning of the reading material cannot continue, and the user cannot continue reading the reading material.
在一个实施例中,第二图库包含的预定区域图像还具有长度和宽度的第一标签。In one embodiment, the image of the predetermined area contained in the second gallery also has a first label of length and width.
请参阅图2,在步骤S104中,获取待识别封面图像的各个区块图像,包括:Referring to Fig. 2, in step S104, each block image of the cover image to be recognized is obtained, including:
S1041、获取待识别封面图像的各个区块的区块位置;S1041. Obtain the block position of each block of the cover image to be recognized;
S1042、使用第一标签包含的长度和宽度,截取待识别封面图像的各个区块,生成区块图像。S1042. Using the length and width included in the first tag, intercept each block of the cover image to be recognized to generate a block image.
在本实施例中,区块图像内包含了对应绘本封面图像的绘本名称和序号,序号可以是数字,也可以是文字,例如序号可以是1,2,3,则绘本名称和序号则表明了具有关联性的多本绘本中,具体的一本绘本;例如序号也可以是上册、中册、下册等,绘本名称和序号也可以表明了具有关联性的多本绘本中,具体的一本绘本;例如序列号也可以是版本号,例如第一版、第二版、第三版等,此时绘本名称和序号也能够表明具有关联性的多本绘本中,具体的一本绘本。因此,可以理解的是,在绘本名称相同的情况下,能够区分不同绘本的信息,均可作为上述中的序号。In this embodiment, the block image contains the picture book name and serial number corresponding to the picture book cover image, and the serial number can be a number or a text, for example, the serial number can be 1, 2, 3, then the picture book name and serial number indicate A specific picture book among multiple related picture books; for example, the serial number can also be Volume 1, Volume 2, Volume 2, etc., and the name and serial number of the picture book can also indicate the specific one among multiple picture books that are related Picture book; for example, the serial number can also be a version number, such as the first edition, second edition, third edition, etc. At this time, the picture book name and serial number can also indicate a specific picture book among the multiple picture books that are related. Therefore, it can be understood that, in the case of the same picture book title, the information that can distinguish different picture books can be used as the serial number in the above.
在步骤S104中,由于绘本封面图像各个区块的位置一般是固定的,在封面图像中间偏上、中间、或中间偏下的位置,因此可以根据第一标签包含的长度和宽度,在这些待识别封面图像的这些位置上进行多次截图,获得多张区块图像,每张区块图像均在第二图库中搜索,找出第二图库中的预定区域图像相同的区块图像,则在第二图库中找出的预定区域图像对应的绘本封面,与实时绘本封面相同。In step S104, since the position of each block of the cover image of the picture book is generally fixed, at the position above, in the middle, or below the middle of the cover image, according to the length and width contained in the first label, in these to-be Recognize these positions of the cover image and perform multiple screenshots to obtain multiple block images, and each block image is searched in the second gallery to find the block image with the same predetermined area image in the second gallery, then in The picture book cover corresponding to the predetermined area image found in the second gallery is the same as the real-time picture book cover.
在一个实施例中,第二图库包含的预定区域图像还具有第二标签,第二标签包括预定区域图像的第一图像特性信息及第一文字特征信息;In one embodiment, the predetermined area image contained in the second gallery further has a second label, and the second label includes the first image characteristic information and the first text characteristic information of the predetermined area image;
封面图像的识别方法还包括:在获取待识别封面图像的各个区块图像时,还获取区块图像的第二图像特征信息及第二文字特征信息;The identification method of the cover image further includes: when obtaining each block image of the cover image to be identified, also obtaining the second image feature information and the second text feature information of the block image;
请参阅图3,在步骤S104中,在第二图库内搜索与区块图像相同的预定区域图像,并将待识别封面图像识别为在第二图库搜索出的,预定区域图像对应的样本封面图像,包括:Please refer to FIG. 3, in step S104, search for the same predetermined area image as the block image in the second gallery, and identify the cover image to be identified as the sample cover image corresponding to the predetermined area image searched in the second gallery ,include:
S1043、在第二图库内搜索与区块图像的第一图像特性信息及第一文字特征信息相同的第二标签代表的预定区域图像;S1043. Search in the second gallery for a predetermined area image represented by a second label that is identical to the first image characteristic information and the first text characteristic information of the block image;
S1044、将待识别封面图像识别为在第二图库搜索出的,预定区域图像对应的样本封面图像。S1044. Recognize the cover image to be recognized as a sample cover image corresponding to the predetermined area image found in the second gallery.
在步骤S1043中,第二标签中包含有预定区域图像的第二图像特征信息及第二文字特征信息,因此若第一图像特性信息及第一文字特征信息与第二标签相同,则表示预定区域图像与区块图像的文字信息、图像信息相同,这种情况下,预定区域图像代表的样本封面图像即为区块图像代表的待识别封面图像。In step S1043, the second label contains the second image feature information and the second text feature information of the predetermined area image, so if the first image feature information and the first text feature information are the same as the second label, it means that the predetermined area image It is the same as the text information and image information of the block image. In this case, the sample cover image represented by the predetermined area image is the cover image to be recognized represented by the block image.
请参阅图4,在一个实施例中,封面图像的识别方法还包:建立第二图库。Please refer to FIG. 4 , in one embodiment, the method for identifying the cover image further includes: establishing a second gallery.
其中,建立第二图库的方法包括:Wherein, the method for establishing the second gallery includes:
S1011、获取第一图库,并生成空白图库;S1011. Acquire the first image gallery, and generate a blank image gallery;
S1012、在第一图库内筛选具有相同关联性的样本封面图像;S1012. Screen sample cover images with the same relevance in the first gallery;
S1013、对筛选出的样本封面图像进行预定区域的截图,得到预定区域图像;S1013. Take a screenshot of the predetermined area on the screened sample cover image to obtain an image of the predetermined area;
S1014、获取预定区域图像的长度和宽度,并使用长度和宽度生成预定区域图像的第一标签;S1014. Obtain the length and width of the predetermined area image, and use the length and width to generate a first label of the predetermined area image;
S1015、提取预定区域图像的第一图像特征信息及第一文字特征信息,并使用第一图像特征信息及第一文字特征信息生成预定区域图像的第二标签;S1015. Extract the first image feature information and the first text feature information of the predetermined area image, and use the first image feature information and the first text feature information to generate a second label of the predetermined area image;
S1016、将所有具有第一标签及第二标签的预定区域图像分配在空白图库的预定区域,生成第二图库。S1016. Allocate all the images in the predetermined area with the first label and the second label in the predetermined area of the blank gallery to generate a second gallery.
在步骤S1016中,第二图库的各个预定区域中,每个预定区域内样本封面图像之间的关联性相同,不同预定区域之间,样本封面图像之间的关联性不同。In step S1016, in each predetermined area of the second gallery, the correlations between the sample cover images in each predetermined area are the same, and the correlations between the sample cover images are different in different predetermined areas.
通过制作图库,并将具有关联性的绘本样本封面图像的预定区域图像,分配到图库的预定区域内,能够使得第二图库内的每个预定区域图像对应的绘本,均具有关联性的绘本,因此在执行步骤S104进行搜索时,不会搜索出没有关联性的绘本,从而减少了搜索量,提升了搜索速度。By making a gallery and distributing the predetermined area images of the associated picture book sample cover images into the predetermined area of the gallery, it is possible to make the picture books corresponding to each predetermined area image in the second gallery have associated picture books, Therefore, when the search is performed in step S104, unrelated picture books will not be searched, thereby reducing the search amount and improving the search speed.
在一个实施例中,封面图像的识别方法还包括:预先对在第一图库内搜索出样本封面图像对应的绘本生成预搜索结果,并对第一图库内搜索出的样本封面图像对应的绘本与其他绘本具有关联性的预搜索结果进行标记。In one embodiment, the method for identifying a cover image further includes: generating pre-search results for the picture books corresponding to the sample cover images searched in the first gallery in advance, and searching for the picture books corresponding to the sample cover images searched in the first gallery and Other picture books are marked with relevant pre-search results.
请参阅图5,步骤S103,判断在第一图库内搜索出的样本封面图像对应的绘本是否与其他绘本具有关联性,包括:Please refer to FIG. 5, step S103, to determine whether the picture book corresponding to the sample cover image searched in the first gallery is related to other picture books, including:
S1031、获取在第一图库内搜索与待识别封面图像相匹配的样本封面图像,得到与预搜索结果相同的搜索结果;S1031. Obtain a sample cover image that matches the cover image to be identified by searching in the first gallery, and obtain the same search result as the pre-search result;
S1032、识别搜索结果对应的预搜索结果中是否具有标记;S1032. Identify whether there is a mark in the pre-search result corresponding to the search result;
S1033、若有,则判断在第一图库内搜索出样本封面图像与其他样本封面图像具有关联性。S1033. If yes, determine that the sample cover image found in the first gallery is related to other sample cover images.
在本实施例中,第一图库内的样本封面图像被搜索出来时,会有一个搜索结果,因此本发明预存了所有样本封面图像的预搜索结果,每个预搜索结果均对应一个搜索结果,因此可以通过步骤S1031,通过搜索结果得到对应的预搜索结果。In this embodiment, when the sample cover image in the first gallery is searched out, there will be a search result, so the present invention pre-stores the pre-search results of all sample cover images, and each pre-search result corresponds to a search result. Therefore, the corresponding pre-search result can be obtained through the search result through step S1031.
在经过步骤S1032的识别后,若预搜索结果中有标记,则表示搜索出的样本封面图像对应的绘本具有相关联性的其他样本封面图像对应的绘本,相应的,若搜索结果中没有标记,则表示搜索出的样本封面图像对应的绘本不具有相关联性其他样本封面图像对应的绘本,因此可以判断出在第一图库内搜索出的样本封面图像对应的绘本是否与其他绘本具有关联性。After the identification in step S1032, if there is a mark in the pre-search result, it means that the picture book corresponding to the searched sample cover image is related to the picture book corresponding to other sample cover images. Correspondingly, if there is no mark in the search result, It means that the picture book corresponding to the searched sample cover image is not associated with other picture books corresponding to the sample cover image, so it can be determined whether the picture book corresponding to the sample cover image searched in the first gallery is related to other picture books.
在一个实施例中,第一图库及第二图库的获取方法,包括:读取本地存储,或/和,读取云端存储,获取所述第一图库及所述第二图库。In one embodiment, the method for acquiring the first gallery and the second gallery includes: reading local storage, or/and, reading cloud storage, and acquiring the first gallery and the second gallery.
优选地,在本实施例中,第一图库及第二图库均部署在云端,通过向云端请求数据,来读取云端存储,获取第一图库及第二图库,通过这样的方法,能够减少用户端的内存占用,且在需要更新或维护第一图库及第二图库时,无需用户下载更新包,从而便于对第一图库及第二图库的更新与维护。Preferably, in this embodiment, both the first gallery and the second gallery are deployed in the cloud, and by requesting data from the cloud, the cloud storage is read to obtain the first gallery and the second gallery. This method can reduce the number of users The memory occupation of the terminal is reduced, and when the first library and the second library need to be updated or maintained, the user does not need to download an update package, thereby facilitating the update and maintenance of the first library and the second library.
在其他实施例中,第二图库和第二图库还可部署在本地存储,这样能够减少用户向互联网请求数据的时间。In other embodiments, the second gallery and the second gallery can also be deployed in local storage, which can reduce the time for users to request data from the Internet.
本申请实施例第二方面提供一种封面图像的识别装置,请参阅图6,装置包括:数据获取模块1、第一搜索模块2、判断模块3、第二搜索模块4及输出模块5;数据获取模块1用于获取待识别封面图像、第一图库及第二图库,第一图库包含已收录的所有样本封面图像,第二图库至少包含一组样本封面图像的预定区域图像,每组预定区域图像对应的样本封面图像具有关联性,具有关联性的样本封面图像,包括一个系列的样本封面图像,或,包括一组多语种的样本封面图像;第一搜索模块2用于在第一图库内搜索与待识别封面图像相匹配的样本封面图像;判断模块3用于判断在第一图库内搜索出的样本封面图像是否与其他样本封面图像具有关联性;第二搜索模块4用于若判断模块3的判断为是,则获取待识别封面图像的各个区块图像,在第二图库内搜索与区块图像相同的预定区域图像,并将待识别封面图像识别为在第二图库搜索出的,预定区域图像对应的样本封面图像;输出模块5用于若判断模块3的判断为否,则将待识别封面图像识别为在第一图库内搜索出的样本封面图像。The second aspect of the embodiment of the present application provides a cover image recognition device, please refer to Figure 6, the device includes: a data acquisition module 1, a first search module 2, a judgment module 3, a second search module 4 and an output module 5; Obtaining module 1 is used to obtain the cover image to be identified, the first gallery and the second gallery, the first gallery contains all sample cover images that have been included, the second gallery contains at least one set of predetermined area images of sample cover images, and each set of predetermined areas The sample cover images corresponding to the images are related, and the sample cover images with correlation include a series of sample cover images, or include a group of multilingual sample cover images; the first search module 2 is used to search in the first gallery Search for a sample cover image that matches the cover image to be identified; Judgment module 3 is used to judge whether the sample cover image searched out in the first gallery is associated with other sample cover images; If the judgment of 3 is yes, each block image of the cover image to be identified is obtained, the predetermined area image identical to the block image is searched in the second gallery, and the cover image to be identified is identified as searched out in the second gallery, The sample cover image corresponding to the predetermined area image; the output module 5 is used to identify the cover image to be recognized as the sample cover image searched in the first library if the judgment of the judging module 3 is negative.
本实施例提供的封面图像的识别装置,能够先判断第一图库内搜索出的样本封面图像对应的绘本与其他绘本是否有关联性,有关联性则表明搜索出的样本封面图像与其他一些有关联性的绘本的封面图像具有较高的相似度,因此在有关联性时,本发明通过对待识别封面图像在第二图库内进行搜索,并且搜索时,使用的是实时封面的区块图像与第二图库内的预定区域图像相匹配,减少了匹配区域,能够更加准确地搜索到待识别封面图像和样本封面图像的区别,从而降低了混淆识别的情况发生的几率,也降低了读物的翻页无法继续进行、用户无法继续阅读读物的情况发生的几率。The cover image identification device provided in this embodiment can first judge whether the picture book corresponding to the sample cover image searched in the first gallery is related to other picture books, and if there is a relationship, it means that the searched sample cover image is related to some other pictures. The cover image of the related picture book has a high similarity, so when there is a relationship, the present invention searches the cover image to be recognized in the second gallery, and when searching, it uses the block image of the real-time cover and The images in the predetermined area in the second gallery are matched, the matching area is reduced, and the difference between the cover image to be recognized and the sample cover image can be searched more accurately, thereby reducing the probability of confusion and recognition, and also reducing the need for reading. Odds that the page will not continue and the user will not be able to continue reading the book.
在一个实施例中,第二图库包含的预定区域图像还具有长度和宽度的第一标签。In one embodiment, the image of the predetermined area contained in the second gallery also has a first label of length and width.
第二搜索模4块包括:区块位置获取单元及区块图像生成单元;区块位置获取单元用于获取待识别封面图像的各个区块的区块位置;区块图像生成单元用于使用第一标签包含的长度和宽度,截取待识别封面图像的各个区块,生成区块图像。The second search module 4 includes: a block position acquisition unit and a block image generation unit; the block position acquisition unit is used to obtain the block positions of each block of the cover image to be identified; the block image generation unit is used to use the first The length and width contained in a label, each block of the cover image to be recognized is intercepted, and a block image is generated.
在一个实施例中,第二图库包含的预定区域图像还具有第二标签,第二标签包括预定区域图像的第一图像特性信息及第一文字特征信息。In one embodiment, the image of the predetermined area included in the second gallery further has a second label, and the second label includes the first image characteristic information and the first text characteristic information of the image of the predetermined area.
封面图像的识别装置还包括信息获取模块,用于获取在第二搜索模块4获取待识别封面图像的各个区块图像时,还获取区块图像的第二图像特征信息及第二文字特征信息。The identification device of the cover image further includes an information acquisition module for acquiring the second image feature information and the second text feature information of the block images when the second search module 4 acquires each block image of the cover image to be recognized.
在本实施例中,第二搜索模块4还包括:预定区域图像搜索单元及封面图像识别单元;In this embodiment, the second search module 4 further includes: a predetermined area image search unit and a cover image recognition unit;
预定区域图像搜索单元用于在第二图库内搜索与区块图像的第一图像特性信息及第一文字特征信息相同的第二标签代表的预定区域图像;The predetermined area image search unit is used to search the predetermined area image represented by the second label that is the same as the first image characteristic information and the first text characteristic information of the block image in the second gallery;
封面图像识别单元用于将待识别封面图像识别为在第二图库搜索出的,预定区域图像对应的样本封面图像。The cover image recognition unit is configured to identify the cover image to be recognized as a sample cover image corresponding to the predetermined area image searched in the second gallery.
在一个实施例中,数据获取模块1包括:第一图库获取单元、空白图库生成单元、筛选单元、截图单元、第一标签生成单元、特征信息提取单元及第二图库生成单元;第一图库获取单元用于获取第一图库;空白图库生成单元用于生成空白图库;筛选单元用于在第一图库内筛选具有相同关联性的样本封面图像;截图单元用于对筛选出的样本封面图像进行预定区域的截图,得到预定区域图像;第一标签生成单元用于获取预定区域图像的长度和宽度,并使用长度和宽度生成预定区域图像的第一标签;特征信息提取单元用于提取预定区域图像的第一图像特征信息及第一文字特征信息,并使用第一图像特征信息及第一文字特征信息生成预定区域图像的第二标签;第二图库生成单元用于将所有具有第一标签及第二标签的预定区域图像分配在空白图库的预定区域,生成第二图库,第二图库的各个预定区域中,每个预定区域内样本封面图像之间的关联性相同,不同预定区域之间,样本封面图像之间的关联性不同。In one embodiment, the data acquisition module 1 includes: a first gallery acquisition unit, a blank gallery generation unit, a screening unit, a screenshot unit, a first label generation unit, a feature information extraction unit, and a second gallery generation unit; the first gallery acquisition The unit is used to obtain the first gallery; the blank gallery generation unit is used to generate a blank gallery; the screening unit is used to screen sample cover images with the same relevance in the first gallery; the screenshot unit is used to pre-order the screened sample cover images A screenshot of the area to obtain an image of the predetermined area; the first label generation unit is used to obtain the length and width of the image of the predetermined area, and uses the length and width to generate the first label of the image of the predetermined area; the feature information extraction unit is used to extract the image of the predetermined area The first image feature information and the first text feature information, and use the first image feature information and the first text feature information to generate the second label of the predetermined area image; the second gallery generation unit is used to use all the first label and the second label. The predetermined area images are distributed in the predetermined areas of the blank gallery, and a second gallery is generated. In each predetermined area of the second gallery, the correlation between the sample cover images in each predetermined area is the same, and between different predetermined areas, the relationship between the sample cover images The correlation between them is different.
在一个实施例中,封面图像的识别装置还包括:预搜索结果生成及标记模块,用于预先对在第一图库内搜索出样本封面图像对应的绘本生成预搜索结果,并对第一图库内搜索出的样本封面图像对应的绘本与其他绘本具有关联性的预搜索结果进行标记。In one embodiment, the cover image recognition device further includes: a pre-search result generation and marking module, which is used to generate a pre-search result for the picture book corresponding to the sample cover image searched in the first gallery in advance, and search for the picture book corresponding to the sample cover image in the first gallery. The picture book corresponding to the searched sample cover image is marked with the pre-search results that are related to other picture books.
在本实施例中,判断模块3包括:样本封面图像获取单元、标记识别单元及关联性判断单元;样本封面图像获取单元用于获取在第一图库内搜索与待识别封面图像相匹配的样本封面图像,得到与预搜索结果相同的搜索结果;标记识别单元用于识别搜索结果对应的预搜索结果中是否具有标记;In this embodiment, the judging module 3 includes: a sample cover image acquisition unit, a mark recognition unit, and a relevance judgment unit; the sample cover image acquisition unit is used to acquire a sample cover that matches the cover image to be identified by searching in the first gallery image, to obtain the same search result as the pre-search result; the tag recognition unit is used to identify whether there is a tag in the pre-search result corresponding to the search result;
关联性判断单元用于若标记识别单元识别出搜索结果对应的预搜索结果中具有标记,则判断在第一图库内搜索出样本封面图像与其他样本封面图像对应的绘本具有关联性。The relevance judging unit is configured to determine that the sample cover images searched in the first gallery are related to picture books corresponding to other sample cover images if the tag recognition unit recognizes that the pre-search results corresponding to the search results have tags.
图7示出了一个实施例中计算机设备的内部结构图。该计算机设备具体可以是终端,也可以是服务器。如图7所示,该计算机设备包括通过系统总线连接的处理器、存储器和网络接口。其中,存储器包括非易失性存储介质和内存储器。该计算机设备的非易失性存储介质存储有操作系统,还可存储有计算机程序,该计算机程序被处理器执行时,可使得处理器实现封面图像的识别方法。该内存储器中也可储存有计算机程序,该计算机程序被处理器执行时,可使得处理器执行封面图像的识别方法。本领域技术人员可以理解,图7中示出的结构,仅仅是与本申请方案相关的部分结构的框图,并不构成对本申请方案所应用于其上的计算机设备的限定,具体的计算机设备可以包括比图中所示更多或更少的部件,或者组合某些部件,或者具有不同的部件布置。Figure 7 shows a diagram of the internal structure of a computer device in one embodiment. Specifically, the computer device may be a terminal or a server. As shown in FIG. 7, the computer device includes a processor, a memory, and a network interface connected through a system bus. Wherein, the memory includes a non-volatile storage medium and an internal memory. The non-volatile storage medium of the computer device stores an operating system, and may also store a computer program. When the computer program is executed by the processor, the processor can realize the method for identifying the cover image. A computer program may also be stored in the internal memory, and when the computer program is executed by the processor, the processor may execute the recognition method of the cover image. Those skilled in the art can understand that the structure shown in Figure 7 is only a block diagram of a part of the structure related to the solution of this application, and does not constitute a limitation to the computer equipment on which the solution of this application is applied. The specific computer equipment can be More or fewer components than shown in the figures may be included, or some components may be combined, or have a different arrangement of components.
本申请实施例还提供一种计算机可读存储介质,存储有计算机程序,计算机程序被处理器执行时,使得处理器执行以下步骤:The embodiment of the present application also provides a computer-readable storage medium, which stores a computer program, and when the computer program is executed by the processor, the processor performs the following steps:
获取待识别封面图像、第一图库及第二图库,第一图库包含已收录的所有样本封面图像,第二图库至少包含一组样本封面图像的预定区域图像,每组预定区域图像对应的样本封面图像具有关联性,具有关联性的样本封面图像,包括一个系列的样本封面图像,或,包括一组多语种的样本封面图像;在第一图库内搜索与待识别封面图像相匹配的样本封面图像;判断在第一图库内搜索出的样本封面图像是否与其他样本封面图像具有关联性;若是,则获取待识别封面图像的各个区块图像,在第二图库内搜索与区块图像相同的预定区域图像,并将待识别封面图像识别为在第二图库搜索出的,预定区域图像对应的样本封面图像;若否,则将待识别封面图像识别为在第一图库内搜索出的样本封面图像。Obtain the cover image to be identified, the first gallery and the second gallery, the first gallery contains all sample cover images that have been included, the second gallery contains at least one set of predetermined area images of sample cover images, and the sample cover corresponding to each set of predetermined area images The images are related, and the sample cover images with relevance include a series of sample cover images, or include a group of multilingual sample cover images; search for sample cover images that match the cover images to be identified in the first gallery ; Judging whether the sample cover image searched out in the first gallery is related to other sample cover images; area image, and identify the cover image to be identified as the sample cover image corresponding to the predetermined area image searched out in the second gallery; if not, identify the cover image to be identified as the sample cover image searched out in the first gallery .
本申请实施例还提供一种绘本识别设备,包括存储器和处理器,存储器存储有计算机程序,计算机程序被处理器执行时,使得处理器执行以下步骤:The embodiment of the present application also provides a picture book recognition device, including a memory and a processor, the memory stores a computer program, and when the computer program is executed by the processor, the processor is made to perform the following steps:
获取待识别封面图像、第一图库及第二图库,第一图库包含已收录的所有样本封面图像,第二图库至少包含一组样本封面图像的预定区域图像,每组预定区域图像对应的样本封面图像具有关联性,具有关联性的样本封面图像,包括一个系列的样本封面图像,或,包括一组多语种的样本封面图像;在第一图库内搜索与待识别封面图像相匹配的样本封面图像;判断在第一图库内搜索出的样本封面图像是否与其他样本封面图像具有关联性;若是,则获取待识别封面图像的各个区块图像,在第二图库内搜索与区块图像相同的预定区域图像,并将待识别封面图像识别为在第二图库搜索出的,预定区域图像对应的样本封面图像;若否,则将待识别封面图像识别为在第一图库内搜索出的样本封面图像。Obtain the cover image to be identified, the first gallery and the second gallery, the first gallery contains all sample cover images that have been included, the second gallery contains at least one set of predetermined area images of sample cover images, and the sample cover corresponding to each set of predetermined area images The images are related, and the sample cover images with relevance include a series of sample cover images, or include a group of multilingual sample cover images; search for sample cover images that match the cover images to be identified in the first gallery ; Judging whether the sample cover image searched out in the first gallery is related to other sample cover images; area image, and identify the cover image to be identified as the sample cover image corresponding to the predetermined area image searched out in the second gallery; if not, identify the cover image to be identified as the sample cover image searched out in the first gallery .
本领域普通技术人员可以理解实现上述实施例方法中的全部或部分流程,是可以通过计算机程序来指令相关的硬件来完成,所述的程序可存储于一非易失性计算机可读取存储介质中,该程序在执行时,可包括如上述各方法的实施例的流程。其中,本申请所提供的各实施例中所使用的对存储器、存储、数据库或其它介质的任何引用,均可包括非易失性和/或易失性存储器。非易失性存储器可包括只读存储器(ROM)、可编程ROM(PROM)、电可编程ROM(EPROM)、电可擦除可编程ROM(EEPROM)或闪存。易失性存储器可包括随机存取存储器(RAM)或者外部高速缓冲存储器。作为说明而非局限,RAM以多种形式可得,诸如静态RAM(SRAM)、动态RAM(DRAM)、同步DRAM(SDRAM)、双数据率SDRAM(DDRSDRAM)、增强型SDRAM(ESDRAM)、同步链路(Synchlink) DRAM(SLDRAM)、存储器总线(Rambus)直接RAM(RDRAM)、直接存储器总线动态RAM(DRDRAM)、以及存储器总线动态RAM(RDRAM)等。Those of ordinary skill in the art can understand that all or part of the processes in the methods of the above embodiments can be realized through computer programs to instruct related hardware, and the programs can be stored in a non-volatile computer-readable storage medium When the program is executed, it may include the processes of the embodiments of the above-mentioned methods. Wherein, any references to memory, storage, database or other media used in the various embodiments provided in the present application may include non-volatile and/or volatile memory. Nonvolatile memory can include read only memory (ROM), programmable ROM (PROM), electrically programmable ROM (EPROM), electrically erasable programmable ROM (EEPROM), or flash memory. Volatile memory can include random access memory (RAM) or external cache memory. By way of illustration and not limitation, RAM is available in many forms such as Static RAM (SRAM), Dynamic RAM (DRAM), Synchronous DRAM (SDRAM), Double Data Rate SDRAM (DDRSDRAM), Enhanced SDRAM (ESDRAM), Synchronous Chain Synchlink DRAM (SLDRAM), memory bus (Rambus) direct RAM (RDRAM), direct memory bus dynamic RAM (DRDRAM), and memory bus dynamic RAM (RDRAM), etc.
以上实施例的各技术特征可以进行任意的组合,为使描述简洁,未对上述实施例中的各个技术特征所有可能的组合都进行描述,然而,只要这些技术特征的组合不存在矛盾,都应当认为是本说明书记载的范围。The technical features of the above embodiments can be combined arbitrarily. To make the description concise, all possible combinations of the technical features in the above embodiments are not described. However, as long as there is no contradiction in the combination of these technical features, they should be It is considered to be within the range described in this specification.
以上所述实施例仅表达了本申请的几种实施方式,其描述较为具体和详细,但并不能因此而理解为对本申请专利范围的限制。应当指出的是,对于本领域的普通技术人员来说,在不脱离本申请构思的前提下,还可以做出若干变形和改进,这些都属于本申请的保护范围。因此,本申请专利的保护范围应以所附权利要求为准。The above-mentioned embodiments only express several implementation modes of the present application, and the description thereof is relatively specific and detailed, but should not be construed as limiting the patent scope of the present application. It should be noted that those skilled in the art can make several modifications and improvements without departing from the concept of the present application, and these all belong to the protection scope of the present application. Therefore, the scope of protection of the patent application should be based on the appended claims.

Claims (10)

  1. 一种封面图像的识别方法,其特征在于,所述方法包括:A method for identifying a cover image, characterized in that the method comprises:
    获取待识别封面图像、第一图库及第二图库,所述第一图库包含已收录的所有样本封面图像,所述第二图库至少包含一组样本封面图像的预定区域图像,每组所述预定区域图像对应的所述样本封面图像具有关联性,具有所述关联性的所述样本封面图像,包括一个系列的样本封面图像,或,包括一组多语种的样本封面图像;Obtain the cover image to be identified, the first gallery and the second gallery, the first gallery contains all the sample cover images that have been included, the second gallery contains at least one set of predetermined area images of the sample cover images, and each set of predetermined The sample cover images corresponding to the region images have a correlation, and the sample cover images with the correlation include a series of sample cover images, or include a group of multilingual sample cover images;
    在所述第一图库内搜索与所述待识别封面图像相匹配的样本封面图像;Searching for a sample cover image matching the cover image to be identified in the first gallery;
    判断在第一图库内搜索出的样本封面图像是否与其他样本封面图像具有关联性;Judging whether the sample cover image searched in the first gallery is related to other sample cover images;
    若是,则获取所述待识别封面图像的各个区块图像,在所述第二图库内搜索与所述区块图像相同的预定区域图像,并将所述待识别封面图像识别为在所述第二图库搜索出的,预定区域图像对应的样本封面图像;If so, obtain each block image of the cover image to be identified, search for an image of a predetermined area identical to the block image in the second gallery, and identify the cover image to be identified as being in the first image The sample cover image corresponding to the image in the predetermined area searched out of the second library;
    若否,则将所述待识别封面图像识别为在所述第一图库内搜索出的所述样本封面图像。If not, the to-be-recognized cover image is identified as the sample cover image found in the first gallery.
  2. 根据权利要求1所述的封面图像的识别方法,其特征在于,The method for identifying a cover image according to claim 1, wherein:
    所述第二图库包含的所述预定区域图像还具有长度和宽度的第一标签;The image of the predetermined area contained in the second gallery also has a first label of length and width;
    所述获取所述待识别封面图像的各个区块图像,包括:The acquisition of each block image of the cover image to be identified includes:
    获取待识别封面图像的各个区块的区块位置;Obtain the block position of each block of the cover image to be recognized;
    使用所述第一标签包含的长度和宽度,截取所述待识别封面图像的各个区块,生成区块图像。Using the length and width included in the first tag, intercept each block of the cover image to be recognized to generate a block image.
  3. 根据权利要求1所述的封面图像的识别方法,其特征在于,The method for identifying a cover image according to claim 1, wherein:
    所述第二图库包含的所述预定区域图像还具有第二标签,第二标签包括所述预定区域图像的第一图像特性信息及第一文字特征信息;The predetermined area image contained in the second gallery also has a second label, and the second label includes the first image characteristic information and the first text characteristic information of the predetermined area image;
    所述方法还包括:在所述获取所述待识别封面图像的各个区块图像时,还获取所述区块图像的第二图像特征信息及第二文字特征信息;The method further includes: when acquiring each block image of the to-be-recognized cover image, further acquiring second image feature information and second character feature information of the block image;
    所述在所述第二图库内搜索与所述区块图像相同的预定区域图像,并将所述待识别封面图像识别为在所述第二图库搜索出的,预定区域图像对应的样本封面图像,包括:Searching for a predetermined area image identical to the block image in the second gallery, and identifying the to-be-recognized cover image as a sample cover image corresponding to the predetermined area image searched in the second gallery ,include:
    在所述第二图库内搜索与所述区块图像的第一图像特性信息及第一文字特征信息相同的第二标签代表的预定区域图像;Searching in the second gallery for a predetermined area image represented by a second label that is the same as the first image characteristic information and the first text characteristic information of the block image;
    将所述待识别封面图像识别为在所述第二图库搜索出的,预定区域图像对应的样本封面图像。The cover image to be recognized is identified as a sample cover image corresponding to a predetermined area image found in the second library.
  4. 根据权利要求1所述的封面图像的识别方法,其特征在于,The method for identifying a cover image according to claim 1, wherein:
    所述方法还包括:预先建立第二图库;The method also includes: pre-establishing a second gallery;
    所述第二图库的建立方法包括:The method for establishing the second gallery includes:
    获取所述第一图库,并生成空白图库;Obtain the first gallery, and generate a blank gallery;
    在所述第一图库内筛选具有相同关联性的样本封面图像;Screening sample cover images with the same relevance in the first gallery;
    对筛选出的样本封面图像进行预定区域的截图,得到预定区域图像;Take a screenshot of the predetermined area on the screened sample cover image to obtain an image of the predetermined area;
    获取所述预定区域图像的长度和宽度,并使用长度和宽度生成所述预定区域图像的第一标签;Acquiring the length and width of the predetermined area image, and using the length and width to generate a first label of the predetermined area image;
    提取所述预定区域图像的第一图像特征信息及第一文字特征信息,并使用所述第一图像特征信息及所述第一文字特征信息生成所述预定区域图像的第二标签;extracting first image feature information and first text feature information of the predetermined area image, and using the first image feature information and the first text feature information to generate a second label of the predetermined area image;
    将所有具有第一标签及第二标签的预定区域图像分配在所述空白图库的预定区域,生成第二图库,所述第二图库的各个预定区域中,每个预定区域内样本封面图像之间的关联性相同,不同预定区域之间,样本封面图像之间的关联性不同。distributing all the predetermined area images with the first label and the second label in the predetermined area of the blank gallery to generate a second gallery, in each predetermined area of the second gallery, between the sample cover images in each predetermined area are the same, and the correlations between sample cover images are different between different predetermined regions.
  5. 根据权利要求1所述的封面图像的识别方法,其特征在于,The method for identifying a cover image according to claim 1, wherein:
    所述方法还包括:预先对在第一图库内搜索出样本封面图像生成预搜索结果,并对第一图库内搜索出的样本封面图像与其他样本封面图像具有关联性的预搜索结果进行标记;The method further includes: generating a pre-search result for the sample cover image searched in the first gallery in advance, and marking the pre-search result that the sample cover image searched in the first gallery is related to other sample cover images;
    所述判断在第一图库内搜索出的样本封面图像是否与其他样本封面图像具有关联性,包括:The judging whether the sample cover image searched in the first gallery is related to other sample cover images includes:
    获取在所述第一图库内搜索与所述待识别封面图像相匹配的样本封面图像,得到与所述预搜索结果相同的搜索结果;Acquire and search for a sample cover image matching the cover image to be identified in the first gallery, and obtain the same search result as the pre-search result;
    识别所述搜索结果对应的预搜索结果中是否具有标记;identifying whether there is a mark in the pre-search result corresponding to the search result;
    若有,则判断在第一图库内搜索出样本封面图像与其他样本封面图像具有关联性。If so, it is determined that the sample cover image found in the first gallery is related to other sample cover images.
  6. 根据权利要求1所述的封面图像的识别方法,其特征在于,The method for identifying a cover image according to claim 1, wherein:
    所述待识别封面图像为绘本的封面图像;The cover image to be identified is the cover image of a picture book;
    获取所述第一图库及第二图库的方法包括:The method for obtaining the first gallery and the second gallery includes:
    读取本地存储,或/和,读取云端存储,获取所述第一图库及所述第二图库。Read local storage, or/and, read cloud storage, and acquire the first gallery and the second gallery.
  7. 根据权利要求1所述的封面图像的识别方法,其特征在于,The method for identifying a cover image according to claim 1, wherein:
    所述预定区域图像及所述区块图像,均至少包括对应样本封面图像的名称和序号。Both the predetermined area image and the block image include at least the name and serial number of the corresponding sample cover image.
  8. 一种封面图像的识别装置,其特征在于,包括:A recognition device for a cover image, characterized in that it includes:
    数据获取模块,用于获取待识别封面图像、第一图库及第二图库,待识别封面图像所述第一图库包含已收录的所有样本封面图像,所述第二图库至少包含一组样本封面图像的预定区域图像,每组所述预定区域图像对应的所述样本封面图像具有关联性,具有所述关联性的所述样本封面图像,包括一个系列的样本封面图像,或,包括一组多语种的样本封面图像;The data acquisition module is used to acquire the cover image to be identified, the first gallery and the second gallery, the first gallery of the cover image to be identified contains all sample cover images that have been included, and the second gallery contains at least one set of sample cover images The sample cover images corresponding to each group of predetermined area images have a correlation, and the sample cover images with the correlation include a series of sample cover images, or include a group of multilingual A sample cover image for ;
    第一搜索模块,用于在所述第一图库内搜索与所述待识别封面图像相匹配的样本封面图像;A first search module, configured to search for a sample cover image matching the cover image to be identified in the first gallery;
    判断模块,用于判断在第一图库内搜索出的样本封面图像是否与其他样本封面图像具有关联性;A judging module, configured to judge whether the sample cover image searched in the first gallery is related to other sample cover images;
    第二搜索模块,则获取所述待识别封面图像的各个区块图像,在所述第二图库内搜索与所述区块图像相同的预定区域图像,并将所述待识别封面图像识别为在所述第二图库搜索出的,预定区域图像对应的样本封面图像;The second search module obtains each block image of the cover image to be identified, searches for an image of a predetermined area identical to the block image in the second gallery, and identifies the cover image to be identified as The sample cover image corresponding to the image in the predetermined area searched out of the second gallery;
    输出模块,用于若所述判断模块的判断为否,则将所述待识别封面图像识别为在所述第一图库内搜索出的所述样本封面图像。An output module, configured to identify the cover image to be recognized as the sample cover image found in the first library if the judgment of the judging module is negative.
  9. 一种计算机可读存储介质,存储有计算机程序,所述计算机程序被处理器执行时,使得所述处理器执行如权利要求1至7中任一项所述方法的步骤。A computer-readable storage medium storing a computer program, when the computer program is executed by a processor, the processor is made to perform the steps of the method according to any one of claims 1 to 7.
  10. 一种图像识别设备,包括存储器和处理器,所述存储器存储有计算机程序,所述计算机程序被所述处理器执行时,使得所述处理器执行如权利要求1至7中任一项所述方法的步骤。An image recognition device, comprising a memory and a processor, the memory stores a computer program, and when the computer program is executed by the processor, the processor performs the process described in any one of claims 1 to 7. method steps.
PCT/CN2021/103865 2021-06-30 2021-06-30 Method and apparatus for recognizing cover image, storage medium, and recognition device WO2023272659A1 (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
PCT/CN2021/103865 WO2023272659A1 (en) 2021-06-30 2021-06-30 Method and apparatus for recognizing cover image, storage medium, and recognition device

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/CN2021/103865 WO2023272659A1 (en) 2021-06-30 2021-06-30 Method and apparatus for recognizing cover image, storage medium, and recognition device

Publications (1)

Publication Number Publication Date
WO2023272659A1 true WO2023272659A1 (en) 2023-01-05

Family

ID=84689877

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2021/103865 WO2023272659A1 (en) 2021-06-30 2021-06-30 Method and apparatus for recognizing cover image, storage medium, and recognition device

Country Status (1)

Country Link
WO (1) WO2023272659A1 (en)

Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20150199412A1 (en) * 2014-01-10 2015-07-16 Htc Corporation Mobile communications device, non-transitory computer-readable medium and method for displaying a search result cover page and switching from the search result cover page to a search result page
CN106445939A (en) * 2015-08-06 2017-02-22 阿里巴巴集团控股有限公司 Image retrieval, image information acquisition and image identification methods and apparatuses, and image identification system
CN108228761A (en) * 2017-12-21 2018-06-29 深圳市商汤科技有限公司 The customized image search method in support area and device, equipment, medium
CN109960742A (en) * 2019-02-18 2019-07-02 苏州科达科技股份有限公司 The searching method and device of local message
CN110807110A (en) * 2019-09-30 2020-02-18 奇安信科技集团股份有限公司 Image searching method and device combining local and global features and electronic equipment
CN111191067A (en) * 2019-12-25 2020-05-22 深圳市优必选科技股份有限公司 Picture book identification method, terminal device and computer readable storage medium
CN111353062A (en) * 2018-12-21 2020-06-30 华为技术有限公司 Image retrieval method, device and equipment
CN112966137A (en) * 2021-01-27 2021-06-15 中国电子进出口有限公司 Image retrieval method and system based on global and local feature rearrangement

Patent Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20150199412A1 (en) * 2014-01-10 2015-07-16 Htc Corporation Mobile communications device, non-transitory computer-readable medium and method for displaying a search result cover page and switching from the search result cover page to a search result page
CN106445939A (en) * 2015-08-06 2017-02-22 阿里巴巴集团控股有限公司 Image retrieval, image information acquisition and image identification methods and apparatuses, and image identification system
CN108228761A (en) * 2017-12-21 2018-06-29 深圳市商汤科技有限公司 The customized image search method in support area and device, equipment, medium
CN111353062A (en) * 2018-12-21 2020-06-30 华为技术有限公司 Image retrieval method, device and equipment
CN109960742A (en) * 2019-02-18 2019-07-02 苏州科达科技股份有限公司 The searching method and device of local message
CN110807110A (en) * 2019-09-30 2020-02-18 奇安信科技集团股份有限公司 Image searching method and device combining local and global features and electronic equipment
CN111191067A (en) * 2019-12-25 2020-05-22 深圳市优必选科技股份有限公司 Picture book identification method, terminal device and computer readable storage medium
CN112966137A (en) * 2021-01-27 2021-06-15 中国电子进出口有限公司 Image retrieval method and system based on global and local feature rearrangement

Similar Documents

Publication Publication Date Title
US20170243583A1 (en) System and method for speech to text translation using cores of a natural liquid architecture system
CN108304530B (en) Knowledge base entry classification method and device and model training method and device
CN112487248A (en) Video file label generation method and device, intelligent terminal and storage medium
US10152540B2 (en) Linking thumbnail of image to web page
CN111159546A (en) Event pushing method and device, computer readable storage medium and computer equipment
WO2020155749A1 (en) Method and apparatus for constructing personal knowledge graph, computer device, and storage medium
JP4200834B2 (en) Information search system, information search method, and information search program
CN113343108B (en) Recommended information processing method, device, equipment and storage medium
KR20090007524A (en) Toolbar searching method and system for intelligently automatic identification
CN108121987B (en) Information processing method and electronic equipment
CN112995749A (en) Method, device and equipment for processing video subtitles and storage medium
CN112559526A (en) Data table export method and device, computer equipment and storage medium
KR20200100027A (en) Method and device for text-based image retrieval
CN111382570A (en) Text entity recognition method and device, computer equipment and storage medium
CN113449655A (en) Method and device for recognizing cover image, storage medium and recognition equipment
WO2023272659A1 (en) Method and apparatus for recognizing cover image, storage medium, and recognition device
US20200302076A1 (en) Document processing apparatus and non-transitory computer readable medium
CN110874216B (en) Complete code generation method, device, equipment and storage medium
CN111522992A (en) Method, device and equipment for putting questions into storage and storage medium
US10503773B2 (en) Tagging of documents and other resources to enhance their searchability
CN108664945B (en) Image text and shape-pronunciation feature recognition method and device
CN111126201A (en) Method and device for identifying people in script
CN114449310A (en) Video editing method and device, computer equipment and storage medium
CN114610948A (en) Video classification method and device, electronic equipment and storage medium
US11010978B2 (en) Method and system for generating augmented reality interactive content

Legal Events

Date Code Title Description
NENP Non-entry into the national phase

Ref country code: DE