CN110046273B - Book query recommendation method based on drawing, electronic equipment and storage medium - Google Patents

Book query recommendation method based on drawing, electronic equipment and storage medium Download PDF

Info

Publication number
CN110046273B
CN110046273B CN201910137321.9A CN201910137321A CN110046273B CN 110046273 B CN110046273 B CN 110046273B CN 201910137321 A CN201910137321 A CN 201910137321A CN 110046273 B CN110046273 B CN 110046273B
Authority
CN
China
Prior art keywords
book
image
user
image information
recommendation method
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN201910137321.9A
Other languages
Chinese (zh)
Other versions
CN110046273A (en
Inventor
邓立邦
刘娅
黎灿勇
陈海强
彭桃
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Guangdong Zhimeiyuntu Tech Corp ltd
Original Assignee
Guangdong Zhimeiyuntu Tech Corp ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Guangdong Zhimeiyuntu Tech Corp ltd filed Critical Guangdong Zhimeiyuntu Tech Corp ltd
Priority to CN201910137321.9A priority Critical patent/CN110046273B/en
Publication of CN110046273A publication Critical patent/CN110046273A/en
Application granted granted Critical
Publication of CN110046273B publication Critical patent/CN110046273B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/50Information retrieval; Database structures therefor; File system structures therefor of still image data
    • G06F16/53Querying
    • G06F16/538Presentation of query results
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/50Information retrieval; Database structures therefor; File system structures therefor of still image data
    • G06F16/58Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually
    • G06F16/583Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually using metadata automatically derived from the content

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Library & Information Science (AREA)
  • Data Mining & Analysis (AREA)
  • Databases & Information Systems (AREA)
  • Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Processing Or Creating Images (AREA)
  • Information Retrieval, Db Structures And Fs Structures Therefor (AREA)

Abstract

The invention discloses a book query recommendation method based on drawing, which comprises the following steps: the acquisition step: acquiring image information input by a user; and (3) comparison: comparing the acquired image information with the book images stored in the database to obtain a matching result; and a display step: and displaying the matching result. The invention also provides an electronic device and a computer readable storage medium. According to the book query recommendation method based on drawing, the image information input by the user is matched with the book image information stored in the database, so that the matched books are queried and recommended for the user, and the processes of borrowing the books and recommending the books are richer and interesting.

Description

Book query recommendation method based on drawing, electronic equipment and storage medium
Technical Field
The present invention relates to the field of book query technologies, and in particular, to a drawing-based book query recommendation method, an electronic device, and a storage medium.
Background
At present, a plurality of books are stored in a library, and when people borrow, books are usually searched by entering book search keywords through a self-service query screen. Since the book retrieval needs to input key information more accurately, and the recommendation of some new books or books is mostly performed in a text matching mode at present, some readers hope to randomly acquire some new book recommendations or acquire some unexpected surprise through matching recommendation by searching in a graphic image mode, and meanwhile, the book recommendation of children is mostly based on image drawing, and the book name is not the most attractive for the children, so how to increase the interestingness of the book recommendation, and people are more attractive to be a direction worthy of research when acquiring the book information.
Disclosure of Invention
In order to overcome the defects of the prior art, one of the purposes of the invention is to provide a book inquiry and recommendation method based on drawing, which can solve the technical problem of inquiring and displaying books based on user input images.
The second object of the present invention is to provide an electronic device, which can solve the technical problem of inquiring and displaying books based on the input image of the user.
It is still another object of the present invention to provide a computer-readable storage medium that can solve the technical problem of performing book inquiry display based on a user input image.
One of the purposes of the invention is realized by adopting the following technical scheme:
a drawing-based book query recommendation method, comprising the steps of:
the acquisition step: acquiring image information input by a user;
and (3) comparison: comparing the acquired image information with the book images stored in the database to obtain a matching result;
and a display step: and displaying the matching result.
Further, in the step of obtaining, the image information input by the user is image information drawn by the user and/or image information clicked by the user, and the image information drawn by the user is a vector line manuscript graph.
Further, the book image is mainly obtained through the following steps:
the acquisition step: collecting a cover image of a book;
the conversion step: obtaining a vector line manuscript graph corresponding to a cover image according to the cover image of the book;
generating: and generating a corresponding book image according to the vector linear manuscript pattern.
Further, the generating step specifically includes the following sub-steps:
automatically splitting the vector line manuscript graph to convert each line forming the vector line manuscript graph into a path;
obtaining all combinations of each path and the paths which form the vector line manuscript graph with the rest according to an enumeration method;
each path combination is stored as a corresponding book image.
Further, the comparing step specifically includes the following sub-steps:
mapping each path of the acquired image information and the book image in the database into a character array;
and comparing the character array of the mapped image information with the character array corresponding to the book image, thereby obtaining a matching result.
Further, the matching result is a similarity ranking result, and the similarity ranking result comprises book image similarity ranking.
Further, the method further comprises a selection step after the display step: and automatically completing lines of the image information input by the user according to the book image selected by the user, and displaying corresponding book position information.
Further, the matching result is a book image with highest similarity, the image information input by the user is automatically complemented according to the book image, and the corresponding book position information is displayed.
The second purpose of the invention is realized by adopting the following technical scheme:
an electronic device comprising a memory, a processor and a computer program stored on the memory and executable on the processor, the processor implementing any one of the objects of the invention when executing the computer program.
The third purpose of the invention is realized by adopting the following technical scheme:
a computer readable storage medium having stored thereon a computer program which when executed by a processor achieves a drawing-based book query recommendation method according to any one of the objects of the invention.
Compared with the prior art, the invention has the beneficial effects that:
according to the book query recommendation method based on drawing, the image information input by the user is matched with the book image information stored in the database, so that the matched books are queried and recommended for the user, and the processes of borrowing the books and recommending the books are richer and interesting.
Drawings
Fig. 1 is a flowchart of a book query recommendation method based on drawing in the first embodiment.
Detailed Description
The present invention will be further described with reference to the accompanying drawings and detailed description, wherein it is to be understood that, on the premise of no conflict, the following embodiments or technical features may be arbitrarily combined to form new embodiments.
Example 1
As shown in fig. 1, the present embodiment provides a book query recommendation method based on drawing, which includes the following steps:
s1: acquiring image information input by a user; in step S1, the image information input by the user is image information drawn by the user and/or image information clicked by the user, and the image information drawn by the user is a vector draft graph. This step is mainly to obtain a basic comparison image, and there are two alternative ways, namely, a database is pre-built to store various images, wherein the images are not cover images, but are a certain image element in the cover images, and the memory of the user is not particularly accurate, so that the user can only memorize a certain part in a certain part of books; and then displayed to the user, and the corresponding image is clicked by the user. Of course, the above-mentioned method consumes much effort of the user, and can not promote the interest of the user in inquiring the borrowed books; in this embodiment, it is most preferable to provide the user with a touch screen or a drawing screen so that the user can draw on it freely, which results in higher user autonomy and better interactivity, and higher freedom of use by the user.
S2: comparing the acquired image information with the book images stored in the database to obtain a matching result; in the comparison, the similarity of the image information may be directly compared, but in addition to this, the comparison may be performed by converting the vector draft pattern into a character array to obtain the similarity, which is preferably performed in the second mode in this embodiment. The specific implementation mode is as follows:
the method is firstly aimed at constructing a database, and because book images in the database are the reference for comparison, a proper book library image storage mode needs to be selected, and the book images are mainly obtained through the following steps:
the acquisition step: collecting a cover image of a book; the cover images of all the books which can be contacted currently are required to be acquired, so that the construction of a database can be perfected, and after all the images are acquired, the books are more aimed at books of the type of painting or the type of artistic painting; other types of books with graphic covers can be provided in addition to the two types of books.
The conversion step: obtaining a vector line manuscript graph corresponding to a cover image according to the cover image of the book; this step converts the image into a vector line manuscript, so that the later comparison is more accurate, and if direct image recognition is adopted, the distinction of elements in the cover is not easy, so that the accuracy of the comparison result is also reduced.
Generating: and generating a corresponding book image according to the vector linear manuscript pattern. The generating step specifically comprises the following substeps:
automatically splitting the vector line manuscript graph to convert each curve forming the vector line manuscript graph into a path;
obtaining all combinations of each path and the paths which form the vector line manuscript graph with the rest according to an enumeration method;
each path combination is stored as a corresponding book image. Because of inaccuracy in user memory, enumeration needs to be performed as much as possible when information is stored. For example, when a book is drawn, a train, eggs, sun or a special character is present, the user only remembers the key characteristics, such as the special character and the eggs, due to the insufficiency of memory, so that when the user only draws the special character and the eggs, the probability of picking an accurate book is greatly improved. And different elements are split and combined, so that when a user draws at will, a richer book corresponding to the drawing elements of the user can be obtained.
The method aims at constructing a database, and comprises the following steps of:
mapping each path of the acquired image information and the book image in the database into a character array; the vector line manuscript graph is set, so that before comparison, all images are scaled in equal proportion and uniformly set to be the size of preset N+ N, after the equal proportion scaling, one side of the maximum size in the length or width of the image content is attached to the edge of the scaled picture cloth, and the width or length side of the relatively smaller size is scaled in a self-adaptive mode. The appropriate value of N is selected for different sizes and complexity of the graphical content. And respectively projecting the divided images in the horizontal direction and the vertical direction, counting the value of each square area in the horizontal direction and the vertical direction, and marking the distribution condition of the points in each square area by using binary codes 0 and 1. Wherein, the mark 1 represents that the region has pixel point distribution, and the mark 0 represents that the region has pixel point distribution; and then, giving a thickness value to the mapped color region, and representing the pixel point thickness of each grid region by 1/N. And counting the distribution condition and thickness value of the pixel points of each image after the square area of each image is projected in the horizontal and vertical 2 directions, and obtaining the distribution data of the pixel points of each image, wherein the distribution data is a corresponding character array.
And comparing the character array of the mapped image information with the character array corresponding to the book image, thereby obtaining a matching result. And matching the vector line manuscript graph drawn by the user with each curve of the vector graph of each book cover. And sequencing the similarity from high to low, and taking a combined draft path corresponding to the curve with the highest similarity.
S3: and displaying the matching result. The matching result is a similarity ranking result, and the similarity ranking result comprises book image similarity ranking. And according to the matching result, the hand drawing shape of the user is completed, the drawing process is displayed on a display screen, after the completion of the completion drawing of the book cover graph, the query and borrowing two-dimensional code of the book is displayed, the book information is checked and borrowed after the user scans, a recommendable button can be displayed, and the user can draw the graph again by clicking the button to obtain the query and recommendable book. The completion is mainly performed on the image drawn by the user, the matched line paths are replaced by the line manuscript drawn by the user, and the rest combination paths corresponding to the line paths are used for completing the book line manuscript, so that the hand drawing trace of the user can be reserved.
S4: and automatically completing lines of the image information input by the user according to the book image selected by the user, and displaying corresponding book position information. The method is mainly aimed at providing a plurality of books for users to select when more matching results exist, and the accuracy of the matching results can be further improved through the method. After the completion of the graphic completion drawing of the book cover according to the image selected by the user, displaying the query and borrowing two-dimensional code of the book for the user to view and borrow the book information after scanning, displaying a recommendable button, and enabling the user to draw the graphic again by clicking the button to obtain the book recommendation.
According to the invention, after the user manually draws the line manuscript image on the touch screen, the hand-drawn image of the user is matched with the book cover image, and then the corresponding matched book is recommended to the user, and the user borrows the book by browsing the book cover image and scanning the two-dimensional code, so that the process of borrowing and recommending the book is more interesting and attractive.
Example two
The second embodiment discloses an electronic device, which includes a processor, a memory, and a program, where the processor and the memory may each adopt one or more, the program is stored in the memory, and configured to be executed by the processor, and when the processor executes the program, the method for recommending book query based on drawing in the first embodiment is implemented. The electronic device may be a series of electronic devices such as a cell phone, a computer, a tablet computer, etc.
Example III
Embodiment three discloses a computer readable storage medium for storing a program, and when the program is executed by a processor, the method for recommending book query based on drawing of embodiment one is implemented.
Of course, the storage medium containing computer executable instructions provided in the embodiments of the present invention is not limited to the method operations described above, and may also perform related operations in the method provided in any embodiment of the present invention.
From the above description of embodiments, it will be clear to a person skilled in the art that the present invention may be implemented by means of software and necessary general purpose hardware, but of course also by means of hardware, although in many cases the former is a preferred embodiment. Based on such understanding, the technical solution of the present invention may be embodied essentially or in a part contributing to the prior art in the form of a software product, which may be stored in a computer readable storage medium, such as a floppy disk, a Read-Only Memory (ROM), a random access Memory (Random Access Memory, RAM), a FLASH Memory (FLASH), a hard disk or an optical disk of a computer, etc., and include several instructions for causing an electronic device (which may be a personal computer, a server, or a network device, etc.) to execute the method according to the embodiments of the present invention.
It should be noted that, in the above embodiment of the notification device based on content update, each unit and module included are only divided according to the functional logic, but not limited to the above division, so long as the corresponding functions can be implemented; in addition, the specific names of the functional units are also only for distinguishing from each other, and are not used to limit the protection scope of the present invention.
The above embodiments are only preferred embodiments of the present invention, and the scope of the present invention is not limited thereto, but any insubstantial changes and substitutions made by those skilled in the art on the basis of the present invention are intended to be within the scope of the present invention as claimed.

Claims (7)

1. A book query recommendation method based on drawing, which is characterized by comprising the following steps:
the acquisition step: acquiring image information input by a user, wherein the image information input by the user is image information drawn by the user and/or image information clicked by the user, and the image information drawn by the user is a vector line manuscript graph;
and (3) comparison: comparing the acquired image information with the book images stored in the database to obtain a matching result; the book image is mainly obtained through the following steps:
the acquisition step: collecting a cover image of a book;
the conversion step: obtaining a vector line manuscript graph corresponding to a cover image according to the cover image of the book;
generating: generating a corresponding book image according to the vector line manuscript pattern; the generating step specifically comprises the following substeps:
automatically splitting the vector line manuscript graph to convert each line forming the vector line manuscript graph into a path;
obtaining all combinations of each path and the paths which form the vector line manuscript graph with the rest according to an enumeration method;
storing each path combination as a corresponding book image;
and a display step: and displaying the matching result.
2. The book query recommendation method based on drawing as claimed in claim 1, wherein said comparing step specifically comprises the sub-steps of:
mapping the acquired image information and the book images in the database into character arrays;
and comparing the character array of the mapped image information with the character array corresponding to the book image, thereby obtaining a matching result.
3. The plot-based book query recommendation method of claim 2, wherein the matching result is a similarity ranking result, the similarity ranking result comprising a book image similarity ranking.
4. The method of claim 3, further comprising the step of selecting after the displaying step: and automatically completing lines of the image information input by the user according to the book image selected by the user, and displaying corresponding book position information.
5. The method for recommending book queries based on drawing as claimed in claim 4, wherein the matching result is a book image with highest similarity, and the image information inputted by the user is automatically complemented according to the book image, and the corresponding book position information is displayed.
6. An electronic device comprising a memory, a processor and a computer program stored on the memory and executable on the processor, wherein the processor implements a plot-based book query recommendation method according to any one of claims 1-5 when the computer program is executed by the processor.
7. A computer-readable storage medium having stored thereon a computer program, characterized by: the computer program, when executed by a processor, implements a drawing-based book query recommendation method as claimed in any one of claims 1 to 5.
CN201910137321.9A 2019-02-25 2019-02-25 Book query recommendation method based on drawing, electronic equipment and storage medium Active CN110046273B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201910137321.9A CN110046273B (en) 2019-02-25 2019-02-25 Book query recommendation method based on drawing, electronic equipment and storage medium

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201910137321.9A CN110046273B (en) 2019-02-25 2019-02-25 Book query recommendation method based on drawing, electronic equipment and storage medium

Publications (2)

Publication Number Publication Date
CN110046273A CN110046273A (en) 2019-07-23
CN110046273B true CN110046273B (en) 2023-10-03

Family

ID=67274216

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201910137321.9A Active CN110046273B (en) 2019-02-25 2019-02-25 Book query recommendation method based on drawing, electronic equipment and storage medium

Country Status (1)

Country Link
CN (1) CN110046273B (en)

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN111796754B (en) * 2020-06-30 2022-03-29 上海连尚网络科技有限公司 Method and device for providing electronic books

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2011088386A1 (en) * 2010-01-15 2011-07-21 Digimarc Corporation Methods and arrangements relating to signal rich art
WO2013089083A1 (en) * 2011-12-14 2013-06-20 株式会社インプレスR&D Information management system for electronic books
CN107679070A (en) * 2017-08-22 2018-02-09 科大讯飞股份有限公司 A kind of intelligence, which is read, recommends method and apparatus, electronic equipment
CN107766547A (en) * 2017-10-31 2018-03-06 掌阅科技股份有限公司 E-book recommends method, electronic equipment and computer-readable storage medium
CN108984752A (en) * 2018-07-17 2018-12-11 华北理工大学 A kind of Library sysem books intelligent recommendation method

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2011088386A1 (en) * 2010-01-15 2011-07-21 Digimarc Corporation Methods and arrangements relating to signal rich art
WO2013089083A1 (en) * 2011-12-14 2013-06-20 株式会社インプレスR&D Information management system for electronic books
CN107679070A (en) * 2017-08-22 2018-02-09 科大讯飞股份有限公司 A kind of intelligence, which is read, recommends method and apparatus, electronic equipment
CN107766547A (en) * 2017-10-31 2018-03-06 掌阅科技股份有限公司 E-book recommends method, electronic equipment and computer-readable storage medium
CN108984752A (en) * 2018-07-17 2018-12-11 华北理工大学 A kind of Library sysem books intelligent recommendation method

Also Published As

Publication number Publication date
CN110046273A (en) 2019-07-23

Similar Documents

Publication Publication Date Title
US9990557B2 (en) Region selection for image match
US8553981B2 (en) Gesture-based visual search
CN110413816B (en) Color Sketch Image Search
US20120054177A1 (en) Sketch-based image search
CN110516096A (en) Synthesis perception digital picture search
US8917957B2 (en) Apparatus for adding data to editing target data and displaying data
CN104685501A (en) Identifying textual terms in response to a visual query
CN112464115A (en) Information display method and device and computer storage medium
CN111339213A (en) Knowledge graph-based visual display method, electronic equipment and medium
JP6276279B2 (en) Method and apparatus for graphic code database update and retrieval
KR20200059993A (en) Apparatus and method for generating conti for webtoon
Purificato et al. Multimedia and geographic data integration for cultural heritage information retrieval
CN110956213A (en) Method and device for generating remote sensing image feature library and method and device for retrieving remote sensing image
Ramnath et al. AutoCaption: Automatic caption generation for personal photos
Bhattacharjee et al. Query adaptive multiview object instance search and localization using sketches
CN110046273B (en) Book query recommendation method based on drawing, electronic equipment and storage medium
CN115062134A (en) Knowledge question-answering model training and knowledge question-answering method, device and computer equipment
KR20130038547A (en) System for dual-searching image using region of interest set and method therefor
Ufer et al. Large-scale interactive retrieval in art collections using multi-style feature aggregation
CN111078724A (en) Method, device and equipment for searching test questions in learning system and storage medium
JPH10254901A (en) Method and device for retrieving image
Wang et al. Query by sketch: An asymmetric sketch-vs-image retrieval system
CN104850608A (en) Method for searching keywords on information exhibiting page
Peng et al. Viewing streaming spatially-referenced data at interactive rates
CN111563181B (en) Digital image file query method, device and readable storage medium

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant