CN109344275A - Resource acquisition device and method based on picture recognition - Google Patents

Resource acquisition device and method based on picture recognition Download PDF

Info

Publication number
CN109344275A
CN109344275A CN201810956056.2A CN201810956056A CN109344275A CN 109344275 A CN109344275 A CN 109344275A CN 201810956056 A CN201810956056 A CN 201810956056A CN 109344275 A CN109344275 A CN 109344275A
Authority
CN
China
Prior art keywords
picture
original image
exterior artwork
result
cutting
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN201810956056.2A
Other languages
Chinese (zh)
Other versions
CN109344275B (en
Inventor
米玖松
赵芬花
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Shenzhen Zhiyuan Excellent Education Technology Co Ltd
Original Assignee
Shenzhen Zhiyuan Excellent Education Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Shenzhen Zhiyuan Excellent Education Technology Co Ltd filed Critical Shenzhen Zhiyuan Excellent Education Technology Co Ltd
Priority to CN201810956056.2A priority Critical patent/CN109344275B/en
Publication of CN109344275A publication Critical patent/CN109344275A/en
Application granted granted Critical
Publication of CN109344275B publication Critical patent/CN109344275B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q50/00—Information and communication technology [ICT] specially adapted for implementation of business processes of specific business sectors, e.g. utilities or tourism
    • G06Q50/10—Services
    • G06Q50/20—Education
    • G06Q50/205—Education administration or guidance
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T3/00—Geometric image transformations in the plane of the image
    • G06T3/04—Context-preserving transformations, e.g. by using an importance map
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00—Arrangements for image or video recognition or understanding
    • G06V10/70—Arrangements for image or video recognition or understanding using pattern recognition or machine learning
    • G06V10/74—Image or video pattern matching; Proximity measures in feature spaces
    • G06V10/75—Organisation of the matching processes, e.g. simultaneous or sequential comparisons of image or video features; Coarse-fine approaches, e.g. multi-scale approaches; using context analysis; Selection of dictionaries
    • G06V10/757—Matching configurations of points or features

Landscapes

  • Engineering & Computer Science (AREA)
  • Business, Economics & Management (AREA)
  • Theoretical Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Physics & Mathematics (AREA)
  • Tourism & Hospitality (AREA)
  • Health & Medical Sciences (AREA)
  • General Health & Medical Sciences (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Strategic Management (AREA)
  • Educational Technology (AREA)
  • Educational Administration (AREA)
  • Computing Systems (AREA)
  • Economics (AREA)
  • Artificial Intelligence (AREA)
  • Evolutionary Computation (AREA)
  • Databases & Information Systems (AREA)
  • Software Systems (AREA)
  • Medical Informatics (AREA)
  • Multimedia (AREA)
  • Human Resources & Organizations (AREA)
  • Marketing (AREA)
  • Primary Health Care (AREA)
  • General Business, Economics & Management (AREA)
  • Management, Administration, Business Operations System, And Electronic Commerce (AREA)
  • Electrically Operated Instructional Devices (AREA)

Abstract

The invention discloses a kind of resource acquisition device and method based on picture recognition, which includes client picture acquiring device, obtains exterior artwork；Picture recognition device carries out picture recognition and exports recognition result；Coalignment carries out Data Matching according to recognition result and exports matching result；Output device exports corresponding resource content in corresponding educational resource packet according to matching result；Wherein, picture recognition device includes picture preprocessing module, and exterior artwork is cut to multiple and cuts picture；Picture feature matching module carries out characteristic matching to cutting picture and exports successful match picture；As a result screening module receives successful match picture and exports recognition result.In resource acquisition device and method based on picture recognition of the invention, papery textbook/paper etc. is scanned into exterior artwork by handheld devices such as tablet computers by user can be directly entered study interface by server automatic-search learning Content, user's operation is simplified, is improved learning efficiency.

Description

Resource acquisition device and method based on picture recognition
Technical field
The present invention relates to information education field more particularly to a kind of resource acquisition devices and side based on picture recognition Method.
Background technique
There are mainly three types of traditional electronic courseware education resource positioning methods: the first is positioned by Courseware Resource catalogue Courseware-related information；Second is input textbook title and page number information positioning courseware-related information；The third is positioned by search engine The education resources such as courseware, knowledge point, examination question.Wherein, the first is first to download specified textbook by way of Courseware Resource catalogue Then corresponding Courseware Resource catalogue or complete multimedia courseware with Courseware Resource catalogue open Courseware Resource catalogue step by step Selection needs the resource learnt；The mode of second of input textbook and page number information needs user to be manually entered books page number letter Breath obtains the education resource of the corresponding books page number；The third by input keyword after starting search engine search positioning courseware, The education resources such as knowledge point, examination question.
However, there is certain defect in existing mode.The first by way of Courseware Resource catalogue can not by into The positioning of the row page.The mode of second of input books page number then needs user to be manually entered books and books page number information, needs Input operation positioning is repeated in user, can not disposably guarantee the accuracy for inputting information.The third passes through search engine only Can will input text as input keyword, can not the information such as tablet pattern picture, formula as inputting keyword, search result It is limited, cause search efficiency not high.Three of the above mode is complex for operation step, can not accomplish simple and fast.
Summary of the invention
The technical problem to be solved in the present invention is that provide a kind of improved resource acquisition device based on picture recognition and Method.
The technical solution adopted by the present invention to solve the technical problems is: providing a kind of resource acquisition based on picture recognition Device, including
Client picture acquiring device, for obtaining exterior artwork；
Picture recognition device is connected with the client picture acquiring device, for according to the acquired outside Picture carries out picture recognition, and exports recognition result；
Coalignment is connected with the picture recognition device, for selectively being counted according to the recognition result According to matching, and export matching result；
Output device is connected with the coalignment, for exporting corresponding educational resource according to the matching result Corresponding resource content in packet；
Wherein, the picture recognition device includes
Picture preprocessing module cuts picture for the exterior artwork to be cut to multiple, and every sanction is arranged Cut the priority and weight information of picture；
Picture feature matching module for carrying out characteristic matching to cutting picture described in every, and exports successful match figure Piece；
As a result screening module for receiving the successful match picture, and exports the recognition result.
Preferably, the picture preprocessing module includes
First cuts unit, for the exterior artwork to be subtracted one first non-active area at left and right sides of X-axis, and It generates first and cuts picture, the sum of first non-active area width of the left and right sides and the width ratio of the exterior artwork are 5-45%, described first cuts the width ratio of picture and the exterior artwork as 55-95%；
Second cuts unit, for by the exterior artwork, two sides to subtract one second non-active area above and below Y-axis, and It generates second and cuts picture, the height ratio of the sum of the height of the second non-active area of two sides with the exterior artwork up and down The height ratio of picture and the exterior artwork is cut for 5-45%, described second as 55-95%.
Preferably, the picture preprocessing module further includes
Third cuts unit, for the exterior artwork to be subtracted a third non-active area along Y-axis distal end, and generates the The height ratio of three cutting pictures, the third non-active area and the exterior artwork is 25-45%, and the third cuts picture Height ratio with the exterior artwork is 55-75%；
4th cuts unit, for the exterior artwork to be subtracted one the 4th non-active area along Y-axis distal end, and generates the The height ratio of four cutting pictures, the 4th non-active area and the exterior artwork is 25-45%, and the described 4th cuts picture Height ratio with the exterior artwork is 55-75%.
Preferably, the picture preprocessing module further includes the 5th cutting unit, for the exterior artwork is remote along Y-axis End subtracts one the 5th non-active area, and generates the 5th and cut picture, the 5th non-active area and the exterior artwork For height than being 46%-60%, the height ratio of the 5th cutting picture and the exterior artwork is 40%~54%.
Preferably, the result screening module includes
Judging unit is received, judges whether there is and receives the successful match picture, if so, output reception result；If No, then it fails to match for output；
Weight limit judging unit judges whether the successful match picture is weight limit according to the reception result, If so, the cutting picture of output weight limit is the recognition result；If it is not, then exporting judging result；
Whether weight comparing unit is in received picture according to the judging result successful match picture Weight is maximum, if so, output comparison result；If it is not, then returning to the reception judging unit；
Receiving terminates judging unit, judges whether that all successful match pictures have received according to the comparison result Finish, if so, exporting the comparison result is the recognition result；If it is not, then returning to the reception judging unit.
A kind of resource acquiring method based on picture recognition is also provided, including
Obtain exterior artwork；
Picture recognition is carried out according to the acquired exterior artwork, and exports recognition result；
Data Matching is selectively carried out according to the recognition result, and exports matching result；
Corresponding resource content in corresponding educational resource packet is exported according to the matching result；
Wherein, the exterior artwork according to acquired in carries out picture recognition, and exports recognition result and include:
The exterior artwork is cut to multiple and cuts picture, and every priority and weight for cutting picture is set Information；
Characteristic matching is carried out to cutting picture described in every, and exports successful match picture；
The successful match picture is received, and exports the recognition result.
Preferably, described that the exterior artwork is cut to multiple cutting pictures, including
The exterior artwork is subtracted into one first non-active area at left and right sides of X-axis, and generates first and cuts picture, The sum of first non-active area width of the left and right sides and the width ratio of the exterior artwork are 5-45%, and described first cuts out The width ratio for cutting picture and the exterior artwork is 55-95%；
By the exterior artwork, two sides subtract one second non-active area above and below Y-axis, and generate second and cut picture, The height ratio of the sum of height of the second non-active area and the exterior artwork of the two sides up and down is 5-45%, described second The height ratio for cutting picture and the exterior artwork is 55-95%.
Preferably, described that the exterior artwork is cut to multiple cutting pictures, further include
The exterior artwork is subtracted into a third non-active area along Y-axis distal end, and generates third and cuts picture, described the The height ratio of three non-active area and the exterior artwork is 25-45%, and the third cuts picture and the exterior artwork Height is than being 55-75%；
The exterior artwork is subtracted into one the 4th non-active area along Y-axis distal end, and generates the 4th and cuts picture, described the The height ratio of four non-active area and the exterior artwork is 25-45%, and the described 4th cuts picture and the exterior artwork Height is than being 55-75%.
Preferably, described that the exterior artwork is cut to multiple cutting pictures, further includes: by the exterior artwork along Y Axis distal end subtracts one the 5th non-active area, and generates the 5th and cut picture, the 5th non-active area and the exterior view The height ratio of piece is 46%-60%, and the height ratio of the 5th cutting picture and the exterior artwork is 40%~54%.
Preferably, described to receive the successful match picture, and export the recognition result and include:
It judges whether there is and receives the successful match picture, if so, output reception result；If it is not, then exporting matching Failure；
Judge whether the successful match picture is weight limit according to the reception result, if so, output most authority The cutting picture of weight is the recognition result；If it is not, then exporting judging result；
Whether it is that weight is maximum in received picture according to the judging result successful match picture, if It is then to export comparison result；The successful match picture is received if it is not, judging whether there is described in then returning；
Judge whether that all successful match pictures have received according to the comparison result, if so, output institute Stating comparison result is the recognition result；The successful match picture is received if it is not, judging whether there is described in then returning.
The beneficial effects of the practice of the present invention is:, will in the resource acquisition device and method of the invention based on picture recognition For the exterior artwork that the scanning of the printed matters such as papery textbook generates as input key message, user only need to be hand-held by tablet computer etc. Equipment carries out picture scanning generation exterior artwork to printed matters such as papery textbook/papers can be by server automatic-search correlation It practises content and is directly entered study interface, simplify user's operation, improve user's learning efficiency.
In addition, the resource acquisition device and method of the invention based on picture recognition also has following 3 technical advantages:
1. there is computer writing input capability without user；
2. ensure that the correctness of input books information；
3. simplifying operating procedure.
Detailed description of the invention
Present invention will be further explained below with reference to the attached drawings and examples, in attached drawing:
Fig. 1 is educational resource positioning system locating for the resource acquisition device based on picture recognition of some embodiments of the invention Total composition schematic diagram；
Fig. 2 is that resource acquisition device is positioned with the educational resource in Fig. 1 based on picture recognition in some embodiments of the invention The connection relationship diagram of other modules in system；
Fig. 3 is the connection relationship diagram of client picture acquiring device in Fig. 2, picture recognition device and coalignment；
Fig. 4 is that some embodiments of the invention are external based on the first cutting unit cutting in the resource acquiring method of picture recognition The schematic diagram of picture；
Fig. 5 is that some embodiments of the invention are external based on third cutting unit cutting in the resource acquiring method of picture recognition The schematic diagram of picture；
Fig. 6 is that some embodiments of the invention are external based on the 5th cutting unit cutting in the resource acquiring method of picture recognition The schematic diagram of picture；
Fig. 7 is that some embodiments of the invention are external based on the second cutting unit cutting in the resource acquiring method of picture recognition The schematic diagram of picture；
Fig. 8 is that some embodiments of the invention are external based on the 4th cutting unit cutting in the resource acquiring method of picture recognition The schematic diagram of picture；
Fig. 9 is the composition schematic diagram of educational resource library module 10 in Fig. 1；
Figure 10 is the composition schematic diagram of picture servers original image library module 30 in Fig. 1；
Figure 11 is the composition schematic diagram of original image and index library module 20 in Fig. 1；
Figure 12 is the composition schematic diagram of chapters and sections relating module 40 in Fig. 1；
Figure 13 is the composition schematic diagram of original image and index compression packet and alias association module 50 in Fig. 1；
Figure 14 is the overall flow figure of the resource acquiring method in some embodiments of the invention based on picture recognition；
Figure 15 is the detail flowchart of the resource acquiring method in some embodiments of the invention based on picture recognition；
Figure 16 is the composition schematic diagram of picture recognition device in Fig. 3；
Figure 17 is the stream that result screening is carried out in resource acquiring method in some embodiments of the invention based on picture recognition Journey schematic diagram.
Specific embodiment
For a clearer understanding of the technical characteristics, objects and effects of the present invention, now control attached drawing is described in detail A specific embodiment of the invention.
It is fixed that Fig. 1 shows the educational resource based on picture recognition locating for the resource acquisition device in some embodiments of the invention Total composition of position system, Fig. 2 is the composition schematic diagram of the resource acquisition device in Fig. 1.Educational resource positioning system 700 includes figure Piece server original image library module 30, educational resource library module 10, original image and index library module 20, chapters and sections relating module 40, original image compressed package and alias association module 50 and resource acquisition device 800, wherein original image library module 30 is arranged In a picture servers 500, educational resource library module 10, original image and index library module 20, chapters and sections relating module 40, original Beginning picture compression packet and alias association module 50 are arranged on a search engine server 600.Resource acquisition device 800 includes figure Piece acquisition device 100, picture recognition device 200, coalignment 300, output device 400, client receives and display device 900。
The present invention provides a kind of by that will generate exterior artwork as input pass after the scanning of the printed matters such as papery textbook/paper Key information carries out educational resource search and positioning and search result is returned to the resource acquiring method and resource acquisition dress of user Set, i.e., user after directly scanning papery textbook/test paper generation exterior artwork by the handheld devices such as tablet computer by this outside Picture is simultaneously uploaded to picture servers as input key message, and with the picture servers original graph that is stored in picture servers Picture servers original image in piece library module 30 is matched, and then by the picture servers original image of successful match It is searched in the educational resource library module 10 that file name stores on search engine server as input key message matched Learning Content will then search for successful learning Content and return to user.Realizing user need to only be educated by tablet computer etc. E-learning equipment is scanned the printed matters such as papery textbook and can search relational learning content immediately and be directly entered study The process that user manually enters keyword is omitted, so that it is highly difficult to have evaded figure, picture, formula and equation etc. in interface The input of key message, simplifies user's operation, enriches input key message, saves the operating time, improve search efficiency and Learning efficiency helps user to construct a good knowledge system.
As shown in connection with fig. 2, the scanner program in the handheld devices such as tablet computer directly scans the interior page of papery textbook/paper Or the picture generated after non-interior page is referred to as exterior artwork, which is sent to picture by client picture acquiring device 100 Identification device 200, and the exterior artwork and the picture servers original image in picture servers 500 are matched, then will The file name of the picture servers original image of successful match passes through coalignment 300 and " original image and index compression packet With alias association table ", " original image concordance list " and " chapters and sections contingency table " successively matched, and export the education of successful match Resource packet mark, original image file name and corresponding chapters and sections information, output device 400 according to coalignment 300 match at The result of function exports corresponding resource content in corresponding educational resource packet；It is received by client reception and display device 900 defeated Corresponding resource content and user is shown in the educational resource packet that device 400 exports out.
In the following, explaining and defining in conjunction with the noun occurred in Fig. 1-17 pairs of some embodiments of the invention.
Papery textbook: papery textbook of the present invention refers to primary school book, and middle school's textbook, primary school's religion is auxiliary, and auxiliary, medium and small term is taught in middle school Last paper, middle college entrance examination such as really inscribe at the study class paper printed matter of types, for ease of description, the present invention refers to institute with papery textbook come generation There is the study class paper printed matter of type.Every papery textbook corresponding one " original image and index compression packet " and " education money Source packet ".Under " original image and index compression packet " include one " original image file " and one " original image concordance list ", The series of scans picture of the formats such as the JPG or PNG that are generated after being scanned comprising the papery textbook by page under original image file.Religion Educate all kinds of education resources that resource packet includes the papery textbook.Every papery textbook and " original image and index compression packet " are corresponding One unique alias.
Alias: giving one unique alias of each original image and index compression package definition, which is also referred to as original graph The prefix of piece and index compression packet.The naming method of alias are as follows: resource type+Course in English+original image and index compression packet ID number will be belonging to the papery textbook that is, using the resource type of the corresponding educational resource packet of every papery textbook as first part Subject is as second part, using the corresponding original image of papery textbook and index compression packet ID number as Part III, then will Above-mentioned three parts sequentially combine the alias for forming original image and index compression packet.As alias is PS in " PSCHINESEG110245 " indicates that resource type is that textbook point reads resource, and CHINESE is Chinese language subject, G110245 It is the corresponding original image of papery textbook and index compression packet ID number.It should be appreciated that the alias is also every papery textbook Alias.
Educational resource packet: educational resource packet includes all kinds of education resources for showing user, such as the parsing of textbook text, example The explanation of topic, the explanation of correlated knowledge point synchronize training, teach auxiliary topic or paper etc., display form have figure, picture, One or more types such as text, sound, video, practice, Flash, craps game.The corresponding education resource of every papery textbook Set form the educational resource packet of the papery textbook, the i.e. corresponding educational resource packet of every papery textbook.
Educational resource packet mark: " educational resource packet of the file name of each educational resource packet as the educational resource packet Mark ", which is unique in educational resource library module 10.
Original image: original image of the present invention refers to papery textbook is scanned from cover to back cover all the elements by page after generate JPG or the series of formats such as PNG in page and non-interior page scanned picture, non-interior page scanned picture refers to cover, back cover, preamble, mesh The corresponding scanned picture of the non-original content such as record, postscript, interior page scanned picture criticize the corresponding several scanned pictures of this content.
Original image folder: all scanned pictures of every papery textbook are stored in jointly under the same Photo folder, should The file name of Photo folder can be named as " picture "." original image file " is referred to as " original graph in patent document Piece folder ", original image press from both sides interior scanned picture and update with the update of papery textbook content.
Original image file name: all interior page scanned pictures and Fei Nei pages of scanned picture have pair in " original image folder " The file name answered, referred to as " original image file name ", the title are unique in corresponding " original image folder ".Its In in interior page scanned picture file name papery textbook corresponding with the interior page scanned picture corresponding original content page page Code is consistent；Non- interior page scanned picture file name is identical as its content, such as cover, catalogue, postscript, back cover.
Exterior artwork: the scanner program in the handheld devices such as tablet computer directly scans the interior page or non-interior page of papery textbook The picture generated afterwards is referred to as exterior artwork.
Hereinafter, being illustrated in conjunction with Fig. 1-17 and above-mentioned explanation and definition to specific embodiment.
Educational resource library module 10 is for storing several educational resource packets.Educational resource library module 10 is stored in search engine On server 600, in conjunction with shown in Fig. 1 to Fig. 3, educational resource library module 10 is by the corresponding educational resource packet collection of several papery textbooks It closes.The corresponding educational resource packet of every papery textbook, educational resource packet include all kinds of education resources for showing user, Such as the parsing of textbook text, the explanation of example, the explanation of correlated knowledge point synchronizes and trains, teaches auxiliary topic or paper etc., exhibition Show that form there are one or more types such as figure, picture, text, sound, video, practice, Flash, craps game.
Each educational resource Bao Jun has unique file name as its mark in educational resource library module 10, thus Guarantee that all educational resource packets in educational resource library module 10 will not bear the same name.This document title is known as the educational resource packet " educational resource packet mark ", naming method is: by the educational resource packet corresponding papery textbook " resource type, teaching material version Sheet, affiliated term, affiliated subject, affiliated grade, term, teaching material release, teaching material impression and other information " sequentially group It closes, as at the beginning of the people that entitled " nine section synchronization-people teach under version-junior middle school-mathematics-seven grades--12 editions " is the synchronization of nine sections teaches version The corresponding file name of papery textbook (namely corresponding educational resource of papery textbook of the next term the 12nd edition of middle mathematics seven grades " the educational resource packet mark " of packet), which is unique in educational resource library module 10.
It should be appreciated that all kinds of education resources that educational resource packet includes are completed on the local device in advance by producer In the educational resource library module 10 for uploading and being stored in search engine server 600 afterwards.The manufacturing process of educational resource packet is herein It does not repeat.
In conjunction with shown in Fig. 1, picture servers original image library module 30 is for storing several picture servers original graphs Piece.Alternatively, system further includes a picture servers 500, and picture servers original image library module 30 is stored in picture clothes It is engaged in device 500.
Papery textbooks all on local device corresponding " original image folder " inner all original images are uploaded and gathered Picture servers original image library module 30, every picture in the library are formed under the same file folder of picture servers 500 Referred to as " picture servers original image ".
The unique serial number an of integer type is set as " picture servers are original to every picture server original image Picture identification ", the mark are unique in " picture servers original image library module 30 ".
The file name of every picture server original image is referred to as " the picture servers original image file of the picture Title ", referred to as " picture servers original image title ".Each picture servers original image file name is in photo services It is unique in device original image library module 30.The naming method of picture servers original image file name are as follows: photo services The alias of original image belonging to the corresponding original image of device original image and index compression packet+picture servers original image pair The original image file name answered, it may be assumed that the first part of picture servers original image file name is that the picture servers are former The alias of original image belonging to the corresponding local original image of beginning picture and index compression packet；Second part is the photo services The corresponding original image file name of device original image.If " PSCHINESEG110245 cover " is the picture servers original graph Piece file name, wherein " PSCHINESEG110245 " is partially alias, " cover " is corresponding for the picture servers original image Original image file name, i.e., the file name of the original image be " cover ", imply that the original image is corresponding papery The scanned picture of the cover of textbook；For another example " PSCHINESEG110245 " is partially alias in " PSCHINESEGG11024510 ", 10 be page page 10 in the i.e. corresponding papery textbook of original image file name.It has been addressed before the naming method of alias, herein no longer It repeats.
" picture servers original image mark " and " picture servers original image file name " are picture servers Identification information of the original image in picture servers original image library module 30.
It should be appreciated that " the picture servers original image " in picture servers original image library module 30 is by elder generation of producer Row is uploaded to picture servers 500 for the original image of the original image underedge of papery textbook production in local device and saves, Picture servers original image therein can additions and deletions and update.
As shown in connection with fig. 1, original image and index library module 20 are for storing several original images and index packet, Mei Yiyuan Beginning picture and index packet include an original image file and one " original image concordance list ", include pair in original image file The original image generated after answering papery textbook to scan by page, the corresponding original image file of every index in " original image concordance list " The corresponding original image of underedge；The corresponding original image of each papery textbook and index packet and educational resource packet.
Since original image and index packet are by producer in advance on the local device for the original graph of papery textbook production Piece and index compression are wrapped reach search engine server 600 after decompress and formed, original image and index packet and original image And the particular content and file name of index compression packet are all the same, therefore emphasis of the present invention describes original image and index compression packet phase Close information.
The file name of " original image and index compression packet " is referred to as " original image and index compression packet mark ", it is preceding It addresses, each original image and index compression packet mark are unique, naming methods are as follows: resource type+teaching material version+term + subject+grade+term+other, i.e., by resource type belonging to papery textbook, teaching material version, term, subject, grade, term And other information is sequentially composed, resource type includes that textbook point reads the types such as resource, examination question shooting resource, subject The elementary and middle schools such as finger speech text, mathematics institute subject mesh." auxiliary topic-synchronization paper-is taught as original image and index compression packet are identified as People teach the May 4th plate-making-primary school-mathematics-six grades-it is upper-teaching material says that complete solution is searched with reference to complete works of -17 years autumns-bat entirely " for papery textbook " teaching material that People's Education Publishing House's the May 4th is made a plate six grades last terms of primary school mathematics says complete solution with reference to complete works of autumn in 2017 entirely The file name of the corresponding original image of the synchronous auxiliary paper of religion " and index compression packet.
The resource acquisition system in the embodiment of the present invention based on picture recognition is illustrated below in conjunction with attached drawing 2-13.
As shown in Fig. 2, resource acquisition device 800 includes: client picture acquiring device 100, picture recognition device 200, Coalignment 300, output device 400, reception and display device 900.
Wherein, client picture acquiring device 100 is for obtaining exterior artwork.
Picture recognition device 200 is connected with client picture acquiring device 100, for according to acquired exterior artwork Picture recognition is carried out, and exports recognition result.It mainly includes three modules: picture preprocessing module 2001, picture feature With module 2002, result screening module 2003.
Picture preprocessing module 2001 is connected with client picture acquiring device 100, for exterior artwork to be cut to Multiple cut picture, and the priority and weight information of every cutting picture is arranged.Preferably, picture preprocessing module 2001 is used Multiple cutting pictures are generated in carrying out respective handling to exterior artwork, improve the discrimination of exterior artwork, specifically: by exterior view Piece is cut into multiple and cuts picture, and the priority and weight of every cutting picture is arranged.
Picture feature matching module 2002 is connected with picture preprocessing module 2001, for carrying out to every cutting picture Characteristic matching, and export successful match picture.Preferably, picture feature matching module 2002, which is used to extract, cuts the specific of picture Feature, and in picture servers original image library module 30 picture servers original image carry out characteristic matching, and then It is fitted on specific picture servers original image.
As a result screening module 2003 is connected with picture preprocessing module 2002, for receiving successful match picture, and it is defeated Recognition result out.Preferably, as a result screening module 2003 is used to filter out the picture servers original closest with exterior artwork Beginning picture, and the file name of picture servers original image is sent to coalignment 300.
Coalignment 300 is connected with picture recognition device 200, for selectively carrying out data according to recognition result Match, and exports matching result.Specifically coalignment 300 is connected with result screening module 2003, for being sieved according to result The file name progress for the picture servers original image that modeling block 2003 is sent is resource matched, and exports the education of successful match Resource packet and section name and chapters and sections serial number；
Output device 400 is connected with coalignment 300, for exporting corresponding educational resource packet according to matching result In corresponding resource content.
Client receives and display device 900 is connected with output device 400, for receiving the output of output device 400 Corresponding resource content and user is shown in educational resource packet.
The resource acquiring method in the embodiment of the present invention based on picture recognition is carried out briefly below in conjunction with attached drawing 1-17 It is bright.
Firstly, obtaining exterior artwork by client picture acquiring device 100.
Modules in the present embodiment are described herein: picture servers original image library module 30, for storing Several picture servers original images；Educational resource library module 10, for storing several educational resource packets；Original image and index Library module 20, for store several original images and index packet, each original image and index packet comprising an original image folder and One corresponding " original image concordance list ", original image folder are interior comprising corresponding to the original graph generated after papery textbook is scanned by page Piece, the corresponding corresponding original image of original image underedge of every index in " original image concordance list "；Each papery textbook pair Answer an original image and index packet and educational resource packet；Chapters and sections relating module 40, for storing several " chapters and sections contingency tables ", Corresponding relationship including each chapters and sections and original image in papery textbook in " chapters and sections contingency table "；Original image and index compression packet With alias association module 50, for storing several " original images and index compression packets and alias association table ", " original image and rope Draw compressed package and alias association table " it include original image and index compression packet mark and the corresponding relationship of alias.
Secondly, carrying out picture recognition according to acquired exterior artwork by picture recognition device 200, and export identification knot Fruit.Specifically, by exterior artwork compared with the original image in picture servers original image library module 30 pair, and according to comparison As a result the picture servers original image title of the corresponding picture in picture servers original image library module 30, picture clothes are obtained Device original image title of being engaged in includes alias and original image file name.Preceding to have addressed, all interior pages are swept in " original image folder " Tracing piece and non-interior page scanned picture have corresponding file name, referred to as " original image file name ", and the title is in phase It is unique in " the original image folder " answered.Wherein interior page scanned picture file name papery corresponding with the interior page scanned picture The page number of corresponding original content page is consistent in textbook；Non- interior page scanned picture file name is identical as its content, such as The non-body matter such as cover, catalogue, postscript, back cover.
Then, coalignment 300 selectively carries out Data Matching according to recognition result, and exports matching result.Specifically Ground, according to the alias in picture servers original image title in original image and index compression packet and alias association module 50 " original image and index compression packet and alias association table " in carry out inquiry comparison, obtain corresponding original image and index pressure Contracting packet mark；Since original image and index compression packet mark are of the same name with corresponding " original image concordance list ", therefore according to original Picture and index compression packet mark navigate to corresponding " original image concordance list " in original image and index library module 20；Root The original image file name for including according to picture servers original image title navigates to accordingly on " original image concordance list " Index record；And since original image and index compression packet identify and corresponding " original image concordance list " and " chapters and sections pass Join table " it is of the same name, therefore corresponding " chapters and sections are navigated on chapters and sections relating module 40 according to original image and index compression packet mark Contingency table ", and according to the original image page number or original in original image and index compression packet mark and " original image concordance list " Beginning picture file serial number navigates to the specific index record in " chapters and sections contingency table ", further according to the specific rope in " chapters and sections contingency table " Draw record location corresponding educational resource packet and section name and chapters and sections serial number into educational resource library module 10, then according to religion It educates resource packet and section name and chapters and sections serial number navigates in educational resource library module corresponding chapters and sections in corresponding education resource packet The resources learning content of content and the corresponding page number, corresponding page number resources learning content include the parsing of textbook text, and example is said Solution, the explanation of correlated knowledge point synchronize training, teach auxiliary topic, paper, practice, video link, Flash link, craps game chain One or more types such as connect.
Output device 400 exports corresponding resource content in corresponding educational resource packet and chapters and sections according to matching result.
Last client receives and display device 900 receives corresponding educational resource packet and chapter that output device 400 exports Corresponding resource content and user is shown in section.
It is carried out specifically below in conjunction with the resource acquiring method in 14,15 pairs of embodiment of the present invention of attached drawing based on picture recognition It is bright.
In step S100, client picture acquiring device 100 obtains exterior artwork, and the exterior artwork file of generation is sent to Picture recognition device 200, specifically includes:
S1001, the starting of client scan program；
S1002, scanner program to the scanned auto-focusing in scanning area and shoot scanning, generate exterior artwork text Part；
S1003, the exterior artwork file of generation is sent to picture preprocessing module 2001.
In step S200, picture recognition device 200 got from client picture acquiring device 100 exterior artwork it Afterwards, picture recognition is carried out to acquired exterior artwork, and exported and exterior artwork picture servers original graph the most similar Piece file name.It specifically includes:
S2001, picture preprocessing module 2001, which receive exterior artwork and carry out cutting to it, generates multiple cutting pictures, if Set the priority and weight of every cutting picture.
S2002, picture feature matching module 2002 extract the specific features for cutting picture, and multiple are cut picture difference Characteristic matching is carried out with picture servers original image.
S2003, result screening module 2003 receive the cutting picture of successful match, according to the priority and power for cutting picture Weight filters out a cutting picture the most matched from the cutting picture of several successful match, and the cutting picture is corresponding The file name of picture servers original image be sent to coalignment 300.
Specific explanations are carried out below for above-mentioned S2001-S2003:
S2001, picture preprocessing module 2001, which receive exterior artwork and carry out cutting to it, generates multiple cutting pictures, if Set the priority and weight of every cutting picture:
Picture preprocessing module 2001 is connected with client picture acquiring device 100, for cutting out to exterior artwork It cuts processing and generates multiple cutting pictures, improve the discrimination of exterior artwork, specifically: exterior artwork is cut into plurality of pictures, The priority and distribution weight of every cutting picture are set.
(1) cut picture purpose: there are some moulds at the exterior artwork edge that the shooting of client picture acquiring device 100 obtains The non-active area of paste, the papery class bigger than left and right width (i.e. the width of X-direction) for upper-lower height (i.e. the height of Y-direction) Exterior artwork captured by this (such textbook be mainstream teaching material textbook), the non-active area relatively large one at left and right sides of picture A bit, exterior artwork captured by the papery textbook smaller than left and right width for upper-lower height, the non-active area at left and right sides of picture Domain is relatively much smaller, such non-active area causes certain interference to picture recognition, therefore need to dismiss, and leaves comprising central area Cutting picture.Picture cutting follows that effective coverage is big as far as possible, non-active area principle small as far as possible, and same exterior artwork The cutting picture for generating multiple different effective coverages is repeatedly cut with different methods.To improve whole discrimination, in this example Symbiosis is at 5 cutting pictures after one exterior artwork is repeatedly cut.
In some embodiments, picture preprocessing module includes that the first cutting unit 2001A and second cut unit 2001B.Wherein, the first cutting unit 2001A is used to exterior artwork subtracting one first non-active area at left and right sides of X-axis Domain, and the first cutting picture is generated, the width ratio of the sum of first non-active area width of the left and right sides and exterior artwork is 5- 45%, described first cuts the width ratio of picture and the exterior artwork as 55-95%.Second cutting unit 2001B is used for will Exterior artwork two sides above and below Y-axis subtract one second non-active area, and generate the second cutting picture, and the second of upper and lower two sides The height ratio of the sum of height of non-active area and exterior artwork is 5-45%, and described second cuts picture and the exterior artwork Height ratio be 55-95%.
Preferably, picture preprocessing module further includes that third cuts the cutting of unit 2001C and the 4th unit 2001D.Wherein, Third cuts unit 2001C, for exterior artwork to be subtracted a third non-active area along Y-axis distal end, and generates third cutting The height ratio of picture, third non-active area and exterior artwork is 25-45%, and the third cuts picture and the exterior artwork Height ratio be 55-75%.4th cuts unit 2001D, for exterior artwork to be subtracted one the 4th non-active area along Y-axis distal end Domain, and the 4th cutting picture is generated, the height ratio of the 4th non-active area and exterior artwork is 25-45%, and the described 4th cuts Picture and the height ratio of the exterior artwork are 55-75%.
In some optimum embodiments, picture preprocessing module further includes the 5th cutting unit 2001E, is used for exterior view Piece subtracts one the 5th non-active area along Y-axis distal end, and generates the 5th and cut picture, the 5th non-active area and exterior artwork For height than being 46%-60%, the height ratio of the 5th cutting picture and the exterior artwork is 40%~54%.
(2) in optimum embodiment of the present invention, an exterior artwork method of picture cutting: is cut into 5 altogether in this example Picture, 5 kinds of different method of cutting out are as follows:
1) upper-lower height is greater than captured by the papery textbook (such textbook is mainstream teaching material textbook) of left and right width The non-active area of exterior artwork, the left and right sides is relatively larger, generally takes three cutting pictures altogether:
1. as shown in connection with fig. 4, cutting unit 2001A using first carries out picture cutting.To reduce exterior artwork or so two Side, that is, X-direction interference region in X direction will be at left and right sides of exterior artwork by starting line of Y-axis using the picture upper left corner as origin After all removing non-active area belonging to the width value of M pixel, left middle section is that first cutting picture claims For first cut picture 101, this first cut picture 101 width value be W1, the value be exterior artwork width value subtract 2M pixel value；The height value of the first cutting picture 101 is identical as the height value of exterior artwork, is H pixel value.Such as Fig. 4 Shown, the region as composed by O1O2O4O3 is exterior artwork affiliated area, and it is also X that wherein O1, which is the upper left corner of exterior artwork, The origin of axis and Y-axis intersection, O1O2 are the width in the X-direction of exterior artwork, and O1O3 is the height in exterior artwork Y-direction. The region as composed by A1A2A4A3 is the first cutting 101 affiliated area of picture, and wherein A1 is the first upper left for cutting picture 101 Angle, A1A2 are the first width for cutting picture 101, width value W1；A1A3 is the first height for cutting picture 101, height value For H；The region O1A1A3O3 and A2O2O4A4 are respectively the first fuzzy non-active area that the left and right sides is cut, wherein O1A1, A2O2 are respectively the width for the non-active area that the left and right sides is cut, and width value is respectively M, height value and first Cutting 101 phase of picture is all H.In some embodiments, the sum of first non-active area width of the left and right sides and exterior artwork Width ratio be 5-45%, the described first width ratio for cutting picture and the exterior artwork is 55-95%.
2. as shown in connection with fig. 5, cutting unit 2001C using third carries out picture cutting.In order to reduce exterior artwork Y-direction The interference of upper fuzzy region takes the image of the more visible partial region of nearer end using the picture upper left corner as origin in the Y direction, and one As using X-axis as starting line, remove the remote area of exterior artwork in Y-direction, leave nearer end region, wherein remote area The ratio of height and the height of exterior artwork is generally 25%-45%；The height of the height and exterior artwork in nearer end region Ratio is generally 55%-75%.It thus generates second cutting picture comprising nearer end region and is referred to as third cutting picture 102.As shown in figure 5, the region as composed by O1O2O4O3 is exterior artwork affiliated area, wherein O1 is the upper left of exterior artwork Angle, the origin also intersected for X-axis and Y-axis, O1O2 are the width in the X-direction of exterior artwork, and O1O3 is in exterior artwork Y-direction Height.The region as composed by O1B1B2O2 is that third cuts 102 affiliated area of picture, and wherein O1 is that third cuts picture 102 upper left corner, O1O2 are the width that third cuts picture 102, and width value is identical as the width value of exterior artwork；O1B1 is The ratio of the height value H of the height of three cutting pictures 102, height value H2, height value H2 and exterior artwork is 55%- 75%；The region B1O3O4B2 is the fuzzy third non-active area that distal end is cut, and wherein B1B2 is non-active area Width, the width value is identical as the width value of exterior artwork, and B1O3 is the height of non-active area, which is the height of exterior artwork Angle value H subtracts the height value H2 that third cuts picture 102, and the ratio of the height value of the height value and exterior artwork is 25%- 45%.In some embodiments, the height of third non-active area and exterior artwork ratio is 25-45%, and the third cuts figure Piece and the height ratio of the exterior artwork are 55-75%.
3. as shown in connection with fig. 6, cutting unit 2001E using the 5th carries out picture cutting.Some thirds cut picture 102 It may obscure and be not easy to identify, thus need to be further reduced the interference of fuzzy region in Y-direction, be original with the picture upper left corner Point takes the image of the more visible partial region in more proximal end to remove outside in Y-direction generally using X-axis as starting line in the Y direction The relatively remote area of picture, leaves more proximal end region, wherein the ratio one of the height compared with the height and exterior artwork of remote area As be 46%-60%；The ratio of the height of the height and exterior artwork of more proximal end region is generally 40%~54%.It thus generates Third comprising more proximal end region cuts picture and is referred to as the 5th cutting picture 103.As shown in fig. 6, by O1O2O4O3 institute group At region be exterior artwork affiliated area, wherein O1 be exterior artwork the upper left corner, also be X-axis and Y-axis intersection origin, O1O2 is the width in the X-direction of exterior artwork, and O1O3 is the height in exterior artwork Y-direction.As composed by O1C1C2O2 Region is the 5th cutting 103 affiliated area of picture, and wherein O1 is the 5th upper left corner for cutting picture, and O1O2 cuts picture for the 5th 103 width, width value are identical as the width value of exterior artwork；O1C1 is the 5th height for cutting picture 103, and height value is The ratio of H3, height value H3 and the height value H of exterior artwork are 40%~54%；The region C1O3O4C2 is that distal end is cut The 5th fuzzy non-active area, wherein C1C2 be the 5th non-active area width, the width of the width value and exterior artwork Be worth it is identical, C1O3 be the 5th non-active area height, the height value be exterior artwork height value H subtract the 5th cutting picture The ratio of the height value of 103 height value H3, the height value and exterior artwork is 46%-60%.In some embodiments, the 5th The height of non-active area and exterior artwork ratio is 46%-60%, and the described 5th cuts the height of picture and the exterior artwork Than being 40%~54%.
2) be less than exterior artwork captured by the papery teaching material textbook of width for height, the effective coverage of the left and right sides compared with It is more, there is seldom a part of blank non-active area to interfere up and down, generally takes two cutting pictures altogether:
1. as shown in connection with fig. 7, cutting unit 2001B using second carries out picture cutting.To reduce exterior artwork or more two The interference region of side direction, using the picture upper left corner as origin, using X-axis as starting line along Y-direction by two sides above and below exterior artwork all After removing non-active area belonging to the height value of N number of pixel, left middle section is that the 4th cutting picture is referred to as Picture 201 is cut for second, which is W, the cutting identical as the width value of exterior artwork The height value of picture 201 is that the height value of exterior artwork subtracts 2N pixel value, is H4 pixel value.As shown in fig. 7, by Region composed by O1O2O4O3 is exterior artwork affiliated area, and it is also X-axis and Y-axis that wherein O1, which is the upper left corner of exterior artwork, The origin of intersection, O1O2 are the width in the X-direction of exterior artwork, and O1O3 is the height in exterior artwork Y-direction.By Region composed by D1D2D4D3 is the second cutting 201 affiliated area of picture, and wherein D1 is the second upper left for cutting picture 201 Angle, D1D2 are the second width for cutting picture 201, width value W；D1D3 is the second height for cutting picture 201, and height value is H4；The region O1D1D2O2 and D3O3O4D4 are respectively the second fuzzy non-active area that two sides are cut up and down, wherein O1D1, D3O3 are respectively the height of the second non-active area that two sides are cut up and down, and height value is respectively N, width value with Exterior artwork is mutually all W.In some embodiments, the sum of height of the second non-active area of upper and lower two sides and exterior artwork For height than being 5-45%, the height ratio of the second cutting picture and the exterior artwork is 55-95%.
2. as shown in connection with fig. 8, cutting unit 2001D using the 4th carries out picture cutting.In order to reduce exterior artwork Y-direction The interference of upper distal end fuzzy region takes the figure of the more visible partial region of nearer end using the picture upper left corner as origin in the Y direction Picture removes the remote area of exterior artwork generally using X-axis as starting line in Y-direction, leaves nearer end region, wherein distal end The ratio of the height of the height and exterior artwork in region is generally 25%-45%；The height in nearer end region and exterior artwork The ratio of height is generally 55%-75%.It thus generates the 5th cutting picture comprising nearer end region and is referred to as the 4th sanction Cut picture 202.As shown in figure 8, the region as composed by O1O2O4O3 is exterior artwork affiliated area, wherein O1 is exterior artwork The upper left corner, also be X-axis and Y-axis intersection origin, O1O2 be exterior artwork X-direction on width, O1O3 be exterior artwork Y Height on direction.The region as composed by O1E1E2O2 is the 4th cutting 202 affiliated area of picture, and wherein O1 is the 4th cutting The upper left corner of picture 202, O1O2 are the 4th width for cutting picture 202, and width value is identical as the width value of exterior artwork；O1E1 The ratio of the height value H of the height for cutting picture 202 for the 4th, height value H5, height value H5 and exterior artwork is 55%- 75%；The region E1O3O4E2 is the 4th fuzzy non-active area that distal end is cut, and wherein E1E2 is the 4th non-active area The width in domain, the width value is identical as the width value of exterior artwork, and E1O3 is the height of the 4th non-active area, which is outside The height value H of picture subtracts the height value H5 of the 4th cutting picture 202, and the ratio of the height value of the height value and exterior artwork is 25%-45%.In some embodiments, the height ratio of the 4th non-active area and exterior artwork is 25-45%, and the described 4th cuts out The height ratio for cutting picture and the exterior artwork is 55-75%.
Significantly, since picture preprocessing module 201 can not judge that acquired exterior artwork is that height is greater than Width or height are less than width, therefore exterior artwork is generally cut into 5 above-mentioned cutting figures by picture preprocessing module 201 Piece.And since mainstream papery textbook is generally highly greater than width, therefore the effective coverage for following picture is big as far as possible, and non-active area is most Small principle is measured, the weight that 5 cut picture is successively sorted from big to small are as follows: 101 > 201 > 102 > 202 > 103.
It should be understood that, it is preferable that all exterior artworks are cut into 5 cutting pictures, and every exterior artwork is 5 corresponding Cut that picture is cut according to the above method and Allotment Serial Number, i.e., the serial number of the corresponding 5 cuttings picture of all exterior artworks are 101,102,103,201 and 202.
It is worth noting that: it cuts picture and generally uses ImageMagick function, only need to provide (X, Y, W, H) to function Corresponding cutting picture 101,201,102,202 and 103 can be obtained in four parameters, wherein (X, Y) is the upper left for cutting picture The origin at angle, wherein X is the location of pixels for cutting the picture upper left corner in the X-direction in exterior artwork, it will be understood that X is the location of pixels that exterior artwork upper left corner origin position adds M pixel along the x axis, and Y is to cut picture upper left corner original Point is along the y axis above plus the location of pixels of N number of pixel, and in the present embodiment, M value is generally 0-200, and N value is generally 0- 100, W be to be formed by the width for cutting picture after W pixel of upper extension along the x axis using upper left corner origin position as starting point Degree, H are to be formed by the height for cutting picture after H pixel of upper extension along the y axis using upper left corner origin position as starting point Degree.
Alternatively, in some embodiments, only setting first the cutting unit 2001B of unit 2001A and second can be cut, Such benefit can be not only cut with the first cutting unit 2001A to the biggish picture of upper-lower height, but also to left and right width Biggish picture is cut with the second cutting unit 2001B.In some preferred embodiments, unit can be cut first On the basis of 2001A and second cuts unit 2001B, then third is set and cuts the cutting unit 2001D of unit 2001C and the 4th, Cutting further can be optimized to the biggish picture of upper-lower height, the biggish picture of left and right width.It further, can also be as before State five kinds of cutting methods for including in embodiment, it may include first, which cuts unit 2001A, the second cutting unit 2001B, third, cuts out Unit 2001C, the 4th cutting unit 2001D and the 5th cutting unit 2001E are cut, such cutting effect is more preferably.
It should be noted that above five kinds of cutting methods can not be limited to, it can also increase a variety of cutting methods more, as long as Correlation function may be implemented.
S2002, picture feature matching module 2002 extract the specific features for cutting picture, and multiple are cut picture difference Characteristic matching is carried out with picture servers original image.
It is described as follows:
Picture feature matching module 2002 receive the cutting picture 101 that picture preprocessing module 2001 sends, 201,102, 202 and 103, multithreading is opened, above-mentioned cutting picture 101,201,102,202 and 103 is original with picture servers respectively The picture servers original image of storage in gallery module 30 matches one by one, and returns to matching result, specifically matches skill Art is the prior art, and details are not described herein again.Following processing is carried out respectively for different matching results:
(1) the picture servers original image of the storage in picture and picture servers original image library module 30 is cut With failure, then corresponding failure code is returned to, and the failure code is sent to result screening module 2003；
(2) the picture servers original image of the storage in picture and picture servers original image library module 30 is cut With success, then the corresponding picture servers original image title of picture servers original image of successful match is returned to, and should Picture servers original image title is sent to result screening module 2003.
It should be appreciated that the format for the failure code that picture feature matching module 2002 returns are as follows: result_fail_ cuts figure Piece serial number, cut picture sequence numbers 101 corresponding to picture sequence numbers, that is, above-mentioned cutting picture 101,102,103,201,202,102, 103,201,202,
As result_fail_101 indicates first cutting picture 101, it fails to match.
The format for the successful match that picture feature matching module 2002 returns is that result_success_ cuts picture sequence Number, cut picture sequence numbers 101 corresponding to picture sequence numbers, that is, above-mentioned cutting picture 101,102,103,201,202,102,103, 201,202,
As result_success_102 indicates second cutting 102 successful match of picture.
It is worth noting that, picture feature matching module 2002 is multithreading asynchronous process, therefore one matching knot of every return Matching result is then sent to result screening module 2003 and handled by fruit.Due in a preferred embodiment, there are 5 cutting pictures, therefore scheme Piece characteristic matching module 2002 shares 5 matching results and returns and be sent to result screening module 2003.
S2003, result screening module 2003 receive the cutting picture of successful match, according to the priority and power for cutting picture Weight filters out a cutting picture the most matched from the cutting picture of several successful match, and the cutting picture is corresponding The file name of picture servers original image be sent to coalignment 300.
The picture match that picture feature matching module 2002 is sent often is received as a result, then recording in memory, is carried out corresponding Processing, it is as follows for the specific processing method of matching result:
(1) as the picture cut in picture 101,102,103,201,202 and picture servers original image library module takes Being engaged in, all it fails to match for device original image, then result screening module 2003 receives the failure that picture feature matching module 2002 returns Code indicates that exterior artwork fails to be matched to corresponding picture servers original graph in picture servers original image library module Piece.
(2) as the picture cut in picture 101,102,103,201,202 and picture servers original image library module takes Business device original image have successful match as a result, then result screening module 2003 according to the corresponding weight of picture is cut filters out phase To the maximum cutting picture of weight, and by picture servers original image in the corresponding picture servers 500 of the cutting picture File name is sent to coalignment 300.Picture feature matching module 2002 is received specific to result screening module 2003 to send Certain come cuts picture match successfully as a result, whether then checking other all cutting pictures bigger than the cutting picture weight It is returned matching result:
It 1) is all as weight is greater than the current other all cutting pictures for cutting picture to have returned to matching result and result With failure, then the successful result of current matching is final matching result, and by the corresponding picture clothes of current the cuttings picture The file name of picture servers original image is sent to coalignment 300 in business device 500, weighs without waiting for picture is cut than currently The matching result of the low other cutting pictures of weight；
2) as weight is greater than the letter that the matching result that the current other cutting pictures for cutting picture return includes successful match Breath, then the result of the maximum successful match for cutting picture of the weight is and maximum by the weight as final matching result The file name for cutting picture servers original image in the corresponding picture servers 500 of picture is sent to coalignment 300；
3) matching result for being greater than the current other cutting pictures for cutting picture if any weight not yet returns, then waits weight The matching result that bigger other cutting pictures return, until the maximum matching result for cutting picture of weight is found in confirmation, and The maximum file name for cutting picture servers original image in the corresponding picture servers 500 of picture of the weight is sent to With device 300.
Preferably, in conjunction with shown in Figure 16 and 17, as a result screening module is sentenced including reception judging unit 2003A, weight limit Disconnected unit 2003B, weight comparing unit 2003C, end judging unit 2003D is received.Wherein, judging unit 2003A is received to use Successful match picture is received in judging whether there is, if so, output reception result；If it is not, then it fails to match for output.Most authority Weight judging unit 2003B is used to judge whether successful match picture is weight limit according to reception result, if so, output is maximum The cutting picture of weight is recognition result；If it is not, then exporting judging result.Weight comparing unit 2003C is used to be tied according to judgement Whether fruit comparison match success picture is that weight is maximum in received picture, if so, output comparison result；If it is not, then It returns and receives judging unit 2003A.Receive terminate judging unit 2003D be used for according to comparison result judge whether it is all matching at Function picture has received, if so, output comparison result is recognition result；Judging unit 2003A is received if it is not, then returning.
As a result the specific embodiment of screening module 2003 is as follows:
If the matching result for cutting picture 101,201,102,202,103 and returning that picture feature matching module 2002 is sent Respectively result_success_101, result_fail_201, result_success_102, result_fail_202, Result_fail_103 is arranged successively by the successive timing of return as result_fail_103, result_success_102, Result_fail_202, result_success_101, result_fail_201 (note: with the expression of success in result With success, it fails to match for the expression with fail).Result_fail_103 is received at first, for it fails to match as a result, directly will Memory is recorded in it, then receives result_success_102, is successful match as a result, reading result memory at this time, discovery Matching result is not yet returned than cutting the big cutting picture 101 of 102 weight of picture and cutting picture 201, therefore by result_ Memory is also recorded in success_102, continues waiting for cutting picture 101 and cuts the matching result of picture 201, then receives Result_fail_202 will cut the result that it fails to match of picture 202 and memory is recorded, then receives for cutting picture 101 With successful result " result_success_101 ", and the weight for cutting picture 101 is maximum, therefore final matching result is Result_success_101, it is directly that the cutting picture 101 is corresponding without waiting for the return matching result for cutting picture 201 Picture servers 500 in the file name of picture servers original image be sent to coalignment 300.
In step S300, coalignment 300 is connected with picture recognition device 200, specifically with result screening module 2003 are connected, the file name of the picture servers original image for being sent according to result screening module 2003 with it is corresponding " original image and index compression packet and alias association table ", " original image concordance list " and " chapters and sections contingency table " successively progress Match, and exports educational resource packet mark, section name and the chapters and sections serial number of successful match.
S300, coalignment 300 receive the filename for the picture servers original image that picture recognition device 200 is sent Claim, and by itself and corresponding " original image and index compression packet and alias association table ", " original image concordance list " and " chapters and sections pass Connection table " successively matched, and export educational resource packet mark, section name and the chapters and sections serial number of successful match.
It is described as follows:
The picture servers original image file name that S3001, reception result screening module 2003 are sent, by photo services Alias in device original image file name and the index in corresponding " original image and index compression packet and alias association table " Record carries out inquiry comparison, obtains corresponding original image and index compression packet mark.
Specifically:
The file name of every picture server original image is referred to as " the picture servers original image file of the picture Title ", referred to as " picture servers original image title ".Each picture servers original image file name is in photo services It is unique in device original image library module 30.The naming method of picture servers original image file name are as follows: photo services The alias of original image belonging to the corresponding original image of device original image and index compression packet+picture servers original image pair The original image file name answered, thus when coalignment 300 receives the picture servers that result screening module 2003 is sent When original image file name, that is, original image belonging to the corresponding original image of picture servers original image is got And the alias of index compression packet, it is then " former with table 3 corresponding in alias association module 50 in original image and index compression packet Beginning picture and index compression packet and alias association table " in find original image corresponding with the alias and index compression packet mark Know.
S3002, according to original image and index compression packet mark location to corresponding " original image concordance list ", further according to The original image file name that picture servers original image title includes navigates to accordingly on " original image concordance list " The original image page number or original image file serial number in index record.
Specifically:
Since original image and index compression packet mark are of the same name with corresponding " original image concordance list " i.e. table 1, therefore according to Original image and index compression packet mark navigate to corresponding " original image index in original image and index library module 20 Table "；The original image file name for including further according to picture servers original image title is fixed on " original image concordance list " Position is to the original image page number or original image file serial number in corresponding index record；
S3003, according to original image and index compression packet mark location to corresponding " chapters and sections contingency table ", and according to The original image page number or original image file serial number in " original image concordance list " navigate to specific in " chapters and sections contingency table " Index record navigates to corresponding religion in educational resource library module 10 then according to the specific index record in " chapters and sections contingency table " Educate resource packet and section name and chapters and sections serial number.
Specifically:
Since original image and index compression packet mark are same with corresponding " original image concordance list " and " chapters and sections contingency table " Name, therefore corresponding " chapters and sections contingency table " is navigated on chapters and sections relating module 40 according to original image and index compression packet mark That is table 2, and according to the original image page number or original in original image and index compression packet mark and " original image concordance list " Picture file serial number navigates to the specific index record in " chapters and sections contingency table ", further according to the specific index in " chapters and sections contingency table " Record location corresponding educational resource packet and section name and chapters and sections serial number into educational resource library module 10 are provided further according to education Source packet and section name and chapters and sections serial number navigate in educational resource library module corresponding chapters and sections content in corresponding education resource packet And the resources learning content of the corresponding page number.
It should be appreciated that same papery textbook corresponding " original image concordance list ", " chapters and sections contingency table ", " original image and Index compression packet and alias association table ", original image and index packet, original image and index compression packet and educational resource packet have Identical file name, because of its store path difference, therefore identical file name will not conflict.
Now for " original image and index compression packet with alias association table ", " original image concordance list " and " chapters and sections are associated with Table " structure be illustrated respectively:
Every papery textbook corresponding one " original image concordance list " i.e. table 1, to record " original image associated with it The index of the inner every picture of folder "." original image concordance list " can be Excel type file.The text of " original image concordance list " Part title corresponding " original image and index compression packet " and the file name of " original image and index packet " are identical, thus When finding picture servers original image file name, that is, get in the picture servers original image file name Alias then passes through the original image and index compression packet to get corresponding original image and index compression packet mark Mark is quickly found out corresponding " original image concordance list "." original image concordance list " naming method are as follows: resource type+teaching material version Sheet+the term+subject+grade+term+other.
Table 1 is the publicly-owned format of " original image concordance list ", and table 1 ' is to be identified as " auxiliary topic-synchronization paper-people to be taught to teach the May 4th Plate-making-primary school-mathematics-six grades-is upper-teaching material says that complete solution is searched with reference to complete works of -17 years autumns-bat entirely " original image and index pressure Contracting packet corresponding " original image concordance list ".As shown in table 1, " original image concordance list " includes " original image concordance list text Part title, original image file serial number, original image and index compression packet mark, the original image page number, original image filename Title, original image MD5, picture servers original image file name, state, founder, date created, is repaired original image URL Change people and modification time " information.
Table 1
Table 1 '
In table 1, original image concordance list file name is the mark of every papery textbook corresponding " original image concordance list " Know, which is BIGINT16.Corresponding " original image concordance list " file name of every papery textbook is " original Picture and index compression packet " in be unique.It is preceding to have addressed, the mark corresponding " original image and index compression packet " File name is identical, it may be assumed that and resource type+teaching material version+term+subject+grade+term+other.
Original image file serial number refers to that the serial number of every original image of original image underedge, the serial number are also regarded as original image Index number of the corresponding index record in this " original image concordance list ", the sequence number field type are VARCHAR (100). The serial number of every picture is unique in original image underedge.
Original image and index compression packet mark can be understood as the corresponding original image of every papery textbook and index pressure Contract the file name wrapped, which is VARCHAR (400).The mark phase of the mark and " original image concordance list " Together, it has been addressed before naming method, details are not described herein again.
Original image page number field type is INT (10), including the interior page scanned picture page number and Fei Nei pages of scanned picture page Code, wherein in the corresponding papery textbook of the page scanned picture page number corresponding original content page the page number it is consistent, opened from 1 Begin, no ceiling；The directory scan picture page number is that a step-length to the last page directory page code incremented by successively is with 1 since negative 0；The page number of other non-interior page scanned pictures of such as cover and back and postscript is uniformly defaulted as " -1000 ".
Original image file name field type is VARCHAR (200), preceding to have addressed comprising interior page scanned picture text Part title and Fei Nei pages of scanned picture file name, wherein in phase in the corresponding papery textbook of page scanned picture file name The page number for the original content page answered is consistent；Non- interior page scanned picture file name is identical as its subject content, such as cover, mesh Record, postscript, back cover etc..
Original image URL refers to chained address of the original image in search engine server 600, and field type is VARCHAR(300)。
5 Message-Digest Algorithm 5 of original image MD5, that is, Message-Digest Algorithm, field type are VARCHAR (100), for ensuring the complete consistency of information after original image uploads to search engine server 600.
Picture servers are former in picture servers original image file name, that is, picture servers original image library module 30 The file name of beginning picture, picture servers original image are corresponding in the papery textbook of local device production in advance by producer Original image uploads to picture servers 500 and is formed, and the picture servers original image file name is in picture servers original It is that uniquely, field type is VARCHAR (100) in beginning gallery module 30.The picture servers original image filename The naming method of title are as follows: original image and index database compression belonging to the corresponding local original image of picture servers original image The file name of the corresponding local original image of the alias of packet+picture servers original image, it may be assumed that picture servers original image The first part of file name is original image and index database compressed package alias belonging to its corresponding local original image, second Part is the file name of the corresponding local original image of the picture servers original image.Such as " PSCHINESEG110245 envelope Face " is the picture servers original image file name, wherein " PSCHINESEG110245 " is first part, that is, alias part, " cover " is the file name of the corresponding local original image of the second part i.e. picture servers original image, i.e., corresponding paper The cover of matter textbook；For another example " PSCHINESEG110245 " is partially alias in " PSCHINESEGG11024510 ", and 10 be original Picture file title, i.e., the interior page of corresponding papery textbook page 10.
Preceding to have addressed, each original image and index compression Bao Jun have a unique alias, which also can be considered figure The prefix of piece server original image file name.The naming rule of alias are as follows: resource type+Course in English+original image and Index compression packet ID number, i.e., using the resource type of the corresponding educational resource packet of every papery textbook as first part, by the paper The affiliated subject of matter textbook is as second part, using the corresponding original image of papery textbook and index compression packet ID number as third Part, then sequentially combine above-mentioned three parts the alias for forming original image and index compression packet.As alias is PS in " PSCHINESEG110245 " indicates that resource type is that textbook point reads resource, and CHINESE is Chinese language subject, G110245 It is the corresponding original image of papery textbook and index compression packet ID number.It should be appreciated that the alias be also every papery textbook and The alias of its corresponding original image and index packet.
State includes effectively referring to that the state of this index record in " original image concordance list " is with invalid two states It is no effectively, 1 be it is effective, 0 is invalid.Its field type is CHAR (2).
Founder, date created, modification people and modification time refer to the related creation and modification information of the index, convenient for looking into Card, statistics and update, do not repeat herein.
It is noted that picture servers original image file name is by paper in " original image concordance list " i.e. table 1 The corresponding local original image of matter textbook is all uploaded to picture servers 500 and generates corresponding picture servers original image Afterwards, then by the picture servers original image file name it is written back into " original image concordance list ".The process of write-back is existing Technology, details are not described herein again.
It should be appreciated that original image and index library module 20 in original image and index packet be by producer in advance in local Equipment making original image and index packet, then search engine service is uploaded to after compressing it into original image and index compression packet Device 600 then decompresses again and is recovered to original image and index packet and saves in search engine server 600, original graph therein Piece and index packet can additions and deletions and updates.
In conjunction with shown in Figure 12, chapters and sections relating module 40 is for storing several " chapters and sections contingency table " i.e. tables 2, " chapters and sections association Table " in the corresponding relationship including each chapters and sections and original image in papery textbook.Chapters and sections relating module 40 is stored in search engine It is to be gathered by several " chapters and sections contingency tables " i.e. table 2 and formed on server 600.Corresponding " the original image of every papery textbook Folder " is one " chapters and sections contingency table " corresponding, original image file name, that is, page that " chapters and sections contingency table " passes through interior page scanned picture Interior page scanned picture in chapters and sections and original image folder is established incidence relation by code, i.e., " chapters and sections contingency table " is for describing each chapter All original images that section includes.
" chapters and sections contingency table " can be Excel type file, as shown in Figure 1, " original image concordance list " with " chapters and sections are associated with Table " store path it is different, therefore " chapters and sections contingency table " and " original image concordance list " is of the same name, namely with corresponding original image and Index compression packet is of the same name, due to including several " chapters and sections contingency tables " in chapters and sections relating module 40, therefore passes through original image and rope The title of the title or " original image concordance list " of drawing compressed package can quickly navigate to corresponding " chapters and sections contingency table ", improve Recall precision.
Table 2 is the publicly-owned format of " chapters and sections contingency table ", and table 2 ' is to be identified as " auxiliary topic-synchronization paper-people to be taught to teach the May 4th system Version-primary school-mathematics-six grades-is upper-teaching material says that complete solution is searched with reference to complete works of -17 years autumns-bat entirely " papery textbook corresponding to " chapter Save contingency table ".As shown in table 2, " chapters and sections contingency table " includes: original image and index compression packet mark, chapters and sections start page are corresponding The page number, that the corresponding page number of chapters and sections sign-off sheet, chapters and sections start page correspond to the index number of original image, chapters and sections sign-off sheet is corresponding former Index number, educational resource packet mark, section name, chapters and sections serial number, the state, founder, date created, modification of beginning picture People, modification time information.
Table 2
Table 2 '
In table 2:
Original image and index compression packet are identified as the text of the corresponding original image of every papery textbook and index compression packet Part title, the identification field type are VARCHAR (400).It should be appreciated that original image and index compression packet mark are in table 2 Original image and index compression packet mark in table 1, therefore same papery textbook content passes through the original image and index compression packet mark Incidence relation can be established for table 1 and table 2 and table 3 by knowing.
The corresponding page number of chapters and sections start page refers to that the page number of the corresponding affiliated papery textbook of the chapters and sections start page, the field type are BIGINT(16)。
The corresponding page number of chapters and sections sign-off sheet refers to that the page number of the corresponding affiliated papery textbook of the chapters and sections sign-off sheet, the field type are BIGINT(16)。
The index number that chapters and sections start page corresponds to original image refers to corresponding original in the affiliated papery textbook of the chapters and sections start page Index number of the picture in corresponding " original image concordance list ", i.e., original picture file serial number in table 1.Therefore same papery class Table 1 and table 2 can be established incidence relation by the index number that the chapters and sections start page corresponds to original image by this content.
The index number that chapters and sections sign-off sheet corresponds to original image refers to corresponding original in the affiliated papery textbook of the chapters and sections sign-off sheet Index number of the picture in corresponding " original image concordance list ", i.e., original picture file serial number in table 1.Therefore same papery class Table 1 and table 2 can be established incidence relation by the index number that the chapters and sections sign-off sheet corresponds to original image by this content.
Educational resource packet identifies the mark for referring to the corresponding educational resource packet of papery textbook, which is VARCHAR(400).It has been addressed before the naming method of educational resource packet mark, details are not described herein again.
Section name refers to that the chapters and sections correspond to the title of the chapters and sections in papery textbook, which is VARCHAR (200)。
Chapters and sections serial number refers to that the chapters and sections correspond to the serial number of the chapters and sections in papery textbook, which is INT (16).
State includes effectively and whether invalid two states, the state for referring to that this records in " chapters and sections contingency table " are effective. Its field type be CHAR (2), 1 be it is effective, 0 is invalid.
Founder, date created, modification people and modification time refer to related creation and the modification letter of chapters and sections association content Breath, convenient for verification, statistics and update do not repeat herein.
It should be appreciated that this table is used to establish the interior page i.e. incidence relation of original content pages and chapters and sections of papery textbook depending on Chapters and sections in the corresponding educational resource packet of position scanning input picture, and it is unrelated with non-interior page cover, back cover and catalogue etc..
It should be appreciated that chapters and sections relating module 40 is several " the chapters and sections contingency tables " made in advance on the local device by producer Gather formation after being uploaded to search engine server 600.
In conjunction with shown in Figure 13, original image and index compression packet and alias association module 50, for storing several " original graphs Piece and index compression packet and alias association table ", " original image and index compression packet and alias association table " include original image and The corresponding relationship of index compression packet mark and alias.Original image and index compression packet and alias association module 50 are stored in search On engine server 600." original image and index compression packet and alias association table " is by " original image and index compression packet mark Know " one-to-one relationship is established with affiliated original image and index compression packet alias and the table that is formed.
" original image and index compression packet and alias association table " can be EXCEL type form document, can also be by program certainly It is dynamic to generate.As shown in Figure 1, " original image and index compression packet and alias association table " and " original image concordance list " and " chapters and sections Contingency table " store path it is different, therefore " original image and index compression packet and alias association table " with it is " chapters and sections contingency table " and " former Beginning picture indices table " it is of the same name namely of the same name with corresponding original image and index compression packet, therefore pass through original image and index pressure The title wrapped or the title of " original image concordance list " of contracting or the title of " chapters and sections contingency table " can quickly navigate to corresponding " former Beginning picture and index compression packet and alias association table ", improve recall precision.
Table 3 is the publicly-owned format of " original image and index compression packet and alias association table ", and table 3 ' is " original image and rope Draw compressed package and alias association table " certain embodiments content.As shown in table 3, " original image and index compression packet and alias association Table " include: picture servers original image title, picture servers original image mark, original image and index compression packet mark Knowledge, educational resource type, alias, state, founder, date created, modification people, modification time information.
Table 3
Table 3 '
In table 3:
Picture servers original image title, that is, picture servers original image file name, the title is in picture servers Be in original image library module 30 uniquely, preceding to have addressed, the naming method of the title is: picture servers original image is corresponding Original image belonging to original image and index compression packet the corresponding original image text of alias+picture servers original image Part title.It should be appreciated that file name of the original image in corresponding original image and index packet is divided into interior page scanned picture File name and non-interior page scanned picture file name, in the interior its corresponding papery textbook original of page scanned picture file name The appearance page number is consistent, and non-interior page scanned picture file name is consistent with its page subject matter content, when original image is uploaded to picture clothes It is engaged in adding when device original image library module 30 using the alias of the affiliated original image of the original image and index compression packet as prefix To the original image file name, corresponding picture servers original image file name is formed.In table 3 ' " PSCHINESEG110245 " in " PSCHINESEG110245_1 " is the alias of corresponding original image and index compression packet, The prefix of i.e. corresponding original image file name, " 1 " are original image file name.The field type is BIGINT (16). Picture servers original image file name in picture servers original image title, that is, table 1 in table 3, therefore in same papery textbook Incidence relation can be established for table 1 and table 3 by picture servers original image title by holding.
Picture servers original image mark is the serial number of an integer type, and the serial number is in " picture servers original graph It is unique in piece library module 30 ".
Original image and index compression packet are identified as the text of the corresponding original image of every papery textbook and index compression packet Part title, the identification field type are VARCHAR (400).It should be appreciated that table 3 in original image and index compression packet mark with Original image and index compression packet mark are identical in table 2 and table 1, therefore same papery textbook content passes through the original image and index Table 3 and table 1 and table 2 can be established incidence relation by compressed package mark.
Educational resource type including textbook point read the types such as resource, examination question shooting resource, can be represented not with different serial numbers Same resource type, quantity of the field to count various types of resources.The field type is BIGINT (16).
The unique Alias of alias, that is, each original image and index compression packet, also may be regarded as papery textbook and original image and Index the alias of packet, prefix of the alias as picture servers original image file name.The naming method of the alias are as follows: money Source Type+Course in English+original image and index compression packet ID number, i.e., by the money of the corresponding educational resource packet of every papery textbook Source Type is as first part, using the affiliated subject of papery textbook as second part, by the corresponding original graph of papery textbook Piece and index compression packet ID number are as Part III, then sequentially combine above-mentioned three parts and form original image and rope Draw the alias of compressed package.As alias indicates that resource type is textbook point for the first part " PS " in " PSCHINESEG110245 " Read resource, second part CHINESE be Chinese language subject, Part III G110245 be the corresponding original image of papery textbook and Index compression packet ID number.The field type is VARCHAR (100).It should be appreciated that picture servers original image title in table 3 Remove the original image file name obtained after prefix i.e. alias corresponding to it, it is original in the original image file name, that is, table 1 Picture file title, thus by obtaining original graph in table 1 after picture servers original image title in table 3 is removed its alias Table 3 and table 1 can be established incidence relation by the mode of piece file name.
State includes effectively with invalid two states, and referring to should in " original image and index compression packet and alias association table " Item record state it is whether effective, 1 be it is effective, 0 be it is invalid, field type be CHAR (2).
Founder, date created, modification people and modification time refer to " original image and the index compression packet and alias association Table " in the related creation and modification information of this record statistics and updated convenient for verification, do not repeat herein.
It should be appreciated that original image and index compression packet and alias association module 50 can be by producers in advance on the local device Production " original image and index compression packet and alias association table " gathers formation after being uploaded to search engine server 600.
In step S400, output device 400 navigates to education money according to educational resource packet and section name and chapters and sections serial number Corresponding chapters and sections content and the resources learning content of the corresponding page number in corresponding education resource packet in the library module of source, and terminated to client It receives and display device 900 exports corresponding chapters and sections content and corresponds to the resources learning content of the page number.
Specifically, it is navigated to according to educational resource packet and section name and chapters and sections serial number corresponding in educational resource library module Corresponding chapters and sections content and the resources learning content of the corresponding page number, corresponding page number resources learning content include class in educational resource packet The parsing of this text, the explanation of example, the explanation of correlated knowledge point synchronize training, teach auxiliary topic, paper, practice, video link Connect, Flash link, craps game link etc. one or more types.
In step S500, client is received and display device 900 receives and shows the chapter that output device 400 exports to user Save the resources learning content of content and the corresponding page number.
It is noted that the case where chapters and sections content for papery textbook is less than a page, increases " chapters and sections association Table " chapters and sections positioning is carried out, to improve the accuracy of positioning.When acquisition " chapters and sections contingency table " corresponding educational resource packet mark and When specific chapters and sections information, in conjunction with the original image page number information in " original image concordance list ", corresponding religion can be navigated to Educate the chapters and sections content of resource packet and the resources learning content of the corresponding page number.
It is noted that directly being positioned if the original image page number in " original image concordance list " is negative or 0 To first index record in " chapters and sections contingency table " of the same name with " the original image concordance list ", according to first index record Navigate to the homepage learning Content of corresponding educational resource packet.It should be appreciated that the original image page number is that negative or 0 indicate to be somebody's turn to do herein Original image is non-interior page scanned picture, the i.e. non-body matter such as cover, catalogue, postscript, back cover.
It is noted that same papery textbook corresponding " original image concordance list ", " chapters and sections contingency table ", " original graph Piece and index compression packet and alias association table ", original image and index packet, original image and index compression packet and educational resource packet File name having the same.
It is noted that alternatively, in some embodiments, system further includes a director server as photo services The set of device 500 and search engine server 600, picture servers original image library module 30, educational resource library module 10, original It is total that beginning picture and index library module 20, chapters and sections relating module 40, original image compressed package and alias association module 50 are stored in this In server.
In method in the present embodiment, other parts are corresponding with the system in previous embodiment, and details are not described herein again.
The above is only a preferred embodiment of the present invention, protection scope of the present invention is not limited merely to above-mentioned implementation Example, all technical solutions belonged under thinking of the present invention all belong to the scope of protection of the present invention.It should be pointed out that for the art Those of ordinary skill for, several improvements and modifications without departing from the principles of the present invention, these improvements and modifications Also it should be regarded as protection scope of the present invention.

Claims (10)

1. a kind of resource acquisition device based on picture recognition, which is characterized in that including
Client picture acquiring device (100), for obtaining exterior artwork；
Picture recognition device (200) is connected, for according to acquired institute with the client picture acquiring device (100) It states exterior artwork and carries out picture recognition, and export recognition result；
Coalignment (300) is connected with the picture recognition device (200), is used for according to the recognition result selectively Data Matching is carried out, and exports matching result；
Output device (400) is connected with the coalignment (300), for exporting corresponding religion according to the matching result Educate corresponding resource content in resource packet；
Wherein, the picture recognition device (200) includes
Picture preprocessing module (2001) cuts picture for the exterior artwork to be cut to multiple, and is arranged described in every Cut the priority and weight information of picture；
Picture feature matching module (2002) for carrying out characteristic matching to cutting picture described in every, and exports successful match Picture；
As a result screening module (2003) for receiving the successful match picture, and export the recognition result.
2. the apparatus according to claim 1, which is characterized in that the picture preprocessing module (2001) includes
First cuts unit (2001A), for the exterior artwork to be subtracted one first non-active area at left and right sides of X-axis Domain, and generate first and cut picture, width of the sum of the first non-active area width of the left and right sides with the exterior artwork For degree than being 5-45%, the width ratio of the first cutting picture and the exterior artwork is 55-95%；
Second cuts unit (2001B), for by the exterior artwork, two sides to subtract one second non-active area above and below Y-axis Domain, and generate second and cut picture, described the sum of height of the second non-active area of two sides up and down and the exterior artwork For height than being 5-45%, the height ratio of the second cutting picture and the exterior artwork is 55-95%.
3. the apparatus of claim 2, which is characterized in that the picture preprocessing module (2001) further includes
Third cuts unit (2001C), for the exterior artwork to be subtracted a third non-active area along Y-axis distal end, and it is raw At third cutting picture, the height ratio of the third non-active area and the exterior artwork is 25-45%, and the third is cut Picture and the height ratio of the exterior artwork are 55-75%；
4th cuts unit (2001D), for the exterior artwork to be subtracted one the 4th non-active area along Y-axis distal end, and it is raw At the 4th cutting picture, the height ratio of the 4th non-active area and the exterior artwork is 25-45%, and the described 4th cuts Picture and the height ratio of the exterior artwork are 55-75%.
4. device according to claim 3, which is characterized in that the picture preprocessing module (2001) further includes the 5th sanction Unit (2001E) is cut, for the exterior artwork to be subtracted one the 5th non-active area along Y-axis distal end, and the 5th is generated and cuts The height ratio of picture, the 5th non-active area and the exterior artwork is 46%-60%, and the described 5th cuts picture and institute The height ratio for stating exterior artwork is 40%~54%.
5. device according to claim 1-4, which is characterized in that the result screening module (2003) includes
It receives judging unit (2003A), judges whether there is and receive the successful match picture, if so, output reception result； If it is not, then it fails to match for output；
Weight limit judging unit (2003B) judges whether the successful match picture is most authority according to the reception result Weight, if so, the cutting picture of output weight limit is the recognition result；If it is not, then exporting judging result；
Whether weight comparing unit (2003C) is received figure according to the judging result successful match picture Weight is maximum in piece, if so, output comparison result；If it is not, then returning to the reception judging unit (2003A)；
Receiving terminates judging unit (2003D), judges whether that all successful match pictures have connect according to the comparison result Harvest it is complete, if so, export the comparison result be the recognition result；If it is not, then returning to the reception judging unit (2003A)。
6. a kind of resource acquiring method based on picture recognition, which is characterized in that including
Obtain exterior artwork；
Picture recognition is carried out according to the acquired exterior artwork, and exports recognition result；
Data Matching is selectively carried out according to the recognition result, and exports matching result；
Corresponding resource content in corresponding educational resource packet is exported according to the matching result；
Wherein, the exterior artwork according to acquired in carries out picture recognition, and exports recognition result and include:
The exterior artwork is cut to multiple and cuts picture, and every priority for cutting picture and weight letter are set Breath；
Characteristic matching is carried out to cutting picture described in every, and exports successful match picture；
The successful match picture is received, and exports the recognition result.
7. according to the method described in claim 6, it is characterized in that, described be cut to multiple cutting figures for the exterior artwork Piece, including
The exterior artwork is subtracted into one first non-active area at left and right sides of X-axis, and generates first and cuts picture, it is described The sum of first non-active area width of the left and right sides and the width ratio of the exterior artwork are 5-45%, and described first cuts figure Piece and the width ratio of the exterior artwork are 55-95%；
By the exterior artwork, two sides subtract one second non-active area above and below Y-axis, and generate second and cut picture, described The height ratio of the sum of height of the second non-active area of upper and lower two sides and the exterior artwork is 5-45%, and described second cuts Picture and the height ratio of the exterior artwork are 55-95%.
8. the method according to the description of claim 7 is characterized in that described be cut to multiple cutting figures for the exterior artwork Piece further includes
The exterior artwork is subtracted into a third non-active area along Y-axis distal end, and generates third and cuts picture, the third is non- The height ratio of effective coverage and the exterior artwork is 25-45%, and the third cuts the height of picture and the exterior artwork Than for 55-75%；
The exterior artwork is subtracted into one the 4th non-active area along Y-axis distal end, and generates the 4th and cuts picture, the described 4th is non- The height ratio of effective coverage and the exterior artwork is 25-45%, and the described 4th cuts the height of picture and the exterior artwork Than for 55-75%.
9. according to the method described in claim 8, it is characterized in that, described be cut to multiple cutting figures for the exterior artwork Piece, further includes: the exterior artwork is subtracted into one the 5th non-active area along Y-axis distal end, and generates the 5th and cuts picture, it is described The height ratio of 5th non-active area and the exterior artwork is 46%-60%, and the described 5th cuts picture and the exterior view The height ratio of piece is 40%~54%.
10. the method according to claim 6, which is characterized in that the reception successful match picture, and Exporting the recognition result includes:
It judges whether there is and receives the successful match picture, if so, output reception result；If it is not, then it fails to match for output；
Judge whether the successful match picture is weight limit according to the reception result, if so, output weight limit The cutting picture is the recognition result；If it is not, then exporting judging result；
Whether it is that weight is maximum in received picture according to the judging result successful match picture, if so, Then export comparison result；The successful match picture is received if it is not, judging whether there is described in then returning；
Judge whether that all successful match pictures have received according to the comparison result, if so, exporting the ratio Relatively result is the recognition result；The successful match picture is received if it is not, judging whether there is described in then returning.
CN201810956056.2A 2018-08-21 2018-08-21 Image identification-based resource acquisition device and method Active CN109344275B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201810956056.2A CN109344275B (en) 2018-08-21 2018-08-21 Image identification-based resource acquisition device and method

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201810956056.2A CN109344275B (en) 2018-08-21 2018-08-21 Image identification-based resource acquisition device and method

Publications (2)

Publication Number Publication Date
CN109344275A true CN109344275A (en) 2019-02-15
CN109344275B CN109344275B (en) 2021-10-26

Family

ID=65291836

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201810956056.2A Active CN109344275B (en) 2018-08-21 2018-08-21 Image identification-based resource acquisition device and method

Country Status (1)

Country Link
CN (1) CN109344275B (en)

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110807121A (en) * 2019-09-29 2020-02-18 广东墨痕教育科技有限公司 Electronic education resource matching method based on image-text intelligent identification and computer readable storage medium
CN113505253A (en) * 2021-07-03 2021-10-15 北京中建建筑科学研究院有限公司 Block chain based picture uploading method and device, server and storage medium
CN114782942A (en) * 2022-04-29 2022-07-22 深圳市致远优学教育科技有限公司 Risk content display detection method

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104050838A (en) * 2014-07-15 2014-09-17 北京网梯科技发展有限公司 Reading system, device and method capable of recognizing and reading common printed matter
CN105069457A (en) * 2015-07-15 2015-11-18 杭州朗和科技有限公司 Image identification method and device
CN106560840A (en) * 2015-09-30 2017-04-12 腾讯科技（深圳）有限公司 Recognition processing method and device of image information

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104050838A (en) * 2014-07-15 2014-09-17 北京网梯科技发展有限公司 Reading system, device and method capable of recognizing and reading common printed matter
CN105069457A (en) * 2015-07-15 2015-11-18 杭州朗和科技有限公司 Image identification method and device
CN106560840A (en) * 2015-09-30 2017-04-12 腾讯科技（深圳）有限公司 Recognition processing method and device of image information

Cited By (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110807121A (en) * 2019-09-29 2020-02-18 广东墨痕教育科技有限公司 Electronic education resource matching method based on image-text intelligent identification and computer readable storage medium
CN113505253A (en) * 2021-07-03 2021-10-15 北京中建建筑科学研究院有限公司 Block chain based picture uploading method and device, server and storage medium
CN113505253B (en) * 2021-07-03 2022-07-05 北京中建建筑科学研究院有限公司 Block chain based picture uploading method and device, server and storage medium
CN114782942A (en) * 2022-04-29 2022-07-22 深圳市致远优学教育科技有限公司 Risk content display detection method
CN114782942B (en) * 2022-04-29 2024-05-28 深圳市致远优学教育科技有限公司 Risk content display detection method

Also Published As

Publication number Publication date
CN109344275B (en) 2021-10-26

Similar Documents

Publication Publication Date Title
CN109344275A (en) Resource acquisition device and method based on picture recognition
Conway Modes of seeing: Digitized photographic archives and the experienced user
CN105224665A (en) Wrong question management method and system
CN109614594B (en) Method for analyzing topic document into topic library data
KR101986345B1 (en) Apparatus for generating meta sentences in a tables or images to improve Machine Reading Comprehension perfomance
CN105069412A (en) Digital scoring method
Terras Artefacts and errors: Acknowledging issues of representation in the digital imaging of ancient texts
CN112528799A (en) Teaching live broadcast method and device, computer equipment and storage medium
CN109344274A (en) Educational resource positioning system and method based on picture recognition
WO2020199512A1 (en) Question information collection method and system
CN111209451A (en) Title password code generation method, identification method, equipment terminal, server and image-text medium
CN111417026A (en) Online learning method and device based on writing content
CN111241955B (en) Bill information extraction method and system
CN209879796U (en) Learning system based on artificial intelligence
KR100819339B1 (en) Infomation Processing System And The Processing Method of Educational Contents
Agegnehu et al. Offline Handwritten Amharic Digit and Punctuation Mark Script Recognition using Deep learning
Baldwin Digitizing and transcribing the John Torrey Papers at The New York Botanical Garden
Mardiati et al. The Potential Use of Artificial Intelligence Technology in the Process of Collecting Metadata in Photo Archive Description Activities
Löffler et al. Minor Politics, Major Consequences: Epistemic Challenges of Metadata and the Contribution of Image Recognition
CN115392160B (en) Format conversion method for circuit diagram description file
Konopska et al. Shaping Poland's borders after the First World War. Methodological problems of creating digital cartographic repositories
CN109145062B (en) Self-learning information classification processing device
Bauer et al. Digital humanities practices and archival appraisal in the contemporary Arab world
Hanneken Three Priorities for Digitally-Enabled Research and Teaching in Manuscripts of Biblical Literature
Räisänen et al. AI Powered Tools for Improving Usability in Digital Archiving

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant