CN114661879A - Data searching method, system, electronic equipment and storage medium - Google Patents
Data searching method, system, electronic equipment and storage medium Download PDFInfo
- Publication number
- CN114661879A CN114661879A CN202210291982.9A CN202210291982A CN114661879A CN 114661879 A CN114661879 A CN 114661879A CN 202210291982 A CN202210291982 A CN 202210291982A CN 114661879 A CN114661879 A CN 114661879A
- Authority
- CN
- China
- Prior art keywords
- image
- user
- instruction
- text content
- retrieval
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000000034 method Methods 0.000 title claims abstract description 53
- 230000000007 visual effect Effects 0.000 claims description 26
- 238000007726 management method Methods 0.000 claims description 21
- 238000004590 computer program Methods 0.000 claims description 16
- 238000009432 framing Methods 0.000 claims description 14
- 238000013135 deep learning Methods 0.000 claims description 10
- 239000000463 material Substances 0.000 claims description 10
- 125000004122 cyclic group Chemical group 0.000 claims description 4
- 238000013528 artificial neural network Methods 0.000 claims description 3
- 238000013523 data management Methods 0.000 claims description 2
- 230000009191 jumping Effects 0.000 claims description 2
- 239000000126 substance Substances 0.000 claims description 2
- 238000010586 diagram Methods 0.000 description 11
- 238000004891 communication Methods 0.000 description 8
- 230000008569 process Effects 0.000 description 6
- 238000012545 processing Methods 0.000 description 5
- 238000005516 engineering process Methods 0.000 description 4
- 238000000605 extraction Methods 0.000 description 4
- 230000006870 function Effects 0.000 description 4
- 102100032202 Cornulin Human genes 0.000 description 3
- 101000920981 Homo sapiens Cornulin Proteins 0.000 description 3
- 238000013136 deep learning model Methods 0.000 description 3
- 230000003287 optical effect Effects 0.000 description 3
- 238000012800 visualization Methods 0.000 description 3
- 238000013527 convolutional neural network Methods 0.000 description 2
- 230000003993 interaction Effects 0.000 description 2
- 238000012986 modification Methods 0.000 description 2
- 230000004048 modification Effects 0.000 description 2
- 238000012015 optical character recognition Methods 0.000 description 2
- 238000003491 array Methods 0.000 description 1
- 238000013473 artificial intelligence Methods 0.000 description 1
- 230000009286 beneficial effect Effects 0.000 description 1
- 230000001413 cellular effect Effects 0.000 description 1
- 238000004883 computer application Methods 0.000 description 1
- 230000007547 defect Effects 0.000 description 1
- 238000013461 design Methods 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 230000005611 electricity Effects 0.000 description 1
- 230000002708 enhancing effect Effects 0.000 description 1
- 239000000284 extract Substances 0.000 description 1
- 238000001914 filtration Methods 0.000 description 1
- 239000011521 glass Substances 0.000 description 1
- 230000006872 improvement Effects 0.000 description 1
- 238000007689 inspection Methods 0.000 description 1
- 239000004973 liquid crystal related substance Substances 0.000 description 1
- 238000010801 machine learning Methods 0.000 description 1
- 239000013307 optical fiber Substances 0.000 description 1
- 238000012552 review Methods 0.000 description 1
- 239000004065 semiconductor Substances 0.000 description 1
- 230000001953 sensory effect Effects 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
- 238000012360 testing method Methods 0.000 description 1
- 238000012549 training Methods 0.000 description 1
- 238000012546 transfer Methods 0.000 description 1
- 230000001960 triggered effect Effects 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/30—Information retrieval; Database structures therefor; File system structures therefor of unstructured textual data
- G06F16/33—Querying
- G06F16/332—Query formulation
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/30—Information retrieval; Database structures therefor; File system structures therefor of unstructured textual data
- G06F16/33—Querying
- G06F16/338—Presentation of query results
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06Q10/00—Administration; Management
- G06Q10/20—Administration of product repair or maintenance
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06Q50/00—Systems or methods specially adapted for specific business sectors, e.g. utilities or tourism
- G06Q50/06—Electricity, gas or water supply
Abstract
The invention discloses a data searching method, a system, electronic equipment and a storage medium. Wherein, the method comprises the following steps: triggering an image acquisition module to acquire an image to be identified according to the retrieval instruction; determining text content in the image to be recognized; and searching and displaying a display result in a preset database according to the text content. The embodiment of the invention improves the accuracy of searching the electronic data, and the content to be searched is determined by the image acquisition mode, so that the difficulty in extracting the search information of the user can be reduced, and the convenience degree of searching can be improved.
Description
Technical Field
The present invention relates to the field of computer application technologies, and in particular, to a method, a system, an electronic device, and a storage medium for searching data.
Background
With the development of internet technology, enterprise business is gradually digitalized and intelligentized. The Internet is also widely applied in the field of electric power. At present, electric power maintainers need train and study the relevant content of safe work regulation before going on duty, can go on duty through the examination after learning finishes to the security knowledge still needs continuous review in the process of duties, in order to ensure that dangerous operation violating regulations does not appear in the work, and the current mode is that electric power maintainers mainly accomplish foretell training through the mode of browsing paper books and making paper exercise. However, for electricity inspection personnel, most of working hours of the personnel need to be carried outdoors, and paper book data are inconvenient to carry. In the prior art, a computer person uploads a paper file to a database by a technical means, and a power overhaul worker reads digital resources in the database. However, because the scale of the data in the power field is large, the power overhaul personnel cannot effectively use the digital data, the operation specification and the problem are stored separately and cannot be linked as much as possible, the accuracy rate of data searching is low, and the power overhaul personnel cannot conveniently learn and guide the scheme of the targeted problem.
Disclosure of Invention
The invention provides a data searching method, a data searching system, electronic equipment and a storage medium, which are used for realizing convenient query of electronic data, improving the accuracy of data search and enhancing the use experience of a user.
According to an aspect of the present invention, there is provided a material search method, wherein the method includes:
triggering an image acquisition module to acquire an image to be identified according to the retrieval instruction;
determining text content in the image to be recognized;
and searching and displaying a display result in a preset database according to the text content.
According to another aspect of the present invention, there is provided a material search system, wherein the system comprises:
the image acquisition module is used for triggering the image acquisition module to acquire an image to be identified according to the retrieval instruction;
the text recognition module is used for determining the text content in the image to be recognized;
and the data retrieval module is used for searching and displaying a display result in a preset database according to the text content.
According to another aspect of the present invention, there is provided an electronic apparatus including:
at least one processor; and
a memory communicatively coupled to the at least one processor; wherein the content of the first and second substances,
the memory stores a computer program executable by the at least one processor, the computer program being executable by the at least one processor to enable the at least one processor to perform a method of searching for material as described in any of the embodiments of the invention.
According to another aspect of the present invention, there is provided a computer-readable storage medium storing computer instructions for causing a processor to implement the method of searching for material according to any one of the embodiments of the present invention when the computer instructions are executed.
According to the technical scheme of the embodiment of the invention, the image to be identified is obtained by using the image acquisition module, the text content is extracted from the image to be identified, the corresponding display result is searched in the preset database according to the text content and displayed, the accuracy of searching the electronic data is improved, the content to be retrieved is determined by the image acquisition mode, the extraction difficulty of the retrieval information of the user can be reduced, and the convenience degree of retrieval can be improved.
It should be understood that the statements in this section do not necessarily identify key or critical features of the embodiments of the present invention, nor do they necessarily limit the scope of the invention. Other features of the present invention will become apparent from the following description.
Drawings
In order to more clearly illustrate the technical solutions in the embodiments of the present invention, the drawings needed to be used in the description of the embodiments will be briefly introduced below, and it is obvious that the drawings in the following description are only some embodiments of the present invention, and it is obvious for those skilled in the art to obtain other drawings based on these drawings without creative efforts.
FIG. 1 is a flowchart illustrating a method for searching data according to an embodiment of the present invention;
FIG. 2 is a flowchart of a data searching method according to a second embodiment of the present invention;
FIG. 3 is a schematic diagram of a data retrieval system according to a third embodiment of the present invention;
FIG. 4 is an architecture diagram of a data retrieval system according to a fourth embodiment of the present invention;
FIG. 5 is an exemplary diagram of an online reading provided in accordance with a fourth embodiment of the invention;
FIG. 6 is a flowchart illustrating a photo retrieval method according to a fourth embodiment of the present invention;
fig. 7 is an exemplary diagram of photo recognition according to a fourth embodiment of the present invention;
FIG. 8 is an exemplary diagram of image text recognition provided according to a fourth embodiment of the invention;
FIG. 9 is an exemplary diagram of a retrieval history presentation according to a fourth embodiment of the present invention;
fig. 10 is a schematic structural diagram of an electronic device implementing the material searching method according to the embodiment of the present invention.
Detailed Description
In order to make the technical solutions of the present invention better understood, the technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are only a part of the embodiments of the present invention, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
It should be noted that the terms "first," "second," and the like in the description and claims of the present invention and in the drawings described above are used for distinguishing between similar elements and not necessarily for describing a particular sequential or chronological order. It is to be understood that the data so used is interchangeable under appropriate circumstances such that the embodiments of the invention described herein are capable of operation in sequences other than those illustrated or described herein. Furthermore, the terms "comprises," "comprising," and "having," and any variations thereof, are intended to cover a non-exclusive inclusion, such that a process, method, system, article, or apparatus that comprises a list of steps or elements is not necessarily limited to those steps or elements expressly listed, but may include other steps or elements not expressly listed or inherent to such process, method, article, or apparatus.
Example one
Fig. 1 is a flowchart of a data search method according to an embodiment of the present invention, which is applicable to the case of power data retrieval, and the method can be executed by a data search system, which can be implemented in the form of hardware and/or software, and the data search system can be configured in a server or a user terminal. As shown in fig. 1, the method includes:
and step 110, triggering an image acquisition module to acquire an image to be identified according to the retrieval instruction.
The retrieval instruction may be an instruction for triggering information retrieval, and may include a user clicking a button in a visual interface to trigger the retrieval instruction or a user triggering the retrieval instruction through voice, the image acquisition module may acquire a software and hardware device of an image, the image acquisition module may include a camera or an image sensor, the image to be recognized may be an image of an object for retrieval, and may include power equipment or power data.
In the embodiment of the invention, a user can send a retrieval instruction, and when the device receives the retrieval instruction, the device can control an image acquisition module arranged in the device to acquire an image to be identified. For example, when searching for the data of a certain power device, the user may take a picture of the power device or paper-based power device data by clicking an image search button, so as to obtain a picture of the power device or paper-based power device data.
And step 120, determining text content in the image to be recognized.
The text content can be text information included in the retrieval object, and the text content can be specific content in paper power data or a nameplate of the power equipment and the like.
Specifically, the text information in the image to be recognized may be recognized, so as to obtain the text content, and the manner of extracting the text content in the image to be recognized may include a deep learning model or an Optical Character Recognition (OCR) manner.
The preset database may be a database storing digitized power data information, and may include power equipment operation specifications, test exercises, and the like. The display result may be digitized power data that matches the image to be recognized.
In the embodiment of the invention, the digital data matched with the text content can be searched in the preset database, and the digital data can be used as a display result to be visually displayed in the user terminal.
According to the embodiment of the invention, the image to be identified is acquired by using the image acquisition module, the text content is extracted from the image to be identified, the corresponding display result is searched in the preset database according to the text content and displayed, the accuracy of searching the electronic data is improved, the content to be retrieved is determined in the image acquisition mode, the extraction difficulty of the retrieval information of a user can be reduced, and the convenience degree of retrieval can be improved.
Example two
Fig. 2 is a flowchart of a data searching method according to a second embodiment of the present invention, which is embodied on the basis of the second embodiment. As shown in fig. 2, the method includes:
In the embodiment of the present invention, the terminal may provide a visual interface for the user, and the user may implement the digital data retrieval in a manner of inputting on the visual interface, and it can be understood that the user may input one or more of a slide instruction, a click instruction, a gesture instruction, and a voice instruction in the visual interface to trigger the retrieval instruction. For example, the user may input a voice keyword in the visual interface, and generate a corresponding retrieval instruction according to the voice keyword.
And step 220, triggering an image acquisition module to acquire an image of the target retrieval object according to the retrieval instruction, and taking the image acquired picture as an image to be identified.
The target retrieval object can be an object for retrieving digital data, and can comprise electric equipment or electric equipment books, and the target retrieval object can be selected by a user actively or passively using the image acquisition module.
Specifically, after receiving a retrieval instruction input by a user on a visual interface, the terminal device may trigger task execution of the image acquisition module, so that the image acquisition module takes a picture of an object to obtain a picture of the target retrieval object, where it is understood that the picture may be a whole or partial image of the target retrieval object. For example, the terminal may start a photographing interface of the camera, the user may lock the target retrieval object using a locking frame in the photographing interface, and then the user clicks the determination button to take a picture of the target retrieval object as an image to be recognized through the camera.
The region-of-interest framing information may be information for locking a region of interest in the image to be identified, the region-of-interest framing information may include selection frame position information and selection frame size information, the selection frame position information may be a two-dimensional coordinate of the selection frame in the visualization interface, the selection frame size information may be the size of the selection frame, the selection frame size may be parameters such as radius, length, width and the like according to different shapes of the selection frame, and the region of interest may be a region where a text or an image of interest in the target retrieval object is located.
In the embodiment of the present invention, the terminal may display the image to be recognized in the visualization interface, the user may perform region-of-interest framing operations on the displayed image to be recognized, and the visualization interface may collect the operations and generate corresponding region-of-interest framing information, for example, the user may place characters in the image to be recognized in a rectangular frame by moving the rectangular frame and adjusting the size of the rectangular frame, and the position of the rectangular frame and the size of the rectangular frame at this time may be used as the region-of-interest framing information.
And 240, extracting the image of the area to be identified corresponding to the region-of-interest framing information in the image to be identified.
Specifically, the region to be extracted in the image to be recognized may be determined according to the position information and the size information of the selection frame in the region of interest framing information, and the image corresponding to the region to be extracted may be extracted as the image of the region to be recognized.
And step 250, extracting text contents in the image of the area to be recognized by using the deep learning character recognition model.
The deep learning character recognition model can be a pre-trained deep learning model, the deep learning model can recognize characters in a picture, and the deep learning character recognition image can be a convolutional neural network model or a cyclic convolutional neural network model.
In the embodiment of the invention, the image of the area to be recognized can be input into the pre-trained deep learning character recognition model, and the text content included in the image of the area to be recognized is extracted.
And step 260, displaying the text content in a search box of the visual interface.
Specifically, after the text content is extracted, the text content may be used as a search keyword to fill in a search box of the visual interface. Furthermore, the search box can also display the characteristic information of the target retrieval object, and the characteristic information can also be output by the deep learning character recognition model. The user may also adjust the search box display content to improve the accuracy of the retrieval.
The search control instruction may be an instruction used by a user to confirm search generation, and the search control instruction may be implemented by clicking a button by the user.
In the embodiment of the present invention, after receiving a search control command input by a user, the terminal may search a preset database for a display result matching the text content of the search box, and it is understood that the search process may be an exact search or a fuzzy search.
And step 280, displaying the similarity between the display result and the text content on the visual interface in sequence from large to small.
Specifically, in the process of searching for the display result, the similarity between the display result and the text content may be determined, the display results may be sorted from large to small according to the similarity, and the display results may be sequentially displayed on the visual interface according to the sorting.
In the embodiment of the invention, the retrieval instruction input by the user is received on the visual interface, the image acquisition module is triggered to acquire the image to be identified of the target retrieval object according to the retrieval instruction, displaying the image to be identified on a visual interface and determining the region-of-interest framing information input by a user, extracting an image of a region to be identified according to the region-of-interest framing information, inputting the image of the region to be identified into a deep learning character recognition model to extract text content, displaying the text content to a search box, when receiving the searching control instruction, the display result is searched in the preset database according to the display content, and the display result is displayed on the visual interface according to the sequence of similarity from large to small, thereby improving the accuracy of searching the electronic data, the content to be retrieved is determined by the image acquisition mode, so that the extraction difficulty of the retrieval information of the user can be reduced, and the convenience degree of retrieval can be improved.
Further, on the basis of the above embodiment of the present invention, extracting the text content in the image of the region to be recognized by using a deep learning character recognition model includes:
converting the image of the area to be identified into a gray image; inputting the gray level image into a convolution cyclic neural network trained in advance to obtain at least one recognition result; sorting the recognition results according to the confidence degrees, and eliminating the recognition results with the confidence degrees lower than a first threshold value; and sequentially splicing all the recognition results into text contents according to the output sequence.
In the embodiment of the present invention, an image of an area to be recognized may be converted into a grayscale image, then the grayscale image may be recognized by using a convolution and convolution network to output an output result corresponding to each character, a confidence may also be extracted when outputting the result, each confidence is compared with a first threshold, if the confidence is smaller than the first threshold, the recognition result corresponding to the execution degree is deleted, and after obtaining each recognition result, each recognition result may be spliced to generate a complete text content.
EXAMPLE III
FIG. 3 is a schematic diagram of a data retrieval system according to a third embodiment of the present invention.
As shown in fig. 3, the apparatus includes:
and the image acquisition module 301 is configured to trigger the image acquisition module to acquire an image to be identified according to the retrieval instruction.
A text recognition module 302, configured to determine text content in the image to be recognized.
And the data retrieval module 303 is configured to search for a display result in a preset database according to the text content and display the display result.
According to the embodiment of the invention, the image acquisition module is used for acquiring the image to be identified, the text identification module extracts the text content from the image to be identified, the data retrieval module searches the corresponding display result in the preset database according to the text content and displays the display result, so that the accuracy of searching the electronic data is improved, the content to be retrieved is determined by the image acquisition mode, the extraction difficulty of the retrieval information of a user can be reduced, and the retrieval convenience can be improved.
Optionally, the image capturing module 301 includes:
the instruction acquisition unit is used for receiving a retrieval instruction input by the user in a visual interface, wherein the retrieval instruction comprises at least one of the following: a slide instruction, a click instruction, a gesture instruction, a voice instruction.
And the picture acquisition unit is used for triggering the image acquisition module to acquire an image of a target retrieval object according to the retrieval instruction and taking the image acquired picture as the image to be identified.
Optionally, the text recognition module 302 includes:
and the frame selection receiving unit is used for displaying the image to be identified on a visual interface and receiving the region-of-interest frame selection information of a user, wherein the region-of-interest frame selection information comprises selection frame position information and selection frame size information.
And the image frame selection unit is used for extracting the image of the area to be identified corresponding to the frame selection information of the area of interest in the image to be identified.
And the character recognition unit is used for extracting the text content in the region image to be recognized by using a deep learning character recognition model.
Optionally, the character recognition unit is specifically configured to: converting the area image to be identified into a gray image; inputting the gray level image into a pre-trained convolution cyclic neural network to obtain at least one recognition result; sorting the recognition results according to the confidence degrees, and eliminating the recognition results with the confidence degrees lower than a first threshold value; and sequentially splicing the recognition results into the text content according to the output sequence.
Optionally, the material retrieving module 303 includes:
and the search display unit is used for displaying the text content in a search box of a visual interface.
And the result matching unit is used for searching a display result matched with the text content in the preset database when a search control instruction of a user is received.
And the result display unit is used for sequentially displaying on the visual interface according to the sequence of the similarity between the display result and the text content from large to small.
Optionally, the system further includes a user management module, where the user management module at least includes:
the system comprises a user registration unit and a user identification unit, wherein the user registration unit is used for registering according to the identity information of a registered user, and the identity information at least comprises an account number, a user name, a password, a real name and a mobile phone number.
And the use information unit is used for recording the online reading time of the registered user and generating a statistical result of the online reading time.
And the user management unit is used for managing the identity information of the registered user.
And the authority management unit is used for managing the operation authority of the registered user and the management user and the visual menu.
Optionally, the system further includes a material reading module, and the resource reading module includes:
the data management unit is used for managing the electronic resources added or the electronic data off-shelf by the user according to a fixed data format;
the data reading unit is used for displaying the electronic resources in the preset database for the registered user;
the reading control unit is used for receiving a reading control instruction of a registered user and jumping to the display range of the electronic resource according to the reading control instruction;
and the label recording unit is used for acquiring a label marking instruction of a registered user and generating a label page for the electronic resource according to the label marking instruction.
Example four
Fig. 4 is an architecture diagram of a data retrieval system according to a fourth embodiment of the present invention, referring to fig. 4, the data retrieval system mainly includes: the system comprises a user management module, an online reading module, a photographing retrieval module, an image text recognition module, a text retrieval module, a retrieval history lookup module and a permission management module. Wherein, the user management module: the method is mainly used for managing the relevant information of the user, including a user name, a password, a real name, a mobile phone number, the duration learning time and the post information.
Further, the user management module supports the user to register a new account number on line, fill in a user name, a password, a real name, a mobile phone number and other information to wait for the manager to pass.
Further, the user management module supports recording of online learning time of the user, and supports statistics viewing and table export of learning time according to year, month and week.
Further, the user management module supports the user to modify the login password on line.
Further, the user management module supports the administrator user to check through the registration of the common personnel.
Further, the user management module supports the administrator user to reset the login password of the common user.
Referring to fig. 5, the online reading module is mainly used for electronically scanning a paper book to form a picture, so as to support a user to read online.
Furthermore, the online reading module supports an administrator to add new electronic books according to a fixed format.
Further, the online reading module supports an administrator to put down a specific book.
Furthermore, the online reading module supports a user to select a certain book for reading.
Furthermore, the online reading module supports the user to skip and read the book content according to the directory index.
Furthermore, the online reading module supports the user to enlarge and reduce the page of the book for reading.
Furthermore, the online reading module supports the user to read the previous page and the next page in a left-right sliding mode.
Further, the online reading module supports the user to select a specific page as the label page.
Further, referring to fig. 6 and 7, the photographing retrieval module supports photographing of text content to be retrieved, recognizes characters on a photo by using an image recognition technology, and queries related content of a book by using a text retrieval technology. The photographing retrieval module executes the following specific steps:
and S1, opening the APP and entering a photographing retrieval function module.
And S2, clicking the photographing button, opening the camera of the mobile phone and taking a clear picture.
And S3, placing the text content to be recognized into the rectangular frame by moving the rectangular frame and adjusting the size of the rectangular frame.
And S4, clicking the identification button to transfer the area in the rectangular frame into the image text identification module.
And S5, receiving the text content identified by the image text identification module and transmitting the text content to the text retrieval module.
And S6, receiving the content retrieved by the text retrieval module, and displaying the content from high to low according to the similarity.
Further, referring to fig. 8, the image text recognition module supports the image selected by the user box to be converted into characters through the trained chinese recognition CRNN algorithm. The method comprises the following specific steps:
and S1, receiving the pictures submitted by the photographing retrieval module.
And S2, converting the received picture into a gray picture.
And S3, sending the gray level picture to a trained Chinese recognition CRNN algorithm.
And S4, sorting the results identified by the CRNN algorithm according to the confidence level, and filtering out the results with the confidence level lower than 90%.
And S5, splicing the filtered results and returning the results as recognized text results.
Further, the text retrieval module: the method is used for inputting keywords into the text box and searching related contents of the book. The method comprises the following specific steps:
and S1, opening the APP and entering a text retrieval function module.
And S2, clicking the text box and inputting the text content to be retrieved by using the input method.
And S3, clicking the identification button to wait for the identification result.
And S4, displaying the retrieved contents in a mode of high to low according to the similarity.
Further, referring to fig. 9, the retrieval history reference module: the method is mainly used for storing and displaying records searched by users.
And further, the retrieval history consulting module is mainly used for recording the content of each piece of search of the user, including the searching mode, the searched text, the searched picture and the retrieved content.
Furthermore, the retrieval history consulting module is mainly used for displaying the user search records in the time sequence from near to far.
Furthermore, the authority management module is mainly used for distinguishing the operation authorities of the common user and the administrator user. The authority management module can endow different operation authorities for different users and control the display of different operation menus for the users with different authorities.
The data search system provided by the embodiment of the invention can execute the data search method provided by any embodiment of the invention, and has corresponding functional modules and beneficial effects of the execution method.
EXAMPLE five
Fig. 10 is a schematic structural diagram of an electronic device implementing the material searching method according to the embodiment of the present invention. Electronic devices are intended to represent various forms of digital computers, such as laptops, desktops, workstations, personal digital assistants, servers, blade servers, mainframes, and other appropriate computers. The electronic device may also represent various forms of mobile devices, such as personal digital assistants, cellular phones, smart phones, wearable devices (e.g., helmets, glasses, watches, etc.), and other similar computing devices. The components shown herein, their connections and relationships, and their functions, are meant to be exemplary only, and are not meant to limit implementations of the inventions described and/or claimed herein.
As shown in fig. 10, the electronic device 10 includes at least one processor 11, and a memory communicatively connected to the at least one processor 11, such as a Read Only Memory (ROM)12, a Random Access Memory (RAM)13, and the like, wherein the memory stores a computer program executable by the at least one processor, and the processor 11 may perform various suitable actions and processes according to the computer program stored in the Read Only Memory (ROM)12 or the computer program loaded from a storage unit 18 into the Random Access Memory (RAM) 13. In the RAM 13, various programs and data necessary for the operation of the electronic apparatus 10 can also be stored. The processor 11, the ROM 12, and the RAM 13 are connected to each other via a bus 14. An input/output (I/O) interface 15 is also connected to the bus 14.
A number of components in the electronic device 10 are connected to the I/O interface 15, including: an input unit 16 such as a keyboard, a mouse, or the like; an output unit 17 such as various types of displays, speakers, and the like; a storage unit 18 such as a magnetic disk, an optical disk, or the like; and a communication unit 19 such as a network card, modem, wireless communication transceiver, etc. The communication unit 19 allows the electronic device 10 to exchange information/data with other devices via a computer network such as the internet and/or various telecommunication networks.
The processor 11 may be a variety of general and/or special purpose processing components having processing and computing capabilities. Some examples of processor 11 include, but are not limited to, a Central Processing Unit (CPU), a Graphics Processing Unit (GPU), various dedicated Artificial Intelligence (AI) computing chips, various processors running machine learning model algorithms, a Digital Signal Processor (DSP), and any suitable processor, controller, microcontroller, and so forth. The processor 11 performs the various methods and processes described above, such as the profile search method.
In some embodiments, the profile searching method may be implemented as a computer program tangibly embodied in a computer-readable storage medium, such as storage unit 18. In some embodiments, part or all of the computer program may be loaded and/or installed onto the electronic device 10 via the ROM 12 and/or the communication unit 19. When the computer program is loaded into RAM 13 and executed by processor 11, one or more steps of the above-described material search method may be performed. Alternatively, in other embodiments, the processor 11 may be configured to perform the profile search method by any other suitable means (e.g., by way of firmware).
Various implementations of the systems and techniques described here above may be implemented in digital electronic circuitry, integrated circuitry, Field Programmable Gate Arrays (FPGAs), Application Specific Integrated Circuits (ASICs), Application Specific Standard Products (ASSPs), system on a chip (SOCs), load programmable logic devices (CPLDs), computer hardware, firmware, software, and/or combinations thereof. These various embodiments may include: implemented in one or more computer programs that are executable and/or interpretable on a programmable system including at least one programmable processor, which may be special or general purpose, receiving data and instructions from, and transmitting data and instructions to, a storage system, at least one input device, and at least one output device.
A computer program for implementing the methods of the present invention may be written in any combination of one or more programming languages. These computer programs may be provided to a processor of a general purpose computer, special purpose computer, or other programmable data processing apparatus, such that the computer programs, when executed by the processor, cause the functions/acts specified in the flowchart and/or block diagram block or blocks to be performed. A computer program can execute entirely on a machine, partly on a machine, as a stand-alone software package partly on a machine and partly on a remote machine or entirely on a remote machine or server.
In the context of the present invention, a computer-readable storage medium may be a tangible medium that can contain, or store a computer program for use by or in connection with an instruction execution system, apparatus, or device. A computer readable storage medium may include, but is not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any suitable combination of the foregoing. Alternatively, the computer readable storage medium may be a machine readable signal medium. More specific examples of a machine-readable storage medium would include an electrical connection based on one or more wires, a portable computer diskette, a hard disk, a Random Access Memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing.
To provide for interaction with a user, the systems and techniques described here can be implemented on an electronic device having: a display device (e.g., a CRT (cathode ray tube) or LCD (liquid crystal display) monitor) for displaying information to a user; and a keyboard and a pointing device (e.g., a mouse or a trackball) by which a user can provide input to the electronic device. Other kinds of devices may also be used to provide for interaction with a user; for example, feedback provided to the user can be any form of sensory feedback (e.g., visual feedback, auditory feedback, or tactile feedback); and input from the user may be received in any form, including acoustic, speech, or tactile input.
The systems and techniques described here can be implemented in a computing system that includes a back-end component (e.g., as a data server), or that includes a middleware component (e.g., an application server), or that includes a front-end component (e.g., a user computer having a graphical user interface or a web browser through which a user can interact with an implementation of the systems and techniques described here), or any combination of such back-end, middleware, or front-end components. The components of the system can be interconnected by any form or medium of digital data communication (e.g., a communication network). Examples of communication networks include: local Area Networks (LANs), Wide Area Networks (WANs), blockchain networks, and the internet.
The computing system may include clients and servers. A client and server are generally remote from each other and typically interact through a communication network. The relationship of client and server arises by virtue of computer programs running on the respective computers and having a client-server relationship to each other. The server can be a cloud server, also called a cloud computing server or a cloud host, and is a host product in a cloud computing service system, so that the defects of high management difficulty and weak service expansibility in the traditional physical host and VPS service are overcome.
It should be understood that various forms of the flows shown above may be used, with steps reordered, added, or deleted. For example, the steps described in the present invention may be executed in parallel, sequentially, or in different orders, and are not limited herein as long as the desired results of the technical solution of the present invention can be achieved.
The above-described embodiments should not be construed as limiting the scope of the invention. It should be understood by those skilled in the art that various modifications, combinations, sub-combinations and substitutions may be made, depending on design requirements and other factors. Any modification, equivalent replacement, and improvement made within the spirit and principle of the present invention should be included in the protection scope of the present invention.
Claims (10)
1. A method for searching for material, comprising:
triggering an image acquisition module to acquire an image to be identified according to the retrieval instruction;
determining text content in the image to be recognized;
and searching and displaying a display result in a preset database according to the text content.
2. The method according to claim 1, wherein the triggering an image acquisition module to acquire the image to be recognized according to the retrieval instruction comprises:
receiving a retrieval instruction input by the user in a visual interface, wherein the retrieval instruction comprises at least one of the following: a sliding instruction, a clicking instruction, a gesture instruction and a voice instruction;
and triggering the image acquisition module to acquire an image of a target retrieval object according to the retrieval instruction, and taking the image acquired picture as the image to be identified.
3. The method according to claim 1 or 2, wherein the determining the text content in the image to be recognized comprises:
displaying the image to be identified on a visual interface and receiving region-of-interest framing information of a user, wherein the region-of-interest framing information comprises selection box position information and selection box size information;
extracting an image of the area to be identified corresponding to the region of interest framing information in the image to be identified;
extracting the text content in the region image to be recognized by using a deep learning character recognition model.
4. The method of claim 3, wherein the extracting the text content in the image of the region to be recognized by using a deep learning character recognition model comprises:
converting the area image to be identified into a gray image;
inputting the gray level image into a pre-trained convolution cyclic neural network to obtain at least one recognition result;
sorting the recognition results according to the confidence degrees, and eliminating the recognition results with the confidence degrees lower than a first threshold value;
and sequentially splicing the recognition results into the text content according to the output sequence.
5. The method of claim 1, wherein the searching and displaying the display result in a predetermined database according to the text content comprises:
displaying the text content in a search box of a visual interface;
searching a display result matched with the text content in the preset database when a search control instruction of a user is received;
and displaying the display results and the text contents on the visual interface in sequence according to the sequence of similarity from large to small of the display results and the text contents.
6. A data search system, comprising:
the image acquisition module is used for triggering the image acquisition module to acquire an image to be identified according to the retrieval instruction;
the text recognition module is used for determining the text content in the image to be recognized;
and the data retrieval module is used for searching and displaying a display result in a preset database according to the text content.
7. The system of claim 6, further comprising a user management module, the user management module comprising at least:
the system comprises a user registration unit, a user identification unit and a user identification unit, wherein the user registration unit is used for registering according to identity information of a registered user, and the identity information at least comprises an account number, a user name, a password, a real name and a mobile phone number;
the use information unit is used for recording the online reading time of the registered user and generating a statistical result of the online reading time;
a user management unit for managing the identity information of a registered user;
and the authority management unit is used for managing the operation authority of the registered user and the management user and the visual menu.
8. The system of claim 6, further comprising a document reading module, the resource reading module comprising:
the data management unit is used for managing the electronic resources added or the electronic data off-shelf by the user according to a fixed data format;
the data reading unit is used for displaying the electronic resources in the preset database for the registered user;
the reading control unit is used for receiving a reading control instruction of a registered user and jumping to the display range of the electronic resource according to the reading control instruction;
and the label recording unit is used for acquiring a label marking instruction of a registered user and generating a label page for the electronic resource according to the label marking instruction.
9. An electronic device, characterized in that the electronic device comprises:
at least one processor; and
a memory communicatively coupled to the at least one processor; wherein the content of the first and second substances,
the memory stores a computer program executable by the at least one processor to enable the at least one processor to perform the method of any one of claims 1-5.
10. A computer-readable storage medium having stored thereon computer instructions for causing a processor to execute the method of any one of claims 1-5.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202210291982.9A CN114661879A (en) | 2022-03-23 | 2022-03-23 | Data searching method, system, electronic equipment and storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202210291982.9A CN114661879A (en) | 2022-03-23 | 2022-03-23 | Data searching method, system, electronic equipment and storage medium |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN114661879A true CN114661879A (en) | 2022-06-24 |
Family
ID=82031426
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202210291982.9A Pending CN114661879A (en) | 2022-03-23 | 2022-03-23 | Data searching method, system, electronic equipment and storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN114661879A (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN117407562A (en) * | 2023-12-13 | 2024-01-16 | 杭州海康威视数字技术股份有限公司 | Image recognition method, system and electronic equipment |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US8484187B1 (en) * | 2011-10-05 | 2013-07-09 | Google Inc. | Enhanced presentation mode for search results |
| CN106844569A (en) * | 2017-01-03 | 2017-06-13 | 陕西甄宝网络有限公司 | A kind of frame selects identifying system and method |
| CN110851560A (en) * | 2018-07-27 | 2020-02-28 | 杭州海康威视数字技术股份有限公司 | Information retrieval method, device and equipment |
| CN111460185A (en) * | 2020-03-30 | 2020-07-28 | 小船出海教育科技（北京）有限公司 | Book searching method, device and system |
| CN113010646A (en) * | 2021-03-31 | 2021-06-22 | 苏州乐智永成智能科技有限公司 | Library's wisdom audiovisual management system |
| CN114120299A (en) * | 2021-10-14 | 2022-03-01 | 平安银行股份有限公司 | Information acquisition method, device, storage medium and equipment |
-
2022
- 2022-03-23 CN CN202210291982.9A patent/CN114661879A/en active Pending
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US8484187B1 (en) * | 2011-10-05 | 2013-07-09 | Google Inc. | Enhanced presentation mode for search results |
| CN106844569A (en) * | 2017-01-03 | 2017-06-13 | 陕西甄宝网络有限公司 | A kind of frame selects identifying system and method |
| CN110851560A (en) * | 2018-07-27 | 2020-02-28 | 杭州海康威视数字技术股份有限公司 | Information retrieval method, device and equipment |
| CN111460185A (en) * | 2020-03-30 | 2020-07-28 | 小船出海教育科技（北京）有限公司 | Book searching method, device and system |
| CN113010646A (en) * | 2021-03-31 | 2021-06-22 | 苏州乐智永成智能科技有限公司 | Library's wisdom audiovisual management system |
| CN114120299A (en) * | 2021-10-14 | 2022-03-01 | 平安银行股份有限公司 | Information acquisition method, device, storage medium and equipment |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN117407562A (en) * | 2023-12-13 | 2024-01-16 | 杭州海康威视数字技术股份有限公司 | Image recognition method, system and electronic equipment |
| CN117407562B (en) * | 2023-12-13 | 2024-04-05 | 杭州海康威视数字技术股份有限公司 | Image recognition method, system and electronic equipment |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN102622592B (en) | Name card recognition method based on cloud technology | |
| US9720912B2 (en) | Document management system, document management method, and document management program | |
| CN107679211A (en) | Method and apparatus for pushed information | |
| US10489637B2 (en) | Method and device for obtaining similar face images and face image information | |
| EP4057163A1 (en) | Facilitating use of images as search queries | |
| CN110427542A (en) | Sorter network training and data mask method and device, equipment, medium | |
| AU2019419891B2 (en) | System and method for spatial encoding and feature generators for enhancing information extraction | |
| EP2806336A1 (en) | Text prediction in a text input associated with an image | |
| CN110941702A (en) | Retrieval method and device for laws and regulations and laws and readable storage medium | |
| CN114595686A (en) | Knowledge extraction method, and training method and device of knowledge extraction model | |
| CN111026967A (en) | Method, device, equipment and medium for obtaining user interest tag | |
| Hwang et al. | A spelling based CAPTCHA system by using click | |
| CN113221918A (en) | Target detection method, and training method and device of target detection model | |
| CN114092948B (en) | Bill identification method, device, equipment and storage medium | |
| CN107766498A (en) | Method and apparatus for generating information | |
| CN113297345B (en) | Analysis report generation method, electronic equipment and related product | |
| CN114661879A (en) | Data searching method, system, electronic equipment and storage medium | |
| CN115099239A (en) | Resource identification method, device, equipment and storage medium | |
| CN107168635A (en) | Information demonstrating method and device | |
| CN113568934A (en) | Data query method and device, electronic equipment and storage medium | |
| CN116343210B (en) | File digitization management method and device | |
| US20170124120A1 (en) | Information processing system, information processing method, and information processing program | |
| EP3408797A1 (en) | Image-based quality control | |
| CN115909357A (en) | Target identification method based on artificial intelligence, model training method and device | |
| CN110472121A (en) | Card information searching method, device, electronic equipment and computer readable storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20220624 |
|
| RJ01 | Rejection of invention patent application after publication |