CN110598186A - Auxiliary processing method, device and system for image recognition - Google Patents
Auxiliary processing method, device and system for image recognition Download PDFInfo
- Publication number
- CN110598186A CN110598186A CN201910702681.9A CN201910702681A CN110598186A CN 110598186 A CN110598186 A CN 110598186A CN 201910702681 A CN201910702681 A CN 201910702681A CN 110598186 A CN110598186 A CN 110598186A
- Authority
- CN
- China
- Prior art keywords
- information
- image
- item
- filled
- image recognition
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V30/00—Character recognition; Recognising digital ink; Document-oriented image-based pattern recognition
- G06V30/10—Character recognition
- G06V30/14—Image acquisition
- G06V30/148—Segmentation of character regions
- G06V30/153—Segmentation of character regions using recognition of characters or words
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V30/00—Character recognition; Recognising digital ink; Document-oriented image-based pattern recognition
- G06V30/40—Document-oriented image-based pattern recognition
- G06V30/41—Analysis of document content
- G06V30/412—Layout analysis of documents structured with printed lines or input boxes, e.g. business forms or tables
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V30/00—Character recognition; Recognising digital ink; Document-oriented image-based pattern recognition
- G06V30/40—Document-oriented image-based pattern recognition
- G06V30/41—Analysis of document content
- G06V30/418—Document matching, e.g. of document images
Landscapes
- Engineering & Computer Science (AREA)
- Computer Vision & Pattern Recognition (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Multimedia (AREA)
- Theoretical Computer Science (AREA)
- Artificial Intelligence (AREA)
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
Abstract
The application discloses an auxiliary processing method, device and system for image recognition, relates to the technical field of image recognition, and can reduce the path and cost for a user to obtain information and improve the efficiency and accuracy for the user to edit recognition information. The method comprises the following steps: outputting at least one input frame containing image identification information, wherein each item of sub-information in the image identification information is displayed in the corresponding input frame; receiving an information editing instruction, and sending an identifier of an item to be filled corresponding to a selected input box so as to perform information editing in the selected input box and highlight field information corresponding to the identifier of the item to be filled in an uploaded image. The method and the device are suitable for auxiliary processing of image recognition.
Description
Technical Field
The present application relates to the field of image recognition technologies, and in particular, to an auxiliary processing method, an auxiliary processing device, and an auxiliary processing system for image recognition.
Background
With the development of scientific technology, image recognition technology is more and more widely applied. For example, the merchant qualification information in the merchant license image can be identified through an image identification technology, so that the user is helped to replace manual input, and the efficiency of the platform side for acquiring the merchant qualification information can be improved.
In the conventional image recognition process, there may be a link that a user edits a recognition error. However, in the prior art, assistance is not provided in the process of editing the identification information by the user, and the efficiency and the accuracy of editing the identification information by the user are influenced.
Disclosure of Invention
In view of this, the present application provides an auxiliary processing method, an apparatus and a system for image recognition, and mainly aims to solve the technical problem that efficiency and accuracy of editing identification information by a user are affected because no assistance is provided in a process of editing identification information by the user in the conventional image recognition process.
According to an aspect of the present application, there is provided an auxiliary processing method for image recognition, which is applicable to a client side, the method including:
outputting at least one input frame containing image identification information, wherein each item of sub-information in the image identification information is displayed in the corresponding input frame;
receiving an information editing instruction, and sending an identifier of an item to be filled corresponding to a selected input box so as to perform information editing in the selected input box and highlight field information corresponding to the identifier of the item to be filled in an uploaded image.
Optionally, after editing the information in the selected input box, the method further includes:
and updating a highlight display form of the field information corresponding to the to-be-filled item identifier in the uploaded image, wherein the updated highlight display form is used for determining the editing operation of the field information corresponding to the to-be-filled item identifier.
Optionally, after editing the information in the selected input box, the method further includes:
and highlighting other field information of which the similarity of the field information content corresponding to the identification of the item to be filled in is greater than a preset threshold value in the uploaded image.
Optionally, the method further includes:
recording the editing content information before and after the information editing;
and transmitting the editing content information so as to update the image recognition database.
Optionally, before the outputting at least one input box containing image recognition information, the method further includes:
receiving an image uploading instruction, and sending the uploaded image to perform image recognition;
receiving the image identification information corresponding to the uploaded image;
and filling each item of sub-information in the image identification information in the corresponding input frame according to the mark of the item to be filled corresponding to the input frame.
According to another aspect of the present application, there is provided another auxiliary processing method for image recognition, which is applicable to a server side, the method including:
receiving an identifier of an item to be filled corresponding to the selected input box;
inquiring a grouping identification corresponding to the identification of the item to be filled;
and acquiring field information corresponding to the group identifier in an uploaded image so as to trigger the field information to be highlighted in the uploaded image while editing information in the selected input box.
Optionally, the method further includes:
receiving the uploaded image;
carrying out image recognition on the uploaded image by using a preset recognition matching rule corresponding to each item to be filled to obtain image recognition information and returning the image recognition information, wherein the image recognition information comprises sub information corresponding to each item to be filled;
grouping the field information which is subjected to image recognition in the uploaded image according to the corresponding item identification to be filled and the field content, configuring a group identification corresponding to the field information which is subjected to image recognition and a mapping relation between the group identification and the corresponding item identification to be filled.
Optionally, after the uploaded image is subjected to image recognition by using the preset recognition matching rule corresponding to each item to be filled to obtain image recognition information, the method further includes:
triggering the display of the respective image-recognized field information in the uploaded image.
Optionally, if the uploaded image cannot be subjected to image recognition according to the preset recognition matching rule, the method further includes:
and returning prompt information of image uploading errors.
Optionally, based on an OCR recognition technology, image recognition is performed on the uploaded image.
According to another aspect of the present application, there is provided an auxiliary processing apparatus for image recognition, which is applicable to a client side, the apparatus including:
the output module is used for outputting at least one input box containing image identification information, wherein each item of sub-information in the image identification information is displayed in the corresponding input box;
and the sending module is used for receiving an information editing instruction and sending the to-be-filled item identifier corresponding to the selected input box so as to highlight the field information corresponding to the to-be-filled item identifier in the uploaded image while editing the information in the selected input box.
Optionally, the apparatus further comprises:
and the updating module is used for updating the highlight display form of the field information corresponding to the to-be-filled item identifier in the uploaded image, wherein the updated highlight display form is used for determining that the field information corresponding to the to-be-filled item identifier has information editing operation.
Optionally, the output module is further configured to highlight, in the uploaded image, other field information whose similarity of the field information content corresponding to the identifier of the item to be filled is greater than a preset threshold.
Optionally, the apparatus further comprises: a recording module;
the recording module is used for recording the editing content information before and after the information editing;
the sending module is further configured to send the editing content information so as to update the database of image recognition.
Optionally, the apparatus further comprises: a receiving module and a filling module;
the sending module is also used for receiving an image uploading instruction and sending the uploaded image for image recognition;
the receiving module is used for receiving the image identification information corresponding to the uploaded image;
and the filling module is used for filling each item of sub-information in the image identification information in the corresponding input box according to the mark of the item to be filled corresponding to the input box.
According to still another aspect of the present application, there is provided an auxiliary processing apparatus for image recognition, which is applicable to a service side, the apparatus including:
the receiving module is used for receiving the mark of the item to be filled corresponding to the selected input box;
the query module is used for querying the grouping identification corresponding to the identification of the item to be filled;
and the sending module is used for acquiring field information corresponding to the group identifier in the uploaded image so as to trigger the field information to be highlighted in the uploaded image while editing information in the selected input frame.
Optionally, the apparatus further comprises: an identification module and a grouping module;
the receiving module is further used for receiving the uploaded image;
the identification module is used for carrying out image identification on the uploaded image by utilizing a preset identification matching rule corresponding to each item to be filled to obtain image identification information, wherein the image identification information comprises sub information corresponding to each item to be filled;
the sending module is further configured to return the image identification information;
the grouping module is used for grouping the field information which is subjected to image recognition in the uploaded image according to the corresponding item identification to be filled and the field content, and configuring a grouping identification corresponding to the field information which is subjected to image recognition and a mapping relation between the grouping identification and the corresponding item identification to be filled.
Optionally, the sending module is further configured to trigger that each image-identified field information is highlighted in the uploaded image.
Optionally, the sending module is further configured to return a prompt message of an image uploading error if the uploaded image cannot be subjected to image recognition according to the preset recognition matching rule.
Optionally, based on an OCR recognition technology, image recognition is performed on the uploaded image.
According to yet another aspect of the present application, there is provided a storage medium having stored thereon a computer program which, when executed by a processor, implements the above-described auxiliary processing method applicable to image recognition on a client side.
According to yet another aspect of the present application, there is provided a client device comprising a storage medium, a processor, and a computer program stored on the storage medium and executable on the processor, the processor implementing the above-mentioned auxiliary processing method applicable to image recognition on the client side when executing the program.
According to yet another aspect of the present application, there is provided a storage medium having stored thereon a computer program which, when executed by a processor, implements the above-described auxiliary processing method applicable to image recognition on a service side.
According to still another aspect of the present application, there is provided a server apparatus including a storage medium, a processor, and a computer program stored on the storage medium and executable on the processor, the processor implementing the above-described auxiliary processing method applicable to image recognition on a server side when executing the program.
According to another aspect of the present application, there is provided an auxiliary processing system for image recognition, including: the client device and the server device.
Compared with the traditional image recognition process, the auxiliary processing method, the device and the system for image recognition provided by the application have the advantages that when an information editing instruction is received, the field information corresponding to the item to be filled in identification can be highlighted in an uploaded image while the information is edited in the input frame by using the item to be filled in identification corresponding to the selected input frame, so that the effect of assisting the user in editing is achieved, the user can know the field content related to the information being edited in the image in time, the user is helped in the process of editing the identification information by the user, the path and the cost for obtaining the information by the user are reduced, and the efficiency and the accuracy for editing the identification information by the user can be improved.
The foregoing description is only an overview of the technical solutions of the present application, and the present application can be implemented according to the content of the description in order to make the technical means of the present application more clearly understood, and the following detailed description of the present application is given in order to make the above and other objects, features, and advantages of the present application more clearly understandable.
Drawings
The accompanying drawings, which are included to provide a further understanding of the application and are incorporated in and constitute a part of this application, illustrate embodiment(s) of the application and together with the description serve to explain the application and not to limit the application. In the drawings:
fig. 1 is a schematic flowchart illustrating an auxiliary processing method for image recognition according to an embodiment of the present application;
FIG. 2 is a flow chart illustrating another method for assisting image recognition according to an embodiment of the present disclosure;
FIG. 3 is a flow chart illustrating a further method for assisting image recognition according to an embodiment of the present disclosure;
fig. 4 is a schematic flowchart illustrating a further method for assisting image recognition according to an embodiment of the present application;
fig. 5 is a schematic flowchart illustrating an application scenario provided in an embodiment of the present application;
FIG. 6 is a diagram illustrating an example application scenario provided by an embodiment of the present application;
fig. 7 is a schematic structural diagram illustrating an auxiliary processing device for image recognition according to an embodiment of the present application;
FIG. 8 is a schematic structural diagram illustrating another auxiliary processing device for image recognition provided in an embodiment of the present application;
fig. 9 shows a schematic structural diagram of an auxiliary processing system for image recognition provided by an embodiment of the present application.
Detailed Description
The present application will be described in detail below with reference to the accompanying drawings in conjunction with embodiments. It should be noted that the embodiments and features of the embodiments in the present application may be combined with each other without conflict.
The method aims to solve the technical problem that the efficiency and the accuracy of the user for editing the identification information are influenced because no assistance is provided in the process of editing the identification information by the user in the traditional image identification process. The embodiment provides an auxiliary processing method for image recognition, which can be applied to a client side as shown in fig. 1, and includes:
101. the client outputs at least one input box containing image recognition information.
And displaying each item of sub information in the image identification information in the corresponding input frame. The image identification information is obtained by sending the uploaded image to a server side for identification.
In this embodiment, each item to be filled has a corresponding input box, and the content displayed in the input box is the image recognition content corresponding to the item to be filled. If there is a recognition error or the user needs to modify the recognized contents, the user may manually edit the contents presented in the input box, such as adding, deleting, replacing certain text, etc.
The execution subject of the embodiment can be an auxiliary processing client device or equipment for image recognition, and is used for better guiding a user to quickly and clearly identify the fields needing to be edited in the process of editing the image recognition information. The process shown in step 102 may be performed.
102. Receiving an information editing instruction, and sending the to-be-filled item identifier corresponding to the selected input box to the server, so that the field information corresponding to the to-be-filled item identifier is highlighted in the uploaded image while the information is edited in the selected input box.
When a user needs to edit the image identification information displayed in a certain input box, the user can select the input box, such as touch, click and the like, and further input an information editing instruction. Correspondingly, when the client receives the information editing instruction, the client can acquire the identifier of the item to be filled corresponding to the selected input box, then the identifier of the item to be filled is sent to the server, the server inquires the corresponding field information in the uploaded image according to the identifier, and then the server is triggered to perform highlighting display (such as highlighting, thickening, shading, frame selection, underlining and other display forms are performed according to the difference from other fields) in the uploaded image, so that the client can perform information editing in the selected input box and simultaneously perform highlighting display on the corresponding field information in the uploaded image.
Compared with the traditional image identification process, the method can prominently display the corresponding field information in the uploaded image while editing the information in the input frame, and further plays a role in assisting the user to edit, so that the user can conveniently know the field content related to the information being edited in the image in time, help is provided for the user in the process of editing the identification information by the user, the path and the cost of obtaining the information by the user are reduced, and the efficiency and the accuracy of editing the identification information by the user can be improved.
Further, as a refinement and an extension of the specific implementation of the above embodiment, in order to fully explain the specific implementation process of the embodiment, another auxiliary processing method applicable to image recognition on the client side is provided, as shown in fig. 2, the method includes:
201. and the client receives the image uploading instruction and sends the uploaded image to the server for image recognition.
For example, the user may tap or click on an upload button, select an image file to be uploaded, and then click on a confirmation upload to input an image upload instruction. And when receiving the image uploading instruction, the client side sends the uploaded image selected by the user to the server side for image recognition.
202. And receiving image identification information corresponding to the uploaded image returned by the server.
In this embodiment, when the server performs image recognition on the uploaded image, the server may recognize sub information corresponding to each item to be filled, and then returns image recognition information to the client.
203. And filling each item of sub-information in the received image identification information in the corresponding input frame according to the mark of the item to be filled corresponding to the input frame.
For example, the sub information corresponding to the item a to be filled in the image identification information is filled in the input box corresponding to the item a to be filled in on the client side; and filling the sub information corresponding to the item B to be filled in the image identification information in an input box corresponding to the item B to be filled in at the client side.
204. And outputting at least one input box containing the image identification information.
And displaying each item of sub information in the image identification information in the corresponding input frame.
For the embodiment, after the image recognition, in order to enable the user to know the field which is already recognized by the image in the uploaded image in time, optionally, after the server performs the image recognition on the uploaded image, the server may mark the recognized field in the uploaded image, and trigger the highlighting. Accordingly, at the client side, while outputting the at least one input box, the respective image-recognized field information may be highlighted in the uploaded image. Through the optional mode, the user can determine which fields in the image are identified, find the unidentified fields in time, and subsequently manually edit and add the unidentified fields, so that the fields are convenient to search, and the information input efficiency is further improved.
Further optionally, when each identified field is highlighted in the uploaded image, the corresponding item to be filled in identifier or the identifier of the corresponding input box may be attached, so that the user can conveniently check the error and find the information of the identification error in time.
205. Receiving an information editing instruction, and sending the to-be-filled item identifier corresponding to the selected input box to the server, so that the field information corresponding to the to-be-filled item identifier is highlighted in the uploaded image while the information is edited in the selected input box.
Specifically, when the field information is highlighted, if other field information is already highlighted, then the field information is distinctively highlighted (e.g., different color shading or background color is used, the thickness is increased, the number of underlines is increased, or the highlighting effect of other field information is canceled, etc.). So as to highlight the field information in the image corresponding to the information being edited.
Further, after the information is edited in the selected input box, in order to make the user clearly understand that the identification content of the field in the image has been edited again, optionally, a highlight form of the field information corresponding to the identifier of the item to be filled in may be updated in the uploaded image, where the updated highlight form is used to determine that the field information corresponding to the identifier of the item to be filled in has an information editing operation. For example, the distinguishing highlighting is performed to prompt the user that the identification content of the field in the uploaded image has been edited again, so that the user can check errors and edit the image in time.
Because a uniform identification mode is adopted in the image identification process, the same field content in the image is generally identified as the same content, namely, a plurality of same identification information exists, if a user reediting one identification information, the other identification information is probably reediting, so that in order to improve the information editing efficiency, further optional, after the information editing is carried out in the selected input box, the other field information with the similarity degree of the field information content corresponding to the identification of the item to be filled greater than the preset threshold value can be highlighted in the uploaded image.
The preset threshold value can be preset and set according to actual requirements, and the higher the threshold value is set, the more similar the content is. The highlighting is used for reminding the user of the position of the field corresponding to other identification information which is similar to or the same as the identification content of the information editing in the image, so that the user can conveniently find the corresponding input box in time according to the identification of the item to be filled in, and then continuously re-edit the other identification information which is the same or similar to the identification content of the information editing. By the method, the efficiency and the accuracy of user information editing can be improved, and the identification information needing to be edited again is avoided being omitted.
The process of editing information by the user again indicates that there may be a certain error in image recognition to a certain extent, so to improve the accuracy of subsequent image recognition, further optionally, this embodiment may further include: recording the editing content information before and after the information editing; and then sending the edited content information to the server so as to update the image recognition database. And then the subsequent server side can perform a more accurate image identification process on the newly uploaded image through the updated data.
The above embodiment is about the auxiliary processing procedure of image recognition described at the client side, and further, to fully illustrate the implementation of this embodiment, this embodiment further provides another auxiliary processing method of image recognition, which can be applied at the server side, as shown in fig. 3, and the method includes:
301. and the server receives the identification of the item to be filled corresponding to the selected input box.
302. And inquiring the grouping identification corresponding to the identification of the item to be filled.
In this embodiment, the server may count the identifiers of the items to be filled in the client in advance, such as a1, a2, A3. In image recognition of the uploaded image, the recognized fields may be grouped, for example, according to the identification of the item to be filled, and marked as B1, B2, and B3 in sequence, where a1 corresponds to B1, a2 corresponds to B2, and A3 corresponds to B3. Therefore, if the server receives the item to be filled corresponding to the selected input box as a1, the corresponding grouping identifier B1 can be queried.
303. And acquiring field information corresponding to the grouping identification in the uploaded image so as to trigger the field information to be highlighted in the uploaded image while editing the information in the selected input box.
Since each identified field information in the uploaded image is grouped, the position information of the corresponding field information can be acquired in the image through grouping identification, and then the corresponding field information is triggered to be highlighted in the image while the information is edited in the input frame at the client side according to the position information.
Compared with the prior art, the auxiliary processing method applicable to the image identification at the server side can prominently display the corresponding field information in the uploaded image while editing the information in the input frame, and further plays a role in assisting the user in editing, so that the user can conveniently know the field content related to the information being edited in the image in time, help the user in the process of editing the identification information by the user, reduce the path and cost for the user to obtain the information, and improve the efficiency and accuracy for the user to edit the identification information.
Further, as a refinement and an extension of the specific implementation of the above embodiment, in order to fully explain the specific implementation process of the embodiment, another auxiliary processing method applicable to image recognition on the server side is provided, as shown in fig. 4, and the method includes:
401. and the server receives the uploaded image sent by the client.
402. And carrying out image recognition on the uploaded image by using a preset recognition matching rule corresponding to each item to be filled to obtain image recognition information and returning the image recognition information to the client.
The image identification information comprises sub information corresponding to each item identifier to be filled. The preset recognition matching rules can be determined according to the content form of the item to be filled. For example, if the item to be filled is a company-established date, the identification matching rule may be determined from the matching rule of XXXXXX year, XX month, XX day; if the item to be filled in is the filling item of a corporate legal person, the identification matching rule can be determined according to the matching rule of the user name; if the item to be filled is a registered capital filling item, then the identifying matching rules can be determined from the matching rules of capitalization combinations + currencies.
In this embodiment, the server prepares the identifiers of the items to be filled in advance, establishes one-to-one identification matching rules, determines whether different identification matching rules are different or not according to the content format of the items to be filled in, and further can accurately identify the field information corresponding to each identifier of the items to be filled in the uploaded image.
Further, in order to enable the user to timely know the fields identified by the images in the uploaded images, optionally, after step 402, the method may further include: the server triggers to highlight the information of each image-recognized field in the uploaded image. Accordingly, at the client side, while outputting the at least one input box, the respective image-recognized field information may be highlighted in the uploaded image. Through the optional mode, the user can determine which fields in the image are identified, find the unidentified fields in time, and subsequently manually edit and add the unidentified fields, so that the fields are convenient to search, and the information input efficiency is further improved.
Furthermore, if the uploaded images cannot be subjected to image recognition according to the preset recognition matching rules, the uploaded images are not in accordance with the requirements, and the uploaded images are likely to be wrong for the user, so that prompt information of the image uploading mistake can be returned to help the user correct the image in time.
Optionally, in this embodiment, the uploaded image may be subjected to image Recognition based on an Optical Character Recognition (OCR) Recognition technology. Because the current OCR recognition technology is relatively perfect, the accuracy of image recognition can be met.
403. And grouping the field information which is subjected to image recognition in the uploaded image according to the corresponding item identification to be filled and the field content, and configuring a group identification corresponding to the field information which is subjected to image recognition and a mapping relation between the group identification and the corresponding item identification to be filled.
404. And the server receives the identification of the item to be filled corresponding to the input box selected by the user and sent by the client.
405. And querying the grouping identification corresponding to the identification of the item to be filled in by utilizing the established mapping relation.
406. And acquiring field information corresponding to the grouping identification in the uploaded image so as to trigger the field information to be highlighted in the uploaded image while editing the information in the selected input box.
To further illustrate the implementation process of the method of the embodiment, the following application scenarios are given, but not limited thereto:
for example, if the merchant needs to create its own online shop on the platform side, the platform side checks the qualification information of the merchant for security, and currently, instead of manually inputting information by a user, uploads the license information, and then identifies the corresponding merchant qualification information through an OCR technology. However, in practice, there is a link that an identification error needs to be edited, so how to better guide a user to quickly and clearly determine a field to be edited in an editing process, so that the input efficiency and accuracy are improved, and an optimization space exists.
In order to achieve the above purpose, as shown in fig. 5, the backend server may prepare in advance the field names of the items to be filled (e.g., a1, a2, A3, etc.), and establish a one-to-one identification matching rule; then the user uploads the picture of the business license; the background server receives the image information, fills the identified fields into an input box, groups the identified fields (the name and the content are a group) and marks the groups in sequence (such as B1, B2, B3 and the like, wherein A1 corresponds to B1, A2 corresponds to B2, and A3 corresponds to B3 …); the user clicks any input box (such as A1) to trigger an editing instruction; the background server triggers the highlighting of the corresponding field (e.g., a1 ═ B1), and the B1 field information is identified in the picture. The specific form can be as shown in fig. 6.
By applying the scheme, the recognized fields in the picture are marked based on an OCR recognition technology, when the user edits the corresponding fields, the input box is activated to trigger the marked fields, and the fields are correspondingly displayed in the picture. And furthermore, through picture marking, the user is helped in the field editing process of the user, and the path and cost for the user to obtain information are reduced.
Further, as a specific implementation of the method shown in fig. 1 and fig. 2, an embodiment of the present application provides an auxiliary processing apparatus applicable to image recognition on a client side, as shown in fig. 7, the apparatus includes: an output module 51 and a sending module 52.
An output module 51, configured to output at least one input box containing image identification information, where each item of sub information in the image identification information is displayed in a corresponding input box;
the sending module 52 may be configured to receive an information editing instruction, send an identifier of an item to be filled corresponding to the selected input box, so as to perform information editing in the selected input box and highlight, in an uplink image, field information corresponding to the identifier of the item to be filled.
In a specific application scenario, the output module 51 may be further configured to highlight each image-recognized field information in the upload image while outputting the at least one input box.
In a specific application scenario, the apparatus further comprises: an update module 53;
and an updating module 53, configured to update a highlight form of the field information corresponding to the to-be-filled item identifier in the uploaded image, where the updated highlight form is used to determine that there is an information editing operation on the field information corresponding to the to-be-filled item identifier.
In a specific application scenario, the output module 51 may be further configured to highlight, in the upload image, other field information whose similarity of the field information content corresponding to the to-be-filled item identifier is greater than a preset threshold.
In a specific application scenario, the apparatus further comprises: a recording module 54;
the recording module 54 may be configured to record editing content information before and after information editing;
the sending module 52 may be further configured to send the edited content information so as to update the database for image recognition.
In a specific application scenario, the apparatus further comprises: a receiving module 55 and a filling module 56;
the sending module 52 is further configured to receive an image uploading instruction, and send the uploaded image for image recognition;
the receiving module 55 is configured to receive the image identification information corresponding to the uploaded image;
the filling module 56 may be configured to fill each item of sub information in the image identification information in the corresponding input box according to the identifier of the item to be filled corresponding to each input box.
It should be noted that other corresponding descriptions of the functional units involved in the auxiliary processing device applicable to image recognition at the user client side provided in this embodiment may refer to the corresponding descriptions in fig. 1 and fig. 2, and are not repeated herein.
Further, as a specific implementation of the methods shown in fig. 3 and fig. 4, an embodiment of the present application provides an auxiliary processing apparatus applicable to image recognition on a server side, as shown in fig. 8, the apparatus includes: a receiving module 61, a query module 62 and a sending module 63.
The receiving module 61 may be configured to receive an identifier of an item to be filled corresponding to the selected input box;
the query module 62 is configured to query the group identifier corresponding to the identifier of the item to be filled;
the sending module 63 may be configured to obtain field information corresponding to the group identifier in the uploaded image, so as to trigger the field information to be prominently displayed in the uploaded image while editing information in the selected input box.
In a specific application scenario, the apparatus further comprises: an identification module 64, a grouping module 65;
the receiving module 61 is further configured to receive the uploaded image;
the identification module 64 may be configured to perform image identification on the uploaded image by using a preset identification matching rule corresponding to each item to be filled, so as to obtain image identification information, where the image identification information includes sub information corresponding to each item to be filled;
the sending module 63 is further configured to return the image identification information;
the grouping module 65 may be configured to group the field information identified by the image in the uploaded image according to the corresponding to-be-filled item identifier and the field content, and configure a grouping identifier corresponding to the field information identified by the image, and a mapping relationship between the grouping identifier and the corresponding to-be-filled item identifier.
In a specific application scenario, the sending module 63 may be further configured to trigger that each image-recognized field information is highlighted in the uploaded image.
In a specific application scenario, the sending module 63 is further configured to return a prompt message indicating that an image is uploaded incorrectly if the uploaded image cannot be subjected to image recognition according to the preset recognition matching rule.
In a specific application scenario, optionally, image recognition is performed on the uploaded image based on an OCR recognition technology.
It should be noted that other corresponding descriptions of the functional units involved in the auxiliary processing device applicable to image recognition at the server side provided in this embodiment may refer to the corresponding descriptions in fig. 3 and fig. 4, and are not repeated herein.
Based on the methods shown in fig. 1 and fig. 2, correspondingly, the present application further provides a storage medium, on which a computer program is stored, and when the computer program is executed by a processor, the storage medium implements the auxiliary processing method applicable to image recognition on the client side of the user as shown in fig. 1 and fig. 2. Based on the methods shown in fig. 3 and 4, the present application further provides another storage medium, on which a computer program is stored, and the computer program, when executed by a processor, implements the auxiliary processing method applicable to the image recognition on the service end side as shown in fig. 3 and 4.
Based on such understanding, the technical solution of the present application may be embodied in the form of a software product, which may be stored in a non-volatile storage medium (which may be a CD-ROM, a usb disk, a removable hard disk, etc.), and includes several instructions for enabling a computer device (which may be a personal computer, a server, or a network device, etc.) to execute the method of the embodiments of the present application.
Based on the methods shown in fig. 1 and fig. 2 and the virtual device embodiment shown in fig. 7, in order to achieve the above object, an embodiment of the present application further provides a client device, which may specifically be a merchant management device, a personal computer, a POS device, a tablet computer, a smart phone, a smart watch, a smart bracelet, or other network device, and the client device includes a storage medium and a processor; a storage medium for storing a computer program; a processor for executing a computer program to implement the above-described auxiliary processing method applicable to image recognition on the user client side as shown in fig. 1 and 2.
Based on the methods shown in fig. 3 and fig. 4 and the virtual device embodiment shown in fig. 8, in order to achieve the above object, the embodiment of the present application further provides a server device, which may specifically be a gateway device, a server, or other network devices. The apparatus includes a storage medium and a processor; a storage medium for storing a computer program; a processor for executing a computer program to implement the auxiliary processing method applicable to the image recognition on the service end side as shown in fig. 3 and 4.
Optionally, both the two entity devices may further include a user interface, a network interface, a camera, a Radio Frequency (RF) circuit, a sensor, an audio circuit, a WI-FI module, and the like. The user interface may include a Display screen (Display), an input unit such as a keypad (Keyboard), etc., and the optional user interface may also include a USB interface, a card reader interface, etc. The network interface may optionally include a standard wired interface, a wireless interface (e.g., WI-FI interface), etc.
Those skilled in the art will appreciate that the physical device structure of the client device and the server device provided in the present embodiment does not constitute a limitation to the two physical devices, and may include more or less components, or combine some components, or arrange different components.
The storage medium may further include an operating system and a network communication module. The operating system is a program that manages the hardware and software resources of the two physical devices described above, supporting the operation of the information processing program as well as other software and/or programs. The network communication module is used for realizing communication among components in the storage medium and communication with other hardware and software in the information processing entity device.
Based on the above, further, the present application provides an auxiliary processing system for image recognition, as shown in fig. 9, the system includes a server device 71, a client device 72;
among other things, the client device 72 may be used to perform the methods shown in fig. 1 and 2, and the server device 71 may be used to perform the methods shown in fig. 3 and 4.
A client device 72 operable to send the uploaded image to the server device 71 for image recognition; then, image identification information corresponding to the uploaded image returned by the server device 71 is received; and then filling each item of sub-information in the image identification information in the corresponding input box according to the mark of the item to be filled corresponding to each input box. And outputting at least one input frame containing image identification information, wherein each item of sub-information in the image identification information is displayed in the corresponding input frame. When receiving the information editing instruction, the identification of the item to be filled corresponding to the selected input box is sent to the server device 71. So that the field information corresponding to the item identification to be filled in is highlighted in the uploaded image while the information is edited in the selected input box.
The server device 71 may be configured to receive the uploaded image sent by the client device 72, perform image recognition, and then return corresponding image recognition information to the client device 72. Receiving the mark of the item to be filled corresponding to the selected input box sent by the client device 72; then inquiring a grouping identification corresponding to the identification of the item to be filled; and acquiring field information corresponding to the group identifier in an uploaded image so as to trigger the field information to be highlighted in the uploaded image while editing information in the selected input box.
Through the above description of the embodiments, those skilled in the art will clearly understand that the present application can be implemented by software plus a necessary general hardware platform, and can also be implemented by hardware. By applying the technical scheme of the application, the identified fields in the picture are marked based on the image identification technology, when the user edits the corresponding fields, the input box is activated to trigger the marked fields, and the fields are correspondingly displayed in the picture. And furthermore, through picture marking, the user is helped in the field editing process of the user, and the path and cost for the user to obtain information are reduced.
Those skilled in the art will appreciate that the figures are merely schematic representations of one preferred implementation scenario and that the blocks or flow diagrams in the figures are not necessarily required to practice the present application. Those skilled in the art will appreciate that the modules in the devices in the implementation scenario may be distributed in the devices in the implementation scenario according to the description of the implementation scenario, or may be located in one or more devices different from the present implementation scenario with corresponding changes. The modules of the implementation scenario may be combined into one module, or may be further split into a plurality of sub-modules.
The above application serial numbers are for description purposes only and do not represent the superiority or inferiority of the implementation scenarios. The above disclosure is only a few specific implementation scenarios of the present application, but the present application is not limited thereto, and any variations that can be made by those skilled in the art are intended to fall within the scope of the present application.
Claims (10)
1. An auxiliary processing method for image recognition is characterized by comprising the following steps:
outputting at least one input frame containing image identification information, wherein each item of sub-information in the image identification information is displayed in the corresponding input frame;
receiving an information editing instruction, and sending an identifier of an item to be filled corresponding to a selected input box so as to perform information editing in the selected input box and highlight field information corresponding to the identifier of the item to be filled in an uploaded image.
2. The method of claim 1, wherein after editing information within the selected input box, the method further comprises:
and updating a highlight display form of the field information corresponding to the to-be-filled item identifier in the uploaded image, wherein the updated highlight display form is used for determining the editing operation of the field information corresponding to the to-be-filled item identifier.
3. An auxiliary processing method for image recognition is characterized by comprising the following steps:
receiving an identifier of an item to be filled corresponding to the selected input box;
inquiring a grouping identification corresponding to the identification of the item to be filled;
and acquiring field information corresponding to the group identifier in an uploaded image so as to trigger the field information to be highlighted in the uploaded image while editing information in the selected input box.
4. An auxiliary processing device for image recognition, comprising:
the output module is used for outputting at least one input box containing image identification information, wherein each item of sub-information in the image identification information is displayed in the corresponding input box;
and the sending module is used for receiving an information editing instruction and sending the to-be-filled item identifier corresponding to the selected input box so as to highlight the field information corresponding to the to-be-filled item identifier in the uploaded image while editing the information in the selected input box.
5. An auxiliary processing device for image recognition, comprising:
the receiving module is used for receiving the mark of the item to be filled corresponding to the selected input box;
the query module is used for querying the grouping identification corresponding to the identification of the item to be filled;
and the sending module is used for acquiring field information corresponding to the group identifier in the uploaded image so as to trigger the field information to be highlighted in the uploaded image while editing information in the selected input frame.
6. A storage medium on which a computer program is stored, the program realizing the image recognition auxiliary processing method according to any one of claims 1 to 2 when executed by a processor.
7. A client device comprising a storage medium, a processor and a computer program stored on the storage medium and executable on the processor, wherein the processor implements the image recognition auxiliary processing method according to any one of claims 1 to 2 when executing the program.
8. A storage medium on which a computer program is stored, wherein the program, when executed by a processor, implements the image recognition assistance processing method of claim 3.
9. A server device comprising a storage medium, a processor, and a computer program stored on the storage medium and executable on the processor, wherein the processor implements the image recognition auxiliary processing method according to claim 3 when executing the program.
10. An auxiliary processing system for image recognition, comprising: a client device as claimed in claim 7 and a server device as claimed in claim 9.
Priority Applications (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910702681.9A CN110598186A (en) | 2019-07-31 | 2019-07-31 | Auxiliary processing method, device and system for image recognition |
| PCT/CN2020/076063 WO2021017458A1 (en) | 2019-07-31 | 2020-02-20 | Auxiliary processing method, device, and system for image recognition |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910702681.9A CN110598186A (en) | 2019-07-31 | 2019-07-31 | Auxiliary processing method, device and system for image recognition |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN110598186A true CN110598186A (en) | 2019-12-20 |
Family
ID=68853310
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201910702681.9A Pending CN110598186A (en) | 2019-07-31 | 2019-07-31 | Auxiliary processing method, device and system for image recognition |
Country Status (2)
| Country | Link |
|---|---|
| CN (1) | CN110598186A (en) |
| WO (1) | WO2021017458A1 (en) |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111967347A (en) * | 2020-07-28 | 2020-11-20 | 北京嘀嘀无限科技发展有限公司 | Data processing method and device, readable storage medium and electronic equipment |
| WO2021017458A1 (en) * | 2019-07-31 | 2021-02-04 | 浙江口碑网络技术有限公司 | Auxiliary processing method, device, and system for image recognition |
Families Citing this family (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113139144A (en) * | 2021-05-11 | 2021-07-20 | 拉扎斯网络科技（上海）有限公司 | Method, device and equipment for acquiring resource picture |
Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1848109A (en) * | 2005-04-13 | 2006-10-18 | 摩托罗拉公司 | Method and system for editing optical character identification result |
| CN101902541A (en) * | 2009-05-26 | 2010-12-01 | 富士施乐株式会社 | Data input system, data input receiving device, data input receiving method and computer readable medium |
| CN102609408A (en) * | 2012-01-11 | 2012-07-25 | 清华大学 | Cross-lingual interpretation method based on multi-lingual document image recognition |
Family Cites Families (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20150006362A1 (en) * | 2013-06-28 | 2015-01-01 | Google Inc. | Extracting card data using card art |
| CN109766778A (en) * | 2018-12-19 | 2019-05-17 | 平安科技（深圳）有限公司 | Invoice information input method, device, equipment and storage medium based on OCR technique |
| CN110598186A (en) * | 2019-07-31 | 2019-12-20 | 浙江口碑网络技术有限公司 | Auxiliary processing method, device and system for image recognition |
-
2019
- 2019-07-31 CN CN201910702681.9A patent/CN110598186A/en active Pending
-
2020
- 2020-02-20 WO PCT/CN2020/076063 patent/WO2021017458A1/en active Application Filing
Patent Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1848109A (en) * | 2005-04-13 | 2006-10-18 | 摩托罗拉公司 | Method and system for editing optical character identification result |
| CN101902541A (en) * | 2009-05-26 | 2010-12-01 | 富士施乐株式会社 | Data input system, data input receiving device, data input receiving method and computer readable medium |
| CN102609408A (en) * | 2012-01-11 | 2012-07-25 | 清华大学 | Cross-lingual interpretation method based on multi-lingual document image recognition |
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2021017458A1 (en) * | 2019-07-31 | 2021-02-04 | 浙江口碑网络技术有限公司 | Auxiliary processing method, device, and system for image recognition |
| CN111967347A (en) * | 2020-07-28 | 2020-11-20 | 北京嘀嘀无限科技发展有限公司 | Data processing method and device, readable storage medium and electronic equipment |
| WO2022022374A1 (en) * | 2020-07-28 | 2022-02-03 | 北京嘀嘀无限科技发展有限公司 | Data processing method and apparatus, readable storage medium, and electronic device |
Also Published As
| Publication number | Publication date |
|---|---|
| WO2021017458A1 (en) | 2021-02-04 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| EP3182684A1 (en) | Intelligent service interaction platform apparatus, system and realizing method thereof | |
| US10452233B2 (en) | Information interactive platform, system and method | |
| CN110598186A (en) | Auxiliary processing method, device and system for image recognition | |
| KR20180072503A (en) | Information processing method, information processing apparatus, terminal and server | |
| KR102002024B1 (en) | Method for processing labeling of object and object management server | |
| CN109815039A (en) | Test method and device, storage medium, the computer equipment of business software | |
| CN107391277A (en) | Information processing method and device | |
| CN111563366A (en) | Document processing method and device and electronic equipment | |
| US20170132462A1 (en) | Document checking support apparatus, document checking support system, and non-transitory computer readable medium | |
| EP3021237A1 (en) | Information processing apparatus, information processing system, and information processing method | |
| CN111046640A (en) | Dynamic generation method and device of certification document | |
| CN112712121B (en) | Image recognition model training method, device and storage medium | |
| US20150348100A1 (en) | Search engine server that searches data based on criteria included in an electronic record received from a computing device | |
| CN109740074B (en) | Method, device and equipment for processing parameter configuration information | |
| US20200065423A1 (en) | System and method for extracting information and retrieving contact information using the same | |
| CN111145143A (en) | Problem image determination method and device, electronic equipment and storage medium | |
| CN113609423B (en) | Task configuration method and device, storage medium and computer equipment | |
| CN109447844A (en) | A kind of management method of electronization test report | |
| JP2017016558A (en) | Information processing device, information processing method, and program | |
| JP6707112B2 (en) | User information input support system | |
| CN114723551A (en) | Data processing method, device and equipment based on multiple data sources and storage medium | |
| CN110443202B (en) | System, method and storage medium for real-time analysis of paper font regularity | |
| JP2017228081A (en) | User information input assistance system | |
| WO2020134710A1 (en) | Generic data acquisition method and apparatus | |
| CN112766254A (en) | Automatic testing method and device for voucher information input |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20191220 |
|
| RJ01 | Rejection of invention patent application after publication |