CN112764599B - Data processing method, device and medium - Google Patents

Data processing method, device and medium Download PDF

Info

Publication number
CN112764599B
CN112764599B CN201911061305.2A CN201911061305A CN112764599B CN 112764599 B CN112764599 B CN 112764599B CN 201911061305 A CN201911061305 A CN 201911061305A CN 112764599 B CN112764599 B CN 112764599B
Authority
CN
China
Prior art keywords
document
picture
area
content
extraction
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN201911061305.2A
Other languages
Chinese (zh)
Other versions
CN112764599A (en
Inventor
陈婷
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Beijing Sogou Technology Development Co Ltd
Original Assignee
Beijing Sogou Technology Development Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Beijing Sogou Technology Development Co Ltd filed Critical Beijing Sogou Technology Development Co Ltd
Priority to CN201911061305.2A priority Critical patent/CN112764599B/en
Publication of CN112764599A publication Critical patent/CN112764599A/en
Application granted granted Critical
Publication of CN112764599B publication Critical patent/CN112764599B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0481—Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F18/00—Pattern recognition
    • G06F18/40—Software arrangements specially adapted for pattern recognition, e.g. user interfaces or toolboxes therefor
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V30/00—Character recognition; Recognising digital ink; Document-oriented image-based pattern recognition
    • G06V30/40—Document-oriented image-based pattern recognition
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F2203/00—Indexing scheme relating to G06F3/00 - G06F3/048
    • G06F2203/048—Indexing scheme relating to G06F3/048
    • G06F2203/04803—Split screen, i.e. subdividing the display area or the window area into separate subareas

Abstract

The embodiment of the invention provides a data processing method, a device and a medium, wherein the method specifically comprises the following steps: displaying a document checking interface; the document verification interface comprises: a picture area and a document area; the picture area is used for carrying out mobile display on picture contents; the document area is used for carrying out mobile display on document contents; updating the picture content in the picture area according to the focus position in the document area; or updating the focus position in the document area according to the picture content in the picture area. The embodiment of the invention can improve the efficiency of document verification.

Description

Data processing method, device and medium
Technical Field
The present invention relates to the field of computer technologies, and in particular, to a data processing method, a data processing apparatus, an apparatus for data processing, and a machine-readable medium.
Background
With the development of computer technology, terminals such as mobile phones and the like are provided with shooting functions, so that users can shoot and store text carriers conveniently for subsequent use. The text carrier may include: such as menus, contracts, documents of documents, or board books, etc.
At present, a terminal such as a mobile phone may process a captured text image, for example, an OCR (Optical Character Recognition) technology may be adopted to obtain text in the text image, obtain a document according to the recognized text and a position of the text in the image, and provide the document to a user, so that the user can view and edit the document.
The inventor finds that in the process of implementing the embodiment of the invention, the user generally needs to check the accuracy of the document content by contrasting the text and the picture. Specifically, the user returns to the picture library to view the corresponding text picture for one document content a, and views the picture part a corresponding to the document content a from the text picture to verify the matching degree between the document content a and the picture part a. The document verification is inefficient because it takes a certain time to verify the document content a at each place.
Disclosure of Invention
Embodiments of the present invention provide a data processing method, a data processing apparatus, an apparatus for data processing, and a machine-readable medium, which can improve efficiency of document verification.
In order to solve the above problem, an embodiment of the present invention discloses a data processing method, including:
displaying a document checking interface; the document checking interface comprises: a picture area and a document area; the picture area is used for carrying out mobile display on picture contents; the document area is used for carrying out mobile display on document contents;
updating the picture content in the picture area according to the focus position in the document area; or updating the focus position in the document area according to the picture content in the picture area.
On the other hand, an embodiment of the present invention discloses a data processing apparatus, including:
the verification interface display module is used for displaying a document verification interface; the document verification interface comprises: a picture area and a document area; the picture area is used for carrying out mobile display on picture contents; the document area is used for carrying out mobile display on document contents;
the updating module is used for updating the picture content in the picture area according to the focus position in the document area; or updating the focus position in the document area according to the picture content in the picture area.
In yet another aspect, an embodiment of the present invention discloses an apparatus for data processing, including a memory, and one or more programs, where the one or more programs are stored in the memory, and configured to be executed by the one or more processors includes instructions for:
displaying a document checking interface; the document verification interface comprises: a picture area and a document area; the picture area is used for carrying out mobile display on picture contents; the document area is used for carrying out mobile display on document contents;
updating the picture content in the picture area according to the focus position in the document area; or updating the focus position in the document area according to the picture content in the picture area.
In yet another aspect, embodiments of the invention disclose one or more machine-readable media having instructions stored thereon, which when executed by one or more processors, cause an apparatus to perform one or more of the data processing methods described above.
The embodiment of the invention has the following advantages:
the document verification interface comprises a picture area and a document area, and the two areas can respectively display corresponding contents in a moving mode. The moving display may mean that the content in the area has a moving characteristic, and may move in response to a moving operation, whereby updating of the visible content in the area may be achieved. The embodiment of the invention can support the user to realize the movement of the content in the area through a scroll bar or a sliding operation mode.
The image content in the image area is updated according to the focus position, so that the updated image content can be matched with the document content corresponding to the focus position, and the image content A corresponding to the document content A can be quickly provided under the condition that a user views the document content A at a certain position, so that the comparison and viewing of the document content and the image content can be facilitated, and the document verification efficiency can be improved.
According to the image content in the image area, the focus position in the document area is updated, and the document content corresponding to the updated focus position can be matched with the image content, so that the document content B corresponding to the image content B can be quickly provided under the condition that a user views the image content B at a certain position, the comparison and viewing of the document content and the image content can be facilitated, and the verification efficiency of the document can be improved.
Drawings
In order to more clearly illustrate the technical solutions of the embodiments of the present invention, the drawings required to be used in the description of the embodiments of the present invention will be briefly introduced below, and it is obvious that the drawings in the description below are only some embodiments of the present invention, and it is obvious for those skilled in the art that other drawings can be obtained according to the drawings without inventive labor.
FIG. 1 is a flow chart of steps of a first embodiment of a data processing method of the present invention;
FIG. 2 is a flow chart of steps of a second embodiment of a data processing method of the present invention;
FIG. 3 is a flowchart illustrating steps of a second embodiment of a data processing method according to the present invention;
FIG. 4 is a flowchart of the third step of a data processing method according to a third embodiment of the present invention;
FIG. 5 is a block diagram of another data processing apparatus embodiment of the present invention;
FIG. 6 is a block diagram of an apparatus 900 for data processing of the present invention; and
fig. 7 is a schematic diagram of a server in some embodiments of the invention.
Detailed Description
The technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are some, not all, embodiments of the present invention. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
For the technical problem of low document verification efficiency in the related art, an embodiment of the present invention provides a data processing scheme, which specifically includes: displaying a document checking interface; the document verification interface comprises: a picture area and a document area; the picture area is used for carrying out mobile display on picture contents; the document area is used for carrying out mobile display on document contents; updating the picture content in the picture area according to the focus position in the document area; or, the focus position in the document area is updated according to the picture content in the picture area.
The document verification interface of the embodiment of the invention is used for verifying the document corresponding to the picture. The document verification interface comprises a picture area and a document area, and the two areas can respectively display the corresponding contents in a moving mode. The moving display may refer to that the content in the area has a moving characteristic and may move in response to a moving operation, whereby updating of the visible content in the area may be achieved. The moving characteristic of the content in the area of the embodiment of the invention also meets the requirement that the area size is smaller than the content size.
The embodiment of the invention can support the user to realize the movement of the content in the area through a scroll bar or a sliding operation mode.
In the embodiment of the invention, the focus position can be used for representing the position of the user operation in the document. The initial focus position may be a default position, such as a start position, or the like. Subsequent focus positions may be updated as user actions are updated. Alternatively, the initial focus may be displayed in response to a call-up operation for the input method program, where the call-up operation may be a click operation for a document area, and the like.
The image content in the image area is updated according to the focus position, so that the updated image content can be matched with the document content corresponding to the focus position, and the image content A corresponding to the document content A can be quickly provided under the condition that a user views the document content A at a certain position, so that the comparison and viewing of the document content and the image content can be facilitated, and the document verification efficiency can be improved.
According to the image content in the image area, the focus position in the document area is updated, and the document content corresponding to the updated focus position can be matched with the image content, so that the document content B corresponding to the image content B can be quickly provided under the condition that a user views the image content B at a certain position, the comparison and viewing of the document content and the image content can be facilitated, and the verification efficiency of the document can be improved.
The embodiment of the invention can be applied to a document extraction scene, and the document extraction scene can extract the document from the picture and verify the extracted document. The document extracted source picture may include: the picture obtained by shooting or the picture obtained by editing the picture obtained by shooting is obtained.
In the embodiment of the present invention, optionally, an OCR (Optical Character Recognition) technique may be used to recognize characters in a picture and obtain a document according to the recognized characters, where the OCR technique examines characters on the picture, determines a shape of the characters by detecting dark and light patterns, and then translates the shape into computer characters by using a Character Recognition method.
The data processing method provided by the embodiment of the invention can be applied to application environments corresponding to the client and the server, wherein the client and the server are positioned in a wired or wireless network, and the client and the server perform data interaction through the wired or wireless network.
Optionally, the client may run on a terminal, and the terminal specifically includes but is not limited to: smart phones, tablet computers, electronic book readers, MP3 (Moving Picture Experts Group Audio Layer III) players, MP4 (Moving Picture Experts Group Audio Layer IV) players, laptop portable computers, car-mounted computers, desktop computers, set-top boxes, smart televisions, wearable devices, and the like.
In the embodiment of the present invention, the client may correspond to any APP (Application). For example, the APP corresponding to the client may include: document extraction APP, input method APP, photographing translation APP and the like.
Method embodiment one
Referring to fig. 1, a flowchart illustrating a first step of a data processing method according to a first embodiment of the present invention is shown, which may specifically include:
step 101, displaying a document checking interface; the document check interface may include: a picture area and a document area; the picture area is used for carrying out mobile display on the picture content; the document area is used for carrying out mobile display on document contents;
102, updating the picture content in the picture area according to the focus position in the document area; alternatively, the first and second electrodes may be,
step 103, updating the focus position in the document area according to the picture content in the picture area.
The embodiment of the method shown in fig. 1 may be executed by a client to improve the efficiency of document verification. It is to be understood that embodiments of the present invention are not limited to the particular implementation of method embodiments.
The embodiment of the present invention does not limit the triggering conditions of step 102 and step 103. For example, step 102 may be performed in the event that the focal position changes. As another example, in the case that the picture content changes, step 103 may be executed.
In step 101, the document check interface may be used to check a document corresponding to the picture.
The embodiment of the invention does not limit the trigger condition corresponding to the displayed document verification interface. For example, the trigger condition corresponding to the displayed document verification interface may include: after the document is extracted, displaying an entry corresponding to the document, wherein the entry can be information such as a thumbnail, and then displaying a document verification interface in response to a trigger operation for the entry.
The document verification interface may include: a picture area and a document area. Optionally, the picture area and the document area are distributed left and right, or the picture area and the document area are distributed up and down. For example, the picture region is located in the upper region, and the document region is located in the lower region, so that the user can edit the document region by referring to the picture region.
In an optional embodiment of the present application, the picture region is suspended above the document region. The document area is positioned in the window at the lower layer, and the picture area is positioned in the floating window at the upper layer, so that a user can conveniently check the document content by referring to the picture content in the floating window.
In the embodiment of the present invention, optionally, the picture area is used for performing mobile display on the picture content of the zoomed picture; the zoomed image can be obtained by zooming the image according to the length or width of the image area.
Since the picture region corresponds to a partial region of the screen, the picture needs to be zoomed, so that the zoomed picture is displayed in the picture region. The embodiment of the invention can zoom the picture according to the length or the width of the picture area. Optionally, scaling the picture may specifically include: length and width are equal in proportion, equal in length, or equal in width, and the like, and it can be understood that the specific process of scaling the picture is not limited in the embodiment of the present invention.
In an optional embodiment of the present invention, the document checking interface may only include: the image area and the document area, that is, the document verification interface may not include other areas except the image area and the document area, so that the areas of the image area and the document area may be increased.
In another optional embodiment of the present invention, in addition to the picture area and the document area, the document verification interface may further include: other areas, such as a title area, may be used to display the title of the document. Alternatively, the title may be extracted from the document based on the location of the text in the document. For example, a title or the like may be extracted from a central position of the beginning of the document.
In the embodiment of the invention, the picture area can display part of the content of the picture, and the document area can display part of the content of the document. The embodiment of the invention can support the user to realize the movement of the content in the picture area or the document area through a scroll bar or a sliding operation mode.
For a document region, the embodiment of the present invention may determine a focus position corresponding to a document according to a user operation. The focus position may be used to characterize where in the document the user operation occurred. The initial focus position may be a default position, such as a start position, or the like. Subsequent focus positions may be updated as user actions are updated. Alternatively, the initial focus may be displayed in response to a call-up operation for the input method program, where the call-up operation may be a click operation for a document area, and the like.
In case the focal position changes, step 102 may be performed.
Step 102, updating the picture content in the picture area according to the focus position in the document area.
In an optional embodiment of the present invention, the updating the picture content in the picture area specifically may include: and determining a target picture position corresponding to the focus position, and updating the picture content in the picture area according to the target picture position. Optionally, the image content corresponding to the target image position may also be marked and displayed to improve the recognition degree of the image content corresponding to the target image position.
Specifically, the target picture position corresponding to the focus position may be determined according to a mapping relationship between a first position corresponding to the document content and a second position corresponding to the picture content, and the picture content in the picture region may be updated according to the target picture position. For example, the target picture position is set to the beginning or middle of the picture region.
The image content in the image area is updated according to the focus position, so that the updated image content can be matched with the document content corresponding to the focus position, and the image content A corresponding to the document content A can be quickly provided under the condition that a user views the document content A at a certain position, so that the comparison and viewing of the document content and the image content can be facilitated, and the document verification efficiency can be improved.
In case the picture content changes, step 103 may be performed.
Step 103 updates the focus position in the document area according to the picture content in the picture area.
In an optional embodiment of the present invention, the updating the focus position in the document area specifically may include: and switching the focus position to a position matched with the picture content, and marking and displaying the document content corresponding to the switched focus position. The above-mentioned marker display may include: highlighting, etc., to improve the identification of the document content corresponding to the switched focal position.
Specifically, the target document position corresponding to the picture content may be determined according to a mapping relationship between a first position corresponding to the document content and a second position corresponding to the picture content, and the focus position may be updated according to the target document position. For example, the target document position is set as the beginning or middle of the document area.
According to the image content in the image area, the focus position in the document area is updated, and the document content corresponding to the updated focus position can be matched with the image content, so that the document content B corresponding to the image content B can be quickly provided under the condition that a user views the image content B at a certain position, the comparison and viewing of the document content and the image content can be facilitated, and the verification efficiency of the document can be improved.
In summary, in the data processing method according to the embodiment of the present invention, the document verification interface includes the picture area and the document area, and the two areas can respectively perform mobile display on the corresponding content. The moving display may refer to that the content in the area has a moving characteristic and may move in response to a moving operation, whereby updating of the visible content in the area may be achieved. The embodiment of the invention can support the user to realize the movement of the content in the area through a scroll bar or a sliding operation mode.
According to the embodiment of the invention, the picture content in the picture area is updated according to the focus position, so that the updated picture content is matched with the document content corresponding to the focus position, and the picture content A corresponding to the document content A can be rapidly provided under the condition that a user views the document content A at a certain position, so that the comparison and viewing of the document content and the picture content can be facilitated, and the document checking efficiency can be further improved.
According to the picture content in the picture area, the focus position in the document area is updated, and the document content corresponding to the updated focus position can be matched with the picture content, so that the document content B corresponding to the picture content B can be quickly provided under the condition that a user views the picture content B at a certain position, the comparison and viewing of the document content and the picture content can be facilitated, and the verification efficiency of the document can be improved.
Method example II
Referring to fig. 2, a flowchart illustrating steps of a second embodiment of a data processing method according to the present invention is shown, which may specifically include:
step 201, detecting characters in a picture;
step 202, determining the size and shape of a selection frame according to the position of characters in the edge area of the picture;
step 203, drawing the selection frame according to the size and the shape of the selection frame;
step 204, displaying a document checking interface; the document verification interface may include: a picture area and a document area; the picture area is used for carrying out mobile display on picture contents; the document area is used for carrying out mobile display on document contents;
step 205, updating the picture content in the picture area according to the focus position in the document area; alternatively, the first and second electrodes may be,
step 206, updating the focus position in the document area according to the picture content in the picture area.
Compared with the first embodiment of the method shown in fig. 1, in this embodiment, step 201 to step 203 are added, and step 201 to step 203 may provide a picture for document extraction to obtain the document in step 204.
The steps 201 to 203 may be configured to provide a corresponding frame for the picture, and since the size and the shape of the frame may be obtained according to the position of the characters in the edge area of the picture, the frame may function as a boundary of the document and determine the range of the document, so that the frame may help the user edit the picture, and the picture editing efficiency is improved.
In the related art, after the picture is taken, a selection box (hereinafter referred to as a conventional selection box) may also be provided for the user to adjust. The size and shape of the conventional frame is generally fixed, for example, the conventional frame is rectangular in shape, the distance between the conventional frame and the picture boundary is generally a fixed distance, and the like. With conventional techniques, a user typically needs to manually adjust a conventional box to determine the extent of the document in the picture, thereby enabling editing of the picture. The manual adjustment of the conventional selection box usually requires a certain operation cost, so that the editing efficiency of the picture is low.
The embodiment of the invention can intelligently determine the size and the shape of the frame according to the position of the characters in the edge area of the picture. The size and shape of the bezel may be different for different pictures. The user can edit the picture directly according to the frame, and the adjustment operation of the frame can be saved, so that the picture editing efficiency can be improved.
The selection frame of the embodiment of the invention can be used as a basis for editing the picture, and the edited picture can be used as a source picture extracted from the document. The process of editing the picture according to the selection box may include: and selecting the picture in the frame as the edited picture. The embodiment of the invention can provide the selection frame, and if the user does not adjust the selection frame, the picture is directly edited according to the frame; or if the user adjusts the selection frame, editing the picture according to the adjusted frame. Because the frame of the embodiment of the invention is obtained according to the position of the characters in the edge area of the picture, the accuracy of the frame is higher, namely the matching degree of the frame and the document is higher, the adjustment operation of the frame can be saved, and the editing efficiency of the picture can be improved.
Method embodiment three
Referring to fig. 3, a flowchart illustrating a third step of the data processing method according to the third embodiment of the present invention is shown, which may specifically include:
step 301, determining a plurality of pictures selected by a user;
step 302, in the process of extracting the document, displaying the processing states of the plurality of pictures respectively;
the processing state specifically includes at least one of the following states:
waiting for an extraction state, an extraction in-process state, an extraction success state and an extraction failure state;
step 303, displaying a document checking interface; the document verification interface may include: a picture area and a document area; the picture area is used for carrying out mobile display on picture contents; the document area is used for carrying out mobile display on document contents;
step 304, updating the picture content in the picture area according to the focus position in the document area; alternatively, the first and second liquid crystal display panels may be,
step 305, updating the focus position in the document area according to the picture content in the picture area.
Compared with the first method embodiment of fig. 1, in this embodiment, steps 301 to 302 are added, the document in step 303 can be obtained by document extraction in steps 301 to 302, and the pictures in steps 301 to 302 can be the pictures in step 303.
Steps 301 to 302 may be used to respectively display the processing status of the plurality of pictures during the document extraction process.
The embodiment of the invention can provide four processing states. The process of changing the processing state of a picture may include: wait for fetch status → fetch in status → fetch success status. Alternatively, the process of changing the processing state of a picture may include: wait for fetch status → fetch in status → fetch failed status → wait for fetch status → fetch in status → fetch successful status,
in the document extraction process, the processing states of the multiple pictures can be dynamically displayed according to the change process, so that a user can know the processing states or the processing progress of the multiple pictures.
In this embodiment of the present invention, optionally, waiting for the display information corresponding to the extraction state may specifically include: the text and icon, and the picture corresponding to "waiting for extraction" are displayed. Wherein the text and icon corresponding to "waiting for extraction" can be located on the picture. Optionally, transparency increasing processing may be performed on the picture to increase the blur degree of the picture. Optionally, the picture may be blurred to increase the blur degree of the picture. Under the condition of increasing the ambiguity of the picture, the identification degree of the text and the icon corresponding to the 'waiting for extraction' can be improved.
In this embodiment of the present invention, optionally, the extracting the display information corresponding to the middle state may specifically include: the corresponding text and animation "under extraction".
In this embodiment of the present invention, optionally, the extracting the display information corresponding to the success status may specifically include: and extracting the page screenshot corresponding to the obtained document.
In this embodiment of the present invention, optionally, the extracting the display information corresponding to the failure state may specifically include: text and icons corresponding to "extraction failure", and a retry control. If the trigger operation for the retry control is received, document extraction can be performed again for the picture, namely, the document is extracted again from the picture, and then a waiting extraction state can be returned.
In an optional embodiment of the present invention, the method may further include: and displaying the information of the documents corresponding to the pictures according to the shooting sequence corresponding to the pictures when the processing states of the pictures are the extraction success states. For example, the priority of display may be: from left to right and top to bottom, assume that the corresponding numbers of the multiple pictures are: 1. 2, 3, …, assuming each row carries thumbnails for 3 pictures, it is possible to present the thumbnails numbered 1, 2, 3 in sequence first in the first row and then in the second row the subsequent thumbnails.
Method example four
Referring to fig. 4, a flowchart illustrating steps of a third embodiment of a data processing method according to the present invention is shown, which specifically may include:
step 401, after a picture is shot, displaying a continuous shooting control and a shooting ending control;
step 402, displaying a document checking interface; the document check interface may include: a picture area and a document area; the picture area is used for carrying out mobile display on picture contents; the document area is used for carrying out mobile display on document contents;
step 403, updating the picture content in the picture area according to the focus position in the document area; alternatively, the first and second liquid crystal display panels may be,
step 404, updating the focus position in the document area according to the picture content in the picture area.
Compared with the first method embodiment shown in fig. 1, in this embodiment, step 401 is added, after a picture is taken in step 401, the continuous shooting control and the shooting ending control are displayed, the continuous shooting control can realize the continuous shooting of the picture, the shooting ending control can end the shooting of the picture, so as to enter the next link of taking the picture, and the next link of taking the picture can be: and previewing the shot picture and the like. Step 401 may provide a plurality of pictures for batch document extraction, and then a plurality of documents may be obtained through batch document extraction. The document in step 402 may be any of a number of documents.
In this embodiment of the present invention, optionally, the method may further include: and responding to the triggering operation aiming at the shooting ending control, and displaying at least one shot picture and the batch processing control. Batch processing controls may be used to trigger batch document extraction.
In summary, the data processing method according to the embodiment of the present invention can implement continuous shooting of the picture by the continuous shooting control, so that the embodiment of the present invention can implement continuous shooting of the picture, and further implement batch document extraction, that is, can improve the efficiency of document extraction.
In order to make those skilled in the art better understand the embodiments of the present invention, the data processing method of the embodiments of the present invention is described herein by using a specific example, which specifically includes the following steps:
s1, providing a shooting control on a document extraction interface, and shooting a picture in response to a trigger operation aiming at the shooting control;
s2, after a picture is shot, entering a picture editing interface, wherein the picture editing interface comprises the following steps: selecting a frame, wherein the size and the shape of the selecting frame can be obtained according to the position of characters in the edge area of the picture;
through the embodiment of the invention, the contents containing the characters in the picture are all defined in the selection frame. Optionally, the embodiment of the present invention may also zoom the picture according to the frame selection condition. The user may manually adjust the checkbox to crop the picture to determine the extent of the document. Of course, if the user does not adjust the frame, the user directly edits the picture according to the frame.
The picture editing interface can further comprise: continuing to shoot the control and ending to shoot the control, and if a trigger control for the continuous shooting control is received, returning to the step S1; and if the trigger operation for finishing the shooting control is received, executing the step S3.
And S3, displaying a picture preview interface. The picture preview interface comprises the following steps: and extracting the shot pictures in the task from the document.
Optionally, the plurality of pictures may be displayed in a sequential order according to the shooting order. For example, arranged from left to right, the first shot is placed first and numbered: and (4) the X sheet.
And zooming and displaying the picture according to the condition that the picture is shot and cut by the user in the picture preview interface. If the long image and the wide image are encountered, the long image can be zoomed in an equal length mode according to the preset size, or the wide image can be zoomed in an equal width mode according to the preset size, and the pictures can be displayed completely through the equal length zooming or the equal width zooming. The preset size may be obtained according to a display area of a picture, and it should be understood that the specific preset size is not limited in the embodiment of the present invention.
And a picture deleting control, a picture adding control or a batch extracting control can be provided in the picture preview interface. And the picture deleting control is used for deleting the picture. The picture adding control is used for triggering the shooting of the picture or the adding of the shot picture. And the batch extraction control is used for triggering batch document extraction of a plurality of pictures.
And S4, responding to the batch extraction control, entering a batch extraction document interface, wherein the batch extraction document interface comprises the processing states of a plurality of pictures.
The embodiment of the invention can adopt multithreading to extract the documents of a plurality of pictures, and the document extraction of the plurality of pictures can be executed in parallel through the multithreading.
The processing state specifically includes at least one of the following states:
waiting for an extraction state, an extraction in-process state, an extraction success state and an extraction failure state;
and S5, displaying the information of the documents corresponding to the pictures according to the shooting sequence corresponding to the pictures under the condition that the processing states of the pictures are the extraction success states.
The information of the document may include: thumbnail, document size, document number, etc.
Optionally, an operation control corresponding to the document may be displayed, such as a save control, a copy control, a share control, and the like. The save control can be used to save the document as a file with picture/PDF/TXT/DOCX format, etc.
S6, responding to the trigger operation corresponding to the document in the S5, and displaying a first document verification interface;
the top of the first document checking interface is provided with a title area, the upper part of the first document checking interface is provided with a picture area, the lower part of the first document checking interface is provided with a document area, and a user can respectively check more contents in the upper area and the lower area in a sliding mode.
And if the picture area of the first document verification interface is provided with a closing control, receiving a triggering operation aiming at the closing control, and entering a second document verification interface. And if the triggering operation aiming at the document area is received, entering a third document correction interface.
And S7, displaying a document in the middle area of the second document verification interface, displaying a thumbnail of a picture corresponding to the document at the upper right corner, and displaying a switching control on the second document verification interface, wherein the switching control is used for sliding switching of different documents.
And S8, setting a picture area at the upper part of the second document verification interface, setting a document area at the lower part of the second document verification interface, hiding the title area and reserving a display space for the picture area and the document area.
And calling a keyboard of an input method program in a document area in the second document verification interface, and displaying the focus position in the document area.
Optionally, updating the picture content in the picture area according to the focus position in the document area; for example, the position in the picture corresponding to the text corresponding to the focus position is identified in the picture area.
Optionally, the focus position in the document area is updated according to the picture content in the picture area.
It should be noted that, for simplicity of description, the method embodiments are described as a series of motion combinations, but those skilled in the art should understand that the present invention is not limited by the described motion sequences, because some steps may be performed in other sequences or simultaneously according to the present invention. Further, those skilled in the art will appreciate that the embodiments described in the specification are presently preferred and that no moving act is required as an embodiment of the invention.
Device embodiment
Referring to fig. 5, a block diagram of a data processing apparatus according to an embodiment of the present invention is shown, which may specifically include:
a verification interface display module 501, configured to display a document verification interface; the document verification interface may include: a picture area and a document area; the picture area is used for carrying out mobile display on picture contents; the document area is used for carrying out mobile display on document contents;
an updating module 502, configured to update the picture content in the picture area according to the focal position in the document area; or, the focus position in the document area is updated according to the picture content in the picture area.
Optionally, the picture area and the document area are distributed left and right, or the picture area and the document area are distributed up and down, or the picture area is suspended above the document area.
Optionally, the updating module 502 may include:
and the first updating module is used for switching the focus position to a position matched with the picture content and marking and displaying the document content corresponding to the switched focus position.
Optionally, the update module may include:
and the second updating module is used for determining the position of the target picture corresponding to the focus position and updating the picture content in the picture area according to the position of the target picture.
Optionally, the picture area is used for performing mobile display on the picture content of the zoomed picture; the zooming picture is obtained by zooming the picture according to the length or the width of the picture area.
Optionally, the apparatus may further include:
the character detection module is used for detecting characters in the picture;
the frame selection information determining module is used for determining the size and the shape of a frame according to the position of characters in the edge area of the picture;
and the frame drawing module is used for drawing the selection frame according to the size and the shape of the selection frame.
Optionally, the apparatus may further include:
the multi-picture determining module is used for determining a plurality of pictures selected by a user;
the processing state display module is used for respectively displaying the processing states of the pictures in the document extraction process;
the processing state may include at least one of the following states:
waiting for an extraction status, an extraction in progress status, an extraction success status, and an extraction failure status.
Optionally, the apparatus may further include:
and the document information display module is used for displaying the information of the documents corresponding to the pictures according to the shooting sequence corresponding to the pictures under the condition that the processing states of the pictures are all extraction success states.
Optionally, the apparatus may further include:
the first control display module is used for displaying the continuous shooting control and the shooting ending control after a picture is shot;
and the second control display module is used for responding to the triggering operation aiming at the shooting ending control, and displaying at least one shot picture and the batch processing control.
For the device embodiment, since it is basically similar to the method embodiment, the description is simple, and for the relevant points, refer to the partial description of the method embodiment.
The embodiments in the present specification are described in a progressive manner, each embodiment focuses on differences from other embodiments, and the same and similar parts among the embodiments are referred to each other.
With regard to the apparatus in the above-described embodiment, the specific manner in which each module performs the operation has been described in detail in the embodiment related to the method, and will not be elaborated here.
An embodiment of the present invention also provides an apparatus for data processing, comprising a memory, and one or more programs, wherein the one or more programs are stored in the memory, and the one or more programs are configured to be executed by the one or more processors and include instructions for: displaying a document checking interface; the document verification interface comprises: a picture area and a document area; the picture area is used for carrying out mobile display on picture contents; the document area is used for carrying out mobile display on document contents; updating the picture content in the picture area according to the focus position in the document area; or updating the focus position in the document area according to the picture content in the picture area.
Fig. 5 is a block diagram illustrating a structure of an apparatus 900 for data processing as a terminal according to an exemplary embodiment. For example, the apparatus 900 may be a mobile phone, a computer, a digital broadcast terminal, a messaging device, a game console, a tablet device, a medical device, an exercise device, a personal digital assistant, and the like.
Referring to fig. 5, apparatus 900 may include one or more of the following components: processing component 902, memory 904, power component 906, multimedia component 908, audio component 910, input/output (I/O) interface 912, sensor component 914, and communication component 916.
The processing component 902 generally controls overall operation of the device 900, such as operations associated with display, telephone calls, data communications, camera operations, and recording operations. Processing element 902 may include one or more processors 920 to execute instructions to perform all or a portion of the steps of the methods described above. Further, processing component 902 can include one or more modules that facilitate interaction between processing component 902 and other components. For example, the processing component 902 can include a multimedia module to facilitate interaction between the multimedia component 908 and the processing component 902.
The memory 904 is configured to store various types of data to support operation at the device 900. Examples of such data include instructions for any application or method operating on device 900, contact data, phonebook data, messages, pictures, videos, and so forth. The memory 904 may be implemented by any type or combination of volatile or non-volatile memory devices such as Static Random Access Memory (SRAM), electrically erasable programmable read-only memory (EEPROM), erasable programmable read-only memory (EPROM), programmable read-only memory (PROM), read-only memory (ROM), magnetic memory, flash memory, magnetic or optical disks.
The power supply component 906 provides power to the various components of the device 900. The power components 906 may include a power management system, one or more power supplies, and other components associated with generating, managing, and distributing power for the device 900.
The multimedia component 908 comprises a screen providing an output interface between the device 900 and a user. In some embodiments, the screen may include a Liquid Crystal Display (LCD) and a Touch Panel (TP). If the screen includes a touch panel, the screen may be implemented as a touch screen to receive an input signal from a user. The touch panel includes one or more touch sensors to sense touch, slide, and gestures on the touch panel. The touch sensor may not only sense the boundary of a touch or slide action, but also detect the duration and pressure associated with the touch or slide operation. In some embodiments, the multimedia component 908 includes a front facing camera and/or a rear facing camera. The front-facing camera and/or the rear-facing camera may receive external multimedia data when the device 900 is in an operating mode, such as a shooting mode or a video mode. Each front camera and rear camera may be a fixed optical lens system or have a focal length and optical zoom capability.
The audio component 910 is configured to output and/or input audio signals. For example, audio component 910 includes a Microphone (MIC) configured to receive external audio signals when apparatus 900 is in an operating mode, such as a call mode, a recording mode, and a voice recognition mode. The received audio signals may further be stored in the memory 904 or transmitted via the communication component 916. In some embodiments, audio component 910 further includes a speaker for outputting audio signals.
I/O interface 912 provides an interface between processing component 902 and peripheral interface modules, which may be keyboards, click wheels, buttons, etc. These buttons may include, but are not limited to: a home button, a volume button, a start button, and a lock button.
The sensor component 914 includes one or more sensors for providing status assessment of various aspects of the apparatus 900. For example, the sensor assembly 914 may detect an open/closed state of the device 900, the relative positioning of the components, such as a display and keypad of the apparatus 900, the sensor assembly 914 may also detect a change in the position of the apparatus 900 or a component of the apparatus 900, the presence or absence of user contact with the apparatus 900, orientation or acceleration/deceleration of the apparatus 900, and a change in the temperature of the apparatus 900. The sensor assembly 914 may include a proximity sensor configured to detect the presence of a nearby object in the absence of any physical contact. The sensor assembly 914 may also include a light sensor, such as a CMOS or CCD image sensor, for use in imaging applications. In some embodiments, the sensor assembly 914 may also include an acceleration sensor, a gyroscope sensor, a magnetic sensor, a pressure sensor, or a temperature sensor.
The communication component 916 is configured to facilitate communications between the apparatus 900 and other devices in a wired or wireless manner. The apparatus 900 may access a wireless network based on a communication standard, such as WiFi,2G or 3G, or a combination thereof. In an exemplary embodiment, the communication component 916 receives a broadcast signal or broadcast associated information from an external broadcast management system via a broadcast channel. In an exemplary embodiment, the communication component 916 further includes a Near Field Communication (NFC) module to facilitate short-range communications. For example, the NFC module may be implemented based on Radio Frequency Identification (RFID) technology, infrared data association (IrDA) technology, ultra Wideband (UWB) technology, bluetooth (BT) technology, and other technologies.
In an exemplary embodiment, the apparatus 900 may be implemented by one or more Application Specific Integrated Circuits (ASICs), digital Signal Processors (DSPs), digital Signal Processing Devices (DSPDs), programmable Logic Devices (PLDs), field Programmable Gate Arrays (FPGAs), controllers, micro-controllers, microprocessors or other electronic components for performing the above-described methods.
In an exemplary embodiment, a non-transitory computer readable storage medium comprising instructions, such as the memory 904 comprising instructions, executable by the processor 920 of the apparatus 900 to perform the above-described method is also provided. For example, the non-transitory computer readable storage medium may be a ROM, a Random Access Memory (RAM), a CD-ROM, a magnetic tape, a floppy disk, an optical data storage device, and the like.
Fig. 6 is a schematic diagram of a server in some embodiments of the invention. The server 1900, which may vary considerably in configuration or performance, may include one or more Central Processing Units (CPUs) 1922 (e.g., one or more processors) and memory 1932, one or more storage media 1930 (e.g., one or more mass storage devices) storing applications 1942 or data 1944. Memory 1932 and storage medium 1930 can be, among other things, transient or persistent storage. The program stored in the storage medium 1930 may include one or more modules (not shown), each of which may include a series of instructions operating on a server. Still further, a central processor 1922 may be provided in communication with the storage medium 1930 to execute a series of instruction operations in the storage medium 1930 on the server 1900.
The server 1900 may also include one or more power supplies 1926, one or more wired or wireless network interfaces 1950, one or more input-output interfaces 1958, one or more keyboards 1956, and/or one or more operating systems 1941, such as Windows Server, mac OS XTM, unixTM, linuxTM, freeBSDTM, etc.
A non-transitory computer readable storage medium in which instructions, when executed by a processor of an apparatus (terminal or server), enable the apparatus to perform a data processing method, the method comprising: displaying a document checking interface; the document verification interface comprises: a picture area and a document area; the picture area is used for carrying out mobile display on picture contents; the document area is used for carrying out mobile display on document contents; updating the picture content in the picture area according to the focus position in the document area; or updating the focus position in the document area according to the picture content in the picture area.
The embodiment of the invention discloses A1 and a data processing method, which comprises the following steps:
displaying a document checking interface; the document checking interface comprises: a picture area and a document area; the picture area is used for carrying out mobile display on picture contents; the document area is used for carrying out mobile display on document contents;
updating the picture content in the picture area according to the focus position in the document area; or updating the focus position in the document area according to the picture content in the picture area.
A2, according to the method of A1, the picture area and the document area are distributed left and right, or the picture area and the document area are distributed up and down, or the picture area is suspended above the document area.
A3, according to the method in A1, the updating the focus position in the document area includes:
and switching the focus position to a position matched with the picture content, and marking and displaying the document content corresponding to the switched focus position.
A4, according to the method in A1, the updating the picture content in the picture area includes:
and determining a target picture position corresponding to the focus position, and updating the picture content in the picture area according to the target picture position.
A5, according to the method of A1, the picture area is used for movably displaying the picture content of the zoom picture; and the zooming picture is obtained by zooming the picture according to the length or the width of the picture area.
A6, the method of A1, further comprising:
detecting characters in the picture;
determining the size and shape of a selection frame according to the position of characters in the edge area of the picture;
and drawing the selection frame according to the size and the shape of the selection frame.
A7, the method of any one of A1 to A6, further comprising:
determining a plurality of pictures selected by a user;
in the document extraction process, respectively displaying the processing states of the plurality of pictures;
the processing state includes at least one of:
waiting for an extraction status, an extraction in progress status, an extraction success status, and an extraction failure status.
A8, the method of A7, further comprising:
and displaying the information of the documents corresponding to the pictures according to the shooting sequence corresponding to the pictures under the condition that the processing states of the pictures are the extraction success states.
A9, the method of any one of A1 to A6, further comprising:
after a picture is shot, the continuous shooting control and the shooting ending control are displayed;
and responding to the triggering operation aiming at the shooting ending control, and displaying at least one shot picture and the batch processing control.
The embodiment of the invention discloses a B10 and a data processing device, wherein the device comprises:
the verification interface display module is used for displaying a document verification interface; the document verification interface comprises: a picture area and a document area; the picture area is used for carrying out mobile display on picture contents; the document area is used for carrying out mobile display on document contents;
the updating module is used for updating the picture content in the picture area according to the focus position in the document area; or updating the focus position in the document area according to the picture content in the picture area.
B11, according to the device of B10, the picture area and the document area are distributed left and right, or the picture area and the document area are distributed up and down, or the picture area is suspended above the document area.
B12, according to the apparatus of B10, the update module includes:
and the first updating module is used for switching the focus position to a position matched with the picture content and marking and displaying the document content corresponding to the switched focus position.
B13, according to the apparatus of B10, the update module includes:
and the second updating module is used for determining the position of the target picture corresponding to the focus position and updating the picture content in the picture area according to the position of the target picture.
B14, according to the device of B10, the picture area is used for movably displaying the picture content of the zoom picture; and the zooming picture is obtained by zooming the picture according to the length or the width of the picture area.
B15, the device according to B10, further comprising:
the character detection module is used for detecting characters in the picture;
the frame selection information determining module is used for determining the size and the shape of a frame according to the position of characters in the edge area of the picture;
and the frame drawing module is used for drawing the selection frame according to the size and the shape of the selection frame.
B16, the apparatus according to any of B10 to B15, further comprising:
the multi-picture determining module is used for determining a plurality of pictures selected by a user;
the processing state display module is used for respectively displaying the processing states of the pictures in the document extraction process;
the processing state includes at least one of:
waiting for an extraction status, an extraction in progress status, an extraction success status, and an extraction failure status.
B17, the apparatus according to B16, further comprising:
and the document information display module is used for displaying the information of the documents corresponding to the pictures according to the shooting sequence corresponding to the pictures under the condition that the processing states of the pictures are extraction success states.
B18, the apparatus according to any of B10 to B15, further comprising:
the first control display module is used for displaying the continuous shooting control and the shooting ending control after a picture is shot;
and the second control display module is used for responding to the trigger operation aiming at the shooting ending control, and displaying the shot at least one picture and the batch processing control.
The embodiment of the invention discloses C19, a device for data processing, comprising a memory and one or more programs, wherein the one or more programs are stored in the memory, and the one or more programs are configured to be executed by the one or more processors and comprise instructions for:
displaying a document checking interface; the document verification interface comprises: a picture area and a document area; the picture area is used for carrying out mobile display on picture contents; the document area is used for carrying out mobile display on document contents;
updating the picture content in the picture area according to the focus position in the document area; or updating the focus position in the document area according to the picture content in the picture area.
And C20, according to the device of C19, the picture area and the document area are distributed left and right, or the picture area and the document area are distributed up and down, or the picture area is suspended above the document area.
C21, the apparatus of C19, the updating the focus position in the document region, comprising:
and switching the focus position to a position matched with the picture content, and marking and displaying the document content corresponding to the switched focus position.
C22, according to the apparatus in C19, the updating the picture content in the picture area includes:
and determining a target picture position corresponding to the focus position, and updating the picture content in the picture area according to the target picture position.
C23, according to the device of C19, the picture area is used for carrying out mobile display on the picture content of the zoom picture; and the zooming picture is obtained by zooming the picture according to the length or the width of the picture area.
C24, the device of C19, the device also configured to execute the one or more programs by the one or more processors including instructions for:
detecting characters in the picture;
determining the size and shape of a selection frame according to the position of characters in the edge area of the picture;
and drawing the selection frame according to the size and the shape of the selection frame.
C25, the device of any of C19-C24, the device further configured to execute the one or more programs by the one or more processors including instructions for:
determining a plurality of pictures selected by a user;
in the document extraction process, respectively displaying the processing states of the plurality of pictures;
the processing state includes at least one of:
waiting for an extraction status, an extraction in progress status, an extraction success status, and an extraction failure status.
C26, the apparatus of C25, further comprising:
and displaying the information of the documents corresponding to the pictures according to the shooting sequence corresponding to the pictures under the condition that the processing states of the pictures are the extraction success states.
C27, the device of any of C19-C24, the device also configured to execute the one or more programs by the one or more processors including instructions for:
after a picture is shot, the continuous shooting control and the shooting ending control are displayed;
and responding to the triggering operation aiming at the shooting ending control, and displaying at least one shot picture and the batch processing control.
Embodiments of the present invention disclose D28, one or more machine readable media having instructions stored thereon that, when executed by one or more processors, cause an apparatus to perform a data processing method as described in one or more of A1 through A9.
Other embodiments of the invention will be apparent to those skilled in the art from consideration of the specification and practice of the invention disclosed herein. The invention is intended to cover any variations, uses, or adaptations of the invention following, in general, the principles of the invention and including such departures from the present disclosure as come within known or customary practice within the art to which the invention pertains. It is intended that the specification and examples be considered as exemplary only, with a true scope and spirit of the invention being indicated by the following claims.
It will be understood that the invention is not limited to the precise arrangements described above and shown in the drawings and that various modifications and changes may be made without departing from the scope thereof. The scope of the invention is limited only by the appended claims.
The above description is only for the purpose of illustrating the preferred embodiments of the present invention and should not be taken as limiting the scope of the present invention, which is intended to cover any modifications, equivalents, improvements, etc. within the spirit and scope of the present invention.
The data processing method, the data processing apparatus, and the machine-readable medium provided by the present invention have been described in detail, and specific examples are used herein to explain the principles and embodiments of the present invention, and the descriptions of the above examples are only used to help understand the method and the core idea of the present invention; meanwhile, for a person skilled in the art, according to the idea of the present invention, there may be variations in the specific embodiments and the application scope, and in summary, the content of the present specification should not be construed as a limitation to the present invention.

Claims (15)

1. A data processing method is applied to a document extraction scene, wherein the document extraction scene extracts a document from a picture and verifies the extracted document, and the method comprises the following steps:
responding to a batch extraction control, and entering a batch extraction document interface, wherein the batch extraction document interface comprises the processing states of a plurality of pictures;
under the condition that the processing states of the pictures are extraction success states, displaying information of the documents corresponding to the pictures according to the shooting sequence corresponding to the pictures;
responding to the triggering operation aiming at the entrance, and displaying a document checking interface; the document verification interface comprises: the entrance is an entrance corresponding to the displayed document after the document is extracted; the picture area is used for carrying out mobile display on picture contents; the document area is used for carrying out mobile display on document contents;
updating the picture content in the picture area according to a focus position in the document area, wherein the focus position represents a position where a user operation occurs in the document, and the updating the picture content in the picture area comprises: determining a target picture position corresponding to the focus position according to a mapping relation between a first position corresponding to the document content and a second position corresponding to the picture content, and updating the picture content in the picture area according to the target picture position, wherein the target picture position is used as the start or middle position of the picture area;
or, updating the focus position in the document area according to the picture content in the picture area, wherein the updating the focus position in the document area includes: determining a target document position corresponding to the picture content according to a mapping relation between a first position corresponding to the document content and a second position corresponding to the picture content, and updating the focus position according to the target document position, wherein the target document position is used as the beginning or middle position of a document area;
the document verification interface is displayed, and comprises: a picture region and a document region, including: responding to the triggering operation of the document, and displaying a first document checking interface;
a title area is arranged at the top of the first document checking interface, a picture area is arranged at the upper part of the first document checking interface, and a document area is arranged at the lower part of the first document checking interface;
a closing control is arranged in a picture area of the first document verification interface, and if a triggering operation aiming at the closing control is received, a second document verification interface is entered; if the triggering operation aiming at the document area is received, entering a third document correction interface area;
a document is displayed in the middle area of the second document verification interface, a thumbnail of a picture corresponding to the document is displayed on the upper right side of the second document verification interface, and the second document verification interface is provided with a switching control which is used for sliding switching of different documents;
the upper part of the second document verification interface is provided with a picture area, the lower part of the second document verification interface is provided with a document area, and the second document verification interface is provided with a title area hiding control.
2. The method according to claim 1, wherein the picture area and the document area are distributed left and right, or the picture area and the document area are distributed up and down, or the picture area is suspended above the document area.
3. The method of claim 1, wherein the picture region is used for mobile display of picture content of a zoomed picture; and the zooming picture is obtained by zooming the picture according to the length or the width of the picture area.
4. The method of claim 1, further comprising:
detecting characters in the picture;
determining the size and shape of a selection frame according to the position of characters in the edge area of the picture;
and drawing the selection frame according to the size and the shape of the selection frame.
5. The method according to any one of claims 1 to 4, further comprising:
determining a plurality of pictures selected by a user;
in the document extraction process, respectively displaying the processing states of the plurality of pictures;
the processing state includes at least one of:
waiting for an extraction status, an extraction in progress status, an extraction success status, and an extraction failure status.
6. The method according to any one of claims 1 to 4, further comprising:
after a picture is shot, the continuous shooting control and the shooting ending control are displayed;
and responding to the triggering operation aiming at the shooting ending control, and displaying at least one shot picture and the batch processing control.
7. A data processing apparatus, applied to a document extraction scenario that extracts a document from a picture and verifies the extracted document, the apparatus comprising:
the verification interface display module is used for responding to the batch extraction control and entering a batch extraction document interface, and the batch extraction document interface comprises the processing states of a plurality of pictures; under the condition that the processing states of the pictures are extraction success states, displaying information of the documents corresponding to the pictures according to the shooting sequence corresponding to the pictures; responding to a triggering operation aiming at an entrance, and displaying a document verification interface, wherein the entrance is an entrance corresponding to a displayed document after the document is extracted; the document verification interface comprises: a picture area and a document area; the picture area is used for carrying out mobile display on picture contents; the document area is used for carrying out mobile display on document contents; responding to the triggering operation of the document, and displaying a first document checking interface; a title area is arranged at the top of the first document checking interface, a picture area is arranged at the upper part of the first document checking interface, and a document area is arranged at the lower part of the first document checking interface; a closing control is arranged in a picture area of the first document verification interface, and if a triggering operation aiming at the closing control is received, a second document verification interface is entered; if receiving a trigger operation aiming at the document area, entering a third document school interface area; a document is displayed in the middle area of the second document verification interface, a thumbnail of a picture corresponding to the document is displayed on the upper right side of the second document verification interface, and the second document verification interface is provided with a switching control which is used for sliding switching of different documents; a picture area is arranged at the upper part of the second document verification interface, a document area is arranged at the lower part of the second document verification interface, and a title area hiding control is arranged on the second document verification interface;
an updating module, configured to update picture content in the picture area according to a focus position in the document area, where the focus position represents a position in the document where a user operation occurs, where the updating of the picture content in the picture area includes: determining a target picture position corresponding to the focus position according to a mapping relation between a first position corresponding to the document content and a second position corresponding to the picture content, and updating the picture content in the picture area according to the target picture position, wherein the target picture position is used as the start or middle position of the picture area; or, updating the focus position in the document area according to the picture content in the picture area, wherein the updating the focus position in the document area includes: determining a target document position corresponding to the picture content according to a mapping relation between a first position corresponding to the document content and a second position corresponding to the picture content, and updating the focus position according to the target document position, wherein the target document position is used as the beginning or middle position of a document area.
8. The apparatus according to claim 7, wherein the picture region and the document region are distributed left and right, or the picture region and the document region are distributed up and down, or the picture region is suspended above the document region.
9. The apparatus of claim 7, wherein the picture area is used for mobile display of picture content of the zoomed picture; and the zooming picture is obtained by zooming the picture according to the length or the width of the picture area.
10. The apparatus of claim 7, further comprising:
the character detection module is used for detecting characters in the picture;
the frame selection information determining module is used for determining the size and the shape of a frame according to the position of characters in the edge area of the picture;
and the frame drawing module is used for drawing the selection frame according to the size and the shape of the selection frame.
11. The apparatus of any of claims 7 to 10, further comprising:
the multi-picture determining module is used for determining a plurality of pictures selected by a user;
the processing state display module is used for respectively displaying the processing states of the pictures in the document extraction process;
the processing state includes at least one of:
waiting for an extraction status, an extraction in progress status, an extraction success status, and an extraction failure status.
12. The apparatus of claim 11, further comprising:
and the document information display module is used for displaying the information of the documents corresponding to the pictures according to the shooting sequence corresponding to the pictures under the condition that the processing states of the pictures are extraction success states.
13. The apparatus of any one of claims 7 to 10, further comprising:
the first control display module is used for displaying the continuous shooting control and the shooting ending control after a picture is shot;
and the second control display module is used for responding to the triggering operation aiming at the shooting ending control, and displaying at least one shot picture and the batch processing control.
14. An apparatus for data processing, comprising a memory and one or more programs, wherein the one or more programs are stored in the memory and when executed by the one or more processors, perform the steps of the method according to any one of claims 1 to 6.
15. One or more machine readable media having instructions stored thereon that, when executed by one or more processors, cause an apparatus to perform the data processing method of any of claims 1-6.
CN201911061305.2A 2019-11-01 2019-11-01 Data processing method, device and medium Active CN112764599B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201911061305.2A CN112764599B (en) 2019-11-01 2019-11-01 Data processing method, device and medium

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201911061305.2A CN112764599B (en) 2019-11-01 2019-11-01 Data processing method, device and medium

Publications (2)

Publication Number Publication Date
CN112764599A CN112764599A (en) 2021-05-07
CN112764599B true CN112764599B (en) 2023-03-10

Family

ID=75692021

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201911061305.2A Active CN112764599B (en) 2019-11-01 2019-11-01 Data processing method, device and medium

Country Status (1)

Country Link
CN (1) CN112764599B (en)

Citations (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103412711A (en) * 2013-08-27 2013-11-27 宇龙计算机通信科技(深圳)有限公司 Document comparison reference method and device
CN104679723A (en) * 2013-11-29 2015-06-03 北京壹人壹本信息科技有限公司 Text contrast display method, system and device
CN106383643A (en) * 2016-09-18 2017-02-08 浙江慧脑信息科技有限公司 Method for browsing picture and text at the same time
CN107315781A (en) * 2017-06-07 2017-11-03 上海斐讯数据通信技术有限公司 A kind of management system and implementation method of photograph album label
CN108549643A (en) * 2018-04-08 2018-09-18 北京百度网讯科技有限公司 translation processing method and device
CN109359644A (en) * 2018-08-28 2019-02-19 东软集团股份有限公司 Character image uniformity comparison method, apparatus, storage medium and electronic equipment
CN109670507A (en) * 2018-11-27 2019-04-23 维沃移动通信有限公司 Image processing method, device and mobile terminal
CN109919146A (en) * 2019-02-02 2019-06-21 上海兑观信息科技技术有限公司 Picture character recognition methods, device and platform
CN109919147A (en) * 2019-03-04 2019-06-21 上海宝尊电子商务有限公司 The method of text identification in drop for clothing image

Family Cites Families (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US8510668B1 (en) * 2000-04-03 2013-08-13 Google Inc. Indicating potential focus in a user interface
US9098479B2 (en) * 2008-02-15 2015-08-04 Edyt Inc. Methods and apparatus for improved navigation among controlled terms in one or more user documents
KR102147935B1 (en) * 2013-08-29 2020-08-25 삼성전자주식회사 Method for processing data and an electronic device thereof
US9665657B2 (en) * 2013-09-24 2017-05-30 Google Inc. Dynamically picking content from social shares to display in a user interface
GB201615382D0 (en) * 2016-09-09 2016-10-26 Univ Court Of The Univ Of Edinburgh The And Lothian Health Board A text display method and apparatus
CN107765966A (en) * 2017-10-13 2018-03-06 广州视源电子科技股份有限公司 Event triggering method, device, intelligent terminal and storage medium based on picture
CN107957831B (en) * 2017-10-31 2021-02-12 创新先进技术有限公司 Data processing method, device and processing equipment for displaying interface content

Patent Citations (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103412711A (en) * 2013-08-27 2013-11-27 宇龙计算机通信科技(深圳)有限公司 Document comparison reference method and device
CN104679723A (en) * 2013-11-29 2015-06-03 北京壹人壹本信息科技有限公司 Text contrast display method, system and device
CN106383643A (en) * 2016-09-18 2017-02-08 浙江慧脑信息科技有限公司 Method for browsing picture and text at the same time
CN107315781A (en) * 2017-06-07 2017-11-03 上海斐讯数据通信技术有限公司 A kind of management system and implementation method of photograph album label
CN108549643A (en) * 2018-04-08 2018-09-18 北京百度网讯科技有限公司 translation processing method and device
CN109359644A (en) * 2018-08-28 2019-02-19 东软集团股份有限公司 Character image uniformity comparison method, apparatus, storage medium and electronic equipment
CN109670507A (en) * 2018-11-27 2019-04-23 维沃移动通信有限公司 Image processing method, device and mobile terminal
CN109919146A (en) * 2019-02-02 2019-06-21 上海兑观信息科技技术有限公司 Picture character recognition methods, device and platform
CN109919147A (en) * 2019-03-04 2019-06-21 上海宝尊电子商务有限公司 The method of text identification in drop for clothing image

Also Published As

Publication number Publication date
CN112764599A (en) 2021-05-07

Similar Documents

Publication Publication Date Title
US11601585B2 (en) Mobile terminal and method of performing multi-focusing and photographing image including plurality of objects using the same
CN105955607B (en) Content sharing method and device
CN109683714B (en) Multimedia resource management method, device and storage medium
CN108108418B (en) Picture management method, device and storage medium
US20100066810A1 (en) Mobile terminal having a panorama photographing function and method for controlling operation thereof
US20200210061A1 (en) Method, device and storage medium for sharing multimedia resource
CN105872365A (en) Photographing method and device for mobile terminal
CN110968364B (en) Method and device for adding shortcut plugins and intelligent device
RU2648616C2 (en) Font addition method and apparatus
CN104850643B (en) Picture comparison method and device
CN106527886B (en) Picture display method and device
CN112308864A (en) Image processing method and device, electronic equipment and storage medium
CN112396675A (en) Image processing method, device and storage medium
CN107832112B (en) Wallpaper setting method and device
CN112764599B (en) Data processing method, device and medium
CN114339019B (en) Focusing method, focusing device and storage medium
CN111092971A (en) Display method and device for displaying
CN105975188B (en) Picture position adjusting method and device
CN114666490B (en) Focusing method, focusing device, electronic equipment and storage medium
CN106572243B (en) Multimedia information display method and device
CN105488131B (en) File opening method and device
US20210333988A1 (en) Method and device for switching interface, touch terminal, and storage medium
CN111538450B (en) Theme background display method and device and storage medium
KR20110134617A (en) Mobile terminal and method for managing list thereof
KR20110080689A (en) Terminal and method for sharing contents thereof

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant