CN111582281B - Picture display optimization method and device, electronic equipment and storage medium - Google Patents
Picture display optimization method and device, electronic equipment and storage medium Download PDFInfo
- Publication number
- CN111582281B CN111582281B CN202010393643.2A CN202010393643A CN111582281B CN 111582281 B CN111582281 B CN 111582281B CN 202010393643 A CN202010393643 A CN 202010393643A CN 111582281 B CN111582281 B CN 111582281B
- Authority
- CN
- China
- Prior art keywords
- coordinates
- block diagram
- fine
- frame
- enhanced
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000000034 method Methods 0.000 title claims abstract description 63
- 238000003860 storage Methods 0.000 title claims abstract description 12
- 238000005457 optimization Methods 0.000 title claims description 9
- 238000010586 diagram Methods 0.000 claims abstract description 192
- 238000012545 processing Methods 0.000 claims abstract description 41
- 238000005520 cutting process Methods 0.000 claims abstract description 8
- 238000004590 computer program Methods 0.000 claims description 13
- 230000009466 transformation Effects 0.000 claims description 8
- 238000013507 mapping Methods 0.000 claims description 2
- 230000000694 effects Effects 0.000 description 10
- 238000006243 chemical reaction Methods 0.000 description 3
- 238000005516 engineering process Methods 0.000 description 3
- 238000012015 optical character recognition Methods 0.000 description 3
- 238000012360 testing method Methods 0.000 description 3
- PXFBZOLANLWPMH-UHFFFAOYSA-N 16-Epiaffinine Natural products C1C(C2=CC=CC=C2N2)=C2C(=O)CC2C(=CC)CN(C)C1C2CO PXFBZOLANLWPMH-UHFFFAOYSA-N 0.000 description 2
- 238000012937 correction Methods 0.000 description 2
- 230000006870 function Effects 0.000 description 2
- 230000001960 triggered effect Effects 0.000 description 2
- 230000002087 whitening effect Effects 0.000 description 2
- 230000002391 anti-complement effect Effects 0.000 description 1
- 230000009286 beneficial effect Effects 0.000 description 1
- 239000003086 colorant Substances 0.000 description 1
- 238000012790 confirmation Methods 0.000 description 1
- 238000013527 convolutional neural network Methods 0.000 description 1
- 230000007547 defect Effects 0.000 description 1
- 230000001419 dependent effect Effects 0.000 description 1
- 238000009826 distribution Methods 0.000 description 1
- 230000003993 interaction Effects 0.000 description 1
- 239000011159 matrix material Substances 0.000 description 1
- 238000003062 neural network model Methods 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 230000002093 peripheral effect Effects 0.000 description 1
- 238000001454 recorded image Methods 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V30/00—Character recognition; Recognising digital ink; Document-oriented image-based pattern recognition
- G06V30/10—Character recognition
- G06V30/14—Image acquisition
- G06V30/148—Segmentation of character regions
- G06V30/153—Segmentation of character regions using recognition of characters or words
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V10/00—Arrangements for image or video recognition or understanding
- G06V10/20—Image preprocessing
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V10/00—Arrangements for image or video recognition or understanding
- G06V10/20—Image preprocessing
- G06V10/24—Aligning, centring, orientation detection or correction of the image
- G06V10/245—Aligning, centring, orientation detection or correction of the image by locating a pattern; Special marks for positioning
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V10/00—Arrangements for image or video recognition or understanding
- G06V10/20—Image preprocessing
- G06V10/26—Segmentation of patterns in the image field; Cutting or merging of image elements to establish the pattern region, e.g. clustering-based techniques; Detection of occlusion
- G06V10/267—Segmentation of patterns in the image field; Cutting or merging of image elements to establish the pattern region, e.g. clustering-based techniques; Detection of occlusion by performing operations on regions, e.g. growing, shrinking or watersheds
Landscapes
- Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Multimedia (AREA)
- Theoretical Computer Science (AREA)
- Computer Vision & Pattern Recognition (AREA)
- User Interface Of Digital Computer (AREA)
- Image Processing (AREA)
Abstract
The embodiment of the invention relates to the technical field of image processing, and discloses a method, a device, electronic equipment and a storage medium for optimizing image display. The method comprises the following steps: acquiring an initial image and operation coordinates of a user, and converting the operation coordinates into the initial image to obtain intention coordinates; cutting the initial image by using a first preset rule based on the intention coordinates to obtain a rough block diagram; simultaneously performing a first operation and a second operation on the rough block diagram, wherein the first operation is to perform image enhancement processing on the rough block diagram to obtain an enhanced rough block diagram; the second operation is to determine fine frame coordinates corresponding to the intention coordinates by utilizing a second preset rule based on the rough block diagram and the intention coordinates; and sending the enhanced rough block diagram and the fine frame coordinates to the client so that the client displays the positions of the fine frame coordinates in the enhanced rough block diagram. By implementing the embodiment of the invention, the time consumption of image processing can be reduced, and the requirement of a user on the recording speed is met.
Description
Technical Field
The present invention relates to the field of image processing technologies, and in particular, to a method and apparatus for optimizing image display, an electronic device, and a storage medium.
Background
The prior APP or intelligent terminal with wrong question collection or question searching function is characterized in that after the intelligent terminal shoots an image, a frame question area is displayed on a shot original picture for a user to select, and after the user selects, pictures in the frame question area are recorded or searched. The method accelerates the processing speed to a certain extent, but for users, the users select in the original images, bad user experience is brought, and how the final effect of the recorded questions is determined by opening the images in the frame question area after the users save the images for a period of time, if the saved images are bad in effect, the users need to re-enter the images again, so that the use efficiency is reduced.
Disclosure of Invention
Aiming at the defects, the embodiment of the invention discloses a method, a device, electronic equipment and a storage medium for optimizing picture display, which can send the coordinates of an enhanced rough block diagram and a refined block diagram to a client, and simultaneously reduce time consumption through parallel processing, thereby meeting the requirement of a user on the recording speed.
The first aspect of the embodiment of the invention discloses a method for optimizing image display, which comprises the following steps:
acquiring an initial image and operation coordinates of a user, and converting the operation coordinates into the initial image to obtain intention coordinates;
cutting the initial image by utilizing a first preset rule based on the intention coordinate to obtain a rough block diagram;
simultaneously performing a first operation and a second operation on the rough block diagram, wherein the first operation is to perform image enhancement processing on the rough block diagram to obtain an enhanced rough block diagram; the second operation is to determine fine frame coordinates corresponding to the intention coordinates by utilizing a second preset rule based on the coarse frame and the intention coordinates;
and sending the enhanced rough block diagram and the fine frame coordinates to the client so that the client displays the positions of the fine frame coordinates in the enhanced rough block diagram.
In a first aspect of the embodiment of the present invention, obtaining an initial image and operation coordinates of a user, and converting the operation coordinates into the initial image to obtain intent coordinates, where the intent coordinates include:
receiving an initial image and operation coordinates sent by a client; the initial image is an image obtained by photographing the carrier by using a camera when the client receives the trigger instruction; the operation coordinates are operation tracks of a user identified by the camera on the carrier by using the operation body;
and obtaining the corresponding intention coordinates of the operation coordinates on the initial image by utilizing coordinate transformation.
As an optional implementation manner, in the first aspect of the embodiment of the present invention, the method further includes:
after the second operation is executed, judging whether the first operation is executed;
if the first operation is executed, acquiring a fine block diagram according to the enhanced coarse block diagram and the fine block diagram coordinates;
if the first operation is not finished, acquiring a fine block diagram according to the coarse block diagram and the fine block diagram coordinates;
and identifying the precise block diagram to obtain character information, and carrying out related search based on the character information to obtain a search result.
As an optional implementation manner, in the first aspect of the embodiment of the present invention, the method further includes:
saving the search result; or/and the combination of the two,
all or part of the search results are sent to the client.
As an optional implementation manner, in the first aspect of the embodiment of the present invention, the method further includes:
receiving fine frame adjustment coordinates after the user adjusts the fine frame coordinates through a client;
and determining a fine frame region according to the fine frame adjustment coordinates and the enhanced coarse frame diagram to obtain a target picture in the fine frame region.
As an optional implementation manner, in the first aspect of the embodiment of the present invention, the method further includes:
terminating the relevant search by the fine block diagram;
and identifying the target picture to obtain target character information, and carrying out related search based on the target character information to obtain a search result.
As an optional implementation manner, in the first aspect of the embodiment of the present invention, the method further includes:
storing the reinforced coarse frame coordinates and the fine frame coordinates, and establishing a mapping relation between the reinforced coarse frame coordinates and the fine frame coordinates; or/and, storing the enhanced coarse block diagram and the fine block diagram obtained by the fine block diagram coordinates;
and if the fine frame adjustment coordinates obtained after the user adjusts the fine frame coordinates through the client are received, replacing the fine frame coordinates with the fine frame adjustment coordinates.
The second aspect of the embodiment of the invention discloses a device for optimizing image display, which comprises:
the acquisition unit is used for acquiring an initial image and operation coordinates of a user, and converting the operation coordinates into the initial image to obtain intention coordinates;
the clipping unit is used for clipping the initial image by utilizing a first preset rule based on the intention coordinate to obtain a rough block diagram;
the processing unit is used for simultaneously carrying out a first operation and a second operation on the rough block diagram, wherein the first operation is to carry out image enhancement processing on the rough block diagram to obtain an enhanced rough block diagram; the second operation is to determine fine frame coordinates corresponding to the intention coordinates by utilizing a second preset rule based on the coarse frame and the intention coordinates;
and the sending unit is used for sending the enhanced rough block diagram and the fine block diagram coordinates to the client so that the client displays the fine block diagram coordinates at the position of the enhanced rough block diagram.
As an optional implementation manner, in the second aspect of the embodiment of the present invention, the apparatus further includes a search unit, where the search unit includes:
the judging subunit is used for judging whether the first operation is executed after the second operation is executed;
the first execution subunit is used for acquiring a fine block diagram according to the enhanced coarse block diagram and the fine block diagram coordinates if the first operation is completed;
the second execution subunit is used for acquiring a fine block diagram according to the coarse block diagram and the fine block diagram coordinates if the first operation is not completed;
and the result acquisition subunit is used for identifying the precise block diagram to obtain character information, and carrying out related search based on the character information to obtain a search result.
As an optional implementation manner, in the second aspect of the embodiment of the present invention, the apparatus further includes an adjusting unit, where the adjusting unit includes:
the first subunit is used for receiving fine frame adjustment coordinates after the user adjusts the fine frame coordinates through the client;
and the second subunit is used for determining a fine frame area according to the fine frame adjustment coordinates and the enhanced coarse block diagram to obtain a target picture in the fine frame area.
As an optional implementation manner, in the second aspect of the embodiment of the present invention, the adjusting unit further includes:
a third subunit for terminating the relevant search by the fine block diagram;
and the fourth subunit is used for identifying the target picture to obtain target character information, and carrying out related search based on the target character information to obtain a search result.
A third aspect of an embodiment of the present invention discloses an electronic device, including: a memory storing executable program code; a processor coupled to the memory; the processor invokes the executable program code stored in the memory to perform some or all of the steps of a method for optimizing display of a picture disclosed in the first aspect of the embodiment of the present invention.
A fourth aspect of the embodiments of the present invention discloses a computer-readable storage medium storing a computer program, where the computer program causes a computer to execute some or all of the steps of a method for optimizing display of a picture disclosed in the first aspect of the embodiments of the present invention.
A fifth aspect of the embodiments of the present invention discloses a computer program product which, when run on a computer, causes the computer to perform some or all of the steps of a method of picture display optimization as disclosed in the first aspect of the embodiments of the present invention.
A sixth aspect of the embodiments of the present invention discloses an application publishing platform for publishing a computer program product, wherein the computer program product, when run on a computer, causes the computer to execute part or all of the steps of a method for optimizing display of a picture disclosed in the first aspect of the embodiments of the present invention.
Compared with the prior art, the embodiment of the invention has the following beneficial effects: in the embodiment of the invention, an initial image and the operation coordinates of a user are obtained, and the operation coordinates are converted into the initial image to obtain the intention coordinates; cutting the initial image by utilizing a first preset rule based on the intention coordinate to obtain a rough block diagram; simultaneously performing a first operation and a second operation on the rough block diagram, wherein the first operation is to perform image enhancement processing on the rough block diagram to obtain an enhanced rough block diagram; the second operation is to determine fine frame coordinates corresponding to the intention coordinates by utilizing a second preset rule based on the coarse frame and the intention coordinates; and sending the enhanced rough block diagram and the fine frame coordinates to the client so that the client displays the positions of the fine frame coordinates in the enhanced rough block diagram. Therefore, by implementing the embodiment of the invention, the time consumption of image processing can be reduced by parallel processing of image enhancement and fine frame coordinate determination, the requirement of a user on the recording speed is met, meanwhile, the client can present the display effect of the fine frame coordinate in the enhanced coarse block diagram, the user experience is improved, and the definition of the recorded picture is also evaluated earlier.
Drawings
In order to more clearly illustrate the technical solutions of the embodiments of the present invention, the drawings that are needed in the embodiments will be briefly described below, and it is obvious that the drawings in the following description are only some embodiments of the present invention, and other drawings may be obtained according to these drawings without inventive effort for a person skilled in the art.
FIG. 1 is a flow chart of a method for optimizing display of pictures according to an embodiment of the present invention;
FIG. 2 is a flow chart of another method for optimizing the display of pictures according to an embodiment of the present invention;
FIG. 3 is a flow chart of a method for optimizing a display of a picture according to an embodiment of the present invention;
FIG. 4 is a schematic structural diagram of a device for optimizing image display according to an embodiment of the present invention;
FIG. 5 is a schematic diagram of another apparatus for optimizing display of pictures according to an embodiment of the present invention;
fig. 6 is a schematic structural diagram of an electronic device according to an embodiment of the present invention.
Detailed Description
The following description of the embodiments of the present invention will be made clearly and completely with reference to the accompanying drawings, in which it is apparent that the embodiments described are only some embodiments of the present invention, but not all embodiments. All other embodiments, which can be made by those skilled in the art based on the embodiments of the invention without making any inventive effort, are intended to be within the scope of the invention.
It should be noted that the terms "first," "second," "third," "fourth," and the like in the description and in the claims of the present invention are used for distinguishing between different objects and not necessarily for describing a particular sequential or chronological order. The terms "comprises," "comprising," and "having," and any variations thereof, are intended to cover a non-exclusive inclusion, such that a process, method, apparatus, article, or device that comprises a list of steps or elements is not necessarily limited to those steps or elements expressly listed or inherent to such process, method, article, or device.
The embodiment of the invention discloses a method, a device, electronic equipment and a storage medium for optimizing picture display, which can reduce time consumption of image processing and meet the requirement of a user on a recording speed through parallel processing of image enhancement and fine frame coordinate determination.
Example 1
Referring to fig. 1, fig. 1 is a flow chart of a picture display optimization method according to an embodiment of the invention. The method described by the embodiment of the invention can realize the picture display optimization process in intelligent terminals such as learning machines, home teaching machines, point reading machines, tablet computers or mobile phones, and can also be realized in interaction between a server and a client. As shown in fig. 1, the picture display optimization method includes the following steps:
110. and acquiring an initial image and operation coordinates of a user, and converting the operation coordinates into the initial image to obtain the intention coordinates.
The initial image is obtained by photographing the client through a camera. The client is some application programs in the intelligent terminal, such as the error question book APP, and can also be some intelligent devices special for error question collection.
When a trigger instruction of a user is received, the client starts the camera to photograph the carrier. The triggering instruction may be a voice instruction sent by the user to the intelligent terminal, for example, please help me record the question or how the question is done, or may be triggered by a touch key or a mechanical key, or may be triggered directly when the user opens the client, which is not limited herein.
The carrier is the initial carrier for the user to record or search questions such as answers, and can be books, exercise books, test papers and the like. The client photographs the carrier through the camera, and simultaneously identifies operation coordinates of the user, wherein the operation coordinates are operation tracks of the user identified by the camera on the carrier by using the operation body. The operation body can be a finger, a touch pen, a pencil, a ruler, a small stick and the like. The operational track may be a closed loop, one or more line segments, one or more points, etc. created on the carrier.
And after receiving the initial image photographed by the client and the identified operation coordinates, carrying out layout correction on the initial image and carrying out coordinate conversion on the operation coordinates. The layout correction is mainly to rotate the initial image correspondingly to the character direction, and can also be performed in intelligent equipment corresponding to the client, the coordinate conversion is to convert the coordinates on the carrier into the coordinates on the initial image, namely, the operation coordinates are converted into the intended coordinates, the operation coordinates can be realized in an affine transformation mode, and the affine transformation can be realized by a transformation matrix formed by internal parameters and external parameters of the camera, for example.
120. And cutting the initial image by utilizing a first preset rule based on the intention coordinate to obtain a rough block diagram.
The first preset rule may be a rectangular box, or other closed figure. The first preset rules are generally as follows: including all the content covered by the operation track, the upper and lower edges are at a distance from the operation track, and preferably the two side edges are the left and right edges of the original image (for a transversely typeset carrier). For example, when the operation track is a point, the first preset rule may be a rectangular frame, the upper edge of the rectangular frame is distant from the point by ten lines of characters, the lower edge of the rectangular block is distant from the point by five lines of characters, and the two side edges of the rectangular frame are left and right edges of the initial image. Obviously, the coarse block diagram may also be the whole initial image itself, when the parameters set by the first preset rule are sufficiently large.
Obtaining a frame selection area on the initial image through a first preset rule and an intention coordinate, and dividing the picture in the frame selection area from the initial image to obtain a rough block diagram.
130. Simultaneously performing a first operation and a second operation on the rough block diagram, wherein the first operation is to perform image enhancement processing on the rough block diagram to obtain an enhanced rough block diagram; and the second operation is to determine fine frame coordinates corresponding to the intention coordinates by utilizing a second preset rule based on the coarse frame and the intention coordinates.
The first operation and the second operation of the parallel processing on the rough block diagram can reduce the time consumption of image processing and meet the requirement of a user on the recording speed.
The first operation is to perform image enhancement processing on the coarse block diagram, including but not limited to contrast enhancement, whitening, denoising, etc.
Image enhancement can be realized by histogram transformation, which is a contrast enhancement method that changes and adjusts the gray level histogram of an image and changes the distribution and structural relationship of image values, thereby achieving the effects of contrast enhancement, whitening, denoising, and the like.
In the scene of wrong recording, handwriting fonts exist in a rough block diagram in many times, the handwriting fonts are smeared and removed in the first operation, the handwriting fonts can be removed by a handwriting font recognition model (a convolutional neural network model or the like can be adopted, the neural network model can be pre-selected and trained through a large number of handwriting samples), the positions of the handwriting fonts are recognized, and then the handwriting fonts are covered through background colors.
The rough block diagram is subjected to image enhancement processing, and then sent to a client for display, so that user experience can be improved, and a partial area (determined according to the fine frame coordinates) of the rough block diagram is also a finally stored picture, so that the definition of the stored picture can be estimated, and the possibility of re-recording is reduced.
The second operation is to obtain fine frame coordinates through a second preset track. The fine frame coordinates are peripheral coordinates of a final recording or a picture for searching the questions, which are acquired according to the intention of a user, and the connecting lines of the fine frame coordinates form a closed annular structure. The second preset track can be various according to the expression form of the intention coordinate, and when the intention coordinate is a closed loop, the second preset track can be a fine frame coordinate by taking the collection of each pixel point on the closed loop as the fine frame coordinate; when the intended coordinate is a horizontal line segment, the second preset track may be a plurality of areas on the upper side of the horizontal line segment (if a question is set, a position with a line spacing larger than a preset threshold value is used as an upper edge, and a set of pixel points corresponding to the upper edge, the horizontal line segment and two side edges of the rough block diagram is used as a fine block coordinate); when the intended coordinate is an inclined line segment, the second preset rule may be to construct a rectangular frame according to the inclined line segment as a diagonal line, where the set of pixel points corresponding to the rectangular frame forms a fine frame coordinate.
140. And sending the enhanced rough block diagram and the fine frame coordinates to the client so that the client displays the positions of the fine frame coordinates in the enhanced rough block diagram.
The enhanced coarse block diagram and the coarse block diagram are the same in size, and therefore, the position of the fine block coordinates on the coarse block diagram corresponds to the enhanced coarse block diagram. The enhanced rough block diagram and the fine frame coordinates may be sent to the client, respectively, so that the client displays the position of the fine frame coordinates in the enhanced rough block diagram, that is, the effect of the user frame selection question is presented on the enhanced rough block diagram. If the first operation is processed, the enhanced rough block diagram can be sent to the client, at the moment, the enhanced rough block diagram presented by the client does not contain the fine frame coordinates, and after the fine frame coordinates are obtained, the fine frame coordinates are displayed on the enhanced rough block diagram. If the second operation is processed first, the rough block diagram and the fine block diagram coordinates can be sent to the client side, at the moment, the client side displays the display effect of the fine block diagram coordinates on the rough block diagram, after the first operation is processed, the rough block diagram is replaced by the enhanced rough block diagram, and the replacing process is similar to the loading process of the picture.
By implementing the embodiment of the invention, the time consumption of image processing can be reduced by the parallel processing of image enhancement and fine frame coordinate determination, the requirement of a user on the recording speed is met, meanwhile, the client can present the display effect of the fine frame coordinate in the enhanced coarse block diagram, the user experience is improved, and the definition of the recorded picture is also evaluated earlier.
Example two
Referring to fig. 2, fig. 2 is a schematic structural diagram of another image display optimization method according to an embodiment of the invention. As shown in fig. 2, the method may include:
210. and acquiring an initial image and operation coordinates of a user, and converting the operation coordinates into the initial image to obtain the intention coordinates.
220. And cutting the initial image by utilizing a first preset rule based on the intention coordinate to obtain a rough block diagram.
230. Simultaneously performing a first operation and a second operation on the rough block diagram, wherein the first operation is to perform image enhancement processing on the rough block diagram to obtain an enhanced rough block diagram; and the second operation is to determine fine frame coordinates corresponding to the intention coordinates by utilizing a second preset rule based on the coarse frame and the intention coordinates.
240. And sending the enhanced rough block diagram and the fine frame coordinates to the client so that the client displays the positions of the fine frame coordinates in the enhanced rough block diagram.
Steps 210-240 are similar to steps 110-140, respectively, in the first embodiment, and are not described here again.
250. The enhanced coarse block diagram and the fine block coordinates are saved.
And the enhanced coarse frame and the fine frame coordinates are stored while the enhanced coarse frame and the fine frame coordinates are sent to the client. The method is mainly applied to the topic recording. And the association between the enhanced coarse block diagram and the fine block diagram is also established while the coordinates of the two blocks are stored.
If the client receives the enhanced rough block diagram and the fine frame coordinates, and does not adjust the fine frame coordinates, after receiving confirmation information sent by the user through the client, the electronic equipment (which can be a learning machine, a home education machine and the like or a server) cuts the enhanced rough block diagram associated with the fine frame coordinates through the stored fine frame coordinates to obtain and store a fine frame picture, and meanwhile, deletes the fine frame coordinates and the enhanced rough block diagram.
And if the client receives the enhanced rough block diagram and the fine frame coordinates, adjusting the fine frame coordinates, and receiving the modified fine frame coordinates transmitted by the user through the client, namely the fine frame adjustment coordinates, cutting the associated enhanced rough block diagram through the fine frame adjustment coordinates by the electronic equipment to obtain and store the fine frame diagram, and deleting the fine frame coordinates and the enhanced rough block diagram.
By implementing the embodiment of the invention, the time consumption of image processing can be reduced by the parallel processing of image enhancement and fine frame coordinate determination, the requirement of a user on the recording speed is met, meanwhile, the client can present the display effect of the fine frame coordinate in the enhanced coarse block diagram, the user experience is improved, and the definition of the recorded picture is also evaluated earlier.
Example III
Referring to fig. 3, fig. 3 is a schematic structural diagram of another image display optimization method according to an embodiment of the invention. As shown in fig. 3, the method may include:
310. and acquiring an initial image and operation coordinates of a user, and converting the operation coordinates into the initial image to obtain the intention coordinates.
320. And cutting the initial image by utilizing a first preset rule based on the intention coordinate to obtain a rough block diagram.
330. Simultaneously performing a first operation and a second operation on the rough block diagram, wherein the first operation is to perform image enhancement processing on the rough block diagram to obtain an enhanced rough block diagram; and the second operation is to determine fine frame coordinates corresponding to the intention coordinates by utilizing a second preset rule based on the coarse frame and the intention coordinates.
340. The correlation search is performed by a fine block diagram.
350. And sending the enhanced rough block diagram and the fine frame coordinates to the client so that the client displays the positions of the fine frame coordinates in the enhanced rough block diagram.
Steps 310-330 and 350 are similar to steps 110-140, respectively, in the first embodiment, and are not repeated here.
Step 340 is mainly applied to topic listing or topic searching. The method mainly comprises the steps of searching editable texts with the same content as the precise block diagram in the title recording, and replacing the precise block diagram for storage. The question searching modes are various, and can be searching answers, pronunciation, paraphrasing or anticomplements and the like, and are determined according to specific trigger instructions generated by users.
The precise block diagram is obtained in a manner that is dependent on the processing speed of the first operation and the second operation of step 330, and the correlation search is performed at the fastest speed.
Specifically, after the second operation is executed, judging whether the first operation is executed, if the first operation is finished before the second operation, obtaining a fine block diagram according to the enhanced rough block diagram and the fine block diagram obtained by the first operation, wherein the fine block diagram is the content covered on the enhanced rough block diagram by the fine block diagram. In this manner, step 340 and step 350 operate simultaneously.
If the second operation is completed before the first operation, the fine block diagram is acquired using the coarse block diagram and the fine block diagram coordinates. In this manner, steps 340 and 350 are also performed simultaneously, but after the first operation is performed, step 350 replaces the coarse block diagram with the enhanced coarse block diagram, and step 340 still uses the fine block diagram obtained from the coarse block diagram to perform the search.
Before relevant searching, the content of the precise block diagram needs to be identified to obtain character information. Recognition can be achieved through mature OCR (Optical Character Recognition ) technology, the OCR technology can be used for directly carrying out character recognition on color images, and character recognition can be carried out on binarized images to obtain character information. Characters include kanji, letters, numbers, punctuation marks, and the like.
If the text is the editable text with the same content as the precise block diagram, the keywords of the topics in the topic library can be compared by extracting the keywords from the character information, then the character information and the topics with the same keywords are integrally compared to obtain the editable text with the same final content, the client can be sent, and the user confirms whether the text needs to be stored or not.
If the content is search pronunciation, paraphrase, example sentence, paraphrase, anti-meaning word, etc., the corresponding content can be obtained according to the key word and then sent to the client for display or playing, etc. If the search test questions are detailed, corresponding contents can be obtained according to the keywords, and then the detailed test questions are sent to the client for display.
In step 350, if the client receives the enhanced rough block diagram and the fine frame coordinates, and then adjusts the fine frame coordinates, the modified fine frame coordinates sent by the user through the client are called fine frame adjustment coordinates, and the electronic device terminates the related search performed by the fine block diagram; and determining a fine frame region according to the fine frame adjustment coordinates and the enhanced coarse frame, obtaining a target picture in the fine frame region, identifying the target picture, obtaining target character information, and carrying out relevant search based on the target character information to obtain a search result. If the relevant search through the refined block diagram is completed, the search result is sent to the client and approved by the user, the relevant search is not performed any more, and if the relevant search is not approved by the client, the relevant search is performed again through the target picture.
By implementing the embodiment of the invention, the image enhancement and the parallel processing of the fine frame coordinate determination can be performed, the related search and the sending of the enhanced coarse frame and the fine frame coordinate to the client are performed in parallel, the time consumption of image processing can be reduced, the requirement of a user on the recording speed is met, meanwhile, the client can present the display effect of the fine frame coordinate in the enhanced coarse frame, the user experience is improved, and the definition of the recorded picture is also evaluated earlier.
Example IV
Referring to fig. 4, fig. 4 is a schematic structural diagram of a picture display optimizing apparatus according to an embodiment of the present invention. As shown in fig. 4, the picture display optimizing apparatus may include:
an obtaining unit 410, configured to obtain an initial image and operation coordinates of a user, and convert the operation coordinates into the initial image to obtain intent coordinates;
the cropping unit 420 is configured to crop the initial image by using a first preset rule based on the intent coordinate, so as to obtain a rough block diagram;
a processing unit 430, configured to perform a first operation and a second operation on the coarse block diagram at the same time, where the first operation is to perform image enhancement processing on the coarse block diagram, so as to obtain an enhanced coarse block diagram; the second operation is to determine fine frame coordinates corresponding to the intention coordinates by utilizing a second preset rule based on the coarse frame and the intention coordinates;
and the sending unit 440 is configured to send the enhanced rough block diagram and the fine frame coordinate to the client, so that the client displays the fine frame coordinate at the position of the enhanced rough block diagram.
As an alternative embodiment, the acquiring unit 410 may include:
a receiving subunit 411, configured to receive the initial image and the operation coordinates sent by the client; the initial image is an image obtained by photographing the carrier by using a camera when the client receives the trigger instruction; the operation coordinates are operation tracks of a user identified by the camera on the carrier by using the operation body;
the conversion subunit 412 is configured to obtain, by using coordinate transformation, an intent coordinate corresponding to the operation coordinate on the initial image.
The image display optimizing device shown in fig. 4 can reduce image processing time consumption through parallel processing of image enhancement and fine frame coordinate determination, and meet the requirement of a user on the recording speed.
Example five
Referring to fig. 5, fig. 5 is a schematic structural diagram of another image display optimizing apparatus according to an embodiment of the invention. As shown in fig. 5, the picture display optimizing apparatus may include:
an obtaining unit 510, configured to obtain an initial image and operation coordinates of a user, and convert the operation coordinates into the initial image to obtain intent coordinates;
the cropping unit 520 is configured to crop the initial image by using a first preset rule based on the intent coordinate, so as to obtain a rough block diagram;
a processing unit 530, configured to perform a first operation and a second operation on the coarse block diagram at the same time, where the first operation is to perform image enhancement processing on the coarse block diagram, so as to obtain an enhanced coarse block diagram; the second operation is to determine fine frame coordinates corresponding to the intention coordinates by utilizing a second preset rule based on the coarse frame and the intention coordinates;
and the sending unit 540 is configured to send the enhanced rough block diagram and the fine block diagram coordinates to the client, so that the client displays the fine block diagram coordinates at the position of the enhanced rough block diagram.
As an alternative embodiment, the apparatus further comprises a search unit 550, the search unit 550 comprising:
a judging subunit 551, configured to judge whether the execution of the first operation is completed after the execution of the second operation is completed;
a first execution subunit 552, configured to obtain a fine block diagram according to the enhanced coarse block diagram and the fine block diagram coordinates if the first operation is performed;
a second execution subunit 553, configured to obtain a fine block diagram according to the coarse block diagram and the fine block coordinates if the first operation is not performed;
and a result obtaining subunit 554, configured to identify the precise block diagram, obtain character information, and perform related search based on the character information, so as to obtain a search result.
As an alternative embodiment, the apparatus further comprises a storing unit 560 and a result feedback unit 570, wherein the storing unit 560 is configured to store the search result, and the result feedback unit 570 is configured to send all or part of the search result to the client.
As an alternative embodiment, the apparatus further comprises an adjusting unit 580, the adjusting unit 580 comprising:
a first subunit 581, configured to receive fine frame adjustment coordinates after the user adjusts the fine frame coordinates through a client;
and a second subunit 582, configured to determine a fine frame area according to the fine frame adjustment coordinates and the enhanced coarse block diagram, and obtain a target picture in the fine frame area.
As an alternative embodiment, the adjusting unit 580 further includes:
a third subunit 583, configured to terminate the relevant search performed by the precise block diagram;
and a fourth subunit 584, configured to identify the target picture, obtain target character information, and perform related search based on the target character information, to obtain a search result.
The image display optimizing device shown in fig. 5 can perform parallel processing on relevant searching and sending the enhanced rough block diagram and the fine frame coordinate to the client through the parallel processing of image enhancement and fine frame coordinate determination, so that image processing time consumption can be reduced, the requirement of a user on the recording speed can be met, meanwhile, the client can present the display effect of the fine frame coordinate in the enhanced rough block diagram, user experience is improved, and the definition of the recorded image is evaluated earlier.
Example six
Referring to fig. 6, fig. 6 is a schematic structural diagram of an electronic device according to an embodiment of the present invention, where the electronic device may be an intelligent terminal such as a learning machine, a home education machine, a point-reading machine, a tablet computer or a mobile phone, or may be a server. As shown in fig. 6, the electronic device may include:
a memory 610 storing executable program code;
a processor 620 coupled to the memory 610;
the processor 620 invokes executable program codes stored in the memory 610 to perform some or all of the steps in the method of optimizing the display of a picture according to any one of the first to third embodiments.
The embodiment of the invention discloses a computer-readable storage medium storing a computer program, wherein the computer program causes a computer to execute part or all of the steps in the method for optimizing the display of a picture in any one of the first to third embodiments.
The embodiment of the invention also discloses a computer program product, wherein the computer program product enables the computer to execute part or all of the steps in the method for optimizing the picture display in any one of the first embodiment to the third embodiment when running on the computer.
The embodiment of the invention also discloses an application release platform, wherein the application release platform is used for releasing a computer program product, and when the computer program product runs on a computer, the computer is caused to execute part or all of the steps in the method for optimizing the picture display in any one of the first to third embodiments.
In various embodiments of the present invention, it should be understood that the size of the sequence numbers of the processes does not mean that the execution sequence of the processes is necessarily sequential, and the execution sequence of the processes should be determined by the functions and internal logic thereof, and should not constitute any limitation on the implementation process of the embodiments of the present invention.
The units described as separate units may or may not be physically separate, and units shown as units may or may not be physical units, may be located in one place, or may be distributed on a plurality of network units. Some or all of the units may be selected according to actual needs to achieve the purpose of the embodiment.
In addition, each functional unit in the embodiments of the present invention may be integrated in one processing unit, or each unit may exist alone physically, or two or more units may be integrated in one unit. The integrated units may be implemented in hardware or in software functional units.
The integrated units, if implemented in the form of software functional units and sold or used as stand-alone products, may be stored in a computer-accessible memory. Based on this understanding, the technical solution of the present invention, or a part contributing to the prior art or all or part of the technical solution, may be embodied in the form of a software product stored in a memory, comprising several requests for a computer device (which may be a personal computer, a server or a network device, etc., in particular may be a processor in a computer device) to execute some or all of the steps of the method according to the embodiments of the present invention.
In the embodiments provided herein, it should be understood that "B corresponding to a" means that B is associated with a, from which B can be determined. It should also be understood that determining B from a does not mean determining B from a alone, but may also determine B from a and/or other information.
Those of ordinary skill in the art will appreciate that some or all of the steps of the various methods of the described embodiments may be implemented by hardware associated with a program that may be stored in a computer-readable storage medium, including Read-Only Memory (ROM), random-access Memory (Random Access Memory, RAM), programmable Read-Only Memory (Programmable Read-Only Memory, PROM), erasable programmable Read-Only Memory (Erasable Programmable Read-Only Memory, EPROM), one-time programmable Read-Only Memory (OTPROM), electrically erasable programmable Read-Only Memory (EEPROM), compact disc Read-Only Memory (Compact Disc Read-Only Memory, CD-ROM), or other optical disk Memory, magnetic disk Memory, tape Memory, or any other medium capable of being used to carry or store data that is readable by a computer.
The method, the device, the electronic equipment and the storage medium for optimizing the picture display disclosed by the embodiment of the invention are described in detail, and specific examples are applied to the description of the principle and the implementation mode of the invention, and the description of the above embodiments is only used for helping to understand the method and the core idea of the invention; meanwhile, as those skilled in the art will have variations in the specific embodiments and application scope in accordance with the ideas of the present invention, the present description should not be construed as limiting the present invention in view of the above.
Claims (12)
1. A method for optimizing display of a picture, comprising:
acquiring an initial image and operation coordinates of a user, and converting the operation coordinates into the initial image to obtain intention coordinates;
cutting the initial image by utilizing a first preset rule based on the intention coordinate to obtain a rough block diagram;
simultaneously performing a first operation and a second operation on the rough block diagram, wherein the first operation is to perform image enhancement processing on the rough block diagram to obtain an enhanced rough block diagram; the second operation is to determine fine frame coordinates corresponding to the intention coordinates by utilizing a second preset rule based on the coarse frame and the intention coordinates;
sending the enhanced rough block diagram and the fine frame coordinate to a client so that the client displays the position of the fine frame coordinate in the enhanced rough block diagram;
acquiring an initial image and operation coordinates of a user, and converting the operation coordinates into the initial image to obtain intention coordinates, wherein the method comprises the following steps of:
receiving an initial image and operation coordinates sent by a client; the initial image is an image obtained by photographing the carrier by using a camera when the client receives the trigger instruction; the operation coordinates are operation tracks of a user identified by the camera on the carrier by using the operation body;
and obtaining the corresponding intention coordinates of the operation coordinates on the initial image by utilizing coordinate transformation.
2. The method according to claim 1, characterized in that the method further comprises:
after the second operation is executed, judging whether the first operation is executed;
if the first operation is executed, acquiring a fine block diagram according to the enhanced coarse block diagram and the fine block diagram coordinates;
if the first operation is not finished, acquiring a fine block diagram according to the coarse block diagram and the fine block diagram coordinates;
and identifying the precise block diagram to obtain character information, and carrying out related search based on the character information to obtain a search result.
3. The method according to claim 2, characterized in that the method further comprises:
saving the search result; or/and the combination of the two,
all or part of the search results are sent to the client.
4. The method according to claim 2, characterized in that the method further comprises:
receiving fine frame adjustment coordinates after the user adjusts the fine frame coordinates through a client;
and determining a fine frame region according to the fine frame adjustment coordinates and the enhanced coarse frame diagram to obtain a target picture in the fine frame region.
5. The method according to claim 4, further comprising:
terminating the relevant search by the fine block diagram;
and identifying the target picture to obtain target character information, and carrying out related search based on the target character information to obtain a search result.
6. The method according to any one of claims 1-5, further comprising:
storing the reinforced coarse frame coordinates and the fine frame coordinates, and establishing a mapping relation between the reinforced coarse frame coordinates and the fine frame coordinates; or/and, storing the enhanced coarse block diagram and the fine block diagram obtained by the fine block diagram coordinates;
and if the fine frame adjustment coordinates obtained after the user adjusts the fine frame coordinates through the client are received, replacing the fine frame coordinates with the fine frame adjustment coordinates.
7. An apparatus for optimizing display of pictures, comprising:
the acquisition unit is used for acquiring an initial image and operation coordinates of a user, and converting the operation coordinates into the initial image to obtain intention coordinates;
the clipping unit is used for clipping the initial image by utilizing a first preset rule based on the intention coordinate to obtain a rough block diagram;
the processing unit is used for simultaneously carrying out a first operation and a second operation on the rough block diagram, wherein the first operation is to carry out image enhancement processing on the rough block diagram to obtain an enhanced rough block diagram; the second operation is to determine fine frame coordinates corresponding to the intention coordinates by utilizing a second preset rule based on the coarse frame and the intention coordinates;
the sending unit is used for sending the enhanced rough block diagram and the fine frame coordinate to the client so that the client displays the fine frame coordinate at the position of the enhanced rough block diagram;
acquiring an initial image and operation coordinates of a user, and converting the operation coordinates into the initial image to obtain intention coordinates, wherein the method comprises the following steps of:
receiving an initial image and operation coordinates sent by a client; the initial image is an image obtained by photographing the carrier by using a camera when the client receives the trigger instruction; the operation coordinates are operation tracks of a user identified by the camera on the carrier by using the operation body;
and obtaining the corresponding intention coordinates of the operation coordinates on the initial image by utilizing coordinate transformation.
8. The apparatus of claim 7, further comprising a search unit, the search unit comprising:
the judging subunit is used for judging whether the first operation is executed after the second operation is executed;
the first execution subunit is used for acquiring a fine block diagram according to the enhanced coarse block diagram and the fine block diagram coordinates if the first operation is completed;
the second execution subunit is used for acquiring a fine block diagram according to the coarse block diagram and the fine block diagram coordinates if the first operation is not completed;
and the result acquisition subunit is used for identifying the precise block diagram to obtain character information, and carrying out related search based on the character information to obtain a search result.
9. The apparatus of claim 8, further comprising an adjustment unit comprising:
the first subunit is used for receiving fine frame adjustment coordinates after the user adjusts the fine frame coordinates through the client;
and the second subunit is used for determining a fine frame area according to the fine frame adjustment coordinates and the enhanced coarse block diagram to obtain a target picture in the fine frame area.
10. The apparatus of claim 9, wherein the adjustment unit further comprises:
a third subunit for terminating the relevant search by the fine block diagram;
and the fourth subunit is used for identifying the target picture to obtain target character information, and carrying out related search based on the target character information to obtain a search result.
11. An electronic device, comprising: a memory storing executable program code; a processor coupled to the memory; the processor invokes the executable program code stored in the memory for performing a method of picture display optimization as claimed in any one of claims 1 to 6.
12. A computer-readable storage medium storing a computer program, wherein the computer program causes a computer to execute a method of optimizing a display of a picture according to any one of claims 1 to 6.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010393643.2A CN111582281B (en) | 2020-05-11 | 2020-05-11 | Picture display optimization method and device, electronic equipment and storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010393643.2A CN111582281B (en) | 2020-05-11 | 2020-05-11 | Picture display optimization method and device, electronic equipment and storage medium |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN111582281A CN111582281A (en) | 2020-08-25 |
| CN111582281B true CN111582281B (en) | 2023-05-16 |
Family
ID=72115627
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202010393643.2A Active CN111582281B (en) | 2020-05-11 | 2020-05-11 | Picture display optimization method and device, electronic equipment and storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN111582281B (en) |
Families Citing this family (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112488110A (en) * | 2020-12-18 | 2021-03-12 | 深圳简捷电子科技有限公司 | Method and system for accurately capturing local information in picture |
Citations (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106127859A (en) * | 2016-06-28 | 2016-11-16 | 华中师范大学 | A kind of mobile augmented reality type scribble is painted this sense of reality and is generated method |
Family Cites Families (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN108182276A (en) * | 2018-01-25 | 2018-06-19 | 广东小天才科技有限公司 | Method for searching questions based on shot picture and electronic equipment |
| CN109933262B (en) * | 2019-03-08 | 2020-12-08 | 江西理工大学南昌校区 | GIF screen capturing method and device |
| CN110276269B (en) * | 2019-05-29 | 2021-06-29 | 西安交通大学 | Remote sensing image target detection method based on attention mechanism |
| CN110309746A (en) * | 2019-06-21 | 2019-10-08 | 国网辽宁省电力有限公司鞍山供电公司 | High-grade information security area list data information extracting method without communication interconnection |
| CN110263794B (en) * | 2019-06-26 | 2021-07-02 | 国网山东省电力公司建设公司 | Training method of target recognition model based on data enhancement |
-
2020
- 2020-05-11 CN CN202010393643.2A patent/CN111582281B/en active Active
Patent Citations (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106127859A (en) * | 2016-06-28 | 2016-11-16 | 华中师范大学 | A kind of mobile augmented reality type scribble is painted this sense of reality and is generated method |
Also Published As
| Publication number | Publication date |
|---|---|
| CN111582281A (en) | 2020-08-25 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN111753767B (en) | Method and device for automatically correcting operation, electronic equipment and storage medium | |
| CN110162164B (en) | Augmented reality-based learning interaction method, device and storage medium | |
| KR102124466B1 (en) | Apparatus and method for generating conti for webtoon | |
| CN111563512B (en) | Method and device for automatically smearing answers, electronic equipment and storage medium | |
| CN111191067A (en) | Picture book identification method, terminal device and computer readable storage medium | |
| US20230027412A1 (en) | Method and apparatus for recognizing subtitle region, device, and storage medium | |
| CN111753120B (en) | Question searching method and device, electronic equipment and storage medium | |
| CN108121987B (en) | Information processing method and electronic equipment | |
| CN111581367A (en) | Method and system for inputting questions | |
| CN112949649B (en) | Text image identification method and device and computing equipment | |
| CN108256523A (en) | Recognition methods, device and computer readable storage medium based on mobile terminal | |
| CN111524045A (en) | Dictation method and device | |
| CN114529635B (en) | Image generation method, device, storage medium and equipment | |
| CN112149680A (en) | Wrong word detection and identification method and device, electronic equipment and storage medium | |
| CN111079726B (en) | Image processing method and electronic equipment | |
| CN111985184A (en) | Auxiliary writing font copying method, system and device based on AI vision | |
| CN111753715A (en) | Method and device for shooting test questions in click-to-read scene, electronic equipment and storage medium | |
| CN111582281B (en) | Picture display optimization method and device, electronic equipment and storage medium | |
| CN110674825A (en) | Character recognition method, device and system applied to intelligent voice mouse and storage medium | |
| CN112835807B (en) | Interface identification method and device, electronic equipment and storage medium | |
| CN110795918A (en) | Method, device and equipment for determining reading position | |
| CN112163513A (en) | Information selection method, system, device, electronic equipment and storage medium | |
| CN111008295A (en) | Page retrieval method and device, electronic equipment and storage medium | |
| CN111553365B (en) | Question selection method and device, electronic equipment and storage medium | |
| CN111711758B (en) | Multi-pointing test question shooting method and device, electronic equipment and storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |