CN111526364A - Image processing method, device and system - Google Patents
Image processing method, device and system Download PDFInfo
- Publication number
- CN111526364A CN111526364A CN202010388114.3A CN202010388114A CN111526364A CN 111526364 A CN111526364 A CN 111526364A CN 202010388114 A CN202010388114 A CN 202010388114A CN 111526364 A CN111526364 A CN 111526364A
- Authority
- CN
- China
- Prior art keywords
- image
- characters
- character
- code stream
- decoding
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000003672 processing method Methods 0.000 title description 12
- 238000012545 processing Methods 0.000 claims abstract description 51
- 238000000034 method Methods 0.000 claims abstract description 46
- 238000012549 training Methods 0.000 claims description 25
- 238000013528 artificial neural network Methods 0.000 claims description 15
- 238000003062 neural network model Methods 0.000 claims description 7
- 238000001514 detection method Methods 0.000 claims description 4
- 230000011218 segmentation Effects 0.000 claims description 3
- 238000010586 diagram Methods 0.000 description 6
- 238000003491 array Methods 0.000 description 4
- 230000006835 compression Effects 0.000 description 3
- 238000007906 compression Methods 0.000 description 3
- 230000008878 coupling Effects 0.000 description 3
- 238000010168 coupling process Methods 0.000 description 3
- 238000005859 coupling reaction Methods 0.000 description 3
- 238000004891 communication Methods 0.000 description 2
- 238000005034 decoration Methods 0.000 description 2
- 230000000694 effects Effects 0.000 description 2
- 238000012986 modification Methods 0.000 description 2
- 230000004048 modification Effects 0.000 description 2
- 230000005540 biological transmission Effects 0.000 description 1
- 230000007547 defect Effects 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
- 230000007717 exclusion Effects 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
- H04N19/134—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or criterion affecting or controlling the adaptive coding
- H04N19/146—Data rate or code amount at the encoder output
-
- G06T5/73—
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T7/00—Image analysis
- G06T7/10—Segmentation; Edge detection
- G06T7/11—Region-based segmentation
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V30/00—Character recognition; Recognising digital ink; Document-oriented image-based pattern recognition
- G06V30/40—Document-oriented image-based pattern recognition
- G06V30/41—Analysis of document content
- G06V30/413—Classification of content, e.g. text, photographs or tables
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
- H04N19/169—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding
- H04N19/17—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object
- H04N19/176—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object the region being a block, e.g. a macroblock
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/85—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using pre-processing or post-processing specially adapted for video compression
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/20—Special algorithmic details
- G06T2207/20021—Dividing image into blocks, subimages or windows
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/20—Special algorithmic details
- G06T2207/20112—Image segmentation details
- G06T2207/20164—Salient point detection; Corner detection
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Computer Vision & Pattern Recognition (AREA)
- Signal Processing (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Theoretical Computer Science (AREA)
- Artificial Intelligence (AREA)
- Compression Or Coding Systems Of Tv Signals (AREA)
Abstract
The invention discloses a method, a device and a system for processing an image. Wherein, the method comprises the following steps: marking image blocks containing characters in the image; respectively coding image blocks and images containing characters to generate character position code streams and image code streams; and sending the character position code stream and the image code stream to a receiving device. The invention solves the technical problem that in the process of compressing the video according to H.264/H.265 in the prior art, if the code stream is small, the characters are fuzzy when the picture is displayed.
Description
Technical Field
The present invention relates to the field of image processing, and in particular, to a method, an apparatus, and a system for image processing.
Background
H.264 is a video compression standard which is the mainstream at present, and H.265 is an upgrade version of H.264, so that the code stream can be further reduced. However, when image compression is performed using these two compression standards, if the code stream is small, the characters in the picture will be blurred.
Aiming at the problem that in the process of compressing a video according to H.264/H.265 in the prior art, if the code stream is small, the characters are fuzzy when a picture is displayed, an effective solution is not provided at present.
Disclosure of Invention
The embodiment of the invention provides an image processing method, device and system, which at least solve the technical problem that in the process of compressing a video according to H.264/H.265 in the prior art, if the code stream is small, the characters are fuzzy when a picture is displayed.
According to an aspect of an embodiment of the present invention, there is provided an image processing method including: marking image blocks containing characters in the image; respectively coding image blocks and images containing characters to generate character position code streams and image code streams; and sending the character position code stream and the image code stream to a receiving device.
Optionally, before marking an image block containing a text in an image, the method further includes: acquiring an image to be processed; performing pixel segmentation on an image to be processed to obtain image blocks forming the image; and judging whether each image block contains characters or not.
Further, optionally, the determining whether each image block contains characters includes: judging the area of the characters in each image block according to the drawing instruction; or, the region where the characters are located is obtained from each image block through corner detection.
Optionally, marking image blocks containing characters in an image includes: if the image blocks forming the image contain characters, marking a first identifier for the image blocks; if the image blocks forming the image do not contain characters, marking a second identifier for the image blocks; and acquiring an image block containing characters according to the first identifier.
Optionally, encoding an image block including a character, and generating a character position code stream includes: and coding the image block containing the characters through lossless coding to generate a character position code stream.
According to another aspect of the embodiments of the present invention, there is provided an image processing method including: receiving a character position code stream and an image code stream sent by a sending device; respectively decoding the character position code stream and the image code stream to obtain character macro block information and a first decoding image; and carrying out image restoration according to the character macro block information and the first decoding image to obtain a second decoding image.
Optionally, performing image restoration according to the text macroblock information and the first decoded image to obtain a second decoded image includes: acquiring the position of an image block containing characters from a first decoding image according to character macro block information; performing character processing on the first decoded image according to the position of the image block containing the characters to obtain an image block with character definition meeting a preset condition; and replacing the image block of the characters in the first decoded image with the image block of which the character definition meets the preset condition to obtain a second decoded image.
Further, optionally, performing character processing on the first decoded image according to the position of the image block containing the characters to obtain an image block whose character definition meets a preset condition includes: sharpening an image block containing characters to obtain an image block with character definition meeting a preset condition; or, performing character processing on the image blocks containing the characters according to a preset image neural network to obtain the image blocks with the character definitions meeting the preset conditions.
Optionally, before performing word processing on the first decoded image according to the position of the image block containing the characters to obtain an image block whose character definition meets a preset condition, training a neural network to obtain the preset image neural network includes: taking image blocks which meet preset conditions and contain characters as training targets; coding image blocks which meet preset conditions and contain characters to obtain training samples; and training the neural network model according to the training target and the training sample to obtain a preset image neural network.
According to still another aspect of the embodiments of the present invention, there is also provided an apparatus for image processing, including: the marking module is used for marking image blocks containing characters in the image; the encoding module is used for respectively encoding the image blocks and the images containing the characters to generate character position code streams and image code streams; and the sending module is used for sending the character position code stream and the image code stream to the receiving device.
According to still another aspect of the embodiments of the present invention, there is also provided an apparatus for image processing, including: the receiving module is used for receiving the character position code stream and the image code stream sent by the sending device; the decoding module is used for respectively decoding the character position code stream and the image code stream to obtain character macro block information and a first decoding image; and the restoring module is used for restoring the image according to the character macro block information and the first decoding image to obtain a second decoding image.
According to an aspect of another embodiment of the present invention, there is also provided an image processing system including: the device comprises a transmitting device and a receiving device, wherein the transmitting device is used for marking image blocks containing characters in an image; respectively coding image blocks and images containing characters to generate character position code streams and image code streams; sending the character position code stream and the image code stream to a receiving device; the receiving device is used for receiving the character position code stream and the image code stream sent by the sending device; respectively decoding the character position code stream and the image code stream to obtain character macro block information and a first decoding image; and carrying out image restoration according to the character macro block information and the first decoding image to obtain a second decoding image.
According to an aspect of another embodiment of the present invention, there is also provided a storage medium, where the storage medium includes a stored program, and where the method of controlling an apparatus in which the storage medium is located to perform the above-mentioned image processing is performed when the program is executed.
According to an aspect of another embodiment of the present invention, there is further provided a processor, where the processor is configured to execute a program, where the program executes the method for processing the image.
In the embodiment of the invention, the image blocks containing characters in the image are marked; respectively coding image blocks and images containing characters to generate character position code streams and image code streams; the character position code stream and the image code stream are sent to the receiving device, the purpose of improving the character definition is achieved, the technical effect that the character definition is reduced when the code stream is reduced by the existing coding method is overcome, and the technical problem that characters are fuzzy when a picture is displayed due to the fact that the code stream is small in the process of compressing videos according to H.264/H.265 in the prior art is solved.
Drawings
The accompanying drawings, which are included to provide a further understanding of the invention and are incorporated in and constitute a part of this application, illustrate embodiment(s) of the invention and together with the description serve to explain the invention without limiting the invention. In the drawings:
fig. 1 is a flowchart schematically illustrating a method of image processing according to embodiment 1 of the present invention;
fig. 2 is a flowchart illustrating a method of image processing according to embodiment 1 of the present invention;
fig. 3 is a flowchart schematically illustrating a method of image processing according to embodiment 2 of the present invention;
fig. 4 is a flowchart illustrating a method of image processing according to embodiment 2 of the present invention;
fig. 5 is a schematic diagram of an apparatus for image processing according to embodiment 3 of the present invention;
fig. 6 is a schematic diagram of an apparatus for image processing according to embodiment 4 of the present invention;
fig. 7 is a schematic diagram of a system for image processing according to embodiment 5 of the present invention.
Detailed Description
In order to make the technical solutions of the present invention better understood, the technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are only a part of the embodiments of the present invention, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
It should be noted that the terms "first," "second," and the like in the description and claims of the present invention and in the drawings described above are used for distinguishing between similar elements and not necessarily for describing a particular sequential or chronological order. It is to be understood that the data so used is interchangeable under appropriate circumstances such that the embodiments of the invention described herein are capable of operation in sequences other than those illustrated or described herein. Furthermore, the terms "comprises," "comprising," and "having," and any variations thereof, are intended to cover a non-exclusive inclusion, such that a process, method, system, article, or apparatus that comprises a list of steps or elements is not necessarily limited to those steps or elements expressly listed, but may include other steps or elements not expressly listed or inherent to such process, method, article, or apparatus.
Example 1
In accordance with an embodiment of the present invention, there is provided a method embodiment of a method of image processing, it being noted that the steps illustrated in the flowchart of the figure may be performed in a computer system such as a set of computer-executable instructions and that, although a logical order is illustrated in the flowchart, in some cases the steps illustrated or described may be performed in an order different than here.
Fig. 1 is a flowchart illustrating a method of image processing according to embodiment 1 of the present invention, and as shown in fig. 1, the method of image processing provided by the embodiment of the present application includes the following steps:
step S102, marking image blocks containing characters in the image;
optionally, before marking image blocks including characters in an image in step S102, the image processing method provided in the embodiment of the present application further includes: acquiring an image to be processed; performing pixel segmentation on an image to be processed to obtain image blocks forming the image; and judging whether each image block contains characters or not.
Further, optionally, the determining whether each image block contains characters includes: judging the area of the characters in each image block according to the drawing instruction; or, the region where the characters are located is obtained from each image block through corner detection.
Specifically, acquiring the image to be processed in the sending device may be acquiring a computer screen, where the computer screen may include: the pictures displayed in the computer, such as an operation window, an executed operation instruction, a played multimedia picture and the like. In this embodiment of the present application, a computer screen is taken as an image to be processed, and based on the acquired image to be processed, the screen is divided into macroblocks (i.e., image blocks in this embodiment) that do not overlap with each other according to N × M pixels, such as: the image to be processed is divided into images composed of A macroblocks.
It is determined whether each macroblock contains text and 0/1 is used to record whether the macroblock contains text. For example, the inclusion text is marked as 0, and the non-inclusion text is marked as 1; or the inclusion characters are 1, and the exclusion characters are 0. Labeled by 0/1, an array containing A0/1 was obtained.
Wherein, judging whether each image block contains characters comprises the following steps: judging the area of the characters in each image block according to the drawing instruction; or, the area where the characters are located is obtained from each image block through corner detection, so that whether the macro blocks contain the characters or not is rapidly and respectively determined from the A0/1 arrays.
Optionally, the step S102 of marking image blocks containing characters in the image includes:
step S1021, if the image blocks forming the image contain characters, marking a first identifier for the image blocks;
step S1022, if the image blocks constituting the image do not contain characters, marking a second identifier for the image block;
in step S1023, the image block including the text is obtained according to the first identifier.
Specifically, with reference to steps S1021 to S1023, assuming that the first identifier is 1 and the second identifier is 2, if an image block constituting an image includes a character, the image block is marked as 1, and if the image block constituting the image does not include a character, the image block is marked as 0;
and sorting the image blocks containing 1 in the A0/1 arrays to obtain image blocks containing characters.
Step S104, respectively coding image blocks and images containing characters to generate character position code streams and image code streams;
optionally, step S104 encodes the image block containing the text, and generating the text position code stream includes:
step S1041, encoding the image block including the characters by lossless encoding, and generating a character position code stream.
Specifically, in combination with step S102, based on the obtained image blocks marked with characters, the position of each image block containing characters is obtained according to a plurality of arrays of 0/1, and lossless coding is performed based on the position and the marked character image blocks, so as to obtain a character position code stream; and sending the image blocks not containing characters into an H.264/265 encoder for encoding to obtain an image code stream, wherein the image to be processed contains the image blocks not containing characters in addition to the characters.
Because the A0/1 arrays only contain 0/1, the code stream after coding is small, the size of the code stream can be reduced, and the transmission efficiency of the code stream can be improved.
And step S106, sending the character position code stream and the image code stream to a receiving device.
Specifically, based on the character position code stream and the image code stream obtained in step S104, the character position code stream and the image code stream are sent to the receiving device, so that the receiving device performs decoding display according to the character position code stream and the image code stream.
In summary, with reference to steps S102 to S106, as shown in fig. 2, fig. 2 is a flowchart illustrating an image processing method according to embodiment 1 of the present invention, and the image processing method provided in the embodiment of the present invention specifically includes:
step1, acquiring a current computer screen image;
step2: dividing the computer screen image into a plurality of macro blocks according to NxM;
step3, judging whether each macro block contains characters or not, and recording;
step4, coding the position of the character macro block by using lossless coding to obtain a character position code stream;
step5, encoding the image by using H.264/265 to obtain an image code stream;
and Step6, sending the character position code stream and the image code stream to a receiving device.
In the embodiment of the invention, the image blocks containing characters in the image are marked; respectively coding image blocks and images containing characters to generate character position code streams and image code streams; the character position code stream and the image code stream are sent to the receiving device, the purpose of improving the character definition is achieved, the technical effect that the character definition is reduced when the code stream is reduced by the existing coding method is overcome, and the technical problem that characters are fuzzy when a picture is displayed due to the fact that the code stream is small in the process of compressing videos according to H.264/H.265 in the prior art is solved.
Example 2
According to another aspect of the embodiments of the present invention, there is provided an image processing method, and fig. 3 is a flowchart of the image processing method according to embodiment 2 of the present invention, and as shown in fig. 3, the method is applied to a receiving apparatus, and includes:
step S302, receiving character position code stream and image code stream sent by a sending device;
specifically, the text position code stream and the h.264/h.265 video code stream (i.e., the image code stream in the embodiment of the present application) sent by the sending device are received.
Step S304, respectively decoding the character position code stream and the image code stream to obtain character macro block information and a first decoding image;
specifically, decompressing the text macro block position code stream to obtain text macro block information; and sending the H.264/265 code stream into a decoder for decoding to obtain a first decoded image.
And S306, carrying out image restoration according to the character macro block information and the first decoding image to obtain a second decoding image.
Optionally, the step S306 of performing image restoration according to the text macroblock information and the first decoded image to obtain a second decoded image includes:
step S3062, the position of the image block containing the characters is obtained from the first decoding image according to the character macro block information;
step S3064, according to the position of the image block containing characters, performing character processing on the first decoding image to obtain an image block with character definition meeting preset conditions;
step S3066, the image block whose character sharpness satisfies the preset condition is substituted for the position of the image block of the character in the first decoded image to obtain a second decoded image.
Specifically, the position of a text macro block (i.e., the position of an image block including text in the embodiment of the present application) is determined from a first decoded image according to text macro block information, and the determined text macro block is processed to obtain an image with high text definition (i.e., a second decoded image in the embodiment of the present application);
wherein, processing the determined character macro block comprises: and processing the characters of the macro blocks to obtain an image meeting the resolution, namely, obtaining a second decoded image with the resolution higher than that of the first decoded image.
Or the like, or, alternatively,
and under the condition that the character definition of the second decoded image is higher than that of the first decoded image, the difference between the character definition of the first decoded image and the character definition of the second decoded image is larger than a preset threshold, and under the condition that the difference is larger than the preset threshold, the character definition in the second decoded image is determined to be higher than that in the first decoded image.
It should be noted that the second decoded image is obtained by replacing the position of the image block of the characters in the first decoded image with the image block whose character definition meets the preset condition in step S3064, so that an image with high character definition can be obtained by the decoding device under the condition that the code stream is not significantly increased by the sending device, thereby making up for the defect that the character definition is reduced while the code stream is reduced by the conventional h.264/h.265 encoding method.
Further, optionally, the performing character processing on the first decoded image according to the position of the image block including the characters in step S3064 to obtain an image block whose character definition meets a preset condition includes: sharpening an image block containing characters to obtain an image block with character definition meeting a preset condition; or, performing character processing on the image blocks containing the characters according to a preset image neural network to obtain the image blocks with the character definitions meeting the preset conditions.
Optionally, before performing word processing on the first decoded image according to the position of the image block including the characters in step S3064 to obtain an image block whose character definition meets a preset condition, training a neural network to obtain the preset image neural network includes: taking image blocks which meet preset conditions and contain characters as training targets; coding image blocks which meet preset conditions and contain characters to obtain training samples; and training the neural network model according to the training target and the training sample to obtain a preset image neural network.
Specifically, the method for performing character processing on a first decoded image according to a position of an image block including characters to obtain an image block whose character definition meets a preset condition provided by the embodiment of the present application includes the following two implementation manners:
the first method is as follows: sharpening an image block containing characters to obtain an image block with character definition meeting a preset condition;
the second method comprises the following steps: performing character processing on an image block containing characters according to a preset image neural network to obtain an image block with character definition meeting a preset condition;
wherein, training the neural network to obtain the preset image neural network may include:
the neural network model is trained in advance, so that the trained neural network model has the capability of restoring clear character images.
The specific training method comprises the following steps:
preparing a large number of original character macro block images (with high definition) as training targets in advance;
after the original character macro block images are coded by H.264/H.265, the images are used as training samples;
training the neural network model by continuously inputting training samples and training targets, so that the neural network model has the capability of restoring high-definition character macro block images.
In summary, with reference to steps S302 to S306, as shown in fig. 4, fig. 4 is a flowchart illustrating an image processing method according to embodiment 2 of the present invention, and the image processing method provided in the embodiment of the present invention specifically includes the following steps:
step1, receiving the character position code stream and the H.264/H.265 video code stream;
step2, decompressing the character position code stream to obtain character position information;
step3, restoring the H.264/H.265 video code stream into an image;
step4, processing the image according to the character position information;
step5, displaying the processed image.
Example 3
According to still another aspect of the embodiments of the present invention, there is also provided an image processing apparatus, and fig. 5 is a schematic diagram of an image processing apparatus according to embodiment 3 of the present invention, as shown in fig. 5, applied to a transmitting apparatus, including: a marking module 52, configured to mark image blocks containing characters in an image; the encoding module 54 is configured to encode the image block and the image containing the text, respectively, and generate a text position code stream and an image code stream; and the sending module 56 is configured to send the text position code stream and the image code stream to the receiving device.
Example 4
According to still another aspect of the embodiments of the present invention, there is further provided an image processing apparatus, and fig. 6 is a schematic diagram of an image processing apparatus according to embodiment 4 of the present invention, as shown in fig. 6, applied to a receiving apparatus, including: a receiving module 62, configured to receive a text position code stream and an image code stream sent by a sending device; a decoding module 64, configured to decode the text position code stream and the image code stream respectively to obtain text macro block information and a first decoded image; and the restoring module 66 is configured to perform image restoration according to the text macro block information and the first decoded image to obtain a second decoded image.
Example 5
According to an aspect of another embodiment of the present invention, there is further provided an image processing system, and fig. 7 is a schematic diagram of an image processing system according to embodiment 5 of the present invention, as shown in fig. 7, including: the device comprises a sending device 72 and a receiving device 74, wherein the sending device 72 is used for marking image blocks containing characters in the images; respectively coding image blocks and images containing characters to generate character position code streams and image code streams; sending the character position code stream and the image code stream to a receiving device; a receiving device 74, configured to receive the text position code stream and the image code stream sent by the sending device; respectively decoding the character position code stream and the image code stream to obtain character macro block information and a first decoding image; and carrying out image restoration according to the character macro block information and the first decoding image to obtain a second decoding image.
Specifically, as shown in fig. 7, the transmitting device 72 marks image blocks containing characters in the image; respectively coding image blocks and images containing characters to generate character position code streams and image code streams; sending the character position code stream and the image code stream to a receiving device; the receiving device 74 receives the character position code stream and the image code stream sent by the sending device; respectively decoding the character position code stream and the image code stream to obtain character macro block information and a first decoding image; and carrying out image restoration according to the character macro block information and the first decoding image to obtain a second decoding image.
Example 6
According to an aspect of another embodiment of the present invention, there is further provided a storage medium, where the storage medium includes a stored program, and where the apparatus in which the storage medium is located is controlled to execute the method of image processing in the above-mentioned embodiment 1 or 2 when the program runs.
Example 7
According to an aspect of another embodiment of the present invention, there is further provided a processor, wherein the processor is configured to execute a program, and the program executes the method of image processing in embodiment 1 or 2.
The above-mentioned serial numbers of the embodiments of the present invention are merely for description and do not represent the merits of the embodiments.
In the above embodiments of the present invention, the descriptions of the respective embodiments have respective emphasis, and for parts that are not described in detail in a certain embodiment, reference may be made to related descriptions of other embodiments.
In the embodiments provided in the present application, it should be understood that the disclosed technology can be implemented in other ways. The above-described embodiments of the apparatus are merely illustrative, and for example, the division of the units may be a logical division, and in actual implementation, there may be another division, for example, multiple units or components may be combined or integrated into another system, or some features may be omitted, or not executed. In addition, the shown or discussed mutual coupling or direct coupling or communication connection may be an indirect coupling or communication connection through some interfaces, units or modules, and may be in an electrical or other form.
The units described as separate parts may or may not be physically separate, and parts displayed as units may or may not be physical units, may be located in one place, or may be distributed on a plurality of units. Some or all of the units can be selected according to actual needs to achieve the purpose of the solution of the embodiment.
In addition, functional units in the embodiments of the present invention may be integrated into one processing unit, or each unit may exist alone physically, or two or more units are integrated into one unit. The integrated unit can be realized in a form of hardware, and can also be realized in a form of a software functional unit.
The integrated unit, if implemented in the form of a software functional unit and sold or used as a stand-alone product, may be stored in a computer readable storage medium. Based on such understanding, the technical solution of the present invention may be embodied in the form of a software product, which is stored in a storage medium and includes instructions for causing a computer device (which may be a personal computer, a server, or a network device) to execute all or part of the steps of the method according to the embodiments of the present invention. And the aforementioned storage medium includes: a U-disk, a Read-Only Memory (ROM), a Random Access Memory (RAM), a removable hard disk, a magnetic or optical disk, and other various media capable of storing program codes.
The foregoing is only a preferred embodiment of the present invention, and it should be noted that, for those skilled in the art, various modifications and decorations can be made without departing from the principle of the present invention, and these modifications and decorations should also be regarded as the protection scope of the present invention.
Claims (14)
1. A method of image processing, comprising:
marking image blocks containing characters in the image;
respectively coding the image blocks containing the characters and the images to generate character position code streams and image code streams;
and sending the character position code stream and the image code stream to a receiving device.
2. The method of claim 1, wherein before marking an image block containing a text in an image, the method further comprises:
acquiring an image to be processed;
performing pixel segmentation on the image to be processed to obtain image blocks forming the image;
and judging whether each image block contains characters or not.
3. The method of claim 2, wherein the determining whether each image block contains a text comprises:
judging the area of the characters in each image block according to the drawing instruction; or the like, or, alternatively,
and acquiring the region of the character from each image block through corner detection.
4. The method according to any one of claims 1 to 3, wherein marking image blocks containing characters in an image comprises:
if the image blocks forming the image contain the characters, marking a first identifier for the image blocks;
if the image blocks forming the image do not contain the characters, marking a second identifier for the image blocks;
and acquiring an image block containing the characters according to the first identification.
5. The method of claim 1, wherein encoding an image block containing a text and generating a text position code stream comprises:
and coding the image block containing the characters through lossless coding to generate the character position code stream.
6. A method of image processing, comprising:
receiving a character position code stream and an image code stream sent by a sending device;
respectively decoding the character position code stream and the image code stream to obtain character macro block information and a first decoding image;
and carrying out image restoration according to the character macro block information and the first decoding image to obtain a second decoding image.
7. The method of claim 6, wherein the performing image restoration according to the text macroblock information and the first decoded image to obtain a second decoded image comprises:
acquiring the position of an image block containing characters from the first decoding image according to the character macro block information;
performing character processing on the first decoded image according to the position of the image block containing the characters to obtain an image block with character definition meeting a preset condition;
and replacing the positions of the image blocks of the characters in the first decoded image with the image blocks of which the character definitions meet preset conditions to obtain a second decoded image.
8. The method of claim 7, wherein the performing word processing on the first decoded image according to the positions of the image blocks containing characters to obtain image blocks with character definitions meeting preset conditions comprises:
sharpening the image block containing the characters to obtain an image block with the character definition meeting a preset condition; or the like, or, alternatively,
and performing character processing on the image blocks containing the characters according to a preset image neural network to obtain the image blocks with the character definition meeting a preset condition.
9. The method of claim 8, wherein before performing word processing on the first decoded image according to the positions of the image blocks containing characters to obtain image blocks with character definitions meeting preset conditions, training a neural network to obtain the preset image neural network comprises:
taking the image blocks which meet the preset conditions and contain characters as training targets;
coding the image blocks which meet the preset conditions and contain characters to obtain training samples;
and training a neural network model according to the training target and the training sample to obtain the preset image neural network.
10. An apparatus for image processing, comprising:
the marking module is used for marking image blocks containing characters in the image;
the coding module is used for coding the image blocks containing the characters and the images respectively to generate character position code streams and image code streams;
and the sending module is used for sending the character position code stream and the image code stream to a receiving device.
11. An apparatus for image processing, comprising:
the receiving module is used for receiving the character position code stream and the image code stream sent by the sending device;
the decoding module is used for respectively decoding the character position code stream and the image code stream to obtain character macro block information and a first decoding image;
and the restoring module is used for restoring the image according to the character macro block information and the first decoding image to obtain a second decoding image.
12. A system for image processing, comprising: a transmitting device and a receiving device, wherein,
the sending device is used for marking image blocks containing characters in the images; respectively coding the image blocks containing the characters and the images to generate character position code streams and image code streams; sending the character position code stream and the image code stream to a receiving device;
the receiving device is used for receiving the character position code stream and the image code stream sent by the sending device; respectively decoding the character position code stream and the image code stream to obtain character macro block information and a first decoding image; and carrying out image restoration according to the character macro block information and the first decoding image to obtain a second decoding image.
13. A storage medium, wherein the storage medium comprises a stored program, and wherein a device on which the storage medium is located is controlled to perform the method of image processing according to any one of claims 1 to 9 when the program is run.
14. A processor, wherein the processor is configured to run a program, wherein the program is configured to perform the method of image processing according to any one of claims 1 to 9 when running.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010388114.3A CN111526364A (en) | 2020-05-09 | 2020-05-09 | Image processing method, device and system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010388114.3A CN111526364A (en) | 2020-05-09 | 2020-05-09 | Image processing method, device and system |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN111526364A true CN111526364A (en) | 2020-08-11 |
Family
ID=71907125
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202010388114.3A Pending CN111526364A (en) | 2020-05-09 | 2020-05-09 | Image processing method, device and system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN111526364A (en) |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20070055931A1 (en) * | 2003-05-14 | 2007-03-08 | Hiroaki Zaima | Document data output device capable of appropriately outputting document data containing a text and layout information |
| CN103873877A (en) * | 2012-12-14 | 2014-06-18 | 华为技术有限公司 | Image transmission method and device for remote desktop |
| CN108184118A (en) * | 2016-12-08 | 2018-06-19 | 中兴通讯股份有限公司 | Cloud desktop contents encode and coding/decoding method and device, system |
| CN110351564A (en) * | 2019-08-08 | 2019-10-18 | 上海纽菲斯信息科技有限公司 | A kind of text clearly video compress transmission method and system |
| CN110378338A (en) * | 2019-07-11 | 2019-10-25 | 腾讯科技（深圳）有限公司 | A kind of text recognition method, device, electronic equipment and storage medium |
-
2020
- 2020-05-09 CN CN202010388114.3A patent/CN111526364A/en active Pending
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20070055931A1 (en) * | 2003-05-14 | 2007-03-08 | Hiroaki Zaima | Document data output device capable of appropriately outputting document data containing a text and layout information |
| CN103873877A (en) * | 2012-12-14 | 2014-06-18 | 华为技术有限公司 | Image transmission method and device for remote desktop |
| CN108184118A (en) * | 2016-12-08 | 2018-06-19 | 中兴通讯股份有限公司 | Cloud desktop contents encode and coding/decoding method and device, system |
| CN110378338A (en) * | 2019-07-11 | 2019-10-25 | 腾讯科技（深圳）有限公司 | A kind of text recognition method, device, electronic equipment and storage medium |
| CN110351564A (en) * | 2019-08-08 | 2019-10-18 | 上海纽菲斯信息科技有限公司 | A kind of text clearly video compress transmission method and system |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US10771813B2 (en) | Reference frame encoding method and apparatus, and reference frame decoding method and apparatus | |
| CN108965871B (en) | Image prediction method and device | |
| CN104853209B (en) | Image coding and decoding method and device | |
| CN108271024B (en) | Image coding and decoding method and device | |
| EP3354030B1 (en) | Methods and apparatuses for encoding and decoding digital images through superpixels | |
| US7630512B2 (en) | Method for performing recoverable video and image watermarking which survives block-based video and image compression | |
| US8873625B2 (en) | Enhanced compression in representing non-frame-edge blocks of image frames | |
| US9503751B2 (en) | Method and apparatus for simplified depth coding with extended prediction modes | |
| CN110636294A (en) | Video decoding method and device, and video encoding method and device | |
| CN109640089B (en) | Image coding and decoding method and device | |
| CN111263243B (en) | Video coding method and device, computer readable medium and electronic equipment | |
| CN107483942B (en) | Decoding method of video data compressed code stream, encoding method and device of video data | |
| CN110913216A (en) | Image compression method combining block matching and string matching | |
| CN112884641A (en) | Method, device and system for image display processing | |
| CN106604032B (en) | Method and device for compressing Chinese character blocks in image and method and device for compressing image | |
| US20230370600A1 (en) | A method and apparatus for encoding and decoding one or more views of a scene | |
| US20210105488A1 (en) | Encoding and decoding a video | |
| CN102246532B (en) | Method and apparatus for avoiding quality deterioration of transmitted media content | |
| CN111526364A (en) | Image processing method, device and system | |
| CN103828366A (en) | Adaptive filtering based on pattern information | |
| CN114422788A (en) | Digital retina video joint coding method, decoding method, device and electronic equipment | |
| CN110677692B (en) | Video decoding method and device and video encoding method and device | |
| CN110545431B (en) | Video decoding method and device, video encoding method and device | |
| CN113422960A (en) | Image transmission method and device | |
| CN105828080B (en) | Image coding and decoding method and device |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20200811 |