CN108924557B - Image processing method, image processing device, electronic equipment and storage medium - Google Patents

Image processing method, image processing device, electronic equipment and storage medium Download PDF

Info

Publication number
CN108924557B
CN108924557B CN201810594562.1A CN201810594562A CN108924557B CN 108924557 B CN108924557 B CN 108924557B CN 201810594562 A CN201810594562 A CN 201810594562A CN 108924557 B CN108924557 B CN 108924557B
Authority
CN
China
Prior art keywords
block
color
layer
foreground
type
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN201810594562.1A
Other languages
Chinese (zh)
Other versions
CN108924557A (en
Inventor
何宏磊
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Vidaa Netherlands International Holdings BV
Original Assignee
Hisense Visual Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Hisense Visual Technology Co Ltd filed Critical Hisense Visual Technology Co Ltd
Priority to CN201810594562.1A priority Critical patent/CN108924557B/en
Publication of CN108924557A publication Critical patent/CN108924557A/en
Application granted granted Critical
Publication of CN108924557B publication Critical patent/CN108924557B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/169Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding
    • H04N19/17Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object
    • H04N19/176Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object the region being a block, e.g. a macroblock
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/134Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or criterion affecting or controlling the adaptive coding
    • H04N19/136Incoming video signal characteristics or properties
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/134Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or criterion affecting or controlling the adaptive coding
    • H04N19/146Data rate or code amount at the encoder output
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/30Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using hierarchical techniques, e.g. scalability

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Compression Of Band Width Or Redundancy In Fax (AREA)
  • Image Processing (AREA)

Abstract

The embodiment of the invention provides an image processing method and device, electronic equipment and a storage medium, and relates to the technical field of image processing. The method comprises the following steps: dividing a gray level image of an original image into a plurality of blocks; performing layout analysis on each block in the plurality of blocks to determine the type of each block; filling the foreground layer, the mask layer and the background layer of each block based on the type of each block; and compressing the foreground layer, the mask layer and the background layer of each block to obtain a compressed image. The technical scheme of the embodiment of the invention can realize the continuous filling of the pixel values of the image, and further improve the compression ratio of the image while ensuring the fidelity.

Description

Image processing method, image processing device, electronic equipment and storage medium
Technical Field
The present invention relates to the field of image processing technologies, and in particular, to an image processing method, an image processing apparatus, an electronic device, and a computer-readable storage medium.
Background
With the development of image processing technology, people have higher requirements on the quality of images, more and more high-resolution images are generated, and how to compress the high-resolution images is a focus of attention.
At present, commonly used image compression methods include a JPEG (Joint Photographic Experts Group) compression method, a PNG (Portable Network Graphics) compression method, and the like. However, these image compression methods can only perform compression on the basis of the original image, and it is difficult to further improve the image compression rate while maintaining fidelity.
Therefore, how to further improve the image compression rate while maintaining fidelity is an urgent technical problem to be solved.
It is to be noted that the information disclosed in the above background section is only for enhancement of understanding of the background of the invention and therefore may include information that does not constitute prior art that is already known to a person of ordinary skill in the art.
Disclosure of Invention
An object of embodiments of the present invention is to provide an image processing method, an image processing apparatus, an electronic device, and a computer-readable storage medium, which overcome one or more of the problems due to the limitations and disadvantages of the related art, at least to some extent.
According to a first aspect of embodiments of the present invention, there is provided an image processing method including: dividing a gray level image of an original image into a plurality of blocks; performing layout analysis on each block in the plurality of blocks to determine the type of each block; and filling the foreground layer, the mask layer and the background layer of each block based on the type of each block to compress the foreground layer, the mask layer and the background layer of each block to obtain a compressed image.
In some embodiments of the present invention, based on the foregoing scheme, performing layout analysis on each of the plurality of blocks to determine the type of each block includes: determining a pixel average value of each of the plurality of blocks, determining a pixel variance value of each block based on the pixel average value; each block is divided into a solid-color type block, a two-color type block, and a multi-color type block based on the pixel variance value of each block.
In some embodiments of the present invention, based on the foregoing scheme, dividing each block into a solid-color type block, a bicolor type block, and a multicolor type block based on the pixel variance value of each block includes: judging whether the pixel variance value of the block is smaller than a first variance threshold value; if the difference is less than the first variance threshold, determining the block as a pure color type block; if the variance is not smaller than the first variance threshold, judging whether the pixel variance value of the block is smaller than a second variance threshold, wherein the second variance threshold is larger than the first variance threshold; if the judgment result is smaller than the second variance threshold value, determining the block as a bicolor block; and if the judgment result is not smaller than the second variance threshold value, determining the block as a multi-color block.
In some embodiments of the present invention, based on the foregoing scheme, the image processing method further includes: judging whether the pixel average value of the pure color type block is larger than a preset threshold value or not; if the pure color type block is judged to be larger than the preset threshold value, determining the pure color type block as a pure color-foreground type block; and if the pure color type block is not larger than the preset threshold value, determining the pure color type block as a pure color-background type block.
In some embodiments of the present invention, based on the foregoing scheme, the image processing method further includes: judging whether the pixel average value of the multi-color type block is larger than the preset threshold value or not; if the judgment result is larger than the preset threshold value, determining the multi-color type block as a multi-color-foreground type block; and if the judgment result is not larger than the preset threshold value, determining the multicolor type block as a multicolor-background type block.
In some embodiments of the present invention, based on the foregoing scheme, filling the foreground layer, the mask layer, and the background layer of each block based on the type of each block includes: when the block is a pure color-foreground type block, filling the color represented by the pixel average value of the block into a foreground layer of the block; filling white color into the mask layer of the block, and filling the color of the background layer of the last pure color-background type block into the background layer of the block.
In some embodiments of the present invention, based on the foregoing scheme, filling the foreground layer, the mask layer, and the background layer of each block based on the type of each block includes:
when the block is a multi-color-foreground type block, filling the original color value of the block into a foreground layer of the block; filling white color into the mask layer of the block, and filling the color of the background layer of the last pure color-background type block into the background layer of the block.
In some embodiments of the present invention, based on the foregoing scheme, filling the foreground layer, the mask layer, and the background layer of each block based on the type of each block includes: when the block is a two-color type block, determining the foreground color and the background color of the block according to the preset threshold value; filling the foreground color into a foreground layer of the tile and filling the background color into a background layer of the tile; judging whether the pixel value of the pixel point of the block is larger than the preset threshold value or not; filling white at the pixel point if the pixel point is judged to be larger than the preset threshold value; and if the pixel point is not larger than the predetermined threshold value, filling black at the pixel point.
In some embodiments of the present invention, based on the foregoing scheme, filling the foreground layer, the mask layer, and the background layer of each block based on the type of each block includes: when the block is a multi-color-background type block, filling the color of the foreground layer of the previous pure-color-foreground type block into the foreground layer of the block; and filling black into the mask layer of the block, and filling the original color of the block into the background layer of the block.
In some embodiments of the present invention, based on the foregoing scheme, filling the foreground layer, the mask layer, and the background layer of each block based on the type of each block includes: when the block is a pure color-background type block, filling the color represented by the pixel average value of the block into a background layer of the block; and filling black into the mask layer of the block, and filling the color of the foreground layer of the previous pure color-foreground type block into the foreground layer of the block.
In some embodiments of the present invention, based on the foregoing scheme, the image processing method further includes: and carrying out reduction processing on the foreground layer and the background layer of each block.
In some embodiments of the present invention, based on the above scheme, the size of each block is one or more of 8 × 8 pixels, 4 × 4 pixels, and 2 × 2 pixels.
According to a second aspect of the embodiments of the present invention, there is provided an image processing apparatus including: a dividing unit for dividing a grayscale image of an original image into a plurality of blocks; a type determining unit, configured to perform layout analysis on each of the plurality of blocks to determine a type of each block; the filling unit is used for filling the foreground layer, the mask layer and the background layer of each block based on the type of each block; and the compression unit is used for compressing the foreground layer, the mask layer and the background layer of each block to obtain a compressed image.
According to a third aspect of embodiments of the present invention, there is provided an electronic apparatus, including: a processor; and a memory having computer readable instructions stored thereon which, when executed by the processor, implement the image processing method as described above in the first aspect.
According to a fourth aspect of embodiments of the present invention, there is provided a computer-readable storage medium having stored thereon a computer program which, when executed by a processor, implements the image processing method as described in the first aspect above.
In the technical solutions provided in some embodiments of the present invention, on one hand, a gray image of an original image is divided into a plurality of blocks, each block is subjected to layout analysis to determine the type of each block, and a foreground layer, a mask layer and a background layer of the block are filled based on the type of the block, so that a blocked image can be obtained, thereby realizing continuous filling of pixel values of the image; on the other hand, the foreground layer, the mask layer and the background layer of each block are compressed to obtain a compressed image, and most blocks are filled with pure colors, so that the encoding quantity of the compressed image can be remarkably reduced, the compression rate of the image can be further improved while fidelity is achieved, and the transmission efficiency of the image in a network can be improved.
It is to be understood that both the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the invention, as claimed.
Drawings
The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the invention and together with the description, serve to explain the principles of the invention. It is obvious that the drawings in the following description are only some embodiments of the invention, and that for a person skilled in the art, other drawings can be derived from them without inventive effort. In the drawings:
FIG. 1 illustrates a flow diagram of an image processing method according to some embodiments of the invention;
FIG. 2 illustrates a schematic diagram of a hierarchy of image processing methods according to some embodiments of the invention;
FIG. 3 shows a flow-schematic block diagram of an image processing method according to further embodiments of the present invention;
FIG. 4 illustrates a flow diagram for layout analysis of tiles in accordance with some embodiments of the invention;
FIG. 5 illustrates a schematic diagram of filling in a solid color-foreground type block according to some embodiments of the invention;
FIG. 6 illustrates a schematic diagram of filling a non-solid color-foreground type block according to some embodiments of the invention;
FIG. 7 illustrates a schematic diagram of filling in foreground-background type patches according to some embodiments of the invention;
FIG. 8 illustrates a schematic diagram of filling a non-solid color-background type tile according to some embodiments of the invention;
FIG. 9 illustrates a schematic diagram of filling in solid-background type tiles according to some embodiments of the invention;
FIG. 10 shows a schematic block diagram of an image processing apparatus according to some embodiments of the present invention;
FIG. 11 illustrates a schematic structural diagram of a computer system suitable for use with the electronic device to implement an embodiment of the invention.
Detailed Description
Example embodiments will now be described more fully with reference to the accompanying drawings. Example embodiments may, however, be embodied in many different forms and should not be construed as limited to the embodiments set forth herein; rather, these embodiments are provided so that this disclosure will be thorough and complete, and will fully convey the concept of example embodiments to those skilled in the art. The same reference numerals denote the same or similar parts in the drawings, and thus, a repetitive description thereof will be omitted.
Furthermore, the described features, structures, or characteristics may be combined in any suitable manner in one or more embodiments. In the following description, numerous specific details are provided to provide a thorough understanding of embodiments of the invention. One skilled in the relevant art will recognize, however, that the invention may be practiced without one or more of the specific details, or with other methods, components, devices, steps, and so forth. In other instances, well-known methods, devices, implementations or operations have not been shown or described in detail to avoid obscuring aspects of the invention.
The block diagrams shown in the figures are functional entities only and do not necessarily correspond to physically separate entities. I.e. these functional entities may be implemented in the form of software, or in one or more hardware modules or integrated circuits, or in different networks and/or processor means and/or microcontroller means.
The flow charts shown in the drawings are merely illustrative and do not necessarily include all of the contents and operations/steps, nor do they necessarily have to be performed in the order described. For example, some operations/steps may be decomposed, and some operations/steps may be combined or partially combined, so that the actual execution sequence may be changed according to the actual situation.
FIG. 1 illustrates a flow diagram of an image processing method according to some embodiments of the invention.
Referring to fig. 1, in step S110, a grayscale image of an original image is divided into a plurality of blocks.
In an exemplary embodiment, when the original image is a color image, the original image is subjected to a graying process to obtain a grayscale image of the original image. For example, when the original image is a color image, an average value of three components of R (Red), G (Green), and B (blue) of a pixel of the color image may be calculated by using an averaging method, and the average value may be used as the gray value of the pixel. It should be noted that the original image may be grayed in other manners, and the present invention is not limited to this.
Further, the grayscale image of the grayed original image is divided into a plurality of blocks, for example, the grayscale image may be divided into a plurality of blocks by 8 × 8 pixels. In addition, it is also within the scope of the present invention to divide the gray image into a plurality of blocks by 4 × 4 pixels or 2 × 2 pixels.
In step S120, each block of the plurality of blocks is subjected to layout analysis to determine the type of each block.
In an exemplary embodiment, the layout analysis of the blocks of the gray image divides each block into a solid type block, a two-color type block, and a multi-color type block, which represents a block having three or more colors. For example, a pixel average value of each of a plurality of blocks of the gray scale image may be determined, and a pixel variance value of each block may be calculated based on the pixel average value; each block is divided into a solid-color type block, a two-color type block, and a multi-color type block based on the pixel variance value of each block.
Further, whether the pixel average value of the pure color type block is larger than a preset threshold value or not can be judged; if the judgment result is larger than the preset threshold value, determining the pure color type block as a pure color-foreground type block; if the determination result is not greater than the predetermined threshold, the solid type block is determined as a solid-background type block.
In addition, whether the pixel average value of the multi-color type block is larger than a preset threshold value can be judged; if the judgment result is larger than the preset threshold value, determining the multi-color type block as a multi-color-foreground type block; if the judgment result is not larger than the preset threshold value, the multicolor type block is determined as the multicolor-background type block.
In this exemplary embodiment, the predetermined threshold may be an average value of the gray levels of the pixels of the gray-scale image of each block, or may be another appropriate threshold capable of dividing the image into the foreground and the background.
In step S130, the foreground layer, the mask layer, and the background layer of each block are filled based on the type of each block.
In an example embodiment, the foreground layer is filled with pixel colors of patches whose pixel mean values are greater than a predetermined threshold; and filling the pixel colors of the blocks with the pixel average value smaller than the preset threshold value into the background layer. The Mask layer retains the characteristics of the original image to which the block belongs, and is used for displaying the pixels on the block by filling the color of the pixels corresponding to the foreground layer or the color of the pixels corresponding to the background layer.
In an exemplary embodiment, when a tile is a solid-color foreground type tile, a color represented by an average value of pixels of the tile is filled into a foreground layer of the tile, a white color is filled into a mask layer of the tile, and a color of a background layer of a previous solid-color background type tile is filled into a background layer of the tile.
When the block is a multi-color-foreground type block, filling the original color value of the block into a foreground layer of the block; filling white color into the mask layer of the block, and filling the color of the background layer of the previous pure color-background type block into the background layer of the block.
When the block is a two-color block, determining the foreground color and the background color of the block according to the preset threshold value; filling the foreground color into the foreground layer of the block, and filling the background color into the background layer of the block; judging whether the pixel value of the pixel point of the block is larger than the preset threshold value; if the pixel point is judged to be larger than the preset threshold value, filling white at the pixel point; and if the pixel point is not larger than the preset threshold, filling black at the pixel point.
When the block is a multi-color-background type block, filling the color of the foreground layer of the previous pure-color-foreground type block into the foreground layer of the block; and filling black into the mask layer of the block, and filling the original color of the block into the background layer of the block.
When the block is a pure color-background type block, filling the color represented by the pixel average value of the block into the background layer of the block; and filling black into the mask layer of the block, and filling the color of the foreground layer of the previous pure color-foreground type block into the foreground layer of the block.
In step S140, the foreground layer, the mask layer, and the background layer of each block are compressed to obtain a compressed image.
In an example embodiment, the foreground layer and the background layer of each block may be compressed by a compression method such as JPEG (Joint Photographic Experts Group), JPEG200, or PNG (Portable Network Graphics), and the compression method of JBIG-level Image Experts Group or JBIG2 may be used to compress the mask layer of each block.
It should be noted that the above-mentioned compression method for compressing the foreground layer, the background layer, and the mask layer is only an example, and other suitable compression methods may also be adopted to compress the foreground layer, the background layer, and the mask layer, and the present invention is not limited to this.
According to the image processing method shown in fig. 1, on one hand, a gray image of an original image is divided into a plurality of blocks, each block is subjected to layout analysis to determine the type of each block, a foreground layer, a mask layer and a background layer of the block are filled based on the type of the block, a blocked image can be obtained, and accordingly continuous filling of pixel values of the image can be achieved; on the other hand, the foreground layer, the mask layer and the background layer of each block are compressed to obtain a compressed image, and most blocks are filled with pure colors, so that the encoding quantity of the compressed image can be remarkably reduced, the compression rate of the image can be further improved while fidelity is achieved, and the transmission efficiency of the image in a network can be improved.
In addition, in some embodiments, before the compression process, the foreground layer and the background layer of each block may be subjected to a reduction process. Because most blocks are filled with pure color, the foreground layer and the background layer are subjected to proper reduction processing, the display effect of the original image is not influenced, and the size of the color image can be effectively reduced. Since the mask layer needs to retain the most primitive and most image detail tables as possible, the mask layer is not subjected to a reduction process.
FIG. 2 illustrates a schematic diagram of the layering of image processing methods according to some embodiments of the invention.
Referring to fig. 2, an image containing text and graphics may be layered to obtain a foreground layer, a mask layer, and a background layer of the image. In the present exemplary embodiment, the pixel colors of the patches whose pixel average values are greater than the predetermined threshold value are filled into the foreground layer; filling the pixel colors of the blocks with the pixel average value smaller than a preset threshold value into the background layer; the mask layer indicates whether the color of the pixel corresponding to the foreground layer or the color of the pixel corresponding to the background layer is used when the pixel on the block is displayed.
In fig. 2, a black pixel in the mask layer represents the color filling of a corresponding pixel with the background layer when the pixel is displayed; the white pixels in the mask layer indicate that the color of the corresponding pixels in the foreground layer is used for filling when the pixels are displayed. For example, if the color of "ABCD" in the black frame in the middle of the mask layer is white, the color of the pixel corresponding to the foreground layer is used to fill the "ABCD" in the black frame in the mask layer, and the color of the pixel corresponding to the background layer is used to fill the black frame. The black frame at the lowest part of the mask layer is filled with the color of the pixel corresponding to the background layer, such as a color picture, when in display.
FIG. 3 shows a flow-chart schematic block diagram of image processing according to further embodiments of the present invention.
Referring to fig. 3, in step S310, the original color image is subjected to a graying process to obtain a grayscale image of the original color image.
In step S320, the grayscale image is divided into a plurality of blocks. The grayscale image may be divided in units of 8 × 8 pixels, or may be divided in units of 4 × 4 or 2 × 2 pixels.
In step S330, the blocks are subjected to layout analysis, and each block is divided into a solid-foreground type block, a non-solid-color, i.e., multi-color, foreground type block, a foreground + background type, i.e., bi-color, a non-solid-background type block, and a solid-color, background type block. The blocks may be classified according to their pixel mean values, pixel variance values, and corresponding mean threshold values and variance threshold values. The mean threshold represents a threshold for distinguishing between foreground and background, and the variance threshold represents a threshold for distinguishing between monochrome, bi-color, and multi-color.
In step S340, the foreground layer, the mask layer, and the background layer of each block are filled based on the type of each block. For a foreground + background type, i.e. a bicolor type block, determining the foreground color and the background color of the block according to a predetermined threshold, for example, the color larger than the predetermined threshold is the foreground color, the color smaller than the predetermined threshold is the background color, filling the foreground color into the foreground layer of the block, and filling the background color into the background layer of the block. In the mask layer, white is filled in the pixels corresponding to the foreground color, and black is filled in the pixels corresponding to the background color.
In step S350, the foreground layer and the background layer of each block are reduced. By reducing the foreground layer and the background layer of the blocked block for reduction processing, the size of the storage space of the compressed image can be effectively reduced, and the transmission efficiency of the image in the network is improved.
In step S360, the foreground layer and the background layer of each block are compressed by a compression method such as JPEG, JPEG200, or PNG, and the mask layer of each block is compressed by a compression method such as JBIG or JBIG 2.
FIG. 4 illustrates a flow diagram for layout analysis of tiles according to some embodiments of the invention.
Referring to fig. 4, in step S410, a gray scale map of an original image is divided to obtain a plurality of blocks.
In step S415, calculating a pixel average value of each block, determining a pixel variance value of each block based on the pixel average value, and determining whether the pixel variance value of each block is smaller than a first variance threshold; if the difference is smaller than the first difference threshold, determining the block as a pure color block, and then proceeding to step S445; if it is determined that the variance is not less than the first variance threshold, the process proceeds to step S420.
In step S420, it is determined whether the pixel variance value of the block is smaller than a second variance threshold, and if it is determined that the pixel variance value of the block is smaller than the second variance threshold, the process proceeds to step S425; if it is determined that the variance is not less than the second variance threshold, a value step S430 is performed, in which the second variance threshold is greater than the first variance threshold, the first variance threshold represents a threshold for distinguishing a single color from a two-color, and the second variance threshold represents a threshold for distinguishing a two-color from a multi-color.
In step S425, a block whose pixel variance is less than the second variance threshold value and greater than the first variance threshold value is determined as a two-color type block, i.e., a foreground + background type block.
In step S430, it is determined whether the average value of the pixels of the block is greater than a predetermined threshold, and if it is determined that the average value of the pixels of the block is greater than the predetermined threshold, the process proceeds to step S435; if it is determined not to be greater than the predetermined threshold, the process proceeds to step S440.
In step S435, the block is determined to be a non-solid color, i.e., a multi-color-foreground type block.
In step S440, the tile is determined to be a non-solid-background type tile.
In step S445, it is determined whether the average value of the pixels of the block is greater than a predetermined threshold, and if it is determined that the average value of the pixels of the block is greater than the predetermined threshold, the process proceeds to step S450; if it is determined not to be greater than the predetermined threshold, proceed to step S455.
In step S450, the block is determined to be a solid-foreground type block.
In step S455, the block is determined to be a solid-background type block.
Fig. 5 illustrates a schematic diagram of filling in a solid color-foreground type block according to some embodiments of the invention.
Referring to fig. 5, when the block is a solid color-foreground type block, calculating the pixel average value of the block, converting the obtained average value of the gray pixels into a color value, and filling the color value into the foreground layer of the block; the mask layer of the tile is filled with white, i.e., 1, and the background layer of the previous solid-background type tile is filled with the color of the background layer of the tile.
Fig. 6 illustrates a schematic diagram of filling a non-solid color-foreground type block according to some embodiments of the invention.
Referring to fig. 6, when the block is a multi-color-foreground type block, the original color value of the block is filled into the foreground layer of the block; the mask layer of the tile is filled with white, i.e., 1, and the background layer of the previous solid-background type tile is filled with the color of the background layer of the tile.
Fig. 7 illustrates a schematic diagram of filling in foreground-background type patches according to some embodiments of the invention.
Referring to fig. 7, when a tile is a two-color type tile, i.e., a foreground + background type tile, the foreground color and the background color of the tile are determined according to a predetermined threshold, for example, a color having a pixel value greater than the predetermined threshold is determined as a foreground color, and a color having a pixel value not greater than the predetermined threshold is determined as a background color; the foreground color is filled into the foreground layer of the tile and the background color is filled into the background layer of the tile.
Further, whether the pixel value of the pixel point of the block is larger than the preset threshold value is judged; if the pixel point is judged to be larger than the preset threshold value, filling white at the pixel point; if the pixel point is not larger than the preset threshold value, filling black at the pixel point. The predetermined threshold may be an average value of pixels of the bicolor type patch, or may be other suitable threshold capable of distinguishing between foreground and background.
Fig. 8 shows a schematic diagram of filling in non-solid-color, i.e., multi-color-background type, tiles according to some embodiments of the invention.
Referring to fig. 8, when the block is a multi-color-background type block, the color of the foreground layer of the previous pure-color-foreground type block is filled into the foreground layer of the block; black, i.e., 0, is filled into the mask layer of the tile and the original color of the tile is filled into the background layer of the tile.
Fig. 9 illustrates a schematic diagram of filling in a solid-background type tile according to some embodiments of the invention.
Referring to fig. 9, when the block is a solid-color background type block, calculating an average value of pixels of the block, converting the obtained average value of gray pixels into a color value, and filling the color value into a background layer of the block; and filling black into the mask layer of the block, and filling the color of the foreground layer of the previous pure color-foreground type block into the foreground layer of the block.
Furthermore, in an embodiment of the present invention, an image processing apparatus is also provided. Referring to fig. 10, the image processing apparatus 1000 may include: a dividing unit 1010, a type determining unit 1020, a padding unit 1030, and a compressing unit 1040. The dividing unit 1010 is configured to divide a grayscale image of an original image into a plurality of blocks; a type determining unit 1020 configured to perform layout analysis on each of the plurality of blocks to determine a type of each block; the filling unit 1030 is configured to fill the foreground layer, the mask layer, and the background layer of each block based on the type of each block; the compressing unit 1040 is configured to perform compression processing on the foreground layer, the mask layer, and the background layer of each block to obtain a compressed image.
In some embodiments of the present invention, based on the foregoing scheme, the type determining unit 1020 includes: a pixel variance value determination unit for determining a pixel average value of each of the plurality of blocks, and determining a pixel variance value of each block based on the pixel average value; and the classification unit is used for classifying each block into a pure color type block, a two-color type block and a multi-color type block based on the pixel variance value of each block.
In some embodiments of the present invention, based on the foregoing scheme, the classification unit is configured to: judging whether the pixel variance value of the block is smaller than a first variance threshold value; if the difference is less than the first variance threshold, determining the block as a pure color type block; if the variance is not smaller than the first variance threshold, judging whether the pixel variance value of the block is smaller than a second variance threshold, wherein the second variance threshold is larger than the first variance threshold; if the judgment result is smaller than the second variance threshold value, determining the block as a bicolor block; and if the judgment result is not smaller than the second variance threshold value, determining the block as a multi-color block.
In some embodiments of the present invention, based on the foregoing solution, the image processing apparatus 1000 further includes: the first judging unit is used for judging whether the pixel average value of the pure color type block is larger than a preset threshold value or not; a first determination unit configured to determine the solid-color type block as a solid-color-foreground type block when it is determined that the color is larger than the predetermined threshold; a second determination unit configured to determine the solid-color type patch as a solid-color-background type patch if it is determined that the solid-color type patch is not greater than the predetermined threshold.
In some embodiments of the present invention, based on the foregoing solution, the image processing apparatus 1000 further includes: a second judging unit, configured to judge whether a pixel average value of the multi-color type block is greater than the predetermined threshold; a third determining unit, configured to determine the multi-color type block as a multi-color-foreground type block if it is determined that the multi-color type block is greater than the predetermined threshold; a fourth judging unit configured to determine the multicolor-type block as a multicolor-background-type block when it is determined that the number of the multicolor-type blocks is not greater than the predetermined threshold.
In some embodiments of the present invention, based on the foregoing scheme, the filling unit 1030 is configured to: when the block is a pure color-foreground type block, filling the color represented by the pixel average value of the block into a foreground layer of the block; filling white color into the mask layer of the block, and filling the color of the background layer of the last pure color-background type block into the background layer of the block.
In some embodiments of the present invention, based on the foregoing scheme, the filling unit 1030 is configured to: when the block is a multi-color-foreground type block, filling the original color value of the block into a foreground layer of the block; filling white color into the mask layer of the block, and filling the color of the background layer of the last pure color-background type block into the background layer of the block.
In some embodiments of the present invention, based on the foregoing scheme, the filling unit 1030 is configured to: when the block is a two-color type block, determining the foreground color and the background color of the block according to the preset threshold value; filling the foreground color into a foreground layer of the tile and filling the background color into a background layer of the tile; judging whether the pixel value of the pixel point of the block is larger than the preset threshold value or not; filling white at the pixel point if the pixel point is judged to be larger than the preset threshold value; and if the pixel point is not larger than the predetermined threshold value, filling black at the pixel point.
In some embodiments of the present invention, based on the foregoing scheme, the filling unit 1030 is configured to: when the block is a multi-color-background type block, filling the color of the foreground layer of the previous pure-color-foreground type block into the foreground layer of the block; and filling black into the mask layer of the block, and filling the original color of the block into the background layer of the block.
In some embodiments of the present invention, based on the foregoing scheme, the filling unit 1030 is configured to: when the block is a pure color-background type block, filling the color represented by the pixel average value of the block into a background layer of the block; and filling black into the mask layer of the block, and filling the color of the foreground layer of the previous pure color-foreground type block into the foreground layer of the block.
In some embodiments of the present invention, based on the foregoing solution, the image processing apparatus 1000 further includes: and the scaling unit is used for carrying out reduction processing on the foreground layer and the background layer of each block.
In some embodiments of the present invention, based on the above scheme, the size of each block is one or more of 8 × 8 pixels, 4 × 4 pixels, and 2 × 2 pixels.
Since each functional module of the image processing apparatus 1000 according to the exemplary embodiment of the present invention corresponds to the steps of the exemplary embodiment of the image processing method described above, the description thereof is omitted here.
In an exemplary embodiment of the present invention, there is also provided an electronic device capable of implementing the above method.
Referring now to FIG. 11, shown is a block diagram of a computer system 1100 suitable for use in implementing an electronic device of an embodiment of the present invention. The computer system 1100 of the electronic device shown in fig. 11 is only an example, and should not bring any limitation to the function and the scope of use of the embodiments of the present invention.
As shown in fig. 11, the computer system 1100 includes a Central Processing Unit (CPU)1101, which can perform various appropriate actions and processes in accordance with a program stored in a Read Only Memory (ROM)1102 or a program loaded from a storage section 1108 into a Random Access Memory (RAM) 1103. In the RAM 1103, various programs and data necessary for system operation are also stored. The CPU 1101, ROM 1102, and RAM 1103 are connected to each other by a bus 1104. An input/output (I/O) interface 1105 is also connected to bus 1104.
The following components are connected to the I/O interface 1105: an input portion 1106 including a keyboard, mouse, and the like; an output portion 1107 including a signal output unit such as a Cathode Ray Tube (CRT), a Liquid Crystal Display (LCD), and a speaker; a storage section 1108 including a hard disk and the like; and a communication section 1109 including a network interface card such as a LAN card, a modem, or the like. The communication section 1109 performs communication processing via a network such as the internet. A driver 1110 is also connected to the I/O interface 1105 as necessary. A removable medium 1111 such as a magnetic disk, an optical disk, a magneto-optical disk, a semiconductor memory, or the like is mounted on the drive 1110 as necessary, so that a computer program read out therefrom is mounted into the storage section 1108 as necessary.
In particular, according to an embodiment of the present invention, the processes described above with reference to the flowcharts may be implemented as computer software programs. For example, embodiments of the invention include a computer program product comprising a computer program embodied on a computer-readable medium, the computer program comprising program code for performing the method illustrated in the flow chart. In such an embodiment, the computer program may be downloaded and installed from a network through the communication portion 1109 and/or installed from the removable medium 1111. The above-described functions defined in the system of the present application are executed when the computer program is executed by a Central Processing Unit (CPU) 1101.
It should be noted that the computer readable medium shown in the present invention can be a computer readable signal medium or a computer readable storage medium or any combination of the two. A computer readable storage medium may be, for example, but not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any combination of the foregoing. More specific examples of the computer readable storage medium may include, but are not limited to: an electrical connection having one or more wires, a portable computer diskette, a hard disk, a Random Access Memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing. In the present invention, a computer readable storage medium may be any tangible medium that can contain, or store a program for use by or in connection with an instruction execution system, apparatus, or device. In the present invention, however, a computer readable signal medium may include a propagated data signal with computer readable program code embodied therein, for example, in baseband or as part of a carrier wave. Such a propagated data signal may take many forms, including, but not limited to, electro-magnetic, optical, or any suitable combination thereof. A computer readable signal medium may also be any computer readable medium that is not a computer readable storage medium and that can communicate, propagate, or transport a program for use by or in connection with an instruction execution system, apparatus, or device. Program code embodied on a computer readable medium may be transmitted using any appropriate medium, including but not limited to: wireless, wire, fiber optic cable, RF, etc., or any suitable combination of the foregoing.
The flowchart and block diagrams in the figures illustrate the architecture, functionality, and operation of possible implementations of systems, methods and computer program products according to various embodiments of the present invention. In this regard, each block in the flowchart or block diagrams may represent a module, segment, or portion of code, which comprises one or more executable instructions for implementing the specified logical function(s). It should also be noted that, in some alternative implementations, the functions noted in the block may occur out of the order noted in the figures. For example, two blocks shown in succession may, in fact, be executed substantially concurrently, or the blocks may sometimes be executed in the reverse order, depending upon the functionality involved. It will also be noted that each block of the block diagrams or flowchart illustration, and combinations of blocks in the block diagrams or flowchart illustration, can be implemented by special purpose hardware-based systems which perform the specified functions or acts, or combinations of special purpose hardware and computer instructions.
The units described in the embodiments of the present invention may be implemented by software, or may be implemented by hardware, and the described units may also be disposed in a processor. Wherein the names of the elements do not in some way constitute a limitation on the elements themselves.
As another aspect, the present application also provides a computer-readable medium, which may be contained in the electronic device described in the above embodiments; or may exist separately without being assembled into the electronic device. The computer-readable medium carries one or more programs which, when executed by the electronic device, cause the electronic device to implement the image processing method as described in the above embodiments.
For example, the electronic device may implement the following as shown in fig. 1: step S110, dividing the gray image of the original image into a plurality of blocks; step S120, performing layout analysis on each block in the plurality of blocks to determine the type of each block; step S130, filling the foreground layer, the mask layer and the background layer of each block based on the type of each block; step S140, performing compression processing on the foreground layer, the mask layer, and the background layer of each block to obtain a compressed image.
It should be noted that although in the above detailed description several modules or units of a device or apparatus for action execution are mentioned, such a division is not mandatory. Indeed, the features and functionality of two or more modules or units described above may be embodied in one module or unit, according to embodiments of the invention. Conversely, the features and functions of one module or unit described above may be further divided into embodiments by a plurality of modules or units.
Through the above description of the embodiments, those skilled in the art will readily understand that the exemplary embodiments described herein may be implemented by software, or by software in combination with necessary hardware. Therefore, the technical solution according to the embodiment of the present invention can be embodied in the form of a software product, which can be stored in a non-volatile storage medium (which can be a CD-ROM, a usb disk, a removable hard disk, etc.) or on a network, and includes several instructions to enable a computing device (which can be a personal computer, a server, a touch terminal, or a network device, etc.) to execute the method according to the embodiment of the present invention.
Other embodiments of the invention will be apparent to those skilled in the art from consideration of the specification and practice of the invention disclosed herein. This application is intended to cover any variations, uses, or adaptations of the invention following, in general, the principles of the invention and including such departures from the present disclosure as come within known or customary practice within the art to which the invention pertains. It is intended that the specification and examples be considered as exemplary only, with a true scope and spirit of the invention being indicated by the following claims.
It will be understood that the invention is not limited to the precise arrangements described above and shown in the drawings and that various modifications and changes may be made without departing from the scope thereof. The scope of the invention is limited only by the appended claims.

Claims (12)

1. An image processing method, comprising:
dividing a gray level image of an original image into a plurality of blocks;
determining a pixel average value of each of the plurality of blocks, determining a pixel variance value of each block based on the pixel average value;
dividing each block into a pure color type block, a double color type block and a multi-color type block based on the pixel variance value of each block, wherein the pure color type block comprises a pure color-foreground type block and a pure color-background type block; the method for determining the solid color-foreground type block and the solid color-background type block comprises the following steps: judging whether the pixel average value of the pure color type block is larger than a preset threshold value or not; if the pure color type block is judged to be larger than the preset threshold value, determining the pure color type block as a pure color-foreground type block; if the color is not larger than the preset threshold value, determining the pure color type block as a pure color-background type block;
filling the foreground layer, the mask layer and the background layer of each block based on the type of each block; when the block is a pure color-foreground type block, filling the color represented by the pixel average value of the block into a foreground layer of the block; filling white color into the mask layer of the block, and filling the color of the background layer of the previous pure color-background type block into the background layer of the block;
and compressing the foreground layer, the mask layer and the background layer of each block to obtain a compressed image.
2. The image processing method of claim 1, wherein dividing each block into a solid-type block, a two-color type block, and a multi-color type block based on a pixel variance value of each block comprises:
judging whether the pixel variance value of the block is smaller than a first variance threshold value;
if the difference is less than the first variance threshold, determining the block as a pure color type block;
if the variance is not smaller than the first variance threshold, judging whether the pixel variance value of the block is smaller than a second variance threshold, wherein the second variance threshold is larger than the first variance threshold;
if the judgment result is smaller than the second variance threshold value, determining the block as a bicolor block;
and if the judgment result is not smaller than the second variance threshold value, determining the block as a multi-color block.
3. The image processing method according to claim 1, characterized in that the image processing method further comprises:
judging whether the pixel average value of the multi-color type block is larger than the preset threshold value or not;
if the judgment result is larger than the preset threshold value, determining the multi-color type block as a multi-color-foreground type block;
and if the judgment result is not larger than the preset threshold value, determining the multicolor type block as a multicolor-background type block.
4. The image processing method of claim 1, wherein filling the foreground layer, the mask layer, and the background layer of each block based on the type of each block comprises:
when the block is a multi-color-foreground type block, filling the original color value of the block into a foreground layer of the block;
filling white color into the mask layer of the block, and filling the color of the background layer of the last pure color-background type block into the background layer of the block.
5. The image processing method of claim 3, wherein filling the foreground layer, the mask layer, and the background layer of each tile based on the type of each tile comprises:
when the block is a two-color type block, determining the foreground color and the background color of the block according to the preset threshold value;
filling the foreground color into a foreground layer of the tile and filling the background color into a background layer of the tile;
judging whether the pixel value of the pixel point of the block is larger than the preset threshold value or not;
filling white at the pixel point if the pixel point is judged to be larger than the preset threshold value;
and if the pixel point is not larger than the predetermined threshold value, filling black at the pixel point.
6. The image processing method of claim 3, wherein filling the foreground layer, the mask layer, and the background layer of each tile based on the type of each tile comprises:
when the block is a multi-color-background type block, filling the color of the foreground layer of the previous pure-color-foreground type block into the foreground layer of the block;
and filling black into the mask layer of the block, and filling the original color of the block into the background layer of the block.
7. The image processing method of claim 3, wherein filling the foreground layer, the mask layer, and the background layer of each tile based on the type of each tile comprises:
when the block is a pure color-background type block, filling the color represented by the pixel average value of the block into a background layer of the block;
and filling black into the mask layer of the block, and filling the color of the foreground layer of the previous pure color-foreground type block into the foreground layer of the block.
8. The image processing method according to any one of claims 1 to 7, characterized in that the image processing method further comprises:
and carrying out reduction processing on the foreground layer and the background layer of each block.
9. The method of claim 8, wherein the size of each tile is one or more of 8 x 8 pixels, 4 x 4 pixels, and 2 x 2 pixels.
10. An image processing apparatus characterized by comprising:
a dividing unit for dividing a grayscale image of an original image into a plurality of blocks;
a type determination unit for determining a pixel average value of each of the plurality of blocks, and determining a pixel variance value of each block based on the pixel average value; dividing each block into a pure color type block, a double color type block and a multi-color type block based on the pixel variance value of each block, wherein the pure color type block comprises a pure color-foreground type block and a pure color-background type block; the method for determining the solid color-foreground type block and the solid color-background type block comprises the following steps: judging whether the pixel average value of the pure color type block is larger than a preset threshold value or not; if the pure color type block is judged to be larger than the preset threshold value, determining the pure color type block as a pure color-foreground type block; if the color is not larger than the preset threshold value, determining the pure color type block as a pure color-background type block;
the filling unit is used for filling the foreground layer, the mask layer and the background layer of each block based on the type of each block; when the block is a pure color-foreground type block, filling the color represented by the pixel average value of the block into a foreground layer of the block; filling white color into the mask layer of the block, and filling the color of the background layer of the previous pure color-background type block into the background layer of the block;
and the compression unit is used for compressing the foreground layer, the mask layer and the background layer of each block to obtain a compressed image.
11. An electronic device, comprising:
a processor; and
a memory having computer readable instructions stored thereon which, when executed by the processor, implement the image processing method of any of claims 1 to 9.
12. A computer-readable storage medium, on which a computer program is stored which, when being executed by a processor, carries out the image processing method of any one of claims 1 to 9.
CN201810594562.1A 2018-06-11 2018-06-11 Image processing method, image processing device, electronic equipment and storage medium Active CN108924557B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201810594562.1A CN108924557B (en) 2018-06-11 2018-06-11 Image processing method, image processing device, electronic equipment and storage medium

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201810594562.1A CN108924557B (en) 2018-06-11 2018-06-11 Image processing method, image processing device, electronic equipment and storage medium

Publications (2)

Publication Number Publication Date
CN108924557A CN108924557A (en) 2018-11-30
CN108924557B true CN108924557B (en) 2022-02-08

Family

ID=64410829

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201810594562.1A Active CN108924557B (en) 2018-06-11 2018-06-11 Image processing method, image processing device, electronic equipment and storage medium

Country Status (1)

Country Link
CN (1) CN108924557B (en)

Families Citing this family (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN109903294B (en) * 2019-01-25 2020-05-29 北京三快在线科技有限公司 Image processing method and device, electronic equipment and readable storage medium
CN110717908B (en) * 2019-10-08 2022-08-09 中山大学附属第三医院 Pathological picture processing method
CN110852938B (en) * 2019-10-28 2024-03-19 腾讯科技(深圳)有限公司 Display picture generation method, device and storage medium

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1455332A (en) * 2002-04-30 2003-11-12 微软公司 Mixed grating-content document
CN101217668A (en) * 2008-01-14 2008-07-09 浙江大学 A mixed image compression method based on block classification
CN101901487A (en) * 2009-05-21 2010-12-01 夏普株式会社 Method for compressing image, image compressing device, image processing system, computer program and recording medium

Family Cites Families (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
DE19817720A1 (en) * 1998-04-21 1999-10-28 Heidelberger Druckmasch Ag Method of digital image data compression for two-colour images enables two-colour image compression without errors and combination with transformation coding for compression of multicolor images
US7110596B2 (en) * 2002-04-25 2006-09-19 Microsoft Corporation System and method facilitating document image compression utilizing a mask
US8086044B2 (en) * 2006-08-25 2011-12-27 Ricoh Co., Ltd. Block-based iterative multi-pass data filling technique for compound document compression
JP4808267B2 (en) * 2009-05-27 2011-11-02 シャープ株式会社 Image processing apparatus, image forming apparatus, image processing method, computer program, and recording medium
US9699468B2 (en) * 2014-02-10 2017-07-04 Microsoft Technology Licensing, Llc Adaptive screen and video coding scheme
CN106162190A (en) * 2015-04-08 2016-11-23 杭州海康威视数字技术股份有限公司 A kind of video image compression and the method for reading, Apparatus and system
CN105005980B (en) * 2015-07-21 2019-02-01 深圳Tcl数字技术有限公司 Image processing method and device

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1455332A (en) * 2002-04-30 2003-11-12 微软公司 Mixed grating-content document
CN101217668A (en) * 2008-01-14 2008-07-09 浙江大学 A mixed image compression method based on block classification
CN101901487A (en) * 2009-05-21 2010-12-01 夏普株式会社 Method for compressing image, image compressing device, image processing system, computer program and recording medium

Also Published As

Publication number Publication date
CN108924557A (en) 2018-11-30

Similar Documents

Publication Publication Date Title
EP2681710B1 (en) Local multiscale tone-mapping operator
CN108924557B (en) Image processing method, image processing device, electronic equipment and storage medium
US8326051B1 (en) Method and apparatus for progressive encoding for text transmission
TW200539705A (en) Image transmitting device, image receiving device and image transceiving system
US7668383B2 (en) Image processing, compressing, decompressing, transmitting, sending and receiving devices and methods, programs thereof and displaying device
CN102890780B (en) Image processing device and image processing method
EP1771008A2 (en) Adaptive method and system for encoding digital images for the internet
KR101805550B1 (en) Image data encoding method for presentation virtualization and server therefor
CN111182303A (en) Encoding method and device for shared screen, computer readable medium and electronic equipment
CN107665128B (en) Image processing method, system, server and readable storage medium
CN111131828B (en) Image compression method and device, electronic equipment and storage medium
JP5995864B2 (en) Display data encoding method and system
CN111080655A (en) Image segmentation and model training method, device, medium and electronic equipment
CN102138158A (en) Unified texture compression framework
CN103402091A (en) Cloud desktop image classifying and encoding method
CN111654721A (en) Video processing method, system, electronic device and storage medium
US11263786B2 (en) Decoding data arrays
CN108471536B (en) Alpha channel transmission method and device, terminal device and storage medium
CN113989174A (en) Image fusion method and training method and device of image fusion model
KR20100080097A (en) Method and apparatus for encoding/decoding image in bit-map
CN112399069B (en) Image encoding method and apparatus, storage medium, and electronic device
Said Compression of compound images and video for enabling rich media in embedded systems
CN115567712A (en) Screen content video coding perception code rate control method and device based on just noticeable distortion by human eyes
US20070002044A1 (en) System and method for a compressed hierarachical stencil buffer
CN102394053B (en) Method and device for displaying pure monochrome picture

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
CB02 Change of applicant information

Address after: 266000, No. 218, Bay Road, Qingdao economic and Technological Development Zone, Shandong

Applicant after: Hisense Visual Technology Co., Ltd.

Address before: 266555 Qingdao economic and Technological Development Zone, Shandong, Hong Kong Road, No. 218

Applicant before: QINGDAO HISENSE ELECTRONICS Co.,Ltd.

CB02 Change of applicant information
GR01 Patent grant
GR01 Patent grant
TR01 Transfer of patent right

Effective date of registration: 20221028

Address after: 83 Intekte Street, Devon, Netherlands

Patentee after: VIDAA (Netherlands) International Holdings Ltd.

Address before: 266000 Qianwan Port Road 218, Qingdao Economic and Technological Development Zone, Shandong Province

Patentee before: Hisense Visual Technology Co., Ltd.

TR01 Transfer of patent right