CN113554659B - Image processing method, device, electronic equipment, storage medium and display system - Google Patents

Image processing method, device, electronic equipment, storage medium and display system Download PDF

Info

Publication number
CN113554659B
CN113554659B CN202010328163.8A CN202010328163A CN113554659B CN 113554659 B CN113554659 B CN 113554659B CN 202010328163 A CN202010328163 A CN 202010328163A CN 113554659 B CN113554659 B CN 113554659B
Authority
CN
China
Prior art keywords
cutting block
pixel points
cutting
image
resolution
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN202010328163.8A
Other languages
Chinese (zh)
Other versions
CN113554659A (en
Inventor
胡春波
文雯
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Hangzhou Hikvision Digital Technology Co Ltd
Original Assignee
Hangzhou Hikvision Digital Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Hangzhou Hikvision Digital Technology Co Ltd filed Critical Hangzhou Hikvision Digital Technology Co Ltd
Priority to CN202010328163.8A priority Critical patent/CN113554659B/en
Publication of CN113554659A publication Critical patent/CN113554659A/en
Application granted granted Critical
Publication of CN113554659B publication Critical patent/CN113554659B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/10—Segmentation; Edge detection
    • G06T7/11—Region-based segmentation
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T3/00—Geometric image transformations in the plane of the image
    • G06T3/40—Scaling of whole images or parts thereof, e.g. expanding or contracting
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T3/00—Geometric image transformations in the plane of the image
    • G06T3/40—Scaling of whole images or parts thereof, e.g. expanding or contracting
    • G06T3/403—Edge-driven scaling; Edge-based scaling
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T3/00—Geometric image transformations in the plane of the image
    • G06T3/40—Scaling of whole images or parts thereof, e.g. expanding or contracting
    • G06T3/4038—Image mosaicing, e.g. composing plane images from plane sub-images
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T5/00—Image enhancement or restoration
    • G06T5/50—Image enhancement or restoration using two or more images, e.g. averaging or subtraction
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/10—Segmentation; Edge detection
    • G06T7/12—Edge-based segmentation
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/20—Special algorithmic details
    • G06T2207/20212—Image combination
    • G06T2207/20221—Image fusion; Image merging
    • Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
    • Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
    • Y02D—CLIMATE CHANGE MITIGATION TECHNOLOGIES IN INFORMATION AND COMMUNICATION TECHNOLOGIES [ICT], I.E. INFORMATION AND COMMUNICATION TECHNOLOGIES AIMING AT THE REDUCTION OF THEIR OWN ENERGY USE
    • Y02D10/00—Energy efficient computing, e.g. low power processors, power management or thermal management

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Editing Of Facsimile Originals (AREA)
  • Image Processing (AREA)

Abstract

The embodiment of the invention provides an image processing method, an image processing device, electronic equipment, a storage medium and a display system, when a source image is cut, cutting parameters of the source image are reversely calculated, as a front preset column pixel point in any cutting block of a target image has a corresponding reference pixel point which is the same as a rear preset column pixel point in an adjacent front cutting block, and a front preset row pixel point has a corresponding reference pixel point which is the same as a rear preset row pixel point in the adjacent upper cutting block, the cutting boundary of each cutting block of the source image when the source image is independently scaled is considered, when the source image is cut and scaled according to the cutting parameters, the scaling ratio of the target pixel point is the same, and each cutting block of the target image has the same or similar image data at the boundary, thereby avoiding the problem of image deformation when the scaled source image cutting blocks are subjected to synthesis processing.

Description

Image processing method, device, electronic equipment, storage medium and display system
Technical Field
The present invention relates to the field of image processing technologies, and in particular, to an image processing method, an image processing device, an electronic device, a storage medium, and a display system.
Background
In the display control field of the large-resolution LED (Light Emitting Diode ) tiled screen, the display is often completed using the image stitching function of an image stitching device or processor. When the display is performed, cutting the source images according to the arrangement rule of each display screen in the LED spliced screen to obtain each source image cutting block, then scaling each source image cutting block respectively, scaling each source image cutting block to the size of the display screen, and displaying the scaled source image cutting blocks in the corresponding display screen respectively.
Due to the influence of the cutting strategy or the alignment requirement to be met by the corresponding cutting blocks of the source image, when the source image is cut, the obtained cutting blocks of the source image may be different in size, as shown in fig. 1, taking the case that the source image of 1280×720 is displayed on a 3×3 and 1080P spliced screen, the source image is cut into 6 426×240 cutting blocks and 3 428×240 cutting blocks, at this time, two scales exist in the horizontal direction, namely, k1=1920/426 and k2=1920/428, and the scales of the cutting blocks of the visible source image are different, so that the finally displayed image is deformed.
Disclosure of Invention
The embodiment of the invention aims to provide an image processing method, an image processing device, electronic equipment, a storage medium and a display system, so as to avoid the situation of image deformation when image mosaic display is performed. The specific technical scheme is as follows:
In a first aspect, an embodiment of the present invention provides an image processing method, including:
acquiring the resolution of a source image, alignment attributes corresponding to the source image, predetermined cutting block arrangement information of a target image, the resolution of each cutting block of the target image and algorithm attribute information of a preset scaling algorithm;
determining a plurality of reference pixel points corresponding to the target pixel points in each cutting block of the target image from the source image according to the resolution, the alignment attribute, the cutting block arrangement information, the resolution of each cutting block and the algorithm attribute information of the source image; the front preset row pixel points in any cutting block of the target image have corresponding reference pixel points which are the same as the rear preset row pixel points in the adjacent previous cutting block, and the front preset row pixel points have corresponding reference pixel points which are the same as the rear preset row pixel points in the adjacent previous cutting block;
determining cutting parameters of a source image according to a plurality of reference pixel points corresponding to target pixel points in each cutting block;
cutting the source image based on the cutting parameters to obtain a plurality of source image cutting blocks, and determining a scaling processing coefficient according to the resolution of the source image, the arrangement information of the cutting blocks, the resolution of each cutting block and the algorithm attribute information;
And respectively scaling each source image cutting block based on a scaling processing coefficient by utilizing a preset scaling algorithm to obtain each target image cutting block, and synthesizing each target image cutting block to obtain a target image.
Optionally, the step of determining, from the source image, a plurality of reference pixel points corresponding to the target pixel point in each cutting block of the target image according to the resolution, the alignment attribute, the cutting block arrangement information, the resolution of each cutting block, and the algorithm attribute information of the source image includes:
determining a plurality of horizontal direction pixel ranges and a plurality of vertical direction pixel ranges of the source image according to the resolution, the alignment attribute and the cutting block arrangement information of the source image;
determining a plurality of reference pixel points corresponding to vertex pixel points in the horizontal direction of each cutting block of the target image according to the pixel range in each horizontal direction, the horizontal component of the resolution of each cutting block and the horizontal order in the algorithm attribute information;
and determining a plurality of reference pixel points corresponding to the vertex pixel points of each cutting block in the vertical direction of the target image according to the pixel range of each vertical direction, the vertical component of each cutting block resolution and the vertical order in the algorithm attribute information.
Optionally, the step of determining a plurality of reference pixel points corresponding to vertex pixel points in the horizontal direction of each cutting block of the target image according to the pixel range in each horizontal direction, the horizontal component of the resolution of each cutting block and the horizontal order in the algorithm attribute information includes:
determining a plurality of reference pixel points at two ends of each horizontal direction pixel range meeting the horizontal order according to each horizontal direction pixel range and the horizontal order in the algorithm attribute information;
for each cutting block, according to the horizontal component of the resolution of the cutting block and a plurality of reference pixel points at two ends of the pixel range in each horizontal direction, determining the plurality of reference pixel points at two ends as a plurality of reference pixel points corresponding to two vertex pixel points in the horizontal direction of the cutting block.
Optionally, the step of determining a plurality of reference pixel points corresponding to vertex pixel points in the vertical direction of each cutting block of the target image according to the vertical direction pixel range, the vertical component of the resolution of each cutting block and the vertical order in the algorithm attribute information includes:
determining a plurality of reference pixel points at two ends of each vertical direction pixel range meeting the vertical order according to each vertical direction pixel range and the vertical order in the algorithm attribute information;
For each cutting block, according to the vertical component of the resolution of the cutting block and a plurality of reference pixel points at two ends of the pixel range in each vertical direction, determining the plurality of reference pixel points at two ends as a plurality of reference pixel points corresponding to two vertex pixel points in the vertical direction of the cutting block.
Optionally, the scaling processing coefficient is a coefficient vector corresponding to each pixel point in the target image;
scaling each source image cutting block based on a scaling processing coefficient by using a preset scaling algorithm to obtain each target image cutting block, wherein the method comprises the following steps:
and aiming at each pixel point in each target image cutting block, performing scaling operation on the pixel values of a plurality of reference pixel points corresponding to the pixel point according to the coefficient vector corresponding to the pixel point to obtain the pixel value of the pixel point.
Optionally, after the step of synthesizing each target image cutting block to obtain the target image, the method further includes:
and controlling each display screen to cut and display the target image, or controlling each display screen to display each target image cutting block respectively.
In a second aspect, an embodiment of the present invention provides an image processing apparatus, including:
The acquisition module is used for acquiring the resolution of the source image, the alignment attribute corresponding to the source image, the predetermined cutting block arrangement information of the target image, the resolution of each cutting block of the target image and algorithm attribute information of a preset scaling algorithm;
the cutting processing module is used for determining a plurality of reference pixel points corresponding to the target pixel points in each cutting block of the target image from the source image according to the resolution, the alignment attribute, the cutting block arrangement information, the resolution of each cutting block and the algorithm attribute information of the source image; the front preset row pixel points in any cutting block of the target image have corresponding reference pixel points which are the same as the rear preset row pixel points in the adjacent previous cutting block, and the front preset row pixel points have corresponding reference pixel points which are the same as the rear preset row pixel points in the adjacent previous cutting block; determining cutting parameters of a source image according to a plurality of reference pixel points corresponding to target pixel points in each cutting block; cutting the source image based on the cutting parameters to obtain a plurality of source image cutting blocks, and determining a scaling processing coefficient according to the resolution of the source image, the arrangement information of the cutting blocks, the resolution of each cutting block and the algorithm attribute information;
The scaling processing module is used for respectively scaling each source image cutting block based on the scaling processing coefficient by utilizing a preset scaling algorithm to obtain each target image cutting block;
and the image synthesis processing module is used for carrying out synthesis processing on each target image cutting block to obtain a target image.
Optionally, the cutting processing module is specifically configured to:
determining a plurality of horizontal direction pixel ranges and a plurality of vertical direction pixel ranges of the source image according to the resolution, the alignment attribute and the cutting block arrangement information of the source image;
determining a plurality of reference pixel points corresponding to vertex pixel points in the horizontal direction of each cutting block of the target image according to the pixel range in each horizontal direction, the horizontal component of the resolution of each cutting block and the horizontal order in the algorithm attribute information;
and determining a plurality of reference pixel points corresponding to the vertex pixel points of each cutting block in the vertical direction of the target image according to the pixel range of each vertical direction, the vertical component of each cutting block resolution and the vertical order in the algorithm attribute information.
Optionally, the cutting processing module is specifically configured to:
determining a plurality of reference pixel points at two ends of each horizontal direction pixel range meeting the horizontal order according to each horizontal direction pixel range and the horizontal order in the algorithm attribute information;
For each cutting block, according to the horizontal component of the resolution of the cutting block and a plurality of reference pixel points at two ends of the pixel range in each horizontal direction, determining the plurality of reference pixel points at two ends as a plurality of reference pixel points corresponding to two vertex pixel points in the horizontal direction of the cutting block.
Optionally, the cutting processing module is specifically configured to:
determining a plurality of reference pixel points at two ends of each vertical direction pixel range meeting the vertical order according to each vertical direction pixel range and the vertical order in the algorithm attribute information;
for each cutting block, according to the vertical component of the resolution of the cutting block and a plurality of reference pixel points at two ends of the pixel range in each vertical direction, determining the plurality of reference pixel points at two ends as a plurality of reference pixel points corresponding to two vertex pixel points in the vertical direction of the cutting block.
Optionally, the scaling processing coefficient is a coefficient vector corresponding to each pixel point in the target image;
the scaling processing module is specifically configured to:
and aiming at each pixel point in each target image cutting block, performing scaling operation on the pixel values of a plurality of reference pixel points corresponding to the pixel point according to the coefficient vector corresponding to the pixel point to obtain the pixel value of the pixel point.
Optionally, the image synthesis processing module is further configured to:
and controlling each display screen to cut and display the target image, or controlling each display screen to display each target image cutting block respectively.
In a third aspect, an embodiment of the present invention provides an electronic device, including a processor and a memory, where the memory stores machine executable instructions executable by the processor, where the machine executable instructions are loaded and executed by the processor to implement the method provided by the first aspect of the embodiment of the present invention.
In a fourth aspect, embodiments of the present invention provide a storage medium having stored therein machine-executable instructions which, when loaded and executed by a processor, implement the method provided by the first aspect of the embodiments of the present invention.
In a fifth aspect, embodiments of the present invention provide a display system, the system comprising a plurality of display screens and a processor;
the processor is used for acquiring the resolution of the source image, the alignment attribute corresponding to the source image, the predetermined cutting block arrangement information of the target image, the resolution of each cutting block of the target image and algorithm attribute information of a preset scaling algorithm; determining a plurality of reference pixel points corresponding to the target pixel points in each cutting block of the target image from the source image according to the resolution, the alignment attribute, the cutting block arrangement information, the resolution of each cutting block and the algorithm attribute information of the source image; the front preset row pixel points in any cutting block of the target image have corresponding reference pixel points which are the same as the rear preset row pixel points in the adjacent previous cutting block, and the front preset row pixel points have corresponding reference pixel points which are the same as the rear preset row pixel points in the adjacent previous cutting block; determining cutting parameters of a source image according to a plurality of reference pixel points corresponding to target pixel points in each cutting block; cutting the source image based on the cutting parameters to obtain a plurality of source image cutting blocks, and determining a scaling processing coefficient according to the resolution of the source image, the arrangement information of the cutting blocks, the resolution of each cutting block and the algorithm attribute information; scaling the source image cutting blocks respectively based on scaling processing coefficients by using a preset scaling algorithm to obtain target image cutting blocks, and synthesizing the target image cutting blocks to obtain target images; controlling each display screen to cut and display the target image, or controlling each display screen to display each target image cutting block respectively;
And each display screen is used for cutting and displaying the target image or displaying each target image cutting block.
According to the image processing method, the device, the electronic equipment, the storage medium and the display system provided by the embodiment of the invention, the electronic equipment acquires and determines a plurality of reference pixel points corresponding to target pixel points in each cutting block of a target image from a source image according to the resolution of the source image, the alignment attribute corresponding to the source image, the cutting block arrangement information of a predetermined target image, the resolution of each cutting block of the target image and the algorithm attribute information of a preset scaling algorithm, wherein the front preset column pixel point in any cutting block of the target image has the same corresponding reference pixel point as the rear preset column pixel point in the adjacent front cutting block, and the front preset row pixel point has the same corresponding reference pixel point as the rear preset row pixel point in the adjacent last cutting block; determining cutting parameters of a source image according to a plurality of reference pixel points corresponding to target pixel points in each cutting block; cutting the source image based on the cutting parameters to obtain a plurality of source image cutting blocks, and determining a scaling processing coefficient according to the resolution of the source image, the arrangement information of the cutting blocks, the resolution of each cutting block and the algorithm attribute information; and respectively scaling each source image cutting block based on a scaling processing coefficient by utilizing a preset scaling algorithm to obtain each target image cutting block, and synthesizing each target image cutting block to obtain a target image.
When the source image is cut, the resolution of the source image, the alignment attribute corresponding to the source image, the cutting block arrangement information of the target image, the cutting block resolution of each cutting block of the target image and the algorithm attribute information of a preset scaling algorithm are utilized to reversely calculate the cutting parameters of the source image, and as the front preset column pixel point in any cutting block of the target image has the same corresponding reference pixel point as the rear preset column pixel point in the adjacent front cutting block and the front preset row pixel point has the same corresponding reference pixel point as the rear preset row pixel point in the adjacent upper cutting block, the cutting boundary of each cutting block of the source image when the source image is independently scaled is considered, when the source image is cut and scaled according to the cutting parameters, the scaling ratio of each cutting block of the target image is the same or similar image data at the boundary, the problem of image deformation when the cutting blocks of each source image after the synthesis processing are synthesized can be avoided.
Drawings
In order to more clearly illustrate the embodiments of the invention or the technical solutions in the prior art, the drawings that are required in the embodiments or the description of the prior art will be briefly described, it being obvious that the drawings in the following description are only some embodiments of the invention, and that other drawings may be obtained according to these drawings without inventive effort for a person skilled in the art.
FIG. 1 is a block diagram of a prior art image zoom display;
FIG. 2 is a flow chart of an image processing method according to an embodiment of the invention;
FIG. 3 is a flow chart of an image processing method according to an embodiment of the invention;
FIG. 4 is a schematic diagram of the various cutting blocks of a video source according to an embodiment of the present invention;
FIG. 5 is a flowchart illustrating a scaling process according to an embodiment of the present invention;
FIG. 6 is a schematic diagram illustrating a scaling process destination pixel calculation flow according to an embodiment of the present invention;
fig. 7 is a schematic structural diagram of an image processing apparatus according to an embodiment of the present invention;
fig. 8 is a schematic structural diagram of an electronic device according to an embodiment of the present invention;
fig. 9 is a schematic structural diagram of a display system according to an embodiment of the invention.
Detailed Description
The following description of the embodiments of the present invention will be made clearly and completely with reference to the accompanying drawings, in which it is apparent that the embodiments described are only some embodiments of the present invention, but not all embodiments. All other embodiments, which can be made by those skilled in the art based on the embodiments of the invention without making any inventive effort, are intended to be within the scope of the invention.
In order to avoid the situation that an image is deformed when the image is spliced and displayed, the embodiment of the invention provides an image processing method, an image processing device, electronic equipment, a storage medium and a display system.
The terms in the embodiments of the present invention are explained as follows:
video frame: is a single image picture with the minimum unit in video or animation, and is equivalent to each lens on a film;
video frame cutting block: the video frame is split into a plurality of parts according to a certain coordinate rule, wherein each part is called a video frame cutting block;
destination video frame: the video source image is configured according to certain parameters and a scaling algorithm is used for carrying out scaling treatment to obtain a video frame;
destination video cutting block: the video frame cutting block is obtained after the video frame cutting block is subjected to scaling treatment according to a certain parameter configuration and a scaling algorithm;
destination pixel: the video source pixels are configured according to certain parameters and the pixels obtained after the scaling processing are carried out by a scaling algorithm;
video frame synthesis: each video frame cutting block is spliced according to a certain coordinate rule to obtain a complete video frame
Large screen splicing: a plurality of display screens are used for splicing display modes, so that a single-screen display function is realized;
YUV420: a video frame data format, Y representing a luminance signal and UV representing a chrominance signal of a video frame, characterized in that every 4Y shares 1 set of UV;
YUV444: a video frame data format, Y representing a luminance signal and UV representing a chrominance signal of a video frame, characterized in that each pixel is described by a set of YUV data.
Next, an image processing method provided by an embodiment of the present invention will be described first.
The execution main body of the image processing method provided by the embodiment of the invention is an electronic device at least having a logic computing function, and the electronic device at least comprises a core processing chip. The image processing method provided by the embodiment of the invention can be implemented by at least one of software, a hardware circuit and a logic circuit arranged in the electronic equipment.
As shown in fig. 2, an image processing method provided by an embodiment of the present invention may include the following steps.
S201, acquiring the resolution of a source image, the alignment attribute corresponding to the source image, the predetermined cutting block arrangement information of a target image, the resolution of each cutting block of the target image and algorithm attribute information of a preset scaling algorithm.
S202, determining a plurality of reference pixel points corresponding to the target pixel points in each cutting block of the target image from the source image according to the resolution, the alignment attribute, the cutting block arrangement information, the resolution of each cutting block and the algorithm attribute information of the source image.
The front preset row pixel points in any cutting block of the target image have corresponding reference pixel points which are the same as the rear preset row pixel points in the adjacent previous cutting block, and the front preset row pixel points have corresponding reference pixel points which are the same as the rear preset row pixel points in the adjacent previous cutting block.
S203, determining cutting parameters of the source image according to a plurality of reference pixel points corresponding to the target pixel points in each cutting block.
S204, cutting the source image based on the cutting parameters to obtain a plurality of source image cutting blocks, and determining a scaling processing coefficient according to the resolution of the source image, the arrangement information of the cutting blocks, the resolution of each cutting block and the algorithm attribute information.
S205, scaling is carried out on each source image cutting block based on a scaling processing coefficient by utilizing a preset scaling algorithm to obtain each target image cutting block, and synthesis processing is carried out on each target image cutting block to obtain a target image.
When the embodiment of the invention is applied to source image cutting, the cutting parameters of the source image are reversely calculated by utilizing the resolution of the source image, the alignment attribute corresponding to the source image, the cutting block arrangement information of the target image, the cutting block resolution of the target image and the algorithm attribute information of a preset scaling algorithm, and as the front preset column pixel point in any cutting block of the target image has the same corresponding reference pixel point as the rear preset column pixel point in the adjacent front cutting block and the front preset row pixel point has the same corresponding reference pixel point as the rear preset row pixel point in the adjacent upper cutting block, the cutting boundary of each cutting block of the source image during independent scaling is considered, so that the scaling ratio of the target pixel point is the same when the source image is cut and scaled according to the cutting parameters, and each cutting block of the target image has the same or similar image data at the boundary, thereby avoiding the problem of image deformation during the synthesis processing of each source image cutting block after the scaling.
The source image may be an input video frame or an input image, which is not limited herein. When cutting, scaling and displaying a source image, the resolution of the source image, the alignment attribute corresponding to the source image, the cutting block arrangement information of a target image, the resolution of each cutting block of the target image and the algorithm attribute information of a preset scaling algorithm need to be obtained.
The resolution of the source image may be input, indicating the size of the source image, for example 1280×720, or may be obtained by identifying the size of the source image after the source image is acquired; the alignment attribute corresponding to the source image is the inherent attribute information of the source image when cutting, scaling and splicing, and is generally determined by the image format of the source image, or may be determined by a scaling algorithm, or may be determined by the image format of the source image and the scaling algorithm together. For example, the source image in YUV420 format is 2-pixel aligned and the source image in YUV444 format is 1-pixel aligned; the arrangement information of the cutting blocks of the target image can be input according to the display requirement, or can be determined according to the display arrangement of the spliced screen, and the resolution of each cutting block of the target image can be input according to the display requirement, for example, the source image of 1280×720 is displayed on the spliced screen of 3×3 and 1080P, the arrangement information of the cutting blocks of the target image is 3×3, and the resolution of each cutting block of the target image is 1920×1080; according to the arrangement information of the cutting blocks and the resolution of each cutting block, the resolution of the target image can be known; the algorithm attribute information of the preset scaling algorithm is determined while the scaling algorithm is selected, and in the embodiment of the invention, one scaling algorithm is uniformly selected for the source image, wherein a scaling strategy is defined in the scaling algorithm, for example, a preset scaling algorithm of horizontal 8-order, vertical 6-order is adopted, and then the algorithm attribute information of the preset scaling algorithm is the algorithm attribute information of the horizontal 8-order, vertical 6-order.
After the resolution of the source image, the alignment attribute corresponding to the source image, the arrangement information of the cutting blocks of the target image, the resolution of each cutting block of the target image and the algorithm attribute information of a preset scaling algorithm are obtained, a plurality of reference pixel points corresponding to the target pixel points in each cutting block of the target image can be determined from the source image according to the information. The destination pixel point may be any pixel point in each cutting block of the destination image, or may be a pixel point in a specific position (for example, a vertex, a midpoint, etc.) in each cutting block of the destination image, the reference pixel point is a pixel point on the source image, and the pixel value of the destination pixel point is obtained by calculating from a plurality of reference pixel points, so that a corresponding relationship exists between the destination pixel point and the plurality of reference pixel points.
After the corresponding relation between the target pixel point and the plurality of reference pixel points in each cutting block of the target image is obtained, how the source image is specifically cut can be known, for example, which columns and which rows are cut into one cutting block, which is the cutting parameter of the source image. Based on the cutting parameters, the source image is cut, a plurality of source image cutting blocks can be obtained, and as the specific cutting modes (which columns and rows are cut into one cutting block) of the source image are given by the cutting parameters, quick and simple image cutting can be realized. And according to the resolution of the source image, the arrangement information of the cutting blocks, the resolution of each cutting block and the algorithm attribute information, a scaling processing coefficient can be determined, the scaling processing coefficient characterizes the operation relation from the reference pixel point of the source image to the pixel point of the target image, and can be specifically a coefficient vector, each pixel point of the target image corresponds to one coefficient vector, the size of the specific coefficient vector is related to the algorithm attribute information of the scaling algorithm, and the scaling processing coefficient is utilized to scale each source image cutting block respectively to obtain each target image cutting block and synthesize each target image cutting block, so that the target image can be obtained. Specifically, when the synthesis processing is performed, the synthesis processing can be performed on each scaled source image cutting block based on image synthesis parameters, which pixels are adjacent to each other, which pixels are fused with each other, and the like can be defined in the image synthesis parameters, and the synthesis of the target image can be realized based on the parameter information.
The manner of determining the correspondence between the target pixel point and the reference pixel point is specifically described below.
Optionally, S202 may be specifically implemented by the following steps:
first, a plurality of horizontal direction pixel ranges and a plurality of vertical direction pixel ranges of a source image are determined according to the resolution, the alignment attribute and the cutting block arrangement information of the source image.
And a second step of determining a plurality of reference pixel points corresponding to vertex pixel points of each cutting block in the horizontal direction of the target image according to the pixel range of each horizontal direction, the horizontal component of each cutting block resolution and the horizontal order in the algorithm attribute information.
And thirdly, determining a plurality of reference pixel points corresponding to vertex pixel points in the vertical direction of each cutting block of the target image according to the pixel range in the vertical direction, the vertical component of the resolution of each cutting block and the vertical order in the algorithm attribute information.
The resolution of the source image is the size of the source image, and has a certain range, for example, if the resolution of the source image is 1280×720, it can be determined that the source image is 1 to 1280 in the horizontal direction and 1 to 720 in the vertical direction, and the alignment attribute defines the alignment requirement of the cutting blocks, and the cutting block arrangement information determines how many blocks the source image needs to be cut into and what manner the cutting is performed, so, based on the three parameters, it can be determined that a plurality of horizontal pixel ranges and a plurality of vertical pixel ranges of the source image, for example, a 1280×720 source image is displayed on a 3×3 and 1080P mosaic screen, and if the source image is 2 pixels aligned, the plurality of horizontal pixel ranges of the source image are 1 to 426, 427 to 852, 853 to 1280, and the plurality of vertical pixel ranges are 1 to 240, 241 to 480, 481 to 720, respectively.
In the embodiment of the present invention, in order to consider the problem that the boundary lacks reference pixels, the front preset row of pixels in any cutting block of the target image is required to have the same corresponding reference pixels as the rear preset row of pixels in the adjacent previous cutting block, and the front preset row of pixels have the same corresponding reference pixels as the rear preset row of pixels in the adjacent previous cutting block. Therefore, for the horizontal direction and the vertical direction, according to the pixel range of the direction, the component of the resolution of each cutting block in the direction and the order of the direction in the algorithm attribute information, a plurality of reference pixel points corresponding to the vertex pixel point of each cutting block of the target image in the direction can be determined, for example, a preset scaling algorithm of a horizontal 8-order vertical 6-order is adopted, different preset scaling algorithms are used for designating different reference pixel point corresponding strategies, based on the information of the pixel range of the plurality of horizontal directions and the pixel range of the plurality of vertical directions of the source image and the information of 1920×1080 of the resolution of each cutting block of the target image, the reference pixel point corresponding to the 1 st pixel point of the first column of the cutting block in the horizontal direction can be determined to be 1-8, the reference pixel point corresponding to the 1920 th pixel point is 423-430, the reference pixel point corresponding to the 1 st pixel point of the second column of the cutting block is 423-430, the reference pixel point corresponding to the 1920 pixel point is 850-857, and the reference pixel point corresponding to the 1 st pixel point of the third column of the cutting block is 1920-853 pixels; the reference pixel points corresponding to the 1 st pixel point of the first row of dividing blocks in the vertical direction are 1-6, the reference pixel points corresponding to the 1080 th pixel point are 237-242, the reference pixel points corresponding to the 1 st pixel point of the second row of dividing blocks are 237-242, the reference pixel points corresponding to the 1080 th pixel point are 477-482, the reference pixel points corresponding to the 1 st pixel point of the third row of dividing blocks are 477-482, and the reference pixel points corresponding to the 1080 th pixel point are 715-720.
Optionally, the second step may specifically be: determining a plurality of reference pixel points at two ends of each horizontal direction pixel range meeting the horizontal order according to each horizontal direction pixel range and the horizontal order in the algorithm attribute information; for each cutting block, according to the horizontal component of the resolution of the cutting block and a plurality of reference pixel points at two ends of the pixel range in each horizontal direction, determining the plurality of reference pixel points at two ends as a plurality of reference pixel points corresponding to two vertex pixel points in the horizontal direction of the cutting block.
Optionally, the third step may specifically be: determining a plurality of reference pixel points at two ends of each vertical direction pixel range meeting the vertical order according to each vertical direction pixel range and the vertical order in the algorithm attribute information; for each cutting block, according to the vertical component of the resolution of the cutting block and a plurality of reference pixel points at two ends of the pixel range in each vertical direction, determining the plurality of reference pixel points at two ends as a plurality of reference pixel points corresponding to two vertex pixel points in the vertical direction of the cutting block.
For the horizontal direction or the vertical direction, according to the pixel range of the direction and the horizontal order or the vertical order in the algorithm attribute information, the number of the reference pixel points corresponding to the target pixel point in the direction can be known, and since the pixel range of the direction is known, at least a plurality of reference pixel points at two ends of the pixel range of the direction meeting the horizontal order or the vertical order can be determined, for example, in the above example, a plurality of reference pixel points at two ends of the first column partition block in the horizontal direction can be determined to be 1-8 and 423-430 respectively. For each cutting block, according to the component of the resolution of the cutting block in the direction and the multiple reference pixel points at two ends of the pixel range in the direction, the multiple reference pixel points at two ends can be respectively determined as multiple reference pixel points corresponding to two vertex pixel points in the direction of the cutting block. If it can be determined that 1-8 is the reference pixel corresponding to the 1 st pixel of the first column segment and 423-430 is the reference pixel corresponding to the 1920 th pixel of the first column segment.
Optionally, the scaling processing coefficient is a coefficient vector corresponding to each pixel point in the target image; in S205, the step of scaling each source image cutting block based on the scaling processing coefficient by using a preset scaling algorithm may specifically be: and aiming at each pixel point in each target image cutting block, performing scaling operation on the pixel values of a plurality of reference pixel points corresponding to the pixel point according to the coefficient vector corresponding to the pixel point to obtain the pixel value of the pixel point.
In the embodiment of the invention, each source image cutting block is respectively scaled, specifically, the pixel value of the corresponding target pixel point is obtained by calculating the reference pixel point. The scaling operation includes the processes of weighting calculation, filtering and the like.
Based on the embodiment shown in fig. 2, the embodiment of the invention further provides an image processing method, which may include the following steps as shown in fig. 3.
S301, acquiring the resolution of a source image, the alignment attribute corresponding to the source image, the predetermined cutting block arrangement information of a target image, the resolution of each cutting block of the target image and algorithm attribute information of a preset scaling algorithm.
S302, determining a plurality of reference pixel points corresponding to the target pixel points in each cutting block of the target image from the source image according to the resolution, the alignment attribute, the cutting block arrangement information, the resolution of each cutting block and the algorithm attribute information of the source image.
The front preset row pixel points in any cutting block of the target image have corresponding reference pixel points which are the same as the rear preset row pixel points in the adjacent previous cutting block, and the front preset row pixel points have corresponding reference pixel points which are the same as the rear preset row pixel points in the adjacent previous cutting block.
S303, determining cutting parameters of the source image according to a plurality of reference pixel points corresponding to the target pixel points in each cutting block.
S304, cutting the source image based on the cutting parameters to obtain a plurality of source image cutting blocks, and determining a scaling processing coefficient according to the resolution of the source image, the arrangement information of the cutting blocks, the resolution of each cutting block and the algorithm attribute information.
S305, respectively scaling each source image cutting block based on the scaling processing coefficient by utilizing a preset scaling algorithm to obtain each target image cutting block, and synthesizing each target image cutting block to obtain the target image.
S306, controlling each display screen to cut and display the target image, or controlling each display screen to display each target image cutting block respectively.
The method can be applied to an imaging system, the imaging system can comprise a spliced screen and a processor, the spliced screen is specifically spliced by a plurality of display screens, final image display is realized on the spliced screen, and a specific display mode can be realized by the following two modes: firstly, controlling each display screen to cut and display a target image, wherein the specific control implementation mode is to cut the target image, then correspondingly send each cut image block to each display screen, and display the cut image block by each display screen; and secondly, controlling each display screen to display each target image cutting block respectively, wherein the specific control implementation mode is that each target image cutting block is directly and correspondingly sent to each display screen, and each display screen displays the target image cutting block respectively.
When the embodiment of the invention is applied to source image cutting, the cutting parameters of the source image are reversely calculated by utilizing the resolution of the source image, the alignment attribute corresponding to the source image, the cutting block arrangement information of the target image, the cutting block resolution of the target image and the algorithm attribute information of a preset scaling algorithm, and as the front preset column pixel point in any cutting block of the target image has the same corresponding reference pixel point as the rear preset column pixel point in the adjacent front cutting block and the front preset row pixel point has the same corresponding reference pixel point as the rear preset row pixel point in the adjacent upper cutting block, the cutting boundary of each cutting block of the source image during independent scaling is considered, so that the scaling ratio of the target pixel point is the same when the source image is cut and scaled according to the cutting parameters, and each cutting block of the target image has the same or similar image data at the boundary, thereby avoiding the problem of image deformation during the synthesis processing of each source image cutting block after the scaling. And the target image is displayed through the spliced screen, so that a user can intuitively observe the target image without deformation.
Taking the example that a video source in YUV420 format is displayed on a 3×3 and 1080P spliced screen, the resolution of the video source is 1280×720, a horizontal 8-order vertical 6-order scaling algorithm is adopted, according to the process in the above embodiment, video source cutting processing is performed to obtain each cutting block of the video source, as shown in fig. 4, a video source image is cut into 3 rows and 3 columns, the vertical directions are respectively video source pixels 1-242, video source pixels 237-482, video source pixels 477-720, and the horizontal directions are respectively video source pixels 1-430, video source pixels 423-858, and video source pixels 849-1280.
When scaling, the key idea is that the target pixel calculation of each target cutting block keeps the integral scaling of the video source reference pixel/scaling algorithm/scaling calculation vector system and the video source consistent so as to ensure that the integral scaling results of the corresponding target pixel and the video source after the independent scaling calculation of each cutting block are completely consistent, and the key is that when the cutting block is scaled, the video source reference pixel and the scaling calculation vector coefficient of the integral scaling processing of the reference video source are calculated by each target pixel, and the scaling processing flow is shown in fig. 5.
Based on the above, as shown in fig. 6, the target pixel 1920/1921/1922 of the cutting block scaling process, the scaling process reference video source pixel and the scaling process vector coefficient and the video source overall process are completely consistent (the target pixels 1920, 1921 and 1922 of the cutting block scaled reference video source pixel are 423-430, 1920 correspond to coefficient vector 1, 1921 correspond to coefficient vector 2, 1922 correspond to coefficient vector 3), thereby ensuring that the cutting block independent scaling result and the video source overall scaling process are completely consistent.
Based on the above method embodiment, an embodiment of the present invention provides an image processing apparatus, as shown in fig. 7, which may include:
An obtaining module 710, configured to obtain a resolution of a source image, an alignment attribute corresponding to the source image, predetermined arrangement information of cutting blocks of a target image, resolutions of cutting blocks of the target image, and algorithm attribute information of a preset scaling algorithm;
the cutting processing module 720 is configured to determine, from the source image, a plurality of reference pixel points corresponding to the target pixel points in each cutting block of the target image according to the resolution, the alignment attribute, the cutting block arrangement information, the resolution of each cutting block, and the algorithm attribute information of the source image; the front preset row pixel points in any cutting block of the target image have corresponding reference pixel points which are the same as the rear preset row pixel points in the adjacent previous cutting block, and the front preset row pixel points have corresponding reference pixel points which are the same as the rear preset row pixel points in the adjacent previous cutting block; determining cutting parameters of a source image according to a plurality of reference pixel points corresponding to target pixel points in each cutting block; cutting the source image based on the cutting parameters to obtain a plurality of source image cutting blocks, and determining a scaling processing coefficient according to the resolution of the source image, the arrangement information of the cutting blocks, the resolution of each cutting block and the algorithm attribute information;
The scaling processing module 730 is configured to scale each source image cutting block based on the scaling processing coefficient by using a preset scaling algorithm, so as to obtain each destination image cutting block;
the image synthesis processing module 740 is configured to perform synthesis processing on each target image cutting block to obtain a target image.
Optionally, the cutting processing module 720 may specifically be configured to:
determining a plurality of horizontal direction pixel ranges and a plurality of vertical direction pixel ranges of the source image according to the resolution, the alignment attribute and the cutting block arrangement information of the source image;
determining a plurality of reference pixel points corresponding to vertex pixel points in the horizontal direction of each cutting block of the target image according to the pixel range in each horizontal direction, the horizontal component of the resolution of each cutting block and the horizontal order in the algorithm attribute information;
and determining a plurality of reference pixel points corresponding to the vertex pixel points of each cutting block in the vertical direction of the target image according to the pixel range of each vertical direction, the vertical component of each cutting block resolution and the vertical order in the algorithm attribute information.
Optionally, the cutting processing module 720 may specifically be configured to:
determining a plurality of reference pixel points at two ends of each horizontal direction pixel range meeting the horizontal order according to each horizontal direction pixel range and the horizontal order in the algorithm attribute information;
For each cutting block, according to the horizontal component of the resolution of the cutting block and a plurality of reference pixel points at two ends of the pixel range in each horizontal direction, determining the plurality of reference pixel points at two ends as a plurality of reference pixel points corresponding to two vertex pixel points in the horizontal direction of the cutting block.
Optionally, the cutting processing module 720 may specifically be configured to:
determining a plurality of reference pixel points at two ends of each vertical direction pixel range meeting the vertical order according to each vertical direction pixel range and the vertical order in the algorithm attribute information;
for each cutting block, according to the vertical component of the resolution of the cutting block and a plurality of reference pixel points at two ends of the pixel range in each vertical direction, determining the plurality of reference pixel points at two ends as a plurality of reference pixel points corresponding to two vertex pixel points in the vertical direction of the cutting block.
Optionally, the scaling processing coefficient is a coefficient vector corresponding to each pixel point in the target image;
the scaling processing module 730 may specifically be configured to:
and aiming at each pixel point in each target image cutting block, performing scaling operation on the pixel values of a plurality of reference pixel points corresponding to the pixel point according to the coefficient vector corresponding to the pixel point to obtain the pixel value of the pixel point.
Optionally, the image synthesis processing module 740 may be further configured to:
and controlling each display screen to cut and display the target image, or controlling each display screen to display each target image cutting block respectively.
When the embodiment of the invention is applied to source image cutting, the cutting parameters of the source image are reversely calculated by utilizing the resolution of the source image, the alignment attribute corresponding to the source image, the cutting block arrangement information of the target image, the cutting block resolution of the target image and the algorithm attribute information of a preset scaling algorithm, and as the front preset column pixel point in any cutting block of the target image has the same corresponding reference pixel point as the rear preset column pixel point in the adjacent front cutting block and the front preset row pixel point has the same corresponding reference pixel point as the rear preset row pixel point in the adjacent upper cutting block, the cutting boundary of each cutting block of the source image during independent scaling is considered, so that the scaling ratio of the target pixel point is the same when the source image is cut and scaled according to the cutting parameters, and each cutting block of the target image has the same or similar image data at the boundary, thereby avoiding the problem of image deformation during the synthesis processing of each source image cutting block after the scaling.
An embodiment of the present invention provides an electronic device, as shown in fig. 8, including a processor 801 and a memory 802, where the memory 802 stores machine executable instructions capable of being executed by the processor 801, and the machine executable instructions are loaded and executed by the processor 801 to implement the above-mentioned image processing method.
The Memory may include RAM (Random Access Memory ) or NVM (Non-volatile Memory), such as at least one magnetic disk Memory. Optionally, the memory may also be at least one memory device located remotely from the aforementioned processor.
The processor may be a general-purpose processor, including a CPU (Central Processing Unit ), NP (Network Processor, network processor), etc.; but also DSP (Digital Signal Processor ), ASIC (Application Specific Integrated Circuit, application specific integrated circuit), FPGA (Field-Programmable Gate Array, field programmable gate array) or other programmable logic device, discrete gate or transistor logic device, discrete hardware components.
The memory 802 and the processor 801 may be in data transmission through a wired connection or a wireless connection, and the electronic device and the other devices may communicate through a wired communication interface or a wireless communication interface. Fig. 8 shows only an example of data transmission through a bus, and is not limited to a specific connection method.
In the embodiment of the invention, the processor can realize by reading the machine executable instructions stored in the memory and loading and executing the machine executable instructions: when the source image is cut, the resolution of the source image, the alignment attribute corresponding to the source image, the cutting block arrangement information of the target image, the cutting block resolution of each cutting block of the target image and the algorithm attribute information of a preset scaling algorithm are utilized to reversely calculate the cutting parameters of the source image, and as the front preset column pixel point in any cutting block of the target image has the same corresponding reference pixel point as the rear preset column pixel point in the adjacent front cutting block and the front preset row pixel point has the same corresponding reference pixel point as the rear preset row pixel point in the adjacent upper cutting block, the cutting boundary of each cutting block of the source image when the source image is independently scaled is considered, when the source image is cut and scaled according to the cutting parameters, the scaling ratio of each cutting block of the target image is the same or similar image data at the boundary, the problem of image deformation when the cutting blocks of each source image after the synthesis processing are synthesized can be avoided.
In addition, an embodiment of the present invention provides a storage medium having stored therein machine-executable instructions which, when loaded and executed by a processor, implement the above-described image processing method.
In the embodiment of the present invention, the machine-readable storage medium stores machine-executable instructions for executing the image processing method provided in the embodiment of the present invention at the time of execution, so that it is possible to implement: when the source image is cut, the resolution of the source image, the alignment attribute corresponding to the source image, the cutting block arrangement information of the target image, the cutting block resolution of each cutting block of the target image and the algorithm attribute information of a preset scaling algorithm are utilized to reversely calculate the cutting parameters of the source image, and as the front preset column pixel point in any cutting block of the target image has the same corresponding reference pixel point as the rear preset column pixel point in the adjacent front cutting block and the front preset row pixel point has the same corresponding reference pixel point as the rear preset row pixel point in the adjacent upper cutting block, the cutting boundary of each cutting block of the source image when the source image is independently scaled is considered, when the source image is cut and scaled according to the cutting parameters, the scaling ratio of each cutting block of the target image is the same or similar image data at the boundary, the problem of image deformation when the cutting blocks of each source image after the synthesis processing are synthesized can be avoided.
The embodiment of the invention also provides a display system, as shown in fig. 9, which comprises a plurality of display screens 901 and a processor 902;
a processor 902, configured to obtain a resolution of a source image, an alignment attribute corresponding to the source image, predetermined arrangement information of cutting blocks of a target image, resolutions of cutting blocks of the target image, and algorithm attribute information of a preset scaling algorithm; determining a plurality of reference pixel points corresponding to the target pixel points in each cutting block of the target image from the source image according to the resolution, the alignment attribute, the cutting block arrangement information, the resolution of each cutting block and the algorithm attribute information of the source image; the front preset row pixel points in any cutting block of the target image have corresponding reference pixel points which are the same as the rear preset row pixel points in the adjacent previous cutting block, and the front preset row pixel points have corresponding reference pixel points which are the same as the rear preset row pixel points in the adjacent previous cutting block; determining cutting parameters of a source image according to a plurality of reference pixel points corresponding to target pixel points in each cutting block; cutting the source image based on the cutting parameters to obtain a plurality of source image cutting blocks, and determining a scaling processing coefficient according to the resolution of the source image, the arrangement information of the cutting blocks, the resolution of each cutting block and the algorithm attribute information; scaling the source image cutting blocks respectively based on scaling processing coefficients by using a preset scaling algorithm to obtain target image cutting blocks, and synthesizing the target image cutting blocks to obtain target images; controlling each display screen to cut and display the target image, or controlling each display screen to display each target image cutting block respectively;
Each display screen 901 is used for cutting and displaying a target image, or displaying each target image cutting block.
The processor in the embodiment of the present invention may be a stand-alone device, such as the electronic device in the embodiment shown in fig. 8; the display system can also be a core processing unit in a display system, and the display system formed by the core processing unit and each display screen is display equipment with image processing and image display functions.
When the embodiment of the invention is applied to source image cutting, the cutting parameters of the source image are reversely calculated by utilizing the resolution of the source image, the alignment attribute corresponding to the source image, the cutting block arrangement information of the target image, the cutting block resolution of the target image and the algorithm attribute information of a preset scaling algorithm, and as the front preset column pixel point in any cutting block of the target image has the same corresponding reference pixel point as the rear preset column pixel point in the adjacent front cutting block and the front preset row pixel point has the same corresponding reference pixel point as the rear preset row pixel point in the adjacent upper cutting block, the cutting boundary of each cutting block of the source image during independent scaling is considered, so that the scaling ratio of the target pixel point is the same when the source image is cut and scaled according to the cutting parameters, and each cutting block of the target image has the same or similar image data at the boundary, thereby avoiding the problem of image deformation during the synthesis processing of each source image cutting block after the scaling.
For the apparatus, electronic device, storage medium and display system embodiments, the description is relatively simple, as the method content involved is substantially similar to the method embodiments described above, and reference will only be made to the part of the description of the method embodiments where relevant.
It is noted that relational terms such as first and second, and the like are used solely to distinguish one entity or action from another entity or action without necessarily requiring or implying any actual such relationship or order between such entities or actions. Moreover, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising one … …" does not exclude the presence of other like elements in a process, method, article, or apparatus that comprises the element.
In this specification, each embodiment is described in a related manner, and identical and similar parts of each embodiment are all referred to each other, and each embodiment mainly describes differences from other embodiments. In particular, for apparatus, electronic devices, storage media, and display system embodiments, the description is relatively simple as it is substantially similar to method embodiments, as relevant points are found in the partial description of method embodiments.
The foregoing description is only of the preferred embodiments of the present invention and is not intended to limit the scope of the present invention. Any modification, equivalent replacement, improvement, etc. made within the spirit and principle of the present invention are included in the protection scope of the present invention.

Claims (15)

1. An image processing method, the method comprising:
acquiring the resolution of a source image, alignment attributes corresponding to the source image, predetermined cutting block arrangement information of a target image, the resolution of each cutting block of the target image and algorithm attribute information of a preset scaling algorithm;
determining a plurality of reference pixel points corresponding to target pixel points in each cutting block of the target image from the source image according to the resolution of the source image, the alignment attribute, the cutting block arrangement information, the resolution of each cutting block and the algorithm attribute information; the front preset row pixel points in any cutting block of the target image have corresponding reference pixel points which are the same as the rear preset row pixel points in the adjacent previous cutting block, and the front preset row pixel points have corresponding reference pixel points which are the same as the rear preset row pixel points in the adjacent previous cutting block;
Determining cutting parameters of the source image according to a plurality of reference pixel points corresponding to the target pixel points in each cutting block;
cutting the source image based on the cutting parameters to obtain a plurality of source image cutting blocks, and determining a scaling processing coefficient according to the resolution of the source image, the cutting block arrangement information, the resolution of each cutting block and the algorithm attribute information;
and respectively scaling each source image cutting block based on the scaling processing coefficient by utilizing the preset scaling algorithm to obtain each target image cutting block, and synthesizing each target image cutting block to obtain a target image.
2. The method according to claim 1, wherein determining a plurality of reference pixel points corresponding to a target pixel point in each cutting block of the target image according to the resolution of the source image, the alignment attribute, the cutting block arrangement information, the respective cutting block resolutions, and the algorithm attribute information includes:
determining a plurality of horizontal direction pixel ranges and a plurality of vertical direction pixel ranges of the source image according to the resolution ratio of the source image, the alignment attribute and the cutting block arrangement information;
Determining a plurality of reference pixel points corresponding to vertex pixel points in the horizontal direction of each cutting block of the target image according to the pixel range in each horizontal direction, the horizontal component of the resolution of each cutting block and the horizontal order in the algorithm attribute information;
and determining a plurality of reference pixel points corresponding to vertex pixel points in the vertical direction of each cutting block of the target image according to the pixel range in each vertical direction, the vertical component of the resolution of each cutting block and the vertical order in the algorithm attribute information.
3. The method according to claim 2, wherein the determining a plurality of reference pixel points corresponding to vertex pixel points in the horizontal direction of each cutting block of the target image according to the pixel range in each horizontal direction, the horizontal component of the resolution of each cutting block, and the horizontal order in the algorithm attribute information includes:
determining a plurality of reference pixel points at two ends of each horizontal direction pixel range meeting the horizontal order according to each horizontal direction pixel range and the horizontal order in the algorithm attribute information;
and for each cutting block, determining the multiple reference pixel points at the two ends as multiple reference pixel points corresponding to two vertex pixel points in the horizontal direction of the cutting block according to the horizontal component of the resolution of the cutting block and the multiple reference pixel points at the two ends of the pixel range in each horizontal direction.
4. The method according to claim 2, wherein the determining a plurality of reference pixel points corresponding to vertex pixel points in the vertical direction of each cutting block of the target image according to the vertical direction pixel range, the vertical component of the resolution of each cutting block, and the vertical order in the algorithm attribute information includes:
determining a plurality of reference pixel points at two ends of each vertical direction pixel range meeting the vertical order according to each vertical direction pixel range and the vertical order in the algorithm attribute information;
and for each cutting block, determining the multiple reference pixel points at the two ends as multiple reference pixel points corresponding to two vertex pixel points in the vertical direction of the cutting block according to the vertical component of the resolution of the cutting block and the multiple reference pixel points at the two ends of the pixel range in the vertical direction.
5. The method of claim 1, wherein the scaling factor is a coefficient vector corresponding to each pixel in the destination image;
the scaling of each source image cutting block based on the scaling processing coefficient by using the preset scaling algorithm to obtain each target image cutting block includes:
And aiming at each pixel point in each target image cutting block, performing scaling operation on the pixel values of a plurality of reference pixel points corresponding to the pixel point according to the coefficient vector corresponding to the pixel point to obtain the pixel value of the pixel point.
6. The method of claim 1, wherein after said synthesizing each of said destination image cutting blocks to obtain a destination image, said method further comprises:
and controlling each display screen to cut and display the target image, or controlling each display screen to display each target image cutting block respectively.
7. An image processing apparatus, characterized in that the apparatus comprises:
the device comprises an acquisition module, a scaling module and a scaling module, wherein the acquisition module is used for acquiring the resolution of a source image, the alignment attribute corresponding to the source image, the cutting block arrangement information of a predetermined target image, the resolution of each cutting block of the target image and the algorithm attribute information of a preset scaling algorithm;
the cutting processing module is used for determining a plurality of reference pixel points corresponding to the target pixel points in each cutting block of the target image from the source image according to the resolution of the source image, the alignment attribute, the cutting block arrangement information, the resolution of each cutting block and the algorithm attribute information; the front preset row pixel points in any cutting block of the target image have corresponding reference pixel points which are the same as the rear preset row pixel points in the adjacent previous cutting block, and the front preset row pixel points have corresponding reference pixel points which are the same as the rear preset row pixel points in the adjacent previous cutting block; determining cutting parameters of the source image according to a plurality of reference pixel points corresponding to the target pixel points in each cutting block; cutting the source image based on the cutting parameters to obtain a plurality of source image cutting blocks, and determining a scaling processing coefficient according to the resolution of the source image, the cutting block arrangement information, the resolution of each cutting block and the algorithm attribute information;
The scaling processing module is used for respectively scaling each source image cutting block based on the scaling processing coefficients by utilizing the preset scaling algorithm to obtain each target image cutting block;
and the image synthesis processing module is used for carrying out synthesis processing on the target image cutting blocks to obtain target images.
8. The device according to claim 7, characterized in that said cutting processing module is in particular adapted to:
determining a plurality of horizontal direction pixel ranges and a plurality of vertical direction pixel ranges of the source image according to the resolution ratio of the source image, the alignment attribute and the cutting block arrangement information;
determining a plurality of reference pixel points corresponding to vertex pixel points in the horizontal direction of each cutting block of the target image according to the pixel range in each horizontal direction, the horizontal component of the resolution of each cutting block and the horizontal order in the algorithm attribute information;
and determining a plurality of reference pixel points corresponding to vertex pixel points in the vertical direction of each cutting block of the target image according to the pixel range in each vertical direction, the vertical component of the resolution of each cutting block and the vertical order in the algorithm attribute information.
9. The device according to claim 8, characterized in that said cutting processing module is in particular adapted to:
Determining a plurality of reference pixel points at two ends of each horizontal direction pixel range meeting the horizontal order according to each horizontal direction pixel range and the horizontal order in the algorithm attribute information;
and for each cutting block, determining the multiple reference pixel points at the two ends as multiple reference pixel points corresponding to two vertex pixel points in the horizontal direction of the cutting block according to the horizontal component of the resolution of the cutting block and the multiple reference pixel points at the two ends of the pixel range in each horizontal direction.
10. The device according to claim 8, characterized in that said cutting processing module is in particular adapted to:
determining a plurality of reference pixel points at two ends of each vertical direction pixel range meeting the vertical order according to each vertical direction pixel range and the vertical order in the algorithm attribute information;
and for each cutting block, determining the multiple reference pixel points at the two ends as multiple reference pixel points corresponding to two vertex pixel points in the vertical direction of the cutting block according to the vertical component of the resolution of the cutting block and the multiple reference pixel points at the two ends of the pixel range in the vertical direction.
11. The apparatus of claim 7, wherein the scaling factor is a factor vector corresponding to each pixel in the destination image;
The scaling processing module is specifically configured to:
and aiming at each pixel point in each target image cutting block, performing scaling operation on the pixel values of a plurality of reference pixel points corresponding to the pixel point according to the coefficient vector corresponding to the pixel point to obtain the pixel value of the pixel point.
12. The apparatus of claim 7, wherein the image synthesis processing module is further configured to:
and controlling each display screen to cut and display the target image, or controlling each display screen to display each target image cutting block respectively.
13. An electronic device comprising a processor and a memory, wherein the memory stores machine executable instructions executable by the processor, the machine executable instructions being loaded and executed by the processor to implement the method of any of claims 1-6.
14. A storage medium having stored therein machine executable instructions which, when loaded and executed by a processor, implement the method of any one of claims 1-6.
15. A display system, the system comprising a plurality of display screens and a processor;
The processor is used for acquiring the resolution of a source image, the alignment attribute corresponding to the source image, the cutting block arrangement information of a predetermined target image, the resolution of each cutting block of the target image and algorithm attribute information of a preset scaling algorithm; determining a plurality of reference pixel points corresponding to target pixel points in each cutting block of the target image from the source image according to the resolution of the source image, the alignment attribute, the cutting block arrangement information, the resolution of each cutting block and the algorithm attribute information; the front preset row pixel points in any cutting block of the target image have corresponding reference pixel points which are the same as the rear preset row pixel points in the adjacent previous cutting block, and the front preset row pixel points have corresponding reference pixel points which are the same as the rear preset row pixel points in the adjacent previous cutting block; determining cutting parameters of the source image according to a plurality of reference pixel points corresponding to the target pixel points in each cutting block; cutting the source image based on the cutting parameters to obtain a plurality of source image cutting blocks, and determining a scaling processing coefficient according to the resolution of the source image, the cutting block arrangement information, the resolution of each cutting block and the algorithm attribute information; scaling each source image cutting block based on the scaling processing coefficient by utilizing the preset scaling algorithm to obtain each target image cutting block, and synthesizing each target image cutting block to obtain a target image; controlling each display screen to cut and display the target image, or controlling each display screen to display each target image cutting block respectively;
And each display screen is used for cutting and displaying the target image or displaying each target image cutting block.
CN202010328163.8A 2020-04-23 2020-04-23 Image processing method, device, electronic equipment, storage medium and display system Active CN113554659B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202010328163.8A CN113554659B (en) 2020-04-23 2020-04-23 Image processing method, device, electronic equipment, storage medium and display system

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202010328163.8A CN113554659B (en) 2020-04-23 2020-04-23 Image processing method, device, electronic equipment, storage medium and display system

Publications (2)

Publication Number Publication Date
CN113554659A CN113554659A (en) 2021-10-26
CN113554659B true CN113554659B (en) 2023-06-02

Family

ID=78129440

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202010328163.8A Active CN113554659B (en) 2020-04-23 2020-04-23 Image processing method, device, electronic equipment, storage medium and display system

Country Status (1)

Country Link
CN (1) CN113554659B (en)

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102289786A (en) * 2011-09-01 2011-12-21 青岛海信信芯科技有限公司 Edge anti-aliasing method and device for image scaling
CN104660916A (en) * 2013-11-18 2015-05-27 杭州海康威视数字技术股份有限公司 Screen splicing system and processing method of video data streams
CN107729899A (en) * 2016-08-11 2018-02-23 杭州海康威视数字技术股份有限公司 A kind of number-plate number recognition methods and device
CN108346131A (en) * 2018-01-26 2018-07-31 深圳开阳电子股份有限公司 A kind of digital image scaling method, device and display equipment
CN110650295A (en) * 2019-11-26 2020-01-03 展讯通信（上海）有限公司 Image processing method and device

Family Cites Families (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7023447B2 (en) * 2001-05-02 2006-04-04 Eastman Kodak Company Block sampling based method and apparatus for texture synthesis
KR20140054518A (en) * 2012-10-29 2014-05-09 삼성전자주식회사 Image processing appparatus and control method thereof

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102289786A (en) * 2011-09-01 2011-12-21 青岛海信信芯科技有限公司 Edge anti-aliasing method and device for image scaling
CN104660916A (en) * 2013-11-18 2015-05-27 杭州海康威视数字技术股份有限公司 Screen splicing system and processing method of video data streams
CN107729899A (en) * 2016-08-11 2018-02-23 杭州海康威视数字技术股份有限公司 A kind of number-plate number recognition methods and device
CN108346131A (en) * 2018-01-26 2018-07-31 深圳开阳电子股份有限公司 A kind of digital image scaling method, device and display equipment
CN110650295A (en) * 2019-11-26 2020-01-03 展讯通信（上海）有限公司 Image processing method and device

Non-Patent Citations (2)

* Cited by examiner, † Cited by third party
Title
Splicebuster: A new blind image splicing detector;Davide Cozzolino,et al.;《2015 IEEE International Workshop on Information Forensics and Security(WIFS)》》;1-6 *
视频图像序列运动参数估计与动态拼接;汤庆阳 等;《计算机科学》(第6期);189-193 *

Also Published As

Publication number Publication date
CN113554659A (en) 2021-10-26

Similar Documents

Publication Publication Date Title
CN109992226A (en) Image display method and device and spliced display screen
JP2005339313A (en) Method and apparatus for presenting image
JP5870586B2 (en) Projector control device, display device, and program.
KR20090132484A (en) Information display apparatus, information displaying method, and computer readable medium
JP2022500792A (en) Image processing methods and devices, electronic devices and storage media
WO2008020506A1 (en) Image display control device, image display method, and information storage medium
US20120242693A1 (en) Image synthesis device and image synthesis program
JP2007017615A (en) Image processor, picture processing method, and program
TW200818911A (en) Video window detector
US20200280684A1 (en) Method and system of fast image blending for overlapping region in surround view
CN113554659B (en) Image processing method, device, electronic equipment, storage medium and display system
WO2018087856A1 (en) Image synthesis device and image synthesis method
US20110221775A1 (en) Method for transforming displaying images
US10930185B2 (en) Information processing system, information processing apparatus, output apparatus, program, and recording medium
KR102005526B1 (en) Method and apparatus for displaying augmented reality
JP5387276B2 (en) Image processing apparatus and image processing method
CN112150345A (en) Image processing method and device, video processing method and sending card
KR102464575B1 (en) Display apparatus and input method thereof
KR20190134217A (en) Method and electronic device for processing a plurality of images
JP2016095667A (en) Image processing device and electronics apparatus
KR20190136517A (en) Apparatus and method for visualizing congestion degree
US11893706B2 (en) Image correction device
JP5281720B1 (en) 3D image processing apparatus and 3D image processing method
JP4148939B2 (en) Image correction apparatus, image correction method, and image display apparatus
JP6237141B2 (en) Gradation correction apparatus and program

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant