CN110913262A - Image superposition method and device - Google Patents

Image superposition method and device Download PDF

Info

Publication number
CN110913262A
CN110913262A CN201911192958.4A CN201911192958A CN110913262A CN 110913262 A CN110913262 A CN 110913262A CN 201911192958 A CN201911192958 A CN 201911192958A CN 110913262 A CN110913262 A CN 110913262A
Authority
CN
China
Prior art keywords
image
pixel
display
superimposed
superposed
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN201911192958.4A
Other languages
Chinese (zh)
Other versions
CN110913262B (en
Inventor
马希通
温垦
耿立华
徐健
李咸珍
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
BOE Technology Group Co Ltd
Original Assignee
BOE Technology Group Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by BOE Technology Group Co Ltd filed Critical BOE Technology Group Co Ltd
Priority to CN201911192958.4A priority Critical patent/CN110913262B/en
Publication of CN110913262A publication Critical patent/CN110913262A/en
Application granted granted Critical
Publication of CN110913262B publication Critical patent/CN110913262B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/431Generation of visual interfaces for content selection or interaction; Content or additional data rendering
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/47End-user applications
    • H04N21/485End-user interface for client configuration
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/47End-user applications
    • H04N21/485End-user interface for client configuration
    • H04N21/4854End-user interface for client configuration for modifying image parameters, e.g. image brightness, contrast

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Human Computer Interaction (AREA)
  • Controls And Circuits For Display Device (AREA)
  • Image Processing (AREA)

Abstract

The application provides an image superposition method and an image superposition device, wherein the method comprises the following steps: acquiring a first image signal corresponding to a superposed image, wherein the first image signal comprises pixel transparency information; acquiring a second image signal corresponding to a display image; and performing superposition processing on the superposed image and the display image according to the pixel transparency information. From this, through setting up every pixel of superimposed image and all corresponding a pixel transparency information to according to pixel transparency information, carry out the stack processing to superimposed image and display image, realized that the transparency of superimposed image is nimble adjustable, make display panel can realize the effect of full fretwork when showing superimposed image and the image after the display image stack, promoted display effect, improved user experience.

Description

Image superposition method and device
Technical Field
The present disclosure relates to the field of image processing technologies, and in particular, to an image superimposing method and apparatus.
Background
The OSD (On-Screen Display) technique is a technique for generating characters or graphics On a Display Screen to help a user understand information conveyed by a designer. For example, some trademarks (logos) are displayed on the display screen when the video is played on the display screen.
At present, when an 8K display System superimposes OSD information on a video, an on-chip System (SOC) is mostly adopted to send the OSD information to be superimposed with video information generated by a Field Programmable Gate Array (FPGA), and when the video information and the OSD information are superimposed, the manner of overlay or uniform transparency superimposition is mainly adopted, and the manner of overlay cannot flexibly control the display manner of the OSD, so that the display effect is poor, and the user experience is poor.
Disclosure of Invention
The embodiment of the application provides an image superposition method and an image superposition device, which are used for solving the technical problems that when video information and OSD information are superposed in a covering superposition or uniform transparency superposition mode in the related art, the OSD display mode cannot be flexibly controlled, the display effect is poor, and the user experience is poor.
To this end, an embodiment of an aspect of the present application provides an image superimposing method, including obtaining a first image signal corresponding to a superimposed image, where the first image signal includes pixel transparency information; acquiring a second image signal corresponding to a display image; and performing superposition processing on the superposed image and the display image according to the pixel transparency information.
As a first possible implementation manner of the first aspect of the present invention, before performing the superimposition processing on the superimposed image and the display image according to the pixel transparency information, the method further includes: acquiring a first pixel value of a pixel of a region corresponding to the superimposed image in the display image, and acquiring a second pixel value of the superimposed image; the superimposing the superimposed image and the display image according to the pixel transparency information includes: and generating a display pixel value of a superposition area according to the pixel transparency information, the first pixel value and the second pixel value.
As a second possible implementation manner of the first aspect of the present invention, the method further includes: and adjusting the background color of the superposed image according to the color information of the area corresponding to the superposed image in the display image and the color information of the superposed image.
As a third possible implementation manner of the first aspect of the present invention, the adjusting the background color of the superimposed image includes: and judging whether the color information of the area corresponding to the superposed image in the display image is consistent with the color information of the superposed image, and changing the background color of the superposed image when the color information of the area corresponding to the superposed image in the display image is consistent with the color information of the superposed image.
As a fourth possible implementation manner of the first aspect of the present invention, the determining whether color information of a region corresponding to the overlay image in the display image matches color information of the overlay image includes: respectively determining the gray scale of each third pixel in the area corresponding to the superposed image in the display image and the gray scale of each fourth pixel corresponding to the superposed image; counting the number M of third pixels with the gray scales larger than a first threshold value and the number N of fourth pixels with the gray scales larger than the first threshold value; calculating the difference percentage P ═ N-M)/M; if the difference percentage is larger than a second threshold and smaller than a third threshold, determining that the color information of the area corresponding to the superimposed image in the display image is consistent with the color information of the superimposed image; the first threshold range is 200-255, the second threshold range is 0.7-0.9, and the third threshold range is 1.0-1.3.
As a fifth possible implementation manner of the first aspect of the present invention, the gray scales of the third pixel and the fourth pixel respectively include a gray scale of a blue channel, a gray scale of a red channel, and a gray scale of a green channel of each pixel; the determining whether the color information of the area corresponding to the overlay image in the display image is consistent with the color information of the overlay image includes: and judging whether the color information of the area corresponding to the superposed image in the display image is consistent with the color information of the superposed image according to the gray scales of the three channels of the third pixels and the gray scales of the three channels of the fourth pixels in the area corresponding to the superposed image in the display image.
As a sixth possible implementation manner of the first aspect of the present invention, the pixel transparency information is transmitted through a reserved bit of the low voltage differential signal.
As a seventh possible implementation manner of the first aspect of the present invention, the method further includes: and carrying out frame synchronization processing on the second image signal and the first image signal.
As an eighth possible implementation manner of the first aspect of the present invention, when the pixel transparency information is 00, the pixel transparency information corresponds to a first transparency level; when the pixel transparency information is 01, corresponding to a second transparency level; when the pixel transparency information is 10, corresponding to a third transparency level; and when the pixel transparency information is 11, corresponding to a fourth transparency level.
As a ninth possible implementation manner of the first aspect of the present invention, the display pixel value of the overlap region is generated according to the following formula: when the transparency information is 00: pixel ═ Pixel (osd)% 0% + Pixel (sdi) 100%; when the transparency information is 01: pixel ═ Pixel (osd) + 25% + Pixel (sdi) 75%; when the transparency information is 10: pixel (osd) 75% + Pixel (sdi) 25%; when the transparency information is 11: pixel ═ Pixel (osd) + 100% + Pixel (sdi) 0%; wherein pixel (SDI) is the first pixel value and pixel (OSD) is the second pixel value.
The embodiment of the other aspect of the application provides an image superposition device, which comprises a system on a chip and a field programmable gate array, wherein the system on the chip is connected with the field programmable gate array; the system-on-chip is configured to provide a first image signal corresponding to a superimposed image, the first image signal containing pixel transparency information; the field programmable gate array is configured to receive the first image signal and a second image signal corresponding to a display image, and perform superposition processing on the display image and the superposition image according to the pixel transparency information.
As a first possible implementation manner of the second aspect of the present invention, the field programmable gate array includes a first interface, a second interface, and a third interface; the field programmable gate array is configured to receive a first image signal provided by the system on chip through the first interface, receive a second image signal through the second interface, and send a third image signal corresponding to the image after the superposition processing to a display panel through the third interface, so that the display panel displays according to the third image signal.
As a second possible implementation manner of the second aspect of the present invention, the field programmable gate array further includes: an image superposition processing module; the image superposition processing module is connected with the third interface, and is configured to acquire a second pixel value of the superposed image according to a first image signal received by the first interface, acquire a first pixel value of a pixel in a region corresponding to the superposed image in a display image according to the first image signal and a second image signal received by the second interface, and generate a display pixel value of the superposed region according to the pixel transparency information, the first pixel value, and the second pixel value.
As a third possible implementation manner of the second aspect of the present invention, the image superimposing apparatus further includes a storage module, and the field programmable gate array further includes a first memory write-in control module, a first memory read-in control module, a second memory write-in control module, and a second memory read-in control module; the first memory write-in control module is respectively connected with the first interface and the storage module, and is configured to write the first image signal received through the first interface into the storage module; the second memory write-in control module is respectively connected with the second interface and the storage module, and is configured to write the second image signal received through the second interface into the storage module; the first memory reading control module is respectively connected with the storage module and the image superposition processing module, and is configured to read the first image signal from the storage module to the image superposition processing module; the second memory reading control module is respectively connected with the storage module and the image superposition processing module, and is configured to read the second image signal from the storage module to the image superposition processing module.
As a fourth possible implementation manner of the second aspect of the present invention, the field programmable gate array further includes: an image analysis module; the image analysis module is respectively connected with the first memory reading control module, the second memory reading control module and the image superposition processing module, and is configured to receive the first image signal read by the first memory reading control module and the second image signal read by the second memory reading control module, and adjust the background color of the superposed image according to the color information of the area corresponding to the superposed image in the display image and the color information of the superposed image.
The technical scheme disclosed in the application has the following beneficial effects:
each pixel of the superposed image corresponds to one pixel transparency information, so that the superposed image and the display image are superposed according to the pixel transparency information, the transparency of the superposed image is flexible and adjustable, the display panel can achieve a full-hollow effect when the superposed image and the image after superposition of the display image are displayed, the display effect is improved, and the user experience is improved.
Additional aspects and advantages of the present application will be set forth in part in the description which follows and, in part, will be obvious from the description, or may be learned by practice of the present application.
Drawings
The foregoing and/or additional aspects and advantages of the present application will become apparent and readily appreciated from the following description of the embodiments, taken in conjunction with the accompanying drawings of which:
FIG. 1 is a flowchart illustrating an image overlay method according to an embodiment of the present application;
FIG. 2 is a schematic flow chart of an image superimposing method according to another embodiment of the present application;
fig. 3 is a schematic structural diagram of an image superimposing apparatus according to an embodiment of the present application;
fig. 4 is a schematic structural diagram of an array substrate according to an embodiment of the present application;
FIG. 5 is a schematic diagram illustrating a synchronization process of a first image signal transmitted by SOC and a second image signal transmitted by SDI according to an embodiment of the present application;
fig. 6 is a schematic structural diagram of an image superimposing apparatus according to another embodiment of the present application;
FIG. 7 is a schematic structural diagram of an electronic device according to an embodiment of the present application;
fig. 8 is a schematic structural diagram of an electronic device according to another embodiment of the present application.
Detailed Description
Reference will now be made in detail to embodiments of the present application, examples of which are illustrated in the accompanying drawings, wherein like or similar reference numerals refer to the same or similar elements or elements having the same or similar function throughout. The embodiments described below with reference to the drawings are exemplary and intended to be used for explaining the present application and should not be construed as limiting the present application.
It is understood that when an image such as a still image or a video image is displayed on the display panel, a preset image may be superimposed at a preset position of the image such as the still image or the video image, for example, when the video image is displayed, a character image of "12: 00" in zhejiang china "may be superimposed at the upper left corner of the video image. In the embodiment of the present application, images such as still images and video images to be displayed are collectively referred to as display images, and characters, images, and the like superimposed on the display images are collectively referred to as superimposed images.
In the related art, the display image and the superimposed image are superimposed mainly in a covering and superimposing or uniform transparency superimposing mode, and the transparency of the superimposed image cannot be flexibly adjusted in the superimposing mode, so that the superimposed image is an opaque or uniform transparency superimposed image, the display effect is poor, and the display mode is single.
In order to solve the technical problem, each pixel of the superposed image is set to correspond to one pixel transparency information, so that after a first image signal corresponding to the superposed image and comprising the pixel transparency information and a second image signal corresponding to the display image are obtained, the superposed image and the display image can be superposed according to the pixel transparency information, the transparency of the superposed image is flexible and adjustable, the display panel can achieve a full-hollow effect when the superposed image and the superposed image of the display image are displayed, the display effect is improved, and the user experience is improved.
An image superimposing method and an image superimposing apparatus according to an embodiment of the present application are described below with reference to the drawings.
First, referring to fig. 1, a detailed description is given of an image superimposing method provided in an embodiment of the present application.
Fig. 1 is a schematic flowchart of an image superimposing method according to an embodiment of the present application.
As shown in fig. 1, the image superimposing method of the present application may include:
step 101, obtaining a first image signal corresponding to a superimposed image, where the first image signal includes pixel transparency information.
Step 102, acquiring a second image signal corresponding to the display image.
Specifically, the image superimposing method provided by the embodiment of the present application may be executed by the image superimposing apparatus provided by the embodiment of the present application, and the image superimposing apparatus may be configured in the electronic device, so that when the superimposed image and the image after the superimposed image are displayed on the electronic device, the transparency of the superimposed image can be flexibly controlled, and the display panel can achieve a full hollow effect when the superimposed image and the image after the superimposed image are displayed. The electronic device may be any hardware device capable of displaying images, such as a smart phone, a notebook computer, a wearable device, and the like, which includes a display panel.
The display image and the superimposed image may be any type of image and any size, which is not limited in this application.
The first image signal may include information such as image content, display position, display size, pixel value of each pixel corresponding to the superimposed image, pixel transparency information, and the like of the superimposed image. The second image signal may include information such as image content of the display image, pixel values of respective pixels corresponding to the display image, and the like.
The different transparency information of the pixels can correspond to different transparency levels, and the transparency of the corresponding superposed images is different according to the different transparency levels. For example, the transparency of the corresponding superimposed image may be 0% at a first transparency level, 25% at a second transparency level, 75% at a third transparency level, and 100% at a fourth transparency level.
In this embodiment, step 101 may be executed before step 102, or may be executed after step 102, or step 101 may also be executed simultaneously with step 102, and this application does not limit the execution order of step 101 and step 102.
And 103, performing superposition processing on the superposed image and the display image according to the pixel transparency information.
In a specific implementation, the image superimposing apparatus may include an SOC configured to provide a first image signal corresponding to the superimposed image, and an FPGA configured to receive the first image signal and the second image signal and perform superimposing processing on the display image and the superimposed image according to the first image signal and the second image signal. That is to say, in the embodiment of the present application, the SOC may generate a first image signal according to information such as image content of the superimposed image, a display position, a display size, a pixel value of each pixel corresponding to the superimposed image, and pixel transparency information, and provide the first image signal to the FPGA, and the FPGA may perform superimposition processing on the superimposed image and the display image by using the first image signal provided by the SOC and a second image signal provided by a digital component serial interface (SDI) to determine a display pixel value of an image to be finally displayed.
In the embodiment of the present application, the SOC may determine the pixel transparency information in various ways to generate the first image signal including the pixel transparency information according to the determined pixel transparency information.
In a first mode
And determining the pixel transparency information according to the pixel transparency information of each pixel corresponding to each superposed image stored in the superposed image database.
Specifically, a superimposed image database may be preset, where the superimposed image database includes pixel transparency information of each pixel corresponding to each superimposed image, and thus the SOC may determine the pixel transparency information corresponding to the superimposed image according to the storage data of the superimposed image database.
Mode two
Pixel transparency information is determined according to the needs of the user.
Specifically, a human-computer interaction interface can be set, and a user can select or input pixel transparency information through the human-computer interaction interface, so that the SOC can determine the pixel transparency information corresponding to the superimposed image according to the selection or input of the user in the human-computer interaction interface.
Alternatively, the transparency information of the pixels corresponding to the superimposed image may also be obtained in other manners, which is not limited in this application.
That is to say, the pixel transparency information corresponding to different superimposed images may be stored in the superimposed image database after being preset, so that when superimposing the superimposed image and the display image, the SOC may determine the pixel transparency information corresponding to the superimposed image according to the content of the specific image to be superimposed and the pixel transparency information corresponding to each superimposed image stored in the superimposed image database, so as to generate a first image signal including the pixel transparency, and further enable the FPGA to perform the superimposing process on the superimposed image and the display image according to the pixel transparency information included in the first image signal. Or the pixel transparency information may be temporarily set in the human-computer interaction interface by the user as required, so that the SOC may generate the first image signal including the pixel transparency information according to the pixel transparency information set by the user, and further cause the FPGA to perform the overlay processing on the overlay image and the display image according to the pixel transparency information included in the first image signal.
In an exemplary embodiment, the SOC may transmit a first image signal including pixel transparency information to the FPGA through a Low-Voltage differential signaling (LVDS), where two reserved bits of the LVDS correspond to the pixel transparency information, and different values of the two reserved bits indicate different pixel transparency information and correspond to different transparency levels.
For example, when the pixel transparency information transmitted by the two reserved bits is 00, the pixel transparency information corresponds to a first transparency level; when the pixel transparency information transmitted by the two reserved bits is 01, the two reserved bits correspond to a second transparency level; when the pixel transparency information transmitted by the two reserved bits is 10, the pixel transparency information corresponds to a third transparency grade; and when the pixel transparency information transmitted by the two reserved bits is 11, the fourth transparency level is corresponded.
Specifically, after the image superimposing apparatus acquires the first image signal corresponding to the superimposed image and the second image signal corresponding to the display image, the image superimposing apparatus may determine the display pixel value corresponding to the superimposed area in which the superimposed image and the display image are superimposed according to the pixel transparency information included in the first image signal and the pixel value of each pixel corresponding to the superimposed image and the pixel value of each pixel corresponding to the display image included in the second image signal, so as to display the superimposed image on the display panel according to the display pixel value.
That is, before step 103, the method may further include:
a first pixel value of a pixel of a region in a display image corresponding to a superimposed image is acquired, and a second pixel value of the superimposed image is acquired.
The first pixel value can be determined according to the pixel value of each pixel corresponding to the display image included in the second image signal and the information such as the display position, the display size and the like of the superimposed image included in the first image signal; the second pixel value may be determined based on a pixel value of each pixel corresponding to the superimposed image included in the first image signal.
Accordingly, step 103 may be implemented by:
and generating a display pixel value of the overlapping area according to the pixel transparency information, the first pixel value and the second pixel value.
In a specific implementation, the display pixel values of the overlap region may be generated according to the following formula.
The transparency level is a first transparency level, that is, when the pixel transparency information is 00: pixel ═ Pixel (osd)% 0% + Pixel (sdi) 100%;
when the transparency level is the second transparency level, that is, the pixel transparency information is 01: pixel ═ Pixel (osd) + 25% + Pixel (sdi) 75%;
the transparency level is a third transparency level, i.e. the pixel transparency information is 10: pixel (osd) 75% + Pixel (sdi) 25%;
when the transparency level is a fourth transparency level, that is, the pixel transparency information is 11: pixel ═ Pixel (osd) + 100% + Pixel (sdi) 0%.
Wherein, Pixel (SDI) is the first Pixel value, Pixel (OSD) is the second Pixel value, and Pixel is the display Pixel value.
After the display pixel value of the superposition area is generated according to the pixel transparency information, the first pixel value and the second pixel value, the superposed image is displayed on the display panel according to the display pixel value, and therefore the required transparency of the superposed image can be presented in the superposition area of the superposed image and the display image.
For example, if each pixel corresponding to the superimposed image includes pixels such as a, B, C, and D, the area of the pixel a 'in the displayed image corresponds to the pixel a, the area of the pixel B' in the displayed image corresponds to the pixel B, the area of the pixel C 'in the displayed image corresponds to the pixel C, the area of the pixel D' in the displayed image corresponds to the pixel D, the first pixel value of the pixel a 'is a1, the second pixel value of the pixel a is a2, the first pixel value of the pixel B' is B1, the second pixel value of the pixel B is B2, the first pixel value of the pixel C 'is C1, the second pixel value of the pixel C is C2, the first pixel value of the pixel D' is D1, the second pixel value of the pixel D is D2, the transparency information of the first image signal corresponds to the second transparency level, and the superimposed image corresponds to the transparency level of the pixel a, B. C, D, the display pixel values of the pixels in the region corresponding to the pixels are: a2 × 25% + a1 × 75%, B2 × 25% + B1 × 75%, C2 × 25% + C1 × 75%, D2 × 25% + D1 × 75% … …. By displaying the superimposed image according to the display pixel values, the superimposed area can be made to be displayed at the second transparency level.
It is understood that, when displaying the superimposed image on the display panel, in addition to the superimposed region in which the superimposed image is to be displayed, it is necessary to display other regions except for the superimposed region, where the display pixel values of the other regions are the pixel values of the pixels of the other regions except for the region corresponding to the superimposed image in the display image. In addition, if the transparency level is other than the first transparency level and the second transparency level, the superimposed image can be displayed as preset pixel transparency information in the superimposed image displayed on the display panel, and the display panel of the display image can be seen through the superimposed image, that is, a full hollow effect is formed.
It should be noted that, in this embodiment of the application, the pixel transparency information of each pixel corresponding to the overlay image may be the same or different, that is, the transparency level corresponding to each pixel corresponding to the overlay image may be the same or different, and this application does not limit this. Accordingly, when the superimposed image is displayed on the display panel, the transparency of different portions of the superimposed image may be the same or different. For example, if the superimposed image includes two characters, which are "a" and "B", respectively, the transparency level of each pixel corresponding to the character "a" may be a first transparency level, the transparency level of each pixel corresponding to the character "B" may be a second transparency level, and accordingly, the transparency levels of "a" and "B" displayed on the display panel are different. Alternatively, the transparency levels of the pixels corresponding to the characters "a" and "B" may be the second transparency level, and accordingly, the transparency levels of the "a" and the "B" displayed on the display panel are the same. When the superimposed image is displayed on the display panel, the transparency of different parts of the superimposed image is different, so that the display effect can be richer.
In addition, in the foregoing embodiment, only the pixel transparency level is set as four levels as an example, in practical applications, the number of the pixel transparency levels may be set as needed, and the present application is not limited thereto.
It can be understood that, when the pixel transparency information is transmitted by using the two-bit reserved bits of the LVDS, the two-bit reserved bits can only transmit 4 different information at most, and then, when the pixel transparency levels include 6, 7, 8 or more levels, in the embodiment of the present application, the pixel transparency information can be transmitted by using the multiple-bit reserved bits of the LVDS, that is, when the pixel transparency information is transmitted by using the reserved bits of the LVDS, the number of bits of the reserved bits used can be flexibly set according to the number of the pixel transparency levels, and the present application does not limit the number of the reserved bits of the LVDS used.
By using reserved bits which have no other use temporarily in the LVDS to transmit the pixel transparency information, a new transmission channel is not required to be set, and resources are saved.
It should be noted that, since the first image signal and the second image signal are different source signals, in order to ensure that the superimposed images can be displayed synchronously, in the embodiment of the present application, the first image signal and the second image signal need to be processed by frame synchronization. The specific synchronization process will be described in the following embodiments, which are not described herein.
It should be noted that the image superimposing method provided in the embodiment of the present application can be applied to an ultra high definition professional display system, such as a medical professional display of the ultra high definition display system, so that when displaying a superimposed image and an image obtained by superimposing the image on the medical professional display, the transparency of the superimposed image can be flexibly controlled, and thus a full-hollow effect is achieved.
According to the image superposition method provided by the embodiment of the application, a first image signal corresponding to a superposed image is obtained at first, the first image signal comprises pixel transparency information, a second image signal corresponding to a display image is obtained, and therefore superposition processing is carried out on the superposed image and the display image according to the pixel transparency information. From this, through setting up every pixel of superimposed image and all corresponding a pixel transparency information to according to pixel transparency information, carry out the stack processing to superimposed image and display image, realized that the transparency of superimposed image is nimble adjustable, make display panel can realize the effect of full fretwork when showing superimposed image and the image after the display image stack, promoted display effect, improved user experience.
As can be seen from the above analysis, in the embodiment of the present application, the superimposed image and the display image may be displayed on the display panel after being superimposed according to the pixel transparency information, and the transparency of the superimposed image is flexible and adjustable, in practical applications, when the superimposed image is superimposed on the display image at a preset transparency level for display, the color of the region corresponding to the displayed image and the color of the superimposed image may be similar, so that the contents respectively displayed by the superimposed image and the displayed image cannot be accurately distinguished, which is described below with reference to fig. 2.
Fig. 2 is a schematic flowchart of an image superimposing method according to another embodiment of the present application.
As shown in fig. 2, the image superimposing method provided in the embodiment of the present application may include the following steps:
step 201, obtaining a first image signal corresponding to the superimposed image, where the first image signal includes pixel transparency information.
Step 202, acquiring a second image signal corresponding to the display image.
The specific implementation process and principle of the step 201 and the step 202 may refer to the description of the above embodiments, and are not described herein again.
Step 203, acquiring color information of the superimposed image according to the first image signal, and acquiring color information of a region corresponding to the superimposed image in the display image according to the first image signal and the second image signal.
And 204, adjusting the background color of the superposed image according to the color information of the area corresponding to the superposed image in the display image and the color information of the superposed image.
Specifically, after the color information of the superimposed image and the color information of the area corresponding to the superimposed image in the display image are obtained, whether the color information of the area corresponding to the superimposed image in the display image is consistent with the color information of the superimposed image or not can be judged, if the color information of the area corresponding to the superimposed image in the display image is consistent with the color information of the superimposed image, it indicates that the contents respectively displayed by the superimposed image and the display image cannot be accurately distinguished when the superimposed image and the display image are displayed after being superimposed, and at this time, the background color of the superimposed image can be changed.
It should be noted that the changed background color may be preset. For example, in the embodiment of the present application, the replacement colors respectively corresponding to the colors may be preset, so that when it is determined that the background color of the superimposed image needs to be changed, the background color to be replaced by the superimposed image may be determined according to the color of the region corresponding to the superimposed image in the display image and the preset replacement colors respectively corresponding to the colors, so as to change the background color of the superimposed image to the determined replacement color. The setting principle of the replacement color is that the contrast between the replacement color and the color of the area corresponding to the superimposed image in the display image is high, so that when the display image and the superimposed image with the replaced background color are displayed in a superimposed manner, the contents respectively displayed by the superimposed image and the display image can be accurately distinguished.
The color information of the superimposed image comprises the gray scale of each fourth pixel corresponding to the superimposed image, and the color information of the area corresponding to the superimposed image in the display image comprises the gray scale of each third pixel in the area corresponding to the superimposed image in the display image.
In a specific implementation, it can be determined whether the color information of the region corresponding to the superimposed image in the display image matches the color information of the superimposed image in the manner of steps 204a to 204 d.
Step 204a, respectively determining the gray scale of each third pixel in the area corresponding to the superimposed image in the display image and the gray scale of each fourth pixel corresponding to the superimposed image.
In step 204b, the number M of the third pixels with the gray scale larger than the first threshold and the number N of the fourth pixels with the gray scale larger than the first threshold are counted.
Specifically, the first threshold may be set as needed in combination with the total number of gray levels of the superimposed image, and it is only necessary to screen out the area of the displayed image corresponding to the superimposed image and the pixels with higher brightness in the superimposed image by using the first threshold, so as to perform subsequent determination by using the color information of these pixels. For example, for a superimposed image of 256 levels of gradation, the first threshold may be set to a value equal to 200 or greater than 200 and less than 255; for a superimposed image of 512 levels of gray scale, a first threshold of 450 may be set, and so on.
In step 204c, calculating a difference percentage P between the number M of the third pixels with the gray scale larger than the first threshold and the number N of the fourth pixels with the gray scale larger than the first threshold, which is (N-M)/M.
And step 204d, if the difference percentage is greater than the second threshold and less than the third threshold, determining that the color information of the area corresponding to the superimposed image in the display image is consistent with the color information of the superimposed image.
In an exemplary embodiment, the gray scale of the third pixel and the gray scale of the fourth pixel include a gray scale of a blue channel, a gray scale of a red channel, and a gray scale of a green channel of each pixel, respectively. Accordingly, when determining whether the color information of the region corresponding to the superimposed image in the display image is consistent with the color information of the superimposed image, it may be determined whether the color information of the region corresponding to the superimposed image in the display image is consistent with the color information of the superimposed image according to the gray scales of the three channels of each third pixel in the region corresponding to the superimposed image in the display image and the gray scales of the three channels of each fourth pixel in the region corresponding to the superimposed image.
That is, in the embodiment of the present application, it is necessary to calculate the difference percentage between the number of the third pixels with the gray scales of each channel larger than the first threshold and the number of the fourth pixels with the gray scales larger than the first threshold, and further determine whether the color information of the area corresponding to the overlay image in the display image is consistent with the color information of the overlay image according to the three difference percentages.
Specifically, assume that the gray level of the red channel is greater than the gray level of the third pixel and the fourth pixel of the first thresholdNumber is MR、NRThe number of the third pixels and the fourth pixels of which the gray scale of the green channel is greater than the first threshold is M respectivelyG、NGThe number of the third pixels and the fourth pixels of which the gray scale of the blue channel is greater than the first threshold is M respectivelyB、NBThen M can be calculated separatelyRAnd NRPercent difference of (P)R,MGAnd NGPercent difference of (P)G,MBAnd NBPercent difference of (P)B
Wherein, PR=(NR-MR)/MR,PG=(NG-MG)/MG,PB=(NB-MB)/MB
Further, P is addedR、PG、PBComparing with the second threshold and the third threshold if PR、PG、PBIf both are greater than the second threshold and less than the third threshold, it may be determined that the color information of the region corresponding to the superimposed image in the display image is consistent with the color information of the superimposed image.
The second threshold and the third threshold can be arbitrarily set as required. In the embodiment of the present application, the second threshold value may be set to 0.8, and the third threshold value may be set to 1.2.
In an exemplary embodiment, the second threshold and the third threshold may be set empirically, or when a plurality of overlay images and a plurality of display images are overlaid according to the image overlay method described in the embodiment of the present application respectively through statistics, the value range of the difference percentage between M and N cannot be clearly distinguished, so that the second threshold and the third threshold are set according to the determined value range of the difference percentage between M and N. For example, by statistics, when it is determined that the percentage of the difference between M and N is smaller than 1.2 and larger than 0.8, the display contents of the superimposed image and the display image cannot be clearly distinguished, the first threshold may be set to 0.8, and the second threshold may be set to 1.2.
And step 205, performing superposition processing on the superposed image and the display image according to the pixel transparency information and the adjusted background color of the superposed image.
In a specific implementation, if the color information of the region corresponding to the superimposed image in the display image and the color information of the superimposed image are changed, the superimposed image and the display image may be superimposed according to each pixel value of the adjusted superimposed image, the first pixel value of the pixel of the region corresponding to the superimposed region in the display image, and the pixel transparency information. For a specific process of the overlay processing, reference may be made to the process of the image overlay processing shown in fig. 1, which is not described herein again.
If the color information of the region corresponding to the superimposed image in the display image does not match the color information of the superimposed image, the display image and the original superimposed image may be directly superimposed without adjusting the background color of the superimposed image.
According to the image superposition method provided by the embodiment of the application, after a first image signal corresponding to a superposed image including pixel transparency information and a second image signal corresponding to a display image are obtained, color information of the superposed image can be obtained according to the first image signal, color information of a region corresponding to the superposed image in the display image is obtained according to the first image signal and the second image signal, the first image signal includes the pixel transparency information, then the background color of the superposed image is adjusted according to the color information of the region corresponding to the superposed image in the display image and the color information of the superposed image, and then the superposed image and the display image are superposed according to the pixel transparency information and the adjusted background color of the superposed image. Therefore, when the display panel displays the superposed images and displays the images after the images are superposed, the contents displayed by the superposed images and the contents displayed by the displayed images can be accurately distinguished, the transparency of the superposed images is flexible and adjustable, the images displayed by the display panel after the images are superposed can realize the effect of full hollowing, the display effect is improved, and the user experience is improved.
The following describes an image superimposing apparatus according to an embodiment of the present application with reference to fig. 3.
As shown in fig. 3, an image superimposing apparatus provided in the embodiment of the present application includes a system on chip 11 and a field programmable gate array 12.
The system-on-chip 11 is configured to provide a first image signal corresponding to a superimposed image, the first image signal containing pixel transparency information;
the field programmable gate array 12 is configured to receive the first image signal and a second image signal corresponding to a display image, and perform an overlay process on the display image and the overlay image according to the pixel transparency information.
Specifically, the image superimposing apparatus provided in the embodiment of the present application may execute the image superimposing method described in the foregoing embodiment, and in a specific implementation, the image superimposing apparatus may be configured in the electronic device, so that when the superimposed image and the image after the superimposed image are displayed on the electronic device, the transparency of the superimposed image can be flexibly controlled, and the display panel can achieve a full hollow effect when the superimposed image and the image after the superimposed image are displayed. The electronic device may be any hardware device capable of displaying images, such as a smart phone, a notebook computer, a wearable device, and the like, which includes a display panel.
In an exemplary embodiment, as shown in fig. 3, the field programmable gate array 12 includes a first interface 121, a second interface 122, and a third interface 123.
The field programmable gate array 12 is configured to receive a first image signal provided by the system on chip 11 through the first interface 121, receive a second image signal through the second interface 122, and send a third image signal corresponding to the superimposed image to the display panel 13 through the third interface 123, so that the display panel 13 displays according to the third image signal.
In an exemplary embodiment, the field programmable gate array 12 further includes: an image overlay processing module 124;
the image superimposition processing module 124 is connected to the third interface 123, and the image superimposition processing module 124 is configured to obtain a second pixel value of the superimposed image according to the first image signal received by the first interface 121, obtain a first pixel value of a pixel of a region corresponding to the superimposed image in the display image according to the first image signal and the second image signal received by the second interface 122, and generate a display pixel value of the superimposed region according to the pixel transparency information, the first pixel value, and the second pixel value.
In an exemplary embodiment, the image superimposing apparatus further includes a storage module 14, wherein the storage module may be a double-rate synchronous dynamic random access memory, and the field programmable gate array 12 further includes a first memory write control module 125, a first memory read control module 126, a second memory write control module 127, and a second memory read control module 128;
the first memory write control module 125 is respectively connected to the first interface 121 and the storage module 14, and the first memory write control module 125 is configured to write the first image signal received through the first interface 121 into the storage module 14;
the second memory write control module 127 is respectively connected to the second interface 122 and the storage module 14, and the second memory write control module 127 is configured to write the second image signal received through the second interface 122 into the storage module 14;
the first memory reading control module 126 is respectively connected to the storage module 14 and the image superposition processing module 124, and the first memory reading control module 126 is configured to read the first image signal from the storage module 14 to the image superposition processing module 124;
the second memory reading control module 128 is respectively connected to the storage module 14 and the image superimposition processing module 124, and the second memory reading control module 128 is configured to read the second image signal from the storage module 14 to the image superimposition processing module 124.
The following describes an image superimposing method provided in an embodiment of the present application with reference to the drawings shown in fig. 3 and 4. Fig. 4 is a schematic structural diagram of an array substrate according to an embodiment of the present disclosure.
As shown in fig. 3 and 4, in the embodiment of the present application, each pixel of the superimposed image may be set to correspond to one pixel transparency information, so that after the field programmable gate array obtains the first image signal corresponding to the superimposed image and including the pixel transparency information and the second image signal corresponding to the display image, the superimposed image and the display image may be superimposed according to the pixel transparency information, thereby achieving flexible and adjustable transparency of the superimposed image, enabling the display panel to achieve a full-hollow effect when displaying the superimposed image and displaying the image after superimposing the image, improving a display effect, and improving user experience.
As shown in fig. 3, in the embodiment of the present application, the system-on-chip 11 may transmit a first image signal including pixel transparency information through LVDS, and transmit a second image signal corresponding to a display image through a digital component serial interface (SDI), where SDI may be 12GSDI, the field programmable gate array 12 receives the first image signal transmitted through LVDS through the first interface 121, and after receiving the second image signal transmitted through 12GSDI through the second interface 122, the first memory write control module 125 may write the first image signal received through the first interface 121 into the storage module 14, the second memory write control module 127 may write the second image signal received through the second interface 122 into the storage module 14, and then the first memory read control module 126 reads the first image signal from the storage module 14 to the image overlay processing module 124, and the second memory read control module 128 reads the second image signal from the storage module 14 to the image overlay processing module 14 And (8) a block 124. The image superimposition processing module 124 may thus obtain the second pixel value of the superimposed image according to the first image signal, obtain the first pixel value of the pixel in the region corresponding to the superimposed image in the display image according to the first image signal and the second image signal, and generate the display pixel value of the superimposed region according to the pixel transparency information, the first pixel value, and the second pixel value, so as to carry the display pixel value and the pixel values of the other pixels in the display image except the pixel in the region corresponding to the superimposed image in the third image signal, and output the third image signal to the display panel 13 through the third interface 13. The display panel 13 can display the superimposed image according to the received third image signal.
In an exemplary embodiment, when the pixel transparency information is 00, it corresponds to a first transparency level; when the pixel transparency information is 01, corresponding to a second transparency level; when the pixel transparency information is 10, corresponding to a third transparency level; and when the pixel transparency information is 11, corresponding to a fourth transparency level.
In an exemplary embodiment, the image overlay processing module 124 is configured to generate the display pixel values of the overlay area according to the following formula:
when the transparency information is 00: pixel ═ Pixel (osd)% 0% + Pixel (sdi) 100%;
when the transparency information is 01: pixel ═ Pixel (osd) + 25% + Pixel (sdi) 75%;
when the transparency information is 10: pixel (osd) 75% + Pixel (sdi) 25%;
when the transparency information is 11: pixel ═ Pixel (osd) + 100% + Pixel (sdi) 0%;
wherein pixel (SDI) is the first pixel value and pixel (OSD) is the second pixel value.
It should be noted that, since the first image signal and the second image signal are different source signals, in order to ensure that the superimposed image can be displayed normally and synchronously, in the embodiment of the present application, the first image signal and the second image signal need to be subjected to frame synchronization processing. The following describes a synchronization process of the first image signal and the second image signal with reference to fig. 5.
As shown in fig. 5, after the first image signal transmitted by the SOC is received by the first interface 121 (step 301), the first image signal transmitted by the SOC is written into the storage module 14 following the write memory signal of the first memory write control module 125 (step 302), after the second image signal transmitted by the SDI is received by the second interface 122 (step 303), the second image signal transmitted by the SDI is written into the storage module 14 following the write memory signal of the second memory write control module 127 (step 304), then the second memory read control module 128 generates a second read memory signal synchronized with the write memory signal to read the second image signal (step 305), and triggers the first memory read signal generated by the first memory read control module 126 to read the first image signal (step 306), and further the first image signal transmitted by the SOC and the second image signal transmitted by the SDI are synchronously output to the image overlay processing module 124 for overlay processing according to the pixel transparency information included in the first image signal, The first pixel value and the second pixel value generate a display pixel value of the display area, and the display pixel value of the superimposition area and pixel values of other pixels in the display image except for the pixel of the area corresponding to the superimposition image are carried in the third image signal (step 307), and then the third image signal is output to the display panel 13 through the third interface 123, so that the superimposed image is displayed on the display panel 13 (step 308).
As can be seen from the above analysis, in practical applications, when the superimposed image is superimposed on the display image at a preset transparency level for display, the colors of the regions corresponding to the displayed image and the superimposed image may be similar to the colors of the superimposed image, so that the contents respectively displayed by the superimposed image and the displayed image cannot be accurately distinguished. To solve this problem, the field programmable gate array 12 in the image superimposing apparatus according to the embodiment of the present application may further include an image analysis module 129, so as to adjust a background color of the superimposed image according to the color information of the area corresponding to the superimposed image in the display image and the color information of the superimposed image, so that the contents displayed by the superimposed image and the display image respectively can be accurately distinguished.
Specifically, as shown in fig. 6, the image analysis module 129 is respectively connected to the first memory reading control module 126, the second memory reading control module 128, and the image superposition processing module 124, and the image analysis module 129 is configured to receive the first image signal read by the first memory reading control module 126 and the second image signal read by the second memory reading control module 128, and adjust the background color of the superposed image according to the color information of the area corresponding to the superposed image in the display image and the color information of the superposed image.
In an exemplary embodiment, the image analysis module 129 may include a determination unit configured to determine whether color information of a region corresponding to the overlay image in the display image coincides with the color information of the overlay image, and a processing unit configured to change a background color of the overlay image when the color information of the region corresponding to the overlay image in the display image coincides with the color information of the overlay image.
In a specific implementation, the determining unit may determine whether the color information of the region corresponding to the superimposed image in the display image is consistent with the color information of the superimposed image according to the following manner:
respectively determining the gray scale of each third pixel in the area corresponding to the superposed image in the display image and the gray scale of each fourth pixel corresponding to the superposed image;
counting the number of third pixels with the gray scales larger than a first threshold value and the number of fourth pixels with the gray scales larger than the first threshold value;
calculating the difference percentage of the number of the third pixels with the gray scales larger than the first threshold value and the number of the fourth pixels with the gray scales larger than the first threshold value;
and if the difference percentage is larger than a second threshold and smaller than a third threshold, determining that the color information of the area corresponding to the superposed image in the display image is consistent with the color information of the superposed image.
The gray scales of the third pixel and the fourth pixel generally include a gray scale of a blue channel, a gray scale of a red channel, and a gray scale of a green channel of each pixel.
Correspondingly, the judging unit is configured to judge whether the color information of the area corresponding to the superimposed image in the display image is consistent with the color information of the superimposed image according to the gray scales of the three channels of the third pixels and the gray scales of the three channels of the fourth pixels in the display image.
It should be noted that, for the implementation process and the technical principle of the image superimposing apparatus of the present embodiment, reference is made to the foregoing explanation of the image superimposing method of the first embodiment, and details are not repeated here.
The image superposition device provided by the embodiment of the application comprises a system on chip and a field programmable gate array, wherein after receiving a second image signal corresponding to a display image and a first image signal which is provided by the system on chip and comprises pixel transparency information, the field programmable gate array can superpose the display image and the superposed image according to the pixel transparency information. From this, through setting up every pixel of superimposed image and all corresponding a pixel transparency information to according to pixel transparency information, carry out the stack processing to superimposed image and display image, realized that the transparency of superimposed image is nimble adjustable, make display panel can realize the effect of full fretwork when showing superimposed image and the image after the display image stack, promoted display effect, improved user experience.
In order to implement the above embodiments, the present application further provides an electronic device.
Fig. 7 is a schematic structural diagram of an electronic device according to an embodiment of the present application. The electronic device shown in fig. 7 is only an example, and should not bring any limitation to the functions and the scope of use of the embodiments of the present application.
Fig. 7 is a schematic structural diagram of an electronic device according to an embodiment of the present application. The electronic device shown in fig. 7 is only an example, and should not bring any limitation to the functions and the scope of use of the embodiments of the present application.
As shown in fig. 7, the electronic device 200 includes: the image superimposing apparatus includes a memory 210, a processor 220, and a computer program stored on the memory 210 and executable on the processor 220, wherein the processor 220 implements the image superimposing method according to the embodiment of the first aspect when executing the program.
Specifically, the electronic device may be any hardware device capable of performing image data processing, such as a smart phone, a notebook computer, a wearable device, and the like.
In an alternative implementation form, as shown in fig. 8, the electronic device 200 may further include: a memory 210 and a processor 220, a bus 230 connecting different components (including the memory 210 and the processor 220), wherein the memory 210 stores a computer program, and when the processor 220 executes the program, the image overlaying method according to the embodiment of the present application is implemented.
Bus 230 represents one or more of any of several types of bus structures, including a memory bus or memory controller, a peripheral bus, an accelerated graphics port, and a processor or local bus using any of a variety of bus architectures. By way of example, such architectures include, but are not limited to, Industry Standard Architecture (ISA) bus, micro-channel architecture (MAC) bus, enhanced ISA bus, Video Electronics Standards Association (VESA) local bus, and Peripheral Component Interconnect (PCI) bus.
Electronic device 200 typically includes a variety of computer device readable media. Such media may be any available media that is accessible by electronic device 200 and includes both volatile and nonvolatile media, removable and non-removable media.
Memory 210 may also include computer system readable media in the form of volatile memory, such as Random Access Memory (RAM)240 and/or cache memory 250. The electronic device 200 may further include other removable/non-removable, volatile/nonvolatile computer system storage media. By way of example only, storage system 260 may be used to read from and write to non-removable, nonvolatile magnetic media (not shown in FIG. 8, and commonly referred to as a "hard drive"). Although not shown in FIG. 8, a magnetic disk drive for reading from and writing to a removable, nonvolatile magnetic disk (e.g., a "floppy disk") and an optical disk drive for reading from or writing to a removable, nonvolatile optical disk (e.g., a CD-ROM, DVD-ROM, or other optical media) may be provided. In these cases, each drive may be connected to bus 230 by one or more data media interfaces. Memory 210 may include at least one program product having a set (e.g., at least one) of program modules that are configured to carry out the functions of embodiments of the application.
A program/utility 280 having a set (at least one) of program modules 270, including but not limited to an operating system, one or more application programs, other program modules, and program data, each of which or some combination thereof may comprise an implementation of a network environment, may be stored in, for example, the memory 210. The program modules 270 generally perform the functions and/or methodologies of the embodiments described herein.
Electronic device 200 may also communicate with one or more external devices 290 (e.g., keyboard, pointing device, display 291, etc.), with one or more devices that enable a user to interact with electronic device 200, and/or with any devices (e.g., network card, modem, etc.) that enable electronic device 200 to communicate with one or more other computing devices. Such communication may occur via input/output (I/O) interfaces 292. Also, the electronic device 200 may communicate with one or more networks (e.g., a Local Area Network (LAN), a Wide Area Network (WAN), and/or a public network such as the Internet) via the network adapter 293. As shown in FIG. 8, the network adapter 293 communicates with the other modules of the electronic device 200 via the bus 230. It should be appreciated that although not shown in FIG. 8, other hardware and/or software modules may be used in conjunction with electronic device 200, including but not limited to: microcode, device drivers, redundant processing units, external disk drive arrays, RAID systems, tape drives, and data backup storage systems, among others.
It should be noted that, for the implementation process and the technical principle of the electronic device of this embodiment, reference is made to the foregoing explanation of the image overlaying method of the embodiment of the first aspect, and details are not repeated here.
According to the electronic device provided by the embodiment of the application, after the second image signal corresponding to the display image and the first image signal including the pixel transparency information are obtained, the display image and the superimposed image can be superimposed according to the pixel transparency information. From this, through setting up every pixel of superimposed image and all corresponding a pixel transparency information to according to pixel transparency information, carry out the stack processing to superimposed image and display image, realized that the transparency of superimposed image is nimble adjustable, make display panel can realize the effect of full fretwork when showing superimposed image and the image after the display image stack, promoted display effect, improved user experience.
To implement the above embodiments, the present application also provides a computer-readable storage medium.
Wherein the computer readable storage medium has stored thereon a computer program which, when executed by a processor, implements the image superimposing method according to the embodiment of the first aspect.
To achieve the above embodiments, the present application also proposes a computer program, which when the instructions in the computer program product are executed by a processor, executes the image superimposing method according to the embodiment of the foregoing aspect.
In the description herein, reference to the description of the term "one embodiment," "some embodiments," "an example," "a specific example," or "some examples," etc., means that a particular feature, structure, material, or characteristic described in connection with the embodiment or example is included in at least one embodiment or example of the application.
Furthermore, the terms "first", "second" and "first" are used for descriptive purposes only and are not to be construed as indicating or implying relative importance or implicitly indicating the number of technical features indicated. Thus, a feature defined as "first" or "second" may explicitly or implicitly include at least one such feature.
Any process or method descriptions in flow charts or otherwise described herein may be understood as representing modules, segments, or portions of code which include one or more executable instructions for implementing specific logical functions or steps of the process, and the scope of the preferred embodiments of the present application includes other implementations in which functions may be executed out of order from that shown or discussed, including substantially concurrently or in reverse order, depending on the functionality involved, as would be understood by those reasonably skilled in the art of the present application.
It should be understood that portions of the present application may be implemented in hardware, software, firmware, or a combination thereof. In the above embodiments, the various steps or methods may be implemented in software or firmware stored in memory and executed by a suitable instruction execution system. For example, if implemented in hardware, as in another embodiment, any one or combination of the following techniques, which are known in the art, may be used: a discrete logic circuit having a logic gate circuit for implementing a logic function on a data signal, an application specific integrated circuit having an appropriate combinational logic gate circuit, a Programmable Gate Array (PGA), a Field Programmable Gate Array (FPGA), or the like.
It will be understood by those skilled in the art that all or part of the steps carried by the method for implementing the above embodiments may be implemented by hardware related to instructions of a program, which may be stored in a computer readable storage medium, and when the program is executed, the program includes one or a combination of the steps of the method embodiments.
The storage medium mentioned above may be a read-only memory, a magnetic or optical disk, etc. Although embodiments of the present application have been shown and described above, it is understood that the above embodiments are exemplary and should not be construed as limiting the present application, and that variations, modifications, substitutions and alterations may be made to the above embodiments by those of ordinary skill in the art within the scope of the present application.

Claims (15)

1. An image overlay method comprising:
acquiring a first image signal corresponding to a superposed image, wherein the first image signal comprises pixel transparency information;
acquiring a second image signal corresponding to a display image;
and performing superposition processing on the superposed image and the display image according to the pixel transparency information.
2. The image superimposing method according to claim 1, wherein before the superimposing process of the superimposed image and the display image according to the pixel transparency information, the method further comprises:
acquiring a first pixel value of a pixel of a region corresponding to the superimposed image in the display image, and acquiring a second pixel value of the superimposed image;
the superimposing the superimposed image and the display image according to the pixel transparency information includes:
and generating a display pixel value of a superposition area according to the pixel transparency information, the first pixel value and the second pixel value.
3. The image superimposing method according to claim 1, further comprising:
and adjusting the background color of the superposed image according to the color information of the area corresponding to the superposed image in the display image and the color information of the superposed image.
4. The image superimposition method according to claim 3, wherein the adjusting of the background color of the superimposed image includes:
and judging whether the color information of the area corresponding to the superposed image in the display image is consistent with the color information of the superposed image, and changing the background color of the superposed image when the color information of the area corresponding to the superposed image in the display image is consistent with the color information of the superposed image.
5. The image superimposing method according to claim 4, wherein the determining whether the color information of the area in the display image corresponding to the superimposed image coincides with the color information of the superimposed image includes:
respectively determining the gray scale of each third pixel in the area corresponding to the superposed image in the display image and the gray scale of each fourth pixel corresponding to the superposed image;
counting the number M of third pixels with the gray scales larger than a first threshold value and the number N of fourth pixels with the gray scales larger than the first threshold value;
calculating the difference percentage P ═ N-M)/M;
if the difference percentage is larger than a second threshold and smaller than a third threshold, determining that the color information of the area corresponding to the superimposed image in the display image is consistent with the color information of the superimposed image;
wherein the first threshold is a value greater than or equal to 200 and less than 255, the second threshold ranges from 0.7 to 0.9, and the third threshold ranges from 1.0 to 1.3.
6. The image superimposing method according to claim 5, wherein the gray scales of the third pixel and the fourth pixel respectively include a gray scale of a blue channel, a gray scale of a red channel, and a gray scale of a green channel of each pixel;
the determining whether the color information of the area corresponding to the overlay image in the display image is consistent with the color information of the overlay image includes:
and judging whether the color information of the area corresponding to the superposed image in the display image is consistent with the color information of the superposed image according to the gray scales of the three channels of the third pixels and the gray scales of the three channels of the fourth pixels in the area corresponding to the superposed image in the display image.
7. The image superimposing method according to claim 1, wherein the pixel transparency information is transmitted through a reserved bit of a low voltage differential signal.
8. The image superimposing method according to claim 1, further comprising:
and carrying out frame synchronization processing on the second image signal and the first image signal.
9. The image superimposing method according to claim 2, wherein when the pixel transparency information is 00, a first transparency level is corresponded; when the pixel transparency information is 01, corresponding to a second transparency level; when the pixel transparency information is 10, corresponding to a third transparency level; and when the pixel transparency information is 11, corresponding to a fourth transparency level.
10. The image superimposing method according to claim 9, wherein the display pixel value of the superimposed area is generated according to the following formula:
when the transparency information is 00: pixel ═ Pixel (osd)% 0% + Pixel (sdi) 100%;
when the transparency information is 01: pixel ═ Pixel (osd) + 25% + Pixel (sdi) 75%;
when the transparency information is 10: pixel (osd) 75% + Pixel (sdi) 25%;
when the transparency information is 11: pixel ═ Pixel (osd) + 100% + Pixel (sdi) 0%;
wherein pixel (SDI) is the first pixel value and pixel (OSD) is the second pixel value.
11. An image superposition device is characterized by comprising a system on chip and a field programmable gate array, wherein the system on chip is connected with the field programmable gate array;
the system-on-chip is configured to provide a first image signal corresponding to a superimposed image, the first image signal containing pixel transparency information;
the field programmable gate array is configured to receive the first image signal and a second image signal corresponding to a display image, and perform superposition processing on the display image and the superposition image according to the pixel transparency information.
12. The image superimposing apparatus according to claim 11, wherein the field programmable gate array includes a first interface, a second interface, a third interface;
the field programmable gate array is configured to receive a first image signal provided by the system on chip through the first interface, receive a second image signal through the second interface, and send a third image signal corresponding to the image after the superposition processing to a display panel through the third interface, so that the display panel displays according to the third image signal.
13. The image superimposing apparatus according to claim 12, wherein the field programmable gate array further comprises: an image superposition processing module;
the image superposition processing module is connected with the third interface, and is configured to acquire a second pixel value of the superposed image according to a first image signal received by the first interface, acquire a first pixel value of a pixel in a region corresponding to the superposed image in a display image according to the first image signal and a second image signal received by the second interface, and generate a display pixel value of the superposed region according to the pixel transparency information, the first pixel value, and the second pixel value.
14. The image superimposing apparatus according to claim 13, wherein the image superimposing apparatus further comprises a storage module, and the field programmable gate array further comprises a first memory write control module, a first memory read control module, a second memory write control module, and a second memory read control module;
the first memory write-in control module is respectively connected with the first interface and the storage module, and is configured to write the first image signal received through the first interface into the storage module;
the second memory write-in control module is respectively connected with the second interface and the storage module, and is configured to write the second image signal received through the second interface into the storage module;
the first memory reading control module is respectively connected with the storage module and the image superposition processing module, and is configured to read the first image signal from the storage module to the image superposition processing module;
the second memory reading control module is respectively connected with the storage module and the image superposition processing module, and is configured to read the second image signal from the storage module to the image superposition processing module.
15. The image superimposing apparatus according to claim 14, wherein the field programmable gate array further comprises: an image analysis module;
the image analysis module is respectively connected with the first memory reading control module, the second memory reading control module and the image superposition processing module, and is configured to receive the first image signal read by the first memory reading control module and the second image signal read by the second memory reading control module, and adjust the background color of the superposed image according to the color information of the area corresponding to the superposed image in the display image and the color information of the superposed image.
CN201911192958.4A 2019-11-28 2019-11-28 Image superposition method and device Active CN110913262B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201911192958.4A CN110913262B (en) 2019-11-28 2019-11-28 Image superposition method and device

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201911192958.4A CN110913262B (en) 2019-11-28 2019-11-28 Image superposition method and device

Publications (2)

Publication Number Publication Date
CN110913262A true CN110913262A (en) 2020-03-24
CN110913262B CN110913262B (en) 2022-11-04

Family

ID=69820272

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201911192958.4A Active CN110913262B (en) 2019-11-28 2019-11-28 Image superposition method and device

Country Status (1)

Country Link
CN (1) CN110913262B (en)

Cited By (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112053419A (en) * 2020-09-21 2020-12-08 长沙景嘉微电子股份有限公司 Image superposition processing method and device, storage medium and electronic device
CN112862696A (en) * 2020-12-31 2021-05-28 深圳市路维光电股份有限公司 Mask repair control method and device and computer readable storage medium
WO2021196874A1 (en) * 2020-03-31 2021-10-07 京东方科技集团股份有限公司 Monitor system and display control method thereof
CN116095400A (en) * 2022-11-21 2023-05-09 南京芯传汇电子科技有限公司 Video data processing method, device, equipment and storage medium
WO2023246552A1 (en) * 2022-06-20 2023-12-28 广州视源电子科技股份有限公司 Image processing method and apparatus, and device

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101321240A (en) * 2008-06-25 2008-12-10 华为技术有限公司 Method and device for multi-drawing layer stacking
US20110032272A1 (en) * 2009-08-06 2011-02-10 Panasonic Corporation Video processing apparatus
CN102833467A (en) * 2012-08-06 2012-12-19 广东响石数码科技有限公司 Broadcast-quality monitor and monitoring image generating method thereof
CN105872418A (en) * 2016-03-30 2016-08-17 浙江大华技术股份有限公司 Method and device for superimposing a GUI (Graphical User Interface) image layer on a digital image
CN106899878A (en) * 2017-03-21 2017-06-27 电子科技大学 A kind of adjustable video and graph compound method and system of transparency based on OMAP chips

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101321240A (en) * 2008-06-25 2008-12-10 华为技术有限公司 Method and device for multi-drawing layer stacking
US20110032272A1 (en) * 2009-08-06 2011-02-10 Panasonic Corporation Video processing apparatus
CN102833467A (en) * 2012-08-06 2012-12-19 广东响石数码科技有限公司 Broadcast-quality monitor and monitoring image generating method thereof
CN105872418A (en) * 2016-03-30 2016-08-17 浙江大华技术股份有限公司 Method and device for superimposing a GUI (Graphical User Interface) image layer on a digital image
CN106899878A (en) * 2017-03-21 2017-06-27 电子科技大学 A kind of adjustable video and graph compound method and system of transparency based on OMAP chips

Cited By (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2021196874A1 (en) * 2020-03-31 2021-10-07 京东方科技集团股份有限公司 Monitor system and display control method thereof
CN112053419A (en) * 2020-09-21 2020-12-08 长沙景嘉微电子股份有限公司 Image superposition processing method and device, storage medium and electronic device
CN112053419B (en) * 2020-09-21 2023-09-22 长沙景嘉微电子股份有限公司 Image superposition processing method and device, storage medium and electronic device
CN112862696A (en) * 2020-12-31 2021-05-28 深圳市路维光电股份有限公司 Mask repair control method and device and computer readable storage medium
WO2023246552A1 (en) * 2022-06-20 2023-12-28 广州视源电子科技股份有限公司 Image processing method and apparatus, and device
CN116095400A (en) * 2022-11-21 2023-05-09 南京芯传汇电子科技有限公司 Video data processing method, device, equipment and storage medium

Also Published As

Publication number Publication date
CN110913262B (en) 2022-11-04

Similar Documents

Publication Publication Date Title
CN110913262B (en) Image superposition method and device
US5831638A (en) Graphics display system and method for providing internally timed time-varying properties of display attributes
CN102629466B (en) Adaptive correction method for color gray-scale image of display
JPWO2018034214A1 (en) Circuit device, electronic device and error detection method
US8629884B2 (en) Wide color gamut display system
US5748866A (en) Virtual display adapters using a digital signal processing to reformat different virtual displays into a common format and display
CN110971839B (en) Video fusion method, electronic device and storage medium
JP2019139121A (en) Circuit device, electronic apparatus, and error detection method
US20230041733A1 (en) Method and apparatus for alpha blending images from different color formats
JP2006332908A (en) Color image display apparatus, color image display method, program, and recording medium
WO2019229548A1 (en) Source-side tone mapping based on native color gamut and brightness of display
TW202008148A (en) Automatic Gamma Curve Setting Method for Display
US20220254321A1 (en) Display control apparatus, display control method, and program
US20230214963A1 (en) Data processing method and apparatus, and electronic device
CN108831370B (en) Display driving method and device, display device and wearable equipment
US8963934B1 (en) Processing multiple regions on an image in a graphics display system
US11202028B2 (en) Display device configuring multi display system and control method thereof
US20160203617A1 (en) Image generation device and display device
CN114647467B (en) Watermark updating method, device, system and storage medium
JP2010128292A (en) Image display system
CN114125344B (en) Video processing apparatus, video processing method, monitor device, computer device, and medium
US20050088454A1 (en) Method of displaying an image of a windowless object
US8111945B2 (en) System and method for providing a blended picture
CN101714072B (en) For the treatment of the method and apparatus of the pixel planes of expression visual information
US20120075323A1 (en) Method and apparatus for generating and processing graphic data

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant