CN110519530B - Hardware-based picture-in-picture display method and device - Google Patents
Hardware-based picture-in-picture display method and device Download PDFInfo
- Publication number
- CN110519530B CN110519530B CN201910512211.6A CN201910512211A CN110519530B CN 110519530 B CN110519530 B CN 110519530B CN 201910512211 A CN201910512211 A CN 201910512211A CN 110519530 B CN110519530 B CN 110519530B
- Authority
- CN
- China
- Prior art keywords
- picture
- image
- line
- pixel information
- region
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N5/00—Details of television systems
- H04N5/222—Studio circuitry; Studio devices; Studio equipment
- H04N5/262—Studio circuits, e.g. for mixing, switching-over, change of character of image, other special effects ; Cameras specially adapted for the electronic generation of special effects
- H04N5/2628—Alteration of picture size, shape, position or orientation, e.g. zooming, rotation, rolling, perspective, translation
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N5/00—Details of television systems
- H04N5/44—Receiver circuitry for the reception of television signals according to analogue transmission standards
- H04N5/445—Receiver circuitry for the reception of television signals according to analogue transmission standards for displaying additional information
- H04N5/45—Picture in picture, e.g. displaying simultaneously another television channel in a region of the screen
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N7/00—Television systems
- H04N7/01—Conversion of standards, e.g. involving analogue television standards or digital television standards processed at pixel level
- H04N7/0125—Conversion of standards, e.g. involving analogue television standards or digital television standards processed at pixel level one of the standards being a high definition standard
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Controls And Circuits For Display Device (AREA)
- Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
Abstract
The invention discloses a hardware-based picture-in-picture display method and device, and relates to the technical field of image processing. The method comprises the following steps: dividing a screen into a main picture area and a pip area; reading the screen area division information of the display equipment by line unit, and judging whether the current line screen area contains a picture-in-picture area; when the judgment result shows that the pixel information is not contained, reading the pixel information corresponding to the current line in the main picture image, and transmitting the pixel information to a receiving end after image processing; when the judgment includes, reading the pixel information which is not covered by the picture-in-picture area and corresponds to the current line in the main picture image and the pixel information which corresponds to the current line in the picture-in-picture image, and transmitting the pixel information to the receiving end after image processing. When the invention is used for realizing picture-in-picture, the result image does not need to be stored, picture-in-picture synthesis can be carried out on the image which is being transmitted, and the picture delay when the picture-in-picture is displayed is reduced.
Description
Technical Field
The present invention relates to the field of image processing technologies, and in particular, to a picture-in-picture display method and apparatus.
Background
In the display field, picture-in-picture functionality is often used. Picture In Picture (PIP) is a function of synthesizing and displaying 2 pieces of image data having the same reproduction time, which are prepared in advance by a content creator, by using a digital technique. In brief, PIP is a PIP region shown in fig. 1 that is a region on a main picture image and is synthesized with another sub picture image. The manner of image composition may typically include an upper layer overlying a lower layer or alpha composition.
In a conventional implementation manner of the pip, an original image and the pip are generally obtained in advance, then the original image and the pip image are subjected to upper layer covering and lower layer or alpha synthesis, then a generated result image (or called a synthesized image) is temporarily stored in a set memory, and then the result image in the memory is displayed through a display device. The above-described picture-in-picture display scheme has the following disadvantages: 1) the resulting image will occupy memory space; 2) storing the result image in the memory and reading the image from the memory by the display device occupy the memory bandwidth; 3) the display is started after the synthesis is completed, which causes some delay; 4) the synthesis is performed on the premise that the original image and the pip are both prepared, and the data is transmitted and stored, so that the images in the transmission process cannot be synthesized.
Disclosure of Invention
The invention aims to: the invention overcomes the defects of the prior art and provides a hardware-based picture-in-picture display method and a hardware-based picture-in-picture display device.
In order to achieve the above object, the present invention provides the following technical solutions:
a hardware-based picture-in-picture display method includes the steps: according to the setting of the frame generating device, the display device divides the screen into a main picture area and a picture-in-picture area; the display device is driven based on an output row;
reading the screen area division information of the display equipment by line unit, and judging whether the current line screen area contains a picture-in-picture area;
under the condition that the picture-in-picture region is judged not to be contained, reading pixel information corresponding to the current line in the main picture image, and transmitting the pixel information to a receiving end after image processing; under the condition that the picture-in-picture region is judged to be contained, reading pixel information which corresponds to a current line and is not covered by the picture-in-picture region in the main picture image and pixel information which corresponds to the current line in the picture-in-picture image, and transmitting the pixel information to a receiving end after image processing, wherein the pixel information is sequentially transmitted from left to right line by line.
Further, the display device is a display or a television with an HDMI interface, and pixels of each line are transmitted from left to right to a sink display device through the HDMI.
Further, when the pixels of each row are transmitted to the receiving end from left to right, when the picture-in-picture region is positioned in the middle of the main picture region, firstly, the image transmission of the left region of the main picture image is carried out, then, the picture-in-picture image is transmitted, and after the picture-in-picture image is transmitted, the picture-in-picture image is switched to the main picture image to carry out the image transmission of the right region of the main picture image.
Further, the step of reading the pixel information corresponding to the current line in the main picture image, processing the image and sending the processed image to the receiving end comprises:
collecting the size information of the main picture image, and comparing the size information with the output size of the display equipment;
acquiring a proportional value N of the size of the main picture image and the output size of the display equipment;
reading corresponding line pixel information of the main picture image according to the N value, and carrying out reduction or enlargement operation on the read line pixels to synthesize one line;
and transmitting the synthesized line pixels to a receiving end after image transformation.
Further, the step of reading the pixel information corresponding to the current line in the main picture image which is not covered by the pip region and the pixel information corresponding to the current line in the pip image, and sending the pixel information to the receiving end after image processing comprises:
acquiring size information of a main picture image and size information of a picture-in-picture image, and comparing the size information of the main picture image and the size information of the picture-in-picture image with the size of an output main picture image and the size of an output picture-in-picture image of display equipment respectively;
acquiring a proportional value N of the size of a main picture image and the size of an output main picture image of display equipment, and a proportional value M of the size of a picture-in-picture image and the size of the output picture-in-picture image of the display equipment;
reading corresponding line pixel information of the main picture image according to the N and M values, performing reduction or enlargement operation on the read line pixels to synthesize a line, reading corresponding line pixel information of the picture-in-picture image, and performing reduction or enlargement operation on the read line pixels to synthesize a line;
and transmitting the synthesized line pixels to a receiving end after image transformation.
Further, the PIP region is rectangular, and the step of determining whether the PIP region is included in the current line of screen regions is,
acquiring the coordinates of the picture-in-picture area in the screen area;
the display equipment processes one line at a time according to the output size, and judges whether the current line passes through the rectangular area of the picture-in-picture or not according to the coordinate of the rectangular position of the picture-in-picture;
the pd region is determined to be included when passing through the rectangular region of the pd.
Further, the pip region is plural, and the shape of the pip region is rectangular or non-rectangular.
The invention also provides a hardware-based picture-in-picture display device, which comprises the following structures:
a frame generation device for setting screen region division information including a picture-in-picture;
an image processing device for reading the screen area division information in line units and judging whether the current line screen area contains a picture-in-picture area; under the condition that the picture-in-picture region is judged not to be contained, reading pixel information corresponding to the current line in the main picture image, and transmitting the pixel information to a receiving end display device after image processing; under the condition that the picture-in-picture region is judged to be contained, reading pixel information which corresponds to a current line and is not covered by the picture-in-picture region in a main picture image and pixel information which corresponds to the current line in the picture-in-picture image, carrying out image processing on the pixel information and then transmitting the pixel information to a receiving end display device, wherein the pixel information is sequentially transmitted from left to right line by line;
a display device driven based on an output line to output an image including a main picture region and a pip region according to the aforementioned screen region division information.
Further, the display device is a display or a television with an HDMI interface, and pixels of each line are transmitted from left to right to a sink display device through the HDMI.
Further, the image processing apparatus further includes a scaling unit configured to acquire size information of the main picture image and size information of the picture-in-picture image, acquire a proportional value N of the size of the main picture image to the size of an output main picture image of the display apparatus and a proportional value M of the size of the picture-in-picture image to the size of the output picture-in-picture image of the display apparatus, respectively, and read corresponding line pixel information of the main picture image, respectively, perform a reduction or enlargement operation on the read line pixels to synthesize one line, and read corresponding line pixel information of the picture-in-picture image, and perform a reduction or enlargement operation on the read line pixels to synthesize one line, according to the aforementioned N and M values.
Due to the adoption of the technical scheme, compared with the prior art, the invention has the following advantages and positive effects as examples: when the technical scheme of the invention is utilized to realize the picture-in-picture, the picture-in-picture synthesis can be carried out on the transmitted images without storing the result images, thereby reducing the picture delay when the picture-in-picture is displayed.
Drawings
Fig. 1 is a diagram showing a picture-in-picture display commonly used in the prior art.
Fig. 2 is a schematic diagram of screen division according to an embodiment of the present invention.
Fig. 3 is a coordinate system established based on a screen according to an embodiment of the present invention.
Fig. 4 is a diagram of reading pixel information that does not include a pip region according to an embodiment of the present invention.
Fig. 5 is a diagram for reading pixel information including a pip region according to an embodiment of the present invention.
Fig. 6 is a main picture image including a plurality of pip regions according to an embodiment of the present invention.
A screen 100;
a main screen area 110;
a pip region 120;
Detailed Description
The hardware-based pip displaying method and apparatus disclosed in the present invention will be described in further detail with reference to the accompanying drawings and specific embodiments. It should be noted that technical features or combinations of technical features described in the following embodiments should not be considered as being isolated, and they may be combined with each other to achieve better technical effects. In the drawings of the embodiments described below, the same reference numerals appearing in the respective drawings denote the same features or components, and may be applied to different embodiments. Thus, once an item is defined in one drawing, it need not be further discussed in subsequent drawings.
It should be noted that the structures, proportions, sizes, and other dimensions shown in the drawings and described in the specification are only for the purpose of understanding and reading the present disclosure, and are not intended to limit the scope of the invention, which is defined by the claims, and any modifications of the structures, changes in the proportions and adjustments of the sizes and other dimensions, should be construed as falling within the scope of the invention unless the function and objectives of the invention are affected. The scope of the preferred embodiments of the present invention includes additional implementations in which functions may be executed out of order from that described or discussed, including substantially concurrently or in reverse order, depending on the functionality involved, as would be understood by those reasonably skilled in the art of the embodiments of the present invention.
Techniques, methods, and apparatus known to those of ordinary skill in the relevant art may not be discussed in detail but are intended to be part of the specification where appropriate. In all examples shown and discussed herein, any particular value should be construed as merely illustrative, and not limiting. Thus, other examples of the exemplary embodiments may have different values.
Examples
Referring to fig. 1, disclosed is a hardware-based picture-in-picture display method, including the steps of:
s100, according to the setting of the frame generating device, the display device divides the screen into a main picture area and a PIP area.
S200, reading the screen area division information of the display device by line unit, and judging whether the current line screen area contains the PIP area.
S300, under the condition that the picture-in-picture region is not included, reading pixel information corresponding to the current line in the main picture image, and transmitting the pixel information to a receiving end after image processing;
under the condition that the picture-in-picture area is judged to be contained, the pixel information which is not covered by the picture-in-picture area and corresponds to the current line in the main picture image and the pixel information which corresponds to the current line in the picture-in-picture image are read, and then the image is processed and transmitted to a receiving end.
In this embodiment, the display device is driven by a display peripheral, such as a display or a television having an HDMI (High Definition Multimedia Interface) Interface. The display device is driven on the basis of the output line, such as HDMI, specifying for how long the transmission of the next line has to be started.
The pixels of each line are transmitted from left to right over HDMI from the sending end to the receiving end for output on a display device. After the transfer of one line is completed, the next line is transferred after a short pause. By adopting the scheme provided by the embodiment, picture-in-picture can be realized without delay as long as the image data required to be displayed can be prepared according to the display speed.
In step S100, the display device divides the screen into two regions according to the setting of the frame generating device, as shown in fig. 2, the window outputted from the screen 100 includes a main picture region 110 (i.e. the bottom view of the pip) and a pip region 120.
The dark areas are main picture areas 110 and the light areas are pip areas 120. The frame generating apparatus is a component that can set screen display contents and/or effects, the display apparatus outputs the corresponding contents and/or effects based on instruction information of the frame generating apparatus, and the display apparatus serves the frame generating apparatus.
By way of example and not limitation, the frame generating device may include a computer CPU (central processing unit) and a game application (or game computer program) running on the computer, and the display device may include a video card and a screen, and the description (instructions) of the frame generating device is displayed through the display device.
In this embodiment, the pip region 120 is preferably rectangular.
By way of example and not limitation, when a pip region is rectangular, the position of the pip in the screen may be noted by capturing the diagonal points of the rectangle. For example, referring to fig. 3, a rectangular coordinate system is established with the starting point of the upper left corner of the screen as the origin, and the position of the pip can be labeled by the upper left corner point coordinate (0.2 ) and the lower right corner point coordinate (0.6, 0.7).
In the step S200, the screen area division information of the aforementioned display device is read in units of lines. In particular, the hardware processes one line of data at a time and sends the data to the sink over HDMI. Referring to fig. 4, the black line in the figure represents the currently processed line 200.
It is determined whether a pip region is included in the current line screen region. In specific implementation, taking the pip region as a rectangle as an example, the step of determining whether the current line of screen region includes the pip region may be as follows:
acquiring the coordinates of the picture-in-picture area in the screen area;
the display equipment processes one line at a time according to the output size, and judges whether the current line passes through the rectangular area of the picture-in-picture or not according to the coordinate of the rectangular position of the picture-in-picture;
when the rectangular area of the pip is passed, it can be determined that the pip region is included.
For example, the display device processes one line at a time according to an output size 1920 × 1080, determines whether the current line passes through a rectangular area of the pip according to a rectangular position of the pip, and determines whether the current line screen area includes the pip area.
Under the condition that the picture-in-picture area is not included, the pixel information of the current line corresponding to the main picture image is read, and then the pixel information is possibly zoomed and transformed, such as saturation adjustment, and then the pixel information is sent to a receiving end through HDMI.
This is explained with reference to fig. 4. When the current processing line 200 (black line) does not pass through the pip region 120, the image information is obtained by reading one or more corresponding lines of the main picture image, i.e., reading the pixel information corresponding to the current line in the main picture image.
Preferably, the method further comprises the following steps:
collecting the size information of the main picture image, and comparing the size information with the output size of the display equipment;
acquiring a proportional value N of the size of the main picture image and the output size of the display equipment;
reading corresponding line pixel information of the main picture image according to the N value, and carrying out reduction or enlargement operation on the read line pixels to synthesize one line;
and transmitting the synthesized line pixels to a receiving end after image transformation.
For example, but not by way of limitation, if the size of the main picture image is 3840x2160, and the output size of the display device is 1920x1080, N =2, 2 lines of main picture image are read each time, and the two lines of read pixel information are scaled 1/2 to be synthesized into one line and then sent to the receiving end via HDMI.
Under the condition of judging that the picture-in-picture area is included, reading the pixel information which is not covered by the picture-in-picture area and corresponds to the current line in the main picture image and the pixel information which corresponds to the current line in the picture-in-picture image, and transmitting the pixel information to a receiving end after image processing.
This will be explained with reference to fig. 5. When the current processing line 200 (black line) passes through the pip region 120, the display device reads one or more corresponding lines of the main picture image, and then performs scaling and transformation, and sends the main picture image to the HDMI receiving end; then, when the line is processed to the pip region, the display apparatus is read from the corresponding one to multiple lines of the pip image.
In other words, in the case that it is determined that the HDMI receiver includes pip, one to a plurality of lines of the main picture image corresponding to the current line, which is not covered by the pip rectangular region, and one to a plurality of lines of the pip image corresponding to the current line are read, possibly scaled, transformed, and transmitted to the HDMI receiver. After the PIP region is processed, the method switches to the main picture image for processing, and the covered part in the main picture image can be optionally discarded to reduce the resource occupation.
Preferably, the method further comprises the following steps:
the steps of reading the pixel information corresponding to the current line in the main picture image and not covered by the PIP region, and the pixel information corresponding to the current line in the PIP image, processing the image and transmitting to the receiving end include,
acquiring the size information of a main picture image and the size information of a picture-in-picture image, and comparing the size information of the main picture image and the size information of the picture-in-picture image with the corresponding output size of display equipment respectively;
acquiring a proportional value N of the size of a main picture image and the corresponding output size of display equipment, and a proportional value M of the size of a picture-in-picture image and the corresponding output size of the display equipment;
reading corresponding line pixel information of the main picture image according to the N and M values, performing reduction or enlargement operation on the read line pixels to synthesize a line, reading corresponding line pixel information of the picture-in-picture image, and performing reduction or enlargement operation on the read line pixels to synthesize a line;
and transmitting the synthesized line pixels to a receiving end after image transformation.
By way of example and not limitation, the size of the home screen image is 3840x2160, and the output home screen image size of the display device is 1920x 1080; the size of the picture-in-picture image is 1920x1080, and the output picture-in-picture size of the display device is 640x 360; then N =2, M = 3; for picture-in-picture, 3 lines of picture-in-picture image are read each time, and the two lines of read pixel information are scaled 1/3 into one line and then transmitted to the receiving end over HDMI.
It should be noted that, although the above embodiment only illustrates the way of performing the reduction processing at the time of display (when the values of N and M are greater than 1), those skilled in the art will know that N and M may also be values less than 1, that is, the display may also be the enlargement processing. For example, and without limitation, if N =0.25 is calculated according to the size of the main screen and the display size, that is, the main screen needs to be enlarged by 4 times when being displayed, it is necessary to read the corresponding 1 line of pixel information of the main screen image, and enlarge the read line of pixels by 4 times to compose one line.
In addition, the calculated N may also be a non-integer, for example, but not limited to, N =1.2, and the corresponding line pixel information to be read is N1=2 rounded up, that is, corresponding 2 lines of pixel information of the main screen image are read, and the read line pixels are scaled by 1/1.2 to be combined into one line.
In this embodiment, referring to fig. 5, the pip region 120 is preferably located in the middle of the main picture region 110, in this case, when the current processing line 200 (black line) passes through the pip region 120, the image transmission of the left region of the main picture image is performed first, and then the pip image transmission is performed, and after the pip image transmission is completed, the pip image is switched to the main picture image, and the image transmission of the right region of the main picture image is performed.
Referring to fig. 6, in another embodiment of the present invention, the pip region 120 may be a plurality of pip regions, and the shape of the pip region 120 is rectangular or non-rectangular. The non-rectangular shape may be, for example and without limitation, circular, elliptical, pentagonal, triangular, and any other irregular closed shape.
When the main picture area includes a plurality of pip regions, the display method thereof is similar to the method including one pip region: acquiring the coordinate position of each PIP region in the main screen region, and judging whether the current line passes through the PIP region according to the coordinate position of the PIP, thereby judging whether the current line screen region contains the PIP region.
Under the condition that the picture-in-picture area is not included, the pixel information of the current line corresponding to the main picture image is read, and then the pixel information is possibly zoomed and transformed, such as saturation adjustment, and then the pixel information is sent to a receiving end through HDMI.
Under the condition of judging that the picture-in-picture area is included, reading the pixel information which is not covered by the picture-in-picture area and corresponds to the current line in the main picture image and the pixel information which corresponds to the current line in the picture-in-picture image, performing possible scaling and transformation, such as saturation adjustment, and sending the pixel information to a receiving end through HDMI.
For a non-rectangular (outline) pip region, it is preferable that the display region of the screen is divided into a plurality of blocks according to the setting of the frame generating apparatus, and a pip display map is generated according to the display size. For example, but not limitation, if the display size is 1920 × 1080, the table width of the mapping table is 1920 and the table height is 1080. The contents of the table may represent the source of each pixel: from a main picture image O, a picture-in-picture image a, a picture-in-picture image B, or a picture-in-picture image C.
By way of example and not limitation, the simplified picture-in-picture display mapping table may be as follows:
another embodiment of the present invention also provides a hardware-based picture-in-picture display device.
The device comprises the following structure:
a frame generation device for setting screen region division information including a picture-in-picture;
an image processing device for reading the screen area division information in line units and judging whether the current line screen area contains a picture-in-picture area; under the condition that the picture-in-picture region is judged not to be contained, reading pixel information corresponding to the current line in the main picture image, and transmitting the pixel information to a receiving end display device after image processing; under the condition that the picture-in-picture area is judged to be contained, reading the pixel information which corresponds to the current line and is not covered by the picture-in-picture area in the main picture image and the pixel information which corresponds to the current line in the picture-in-picture image, and transmitting the pixel information to a receiving end display device after image processing;
and a display device for outputting an image including a main picture region and a pip region according to the screen division information.
In this embodiment, the display device is driven based on a display peripheral, such as a display or a television having an HDMI (High Definition Multimedia Interface) Interface. The pixels of each line are transmitted from left to right over HDMI from the sending end to the receiving end for output on a display device. After the transfer of one line is completed, the next line is transferred after a short pause. By adopting the scheme provided by the embodiment, picture-in-picture can be realized without delay as long as the image data required to be displayed can be prepared according to the display speed.
The frame generating apparatus is a component that can set screen display contents and/or effects, the display apparatus outputs the corresponding contents and/or effects based on instruction information of the frame generating apparatus, and the display apparatus serves the frame generating apparatus.
By way of example and not limitation, the frame generating device may include a computer CPU (central processing unit) and a game application (or game computer program) running on the computer, and the display device may include a video card and a screen, and the description (instructions) of the frame generating device is displayed through the display device.
The pip region 120 is preferably rectangular.
In another implementation of this embodiment, the image processing apparatus may further include a scaling unit.
The zooming unit is used for acquiring the size information of the main picture image and the size information of the picture-in-picture image, sequentially acquiring the proportional values N and M of the main picture image and the corresponding output size of the display equipment, respectively reading the corresponding line pixel information of the main picture image according to the N and M values to perform zooming operation and synthesize a line, and reading the corresponding line pixel information of the picture-in-picture image to perform zooming operation and synthesize a line.
By way of example and not limitation, the size of the home screen image is 3840x2160, and the output home screen image size of the display device is 1920x 1080; the size of the pip image is 1920x1080, and the output pip size of the display device is 640x360, 3 lines of pip image are read each time, and the two lines of read pixel information are scaled 1/3 and combined into one line, and then sent to the receiving end through HDMI.
Other technical features are described in the previous embodiment and are not described in detail herein.
It should be noted that, in the present invention, the device or apparatus may further include other components commonly found in a computing system, such as an operating system, a queue manager, a device driver, a database driver, or one or more network protocols, etc. stored in a memory and executed by a processor, which belong to the prior art and are not described herein again.
In the foregoing description, the disclosure of the present invention is not intended to limit itself to these aspects. Rather, the various components may be selectively and operatively combined in any number within the intended scope of the present disclosure. In addition, terms like "comprising," "including," and "having" should be interpreted as inclusive or open-ended, rather than exclusive or closed-ended, by default, unless explicitly defined to the contrary. All technical, scientific, or other terms used herein have the same meaning as commonly understood by one of ordinary skill in the art to which this invention belongs unless defined otherwise. Common terms found in dictionaries should not be interpreted too ideally or too realistically in the context of related art documents unless the present disclosure expressly limits them to that. Any changes and modifications of the present invention based on the above disclosure will be within the scope of the appended claims.
Claims (10)
1. A picture-in-picture display method based on hardware is characterized by comprising the following steps:
according to the setting of the frame generating device, the display device divides the screen into a main picture area and a picture-in-picture area; the display device is driven based on an output row; reading the screen area division information of the display equipment by line unit, and judging whether the current line screen area contains a picture-in-picture area;
under the condition that the picture-in-picture region is judged not to be contained, reading pixel information corresponding to the current line in the main picture image, and transmitting the pixel information to a receiving end after image processing; under the condition that the picture-in-picture region is judged to be contained, reading pixel information which corresponds to a current line and is not covered by the picture-in-picture region in the main picture image and pixel information which corresponds to the current line in the picture-in-picture image, and transmitting the pixel information to a receiving end after image processing, wherein the pixel information is sequentially transmitted from left to right line by line.
2. The method of claim 1, wherein: the display device is a display or a television with an HDMI interface, and pixels of each line are transmitted to the receiving end display device from left to right through the HDMI.
3. The method of claim 2, wherein: when the pixels of each row are transmitted to a receiving end from left to right, when the picture-in-picture region is positioned in the middle of the main picture region, firstly, the image transmission of the left region of the main picture image is carried out, then, the picture-in-picture image is transmitted, and after the picture-in-picture image is transmitted, the picture-in-picture image is switched to the main picture image to carry out the image transmission of the right region of the main picture image.
4. The method of claim 1, wherein: the step of reading the pixel information corresponding to the current line in the main picture image, sending the pixel information to the receiving end after image processing,
collecting the size information of the main picture image, and comparing the size information with the output size of the display equipment;
acquiring a proportional value N of the size of the main picture image and the output size of the display equipment;
reading corresponding line pixel information of the main picture image according to the N value, and carrying out reduction or enlargement operation on the read line pixels to synthesize one line;
and transmitting the synthesized line pixels to a receiving end after image transformation.
5. The method of claim 1, wherein: the steps of reading the pixel information corresponding to the current line in the main picture image and not covered by the PIP region, and the pixel information corresponding to the current line in the PIP image, processing the image and transmitting to the receiving end include,
acquiring size information of a main picture image and size information of a picture-in-picture image, and comparing the size information of the main picture image and the size information of the picture-in-picture image with the size of an output main picture image and the size of an output picture-in-picture image of display equipment respectively;
acquiring a proportional value N of the size of a main picture image and the size of an output main picture image of display equipment, and a proportional value M of the size of a picture-in-picture image and the size of the output picture-in-picture image of the display equipment;
reading corresponding line pixel information of the main picture image according to the N and M values, performing reduction or enlargement operation on the read line pixels to synthesize a line, reading corresponding line pixel information of the picture-in-picture image, and performing reduction or enlargement operation on the read line pixels to synthesize a line;
and transmitting the synthesized line pixels to a receiving end after image transformation.
6. The method of claim 1, wherein: the PIP region is rectangular, and the step of determining whether the PIP region is included in the current line of screen region is,
acquiring the coordinates of the picture-in-picture area in the screen area;
the display equipment processes one line at a time according to the output size, and judges whether the current line passes through the rectangular area of the picture-in-picture or not according to the coordinate of the rectangular position of the picture-in-picture;
the pd region is determined to be included when passing through the rectangular region of the pd.
7. The method of claim 1, wherein: the pip region is plural, and the shape of the pip region is rectangular or non-rectangular.
8. A hardware-based picture-in-picture display device, comprising:
a frame generation device for setting screen region division information including a picture-in-picture;
an image processing device for reading the screen area division information in line units and judging whether the current line screen area contains a picture-in-picture area; under the condition that the picture-in-picture region is judged not to be contained, reading pixel information corresponding to the current line in the main picture image, and transmitting the pixel information to a receiving end display device after image processing; under the condition that the picture-in-picture region is judged to be contained, reading pixel information which corresponds to a current line and is not covered by the picture-in-picture region in a main picture image and pixel information which corresponds to the current line in the picture-in-picture image, carrying out image processing on the pixel information and then transmitting the pixel information to a receiving end display device, wherein the pixel information is sequentially transmitted from left to right line by line;
a display device driven based on an output line to output an image including a main picture region and a pip region according to the aforementioned screen region division information.
9. The apparatus of claim 8, wherein: the display device is a display or a television with an HDMI interface, and pixels of each line are transmitted to the receiving end display device from left to right through the HDMI.
10. The apparatus of claim 8, wherein: the image processing device also comprises a zooming unit which is used for acquiring the size information of the main picture image and the size information of the picture-in-picture image, respectively acquiring the proportional value N of the size of the main picture image and the size of the output main picture image of the display device and the proportional value M of the size of the picture-in-picture image and the size of the output picture-in-picture image of the display device, respectively reading the corresponding line pixel information of the main picture image according to the N and M values, carrying out the reduction or amplification operation on the read line pixels to synthesize a line, reading the corresponding line pixel information of the picture-in-picture image, and carrying out the reduction or amplification operation on the read line pixels to synthesize a line.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910512211.6A CN110519530B (en) | 2019-06-13 | 2019-06-13 | Hardware-based picture-in-picture display method and device |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910512211.6A CN110519530B (en) | 2019-06-13 | 2019-06-13 | Hardware-based picture-in-picture display method and device |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN110519530A CN110519530A (en) | 2019-11-29 |
| CN110519530B true CN110519530B (en) | 2021-07-16 |
Family
ID=68622406
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201910512211.6A Active CN110519530B (en) | 2019-06-13 | 2019-06-13 | Hardware-based picture-in-picture display method and device |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN110519530B (en) |
Families Citing this family (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN115328421B (en) * | 2022-08-10 | 2023-12-22 | 上海为旌科技有限公司 | Multi-sub-image split-screen display method, system, hardware circuit and storage medium |
Citations (11)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| EP0271055A2 (en) * | 1986-12-10 | 1988-06-15 | Nokia Unterhaltungselektronik (Deutschland) GmbH | Video recorder with a second video signal track |
| CN1149801A (en) * | 1995-08-30 | 1997-05-14 | 德克萨斯仪器股份有限公司 | Sampling analog video frequency signal for sub image |
| US5657091A (en) * | 1995-11-01 | 1997-08-12 | International Business Machines Corporation | Video display controller, user interface and programming structure for such interface |
| JPH10240199A (en) * | 1997-02-28 | 1998-09-11 | Nec Corp | Picture display control device |
| EP0933931A2 (en) * | 1989-06-15 | 1999-08-04 | Sharp Kabushiki Kaisha | Television |
| US6919929B1 (en) * | 2001-03-29 | 2005-07-19 | National Semiconductor Corporation | Method and system for implementing a video and graphics interface signaling protocol |
| CN101383927A (en) * | 1995-12-29 | 2009-03-11 | 汤姆森消费电子有限公司 | Television system with provisions for displaying an auxiliary image of variable size |
| CN101461233A (en) * | 2006-04-18 | 2009-06-17 | 马维尔国际有限公司 | Shared memory multi video channel display apparatus and methods |
| CN101926169A (en) * | 2008-02-07 | 2010-12-22 | 松下电器产业株式会社 | Video signal processing method, integrated circuit, and video reproducer |
| CN103338340A (en) * | 2013-06-18 | 2013-10-02 | 北京汉博信息技术有限公司 | Picture-in-picture module and method for realizing user-defined combination of frame pictures of multiple video streams |
| CN105227866A (en) * | 2015-08-31 | 2016-01-06 | 青岛中星微电子有限公司 | A kind of multi-channel video display packing and device |
-
2019
- 2019-06-13 CN CN201910512211.6A patent/CN110519530B/en active Active
Patent Citations (11)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| EP0271055A2 (en) * | 1986-12-10 | 1988-06-15 | Nokia Unterhaltungselektronik (Deutschland) GmbH | Video recorder with a second video signal track |
| EP0933931A2 (en) * | 1989-06-15 | 1999-08-04 | Sharp Kabushiki Kaisha | Television |
| CN1149801A (en) * | 1995-08-30 | 1997-05-14 | 德克萨斯仪器股份有限公司 | Sampling analog video frequency signal for sub image |
| US5657091A (en) * | 1995-11-01 | 1997-08-12 | International Business Machines Corporation | Video display controller, user interface and programming structure for such interface |
| CN101383927A (en) * | 1995-12-29 | 2009-03-11 | 汤姆森消费电子有限公司 | Television system with provisions for displaying an auxiliary image of variable size |
| JPH10240199A (en) * | 1997-02-28 | 1998-09-11 | Nec Corp | Picture display control device |
| US6919929B1 (en) * | 2001-03-29 | 2005-07-19 | National Semiconductor Corporation | Method and system for implementing a video and graphics interface signaling protocol |
| CN101461233A (en) * | 2006-04-18 | 2009-06-17 | 马维尔国际有限公司 | Shared memory multi video channel display apparatus and methods |
| CN101926169A (en) * | 2008-02-07 | 2010-12-22 | 松下电器产业株式会社 | Video signal processing method, integrated circuit, and video reproducer |
| CN103338340A (en) * | 2013-06-18 | 2013-10-02 | 北京汉博信息技术有限公司 | Picture-in-picture module and method for realizing user-defined combination of frame pictures of multiple video streams |
| CN105227866A (en) * | 2015-08-31 | 2016-01-06 | 青岛中星微电子有限公司 | A kind of multi-channel video display packing and device |
Non-Patent Citations (1)
| Title |
|---|
| 液晶电视接收机的研究与实现;陈卫东;《中国优秀硕士论文全文数据库 信息科技辑》;20100315;全文 * |
Also Published As
| Publication number | Publication date |
|---|---|
| CN110519530A (en) | 2019-11-29 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US6493036B1 (en) | System and method for scaling real time video | |
| EP1199888B1 (en) | Image data output device and receiving device | |
| CN111161660A (en) | Data processing system | |
| JP2007089110A (en) | Image splitting method for television wall | |
| US7701466B2 (en) | Method and system for providing accelerated video processing in a communication device | |
| CN114040246A (en) | Image format conversion method, device, equipment and storage medium of graphic processor | |
| CN113727161B (en) | Microblaze-based real-time video seam clipping method and system | |
| CN110519530B (en) | Hardware-based picture-in-picture display method and device | |
| US20010048771A1 (en) | Image processing method and system for interpolation of resolution | |
| CN110602410B (en) | Image processing method and device, aerial camera and storage medium | |
| US20030044082A1 (en) | Image processing apparatus having processing operation by coordinate calculation | |
| CN112184538A (en) | Image acceleration method, related device, equipment and storage medium | |
| JPWO2018087856A1 (en) | Video composition apparatus and video composition method | |
| KR101169994B1 (en) | Graphic image processing apparatus and method using alpha plane | |
| CN114245027B (en) | Video data hybrid processing method, system, electronic equipment and storage medium | |
| CN113393391B (en) | Image enhancement method, image enhancement device, electronic apparatus, and storage medium | |
| US7236645B2 (en) | Image synthesizing apparatus and method | |
| JP3872295B2 (en) | Data display method, recording medium, and processor-based system | |
| US7474311B2 (en) | Device and method for processing video and graphics data | |
| JPH11355683A (en) | Video display device | |
| JP2002006825A (en) | Video signal correcting device | |
| US20140056524A1 (en) | Image processing device, image processing method, and program | |
| JP4534205B2 (en) | Image display device | |
| JP2007201816A (en) | Video image display system and video image receiver | |
| EP1511002A2 (en) | Information processing apparatus, semiconductor device for display control and video stream data display control method |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant | ||
| CP02 | Change in the address of a patent holder | ||
| CP02 | Change in the address of a patent holder |
Address after: 201210 8th floor, building 1, 298 Xiangke Road, Pudong New Area, Shanghai Patentee after: MOUXIN TECHNOLOGY (SHANGHAI) Co.,Ltd. Address before: Room 507, building 1, No. 800, Naxian Road, pilot Free Trade Zone, Pudong New Area, Shanghai 201210 Patentee before: MOUXIN TECHNOLOGY (SHANGHAI) Co.,Ltd. |