CN110519530A - Hardware based picture-in-picture display methods and device - Google Patents

Hardware based picture-in-picture display methods and device Download PDF

Info

Publication number
CN110519530A
CN110519530A CN201910512211.6A CN201910512211A CN110519530A CN 110519530 A CN110519530 A CN 110519530A CN 201910512211 A CN201910512211 A CN 201910512211A CN 110519530 A CN110519530 A CN 110519530A
Authority
CN
China
Prior art keywords
picture
image
region
equipment
current line
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN201910512211.6A
Other languages
Chinese (zh)
Other versions
CN110519530B (en
Inventor
陈胤凯
孙德印
梅佳希
张云
郑成植
何珊
刘守浩
韦虎
董虎
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Eye Core Technology (shanghai) Co Ltd
Original Assignee
Eye Core Technology (shanghai) Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Eye Core Technology (shanghai) Co Ltd filed Critical Eye Core Technology (shanghai) Co Ltd
Priority to CN201910512211.6A priority Critical patent/CN110519530B/en
Publication of CN110519530A publication Critical patent/CN110519530A/en
Application granted granted Critical
Publication of CN110519530B publication Critical patent/CN110519530B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00Details of television systems
    • H04N5/222Studio circuitry; Studio devices; Studio equipment
    • H04N5/262Studio circuits, e.g. for mixing, switching-over, change of character of image, other special effects ; Cameras specially adapted for the electronic generation of special effects
    • H04N5/2628Alteration of picture size, shape, position or orientation, e.g. zooming, rotation, rolling, perspective, translation
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00Details of television systems
    • H04N5/44Receiver circuitry for the reception of television signals according to analogue transmission standards
    • H04N5/445Receiver circuitry for the reception of television signals according to analogue transmission standards for displaying additional information
    • H04N5/45Picture in picture, e.g. displaying simultaneously another television channel in a region of the screen
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00Television systems
    • H04N7/01Conversion of standards, e.g. involving analogue television standards or digital television standards processed at pixel level
    • H04N7/0125Conversion of standards, e.g. involving analogue television standards or digital television standards processed at pixel level one of the standards being a high definition standard

Abstract

The invention discloses hardware based picture-in-picture display methods and devices, are related to technical field of image processing.The method includes the steps: screen is divided into key frame region and picture-in-picture region;Whether the screen area division information that aforementioned display equipment is read with behavior unit determines in current line screen area to include picture-in-picture region;When judgement does not include, Pixel Information corresponding with current line in main picture image is read, receiving end is transferred to after image procossing;When judgement includes, reads in main picture image and current line is corresponding not by Pixel Information corresponding with current line in the Pixel Information of picture-in-picture region covering and pip image, then be transferred to receiving end after image procossing.When realizing picture-in-picture using the present invention, without saving to result images, picture-in-picture synthesis can be carried out to the image transmitted, reduce picture delay when picture-in-picture display.

Description

Hardware based picture-in-picture display methods and device
Technical field
The present invention relates to technical field of image processing more particularly to a kind of picture-in-picture display methods and devices.
Background technique
In display field, picture-in-picture function is often used.Picture-in-picture (Picture in Picture abbreviation PIP) is benefit It is the function that contents producer cut-and-dried recovery time identical 2 image datas are carried out to synthesis display with digital technology Energy.In simple terms, picture-in-picture is that some region on a main picture image synthesizes an other sub-screen image, ginseng The region PIP as shown in Figure 1.The mode of image synthesis usually may include upper layer covering lower layer or Alpha's synthesis.
The implementation of traditional picture-in-picture, it usually needs in advance obtaining original image and picture-in-picture (and then original image and will draw It draws and carries out upper layer covering lower layer or Alpha's synthesis, then the result images of generation (or composograph) are temporarily stored in and are set In fixed memory, then the result images in aforementioned memory are shown by display equipment.Above-mentioned picture-in-picture displaying scheme Have the disadvantage that: 1) result images can committed memory space;2) result images memory and display equipment is saved in read from memory Take image all can committed memory bandwidth;3) it has to start to show after synthesis finishes, some delays can be generated;4) it carries out The premise of synthesis is that original image and picture-in-picture have all had been prepared for, and data have been transmitted and stored, thus can not be right Image just in transmission process is synthesized.
Summary of the invention
It is an object of the invention to: overcome the deficiencies of the prior art and provide a kind of hardware based picture-in-picture display side Method and device, using the present invention realize picture-in-picture when, without being saved to result images, can to the image transmitted into The synthesis of row picture-in-picture reduces picture delay when picture-in-picture display.
To realize above-mentioned target, the present invention provides the following technical scheme that
A kind of hardware based picture-in-picture display methods, comprising steps of generating the setting of equipment according to frame, display equipment will Screen is divided into key frame region and picture-in-picture region;Letter is divided with the screen area that behavior unit reads aforementioned display equipment Whether breath determines in current line screen area to include picture-in-picture region;Determine in the case where not including picture-in-picture region, reads master Pixel Information corresponding with current line, is transferred to receiving end after image procossing in picture image;Determine to include picture-in-picture region In the case where, read the Pixel Information not covered by picture-in-picture region corresponding with current line, Yi Jihua in main picture image Middle picture Pixel Information corresponding with current line as in, then receiving end is transferred to after image procossing.
Further, the display equipment is display or television set with HDMI interface, by HDMI by the picture of every row Element is from left to right transferred to receiving end and shows equipment.
Further, when the pixel of every row being from left to right transferred to receiving end, when picture-in-picture region is located at key frame region When middle part, the image transmitting of main picture image left area is carried out first, then carries out pip image transmission, and pip image passes It is switched to main picture image after the completion of defeated, carries out the image transmitting of main picture image right area.
Further, Pixel Information corresponding with current line in main picture image is read, reception is sent to after image procossing The step of end includes:
The dimension information for acquiring main picture image is compared with the Output Size of display equipment;
Obtain the ratio value N of the size of main picture image and the Output Size of display equipment;
According to aforementioned N value, read the corresponding row Pixel Information of main picture image, to the row pixel of reading carry out reduce or Synthesis a line is enlarged;
Row pixel after synthesis is transferred to receiving end after image converts.
Further, the Pixel Information not covered by picture-in-picture region corresponding with current line in main picture image is read, And Pixel Information corresponding with current line in pip image, then the step of being sent to after image procossing receiving end include:
Acquire the dimension information of main picture image and the dimension information of pip image, by the two respectively with display equipment Corresponding Output Size is compared;
The ratio value N of the size of acquisition main picture image and the corresponding Output Size of display equipment, the ruler of pip image It is very little with display equipment corresponding Output Size ratio value M;
According to aforementioned N and M value, the corresponding row Pixel Information of main picture image is read, is contracted to the row pixel of reading Small or amplifying operation synthesis a line, and the corresponding row Pixel Information of pip image is read, the row pixel of reading is carried out Zoom in or out operation synthesis a line;
Row pixel after synthesis is transferred to receiving end after image converts.
Further, whether the picture-in-picture region is rectangle, determine in current line screen area to include picture-in-picture region Step is,
Obtain coordinate of the picture-in-picture region in screen area;
Display equipment is sentenced according to size a line per treatment of output according to the coordinate of the rectangle position of aforementioned picture-in-picture Whether disconnected current line passes through the rectangular area of the picture-in-picture;
By the picture-in-picture rectangular area when determine include picture-in-picture region.
Further, the picture-in-picture region is multiple, and the shape of the picture-in-picture region is rectangle or non-rectangle.
The present invention also provides a kind of hardware based picture-in-picture display device (comprise the following structure:
Frame generates equipment, to set the screen area division information comprising picture-in-picture;
Image processing equipment determines current line screen area for reading said display partition information with behavior unit It whether include picture-in-picture region in domain;And determine do not include picture-in-picture region in the case where, read main picture image in work as Move ahead corresponding Pixel Information, and receiving end is transferred to after image procossing and shows equipment;Determining the feelings comprising picture-in-picture region Under condition, the Pixel Information not covered by picture-in-picture region corresponding with current line and picture-in-picture in main picture image are read Pixel Information corresponding with current line in image, then be transferred to receiving end after image procossing and show equipment;
Equipment is shown, to include the figure in key frame region and picture-in-picture region according to the output of said display division information Picture.
Further, the display equipment is display or television set with HDMI interface, by HDMI by the picture of every row Element is from left to right transferred to receiving end and shows equipment.
Further, described image processing equipment further includes unit for scaling, to acquire the dimension information of main picture image With the dimension information of pip image, the ratio value N and M of the two with the corresponding Output Size of display equipment, and root are successively obtained Operation synthesis a line is zoomed in and out according to the corresponding N row Pixel Information that aforementioned N and M value reads main picture image respectively, reads picture The corresponding M row Pixel Information of middle picture picture zooms in and out operation synthesis a line.
The present invention due to using the technology described above, compared with prior art, as an example, has the following advantages that and accumulates Pole effect:, can be to transmitting without being saved to result images when realizing picture-in-picture using technical solution of the present invention Image carry out picture-in-picture synthesis, reduce picture-in-picture display when picture delay.
Detailed description of the invention
Fig. 1 is picture-in-picture display example figure common in the art.
Fig. 2 is that screen provided in an embodiment of the present invention divides schematic diagram.
Fig. 3 is the coordinate system provided in an embodiment of the present invention established based on screen.
Fig. 4 is the schematic diagram provided in an embodiment of the present invention for reading and not including the Pixel Information of picture-in-picture region.
Fig. 5 is the schematic diagram provided in an embodiment of the present invention for reading the Pixel Information comprising picture-in-picture region.
Fig. 6 is the main picture image provided in an embodiment of the present invention comprising multiple picture-in-picture regions.
Screen 100;
Key frame region 110;
Picture-in-picture region 120;
Currently processed row 200.
Specific embodiment
Below in conjunction with the drawings and specific embodiments to hardware based picture-in-picture display methods disclosed by the invention and device It is described in further detail.It should be noted that the combination of technical characteristic or technical characteristic described in following embodiments is not Should be considered as it is isolated, they can be combined with each other to reaching superior technique effect.In the attached of following embodiments In figure, the identical label that each attached drawing occurs represents identical feature or component, can be apply to different embodiments.Therefore, Once being defined in a certain Xiang Yi attached drawing, then in subsequent attached drawing do not need that it is further discussed.
It should be noted that structure, ratio, size etc. depicted in this specification institute attached drawing, only to cooperate explanation The revealed content of book is not limited to invent enforceable restriction item so that those skilled in the art understands and reads Part, the modification of any structure, the change of proportionate relationship or the adjustment of size are not influencing the effect of invention can be generated and institute's energy Under the purpose reached, it should all fall in the range of the revealed technology contents of invention can cover.Preferred implementation side of the invention The range of formula includes other realization, wherein described or discussion the sequence can not be pressed, including is pressed according to related function Basic mode simultaneously or in the opposite order, Lai Zhihang function, this should be by the skill of the embodiment of the present invention technical field Art personnel are understood.
Technology, method and apparatus known to person of ordinary skill in the relevant may be not discussed in detail, but suitable In the case of, the technology, method and apparatus should be considered as authorizing part of specification.Institute that is shown here and discussing Have in example, any occurrence should be construed as merely illustratively, not as limitation.Therefore, exemplary embodiment Other examples can have different values.
Embodiment
It is shown in Figure 1, a kind of hardware based picture-in-picture display methods is disclosed, comprising steps of
S100 (generates the setting of equipment according to frame, shows that screen is divided into key frame region and picture-in-picture region by equipment.
S200 (is read the screen area division information of aforementioned display equipment with behavior unit, determines current line screen area In whether include picture-in-picture region.
S300 (determines in the case where not including picture-in-picture region, reads pixel corresponding with current line in main picture image Information is transferred to receiving end after image procossing;
Determine corresponding with current line not by picture-in-picture in main picture image comprising reading in the case where picture-in-picture region Pixel Information corresponding with current line in the Pixel Information and pip image of region overlay, then transmitted after image procossing To receiving end.
In this implementation, the display equipment is based on display peripheral hardware driving, for example has HDMI (High Definition Multimedia Interface high-definition media interface) interface display or television set.The display equipment is based on output Row driving, such as HDMI regulation have to how long, start the transmission of next line.
The pixel of every row is from left to right transferred in receiving end display equipment from transmitting terminal by HDMI and is exported.A line passes After the completion of defeated, after an of short duration pause, then next line is transmitted.Using scheme provided in this embodiment, as long as can be by It is ready to need display image data according to the speed of display, so that it may in the case where no delay, realize picture-in-picture.
In the step S100, the setting of equipment is generated according to frame, shows that screen is divided into two regions by equipment, referring to It include key frame region 110 (base map i.e. where picture-in-picture) and picture-in-picture area in the form that screen 100 exports shown in Fig. 2 Domain 120.
The darker regions are main picture area 110, and light areas is picture-in-picture region 120.The frame generates equipment The component of content and/or effect can be shown with setting screen, display equipment is answered based on the command information output phase that frame generates equipment Content and/or effect, display equipment be for frame generate device service.
By way of example and not limitation, for example frame generation equipment may include computer CPU (central processing unit) and operate in this Game application (or game computer program) on computer, and show that equipment may include video card and screen, is set by display The standby description (instruction) that frame is generated equipment is shown.
In the present embodiment, the picture-in-picture region 120 is preferably rectangle.
By way of example and not limitation, when picture-in-picture region is rectangle, can by acquire the angle steel joint of the rectangle come Mark position of the picture-in-picture in screen.For example, it is shown in Figure 3, right angle is established as origin using the starting point in the screen upper left corner Coordinate system, the position of the picture-in-picture can pass through upper left angular coordinate (0.2 (0.2) and bottom right angular coordinate (0.6 (0.7) To mark.
(the screen area division information of aforementioned display equipment is read with behavior unit in the step S200.It is specific real Shi Shi, hardware data line per treatment, and receiving end is sent by HDMI by these data.It is shown in Figure 4, in figure Black line represents currently processed row 200.
Determine in current line screen area whether to include picture-in-picture region.When it is implemented, using picture-in-picture region as rectangle For, determine that the step of whether including picture-in-picture region can be such that in current line screen area
Obtain coordinate of the picture-in-picture region in screen area;
Display equipment is sentenced according to size a line per treatment of output according to the coordinate of the rectangle position of aforementioned picture-in-picture Whether disconnected current line passes through the rectangular area of the picture-in-picture;
By the picture-in-picture rectangular area when, it can determine include picture-in-picture region.
As an example, for example equipment is shown according to size 1920x1080 a line per treatment of output, further according to above The rectangle position of picture-in-picture judges whether current line passes through the rectangular area of the picture-in-picture, determine when in row screen area whether Include picture-in-picture region.
In the case where determining not including picture-in-picture region, the Pixel Information of the corresponding current line of main picture image is read, Using possible scaling, transformation --- such as adjustment saturation degree, then receiving end is sent to by HDMI.
It is illustrated in conjunction with Fig. 4.When currently processed row 200 (black line) does not pass through picture-in-picture region 120, image is obtained The mode of information exactly reads out the correspondence of main picture image one to multirow, i.e., reading main picture image in current line Corresponding Pixel Information.
Preferably, further include following steps:
The dimension information for acquiring main picture image is compared with the Output Size of display equipment;
Obtain the ratio value N of the size of main picture image and the Output Size of display equipment;
According to aforementioned N value, read the corresponding row Pixel Information of main picture image, to the row pixel of reading carry out reduce or Synthesis a line is enlarged;
Row pixel after synthesis is transferred to receiving end after image converts.
By way of example and not limitation, for example the size of main picture image is 3840x2160, shows that the Output Size of equipment is 1920x1080, N=2 will then read 2 row main picture image rows every time, by two row Pixel Informations scaling, 1/2 synthesis of reading After a line, receiving end is sent to by HDMI.
In the case where determining comprising picture-in-picture region, read corresponding with current line not by picture in main picture image Pixel Information corresponding with current line in the Pixel Information and pip image of region overlay is drawn, then is passed after image procossing It is defeated to arrive receiving end.
It is illustrated in conjunction with Fig. 5.When currently processed row 200 (black line) passes through picture-in-picture region 120, display equipment can be first The correspondence one of main picture image is read out to multirow, using possible scaling, transformation is sent to the receiving end HDMI;So Afterwards, when current row is handled to picture-in-picture region, display equipment is read out from the correspondence one of pip image to multirow.
I.e. in the case where determining comprising picture-in-picture, the corresponding main picture image of current line is read not by picture-in-picture rectangle Multirow is arrived to the one of multirow and the corresponding pip image of current line in the part one of region overlay, by possible scaling, becomes It changes, is sent to the receiving end HDMI.It is switched to main picture image again after having handled picture-in-picture region to be handled, main picture image Middle covered portionss can choose discarding to reduce resource occupation.
Preferably, further include following steps:
The Pixel Information not covered by picture-in-picture region corresponding with current line in main picture image is read, and in picture It draws the Pixel Information corresponding with current line as in, then the step of being sent to after image procossing receiving end includes,
Acquire the dimension information of main picture image and the dimension information of pip image, by the two respectively with display equipment Corresponding Output Size is compared;
The ratio value N of the size of acquisition main picture image and the corresponding Output Size of display equipment, the ruler of pip image It is very little with display equipment corresponding Output Size ratio value M;
According to aforementioned N and M value, the corresponding row Pixel Information of main picture image is read, is contracted to the row pixel of reading Small or amplifying operation synthesis a line, and the corresponding row Pixel Information of pip image is read, the row pixel of reading is carried out Zoom in or out operation synthesis a line;
Row pixel after synthesis is transferred to receiving end after image converts.
By way of example and not limitation, for example the size of main picture image is 3840x2160, shows the output key frame of equipment Picture size is 1920x1080;The size of pip image is 1920x1080, show the output picture-in-picture of equipment having a size of 640x360;Then N=2 (M=3;For picture-in-picture, 3 row pip image rows are read every time, and two row pixels of reading are believed After 1/3 synthesis a line of breath scaling, receiving end is sent to by HDMI.
It should be noted that, although only illustrated in above-described embodiment carried out when display reduce processing mode (at this time N and 1) value of M is greater than, but those skilled in the art will be appreciated that, the N and M can also be the value less than 1, that is, can also be when showing Enhanced processing.N=0.25 is calculated, i.e., main picture Face needs to be amplified 4 times in display, then needs to read the corresponding 1 row Pixel Information of main picture image, to the row picture of reading A line is synthesized after 4 times of element amplification.
In addition, the N that is calculated can also be non-integer, by way of example and not limitation, such as N=1.2, it needs to read Corresponding row Pixel Information be N round up after number N1=2, that is, read main picture image corresponding 2 row Pixel Information, A line is synthesized after scaling 1/1.2 to the row pixel of reading.
Shown in Figure 5 in the present embodiment, the picture-in-picture region 120 is preferably located at 110 middle part of key frame region, In such cases, when currently processed row 200 (black line) passes through picture-in-picture region 120, main picture image left side area is carried out first The image transmitting in domain, then pip image transmission is carried out, pip image is switched to main picture image after being transmitted, and is led The image transmitting of picture image right area.
It is shown in Figure 6, it is another embodiment of the present embodiment, the picture-in-picture region 120 can be described to be multiple The shape of picture-in-picture region 120 is rectangle or non-rectangle.The non-rectangular shape, by way of example and not limitation, such as can be with For circle, ellipse, pentalpha, triangle and any other irregular close-shaped.
When key frame region includes multiple picture-in-picture regions, display methods and the method for including a picture-in-picture region It is similar: to obtain coordinate position of each picture-in-picture region in key frame region, judged according to the coordinate position of picture-in-picture current Whether whether row passes through the picture-in-picture region, therefore, it is determined that when including picture-in-picture region in row screen area.
In the case where determining not including picture-in-picture region, the Pixel Information of the corresponding current line of main picture image is read, Using possible scaling, transformation --- such as adjustment saturation degree, then receiving end is sent to by HDMI.
In the case where determining comprising picture-in-picture region, read corresponding with current line not by picture in main picture image Pixel Information corresponding with current line in the Pixel Information and pip image of region overlay is drawn, using possible scaling, Transformation --- such as adjustment saturation degree, then receiving end is sent to by HDMI.
For the picture-in-picture region of non-rectangle (profile), it is preferred that the setting that equipment can be generated according to frame, by screen Display area is divided into muti-piece, and generates a picture-in-picture according to display size and show mapping table.By way of example and not limitation, with For showing dimensions as 1920x1080, then the table of above-mentioned mapping table is wide by 1920, high by 1080.The content of table can indicate each picture The source of element: main picture image O, pip image A, pip image B or pip image C are come from.
By way of example and not limitation, the simplified picture-in-picture shows that mapping table can be such that
O O O O O O O O O O O O O O O O O O O O
O O O A A A O O O O O O O O B B B B O O
O O A A A A A O O O O O O O B B B B O O
O O O A A A O O O O O O O O B B B B O O
O O O O O O O O O O O O O O B B B B O O
O O O O O O O O O O O O O O B B B B O O
O O O O O C O O O O O O O O B B B B O O
O O O C C C C C O O O O O O B B B B O O
O O O O C C C O O O O O O O B B B B O O
O O O C O O O C O O O O O O B B B B O O
O O O O O O O O O O O O O O B B B B O O
O O O O O O O O O O O O O O O O O O O O
Another embodiment of the present invention additionally provides a kind of hardware based picture-in-picture display device.
Described device comprises the following structure:
Frame generates equipment, to set the screen area division information comprising picture-in-picture;
Image processing equipment determines current line screen area for reading said display partition information with behavior unit It whether include picture-in-picture region in domain;And determine do not include picture-in-picture region in the case where, read main picture image in work as Move ahead corresponding Pixel Information, and receiving end is transferred to after image procossing and shows equipment;Determining the feelings comprising picture-in-picture region Under condition, the Pixel Information not covered by picture-in-picture region corresponding with current line and picture-in-picture in main picture image are read Pixel Information corresponding with current line in image, then be transferred to receiving end after image procossing and show equipment;
Equipment is shown, to include the figure in key frame region and picture-in-picture region according to the output of said display division information Picture.
In the present embodiment, the display equipment is based on display peripheral hardware driving, for example has HDMI (High Definition Multimedia Interface high-definition media interface) interface display or television set.By HDMI by the pixel of every row It is from left to right transferred in receiving end display equipment and exports from transmitting terminal.After a line is transmitted, by an of short duration pause Afterwards, then next line is transmitted.Using scheme provided in this embodiment, as long as can be ready to need display figure according to the speed of display As data, so that it may in the case where no delay, realize picture-in-picture.
It is the component that content and/or effect can be shown with setting screen that the frame, which generates equipment, and display equipment is produced based on frame The command information of generating apparatus exports corresponding content and/or effect, and display equipment is to generate device service for frame.
By way of example and not limitation, for example frame generation equipment may include computer CPU (central processing unit) and operate in this Game application (or game computer program) on computer, and show that equipment may include video card and screen, is set by display The standby description (instruction) that frame is generated equipment is shown.
The picture-in-picture region 120 is preferably rectangle.
In another embodiment of the present embodiment, described image processing equipment can also include unit for scaling.
Unit for scaling successively obtains two to acquire the dimension information of main picture image and the dimension information of pip image Person and show equipment corresponding Output Size ratio value N and M, and read according to aforementioned N and M value pair of main picture image respectively The row Pixel Information answered zooms in and out operation synthesis a line, and the corresponding row Pixel Information for reading pip image zooms in and out behaviour Make synthesis a line.
By way of example and not limitation, for example the size of main picture image is 3840x2160, shows the output key frame of equipment Picture size is 1920x1080;The size of pip image is 1920x1080, show the output picture-in-picture of equipment having a size of 640x360 will then read 3 row pip image rows every time, after two row Pixel Informations scaling, 1/3 synthesis a line of reading, Receiving end is sent to by HDMI.
Other technical characteristics are referring to the description in preceding embodiment, and details are not described herein.
It should be noted that device can also be other including usually finding in computing systems in the present invention Component such as stores in memory and by the operating system of processor execution, queue management device, device driver, data Library driver or one or more network protocols etc., belong to the prior art, details are not described herein.
In the above description, the disclosure is not intended to for its own to be limited to these aspects.But at this Within the scope of the protection of goal of disclosure, each component can selectively and operatively be merged with arbitrary number.In addition, As the term of " comprising ", " including " and " having " should default it is being interpreted as including property or open, rather than it is exclusive Property or closure, unless it is explicitly defined as opposite meaning.All technologies, science and technology or otherwise term all meet Meaning understood by one of ordinary skill in the art, unless it is defined as opposite meaning.The public term found in dictionary is answered It is not idealized very much or is impractically explained very much when under the background in the relevant technologies document, unless present disclosure is clearly limited Determine at such.Any change, the modification that the those of ordinary skill in field of the present invention does according to the disclosure above content, belong to right The protection scope of claim.

Claims (10)

1. a kind of hardware based picture-in-picture display methods, it is characterised in that comprising steps of
The setting of equipment is generated according to frame, shows that screen is divided into key frame region and picture-in-picture region by equipment;
With behavior unit read it is aforementioned display equipment screen area division information, determine current line screen area in whether include Picture-in-picture region;
Determine in the case where not including picture-in-picture region, Pixel Information corresponding with current line in main picture image is read, through scheming As being transferred to receiving end after processing;Determine corresponding with current line in main picture image comprising reading in the case where picture-in-picture region The Pixel Information not covered by picture-in-picture region and pip image in Pixel Information corresponding with current line, then pass through Receiving end is transferred to after image procossing.
2. according to the method described in claim 1, it is characterized by: the display equipment be display with HDMI interface or The pixel of every row is from left to right transferred to receiving end by HDMI and shows equipment by television set.
3. according to the method described in claim 2, it is characterized by: when the pixel of every row is from left to right transferred to receiving end, When picture-in-picture region is located in the middle part of key frame region, the image transmitting of main picture image left area is carried out first, then is carried out Pip image transmission, pip image are switched to main picture image after being transmitted, carry out main picture image right area Image transmitting.
4. according to the method described in claim 1, it is characterized by: reading pixel letter corresponding with current line in main picture image Breath, the step of receiving end is sent to after image procossing include,
The dimension information for acquiring main picture image is compared with the Output Size of display equipment;
Obtain the ratio value N of the size of main picture image and the Output Size of display equipment;
According to aforementioned N value, the corresponding row Pixel Information of main picture image is read, the row pixel of reading is zoomed in or out Operation synthesis a line;
Row pixel after synthesis is transferred to receiving end after image converts.
5. according to the method described in claim 1, it is characterized by: read main picture image in it is corresponding with current line not by Pixel Information corresponding with current line in the Pixel Information and pip image of picture-in-picture region covering, then through image procossing After the step of being sent to receiving end include,
The dimension information of main picture image and the dimension information of pip image are acquired, the two is corresponding with display equipment respectively Output Size is compared;
Obtain main picture image size with display equipment corresponding Output Size ratio value N, the size of pip image and Show the ratio value M of the correspondence Output Size of equipment;
According to aforementioned N and M value, read the corresponding row Pixel Information of main picture image, to the row pixel of reading carry out reduce or Synthesis a line is enlarged, and reads the corresponding row Pixel Information of pip image, the row pixel of reading is reduced Or synthesis a line is enlarged;
Row pixel after synthesis is transferred to receiving end after image converts.
6. according to the method described in claim 1, it is characterized by: the picture-in-picture region is rectangle, judgement current line screen The step of whether including picture-in-picture region in region is,
Obtain coordinate of the picture-in-picture region in screen area;
Equipment is shown according to size a line per treatment of output, according to the coordinate of the rectangle position of aforementioned picture-in-picture, judgement is worked as It moves ahead and whether passes through the rectangular area of the picture-in-picture;
By the picture-in-picture rectangular area when determine include picture-in-picture region.
7. according to the method described in claim 1, it is characterized by: the picture-in-picture region is multiple, the picture-in-picture region Shape be rectangle or non-rectangle.
8. a kind of hardware based picture-in-picture display device, characterized by comprising:
Frame generates equipment, to set the screen area division information comprising picture-in-picture;
Image processing equipment determines in current line screen area for reading said display partition information with behavior unit It whether include picture-in-picture region;And determine do not include picture-in-picture region in the case where, read main picture image in current line Corresponding Pixel Information is transferred to receiving end after image procossing and shows equipment;In the case where determining comprising picture-in-picture region, It reads corresponding with current line not by the Pixel Information of picture-in-picture region covering and pip image in main picture image Pixel Information corresponding with current line, then be transferred to receiving end after image procossing and show equipment;
Equipment is shown, to include the image in key frame region and picture-in-picture region according to the output of said display division information.
9. device according to claim 8, it is characterised in that: the display equipment be display with HDMI interface or The pixel of every row is from left to right transferred to receiving end by HDMI and shows equipment by television set.
10. device according to claim 8, it is characterised in that: described image processing equipment further includes unit for scaling, is used To acquire the dimension information of main picture image and the dimension information of pip image, it is corresponding with display equipment successively to obtain the two The ratio value N and M of Output Size, and according to aforementioned N and M value read respectively the corresponding N row Pixel Information of main picture image into Row zoom operations synthesize a line, and the corresponding M row Pixel Information for reading pip image zooms in and out operation synthesis a line.
CN201910512211.6A 2019-06-13 2019-06-13 Hardware-based picture-in-picture display method and device Active CN110519530B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201910512211.6A CN110519530B (en) 2019-06-13 2019-06-13 Hardware-based picture-in-picture display method and device

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201910512211.6A CN110519530B (en) 2019-06-13 2019-06-13 Hardware-based picture-in-picture display method and device

Publications (2)

Publication Number Publication Date
CN110519530A true CN110519530A (en) 2019-11-29
CN110519530B CN110519530B (en) 2021-07-16

Family

ID=68622406

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201910512211.6A Active CN110519530B (en) 2019-06-13 2019-06-13 Hardware-based picture-in-picture display method and device

Country Status (1)

Country Link
CN (1) CN110519530B (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN115328421A (en) * 2022-08-10 2022-11-11 上海为旌科技有限公司 Multi-sub-image split-screen display method, system, hardware circuit and storage medium

Citations (11)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP0271055A2 (en) * 1986-12-10 1988-06-15 Nokia Unterhaltungselektronik (Deutschland) GmbH Video recorder with a second video signal track
CN1149801A (en) * 1995-08-30 1997-05-14 德克萨斯仪器股份有限公司 Sampling analog video frequency signal for sub image
US5657091A (en) * 1995-11-01 1997-08-12 International Business Machines Corporation Video display controller, user interface and programming structure for such interface
JPH10240199A (en) * 1997-02-28 1998-09-11 Nec Corp Picture display control device
EP0933931A2 (en) * 1989-06-15 1999-08-04 Sharp Kabushiki Kaisha Television
US6919929B1 (en) * 2001-03-29 2005-07-19 National Semiconductor Corporation Method and system for implementing a video and graphics interface signaling protocol
CN101383927A (en) * 1995-12-29 2009-03-11 汤姆森消费电子有限公司 Television system with provisions for displaying an auxiliary image of variable size
CN101461233A (en) * 2006-04-18 2009-06-17 马维尔国际有限公司 Shared memory multi video channel display apparatus and methods
CN101926169A (en) * 2008-02-07 2010-12-22 松下电器产业株式会社 Video signal processing method, integrated circuit, and video reproducer
CN103338340A (en) * 2013-06-18 2013-10-02 北京汉博信息技术有限公司 Picture-in-picture module and method for realizing user-defined combination of frame pictures of multiple video streams
CN105227866A (en) * 2015-08-31 2016-01-06 青岛中星微电子有限公司 A kind of multi-channel video display packing and device

Patent Citations (11)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP0271055A2 (en) * 1986-12-10 1988-06-15 Nokia Unterhaltungselektronik (Deutschland) GmbH Video recorder with a second video signal track
EP0933931A2 (en) * 1989-06-15 1999-08-04 Sharp Kabushiki Kaisha Television
CN1149801A (en) * 1995-08-30 1997-05-14 德克萨斯仪器股份有限公司 Sampling analog video frequency signal for sub image
US5657091A (en) * 1995-11-01 1997-08-12 International Business Machines Corporation Video display controller, user interface and programming structure for such interface
CN101383927A (en) * 1995-12-29 2009-03-11 汤姆森消费电子有限公司 Television system with provisions for displaying an auxiliary image of variable size
JPH10240199A (en) * 1997-02-28 1998-09-11 Nec Corp Picture display control device
US6919929B1 (en) * 2001-03-29 2005-07-19 National Semiconductor Corporation Method and system for implementing a video and graphics interface signaling protocol
CN101461233A (en) * 2006-04-18 2009-06-17 马维尔国际有限公司 Shared memory multi video channel display apparatus and methods
CN101926169A (en) * 2008-02-07 2010-12-22 松下电器产业株式会社 Video signal processing method, integrated circuit, and video reproducer
CN103338340A (en) * 2013-06-18 2013-10-02 北京汉博信息技术有限公司 Picture-in-picture module and method for realizing user-defined combination of frame pictures of multiple video streams
CN105227866A (en) * 2015-08-31 2016-01-06 青岛中星微电子有限公司 A kind of multi-channel video display packing and device

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
陈卫东: "液晶电视接收机的研究与实现", 《中国优秀硕士论文全文数据库 信息科技辑》 *

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN115328421A (en) * 2022-08-10 2022-11-11 上海为旌科技有限公司 Multi-sub-image split-screen display method, system, hardware circuit and storage medium
CN115328421B (en) * 2022-08-10 2023-12-22 上海为旌科技有限公司 Multi-sub-image split-screen display method, system, hardware circuit and storage medium

Also Published As

Publication number Publication date
CN110519530B (en) 2021-07-16

Similar Documents

Publication Publication Date Title
US20060061661A1 (en) Real-time image stabilization
EP1199888B1 (en) Image data output device and receiving device
EP1531620A2 (en) Controlled non-proportional scaling display
US11373337B2 (en) Image processing method of virtual reality and apparatus thereof
WO2022161260A1 (en) Focusing method and apparatus, electronic device, and medium
CN113126862B (en) Screen capture method and device, electronic equipment and readable storage medium
JP2007089110A (en) Image splitting method for television wall
US20230362328A1 (en) Video frame insertion method and apparatus, and electronic device
CN112073647A (en) Image zooming display method, image processing device and display system
CN112132836A (en) Video image clipping method and device, electronic equipment and storage medium
US9013633B2 (en) Displaying data on lower resolution displays
CN115294055A (en) Image processing method, image processing device, electronic equipment and readable storage medium
CN110519530A (en) Hardware based picture-in-picture display methods and device
US9836812B2 (en) Image processing apparatus, method, and medium to apply a restrictive condition
CN110602410B (en) Image processing method and device, aerial camera and storage medium
JPH0918798A (en) Video display device with character processing function
US6701017B1 (en) High resolution high-value added video transfer method system and storage medium by using pseudo natural image
CN113393391B (en) Image enhancement method, image enhancement device, electronic apparatus, and storage medium
CN100518261C (en) Apparatus and method for magnifying or lessening local area of television picture
US20120300976A1 (en) Image processing device, image generation device, image processing method, and image generation method
US20120106648A1 (en) Image processing device and video reproducing device
CN113259716A (en) Video issuing method, video acquiring method, server, terminal and system
JP2005027193A (en) Image transfer device, method, and program
JP2010009305A (en) Image-processing device, image-processing method, and program
JP2005260630A (en) Image composition by superposing images together to generate composite image

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant
CP02 Change in the address of a patent holder
CP02 Change in the address of a patent holder

Address after: 201210 8th floor, building 1, 298 Xiangke Road, Pudong New Area, Shanghai

Patentee after: MOUXIN TECHNOLOGY (SHANGHAI) Co.,Ltd.

Address before: Room 507, building 1, No. 800, Naxian Road, pilot Free Trade Zone, Pudong New Area, Shanghai 201210

Patentee before: MOUXIN TECHNOLOGY (SHANGHAI) Co.,Ltd.