CN108024133A - A kind of information output display method and device - Google Patents
A kind of information output display method and device Download PDFInfo
- Publication number
- CN108024133A CN108024133A CN201610977422.3A CN201610977422A CN108024133A CN 108024133 A CN108024133 A CN 108024133A CN 201610977422 A CN201610977422 A CN 201610977422A CN 108024133 A CN108024133 A CN 108024133A
- Authority
- CN
- China
- Prior art keywords
- layer
- video
- image layer
- image
- video layer
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Withdrawn
Links
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/431—Generation of visual interfaces for content selection or interaction; Content or additional data rendering
- H04N21/4312—Generation of visual interfaces for content selection or interaction; Content or additional data rendering involving specific graphical features, e.g. screen layout, special fonts or colors, blinking icons, highlights or animations
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/431—Generation of visual interfaces for content selection or interaction; Content or additional data rendering
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Controls And Circuits For Display Device (AREA)
Abstract
The embodiment of the invention discloses a kind of information output display method, the described method includes：Calculate the mixing Overlapping display parameter of video layer and image layer, filter out the Part I image layer in video layer and image layer, video layer and Part I image layer are exported to first processor, Part II image layer is sequentially output to second processor and first processor, video layer, Part I image layer and the Part II image layer handled by first processor is shown according to mixing Overlapping display parameter.The embodiment of the present invention also discloses a kind of information output display device at the same time.
Description
Technical field
The present invention relates to the information processing technology in the communications field, more particularly to a kind of information output display method and dress
Put.
Background technology
At present, the smart television set top box that multimedia video plays progressively instead of traditional television set, into people
The daily life of class, more and more user's selections watch digital television program by set-top box.User is by set-top box in electricity
Image depending on being watched on terminal screen belongs to image layer, and the TV programme watched belong to video layer, and video screen is in content
During display, set-top box usually reads source data from server and the source data of reading is write video memory, then by set-top box
Display device driving read target data and flush on screen from the video memory at regular intervals, you can display source data
The content of representative.
In the existing multimedia video play system based on Android Android platform, as smart television set top box
Most crucial function, output display method mainly have three kinds, however these three methods or there are delivery efficiency it is low the problem of, or
Person there are CPU and GPU occupancies it is high the problem of, or there is the problem of video can not being output to designated position.
The content of the invention
In order to solve the above technical problems, an embodiment of the present invention is intended to provide a kind of information output display method and device, solution
Existing method of having determined either there are delivery efficiency it is low the problem of or there are central processing unit and graphics processor occupancy are high
Problem, or there is the problem of video can not being output to designated position, so as to save bus bandwidth, the system of improving is broadcast
Frame per second during video is put, realizes any output of video location, meanwhile, significantly reduce the power consumption of equipment, also improve
User experience.
The technical proposal of the invention is realized in this way：
A kind of information output display method, including：
Calculate the mixing Overlapping display parameter of video layer and image layer；Wherein, the video layer and described image layer difference
Be fill data after the video layer and filling data after described image layer；
Filter out the Part I image layer in the video layer and described image layer；
The video layer and the Part I image layer are exported to first processor, is sequentially output Part II image layer
To second processor and the first processor；Wherein, described image layer includes the Part I image layer and described second
Partial image layers；The first processor is video and the mixing overlap-add procedure device of image, and the second processor is mixed for image
Close overlap-add procedure device；
The video layer that is handled according to the mixing Overlapping display parameter display by the first processor, described the
A part of image layer and the Part II image layer.
Method as described above, further includes：
By at least one video layer buffering area of video Layer assignment that first interface is pending data, pass through second interface
For at least one image layer buffering area of image Layer assignment of the pending data.
Method as described above, further includes：
The video data of the pending data is filled into the video layer buffering area, and fills the pending data
View data into described image layer buffering area；
The video data of the video layer buffering area is filled into the corresponding video layer, and fills described image layer and delays
The view data in area is rushed into corresponding described image floor, obtains the video layer after filling data and the institute after filling data
State image layer.
Method as described above, further includes：
The video layer buffering area is marked by the first interface；
Obtain the Z-order information of video layer and image layer superposition；
Correspondingly, the Part I image layer filtered out in video layer and image layer, including：
Gone out according to the mark of the video layer buffering area and the Z-order information siftings in the video layer and image layer
Part I image layer.
Method as described above, the mark and the Z-order information siftings according to the video layer buffering area go out
Part I image layer in the video layer and image layer, including：
The video layer is gone out according to the label screening of the video layer buffering area；
According to the mark and Z-order information of the video layer buffering area, in the mixed of the video layer and described image layer
Close and the number positioned at the superiors' video layer draw above picture layer and the image layer below orlop video layer are obtained in region
Number；
Compare the number of the image layer on the superiors' video layer and the figure being located under orlop video layer
As the size of the number of layer；
By the number of the image layer on the superiors' video layer and the image layer being located under orlop video layer
The small image layer of number is as the Part I image layer in number.
A kind of information output display device, including：
Computing module, for calculating the mixing Overlapping display parameter of video layer and image layer；Wherein, the video layer and institute
State image layer respectively be fill data after the video layer and filling data after described image layer；
Screening module, for filtering out the Part I image layer in the video layer and described image layer；
Output module, for exporting the video layer and the Part I image layer to first processor, is sequentially output
Part II image layer is to second processor and the first processor；Wherein, described image layer includes the Part I figure
As layer and the Part II image layer；The first processor for video and image mixing overlap-add procedure device, described second
Processor is image blend overlap-add procedure device；
Display module, described according to the mixing Overlapping display parameter display by first processor processing
Video layer, the Part I image layer and the Part II image layer.
Device as described above, further includes：
Processing module, for being buffered by first interface at least one video layer of video Layer assignment of pending data
Area, passes through at least one image layer buffering area of image Layer assignment that second interface is the pending data.
Device as described above, further includes：
Module is filled, for filling the video data of the pending data into the video layer buffering area, and is filled
The view data of the pending data is into described image layer buffering area；The video data for filling the video layer buffering area arrives
In the corresponding video layer, and the view data for filling described image layer buffering area is obtained into corresponding described image layer
Fill the video layer after data and the described image layer after filling data.
Device as described above, further includes：
Acquisition module, for obtaining the Z-order information of video layer and image layer superposition；
The processing module, is additionally operable to that the video layer buffering area is marked by the first interface；
The screening module, specifically for the mark according to the video layer buffering area and the Z-order information siftings
Go out the Part I image layer in the video layer and image layer.
Device as described above, the screening module include：
Screening unit, for going out the video layer according to the label screening of the video layer buffering area；
Acquiring unit, for the mark and Z-order information according to the video layer buffering area, in the video layer and institute
State in the Mixed Zone of image layer and obtain positioned at the number of the superiors' video layer draw above picture layer and positioned at orlop video layer
The number of following image layer；
Comparing unit, for the relatively described image layer on the superiors' video layer number and described be located at orlop
The size of the number of image layer under video layer；
Processing unit, for by the number of the image layer on the superiors' video layer and described being located at orlop video layer
Under image layer number in the small image layer of number as the Part I image layer.
The information output display method and device that the embodiment of the present invention is provided, can calculate the mixed of video layer and image layer
Overlapping display parameter is closed, filters out the Part I image layer in video layer and image layer, exports video layer and Part I figure
As layer to first processor, Part II image layer is sequentially output to second processor and first processor, is superimposed according to mixing
Display parameters show video layer, Part I image layer and the Part II image layer by first processor processing；In this way,
Realize the graph layer different to video layer and position and screened difference, send to different processors and carry out mixing superposition,
The video layer and image layer being superimposed further according to the mixing Overlapping display parameter of calculating to mixing are shown to the designated position of screen,
So as to save bus bandwidth, frame per second during system plays video is improved, realizes any output of video location, meanwhile,
Significantly reduce the power consumption of equipment, also improve user experience.
Brief description of the drawings
Fig. 1 is a kind of flow diagram of information output display method of the prior art；
Fig. 2 is the flow diagram of another information output display method of the prior art；
Fig. 3 is the flow diagram of another information output display method of the prior art；
Fig. 4 is a kind of flow diagram of information output display method provided in an embodiment of the present invention；
Fig. 5 is the flow diagram of another information output display method provided in an embodiment of the present invention；
Fig. 6 is the flow diagram of another information output display method provided in an embodiment of the present invention；
Fig. 7 is the flow diagram of another information output display method provided in an embodiment of the present invention；
Fig. 8 is a kind of structure diagram of information output display device provided in an embodiment of the present invention；
Fig. 9 is the structure diagram of another information output display device provided in an embodiment of the present invention；
Figure 10 is the structure diagram of another information output display device provided in an embodiment of the present invention；
Figure 11 is the structure diagram of another information output display device provided in an embodiment of the present invention.
Embodiment
Fig. 1 is a kind of flow diagram of information output display method of the prior art.As shown in Figure 1, this output is aobvious
It is by player (MediaPlayer) driving multimedia service (MediaServer) to show method, is managed by MediaServer logical
The interface for crossing Android (Android) frame buffer zone hardware abstraction layer module (gralloc modules) is each video Layer assignment one
Or multiple video layer buffering areas, it is each image Layer assignment one or more image layer buffering area, MediaServer management is filled
Video data is into corresponding video layer buffering area, and filling view data is into corresponding image layer buffering area, MediaServer
Data in video layer buffering area are filled into corresponding video layer further according to this frame content to be shown, image layer is delayed
Rush the data in area to be filled into corresponding image layer, then the video layer after filling data and graph layer are passed through
SurfaceFlinger (function of calculating aliasing figure layer parameter is realized in android system) is and according to Z-order (z-order)
Information mixing, superposition are output in the frame buffering of graphics process hardware device (Graphic Processing Unit, GPU) application,
Pass through liquid crystal display (Liquid Crystal Display, LCD) or hardware display output module (On Screen again
Display, OSD) output is shown on screen, the shortcomings that this mode be the video display output overwhelming majority work by
SurfaceFlinger and GPU is completed, when video source resolution ratio becomes larger (more than 1080P), the frame buffer memory of required application
Space sharply increases, and GPU and central processing unit (Central Processing Unit, CPU) occupancy are very high, cause frame per second
It is difficult to put on.
Fig. 2 is the flow diagram of another information output display method of the prior art.As shown in Fig. 2, this output
The same above method of previous contents of display methods, is followed by the video layer after filling data and graph layer to pass through
SurfaceFlinger is simultaneously output to the Hwcomposer (displays in android system according to the mixing of Z-order information, superposition
Frame) in, then the hardware module by display, as OSD mixed, is superimposed and is output to screen, this mode is relative to first
The mode of kind, although can mitigate the burden of GPU and CPU and can lift frame per second, is limited by hardware module, when the need number of plies to be shown
When can mix the number of plies of superposition more than Hwcomposer hardware modules, display output efficiency can drastically decline, and special to part
Different figure layer, as blindstory (Dim Layer) can not mix superposition.
Fig. 3 is the flow diagram of another information output display method of the prior art.As shown in figure 3, this output
The same first method of previous contents of display methods, behind be then the hardware module that video layer is individually exported to display, such as
OSD, without the SurfaceFlinger by Android standards；Graph layer can be still output to by SurfaceFlinger
GPU, then be output in the hardware module of display, this method can largely improve video output and display efficiency, but by
Fail the calculating for passing through SurfaceFlinger together with graph layer in video layer, video layer can not be shown on screen and wanted
Position.
Below in conjunction with the attached drawing in the embodiment of the present invention, the technical solution in the embodiment of the present invention is carried out clear, complete
Site preparation describes.
Fig. 4 is a kind of flow diagram of information output display method provided in an embodiment of the present invention.As shown in figure 4, should
Method comprises the following steps：
Step 101, the mixing Overlapping display parameter for calculating video layer and image layer.Wherein, video layer and image layer difference
Be fill data after video layer and filling data after image layer.
Specifically, it can be aobvious by information output that step 101, which calculates video layer and the mixing Overlapping display parameter of image layer,
Showing device is realized；Video layer can be one or more, and image layer can also be one or more, when video layer is multiple
When, the content in final output to screen is the display format of picture-in-picture.
It should be noted that mixing Overlapping display parameter includes video layer, the display location parameter of image layer, and video
Layer, the visible area of image layer, the display parameters etc. of transparent region.
Step 102, filter out Part I image layer in video layer and image layer.
Specifically, the Part I image layer that step 102 filters out in video layer and image layer can be exported by information
Display device is realized；Step 102 to realize video layer and image layer superposition region in filter out filling data after
Video layer in advance can be handled video layer buffering area, and the method for processing can be the method for mark, can also pass through it
His method；And since video layer and image layer are superimposed, all image layers can not be separated with video layer, because
This, in screening process, a part of image layer is screened out in which can not avoid, this part of image layer is denoted as first
Partial image layers, will be denoted as Part II image layer except the image layer of Part I image layer, and in order to reduce nothing as far as possible
Method avoids the image layer for being screened out, and the quantity of Part I image layer is more few better.
Step 103, output video layer and Part I image layer are sequentially output Part II image layer to first processor
To second processor and first processor.Wherein, image layer includes Part I image layer and Part II image layer；At first
Device is managed as video and the mixing overlap-add procedure device of image, second processor is image blend overlap-add procedure device.
Specifically, step 103 output video layer and Part I image layer are sequentially output Part II to first processor
Image layer to second processor and first processor can be realized by information output display device；Regarded what is screened
Frequency layer and Part I image layer export the mixing overlap-add procedure device to video and image, and Part II image layer is first exported
To image blend overlap-add procedure device, advance superposition mixing is carried out to the image layer of Part II by mixing overlap-add procedure device,
The mixing overlap-add procedure device to video and image is exported again, is carried out with the video layer and Part I image layer exported before final
Mixing superposition.
It should be noted that first processor can be GPU, second processor can be OSD module.
Step 104, according to mixing Overlapping display parameter show by first processor processing video layer, Part I figure
As layer and Part II image layer.
Specifically, step 104 shows the video layer handled by first processor, first according to mixing Overlapping display parameter
Partial image layers and Part II image layer can be realized by information output display device.
The information output display method that the embodiment of the present invention is provided, can calculate the mixing superposition of video layer and image layer
Display parameters, filter out the Part I image layer in video layer and image layer, export video layer and Part I image layer extremely
First processor, is sequentially output Part II image layer to second processor and first processor, according to mixing Overlapping display ginseng
Digital display shows video layer, Part I image layer and the Part II image layer handled by first processor；In this way, realize
The graph layers different to video layer and position are screened difference, are sent to different processors and are carried out mixing superposition, further according to
Video layer and image layer are shown to the designated position of screen by the mixing Overlapping display parameter of calculating, so as to save bus bar
Width, improves frame per second during system plays video, realizes any output of video location, meanwhile, significantly reduce equipment
Power consumption, also improve user experience.
Fig. 5 is the flow diagram of another information output display method provided in an embodiment of the present invention.As shown in figure 5,
This method comprises the following steps：
Step 201, information output display device are at least one for the video Layer assignment of pending data by first interface
Video layer buffering area, passes through at least one image layer buffering area of image Layer assignment that second interface is pending data.
It should be noted that step 201 is at least one video layer buffering area of video Layer assignment of pending data, to treat
When handling at least one image layer buffering area of image layer of data, specific data are not filled also in video layer and image layer.
Explanation is also needed to, since subsequent step screens video layer, so as to need to carry out screen buffer
It is some to anticipate to ensure just be screened video layer according to the result after processing, therefore first interface will in design
It can support to anticipate screen buffer, and in the case where not handling image layer buffering area, second
Interface is exactly native interface.
Step 202, the video data of information output display device filling pending data are filled out into video layer buffering area
The view data of pending data is filled into image layer buffering area.
Specifically, if the video layer of pending data is one, the video data of pending data is filled to the video
In one or more video layer buffering areas of layer；If the video layer of pending data is multiple, filling pending data regards
Frequency is according in one or more video layer buffering areas to corresponding video layer.
Step 203, information output display device fill the video data of video layer buffering area into corresponding video layer, and
The view data of image layer buffering area is filled into corresponding image layer, after obtaining the video layer after filling data and filling data
Image layer.
It should be noted that in practical applications, information output display device can be incited somebody to action according to each frame content to be shown
Data in video layer buffering area are filled into corresponding video layer, and the data in image layer buffering area are filled into corresponding figure
As in layer.
Specifically, if the video layer of pending data is one, a video layer is selected to delay in video layer buffering area
Area is rushed, the data in the video layer buffering area are filled into the video layer；If the video layer of pending data is multiple,
A video layer buffering area is respectively selected in per class video layer buffering area, the data in these video layer buffering areas are filled into respectively
In corresponding video layer, wherein, a kind of video layer buffering area corresponds to a video layer, in a kind of video layer buffering area by one or
Multiple video layer buffer sets into.
Step 204, information output display device calculate the mixing Overlapping display parameter of video layer and image layer.Wherein, depending on
Frequency layer and image layer are to fill the video layer after data and the image layer after filling data respectively.
Step 205, information output display device filter out the Part I image layer in video layer and image layer.
Step 206, information output display device output video layer and Part I image layer are defeated successively to first processor
Go out Part II image layer to second processor and first processor.Wherein, image layer includes Part I image layer and second
Partial image layers；First processor is video and the mixing overlap-add procedure device of image, and second processor is at image blend superposition
Manage device.
Step 207, information output display device show what is handled by first processor according to mixing Overlapping display parameter
Video layer, Part I image layer and Part II image layer.
It should be noted that it is referred in the present embodiment with the explanation of same steps in other embodiments or concept other
Description in embodiment, details are not described herein again.
The information output display method that the embodiment of the present invention is provided, can be respectively pending data by distinct interface
Video layer and image Layer assignment video layer buffering area and image layer buffering area, fill video data and view data respectively to regarding
In frequency layer buffering area and image layer buffering area, the data refilled in the data in video layer buffering area and image layer buffering area arrive
In corresponding video layer and image layer, the mixing Overlapping display parameter of video layer and image layer is then calculated, filters out video layer
With the Part I image layer in image layer, video layer and Part I image layer are exported to first processor, are sequentially output the
Two partial image layers are shown by first processor to second processor and first processor according to mixing Overlapping display parameter
Video layer, Part I image layer and the Part II image layer of reason；In this way, realize different to video layer and position
Graph layer is screened difference, is sent to different processors and is carried out mixing superposition, further according to the mixing Overlapping display parameter of calculating
Video layer and image layer are shown to the designated position of screen, so that bus bandwidth is saved, when improving system plays video
Frame per second, realize any output of video location, meanwhile, significantly reduce the power consumption of equipment, also improve user experience.
Fig. 6 is the flow diagram of another information output display method provided in an embodiment of the present invention.As shown in fig. 6,
This method comprises the following steps：
Step 301, information output display device are at least one for the video Layer assignment of pending data by first interface
Video layer buffering area, passes through at least one image layer buffering area of image Layer assignment that second interface is pending data.
Step 302, information output display device are marked video layer buffering area by first interface.
Step 303, the video data of information output display device filling pending data are filled out into video layer buffering area
The view data of pending data is filled into image layer buffering area.
Step 304, information output display device fill the video data of video layer buffering area into corresponding video layer, and
The view data of image layer buffering area is filled into corresponding image layer, after obtaining the video layer after filling data and filling data
Image layer.
It should be noted that filling video layer buffering area video data into corresponding video layer, video layer buffering
The mark in area can be tagged in video layer therewith.
Step 305, information output display device calculate the mixing Overlapping display parameter of video layer and image layer.
Step 306, information output display device obtain the Z-order information of video layer and image layer superposition.
Step 307, information output display device go out video according to the mark and Z-order information siftings of video layer buffering area
Part I image layer in layer and image layer.
Specifically, step 304 filling video layer buffering area video data into corresponding video layer, video layer buffering
The mark in area can be tagged in video layer therewith, correspondingly, video layer will carry mark, that is to say, that in corresponding video layer
Middle filling be that video layer buffering area video data, video layer will carry the video layer buffering area for being used to filling
Mark, therefore, marks according to one or more, with regard to that can filter out the video layer after one or more fills data.
Step 308, information output display device output video layer and Part I image layer are defeated successively to first processor
Go out Part II image layer to second processor and first processor.Wherein, image layer includes Part I image layer and second
Partial image layers；First processor is video and the mixing overlap-add procedure device of image, and second processor is at image blend superposition
Manage device.
Step 309, information output display device show what is handled by first processor according to mixing Overlapping display parameter
Video layer, Part I image layer and Part II image layer.
The information output display method that the embodiment of the present invention is provided, can be respectively pending data by distinct interface
Video layer and image Layer assignment video layer buffering area and image layer buffering area and be marked for video layer buffering area, respectively
Video data and view data are filled into video layer buffering area and image layer buffering area, refills the number in video layer buffering area
, into corresponding video layer and image layer, the mixing of video layer and image layer is then calculated according to the data in image layer buffering area
Overlapping display parameter, first in video layer and image layer is gone out according to the mark and Z-order information siftings of video layer buffering area
Partial image layers, export video layer and Part I image layer to first processor, are sequentially output Part II image layer to the
Two processors and first processor, the video layer handled by first processor, first are shown according to mixing Overlapping display parameter
Partial image layers and Part II image layer；Screened in this way, realizing the graph layer different to video layer and position
Difference, send to different processors and carries out mixing superposition, further according to calculating mixing Overlapping display parameter by video layer and image
Layer is shown to the designated position of screen, so as to save bus bandwidth, improves frame per second during system plays video, realizes and regard
Any output of frequency position, meanwhile, significantly reduce the power consumption of equipment, also improve user experience.
Fig. 7 is the flow diagram of another information output display method provided in an embodiment of the present invention.As shown in fig. 7,
This method comprises the following steps：
Step 401, information output display device are at least one for the video Layer assignment of pending data by first interface
Video layer buffering area, passes through at least one image layer buffering area of image Layer assignment that second interface is pending data.
Step 402, information output display device are marked video layer buffering area by first interface.
Step 403, the video data of information output display device filling pending data are filled out into video layer buffering area
The view data of pending data is filled into image layer buffering area.
Step 404, information output display device fill the video data of video layer buffering area into corresponding video layer, and
The view data of image layer buffering area is filled into corresponding image layer, after obtaining the video layer after filling data and filling data
Image layer.
Step 405, information output display device calculate the mixing Overlapping display parameter of video layer and image layer.
Step 406, information output display device obtain the Z-order information of video layer and image layer superposition.
Step 407, information output display device go out video layer according to the label screening of video layer buffering area.
Step 408, information output display device are according to the mark and Z-order information of video layer buffering area, in video layer
Obtained with the Mixed Zone of image layer positioned at the number of the superiors' video layer draw above picture layer and positioned at orlop video layer
The number of following image layer.
Specifically, in the Mixed Zone of video layer and image layer, found according to the mark of video layer and Z-order information
The video layer of the superiors in video layer, acquisition is located at the video layer draw above picture layer number, according to the mark and Z- of video layer
Order information finds undermost video layer in video layer, obtains the image layer number below the video layer.
Step 409, information output display device compare the number of the image layer on the superiors' video layer and positioned at most
The size of the number of image layer under lower layer video layer.
Step 410, information output display device are by the number of the image layer on the superiors' video layer and positioned at most lower
The small image layer of number is as Part I image layer in the number of image layer under layer video layer.
Step 411, information output display device output video layer and Part I image layer are defeated successively to first processor
Go out Part II image layer to second processor and first processor.Wherein, image layer includes Part I image layer and second
Partial image layers；First processor is video and the mixing overlap-add procedure device of image, and second processor is at image blend superposition
Manage device.
Step 412, information output display device show what is handled by first processor according to mixing Overlapping display parameter
Video layer, Part I image layer and Part II image layer.
It should be noted that it is referred in the present embodiment with the explanation of same steps in other embodiments or concept other
Description in embodiment, details are not described herein again.
The information output display method that the embodiment of the present invention is provided, can be respectively pending data by distinct interface
Video layer and image Layer assignment video layer buffering area and image layer buffering area and be marked for video layer buffering area, respectively
Video data and view data are filled into video layer buffering area and image layer buffering area, refills the number in video layer buffering area
, into corresponding video layer and image layer, the mixing of video layer and image layer is then calculated according to the data in image layer buffering area
Overlapping display parameter, first in video layer and image layer is gone out according to the mark and Z-order information siftings of video layer buffering area
Partial image layers, export video layer and Part I image layer to first processor, are sequentially output Part II image layer to the
Two processors and first processor, the video layer handled by first processor, first are shown according to mixing Overlapping display parameter
Partial image layers and Part II image layer；Screened in this way, realizing the graph layer different to video layer and position
Difference, send to different processors and carries out mixing superposition, further according to calculating mixing Overlapping display parameter by video layer and image
Layer is shown to the designated position of screen, so as to save bus bandwidth, improves frame per second during system plays video, realizes and regard
Any output of frequency position, meanwhile, significantly reduce the power consumption of equipment, also improve user experience.
The embodiment of the present invention provides a kind of information output display device, and it is real which can be applied to the corresponding methods of Fig. 4
Shi Zhong, Fig. 8 are a kind of structure diagram of information output display device provided in an embodiment of the present invention, as shown in figure 8, the device
5 include：
Computing module 51, for calculating the mixing Overlapping display parameter of video layer and image layer；Wherein, video layer and image
Layer respectively be fill data after video layer and filling data after image layer.
Screening module 52, for filtering out the Part I image layer in video layer and image layer.
Output module 53, for exporting video layer and Part I image layer to first processor, is sequentially output second
Partial image layer is to second processor and first processor.Wherein, image layer includes Part I image layer and Part II image
Layer；First processor is video and the mixing overlap-add procedure device of image, and second processor is image blend overlap-add procedure device.
Display module 54, for show video layer by first processor processing, the according to mixing Overlapping display parameter
A part of image layer and Part II image layer.
The information output display device that the embodiment of the present invention is provided, can calculate the mixing superposition of video layer and image layer
Display parameters, filter out the Part I image layer in video layer and image layer, export video layer and Part I image layer extremely
First processor, is sequentially output Part II image layer to second processor and first processor, according to mixing Overlapping display ginseng
Digital display shows video layer, Part I image layer and the Part II image layer handled by first processor；In this way, realize
The graph layers different to video layer and position are screened difference, are sent to different processors and are carried out mixing superposition, further according to
Video layer and image layer are shown to the designated position of screen by the mixing Overlapping display parameter of calculating, so as to save bus bar
Width, improves frame per second during system plays video, realizes any output of video location, meanwhile, significantly reduce equipment
Power consumption, also improve user experience.
Further, Fig. 9 is the structure diagram of another information output display device provided in an embodiment of the present invention, is such as schemed
Shown in 9, which further includes：
Processing module 55, for being buffered by first interface at least one video layer of video Layer assignment of pending data
Area, by second interface be pending data at least one image layer buffering area of image Layer assignment, by first interface to regarding
Frequency layer buffering area is marked.
Module 56 is filled, for filling the video data of pending data into video layer buffering area, and is filled pending
The view data of data is into image layer buffering area；The video data of video layer buffering area is filled into corresponding video layer, and
The view data of image layer buffering area is filled into corresponding image layer, after obtaining the video layer after filling data and filling data
Image layer.
Further, Figure 10 is the structure diagram of another information output display device provided in an embodiment of the present invention, such as
Shown in Figure 10, which further includes：
Acquisition module 57, for obtaining the Z-order information of video layer and image layer superposition.
Processing module 55, is additionally operable to that video layer buffering area is marked by first interface.
Screening module 52, specifically for the mark according to video layer buffering area and Z-order information siftings go out video layer and
Part I image layer in image layer.
Further, Figure 11 is the structure diagram of another information output display device provided in an embodiment of the present invention, such as
Shown in Figure 11, the screening module 52 of the device 5 includes：
Screening unit 521, for going out video layer according to the label screening of video layer buffering area；
Acquiring unit 522, for the mark according to video layer buffering area and Z-order information, in video layer and image layer
Mixed Zone in obtain positioned at the superiors' video layer draw above picture layer number and the figure below orlop video layer
As the number of layer；
Comparing unit 523, for comparing the number for the image layer being located on the superiors' video layer and positioned at orlop video
The size of the number of image layer under layer；
Processing unit 524, for by the number of the image layer on the superiors' video layer and positioned at orlop video layer
Under image layer number in the small image layer of number as Part I image layer.
It should be noted that the interaction in the present embodiment between modules and unit, is referred to Fig. 4~7 pair
A kind of information output display method that the embodiment answered provides, details are not described herein again.
The information output display device that the embodiment of the present invention is provided, can be respectively pending data by distinct interface
Video layer and image Layer assignment video layer buffering area and image layer buffering area and be marked for video layer buffering area, respectively
Video data and view data are filled into video layer buffering area and image layer buffering area, refills the number in video layer buffering area
, into corresponding video layer and image layer, the mixing of video layer and image layer is then calculated according to the data in image layer buffering area
Overlapping display parameter, first in video layer and image layer is gone out according to the mark and Z-order information siftings of video layer buffering area
Partial image layers, export video layer and Part I image layer to first processor, are sequentially output Part II image layer to the
Two processors and first processor, the video layer handled by first processor, first are shown according to mixing Overlapping display parameter
Partial image layers and Part II image layer；Screened in this way, realizing the graph layer different to video layer and position
Difference, send to different processors and carries out mixing superposition, further according to calculating mixing Overlapping display parameter by video layer and image
Layer is shown to the designated position of screen, so as to save bus bandwidth, improves frame per second during system plays video, realizes and regard
Any output of frequency position, meanwhile, significantly reduce the power consumption of equipment, also improve user experience.
In practical applications, the computing module 51, screening module 52, screening unit 521, relatively acquiring unit 522, list
Member 523, processing unit 524, output module 53, display module 54, processing module 55, filling module 56 and acquisition module 57
By the CPU in information output display device, microprocessor (Micro Processor Unit, MPU), Digital Signal Processing
Device (Digital Signal Processor, DSP) or field programmable gate array (Field Programmable Gate
Array, FPGA) etc. realize.
Information output display method provided by the invention, applied to Android platform, specifically includes following steps：
Step 1: adding an interface in gralloc modules, it is gralloc_alloc_vpu to name this interface, by connecing
Mouth gralloc_alloc_vpu is video Layer assignment video layer buffering area, and creates a buffer_ for each screen buffer
The structure of handle_t；Native interface gralloc_alloc_buffer by Android system is image layer distribution diagram
As layer buffering area, and it is the structure of one buffer_handle_t of each image layer buffering area establishment.
Step 2: managing filling video data into corresponding video layer buffering area by Mediaserver, picture number is filled
According into corresponding image layer buffering area, while with a variable label video layer buffering area, in the present embodiment, by this variable
Usage is named as, is then stored in variable usage in the buffer_handle_t of corresponding video layer buffering area structure,
Finally the video layer buffering area after filling data and the image layer buffering area after filling data are output to together
SurfaceFlinger。
Step 3: SurfaceFlinger calculates the mixing superposition parameter and Z-order information of video layer and image layer,
Then the prepare interfaces of Hwcomposer are called.
Step 4: in prepare interfaces, according to the change in the buffer_handle_t of video layer buffering area structure
Usage, and the z-order information of video layer, image layer are measured, video layer is filtered out, by the structure of video layer
The set of compositionType member variables then counts position and is located at the superiors' video layer into HWC_OVERLAY (macrodefinition)
The number of draw above picture layer and the number of the image layer below orlop video layer, by the small figure layer segment of number
Also set is into HWC_OVERLAY (macrodefinition) for CompositionType member variables in structure, and by video layer and this portion
Partial image layer breaks into package；CompositionType member variables in the structure of remaining graph layer are then set to HWC_
FRAMEBUFFER (macrodefinition).
Step 5: calling the commit interfaces of Hwcomposer in SurfaceFlinger, the video of package will be broken into
Layer and image layer are output to OSD module, then call GPU to carry out mixing superposition to remaining image layer and are output to OSD module again.
Step 6: the buffer data of each layer are carried out mixing superposition by OSD module, display device is output to.
The information output display method that the embodiment of the present invention is provided, can be respectively pending data by distinct interface
Video layer and image Layer assignment video layer buffering area and image layer buffering area and be marked for video layer buffering area, respectively
Video data and view data are filled into video layer buffering area and image layer buffering area, refills the number in video layer buffering area
, into corresponding video layer and image layer, the mixing of video layer and image layer is then calculated according to the data in image layer buffering area
Overlapping display parameter, first in video layer and image layer is gone out according to the mark and Z-order information siftings of video layer buffering area
Partial image layers, export video layer and Part I image layer to first processor, are sequentially output Part II image layer to the
Two processors and first processor, the video layer handled by first processor, first are shown according to mixing Overlapping display parameter
Partial image layers and Part II image layer；Screened in this way, realizing the graph layer different to video layer and position
Difference, send to different processors and carries out mixing superposition, further according to calculating mixing Overlapping display parameter by video layer and image
Layer is shown to the designated position of screen, so as to save bus bandwidth, improves frame per second during system plays video, realizes and regard
Any output of frequency position, meanwhile, significantly reduce the power consumption of equipment, also improve user experience.
It should be understood by those skilled in the art that, the embodiment of the present invention can be provided as method, system or computer program
Product.Therefore, the shape of the embodiment in terms of the present invention can use hardware embodiment, software implementation or combination software and hardware
Formula.Moreover, the present invention can use the computer for wherein including computer usable program code in one or more to use storage
The form for the computer program product that medium is implemented on (including but not limited to magnetic disk storage and optical memory etc.).
The present invention be with reference to according to the method for the embodiment of the present invention, the flow of equipment (system) and computer program product
Figure and/or block diagram describe.It should be understood that it can be realized by computer program instructions every first-class in flowchart and/or the block diagram
The combination of flow and/or square frame in journey and/or square frame and flowchart and/or the block diagram.These computer programs can be provided
The processors of all-purpose computer, special purpose computer, Embedded Processor or other programmable data processing devices is instructed to produce
A raw machine so that the instruction performed by computer or the processor of other programmable data processing devices, which produces, to be used in fact
The device for the function of being specified in present one flow of flow chart or one square frame of multiple flows and/or block diagram or multiple square frames.
These computer program instructions, which may also be stored in, can guide computer or other programmable data processing devices with spy
Determine in the computer-readable memory that mode works so that the instruction being stored in the computer-readable memory, which produces, to be included referring to
Make the manufacture of device, the command device realize in one flow of flow chart or multiple flows and/or one square frame of block diagram or
The function of being specified in multiple square frames.
These computer program instructions can be also loaded into computer or other programmable data processing devices so that counted
Series of operation steps is performed on calculation machine or other programmable devices to produce computer implemented processing, thus in computer or
The instruction performed on other programmable devices is provided and is used for realization in one flow of flow chart or multiple flows and/or block diagram one
The step of function of being specified in a square frame or multiple square frames.
The foregoing is only a preferred embodiment of the present invention, is not intended to limit the scope of the present invention.
Claims (10)
- A kind of 1. information output display method, it is characterised in that the described method includes：Calculate the mixing Overlapping display parameter of video layer and image layer；Wherein, the video layer and described image layer are filled out respectively Make up the number the video layer after and the described image layer after filling data；Filter out the Part I image layer in the video layer and described image layer；The video layer and the Part I image layer are exported to first processor, is sequentially output Part II image layer to Two processors and the first processor；Wherein, described image layer includes the Part I image layer and the Part II Image layer；The first processor is video and the mixing overlap-add procedure device of image, and the second processor is folded for image blend Add processor；It is the video layer that is handled according to the mixing Overlapping display parameter display by the first processor, first described Partial image layer and the Part II image layer.
- 2. according to the method described in claim 1, it is characterized in that, the method further includes：It is institute by second interface by least one video layer buffering area of video Layer assignment that first interface is pending data State at least one image layer buffering area of image Layer assignment of pending data.
- 3. according to the method described in claim 2, it is characterized in that, the method further includes：The video data of the pending data is filled into the video layer buffering area, and fills the figure of the pending data As data are into described image layer buffering area；The video data of the video layer buffering area is filled into the corresponding video layer, and fills described image layer buffering area View data into corresponding described image layer, obtain filling data after the video layer and filling data after the figure As layer.
- 4. according to the method described in claim 3, it is characterized in that, the method further includes：The video layer buffering area is marked by the first interface；Obtain the Z-order information of video layer and image layer superposition；Correspondingly, the Part I image layer filtered out in video layer and image layer, including：Go out the in the video layer and image layer according to the mark of the video layer buffering area and the Z-order information siftings A part of image layer.
- 5. the according to the method described in claim 4, it is characterized in that, mark according to the video layer buffering area and described Z-order information siftings go out the Part I image layer in the video layer and image layer, including：The video layer is gone out according to the label screening of the video layer buffering area；According to the mark and Z-order information of the video layer buffering area, in the mixed zone of the video layer and described image layer Of the number positioned at the superiors' video layer draw above picture layer and the image layer below orlop video layer is obtained in domain Number；Compare the number of the image layer on the superiors' video layer and the image layer being located under orlop video layer Number size；By the number of the image layer on the superiors' video layer and the number of the image layer being located under orlop video layer The small image layer of middle number is as the Part I image layer.
- 6. a kind of information output display device, it is characterised in that described device includes：Computing module, for calculating the mixing Overlapping display parameter of video layer and image layer；Wherein, the video layer and the figure As layer respectively be fill data after the video layer and filling data after described image layer；Screening module, for filtering out the Part I image layer in the video layer and described image layer；Output module, for exporting the video layer and the Part I image layer to first processor, is sequentially output second Partial image layers are to second processor and the first processor；Wherein, described image layer includes the Part I image layer With the Part II image layer；The first processor is the mixing overlap-add procedure device of video and image, the second processing Device is image blend overlap-add procedure device；Display module, for the video handled according to the mixing Overlapping display parameter display by the first processor Layer, the Part I image layer and the Part II image layer.
- 7. device according to claim 6, it is characterised in that described device further includes：Processing module, for by least one video layer buffering area of video Layer assignment that first interface is pending data, leading to Cross at least one image layer buffering area of image Layer assignment that second interface is the pending data.
- 8. device according to claim 7, it is characterised in that described device further includes：Module is filled, for filling the video data of the pending data into the video layer buffering area, and described in filling The view data of pending data is into described image layer buffering area；The video data of the video layer buffering area is filled to corresponding to The video layer in, and the view data for filling described image layer buffering area is filled into corresponding described image layer The described image layer after the video layer and filling data after data.
- 9. device according to claim 8, it is characterised in that described device further includes：Acquisition module, for obtaining the Z-order information of video layer and image layer superposition；The processing module, is additionally operable to that the video layer buffering area is marked by the first interface；The screening module, goes out institute specifically for the mark according to the video layer buffering area and the Z-order information siftings State the Part I image layer in video layer and image layer.
- 10. device according to claim 9, it is characterised in that the screening module includes：Screening unit, for going out the video layer according to the label screening of the video layer buffering area；Acquiring unit, for the mark and Z-order information according to the video layer buffering area, in the video layer and the figure As layer Mixed Zone in obtain positioned at the superiors' video layer draw above picture layer number and below orlop video layer Image layer number；Comparing unit, for the relatively described image layer on the superiors' video layer number and described be located at orlop video The size of the number of image layer under layer；Processing unit, for by the number of the image layer on the superiors' video layer and it is described be located at orlop video layer under The small image layer of number is as the Part I image layer in the number of image layer.
Priority Applications (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201610977422.3A CN108024133A (en) | 2016-10-28 | 2016-10-28 | A kind of information output display method and device |
| PCT/CN2017/097710 WO2018076898A1 (en) | 2016-10-28 | 2017-08-16 | Information outputting and displaying method and device, and computer readable storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201610977422.3A CN108024133A (en) | 2016-10-28 | 2016-10-28 | A kind of information output display method and device |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN108024133A true CN108024133A (en) | 2018-05-11 |
Family
ID=62023087
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201610977422.3A Withdrawn CN108024133A (en) | 2016-10-28 | 2016-10-28 | A kind of information output display method and device |
Country Status (2)
| Country | Link |
|---|---|
| CN (1) | CN108024133A (en) |
| WO (1) | WO2018076898A1 (en) |
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111694442A (en) * | 2020-06-16 | 2020-09-22 | 深圳市创凯智能股份有限公司 | Method for reducing mouse delay of distributed KVM system |
| CN112839252A (en) * | 2019-11-25 | 2021-05-25 | 青岛海信电器股份有限公司 | Display device |
| CN113542623A (en) * | 2020-04-20 | 2021-10-22 | Oppo广东移动通信有限公司 | Image processing method and related device |
Families Citing this family (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110719517B (en) * | 2018-07-11 | 2021-08-13 | 视联动力信息技术股份有限公司 | Video stream display method and device |
| CN112367509B (en) * | 2020-11-10 | 2022-10-14 | 北京计算机技术及应用研究所 | Method for realizing domestic four-way super-definition image comprehensive display device |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101902596A (en) * | 2010-02-09 | 2010-12-01 | 深圳市同洲电子股份有限公司 | Image processing method, image processing device and digital television receiving terminal |
| CN102917272A (en) * | 2012-09-04 | 2013-02-06 | 苏州汉辰数字科技有限公司 | Method for cross nested display of application program |
| CN103259989A (en) * | 2012-02-17 | 2013-08-21 | 中兴通讯股份有限公司 | Screen content display method and screen content display device |
| US20130238995A1 (en) * | 2012-03-12 | 2013-09-12 | sCoolTV, Inc | Apparatus and method for adding content using a media player |
| CN103517029A (en) * | 2012-06-26 | 2014-01-15 | 华为技术有限公司 | Data processing method of video call, terminal and system |
Family Cites Families (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1968372A (en) * | 2005-11-17 | 2007-05-23 | 深圳Tcl新技术有限公司 | Background changing method for TV functional interface |
-
2016
- 2016-10-28 CN CN201610977422.3A patent/CN108024133A/en not_active Withdrawn
-
2017
- 2017-08-16 WO PCT/CN2017/097710 patent/WO2018076898A1/en active Application Filing
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101902596A (en) * | 2010-02-09 | 2010-12-01 | 深圳市同洲电子股份有限公司 | Image processing method, image processing device and digital television receiving terminal |
| CN103259989A (en) * | 2012-02-17 | 2013-08-21 | 中兴通讯股份有限公司 | Screen content display method and screen content display device |
| US20130238995A1 (en) * | 2012-03-12 | 2013-09-12 | sCoolTV, Inc | Apparatus and method for adding content using a media player |
| CN103517029A (en) * | 2012-06-26 | 2014-01-15 | 华为技术有限公司 | Data processing method of video call, terminal and system |
| CN102917272A (en) * | 2012-09-04 | 2013-02-06 | 苏州汉辰数字科技有限公司 | Method for cross nested display of application program |
Cited By (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112839252A (en) * | 2019-11-25 | 2021-05-25 | 青岛海信电器股份有限公司 | Display device |
| CN113542623A (en) * | 2020-04-20 | 2021-10-22 | Oppo广东移动通信有限公司 | Image processing method and related device |
| CN111694442A (en) * | 2020-06-16 | 2020-09-22 | 深圳市创凯智能股份有限公司 | Method for reducing mouse delay of distributed KVM system |
| CN111694442B (en) * | 2020-06-16 | 2023-10-20 | 深圳市创凯智能股份有限公司 | Method for reducing mouse delay of distributed KVM system |
Also Published As
| Publication number | Publication date |
|---|---|
| WO2018076898A1 (en) | 2018-05-03 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN108024133A (en) | A kind of information output display method and device | |
| CN105739934B (en) | Multi-screen splicing display processing method and equipment | |
| DE69735975T2 (en) | System and method for superimposing images optionally stored in different native formats | |
| CN104935840B (en) | The captions rolling display methods and system of a kind of mosaic display screen | |
| CN108665520A (en) | A kind of method and device that page animation renders | |
| CN102208171B (en) | Local detail playing method on portable high-definition video player | |
| CN103390397B (en) | Double screen display device and method based on Android system | |
| CN103618869B (en) | Many picture video joining methods and device | |
| CN102622979B (en) | LCD (Liquid Crystal Display) controller and display control method thereof | |
| CN108984137B (en) | Double-screen display method and system and computer readable storage medium | |
| CN103974007B (en) | The stacking method and device of screen menu type regulative mode information | |
| CN103686304B (en) | Method, device and terminal device for layer composition | |
| CN105979198A (en) | Video wall security system | |
| US8842129B2 (en) | Device and method for generating variable priority multiwindow images | |
| EP1759381A2 (en) | Display updates in a windowing system using a programmable graphics processing unit | |
| CN104361556A (en) | Image synthesis method, image chip and image equipment | |
| CN104995622B (en) | Synthesizer for graph function is supported | |
| CN104735297B (en) | A kind of broadcast quality monitor and monitoring picture generation method | |
| CN107105185A (en) | The transmission method and device of vision signal | |
| CN104349124A (en) | Structure and method for expanding multi-screen display on video recorder | |
| CN105741819B (en) | A kind of figure layer process method and device | |
| CN109862410A (en) | Recommendation information insertion method, device and storage medium | |
| CN103400565B (en) | A kind of interface piecemeal method for refreshing based on GDI | |
| CN109389558A (en) | A kind of method and device for eliminating image border sawtooth | |
| CN104754409A (en) | Multimedia video playing system applied to Android platform and multimedia video playing method applied to multimedia video playing system of Android platform |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| WW01 | Invention patent application withdrawn after publication | ||
| WW01 | Invention patent application withdrawn after publication |
Application publication date: 20180511 |