CN1964439A - Screen display mixing system and method - Google Patents

Screen display mixing system and method Download PDF

Info

Publication number
CN1964439A
CN1964439A CN 200510110140 CN200510110140A CN1964439A CN 1964439 A CN1964439 A CN 1964439A CN 200510110140 CN200510110140 CN 200510110140 CN 200510110140 A CN200510110140 A CN 200510110140A CN 1964439 A CN1964439 A CN 1964439A
Authority
CN
China
Prior art keywords
layer
window
data
video
screen display
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN 200510110140
Other languages
Chinese (zh)
Other versions
CN100556085C (en
Inventor
周振亚
袁焱
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
QIMA DIGITAL INFORMATION CO Ltd SHANGHAI
Shanghai Magima Digital Information Co Ltd
Original Assignee
QIMA DIGITAL INFORMATION CO Ltd SHANGHAI
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by QIMA DIGITAL INFORMATION CO Ltd SHANGHAI filed Critical QIMA DIGITAL INFORMATION CO Ltd SHANGHAI
Priority to CNB2005101101405A priority Critical patent/CN100556085C/en
Publication of CN1964439A publication Critical patent/CN1964439A/en
Application granted granted Critical
Publication of CN100556085C publication Critical patent/CN100556085C/en
Expired - Fee Related legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Landscapes

  • Controls And Circuits For Display Device (AREA)

Abstract

The mixed display screen system comprises: a coordinate scanning device to scan screen and generate current scanning pixel as coordinate flow; a first rectangular window device to decide the window contained current scanning pixel and select data to from a RGB domain temporary layer; a second rectangular window device to decide the video widow contained current pixel, a read buffer device to receive data from two rectangular windows, a conversion device to convert the temporary layer data from RGB domain into YUV domain; and an Alpha mixer to mix YUV domain data with video data.

Description

Screen display hybrid system and mixed method
Technical field
The present invention relates to the screen display hybrid system, relate in particular to the screen display hybrid system that video layer is mixed with multi-layer datas such as graph layers.
Background technology
Digital video broadcasting (Digital Video Broadcasting; DVB) be a kind of market-oriented digital service architecture, select the encoding compression mode of MPEG-2 in the DVB standard for use as audio frequency and video.The packing of after compression MPEG-2 code stream forms transport stream (TS), behind a plurality of transmission flow multiplexes, and can be via satellite, different media such as cable TV and OCTV transmit.
The MPEG2 code stream decoding become picture deliver to television signal encoder encode show before, need usually and OSD (on screen display on-screen display objects), cursor, background, graphic user interface (Graphic User Interface; GUI), captions etc. are pre-mixed, and form a pictures jointly, and then send into television signal encoder and show by field scanning rate.Defined hierarchical mode in the DVB standard, represented the different pieces of information layer with show levels.Fig. 1 is the hierarchical mode schematic diagram of display plane in the DVB technology.Referring to Fig. 1, show levels generally includes background layer 11, video layer 12, GUI layer 13, OSD14 layer, subtitle layer 15, cursor layer 16 etc.Background layer usually refers to color background.The video flowing that video layer is normally generated by Video Decoder can be input to hybrid system by the hardware coupling.The GUI layer usually comprises window, menu etc.Subtitle layer is meant the relevant information that the middle decoding of the elementary stream bag (PES) from transport stream is come out, as captions, palette content etc.OSD (on screen display) is generally used for hardware setting, adjusting information demonstration etc.Cursor layer is a hardware cursor, control cursor position etc.
Usually, background layer, GUI layer, OSD layer, subtitle layer, cursor layer etc. all are the pixel formats in RGB territory, and video layer is the pixel format in YUV territory, as the form of YUV4:2:2, so background layer, GUI layer, OSD layer, subtitle layer, cursor layer etc. all need to carry out earlier the conversion of RGB to yuv format in the mixed process.The major function that hybrid system realizes is that hierarchical mode is carried out RGB to the conversion of yuv format and mixed, and will export a picture that mixes at last to television signal coding system (TVencoder).Prior art generally is earlier each layers such as GUI layer, OSD layer, subtitle layer to be carried out the conversion of rgb format to yuv format respectively, and respectively itself and video layer is mixed.For example, earlier the GUI layer is carried out the conversion of rgb format to yuv format, and be mixed into the second layer with video layer; Then the OSD layer is carried out the conversion of rgb format to yuv format, again itself and front are mixed the second layer mixing that obtains and obtain the 3rd layer; Background layer is carried out the conversion of rgb format to yuv format, again itself and front are mixed the 3rd layer of mixing that obtains and obtain the 4th layer; Be that cursor layer is carried out the conversion of rgb format to yuv format at last, again itself and front mixed the layer mixing that obtains and obtain final layer.Carry out repeatedly the operation of rgb format, and through repeatedly mixing, the picture that finally mixes can be exported to the television signal coding system to the conversion of yuv format.All provide such modular converter for each layer RGB to the conversion of yuv format in the prior art, but RGB is bigger to the hardware area of the modular converter consumption of yuv format, certainly will cause the hardware area of whole system to reduce, correspondingly, cost also can't reduce.
Summary of the invention
The objective of the invention is to overcome the defective that exists in the prior art, a kind of improved screen display hybrid system is provided, it can reduce the hardware area of system, and reduces the whole cost of system.
According to an aspect of the present invention, provide a kind of screen display hybrid system, it comprises:
The screen coordinate scanning means, the scanning screen produces with the streamed current scanning element of coordinate scanning;
The first rectangular window device, judge that according to described coordinate scanning stream current scanning element is arranged in a window of a plurality of windows that comprise graphical window and cursor window, and the data that comprise graph layer and cursor layer are carried out the temporary layer in a RGB territory of selection formation of multiselect one;
The second rectangular window device judges that according to described coordinate scanning stream current scanning element is positioned at a video window;
Read buffer unit,, receive graph layer data of being transmitted and the video layer data of being transmitted from the reception of the second rectangular window device from the first rectangular window device respectively according to the window at current scanning element place;
Conversion equipment, carry out the format conversion of RGB territory to the YUV territory to the temporary layer data in described RGB territory:
The Alpha mixing arrangement carries out Alpha to the temporary layer data and the video layer data in YUV territory and mixes.
According to a further aspect in the invention, provide a kind of screen display mixed method, it comprises the steps:
Be provided with corresponding to the graphical window of graph layer data with corresponding to the cursor window of cursor layer data at the first rectangular window device corresponding to the viewing area of each layer data of screen display, at the video window of second rectangular window device setting, and be described each window definition the window's position coordinate corresponding to the video layer data;
The scanning screen, and the current scanning element that will obtain is delivered to the first rectangular window device and the second rectangular window device with the form of coordinate scanning stream;
The window's position coordinate of current scanning element and described each window is compared, to determine the window at current scanning element place;
According to the window at current scanning element place, described each layer data delivered to read buffer unit, wherein, graph layer data and cursor layer data form a temporary layer delivering to the selection of carrying out multiselect one before reading buffer unit earlier;
When judgement is read data in the buffer unit and is the temporary layer data, described temporary layer data are carried out the conversion of rgb format to yuv format;
Carry out the Alpha mixing to the video layer data with through the temporary layer data after the described format conversion at the YUV color gamut.
Description of drawings
The following drawings is the aid illustration to exemplary embodiment of the present, in conjunction with the following drawings to the elaboration of the embodiment of the invention, is to disclose feature of the present invention place for further, but does not limit the present invention.Identical reference number is represented corresponding element, parts or step among the figure, wherein:
Fig. 1 is the schematic diagram of the hierarchical mode of display plane in the expression DVB technology.
Fig. 2 is the schematic diagram of the simplification hierarchical mode of display plane in expression one embodiment of the invention.
Fig. 3 is system's engine structure schematic diagram of the screen display hybrid system of one embodiment of the invention.
Fig. 4 is the mode of operation schematic diagram of a screen coordinate scanning means in the system shown in Figure 3.
Fig. 5 is the structured flowchart of the screen display hybrid system of one embodiment of the invention.
Fig. 6 is the schematic diagram of the worker state machine of screen display hybrid system shown in Figure 5.
Fig. 7 is the structural representation of window judgment means in the screen display hybrid system of the present invention.
Fig. 8 is an internal structure and peripheral interactive signal schematic diagram of reading buffer unit in the screen display hybrid system of the present invention.
Fig. 9 is the flow chart of an embodiment of screen display mixed method of the present invention.
Figure 10 is the flow chart of another embodiment of screen display mixed method of the present invention.
Figure 11 is the hardware block diagram of the 2D module of one embodiment of the invention.
Figure 12 is a 2D module worker state machine schematic diagram shown in Figure 11.
Embodiment
In the MPEG-2 decoding, usually, GUI, OSD and captions etc. all are to be stored among the SDRAM with scattered form.Be to simplify the hierarchical mode in the DVB standard, can be pre-mixed before sending into screen display hybrid system (hereinafter to be referred as hybrid system), form a full frame graph layer, and deposit back among the SDRAM for scattered contents such as GUI layer, OSD layer and subtitle layer.In one embodiment of the invention, can carry out alpha in advance to the scattered content among the SDRAM such as GUI layer, OSD layer and subtitle layer by the 2D engine and mix full frame graph layer of formation.In a kind of preferred implementation, can allow graph layer to support the pixel format of some kinds of little bit wides, thereby reduce the demand of bandwidth to a certain extent.Through after being pre-mixed, mixed model originally just is simplified to 4 layers, as shown in Figure 2, is respectively background layer 11, graph layer 17, video layer 12 and cursor layer 16, thereby at first provides a simplified model for the design of simplifying hybrid system.
Fig. 3 is system's engine structure schematic diagram of the hybrid system of one embodiment of the invention.System's engine comprises screen coordinate scanning means 31, the first rectangular window device 33, the second rectangular window device 34, reads buffer unit 35, conversion equipment 36, and ALPHA mixing arrangement 37.The screen coordinate scanning means scans whole screen, and sends coordinate scanning stream and give the first rectangular window device and the second rectangular window device.The first rectangular window device and the second rectangular window device utilize windowing mechanism, judge according to coordinate scanning stream which window current scanning element is positioned at.Read buffer unit and read the current screen data according to the judged result of the first rectangular window device and the second rectangular window device.The data definition that the first rectangular window device is sent is a temporary layer.Conversion equipment carries out the format conversion of RGB to YUV to the temporary layer data.The ALPHA mixing arrangement carries out the ALPHA married operation to video pixel on the current coordinate and temporary layer pixel.
Fig. 4 is the mode of operation schematic diagram of screen coordinate scanning means.Whole screen can be defined as a screen coordinate system usually, and as shown in Figure 4, the upper left corner is defined as initial point (0,0), is to the right the positive axis of x axle, is downwards the positive axis of y axle.
" window " in the windowing mechanism is meant a zone in such screen coordinate system the inside.In one embodiment of the invention, this zone is the rectangular area, and it can come unique appointment by the position coordinates in the upper left corner and the position coordinates in the lower right corner.For example, corresponding to the viewing area of video layer, video window can be by two position coordinates (Xv 1, Yv 1) and (Xv 2, Yv 2) determine; Corresponding to the viewing area of background layer, backdrop window can be by two position coordinates (Xb 1, Yb 1) and (Xb 2, Yb 2) determine or the like.
The screen coordinate scanning means is according to the row-field scanning sequential of television signal encoder, begins scanning from the upper left corner of whole screen, finishes up to the lower right corner of screen.Scanning odd-numbered line in strange, scanning even number line in the idol field.The screen coordinate scanning means stably sends coordinate scanning stream according to the scanning sequence of video scanning screen the time.
Be provided with horizontal counter and vertical counter (not shown) in the screen coordinate scanning means.Horizontal counter along continuous straight runs is counted screen, and vertical counter is vertically counted screen.Here the screen scanning area with 640*480 is that example is illustrated.When hybrid system adopted frame pattern to count, the counting of horizontal counter from 0 to 639 added up 1 at every turn, and vertical counting from 0 to 479 adds up 1 at every turn.When hybrid system adopted field mode to count, whole screen was divided into very, two of idols, and at first counting is strange, again counting idol field.When counting strange, the counting of horizontal counter from 0 to 639 adds 1 at every turn, and vertical counting from 0 to 478 adds up 2 at every turn; During counting idol field, the counting of horizontal counter from 0 to 639 adds 1 at every turn, and vertical counting from 1 to 479 adds up 2 at every turn.Fig. 5 is the structured flowchart of the hybrid system of one embodiment of the invention.Control register 40 receives from the command signal of CPU (not shown) and the work of control system engine.The worker state machine of control register can comprise 4 kinds of states referring to Fig. 6: initial state 61, idle condition 63, operating state 65 and fault processing state 67.When hybrid system is started working, at first write control register by CPU, give start (beginning) register (not shown) assignment 1 wherein, hybrid system just enters into idle condition from initial state.Under idle condition, when hybrid system detects synchronizing signal VSYNC, the shadow register of then resetting (not shown), and enter operating state, system's engine begins to carry out hybrid working.Carry the data of the present frame that finishes when hybrid system after, receive that DMA finish is 1 signal, enter the fault processing state, in this state, will be all input FIFO and once empty operation, prevent previous frame because make mistakes and residual data, thereby isolated the influence each other of each frame, reached the purpose of error correction.5 all after dates of fault processing state automatically return to idle condition.
In conjunction with Fig. 5, according to one embodiment of present invention, the first rectangular window device can carry out the selection of multiselect 1 to background layer, GUI layer, OSD layer, subtitle layer, cursor layer etc., obtains the temporary layer in RGB territory.In one embodiment of the invention,, can before sending into hybrid system, be pre-mixed, form a full frame graph layer, and deposit back among the SDRAM for scattered contents such as GUI layer, OSD layer and subtitle layer according to the description of front.Therefore, the first rectangular window module can directly be carried out three to background layer, graph layer and cursor layer and selected one selection.The first rectangular window device 33 and the second rectangular window device 34 are respectively wherein each layer and are equipped with a window judgment means 70 (referring to Fig. 7).In other words, in the present embodiment, for the configurable graph layer window judgment means of graph layer, for the configurable cursor layer window judgment means of cursor layer.Before screen scanning, be provided with a window respectively corresponding to the viewing area of graph layer and each layer data of cursor layer, can be described as graphical window 331 and cursor window 332.Each window all contains above-mentioned window judgment means.Graphical window is by two position coordinates (Xg 1, Yg 1) and (Xg 2, Yg 2) determine; The cursor window is by two position coordinates (Xc 1, Yc 1) and (Xc 2, Yc 2) determine.Graphical window and cursor position of window coordinate input window judgment means when every two field picture begins.Fig. 7 is the structural representation of window judgment means.Each window judgment means is provided with the window's position coordinate register 701 and window comparison means 702 among Fig. 7.The window's position coordinate register can be deposited definition position of window coordinate, as two position coordinates (Xg of graphical window 1, Yg 1) and (Xg 2, Yg 2), two position coordinates (Xc of cursor window 1, Yc 1) and (Xc 2, Yc 2).
The second rectangular window device can judge that similar with the first rectangular window principle of device, video window 341 wherein contains video layer window judgment means 70 to the video layer data.Video window 341 can be by two position coordinates (Xv 1, Yv 1) and (Xv 2, Yv 2) determine.Video layer window judgment means 70 also is provided with the window's position coordinate register 701 and window comparison means 702.Position coordinates (the Xv of video window 1, Yv 1) and (Xv 2, Yv 2) the window's position coordinate register of input window judgment means when every two field picture begins.
The coordinate scanning stream that the screen coordinate scanning means is sent is concurrently by video layer window judgment means, graph layer window judgment means, cursor layer window judgment means.Window comparison means in each window judgment means compares respectively coordinate scanning stream and each position of window coordinate.For example, video layer window judgment means is with coordinate scanning stream and video layer position of window coordinate (Xv 1, Yv 1) and (Xv 2, Yv 2) compare, judge whether current scanning element is positioned within the video window.If (X Y), satisfies this and falls into condition current scanning element, falls into two position coordinates (Xv 1, Yv 1) and (Xv 2, Yv 2) between, promptly
Xv 1≤X≤Xv 2;Yv 1≤Y≤Yv 2
Then current scanning element falls within this window.
The second rectangular window device is provided with video FIFO 342, can receive the video data from Video Decoder.Judge current scanning element when video layer window judgment means and fall within the video window, video layer window judgment means produces video window useful signal xy_in_video, and this signal is sent into read buffer unit.Correspondingly, read buffer unit and from video FIFO, load video pixel.
The first rectangular window device is provided with graphics fifo 334 and D graphics MA 333.D graphics MA can carry graph data from external memory storage, and leaves in the graphics fifo.External memory storage can be SDRAM etc.Judge current scanning element when graph layer window judgment means and fall within the graphical window, graph layer window judgment means produces graphical window useful signal xy_in_graphic, and this signal is sent into read buffer unit.Correspondingly, read buffer unit and from graphics fifo, load pattern pixel.
It is built-in that cursor data and background data are system's engine of hybrid system.For example, in one embodiment of the invention, read to comprise in the buffer unit low capacity SRAM that can deposit cursor data and the register of depositing background data, cursor data and background data leave in to be read in the buffer unit.The value of background data can suitably be adjusted the color that changes background in the register.Judge current scanning element when cursor layer window judgment means and fall within the cursor window, cursor layer window judgment means produces cursor window useful signal xy_in_cursor, and this signal is sent into read buffer unit.Correspondingly, read buffer unit and from system's engine internal module, load cursor data.If current selection background layer input is then read buffer unit and load background data from system's engine internal module.
In the system definition of one embodiment of the invention, when all occurring, data do not fill with background.Background layer does not dispose special window judgment means, only when the equal free of data of figure, cursor and video window is imported, thinks that current scanning element falls into backdrop window, and selects the background layer input.
In other embodiments of the invention, the first rectangular window device can carry out the selection of alternative to graph layer and cursor layer.Background layer then is placed in the second rectangular window device and handles.Video layer window judgment means in the second rectangular window device is judged current coordinate scanning element and is not dropped on the video layer window, just thinks that current scanning element falls into backdrop window, and selects the background layer input.
Fig. 8 is internal structure and a peripheral interactive signal schematic diagram of reading buffer unit.Read buffer unit 35 and have input register 351 and output register 353, and be provided with protocol analysis device 355 and coordinate reading and sending of data in input registers and the output register.Input register can temporarily be deposited the signal that receives from the first rectangular window device of front and the second rectangular window device, as video window useful signal xy_in_video, cursor window useful signal xy_in_cursor etc.For graphics fifo and video FIFO, when the current data of output that need among the FIFO have been placed on the FIFO port, wait for when subordinate's module reads that the figure waiting signal G_fifo_lasting of graphics fifo is high, perhaps the video waiting signal V_fifo_lasting of video FIFO is high.If the protocol analysis device receives graphical window useful signal xy_in_graphi c and effective figure readable signal G_fifo_lasting simultaneously, can send one to figure readable signal G_fifo_reading that should graphics fifo, and take the data on the graphics fifo port away.When if the protocol analysis device receives video window useful signal xy_in_video and video waiting signal V_fifo_lasting simultaneously, can send one to figure readable signal V_fifo_reading that should graphics fifo, and take the data on the video FIFO port away.
Reading buffer unit is connected with the ALPHA mixing arrangement with conversion equipment simultaneously.Conversion equipment can be the data transaction of rgb format to yuv format.In one embodiment of the invention, when the data in reading buffer unit were temporary layer, promptly when background layer, graph layer and cursor layer, these data were sent into conversion equipment earlier, are transformed into yuv format from rgb format, send into the ALPHA mixing arrangement again.When the data in reading buffer unit were video layer, these data were directly sent into the ALPHA mixing arrangement.
The ALPHA mixing arrangement carries out the ALPHA married operation to video pixel on the current coordinate and temporary layer pixel.Usually can take following formula to calculate:
dst=A*src1+(1-A)*src2
=A*(src1-src2)+src2
Src1 and src2 represent the layer that participates in mixing respectively in the formula, suppose src1 on src2, and wherein A is the ALPHA value, expression " opacity ", and span is 0~1, value is 0 o'clock, represents transparent fully; Value is 1 o'clock, represents opaque fully.
The ALPHA mixing arrangement can comprise ALPHA value adjuster (not shown), is used for adjusting the ALPHA value.For example, for certain picture element, src1 is a graph layer, and src2 is a video layer, and when the video layer data were above graph layer, the ALPHA value adjuster was made as 0 to the ALPHA value, and then this picture element is mixing the complete cover graphics layer of rear video layer.
Fig. 9 is the screen display mixed method flow chart of one embodiment of the invention, and by shown in Figure 9, mixed method of the present invention may further comprise the steps:
Step S1. is provided with a plurality of windows, and is each window definition the window's position coordinate.Comprise video window, graphical window and cursor window in a plurality of windows.
Step S2. scans screen, and send coordinate scanning to flow to the first and second rectangular window devices.In the present embodiment, the screen coordinate scanning means scans screen, and the form that the current scanning element that obtains is flowed with coordinate scanning is sent to the first rectangular window device and the second rectangular window device.
The window's position coordinate of each window compares in the current scanning element of step S3. and the above-mentioned first rectangular window device and the second rectangular window device, to determine the window at current scanning element place.In the present embodiment, the first rectangular window device and the second rectangular window device compare the window's position coordinate of each window in current scanning element and the module respectively, to determine the window at current scanning element place, wherein the first rectangular window device carries out the selection of multiselect one to data such as figure, cursor, backgrounds, form one deck temporary layer, the second rectangular window device compares current scanning element and video window, to determine whether current scanning element is positioned at video window.
Step S4. transmits data to and reads buffer unit according to current scanning element place window.In the present embodiment, if current scanning element at graphical window, the first rectangular window device from graphics fifo transmitting graphics data to reading buffer unit; If current scanning element is at video window, the second rectangular window device from video FIFO transmitting video data to reading buffer unit; If current scanning element at the cursor window, just directly reads cursor data to reading buffer unit from system's engine,, then from system's engine, read background data to reading buffer unit if current scanning element does not drop on defined coordinate window.
Step S5. judges whether the data of reading in the buffer unit are temporary layer.In the present embodiment, when judgement is read data in the buffer unit and is temporary layer, promptly when background, figure or cursor data,, these data are sent into conversion equipment earlier, be transformed into yuv format, send into the ALPHA mixing arrangement again from rgb format at step S6; Read data in the buffer unit when the temporary layer when judgement, when promptly being defaulted as video layer, these data are directly sent into the ALPHA mixing arrangement.
Step S6.ALPHA mixes.In the present embodiment, the temporary layer data in YUV territory and video layer data being carried out ALPHA mixes.
In some embodiments of the invention, can before sending into hybrid system, be pre-mixed, form a full frame graph layer, and deposit back among the SDRAM for scattered contents such as GUI layer, OSD layer and subtitle layer.
Among the step S2, the screen coordinate scanning means stably sends coordinate scanning stream according to the parity field sequential of video, and this coordinate stream scanning is handled by each rectangular window device concurrently, is to be positioned within which window thereby judge current scanning element.
Background data elder generation among the step S4 in system's engine, is read from system's engine and reads buffer unit at rgb format by software setting.
Among the step S6 background layer, graph layer and cursor layer on hardware paths a shared RGB color gamut to the transform engine of YUV color gamut.
Figure 10 is the screen display mixed method flow chart of another embodiment of the present invention, be with difference embodiment illustrated in fig. 9, background layer wherein is not as temporary layer, but in system's engine, directly be set to yuv format by software, do not need to carry out the conversion of RGB to YUV, just can from system's engine, read buffer unit, participate in the ALPHA married operation directly.By shown in Figure 10, among the step S3 ' of the mixed method of this embodiment wherein the first rectangular window device only data such as figure, cursor are carried out the selection of multiselect one, form one deck temporary layer.
As another kind of conversion, aforesaid OSD layer, GUI layer and subtitle layer can not done premixed yet and are directly delivered to and handle in the screen display hybrid system, in the case, described graphical window can comprise each windows such as OSD window, GUI window and caption window.
As previously mentioned, in one embodiment of the invention, can carry out alpha in advance to the scattered content among the SDRAM such as GUI layer, OSD layer and subtitle layer by the 2D engine and mix full frame graph layer of formation.Below be the embodiment that utilizes a 2D module to carry out a graph layer of described premixed formation of the present invention, certainly, described premixed also can adopt the module of other conventionally form to finish.
Figure 11 is the hardware block diagram of the 2D module of one embodiment of the invention.The 2D module utilizes data DMA111 to take out data from SDRAM, and data are sent into the source buffer.The 2D module is provided with the first source buffer 113 and the second source buffer 114 among the figure, like this, when data DMA fetches data from SDRAM, can once get two layer data and send into the first source buffer and the second source buffer respectively.Data in the first source buffer and the second source buffer enter subsequently in the 2Dalpha mixed cell 116 and are pre-mixed.In an embodiment of the present invention, between the first source buffer and the second source buffer and the 2Dalpha mixed cell format conversion unit 115 can be set, to support the data Layer of various pixel formats.Can allow graph layer to support the pixel format of multiple little storage bit wide like this, thereby reduce the demand of bandwidth to a certain extent.According to one embodiment of present invention, as shown in figure 11, format conversion unit 115 comprises format converter 1151 and 1153, can be as RGB565, ARGB3454, ARGB4444, pixel formats such as ARGB32 convert for example ARGB32 pixel format in interior multiple uniform format.Like this, the 2Dalpha mixed cell can for example be pre-mixed under this a kind of form of ARGB32.Among the embodiment shown in Figure 4, palette 1152 and format converter 1151 parallel being arranged between the first source buffer and the 2Dalpha mixed cell, similarly, palette can carry out the pixel format conversion of some form kinds between the first source buffer and the second source buffer and 2Dalpha mixed cell, for example 8 ARGB32 index, 8 AYUV32 index etc. are converted to the ARGB32 form.Be understandable that, and the format conversion unit between the 2Dalpha mixed cell format converter and palette in present embodiment, listed, can also dispose other device and carry out the conversion of various pixel formats.
The 2Dalpha mixed cell carries out the ALPHA married operation to the pixel through format conversion in the first source buffer and the second source buffer.Usually can take following formula to calculate:
dst=A*src1+(1-A)*src2
=A*(src1-src2)+src2
Src1 and src2 represent the layer that participates in mixing respectively in the formula, are through the pixel layer of format conversion in the first source buffer and the second source buffer at this.Suppose src1 on src2, wherein A is the alpha value, expression " opacity ", and span is 0~1, value is 0 o'clock, represents transparent fully; Value is 1 o'clock, represents opaque fully.
The 2Dalpha mixed cell can comprise the 2Dalpha value and adjust logic, is used for adjusting the ALPHA value.For example, for certain picture element, src1 is the GUI layer, and src2 is the OSD layer, and when the OSD layer data was above the GUI layer, the 2Dalpha value was adjusted logic the ALPHA value is made as 0, and then this picture element OSD layer after mixing covers the GUI layer fully.
The 2Dalpha mixed cell is delivered to the data that mix among the 2D output FIFO117.2D output FIFO117 returns FIFO112 with 2D and is connected, and the data that 2D returns among the FIFO send back among the SDRAM via data DMA.When utilizing the 2D module to carry out multilayer, mix by needs, for example during the mixing more than three layers or three layers, the data of 2D output FIFO can be returned FIFO through 2D and send and be added among the SDRAM, again sent in the 2D module with other layer among the SDRAM by data DMA and mix, recycling can support the 2D module of two layers of ALPHA mixing just can realize the mixing of multilayer like this.
Come the work of control system engine in the 2D module by configuration register 20.Configuration register receives the control command from CPU, realizes control to 2D module work engine by interrupting communication mechanism.The worker state machine of configuration register as shown in figure 12.It comprises 4 kinds of states: beginning 21, free time 23, work 25 and interrupt service routine 27 states.Under the initial state, send initiation command by CPU and give configuration register, and configure other all 2D register.Subsequently, the 2D module enters idle condition.Under the idle condition, if configuration register receive that CPU sends the engine_start register is put 1 signal, configuration register will enter system's engine that operating state starts the 2D module and start working.The 2D module down, if receive the interruptive command that CPU sends, will enter interrupt service routine (ISR) state and wait in working order.Under the interrupt service routine (ISR), put 1 signal, then return operating state again and work on if configuration register receives the engine_start register; If receive the engine_start register and be 0 signal, then get back to idle condition.The foregoing description is just in order further more clearly to describe the present invention, but not limitation of the present invention.Be to be understood that the present invention is not limited to the elaboration that above embodiment does, anyly all should be encompassed within the spirit and scope of claim of the present invention based on modification of the present invention and equivalent of the present invention.

Claims (10)

1. screen display hybrid system comprises:
The screen coordinate scanning means, the scanning screen produces with the streamed current scanning element of coordinate scanning;
The first rectangular window device, judge that according to described coordinate scanning stream current scanning element is arranged in a window of a plurality of windows that comprise graphical window and cursor window, and the data that comprise graph layer and cursor layer are carried out the temporary layer in a RGB territory of selection formation of multiselect one;
The second rectangular window device judges that according to described coordinate scanning stream current scanning element is positioned at a video window;
Read buffer unit,, receive graph layer data of being transmitted and the video layer data of being transmitted from the reception of the second rectangular window device from the first rectangular window device respectively according to the window at current scanning element place;
Conversion equipment carries out the format conversion of RGB territory to the YUV territory to the temporary layer data in described RGB territory;
The Alpha mixing arrangement carries out Alpha to the temporary layer data and the video layer data in YUV territory and mixes.
2. screen display hybrid system as claimed in claim 1 is characterized in that, the temporary layer in described RGB territory is to comprising graph layer, and cursor layer and background layer carry out the temporary layer in the RGB territory that the selection of multiselect one forms in interior data.
3. screen display hybrid system as claimed in claim 1 or 2, it is characterized in that, described window contains the window judgment means, this window judgment means comprises in order to depositing the window's position coordinate register of the window's position coordinate, and the window comparison means in order to described coordinate scanning stream and described the window's position coordinate are compared.
4. screen display hybrid system as claimed in claim 1 or 2 is characterized in that, describedly reads that buffer unit comprises input register, output register and in order to coordinate the protocol analysis device that reads and send of data in input register and the output register.
5. screen display hybrid system as claimed in claim 1 or 2 is characterized in that described graph layer comprises GUI layer, OSD layer and subtitle layer, and described graphical window comprises GUI window, OSD window and caption window.
6. screen display hybrid system as claimed in claim 1 or 2 is characterized in that, described graph layer is by the 2D engine the scattered content that comprises GUI layer, OSD layer and subtitle layer to be carried out alpha in advance to mix a full frame graph layer that forms.
7. a screen display mixed method comprises the steps:
Be provided with corresponding to the graphical window of graph layer data with corresponding to the cursor window of cursor layer data at the first rectangular window device corresponding to the viewing area of each layer data of screen display, at the video window of second rectangular window device setting, and be described each window definition the window's position coordinate corresponding to the video layer data;
The scanning screen, and the current scanning element that will obtain is delivered to the first rectangular window device and the second rectangular window device with the form of coordinate scanning stream;
The window's position coordinate of current scanning element and described each window is compared, to determine the window at current scanning element place;
According to the window at current scanning element place, described each layer data delivered to read buffer unit, wherein, graph layer data and cursor layer data are being delivered to the selection of carrying out multiselect one before reading buffer unit earlier, form the temporary layer in a RGB territory;
When judgement is read data in the buffer unit and is the temporary layer data, described temporary layer data are carried out the format conversion of RGB territory to the YUV territory;
Carry out the Alpha mixing in the YUV territory to the video layer data with through the temporary layer data after the described format conversion.
8. screen display mixed method as claimed in claim 7 is characterized in that, described graph layer data and cursor layer data form described temporary layer delivering to the selection of also carrying out multiselect one before reading buffer unit with the background layer data earlier.
9. as claim 7 or 8 described screen display mixed methods, it is characterized in that described graph layer comprises GUI layer, OSD layer and subtitle layer, described graphical window comprises GUI window, OSD window and caption window.
10. as claim 7 or 8 described screen display mixed methods, it is characterized in that described graph layer is by the 2D engine the scattered content that comprises GUI layer, OSD layer and subtitle layer to be carried out alpha in advance to mix a full frame graph layer that forms.
CNB2005101101405A 2005-11-09 2005-11-09 Screen display hybrid system and mixed method Expired - Fee Related CN100556085C (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CNB2005101101405A CN100556085C (en) 2005-11-09 2005-11-09 Screen display hybrid system and mixed method

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CNB2005101101405A CN100556085C (en) 2005-11-09 2005-11-09 Screen display hybrid system and mixed method

Publications (2)

Publication Number Publication Date
CN1964439A true CN1964439A (en) 2007-05-16
CN100556085C CN100556085C (en) 2009-10-28

Family

ID=38083291

Family Applications (1)

Application Number Title Priority Date Filing Date
CNB2005101101405A Expired - Fee Related CN100556085C (en) 2005-11-09 2005-11-09 Screen display hybrid system and mixed method

Country Status (1)

Country Link
CN (1) CN100556085C (en)

Cited By (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102024444A (en) * 2009-09-10 2011-04-20 扬智科技股份有限公司 Method of raster-scan search for multi-region on-screen display and system using the same
CN102598686A (en) * 2010-08-06 2012-07-18 松下电器产业株式会社 Reproduction Device, Integrated Circuit, Reproduction Method, And Program
CN101902596B (en) * 2010-02-09 2012-08-22 深圳市同洲电子股份有限公司 Image processing method, image processing device and digital television receiving terminal
CN103002337A (en) * 2012-12-14 2013-03-27 四川九洲电器集团有限责任公司 Method for controlling set-top box image display
CN103974006A (en) * 2013-01-29 2014-08-06 北京哲朗科技有限公司 High-performance OSD design
CN105072487A (en) * 2015-08-11 2015-11-18 珠海全志科技股份有限公司 Video data processing method and device thereof
CN105528182A (en) * 2015-12-11 2016-04-27 中国航空工业集团公司西安航空计算技术研究所 Control circuit for accessing SDRAM (synchronous dynamic random-access memory) by sporadic data and method
CN105704553A (en) * 2014-11-24 2016-06-22 乐视致新电子科技(天津)有限公司 Method for adjusting volume of boot-up advisement of smart television and player
WO2016184066A1 (en) * 2015-05-20 2016-11-24 深圳市中兴微电子技术有限公司 Multi-media information outputting method, device and storage medium
CN107168715A (en) * 2017-05-25 2017-09-15 深圳市视维科技股份有限公司 A kind of intelligent terminal menu subject GUI engine implementation method

Cited By (14)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102024444B (en) * 2009-09-10 2013-01-16 扬智科技股份有限公司 Method of raster-scan search for multi-region on-screen display and system using the same
CN102024444A (en) * 2009-09-10 2011-04-20 扬智科技股份有限公司 Method of raster-scan search for multi-region on-screen display and system using the same
CN101902596B (en) * 2010-02-09 2012-08-22 深圳市同洲电子股份有限公司 Image processing method, image processing device and digital television receiving terminal
CN102598686B (en) * 2010-08-06 2016-08-17 松下知识产权经营株式会社 Transcriber, integrated circuit, reproducting method
CN102598686A (en) * 2010-08-06 2012-07-18 松下电器产业株式会社 Reproduction Device, Integrated Circuit, Reproduction Method, And Program
CN103002337A (en) * 2012-12-14 2013-03-27 四川九洲电器集团有限责任公司 Method for controlling set-top box image display
CN103002337B (en) * 2012-12-14 2016-09-14 四川九洲电器集团有限责任公司 The control method that Set Top Box figure shows
CN103974006A (en) * 2013-01-29 2014-08-06 北京哲朗科技有限公司 High-performance OSD design
CN105704553A (en) * 2014-11-24 2016-06-22 乐视致新电子科技(天津)有限公司 Method for adjusting volume of boot-up advisement of smart television and player
WO2016184066A1 (en) * 2015-05-20 2016-11-24 深圳市中兴微电子技术有限公司 Multi-media information outputting method, device and storage medium
CN106303285A (en) * 2015-05-20 2017-01-04 深圳市中兴微电子技术有限公司 The output intent of a kind of multimedia messages and device
CN105072487A (en) * 2015-08-11 2015-11-18 珠海全志科技股份有限公司 Video data processing method and device thereof
CN105528182A (en) * 2015-12-11 2016-04-27 中国航空工业集团公司西安航空计算技术研究所 Control circuit for accessing SDRAM (synchronous dynamic random-access memory) by sporadic data and method
CN107168715A (en) * 2017-05-25 2017-09-15 深圳市视维科技股份有限公司 A kind of intelligent terminal menu subject GUI engine implementation method

Also Published As

Publication number Publication date
CN100556085C (en) 2009-10-28

Similar Documents

Publication Publication Date Title
CN100556085C (en) Screen display hybrid system and mixed method
CN100414981C (en) A control system for screen display
US8184127B2 (en) Apparatus for and method of generating graphic data, and information recording medium
US6493008B1 (en) Multi-screen display system and method
TWI538495B (en) Combining video data streams of differing dimensionality for concurrent display
CN101043600B (en) Playback apparatus and playback method using the playback apparatus
KR101796603B1 (en) Mechanism for memory reduction in picture-in-picture video generation
CN103974007B (en) The stacking method and device of screen menu type regulative mode information
CN101742167B (en) Video processing circuit and related method for merging video output streams with graphical stream for transmission
US7554563B2 (en) Video display control apparatus and video display control method
US20070146547A1 (en) Image processing apparatus and method
CN102957875A (en) Image processing method, device and system
CN100556096C (en) Method and device thereof that a kind of television function interface transparent shows
CN103167257A (en) Display device, display method, transmitting device and transmitting method
CN100542234C (en) Display device and control method thereof
CN101448108A (en) Image processing apparatus and related method
CN103813124A (en) Image processing device and image processing method
CN110928513A (en) Super-resolution synthesis command application system
CN101986384A (en) Method for processing display of multi-layer picture in picture for DLP multi-screen splicing display wall
TWI222831B (en) Video playback system to generate both progressive and interlace video signals
US7227584B2 (en) Video signal processing system
TWI246326B (en) Image processing circuit of digital TV
US7554605B2 (en) Method for progressive and interlace TV signal simultaneous output
TWI313563B (en) A display mixer and the method thereof
US7663646B2 (en) Device, system and method for realizing on screen display

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
C14 Grant of patent or utility model
GR01 Patent grant
C17 Cessation of patent right
CF01 Termination of patent right due to non-payment of annual fee

Granted publication date: 20091028

Termination date: 20121109