CN104349200B - Television control apparatus and correlation technique - Google Patents

Television control apparatus and correlation technique Download PDF

Info

Publication number
CN104349200B
CN104349200B CN201310347850.4A CN201310347850A CN104349200B CN 104349200 B CN104349200 B CN 104349200B CN 201310347850 A CN201310347850 A CN 201310347850A CN 104349200 B CN104349200 B CN 104349200B
Authority
CN
China
Prior art keywords
frame
sub
image
picture
vision signal
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Expired - Fee Related
Application number
CN201310347850.4A
Other languages
Chinese (zh)
Other versions
CN104349200A (en
Inventor
黄宏吉
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
MediaTek Inc
Original Assignee
MStar Semiconductor Inc Taiwan
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by MStar Semiconductor Inc Taiwan filed Critical MStar Semiconductor Inc Taiwan
Priority to CN201310347850.4A priority Critical patent/CN104349200B/en
Publication of CN104349200A publication Critical patent/CN104349200A/en
Application granted granted Critical
Publication of CN104349200B publication Critical patent/CN104349200B/en
Expired - Fee Related legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/431Generation of visual interfaces for content selection or interaction; Content or additional data rendering
    • H04N21/4312Generation of visual interfaces for content selection or interaction; Content or additional data rendering involving specific graphical features, e.g. screen layout, special fonts or colors, blinking icons, highlights or animations
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/44Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream, rendering scenes according to MPEG-4 scene graphs
    • H04N21/4402Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream, rendering scenes according to MPEG-4 scene graphs involving reformatting operations of video signals for household redistribution, storage or real-time display
    • H04N21/440263Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream, rendering scenes according to MPEG-4 scene graphs involving reformatting operations of video signals for household redistribution, storage or real-time display by altering the spatial resolution, e.g. for displaying on a connected PDA
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/44Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream, rendering scenes according to MPEG-4 scene graphs
    • H04N21/4402Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream, rendering scenes according to MPEG-4 scene graphs involving reformatting operations of video signals for household redistribution, storage or real-time display
    • H04N21/440263Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream, rendering scenes according to MPEG-4 scene graphs involving reformatting operations of video signals for household redistribution, storage or real-time display by altering the spatial resolution, e.g. for displaying on a connected PDA
    • H04N21/440272Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream, rendering scenes according to MPEG-4 scene graphs involving reformatting operations of video signals for household redistribution, storage or real-time display by altering the spatial resolution, e.g. for displaying on a connected PDA for performing aspect ratio conversion
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/47End-user applications
    • H04N21/472End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content
    • H04N21/47205End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content for manipulating displayed content, e.g. interacting with MPEG-4 objects, editing locally

Abstract

A kind of television control apparatus and correlation technique, apply to a television system.Television control apparatus includes a signal source module and a synthesis module.Signal source module can be respectively by obtaining one first frame and one second frame in one first vision signal and one second vision signal.Synthesis module can capture a part from the first frame and be used as a sub-image, and sub-image is shown in a subregion of picture when the second frame is shown in the picture of television system.Wherein, sub-image is less than the first frame.

Description

Television control apparatus and correlation technique
Technical field
The invention relates to a kind of television control apparatus and correlation technique, and can be in main display in particular to one kind The subregion in region shows the television control apparatus and correlation technique of the part image of another information source.
Background technology
It can show that static and/or dynamic menu television system turns into most important electronic product in advanced information society One of;It is furthermore video conferencing system, safe monitoring system, integrated(all-in-one)Computer, projection display system, record The multimedia player and various wearable, hand-helds, portable product of camera, CD/hard disk/Nonvolatile memory, example Such as mobile phone, guiding aircraft, digital camera/video camera, also can all be considered as television system.
Television system possesses screen, with the display picture in the viewing area of screen, plays vision signal.Due in video The diversification of appearance, user, which can wish efficiently to integrate the vision signal of multiple different aforementioned sources, is shown in same viewing area Domain.Existing PIP in existing display control technology(PIP, Picture In Picture)Function;Using primary and secondary The technology of picture plays two vision signals simultaneously when, the frame of the second vision signal forms background full of viewing area(Mother draws Face), the frame of the first vision signal then can completely be shown in the subregion in viewing area(Sprite)It is interior.
But, it is known that PIP technology still have many parts to be modified.For example, in known technology, sub-district The whole frame of the first vision signal can only be regularly shown in domain, can not make a summary the critical part highlighted in frame, can not also arrange Except in frame to the unessential part of user.It is thus known that technology also just can not efficiently use the less subregion of area To concentrate the image information that user is presented and takes notice of.Furthermore in known technology, subregion/sprite is fixed as rectangle, lack It is weary with upper elasticity, also can not be in response to the individual demand of different users.
The content of the invention
The present invention applies to a television system on a kind of television control apparatus.Television system can be in a viewing area Display picture.Television control apparatus may include a signal source module and a synthesis module.Signal source module can be respectively by one first Vision signal is with obtaining one first frame in one second vision signal(frame)With one second frame, and by the first frame capture one Part is to be used as a sub-image.Synthesis module then can enable the sub-image to be shown in the picture when the second frame is shown in the picture In one subregion in face.Wherein, sub-image is less than the first frame;For example, the pixel that sub-image is covered can be all pictures of the first frame The subclass of element.
In one embodiment, signal source module more can be by obtaining one second frame in one second vision signal;For example, signal Source module may include multiple decodings(codec)Module, each decoding module is respectively by the first vision signal and the second vision signal It is middle to decode to obtain the first frame and the second frame.Synthesis module is then covered the sub-image of the first frame repeatedly on the second frame, makes the second frame It is able to be shown in viewing area as background, and sub-image is shown in subregion as prospect.
In one embodiment, television control apparatus of the present invention may include an access module, to access a database.This data To store multiple picture layouts, each picture layout records various acquisition information and sub-district domain information, also may include one turn in storehouse Change information.Television control apparatus can be by selecting one of them in these picture layouts;Signal source module can be according to the picture selected The recorded acquisition information of layout(Such as capture the position of sub-image)To capture sub-image from the first frame, synthesis module then may be used The sub-district domain information recorded according to the picture layout selected(Such as sub-window position)To enable sub-image to show in subregion. Transitional information then can record how sub-image is converted to corresponding sub-region.
In one embodiment, the control of television control apparatus acceptable use person and select picture layout.And/or electricity Picture layout can be selected automatically depending on control device.For example, access module can be automatically according to the first vision signal and second Channel Access database corresponding to vision signal is to select picture layout.And/or access module can be according to television system Running situation automatically access database to select applicable picture layout.
In one embodiment, television control apparatus of the present invention can operate on a setting pattern and a play mode, also, also wrap Include a setting module.When television control apparatus operates on setting pattern, setting module can be determined in the first frame according to an instruction This part(That is sub-image), and/or, the subregion for determining the picture is instructed according to one.For example, setting module can make it is more Individual anchor point is shown in picture, and instructs one of these corresponding anchor points.For example, television control apparatus can foundation User with instruct the anchor point of selection determine subregion position.When television control apparatus operates on play mode, synthesis Module can be according to the sub-window position that setting module determines so that sub-image is able to be shown in subregion.Sub-image and/or son The shape in region can be not limited to rectangle.
The present invention is again on a kind of method for controlling television system, such as running of television control apparatus of the present invention.
Brief description of the drawings
More preferably understand to have to addressing other side on the present invention, preferred embodiment cited below particularly, and coordinate institute Accompanying drawings, it is described in detail below:
Fig. 1 illustrates that the television system according to one embodiment of the invention.
Fig. 2 illustrates that the running embodiment of television system in Fig. 1.
Fig. 3 illustrates that the television system according to one embodiment of the invention.
Fig. 4 and Fig. 5 illustrates that the running embodiment of Fig. 3 television systems.
Fig. 6 illustrates that a kind of embodiment of picture layout in Fig. 3.
Fig. 7 and the running of the television system of Fig. 8 example schematics 3.
Circuit in Fig. 9 schematic diagrames 1 and Fig. 3 included by signal source module.
Figure 10 illustrates that the flow according to one embodiment of the invention.
Embodiment
Fig. 1 is refer to, it illustrates that the television system 10 according to one embodiment of the invention.Television system 10 can wrap Include a screen 12(Such as liquid crystal display panel)With a television control apparatus 16;For example, television control apparatus 16 can be One TV control chip, the peripheral circuit of TV control chip can also be included with supporting at device, such as driving chip, image Manage chip and/or volatibility and/or non-volatile storage device etc..Television control apparatus 16 couples screen 12, uses To control screen 12, to show static and/or dynamic menu in a viewing area 14 of screen 12.
Television control apparatus 16 can include a signal source module 18 and a synthesis module 20, signal source module 18 are coupled to Synthesis module 20.Signal source module 18 can receive multiple vision signals, in Fig. 1 by taking two vision signal S1 and S2 as an example.Video One or more frames, such as frame S1 [n] can be included in signal S1;Similarly, one or more can also be included in vision signal S2 Frame, such as frame S2 [n].Signal source module 18 can be by obtaining frame S1 [n] and S2 [n] respectively in vision signal S1 and S2.
The frame S2 [n] that basis signal source module 18 provides and sub-image S1 [n], synthesis module 20 can fill out frame S2 [n] Fill and be shown in viewing area 14, and by capturing a part in frame S1 [n](In Fig. 1 by taking the bottom of frame as an example), as a sub-image S1 [n] _ d, and sub-image S1 [n] _ d is shown in a sub-regions 22 of viewing area 14.That is, synthesis module 20 can So that sub-image S1 [n] _ d is shown in the subregion 22 in viewing area 14, remaining area of viewing area 14 then can be used to show Show frame S2 [n].Wherein, sub-image S1 [n] _ d is less than frame S1 [n].
In other words, television control apparatus 16 can not only show frame S2 [n], can also be by capturing emphasis institute in frame S1 [n] Sub-image S1 [n] _ d, and sub-image S1 [n] _ d is fully shown with subregion 22, to exclude not weigh in frame S1 [n] The secondary part wanted, secondary part is set not take the limited areal of subregion 22 for no reason.For example, vision signal S2 can be with It is the main contents to be viewed and admired of user, vision signal S1 can be the content that a news channel provides;User can utilize this Vision signal S1 headline part is taken passages and is shown in for sub-image in subregion 22 by inventive technique, in this way, just Headline can be synchronously concerned about when viewing and admiring vision signal S2.
Continue Fig. 1 embodiments, refer to Fig. 2, it illustrates that a kind of running embodiment of television control apparatus 16. In this embodiment, synthesis module 20 can cover frame S1 [n] sub-image S1 [n] _ d repeatedly with position according to the size of subregion 22 Background is used as in being able to, frame S2 [n] on frame S2 [n] to be shown in viewing area 14, while sub-image S1 [n] _ d is shown It is shown in subregion 22 and is used as prospect.By vision signal S1 and S2(Fig. 1), can be to frame S2 after middle acquirement frame S1 [n] and S2 [n] [n] carries out image processing 24a, such as says it is according to viewing area 14(Fig. 1)Resolution ratio frame S2 [n] is zoomed in and out etc.. On the other hand, after by capturing sub-image S1 [n] _ d in frame S1 [n], then can carry out image processing 24b to it, for example, say be according to Adjustment etc. is zoomed in and out to sub-image S1 [n] _ d according to the size of subregion 12.Then, sub-image S1 [n] _ d after processing Just it can cover repeatedly on the frame S2 [n] through processing, synthesize frame Fx [n], to be played in viewing area 14.
In one embodiment, synthesis module 20 can access(And/or including)One synthesis buffer 26 and two(Or more) Frame buffer(frame buffer), such as frame buffer 28a and 28b.Sub-image S1 [n] _ d and frame S2 [n] building-up process can Carried out using memory space that buffer 26 provided is synthesized, the synthetic frame Fx [n] of gained is just temporarily stored into synthesis buffer 26; When playing frame Fx [n], synthetic frame Fx [n] can be read by synthesizing buffer 26(fetch)To frame buffer 28a, delayed by frame Device 28a is rushed to export to screen 12(Fig. 1).While synthetic frame Fx [n] is exported by frame buffer 28a, conjunction can be synchronously utilized Next frame S2 [n+1] and next frame S1 [n+1] sub-image S1 [n+1] _ d are synthesized into buffer 26, to form next synthesis Frame Fx [n+1](It is not shown), and synthetic frame Fx [n+1] is read out into another frame buffer 28b.When synthetic frame Fx [n to be shown When+1], synthetic frame Fx [n+1] can be exported by frame buffer 28b, and another frame buffer 28a is then ready for by synthesizing buffering Device 26 reads next synthetic frame Fx [n+2].In other words, two frame buffer 28a can replace running with 28b, when one of them When a certain synthetic frame is exported to screen, another frame buffer can be used for keeping in next synthetic frame.
In another embodiment of resultant image, synthesis module 20 is directly distinguished when output according to the position of subregion 12 Frame S1 [n] and S2 [n] is read, can not have to repeatedly be covered.For example, when synthesis module 20 is output synthetic frame Fx's [n] I-th scan line(Non- icon)When, if the scan line is not occured simultaneously with subregion 12, synthesis module 20 can read frame S2 [n] In i-th scan line to export i-th scan line for synthetic frame Fx [n].If i-th scan line and subregion 12 occur simultaneously in Jth 1 is to 2 pixels of jth(Non- icon), then synthesis module 20, can be by frame in output frame Fx [n] i-th scan line The 1st of i-th article of scan line is read in S1 [n] to 1 pixel of jth, and the jth 1 of i-th scan line is read by frame S2 [n] To 2 pixels of jth, the jth 2 of i-th scan line is more read by frame S1 [n] to last pixel.
Fig. 3 is refer to, it illustrates that the television system 30 according to one embodiment of the invention, and it may include a screen 32 With a television control apparatus 36.Television control apparatus 36 couples screen 32, to control screen 32, with a display of screen 32 Static and/or dynamic menu is shown in region 34.Television control apparatus 36 can include a signal source module 38, a synthesis module 40th, an access module 42 and a setting module 44.Signal source module 38 can be by multiple vision signals(Such as vision signal S [1], S [2] to S [m] etc.)Frame is obtained respectively.Synthesis module 40 is coupled to signal source module 38 and access module 42.
Access module 42 couples a database 46, to access this database 46;Database 46 can be by Nonvolatile memory Realize, it can be a part for television control apparatus 36(Such as inline memory)Or it is external in television control apparatus 36 External connection storage apparatus.Database 46 is storing one or more picture layouts L [1], L [2] to L [k] etc., each screen cloth Office L [] is the configuration that viewing area 34 records a kind of " subregion ";That is, each picture layout L [] can record it is one or more Coordinate, position and/or the size of sub-regions.Television control apparatus 36 can be by selecting one of them in these picture layouts L [] L [k_selected] (not illustrating);After signal source module 38 solves the frame of one or more vision signals, synthesis module 40 can foundation The picture layout L [k_selected] selected to capture one or more sub-images from the frame of one or more vision signals, and Sub-image is set to be shown in corresponding sub-region according to the picture layout L [k_selected] selected.
Continue Fig. 3 embodiment, refer to Fig. 4, several picture layouts in its schematic data storehouse 46 of illustrating, such as screen cloth Office L [k1], L [k2] and L [k3].Picture layout L [k1] be viewing area 34 configure two sub-regions Rs [k1,1] and Rs [k1, 2], showing two sub-images.According to this picture layout L [k1], signal source module 38(Fig. 3)Solve vision signal S [a1] (not illustrating), S [a2] (not illustrating) and S [a3] (not illustrating) frame S [a1, n], S [a2, n] and S [a3, n], synthesis module 40 Capture sub-image S [a1, n] _ d and S [a2, n] _ d from frame S [a1, n], S [a2, n] respectively, and by sub-image S [a1, n] _ d It is respectively synthesized with S [a2, n] _ d to subregion Rs [k1,1] and Rs [k1,2] as prospect, to cover repeatedly on background frames, such as Frame S [a3, n].
Picture layout L [k2] can be that viewing area 34 provides two sub-regions Rs [k2,1] and Rs [k2,2], to show Two sub-images.If from this picture layout L [k2], signal source module 38 can solve vision signal S [b1] (not illustrating), S [b2] (not illustrating) and S [b3] (not illustrating) frame S [b1, n], S [b2, n] and S [b3, n], synthesis module 40 is then respectively from frame S [b1, n] and S [b2, n] capture sub-image S [b1, n] _ d and S [b2, n] _ d, and by sub-image S [b1, n] _ d and S [b2, n] _ D is respectively synthesized to subregion Rs [k2,1] and Rs [k2,2] as prospect, to cover repeatedly on background frames, for example, frame S [b3, n]。
Picture layout L [k1] and L [k2] all provides two sub-regions, but different pictures layout can be furnished with different numbers And/or different kenels(Different shape, diverse location and/or different sizes)Subregion.For example, picture layout L [k1] Subregion Rs [k1,1] and Rs [k1,2] can be that horizontal-extending two traverse rectangle, picture layout L [k2] subregion Rs [k2,1] and Rs [k2,2] can be then the rectangles positioned at left side and lower right side.
Subregion can be not only rectangle or polygon, and the picture layout L [k3] in Fig. 4 includes one The subregion Rs [k3,1] of individual irregular polygon.If from this picture layout L [k3], television control apparatus 30 can coordinate sub-district Domain Rs [k3,1] shape and by capturing the sub-image S of irregular shape in the frame S [c1, n] of a certain vision signal S [c1] [c1, n] _ d, sub-image S [c1, n] _ d is shown in subregion Rs [k3,1], be covered in background frames(Such as information source S The frame S [c2, n] of [c2])On.
By different picture layouts, the present invention can provide multiple choices for the presentation of sub-image, user is substantially improved View and admire the elasticity and enjoyment of video content.In a kind of embodiment, the control of the acceptable use person of television control apparatus 36, foundation makes The selection of user and by accessing the desired picture layout of user in database 46, and the picture layout selected according to user is come Resultant image, display picture.For example, television control apparatus 36 can operate on user's selection mode and play mould with one Formula.When user will select picture layout, television control apparatus 36 can enter to user's selection mode, with screen display (OSD, On-Screen Display)The various picture layouts in database 46 are presented, allow user can preview different pictures Sub-district configuration of territory in layout.The selection that user is received when television control apparatus 36 controls, can be by being deposited in database 46 The picture layout for taking user to select, and terminate user's selection mode and enter to play mode.In play mode, TV The picture layout that control device 36 can select according to user captures sub-image from different vision signals, is synthesized, And show the frame of synthesis.User to television control apparatus 36 selection control can be via remote control, acoustic control, touch-control with And/or person's motion sensing control is assigned.
In one embodiment, television control apparatus 36 can not only be selected desired picture layout by user, Specific picture layout can be automatically selected;For example, the running situation according to television system 30(context)Carry out automatic access number According to the picture layout in storehouse.For example, television control apparatus 36 can automatically select according to channel that user to be watched Picture layout, such as say that user is intended to select vision signal source of the sports channel for subregion, then television control apparatus 36 Automatically select the picture layout for sub-image by score sheet Position Design.And/or television control apparatus 36 can be according to the time To automatically select picture layout, such as say and select a certain picture layout automatically when reaching a certain moment, until another moment Another picture layout is automatically switched to again.And/or television control apparatus 36 can be according to other signals(Or device)Triggering And a certain picture layout is selected automatically.For example, the sound arround 36 sustainable monitoring of television control apparatus, if meeting a certain bar Part, then a certain picture layout is selected automatically;This condition can be:By having picked out certain kenel in the sound(Or some frequencies)Sound Ring, and/or, volume has been higher than(Or it is less than)Certain threshold value.And/or television control apparatus 36 can be according to light sensing The sensing result of device selects picture layout automatically, such as say to be less than in brightness(Or it is higher than)Selected automatically during a certain threshold value A certain picture layout.And/or television control apparatus 36 can coordinate the video camera before screen, with the knot according to image identification Fruit selects picture layout automatically;For example, if user's number before screen(The face number that can be picked out)It is more than(Or It is less than)During a certain threshold number, then television control apparatus 36 selects a certain picture layout automatically.And/or if pick out (Or do not pick out)The face of a certain specific user, then television control apparatus 36 select a certain picture layout automatically.And/or Person, if the dynamic before screen obtained by shooting(Such as gesture or pupil tracing)When meeting a certain default kenel, then TV control fills Put 36 and select a certain picture layout automatically.
In each picture layout L [], the sub-image for being presented in different subregion Rs [,] can come from different video letter Number frame, can be from the same frame of same vision signal.For example, in the picture layout L [k2] of Fig. 4 citings, son Region Rs [k2,1] and Rs [k2,2] sub-image can be captured to come by same frame, i.e., mark enough b1 and b2 can with equal, Frame S [b1, n] and S [b2, n] can be the same frame of same information source.And/or in same picture layout L [], it is in Now different frame from same vision signal can also be captured respectively in the sub-image of different subregions;It is with picture layout L [k2] Example, the sub-image that be shown in subregion Rs [k2,1] and Rs [k2,2] can be respectively by frame S [b1, n] and S [b1, n-m] institute Capture what is come.
In Fig. 3 embodiments, the picture layout L [] in database 46 can be built-in in advance or by using What person voluntarily established and/or edited.The setting module 44 of television control apparatus 36 is used for the custom picture layout of assisting user, Such as say it is all subregion in custom picture layout.Except previously mentioned user's selection mode and play mode, TV Control device 36 can also operate on a setting pattern.Fig. 5 is refer to, it illustrates that the running embodiment of setting pattern.Setting Under mould-fixed, setting module 44(Fig. 3)Screen display can be used(OSD)And multiple alignment marks are allow to be shown in viewing area Domain 34, such as horizontal gridlines h [1], h [2] to h [p_max] in Fig. 5 etc., and vertical gridlines v [1], v [2] to v [q_max] etc..User can be in horizontal gridlines and many intersection points of vertical gridlines(That is anchor point)Between unrestricted choice, with Orient the summit of subregion.Television control apparatus 36 can receive the control of user, and the intersection point that user selects is shown in Viewing area 34, allow user can be with the position of intersecting point selected by preview.Fig. 5 examples of passing the imperial examinations at the provincial level illustrate two summit Q [q, 1](It is located at Grid lines v [q] and h [1] intersection point)And Q [1, p](Grid lines v [1] and h [p] intersection point).
Gather multiple summits, setting module 44 can determine position and the scope of subregion, and via access module 42 and The position of subregion is set to may be recorded in corresponding picture layout.For example, if user sets three summits, The subregion of a triangle is defined, can be used to show the triangle sub-image of a certain picture frame.And/or user The shape of subregion can be first selected, as the geometric parameter needed for setting module 44 prompts this kind of shape and necessary setting procedure; For example, if subregion is rectangle, user can only select two summits, the diagonal both ends as rectangle;Or use Person can only select some central point as rectangle(An or summit), then set in a manner of increasing and decreasing the length of rectangle with it is wide.Furthermore Setting module 44 can not also show any grid lines and alignment mark, allow user freely to determine the position on summit.And/or Person, setting module 44 can also realize other subregion design/edit modes, such as say:By the sub-district in another picture layout Domain is imported to the picture layout in current setting, and/or is provided a variety of built-in subregions and allowed user to import to being currently set In picture layout, and/or allow user's increase, delete, the summit of mobile subregion, and/or do not changing subregion shape In the case of move position, the scaling subregion of subregion, and/or rotation subregion etc..When television control apparatus 36 operates When play mode, the screen cloth of the earlier set of setting module 44 can be accessed from database 46 via access module 42 Office;Then, signal source module 38 can capture sub-image according to this, and synthesis module 40 then enables sub-image to be shown in subregion.
Fig. 6 is refer to, it illustrates that the information included by picture layout L [k] in one embodiment of the invention.Screen cloth Office L [k] may include sub-district domain information L [k] a, record position and/or size of one or more subregions etc., so as to aobvious Show region 34(Fig. 4)In orient one or more subregions.In one embodiment of this invention, television control apparatus 36 can foundation Geometrical relationship between subregion and complete display area in whole frame with carrying out equal proportion by capturing sub-image.For example, exist In Fig. 4 picture layout L [k1], it is assumed that subregion Rs [k1,1] upright position is at the top 1/3rd of viewing area 34 Place, then when capturing sub-image S [a1, n] _ d in by frame S [a1, n], and it is son that preceding 1/3rd of frame S [a1, n], which are captured, Image S [a1, n] _ d.
In one embodiment of this invention, the geometrical relationship of sub-image and interframe can also be independently of subregion and viewing area Geometrical relationship between domain, it is not necessarily intended to be equal proportion between two geometrical relationships.Therefore, can be selective in picture layout L [k] Ground includes sub-image information L [k] b and transitional information L [k] c.Sub-image information L [k] b records one or more sub-images and existed Position and/or size in frame etc., transitional information L [k] c make the sub-image after conversion meet son to change the sub-image Region.For example, it refer to Fig. 7 embodiment;In this instance, picture layout L [k] make frame S [m1, n] sub-image S [m1, N] _ d is via rotation(Also may include to scale)And be shown in the subregion Rs [k, 1] of viewing area 34, with cover repeatedly in frame S [m2, N] background before.To realize the synthesis of such a picture, picture layout L [k] sub-district domain information L [k] a record subregions Rs [k, 1] position in viewing area 34(And/or size), sub-image information L [k] b record sub-image S [m1, n] _ d in frame S [m1, N] in position(And/or size), transitional information L [k] c records are then to insert sub-image S [m1, n] _ d to subregion Rs Required video conversion and/or image processing when [k, 1], such as say it is rotation and/or scaling etc..
Picture layout L [k] is also selectively included other information L [k] d;For example, information L [k] d can remember Record the information source of each sub-image, for example, say be will be by which(Or which)Sub-image is captured in the program of channel.And/or Person, information L [k] d can include:How each sub-image will synthesize with background frames, for example, say be via pixel data and computing, Or computing plus computing or subtract computing etc. and sub-image is blended into background frames.
The position dimension of subregion and/or sub-image can also be set automatically by television control apparatus 36.Citing For, television control apparatus 36 can be directed to a certain frame and carry out image analysing computer, will meet the pixel cluster of a certain preparatory condition automatically For sub-image, it is further filled with into subregion.Example as shown in Figure 8, television control apparatus 36 can be in the series of same information source Dynamic detection is carried out in frame S [m, n] and S [m, n+1], the part occurred according to dynamic automatically determines sub-image S [m, n] _ d and S [m, n+1] _ d position is simultaneously captured, and sub-image S [m, n] _ d and S [m, n+1] _ d are sequentially shown in into viewing area In subregion Rs [k, 1].In viewing area 34, subregion Rs [k, 1] position can be fixed or with sub- shadow Image position and movement.
In Fig. 1 and Fig. 3 television control apparatus 10 and 30, signal source module 18 and 38 can include one or more decodings Module, such as two decoding modules 50a and 50b shown in Fig. 9, each decoding module in a corresponding vision signal by obtaining frame; For example, decoding module 50a and 50b can be respectively by obtaining frame S1 [n] and S2 [n] in vision signal S1 and S2.Decoding module 50a and 50b conformation function can be identical.By taking decoding module 50a as an example, it may include there is a decoding unit 52a, a sound Frequency decoder(audio codec)54a, an image decoding device(video codec)56a, a captioning module 58a and one play mould Block 59a.In decoding module 50a, decoding unit 52a coupling vision signal S1, the audio content that vision signal S1 is solved, shadow As content and caption content are respectively transmitted to tone decoder 54a, image decoding device 56a and captioning module 58a, audio is allowed Decoder 54a, image decoding device 56a and captioning module 58a decode out audio, frame and captions and are sent to playing module 59a.Most Audio and frame S1 [n] (or frame S1 [n] plus captions) are exported by playing module 59a afterwards.Decoding module 50b may include have One decoding unit 52b, a tone decoder 54b, an image decoding device 56b, a captioning module 58b and a playing module 59b, its Framework is analogous respectively to decoding unit 52a, tone decoder 54a, image decoding device 56a, captioning module 58a with playing with function Module 59a, therefore repeat no more.When the television control apparatus 16 or 36 of television system 10 or 30 performs application program to realize this hair , can be via operating system when bright(operation system)Service routine(service routine)Control each decoding mould Block 50a and 50b etc..
Figure 10 is refer to, the flow 100 of its foundation one embodiment of the invention illustrated, it can be used to control a TV system System;For example, Fig. 3 of the present invention television control apparatus 36 can control television system 30 according to flow 100.Flow 100 can Comprise the following steps.
Step 102:Frame is obtained, such as says it is that row decoding is entered respectively to one first vision signal and one second vision signal, To obtain one first frame and one second frame respectively.
Step 104:Access database(Such as Fig. 3 databases 46), and selected in multiple picture layouts by database storage One of them.In database, each picture layout is recording various acquisition information(Such as the acquisition position of sub-image)With son Area information(Such as the position of subregion), and may include a transitional information.For example, transitional information can be used to record a picture layout In each sub-image how to be converted to corresponding subregion.When carrying out step 104, the picture to be used can be selected by user Face is laid out;And/or also database can be automatically accessed to select picture layout according to the running situation of television system;Example Such as, can be according to the Channel Access database corresponding to the first vision signal and the second vision signal.
Step 106:After step 104 selects picture layout, the acquisition information that is recorded according to the picture layout selected with A part is captured from the first frame and is used as sub-image, also, is made according to the sub-district domain information that the picture layout selected is recorded The sub-image is shown in corresponding subregion.
Flow 100 is optionally included with a step 101, and it makes television system operate on setting pattern, to refer to according to one Order determines the sub-image and/or subregion of a picture layout, such as captures the position of sub-image and the position of subregion.One implements In example, when carrying out step 101, multiple anchor points can be made to be shown in picture, and the instruction is corresponded to those anchor points wherein One of.End step 101, can end setup pattern.Then, flow 100 can proceed with the broadcasting to step 102 and 106 Pattern.
In summary, different video content can be shown in subregion compared to known PIP technology, the present invention Sub-image, different content is shown with efficiently multitask, and with more changes, can custom, high utilization that can be customized Elasticity, fully to meet the individual demand of user.
In summary, although the present invention is disclosed above with preferred embodiment, so it is not limited to the present invention.This hair Bright those of ordinary skill in the art, without departing from the spirit and scope of the invention, when various changes can be made With retouching.Therefore, the protection domain of the present invention is worked as and is defined depending on appended claim institute defender.

Claims (8)

1. a kind of television control apparatus, applying to a television system, the television system is to show a picture, and the TV controls Device includes:
One signal source module, respectively by obtaining one first frame and one second in one first vision signal and one second vision signal Frame;
One synthesis module, when second frame is shown in the picture, captured from first frame it is a part of using as a sub-image, And the sub-image is shown in a subregion of the picture, wherein, the sub-image is less than first frame;
One access module, to access multiple picture layouts, those picture layouts record respectively its corresponding acquisitions information and Sub-district domain information;
Wherein, the television control apparatus is according to the channel corresponding to first vision signal and second vision signal or according to this The running situation of television system in those picture layouts by selecting one of them, the picture layout that the synthesis module is selected according to this The acquisition information recorded from first frame to capture the sub-image, and is recorded according to the picture layout selected Sub-district domain information makes the sub-image be shown in the subregion;
Wherein, the running situation include the time, volume arround one, arround one brightness and the result of an image identification wherein it One.
2. television control apparatus as claimed in claim 1, it is characterised in that the signal source module includes:
One first decoding module and one second decoding module, first vision signal is decoded respectively with second vision signal to take Obtain first frame and second frame.
3. television control apparatus as claimed in claim 1, it is characterised in that respectively the picture layout further includes a transitional information, To change the sub-image, the sub-image after conversion is set to meet the subregion.
4. a kind of television control apparatus, applying to a television system, the television system is to show a picture, and the TV controls Device includes:
One signal source module, respectively by obtaining one first frame and one second in one first vision signal and one second vision signal Frame;
One synthesis module, when second frame is shown in the picture, captured from first frame it is a part of using as a sub-image, And the sub-image is shown in a subregion of the picture, wherein, the sub-image is less than first frame;
One setting module, when the television control apparatus operates on a setting pattern, the setting module determines according to an instruction should The part and/or the subregion in first frame, wherein, the setting module makes multiple anchor points be shown in the picture, the instruction It is corresponding one of to those anchor points.
5. a kind of method for controlling a television system, the television system is to show a picture, and this method includes:
Respectively by obtaining one first frame and one second frame in one first vision signal and one second vision signal;
It is a part of using as a sub-image by being captured in first frame when second frame is shown in the picture, and make the sub- shadow As being shown in a subregion of the picture, wherein, the sub-image is less than first frame;
Multiple picture layouts are accessed, those picture layouts record its corresponding acquisition information and sub-district domain information respectively;
According to the channel corresponding to first vision signal and second vision signal or the running situation according to the television system By selecting one of them in those picture layouts;
The acquisition information recorded according to the picture layout selected from first frame to capture the sub-image;And
The sub-district domain information recorded according to the picture layout selected makes the sub-image be shown in the subregion;
Wherein, the running situation include the time, volume arround one, arround one brightness and the result of an image identification wherein it One.
6. method as claimed in claim 5, it is characterised in that also include:
First vision signal is decoded with second vision signal to obtain first frame and second frame.
7. method as claimed in claim 5, it is characterised in that respectively the picture layout further includes a transitional information, to change The sub-image, the sub-image after conversion is set to meet the subregion.
8. a kind of method for controlling a television system, the television system is to show a picture, and this method includes:
Respectively by obtaining one first frame and one second frame in one first vision signal and one second vision signal;
When second frame is shown in the picture, captured from first frame a part of using as a sub-image, and make the sub- shadow As being shown in a subregion of the picture, wherein, the sub-image is less than first frame;
When the television control apparatus operates on a setting pattern, the setting module determines being somebody's turn to do in first frame according to an instruction Part and/or the subregion, wherein, the setting module makes multiple anchor points be shown in the picture, and the instruction is corresponding fixed to those One of site.
CN201310347850.4A 2013-08-09 2013-08-09 Television control apparatus and correlation technique Expired - Fee Related CN104349200B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201310347850.4A CN104349200B (en) 2013-08-09 2013-08-09 Television control apparatus and correlation technique

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201310347850.4A CN104349200B (en) 2013-08-09 2013-08-09 Television control apparatus and correlation technique

Publications (2)

Publication Number Publication Date
CN104349200A CN104349200A (en) 2015-02-11
CN104349200B true CN104349200B (en) 2018-04-03

Family

ID=52503871

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201310347850.4A Expired - Fee Related CN104349200B (en) 2013-08-09 2013-08-09 Television control apparatus and correlation technique

Country Status (1)

Country Link
CN (1) CN104349200B (en)

Families Citing this family (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106792223A (en) * 2016-12-31 2017-05-31 天脉聚源(北京)科技有限公司 The method and apparatus that many pictures are played in interactive interface
CN108347641B (en) * 2017-01-25 2021-01-22 联发科技股份有限公司 Dynamic image processing device and method matched with television transmission system
CN111405182B (en) * 2020-03-26 2021-07-23 杭州小影创新科技股份有限公司 Video editing method for adjusting lens proportion

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US4249211A (en) * 1978-02-07 1981-02-03 Matsushita Electric Industrial Co., Ltd. Composite image display apparatus
CN1205825A (en) * 1995-12-29 1999-01-20 汤姆森消费电子有限公司 Television system with provisions for displaying auxiliary image of variable size
CN1832548A (en) * 2005-03-09 2006-09-13 三星电子株式会社 Display apparatus and control method thereof
JP2006352208A (en) * 2005-06-13 2006-12-28 Matsushita Electric Ind Co Ltd Video display apparatus
CN101335858A (en) * 2007-06-26 2008-12-31 索尼株式会社 Image processing device, method and program

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US4249211A (en) * 1978-02-07 1981-02-03 Matsushita Electric Industrial Co., Ltd. Composite image display apparatus
CN1205825A (en) * 1995-12-29 1999-01-20 汤姆森消费电子有限公司 Television system with provisions for displaying auxiliary image of variable size
CN1832548A (en) * 2005-03-09 2006-09-13 三星电子株式会社 Display apparatus and control method thereof
JP2006352208A (en) * 2005-06-13 2006-12-28 Matsushita Electric Ind Co Ltd Video display apparatus
CN101335858A (en) * 2007-06-26 2008-12-31 索尼株式会社 Image processing device, method and program

Also Published As

Publication number Publication date
CN104349200A (en) 2015-02-11

Similar Documents

Publication Publication Date Title
TWI520610B (en) Television control apparatus and associated method
US10334162B2 (en) Video processing apparatus for generating panoramic video and method thereof
US8756631B2 (en) Method and apparatus for display of a digital video signal having minor channels
CN1878260B (en) Multi-menu co-screen playing method
CN1795674A (en) Multimedia playback device and playback method
CN106341711A (en) Multi-position video live broadcast playback method and system
EP1734757A3 (en) Video recording/reproducing apparatus and method of displaying a menu guide
JP2002354367A (en) Multi-screen display device, multi-screen display method, storage medium and program
CN104349200B (en) Television control apparatus and correlation technique
CN100372367C (en) Imaging apparatus
EP1553762A2 (en) Information display apparatus and method having folded and unfolded content items
CN1335018A (en) System and method of default channel lineup and display with customization of electronic program guide grids
JP2016163311A (en) Video processing device, video processing system, and video processing method
WO2015138222A1 (en) News production system with integrated display
JP2007129332A (en) Method and device for operating each image on multi-screen
JP2003517222A (en) Decimation method for providing PIG window
CN101489065B (en) Window television and method for implementing window therefor
EP1515550A1 (en) Decoding apparatus and decoding method
US20040179813A1 (en) Disk reproduction apparatus allowing setting of book mark for reproducing disk, and disk reproduction method
CN106161992B (en) Window special-shaped display device and display method of desktop type video processing console
CN101667442A (en) Digital home DVD player system for monitoring visitors and method thereof
CN115643454A (en) Display device, video playing method and device thereof
US20050212967A1 (en) System for displaying a sequence of moving images
JPH05191721A (en) Television monitor device
JPH03106213A (en) Channel search device in television receiver

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant
TR01 Transfer of patent right

Effective date of registration: 20200414

Address after: No.1, Duhang 1st Road, Hsinchu City, Hsinchu Science Park, Taiwan, China

Patentee after: MEDIATEK Inc.

Address before: Taiwan Hsinchu County Tai Yuan Street China jhubei City, No. 26 4 floor 1

Patentee before: MSTAR SEMICONDUCTOR Inc.

TR01 Transfer of patent right
CF01 Termination of patent right due to non-payment of annual fee

Granted publication date: 20180403

Termination date: 20210809

CF01 Termination of patent right due to non-payment of annual fee