CN104349200A - Television control device and correlation method - Google Patents
Television control device and correlation method Download PDFInfo
- Publication number
- CN104349200A CN104349200A CN201310347850.4A CN201310347850A CN104349200A CN 104349200 A CN104349200 A CN 104349200A CN 201310347850 A CN201310347850 A CN 201310347850A CN 104349200 A CN104349200 A CN 104349200A
- Authority
- CN
- China
- Prior art keywords
- frame
- sub
- image
- subregion
- control apparatus
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/431—Generation of visual interfaces for content selection or interaction; Content or additional data rendering
- H04N21/4312—Generation of visual interfaces for content selection or interaction; Content or additional data rendering involving specific graphical features, e.g. screen layout, special fonts or colors, blinking icons, highlights or animations
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/44—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream, rendering scenes according to MPEG-4 scene graphs
- H04N21/4402—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream, rendering scenes according to MPEG-4 scene graphs involving reformatting operations of video signals for household redistribution, storage or real-time display
- H04N21/440263—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream, rendering scenes according to MPEG-4 scene graphs involving reformatting operations of video signals for household redistribution, storage or real-time display by altering the spatial resolution, e.g. for displaying on a connected PDA
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/44—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream, rendering scenes according to MPEG-4 scene graphs
- H04N21/4402—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream, rendering scenes according to MPEG-4 scene graphs involving reformatting operations of video signals for household redistribution, storage or real-time display
- H04N21/440263—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream, rendering scenes according to MPEG-4 scene graphs involving reformatting operations of video signals for household redistribution, storage or real-time display by altering the spatial resolution, e.g. for displaying on a connected PDA
- H04N21/440272—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream, rendering scenes according to MPEG-4 scene graphs involving reformatting operations of video signals for household redistribution, storage or real-time display by altering the spatial resolution, e.g. for displaying on a connected PDA for performing aspect ratio conversion
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/47—End-user applications
- H04N21/472—End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content
- H04N21/47205—End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content for manipulating displayed content, e.g. interacting with MPEG-4 objects, editing locally
Abstract
The invention provides a television control device and a correlation method, which are applied to a television system. The television control device comprises a signal source module and a synthesis module, wherein the signal source module is used for obtaining a first frame and a second frame from a first video signal and a second video signal respectively; the synthesis module is used for capturing one part from the first frame to be used as a sub-image when the second frame is displayed on a picture of the television system, and displaying the sub-image to a sub-region of the picture, wherein the sub-image is smaller than the first frame.
Description
Technical field
The invention relates to a kind of television control apparatus and correlation technique, and relate to a kind of television control apparatus and the correlation technique that can show the part image of another information source in the subregion of main viewing area especially.
Background technology
Display television system that is static and/or dynamic menu can become one of most important electronic product in advanced information society; Moreover, the multimedia player of video conferencing system, safe monitoring system, integrated (all-in-one) computer, projection display system, video tape recorder, CD/hard disk/Nonvolatile memory and various Wearable, hand-hold type, portable product, such as mobile phone, guiding aircraft, digital camera/video camera etc., also all can be regarded as television system.
Television system possesses screen, with display frame in the viewing area of screen, and broadcast video signal.Due to the diversification of video content, user can wish the vision signal of multiple different aforementioned sources to integrate efficiently to be shown in same viewing area.The function of existing PIP (PIP, Picture In Picture) in existing display control technology; When using the technology of PIP to play two vision signals simultaneously, the frame of the second vision signal is full of viewing area and formation background (mother picture), and the frame of the first vision signal then can completely be shown in the subregion (sprite) in viewing area.
But, known PIP technology still has many parts to be modified.For example, in known technology, the whole frame of the first vision signal in subregion, can only be shown regularly, the critical part highlighted in frame of cannot making a summary, also cannot get rid of in frame the unessential part of user.Therefore, the subregion that known technology also just cannot use area less efficiently concentrates the image information presenting user and take notice of.Moreover in known technology, subregion/sprite is all fixed as rectangle, lack the elasticity on using, also cannot in response to the individual demand of different users.
Summary of the invention
The present invention, about a kind of television control apparatus, applies to a television system.Television system can display frame in a viewing area.Television control apparatus can comprise a signal source module and a synthesis module.Signal source module can respectively by obtaining one first frame (frame) and one second frame in one first vision signal and one second vision signal, and a part of using as a sub-image by acquisition in the first frame.Synthesis module then can, when the second frame is shown in this picture, make this sub-image be shown in a subregion of this picture.Wherein, sub-image is less than the first frame; Such as, the pixel that sub-image is contained can be the subclass of all pixels of the first frame.
In one embodiment, signal source module more can obtain one second frame by one second vision signal; For example, signal source module can comprise multiple decoding (codec) module, each decoding module respectively by decoding in the first vision signal and the second vision signal to obtain the first frame and the second frame.The sub-image of the first frame then covers repeatedly on the second frame by synthesis module, makes the second frame be shown in viewing area as a setting, and makes sub-image be shown in subregion as prospect.
In one embodiment, television control apparatus of the present invention can comprise an access module, in order to access a database.This database is in order to store multiple picture layout, and the various retrieve information of each picture layout record and subregion information, also can comprise a transitional information.Television control apparatus can select one of them by these picture layout; To capture sub-image from the first frame, the subregion information (as sub-window position) that synthesis module then can record according to the picture layout selected makes sub-image be shown in subregion to the retrieve information (as captured the position of sub-image) that signal source module can record according to the picture layout selected.Transitional information then can record sub-image and how be converted to corresponding subregion.
In one embodiment, television control apparatus can accept the control of user and select picture layout.And/or television control apparatus can select picture layout automatically.For example, access module can automatically according to the first vision signal and the Channel Access database corresponding to the second vision signal to select picture layout.And/or, access module can according to the running situation of television system automatically access database to select applicable picture layout.
In one embodiment, television control apparatus of the present invention can operate on a set model and a play mode, and, also comprise a setting module.When television control apparatus operates on set model, setting module can determine this part (i.e. sub-image) in the first frame according to an instruction, and/or, the subregion of this picture is determined according to an instruction.Such as, setting module can make multiple anchor point be shown in picture, and one of them of instruction these anchor points corresponding.For example, the position in anchor point determinant region that can select with instruction according to user of television control apparatus.When television control apparatus operates on play mode, the sub-window position that synthesis module just can determine according to setting module is shown in subregion to make sub-image.The shape of sub-image and/or subregion can be not limited to rectangle.
The present invention again about a kind of method controlling television system, as the running of television control apparatus of the present invention.
Accompanying drawing explanation
In order to have better understanding, preferred embodiment cited below particularly to addressing other side on the present invention, and coordinating institute's accompanying drawings, being described in detail below:
Fig. 1 signal be television system according to one embodiment of the invention.
Fig. 2 signal be the running embodiment of television system in Fig. 1.
Fig. 3 signal be television system according to one embodiment of the invention.
Fig. 4 and Fig. 5 signal be the running embodiment of Fig. 3 television system.
Fig. 6 signal be a kind of embodiment of picture layout in Fig. 3.
The running of Fig. 7 and Fig. 8 example schematic 3 television system.
Circuit in Fig. 9 schematic diagram 1 and Fig. 3 included by signal source module.
Figure 10 signal be flow process according to one embodiment of the invention.
Embodiment
Please refer to Fig. 1, what it was illustrated is according to the television system 10 of one embodiment of the invention.Television system 10 can comprise a screen 12(such as display panels) and a television control apparatus 16; For example, television control apparatus 16 can be a TV control chip, also can comprise peripheral circuit and the supportive device of TV control chip, such as driving chip, image processing chip and/or volatibility and/or non-volatile storage device etc.Television control apparatus 16 couples screen 12, in order to control screen 12, to show static and/or dynamic menu in a viewing area 14 of screen 12.
Television control apparatus 16 can comprise signal source module 18 and a synthesis module 20, and signal source module 18 is coupled to synthesis module 20.Signal source module 18 can receive multiple vision signal, for two vision signal S1 and S2 in Fig. 1.One or more frame can be comprised, such as frame S1 [n] in vision signal S1; Similarly, in vision signal S2, also can comprise one or more frame, such as frame S2 [n].Signal source module 18 can by obtaining frame S1 [n] and S2 [n] in vision signal S1 and S2 respectively.
The frame S2 [n] that basis signal source module 18 provides and sub-image S1 [n], synthesis module 20 can make frame S2 [n] fill and be shown in viewing area 14, and by an acquisition part (for the bottom of frame in Fig. 1) in frame S1 [n], as sub-image S1 [n] _ d, and sub-image S1 [n] _ d is shown in a sub regions 22 of viewing area 14.That is synthesis module 20 can make sub-image S1 [n] _ d be shown in subregion 22 in viewing area 14, and all the other areas of viewing area 14 then can in order to display frame S2 [n].Wherein, sub-image S1 [n] _ d is less than frame S1 [n].
In other words, television control apparatus 16 not only can display frame S2 [n], also can by sub-image S1 [the n] _ d capturing emphasis place in frame S1 [n], and use subregion 22 to show sub-image S1 [n] _ d fully, to get rid of unessential secondary part in frame S1 [n], make secondary part can not take the limited areal of subregion 22 for no reason.For example, vision signal S2 can be the main contents of user for viewing and admiring, and vision signal S1 can be the content that a news channel provides; User can utilize the technology of the present invention to take passages the headline of vision signal S1 part for sub-image and be shown in subregion 22, so, just synchronously can be concerned about headline when viewing and admiring vision signal S2.
Continuity Fig. 1 embodiment, please refer to Fig. 2, the one running embodiment of what it was illustrated is television control apparatus 16.In this embodiment, sub-image S1 [the n] _ d of frame S1 [n] can cover repeatedly on frame S2 [n] according to the size of subregion 22 and position by synthesis module 20, make frame S2 [n] be shown in viewing area 14 as a setting, also make sub-image S1 [n] _ d be shown in subregion 22 as prospect simultaneously.By vision signal S1 and S2(Fig. 1) in obtain frame S1 [n] and S2 [n] after, image processing 24a can be carried out to frame S2 [n], such as, say it is foundation viewing area 14(Fig. 1) resolution convergent-divergent etc. is carried out to frame S2 [n].On the other hand, after capturing sub-image S1 [n] _ d in frame S1 [n], then can carry out image processing 24b to it, such as, say it is, according to the size of subregion 12, convergent-divergent adjustment etc. is carried out to sub-image S1 [n] _ d.Then, sub-image S1 [n] _ d after treatment just can cover repeatedly on treated frame S2 [n], synthesizes frame Fx [n], to play in viewing area 14.
In one embodiment, synthesis module 20 can access (and/or a comprising) synthesis buffer 26 and two (or more individual) frame buffer (frame buffer), as frame buffer 28a and 28b.The building-up process of sub-image S1 [n] _ d and frame S2 [n] can utilize the memory space synthesizing buffer 26 and provide to carry out, and the synthetic frame Fx [n] of gained is just temporary in synthesis buffer 26; When playing frame Fx [n], synthetic frame Fx [n] can be read out (fetch) to frame buffer 28a by synthesis buffer 26, exports screen 12(Fig. 1 to by frame buffer 28a).While exporting synthetic frame Fx [n] by frame buffer 28a, just can synchronously utilize synthesis buffer 26 to synthesize sub-image S1 [the n+1] _ d of next frame S2 [n+1] and next frame S1 [n+1], to be formed next synthetic frame Fx [n+1] (not shown), and synthetic frame Fx [n+1] is read out to another frame buffer 28b.When by the time will show synthetic frame Fx [n+1], just can export synthetic frame Fx [n+1] by frame buffer 28b, another frame buffer 28a then can prepare to read next synthetic frame Fx [n+2] by synthesis buffer 26.In other words, two frame buffer 28a and 28b can alternately operate, and when one of them is when exporting a certain synthetic frame to screen, another frame buffer just can be used to next synthetic frame temporary.
In the another kind of embodiment of resultant image, synthesis module 20 directly reads frame S1 [n] and S2 [n] respectively according to the position of subregion 12 in time exporting, and can repeatedly cover.For example, when synthesis module 20 is when exporting i-th scan line (the non-icon) of synthetic frame Fx [n], if this scan line does not occur simultaneously with subregion 12, then synthesis module 20 can read i-th scan line that i-th scan line in frame S2 [n] take output as synthetic frame Fx [n].If i-th scan line and subregion 12 occur simultaneously in jth 1 to jth 2 pixels (all non-icon), then synthesis module 20 is when i-th scan line of output frame Fx [n], can by reading the 1st of i-th article of scan line in frame S1 [n] to jth 1 pixel, and the jth 1 being read i-th scan line by frame S2 [n] is to jth 2 pixels, more reads the jth 2 of i-th scan line to last pixel by frame S1 [n].
Please refer to Fig. 3, what it was illustrated is according to the television system 30 of one embodiment of the invention, and it can comprise screen 32 and a television control apparatus 36.Television control apparatus 36 couples screen 32, in order to control screen 32, to show static and/or dynamic menu in a viewing area 34 of screen 32.Television control apparatus 36 can comprise signal source module 38, synthesis module 40, access module 42 and a setting module 44.Signal source module 38 can obtain frame respectively by multiple vision signal (as vision signal S [1], S [2] to S [m] etc.).Synthesis module 40 is coupled to signal source module 38 and access module 42.
Access module 42 couples a database 46, to access this database 46; Database 46 can be realized by Nonvolatile memory, and it can be a part (as inline memory) for television control apparatus 36, also can be the external connection storage apparatus being external in television control apparatus 36.Database 46 is in order to store one or more picture layout L [1], L [2] to L [k] etc., and each picture layout L [.] is for recording the configuration of one " subregion " in viewing area 34; That is each picture layout L [.] can record the coordinate of one or more subregion, position and/or size.Television control apparatus 36 can be selected one of them L [k_selected] (not illustrating) by these picture layout L [.]; After signal source module 38 solves the frame of one or more vision signal, synthesis module 40 can according to the picture layout L selected [k_selected] to capture one or more sub-image from the frame of one or more vision signal, and make sub-image be shown in corresponding subregion according to the picture layout L [k_selected] selected.
The embodiment of continuity Fig. 3, please refer to Fig. 4, and several picture layout in its citing schematic data storehouse 46, as picture layout L [k1], L [k2] and L [k3].Picture layout L [k1] configures two sub regions Rs [k1,1] and Rs [k1,2], in order to show two sub-images for viewing area 34.According to this picture layout L [k1], signal source module 38(Fig. 3) solve vision signal S [a1] (not illustrating), frame S [the a1 of S [a2] (not illustrating) and S [a3] (not illustrating), n], S [a2, n] and S [a3, n], synthesis module 40 is respectively from frame S [a1, n], S [a2, n] in capture sub-image S [a1, n] _ d and S [a2, n] _ d, and by sub-image S [a1, n] _ d and S [a2, n] _ d is blended into subregion Rs [k1 respectively, 1] with Rs [k1, 2] using as prospect, cover repeatedly on background frames, such as frame S [a3, n].
Picture layout L [k2] can be viewing area 34 and provides two sub regions Rs [k2,1] and Rs [k2,2], in order to show two sub-images.If select this picture layout L [k2], signal source module 38 can solve vision signal S [b1] (not illustrating), frame S [the b1 of S [b2] (not illustrating) and S [b3] (not illustrating), n], S [b2, n] and S [b3, n], synthesis module 40 is respectively from frame S [b1, n] and S [b2, n] capture sub-image S [b1, n] _ d and S [b2, n] _ d, and by sub-image S [b1, n] _ d and S [b2, n] _ d is blended into subregion Rs [k2 respectively, 1] with Rs [k2, 2] using as prospect, cover repeatedly on background frames, such as, frame S [b3, n].
Picture layout L [k1] and L [k2] all provide two sub regions, but different pictures layout can be furnished with the subregion of different number and/or different kenel (difformity, diverse location and/or different size).For example, subregion Rs [k1,1] and the Rs [k1 of picture layout L [k1], 2] can be that two of horizontal-extending traverses rectangle, subregion Rs [k2,1] and the Rs [k2,2] of picture layout L [k2] can be then the rectangles being positioned at left side and lower right side.
Subregion can be not only rectangle, also can be polygonal, and namely the picture layout L [k3] in Fig. 4 comprises the subregion Rs [k3,1] of an irregular polygon.If select this picture layout L [k3], television control apparatus 30 can coordinate subregion Rs [k3,1] shape and by the frame S [c1 of a certain vision signal S [c1], n] in capture erose sub-image S [c1, n] _ d, make sub-image S [c1, n] _ d can be shown in subregion Rs [k3,1], in, be covered on background frames (the frame S [c2, n] of such as information source S [c2]).
By different picture layout, the present invention can be presenting of sub-image provides multiple choices, significantly promotes elasticity and enjoyment that user views and admires video content.In a kind of embodiment, television control apparatus 36 can accept the control of user, according to the selection of user by accessing the desired picture layout of user in database 46, and comes resultant image, display frame according to the picture layout that user selects.For example, television control apparatus 36 can operate on user's preference pattern and a play mode.When user will select picture layout, television control apparatus 36 can enter to user's preference pattern, use screen display (OSD, On-Screen Display) to present various picture layout in database 46, allow user can subregion configuration in preview different pictures layout.The selection receiving user when television control apparatus 36 controls, and just by the picture layout accessing user's selection in database 46, and can terminate user's preference pattern and enter to play mode.In play mode, the picture layout that television control apparatus 36 just can be selected according to user captures sub-image from different vision signals, synthesizes, and the frame of display synthesis.User controls can be control assigned via remote controller, acoustic control, touch-control and/or body sense to the selection of television control apparatus 36.
In one embodiment, television control apparatus 36 not only can select desired picture layout by user, also can automatically select specific picture layout; Such as, according to the picture layout in the next automatic access database of running situation (context) of television system 30.For example, television control apparatus 36 can automatically select picture layout for the channel of viewing according to user, such as say that user is the vision signal source of subregion for selection one sports channel, then television control apparatus 36 is selected automatically by score sheet Position Design is the picture layout of sub-image.And/or television control apparatus 36 can select picture layout automatically according to the time, such as, say and automatically select a certain picture layout when arriving a certain moment, by the time automatically switch to again another picture layout during another moment.And/or television control apparatus 36 can select a certain picture layout automatically according to the triggering of other signal (or device).For example, the sound arround the sustainable monitoring of television control apparatus 36, if meet a certain condition, then selects a certain picture layout automatically; This condition can be: by the sound having picked out certain kenel (or some frequency) in the sound, and/or volume is higher than (or lower than) certain threshold value.And/or television control apparatus 36 can select picture layout automatically according to the sensing result of optical sensor, such as, say it is automatically select a certain picture layout in brightness lower than during (or higher than) a certain threshold value.And/or television control apparatus 36 can coordinate the video camera before screen, automatically select picture layout with the result according to image identification; For example, if user's number before screen (the face number that can pick out) more than (or being less than) a certain face limit number time, then television control apparatus 36 selects a certain picture layout automatically.And/or if pick out the face of (or not picking out) a certain specific user, then television control apparatus 36 selects a certain picture layout automatically.And/or, if when dynamic (as gesture or the pupil tracing) of taking gained before screen meets a certain default kenel, then television control apparatus 36 selects a certain picture layout automatically.
In each picture layout L [.], be presented in different subregion Rs [. .] sub-image can from the frame of different video signal, also can from the same frame of same vision signal.For example, in the picture layout L [k2] of Fig. 4 citing, subregion Rs [k2,1] can be captured out by same frame with the sub-image of Rs [k2,2], namely foot mark b1 and b2 can be equal, frame S [b1, n] and S [b2, n] can be the same frames of same information source.And/or in same picture layout L [.], the sub-image being presented in different subregion also can capture the different frame from same vision signal respectively; For picture layout L [k2], the sub-image that be shown in subregion Rs [k2,1] and Rs [k2,2] can be respectively by frame S [b1, n] and S [b1, n-m] capture out.
In Fig. 3 embodiment, the picture layout L [.] in database 46 can be built-in in advance, also can be set up voluntarily by user and/or edit.Namely the setting module 44 of television control apparatus 36 is used for the custom picture layout of assisting user, such as, say it is all subregion in custom picture layout.Except previously mentioned user's preference pattern and play mode, television control apparatus 36 also can operate on a set model.Please refer to Fig. 5, its signal be the running embodiment of set model.Under set model, setting module 44(Fig. 3) screen display (OSD) can be used and make multiple alignment mark can be shown in viewing area 34, such as, horizontal gridlines h [1] in Fig. 5, h [2] to h [p_max] etc., and vertical gridlines v [1], v [2] to v [q_max] etc.User can between many intersection points (i.e. anchor point) of horizontal gridlines and vertical gridlines unrestricted choice, to orient the summit of subregion.Television control apparatus 36 can receive the control of user, and the intersection point that user selects is shown in viewing area 34, allows user can position of intersecting point selected by preview.Fig. 5 example of passing the imperial examinations at the provincial level illustrates two summit Q [q, 1] (being positioned at the intersection point of grid line v [q] and h [1]) and Q [1, the p] intersection point of h [p] (the grid line v [1] with).
Gather multiple summit, setting module 44 just can the range and position in determinant region, and makes the position of subregion can be recorded in corresponding picture layout via access module 42.For example, if user sets three summits, just definable goes out a leg-of-mutton subregion, can in order to show the triangle sub-image of a certain picture frame.And/or user also can the shape in first chooser region, point out geometric parameter needed for this kind of shape and necessary setting procedure by setting module 44; For example, if subregion is rectangle, user only can select two summits, as the diagonal two ends of rectangle; Or user can only select a bit as central point (or a summit) of rectangle, then set the length of rectangle and wide in increase and decrease mode.Moreover setting module 44 also can not show any grid line and alignment mark, user is allowed freely to determine the position on summit.And/or, setting module 44 also can realize other subregion design/edit mode, such as say: the subregion in another picture layout is imported the picture layout to current setting, and/or provide multiple built-in subregion to allow user import to the picture layout in setting at present, and/or allow user increase, delete, the summit in mover region, and/or position, the convergent-divergent subregion of sub area is moved down in the situation not changing subregion shape, and/or gyrator region etc.When television control apparatus 36 operates on play mode, the picture layout of setting module 44 earlier set just can be accessed via access module 42 from database 46; Then, signal source module 38 just can capture sub-image according to this, and synthesis module 40 makes sub-image be shown in subregion.
Please refer to Fig. 6, the information that what it was illustrated is included by picture layout L in one embodiment of the invention [k].Picture layout L [k] can comprise subregion information L [k] a, records the position and/or size etc. of one or more subregion, so that at viewing area 34(Fig. 4) in orient one or more subregion.In one embodiment of this invention, television control apparatus 36 can capture sub-image by whole frame carry out equal proportion according to the geometrical relationship between subregion and complete display area.For example, in the picture layout L [k1] of Fig. 4, suppose subregion Rs [k1,1] upright position is top 1/3rd place in viewing area 34, then capturing sub-image S [a1 by frame S [a1, n] is middle, n] _ d time, also be by frame S [a1, n] first three/acquisition is for sub-image S [a1, n] _ d.
In one embodiment of this invention, the geometrical relationship of sub-image and interframe also can independent of the geometrical relationship between subregion and viewing area, if not necessarily equal proportion between two geometrical relationships.Therefore, sub-image information L [k] b and transitional information L [k] c can optionally be comprised in picture layout L [k].Sub-image information L [k] b records the position and/or size etc. of one or more sub-image in frame, and transitional information L [k] c, in order to change this sub-image, makes the sub-image after conversion meet subregion.For example, please refer to the embodiment of Fig. 7; In this instance, picture layout L [k] makes sub-image S [m1, the n] _ d of frame S [m1, n] be shown in the subregion Rs [k, 1] of viewing area 34 via rotating (also can comprise convergent-divergent), to cover repeatedly before the background of frame S [m2, n].For realizing this kind of picture synthesis, subregion information L [k] a of picture layout L [k] records subregion Rs [k, 1] position (and/or size) in viewing area 34, sub-image information L [k] b records sub-image S [m1, n] _ d is in frame S [m1, n] in position (and/or size), what transitional information L [k] c recorded is then by sub-image S [m1, n] _ d inserts to subregion Rs [k, 1] video conversion required time and/or image processing, such as, say it is rotation and/or convergent-divergent etc.
Picture layout L [k] also optionally comprises out of Memory L [k] d; For example, information L [k] d can record the information source of each sub-image, such as, say it is will capture sub-image by the program of which (or which) channel.And/or information L [k] d can comprise: how each sub-image will synthesize with background frames, such as say be via pixel data with computing or computing, add computing or subtract computing etc. and sub-image is blended into background frames.
The position dimension of subregion and/or sub-image also can be set by television control apparatus 36 automatically.For example, television control apparatus 36 can carry out image analysing computer for a certain frame, automatically troops meeting a certain pre-conditioned pixel for sub-image, then inserts in subregion.Example as shown in Figure 8, television control apparatus 36 can at the series of frames S [m of same information source, n] with S [m, n+1] in carry out detection of dynamic, according to the part automatic determinant image S [m dynamically occurred, n] _ d and S [m, n+1] _ d position and capture, with by sub-image S [m, n] _ d and S [m, n+1] _ d is sequentially shown in the subregion Rs [k, 1] of viewing area.In viewing area 34, the position of subregion Rs [k, 1] can be fixing, also can move with sub-image position.
In the television control apparatus 10 and 30 of Fig. 1 and Fig. 3, signal source module 18 and 38 can comprise one or more decoding module, such as, two decoding module 50a and 50b shown in Fig. 9, and each decoding module obtains frame by a corresponding vision signal; For example, decoding module 50a and 50b can respectively by obtaining frame S1 [n] and S2 [n] in vision signal S1 and S2.The conformation function of decoding module 50a and 50b can be identical.For decoding module 50a, it can include a decoding unit 52a, a tone decoder (audio codec) 54a, an image decoding device (video codec) 56a, a captioning module 58a and a playing module 59a.In decoding module 50a, decoding unit 52a couples vision signal S1, the audio content solved by vision signal S1, presentation content and caption content send tone decoder 54a, image decoding device 56a and captioning module 58a respectively to, allow tone decoder 54a, image decoding device 56a and captioning module 58a decoding go out audio frequency, frame and captions and to be sent to playing module 59a.Last by playing module 59a output audio and frame S1 [n] (or adding the frame S1 [n] of captions).Decoding module 50b can include a decoding unit 52b, a tone decoder 54b, an image decoding device 56b, a captioning module 58b and a playing module 59b, its framework and function are similar to decoding unit 52a, tone decoder 54a, image decoding device 56a, captioning module 58a and playing module 59a respectively, therefore repeat no more.When television control apparatus 16 or 36 executive utility of television system 10 or 30 is to realize of the present invention, each decoding module 50a and 50b etc. can be controlled via the service routine of operating system (operation system) (service routine).
Please refer to Figure 10, the flow process 100 of its foundation one embodiment of the invention illustrated, it can in order to control a television system; For example, the television control apparatus 36 of Fig. 3 of the present invention can control television system 30 according to flow process 100.Flow process 100 can comprise the following steps.
Step 102: obtain frame, such as, say it is carry out decoding respectively to one first vision signal and one second vision signal, to obtain one first frame and one second frame respectively.
Step 104: access database (as Fig. 3 database 46), and select one of them by multiple picture layout of database storage.In a database, each picture layout in order to record various retrieve information (the acquisition position as sub-image) and subregion information (position as subregion), and can comprise a transitional information.Such as, how transitional information can be converted to corresponding subregion in order to each sub-image recorded in a picture layout.When carrying out step 104, the picture layout of wish employing can be selected by user; And/or, also can according to the running situation of television system automatically access database to select picture layout; Such as, can according to the Channel Access database corresponding to the first vision signal and the second vision signal.
Step 106: after step 104 selects picture layout, the retrieve information recorded according to the picture layout selected is using an acquisition part from the first frame as sub-image, further, the subregion information that the picture layout selected according to this records makes this sub-image be shown in corresponding subregion.
Flow process 100 optionally comprises a step 101, and it makes television system operate on set model, to determine sub-image and/or the subregion of a picture layout according to an instruction, such as, captures the position of sub-image and the position of subregion.In one embodiment, when carrying out step 101, multiple anchor point can be made to be shown in picture, and this instruction correspond to those anchor points one of them.End step 101, just can end setup pattern.Then, flow process 100 can continue to the play mode of step 102 and 106.
In summary, compared to known PIP technology, the present invention can show the sub-image of different video content in subregion, with efficiently multitask display different content, and there is changeableization, custom, height that can be customized can use elasticity, fully to meet the individual demand of user.
In sum, although the present invention with preferred embodiment disclose as above, so itself and be not used to limit the present invention.Persond having ordinary knowledge in the technical field of the present invention, without departing from the spirit and scope of the invention, when doing various changes and retouching.Therefore, the protection range of the present invention is when being as the criterion depending on the appended claim person of defining.
Claims (18)
1. a television control apparatus, applies to a television system, and this television system is in order to show a picture, and this television control apparatus comprises:
One signal source module, obtains one first frame and one second frame by one first vision signal and one second vision signal respectively; And
One synthesis module, when this second frame is shown in this picture, in this first frame, acquisition is a part of using as a sub-image, and makes this sub-image be shown in a subregion of this picture, and wherein, this sub-image is less than this first frame.
2. television control apparatus as claimed in claim 1, it is characterized in that, this signal source module comprises:
One first decoding module and one second decoding module, this first vision signal of decoding and this second vision signal are to obtain this first frame and this second frame respectively.
3. television control apparatus as claimed in claim 1, is characterized in that, also comprise:
One access module, in order to access multiple picture layout, those picture layout record its corresponding retrieve information and subregion information respectively;
Wherein, this television control apparatus selects one of them by those picture layout, the retrieve information that the picture layout that this synthesis module is selected according to this records to capture this sub-image from this first frame, and makes this sub-image be shown in this subregion according to the subregion information that the picture layout that this is selected records.
4. television control apparatus as claimed in claim 3, is characterized in that, select one of them according to the channel corresponding to this first vision signal and this second vision signal by those picture layout.
5. television control apparatus as claimed in claim 3, it is characterized in that, the running situation according to this television system selects one of them by those picture layout.
6. television control apparatus as claimed in claim 3, it is characterized in that, respectively this picture layout more comprises a transitional information, in order to change this sub-image, makes this sub-image after conversion meet this subregion.
7. television control apparatus as claimed in claim 1, it is characterized in that, it can operate on a set model, also comprises:
One setting module; When this television control apparatus operates on this set model, this setting module determines this part in this first frame according to an instruction.
8. television control apparatus as claimed in claim 7, it is characterized in that, this setting module makes multiple anchor point be shown in this picture, and this instruction corresponds to one of them of those anchor points.
9. television control apparatus as claimed in claim 1, it is characterized in that, it can operate on a set model, also comprises:
One setting module; When this television control apparatus operates on this set model, this setting module determines this subregion according to an instruction.
10. control a method for a television system, this television system is in order to show a picture, and the method comprises:
One first frame and one second frame is obtained respectively by one first vision signal and one second vision signal; And
When this second frame is shown in this picture, a part of using as a sub-image by acquisition in this first frame, and make this sub-image be shown in a subregion of this picture, wherein, this sub-image is less than this first frame.
11. methods as claimed in claim 10, is characterized in that, also comprise:
This first vision signal of decoding and this second vision signal are to obtain this first frame and this second frame.
12. methods as claimed in claim 10, is characterized in that, also comprise:
Access multiple picture layout, those picture layout record its corresponding retrieve information and subregion information respectively; And
One of them is selected by those picture layout, and the retrieve information recorded according to the picture layout that this is selected to capture this sub-image from this first frame, and the subregion information that the picture layout selected according to this records makes this sub-image be shown in this subregion.
13. methods as claimed in claim 12, is characterized in that, comprised by the step selecting one of them in those picture layout: select one of them according to the channel corresponding to this first vision signal and this second vision signal by those picture layout.
14. methods as claimed in claim 12, is characterized in that, comprised by the step selecting one of them in those picture layout: the running situation according to this television system selects one of them by those picture layout.
15. methods as claimed in claim 12, it is characterized in that, respectively this picture layout more comprises a transitional information, in order to change this sub-image, makes this sub-image after conversion meet this subregion.
16. methods as claimed in claim 10, is characterized in that, also comprise:
This television system is made to operate on a set model, to determine this part in this first frame according to an instruction.
17. methods as claimed in claim 16, is characterized in that, also comprise:
Under this set model, make multiple anchor point be shown in this picture, wherein, this instruction corresponds to one of them of those anchor points.
18. methods as claimed in claim 10, is characterized in that, also comprise:
This television system is made to operate on a set model, to determine this subregion according to an instruction.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201310347850.4A CN104349200B (en) | 2013-08-09 | 2013-08-09 | Television control apparatus and correlation technique |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201310347850.4A CN104349200B (en) | 2013-08-09 | 2013-08-09 | Television control apparatus and correlation technique |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN104349200A true CN104349200A (en) | 2015-02-11 |
| CN104349200B CN104349200B (en) | 2018-04-03 |
Family
ID=52503871
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201310347850.4A Expired - Fee Related CN104349200B (en) | 2013-08-09 | 2013-08-09 | Television control apparatus and correlation technique |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN104349200B (en) |
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106792223A (en) * | 2016-12-31 | 2017-05-31 | 天脉聚源（北京）科技有限公司 | The method and apparatus that many pictures are played in interactive interface |
| CN108347641A (en) * | 2017-01-25 | 2018-07-31 | 晨星半导体股份有限公司 | Coordinate the dynamic image processing device and dynamic image processing method of TV broadcast system |
| CN111405182A (en) * | 2020-03-26 | 2020-07-10 | 杭州趣维科技有限公司 | Video editing method for adjusting lens proportion |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US4249211A (en) * | 1978-02-07 | 1981-02-03 | Matsushita Electric Industrial Co., Ltd. | Composite image display apparatus |
| CN1205825A (en) * | 1995-12-29 | 1999-01-20 | 汤姆森消费电子有限公司 | Television system with provisions for displaying auxiliary image of variable size |
| CN1832548A (en) * | 2005-03-09 | 2006-09-13 | 三星电子株式会社 | Display apparatus and control method thereof |
| JP2006352208A (en) * | 2005-06-13 | 2006-12-28 | Matsushita Electric Ind Co Ltd | Video display apparatus |
| CN101335858A (en) * | 2007-06-26 | 2008-12-31 | 索尼株式会社 | Image processing device, method and program |
-
2013
- 2013-08-09 CN CN201310347850.4A patent/CN104349200B/en not_active Expired - Fee Related
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US4249211A (en) * | 1978-02-07 | 1981-02-03 | Matsushita Electric Industrial Co., Ltd. | Composite image display apparatus |
| CN1205825A (en) * | 1995-12-29 | 1999-01-20 | 汤姆森消费电子有限公司 | Television system with provisions for displaying auxiliary image of variable size |
| CN1832548A (en) * | 2005-03-09 | 2006-09-13 | 三星电子株式会社 | Display apparatus and control method thereof |
| JP2006352208A (en) * | 2005-06-13 | 2006-12-28 | Matsushita Electric Ind Co Ltd | Video display apparatus |
| CN101335858A (en) * | 2007-06-26 | 2008-12-31 | 索尼株式会社 | Image processing device, method and program |
Cited By (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106792223A (en) * | 2016-12-31 | 2017-05-31 | 天脉聚源（北京）科技有限公司 | The method and apparatus that many pictures are played in interactive interface |
| CN108347641A (en) * | 2017-01-25 | 2018-07-31 | 晨星半导体股份有限公司 | Coordinate the dynamic image processing device and dynamic image processing method of TV broadcast system |
| CN108347641B (en) * | 2017-01-25 | 2021-01-22 | 联发科技股份有限公司 | Dynamic image processing device and method matched with television transmission system |
| CN111405182A (en) * | 2020-03-26 | 2020-07-10 | 杭州趣维科技有限公司 | Video editing method for adjusting lens proportion |
| CN111405182B (en) * | 2020-03-26 | 2021-07-23 | 杭州小影创新科技股份有限公司 | Video editing method for adjusting lens proportion |
Also Published As
| Publication number | Publication date |
|---|---|
| CN104349200B (en) | 2018-04-03 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| TWI520610B (en) | Television control apparatus and associated method | |
| US8166420B2 (en) | Electronic apparatus and image display control method of the electronic apparatus | |
| US10334162B2 (en) | Video processing apparatus for generating panoramic video and method thereof | |
| JP5423183B2 (en) | Display control apparatus and display control method | |
| US8935169B2 (en) | Electronic apparatus and display process | |
| US8201105B2 (en) | Electronic apparatus and image display control method of the electronic apparatus | |
| US9733718B2 (en) | Display apparatus and display method thereof | |
| US20090034806A1 (en) | Electronic apparatus and face image display method | |
| CN102106145A (en) | Apparatus and method for displaying an enlarged target region of a reproduced image | |
| CN109661809A (en) | Show equipment | |
| US20170243613A1 (en) | Image processing apparatus that processes a group consisting of a plurality of images, image processing method, and storage medium | |
| CN104349200A (en) | Television control device and correlation method | |
| TW202008781A (en) | Generating method and playing method of multimedia file, multimedia file generation apparatus and multimedia file playback apparatus | |
| US20150326787A1 (en) | Control device, control method, and recording medium | |
| CN111464869B (en) | Motion position detection method, screen brightness adjustment method and intelligent device | |
| CN101667442A (en) | Digital home DVD player system for monitoring visitors and method thereof | |
| KR101481689B1 (en) | Method and apparatus for detecting multimedia contents using number information | |
| JP5318171B2 (en) | Electronic device and image display control method | |
| CN115643454A (en) | Display device, video playing method and device thereof | |
| JP2001103469A (en) | Object video image display device | |
| JP5038836B2 (en) | Information processing device | |
| CN117809592A (en) | Display device and layer refresh rate setting method | |
| CN114297435A (en) | Communication terminal and multi-screen interactive video browsing method | |
| JPH10243383A (en) | Video reproducing device, video recording device, information recording device and recording medium | |
| JPH0686167A (en) | Television monitor device |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant | ||
| TR01 | Transfer of patent right | ||
| TR01 | Transfer of patent right |
Effective date of registration: 20200414 Address after: No.1, Duhang 1st Road, Hsinchu City, Hsinchu Science Park, Taiwan, China Patentee after: MEDIATEK Inc. Address before: Taiwan Hsinchu County Tai Yuan Street China jhubei City, No. 26 4 floor 1 Patentee before: MSTAR SEMICONDUCTOR Inc. |
|
| CF01 | Termination of patent right due to non-payment of annual fee | ||
| CF01 | Termination of patent right due to non-payment of annual fee |
Granted publication date: 20180403 Termination date: 20210809 |