CN103517126A - Mosaic video display method, display control device and terminal - Google Patents

Mosaic video display method, display control device and terminal Download PDF

Info

Publication number
CN103517126A
CN103517126A CN201210203274.1A CN201210203274A CN103517126A CN 103517126 A CN103517126 A CN 103517126A CN 201210203274 A CN201210203274 A CN 201210203274A CN 103517126 A CN103517126 A CN 103517126A
Authority
CN
China
Prior art keywords
mosaic region
operand
mosaic
primary importance
region
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN201210203274.1A
Other languages
Chinese (zh)
Inventor
黄神治
亢治
任雁蒙
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Huawei Technologies Co Ltd
Original Assignee
Huawei Technologies Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Huawei Technologies Co Ltd filed Critical Huawei Technologies Co Ltd
Priority to CN201210203274.1A priority Critical patent/CN103517126A/en
Priority to PCT/CN2013/070535 priority patent/WO2013189179A1/en
Publication of CN103517126A publication Critical patent/CN103517126A/en
Pending legal-status Critical Current

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/41—Structure of client; Structure of client peripherals
    • H04N21/422—Input-only peripherals, i.e. input devices connected to specially adapted client devices, e.g. global positioning system [GPS]
    • H04N21/42204—User interfaces specially adapted for controlling a client device through a remote control device; Remote control devices therefor
    • H04N21/42206—User interfaces specially adapted for controlling a client device through a remote control device; Remote control devices therefor characterized by hardware details
    • H04N21/42224—Touch pad or touch panel provided on the remote control
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0487—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
    • G06F3/0488—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures
    • G06F3/04886—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures by partitioning the display area of the touch-screen or the surface of the digitising tablet into independently controllable areas, e.g. virtual keyboards or menus
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/47—End-user applications
    • H04N21/482—End-user interface for program selection
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F2203/00—Indexing scheme relating to G06F3/00 - G06F3/048
    • G06F2203/048—Indexing scheme relating to G06F3/048
    • G06F2203/04808—Several contacts: gestures triggering a specific function, e.g. scrolling, zooming, right-click, when the user establishes several contacts with the surface simultaneously; e.g. using several fingers or a combination of fingers and pen
    • G—PHYSICS
    • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G5/00—Control arrangements or circuits for visual indicators common to cathode-ray tube indicators and other visual indicators
    • G09G5/14—Display of multiple viewports

Landscapes

  • Engineering & Computer Science (AREA)
  • Human Computer Interaction (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • General Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • User Interface Of Digital Computer (AREA)

Abstract

A mosaic video display method, a display control device and a terminal are provided. The mosaic video display method disclosed in the invention comprises: receiving a plurality of video data streams; invoking mutually-independent players, the number of which is the same as the number of the video data streams, each player being used for displaying one mosaic cell; based on a preset distribution rule, distributing the plurality of video data streams respectively to the player corresponding to each video data stream, and controlling each distributed video data stream to respectively display in the corresponding mosaic cell. Through the technical scheme in the invention, an independent program source can be set for each mosaic cell, and user experience is improved.

Description

The method that mosaic video presents, display control unit and terminal
Technical field
The present invention relates to communication technical field, be specifically related to method, display control unit and terminal that mosaic video presents.
Background technology
Develop rapidly along with Digital Television, satellite television, Web TV, the quantity of TV programme is more and more, it is traditional that full frame to browse the information of once browsing few, when user will browse all programs, need ceaselessly zapping, reduced surfing, this full frame browsing mode can not meet user's needs.And browsing mode based on mosaic (MC, Mosaic Cell) allows user to browse a plurality of video frequency programs simultaneously, can once switch a plurality of video frequency programs, accelerated the speed that user browses.
So-called MC is divided into display screen a plurality of regions (Cell) exactly, such as 3 * 3, and 4 * 4 viewing area etc.The different content of independent demonstration in each region, such as different channels.Mosaic is Digital Television, Internet TV (IPTV, Interactive Personality TV), internet television (OTT Video, Over-The-Top Video) a very attractive business in, in digital video broadcasting (DVB, Digital Video Broadcasting), there is specially definition.
Current Mosaic video presents scheme and is: the sectional drawing of general Shi Jiang mono-road video and other several roads videos is frequently multiplexed into a circuit-switched data stream and sends to terminal, then after terminal demultiplexing, present respectively, or by the synthetic road video of all videos, in terminal, synthetic picture is played up on screen, at video, being can only be that one of them MC presents with video now, other non-MC of choosing present with video interception or programme form, or the mode on the synthetic road of the video of several MC is presented, in fact being equivalent to single video plays, and existing these schemes all can not be independently for each MC arranges program source, cause user to experience poor.
Summary of the invention
A kind of method that the embodiment of the present invention provides mosaic video to present, can not be independently each mosaic region division program source for what solve that prior art exists, causes the problem of poor user experience.
The method that mosaic video presents, comprising:
Receive a plurality of video data streams;
Call the separate a plurality of players identical with a plurality of video data stream quantity, each player is for presenting a mosaic region in viewing area;
According to preset allocation rule, a plurality of video data streams are distributed to respectively to player corresponding with each video data stream in a plurality of players, and the mosaic region that each video data stream after control distribution presents at corresponding player presents.
, comprising:
Receiving element, for receiving a plurality of video data streams;
Call unit, for calling the identical separate a plurality of players of a plurality of video data stream quantity that receive with receiving element, each player in a plurality of players is for presenting a mosaic region in viewing area;
Allocation units, for the allocation rule according to preset, distribute to player corresponding in a plurality of players by each video data stream in a plurality of video data streams;
Control unit, the mosaic region presenting at corresponding player for each video data stream of controlling after allocation units distribute presents.
A kind of terminal, terminal comprises display control unit and display screen, display screen is used for providing viewing area, display control unit is the display control unit in such scheme, and display screen is the video data stream presenting in mosaic region for showing that in viewing area display control unit is controlled also.
The embodiment of the present invention adopts and receives a plurality of video data streams; Call the separate player identical with described video data stream quantity, described in each, player is used for presenting a mosaic region; According to preset allocation rule, a plurality of described video data streams are distributed to respectively to the player corresponding with each video data stream, and each video data stream of controlling after described distribution presents respectively in corresponding mosaic region.On same screen of the prior art, can only there is a mosaic region display video programs to compare, the method that the mosaic video that the embodiment of the present invention provides presents, can, for each mosaic region division program source independently, improve user's experience.
Accompanying drawing explanation
Fig. 1 is an embodiment schematic diagram of the method that provides of the embodiment of the present invention;
Fig. 2 is the present invention's one scene example schematic;
Fig. 3 A ~ 3D is another scene example schematic of the present invention;
Fig. 4 is another scene example schematic of the present invention;
Fig. 5 is another scene example schematic of the present invention;
Fig. 6 is another scene example schematic of the present invention;
Fig. 7 A ~ 7B is another scene example schematic of the present invention;
Fig. 8 A ~ 8B is another scene example schematic of the present invention;
Fig. 9 A ~ 9C is another scene example schematic of the present invention;
Figure 10 is another scene example schematic of the present invention;
Figure 11 is another scene example schematic of the present invention;
Figure 12 is another scene example schematic of the present invention;
Figure 13 is another scene example schematic of the present invention;
Figure 14 is another scene example schematic of the present invention;
Figure 15 is an embodiment schematic diagram of display control unit of the present invention;
Figure 16 is another embodiment schematic diagram of display control unit of the present invention;
Figure 17 is another embodiment schematic diagram of display control unit of the present invention;
Figure 18 is another embodiment schematic diagram of display control unit of the present invention;
Figure 19 is another embodiment schematic diagram of display control unit of the present invention;
Figure 20 is another embodiment schematic diagram of display control unit of the present invention;
Figure 21 is another embodiment schematic diagram of display control unit of the present invention;
Figure 22 is another embodiment schematic diagram of display control unit of the present invention;
Figure 23 is another embodiment schematic diagram of display control unit of the present invention;
Figure 24 is another embodiment schematic diagram of display control unit of the present invention;
Figure 25 is an embodiment schematic diagram of terminal of the present invention;
Figure 26 is another embodiment schematic diagram of terminal of the present invention.
Embodiment
A kind of method that the embodiment of the present invention provides mosaic video to present, can, for each mosaic region division program source independently, improve user's experience.The embodiment of the present invention also provides corresponding display control unit and terminal.Below be elaborated respectively.
Consult Fig. 1, an embodiment of the method that the mosaic video that the embodiment of the present invention provides presents comprises:
101, receive a plurality of video data streams.
It should be noted that, " video " here generally refers to existing image, has again the video of sound, and not only comprises " video " that only has image.Certainly, in actual use procedure, also can use and only have image and asonant " video ", processing scheme and the present embodiment processing scheme are similar in this case, (those skilled in the art only need to process audio frequency part to save), repeats no more here.
102, call the separate a plurality of players identical with described a plurality of video data stream quantity, described in each, player is for presenting a mosaic region in viewing area.
Display control unit receives after video data stream, display control unit calls the separate player identical with described video data stream quantity, and described in each, player is in viewing area, (region of screen for showing) presents a mosaic region.The player of the embodiment of the present invention can be realized based on software and hardware, and the present embodiment is preferably used software to realize, and can reduce the demand to hardware like this, implements more flexible." separate " of the embodiment of the present invention refers to that these players are not controlled by other players when displaying video, as each player can be independently to video volume, video display position, video shows size, broadcasting skip forward/back etc. is controlled, and not controlled by other players.Certainly, the present embodiment does not limit based on hardware yet and realizes separate a plurality of players.
Controlling mosaic region corresponding the process that independently player presents video data stream is: player comprises document analysis thread, video decode thread and audio decoder thread, the corresponding video data queue of video decode thread, the corresponding voice data queue of audio decoder thread, document analysis thread is resolved video data stream, in judgement video data stream, the type of packet is (as for a mp4 video data number, analyze the characteristic information of each bag the inside, as the type information containing in packet header, judge that this bag belongs to audio pack, video packets, or other types), and according to the type of the packet judging after resolving, packet is put into corresponding video data queue or voice data queue, video decode thread and audio frequency solve thread respectively from video data queue and voice data queue data fetch packet decode and present and (play up in the mosaic region corresponding with this player, play).Wherein, mosaic region with one independently painting canvas play up decoded video image, and move freely in the Ke interface, position of painting canvas; Audio frequency can independently be adjusted volume, and can open at any time and forbid sound, when sound is forbidden, document analysis thread is not put into packets of audio data in the middle of the queue that audio decoder thread is corresponding, or audio decoder thread abandons audio pack, do not decode and present, to save system resource.
Above-mentioned document analysis thread, video decode thread and audio decoder thread can have one or more, and (as large in data volume, to increase thread) can be set according to the data volume size of processing.
103, according to preset allocation rule, a plurality of described video data streams are distributed to respectively to player corresponding with each video data stream in a plurality of players, and control the mosaic region that each video data stream after described distribution presents at corresponding player and present.
Preset allocation rule can be: the order in mosaic region, successively video flowing is distributed to each mosaic region, and can be also the order of customization, as the mosaic region in appointment presents the video frequency program of appointment.
Call after player corresponding to mosaic region, a plurality of described video data streams are distributed to respectively to the player corresponding with each video data stream, and each video data stream of controlling after described distribution presents respectively in corresponding mosaic region.
In the embodiment of the present invention, adopt and receive a plurality of video data streams; Call the separate player identical with described video data stream quantity, described in each, player is used for presenting a mosaic region; According to preset allocation rule, a plurality of described video data streams are distributed to respectively to the player corresponding with each video data stream, and each video data stream of controlling after described distribution presents respectively in corresponding mosaic region.On same screen of the prior art, can only there is a mosaic region display video programs to compare, the method that the mosaic video that the embodiment of the present invention provides presents, can, for each mosaic region division program source independently, improve user's experience.
Alternatively, on the basis of above-described embodiment, the embodiment of the present invention can also comprise: determine that user uses the primary importance in the selected viewing area of operand; Determine the first mosaic region that described primary importance is affiliated; Detect the operational motion of described operand to described the first mosaic region, when described operational motion to be detected be predetermined move operation, call the first player corresponding to mosaic region, the first mosaic region after the position display after moving according to described operand is upgraded.
Operand in the embodiment of the present invention can be finger, mouse, pointer, eyes etc., as long as can carry out the operation in the embodiment of the present invention, the operand in the embodiment of the present invention is not limited.
When the embodiment of the present invention is applied to touch panel device, can obtain the primary importance that user touches by described touch-screen; Determine the first mosaic region that described primary importance is affiliated; By described touch-screen, continue to detect the change of described user touch location; When in the first preset time, during described user touch location generation continuous moving, call described the first player corresponding to mosaic region, along the first mosaic region after described user touch location moving direction display update.
Predetermined move operation in the embodiment of the present invention can be: whether, during touch control operation, first detect and pin a bit, if within the predetermined time, the skew of touch point occurrence positions, is defined as occurring " move operation "; If during mouse-based operation, definition a mouse click left button or right button, and when pinning key, rolling mouse, is defined as " move operation ".When being eyes operation, can first keep a close watch on a bit by eyes, then eyeball moves, and is defined as occurring " move operation ".
Consult Fig. 2, user uses operand, as: finger, the primary importance in selected viewing area, the coordinate of primary importance is (X, Y), display control unit is determined after the coordinate (X, Y) of primary importance, is more further determined the coordinate (X of primary importance, Y) in the first mosaic region, the first mosaic is rectangle (x, y, w for region, h) represent, x wherein, y is the coordinate of rectangle top left corner apex, w is rectangle width, h is rectangle height, determines that primary importance in the process in the first mosaic region is: when simultaneously, meet x < X < x+w; During y < Y < y+h, determine the first mosaic region that described primary importance is affiliated.
Consult Fig. 3 A, on display screen, there are 4 mosaic regions, be respectively Channel1, Channel2, Channel3, Channel4, from Fig. 3 A, can find out that user uses primary importance in the selected viewing area of operand in Channel4 mosaic region, when display control unit continues to detect the operational motion of described operand, the position of stating operand detected movement has occurred, can be defined as described operational motion for the move operation with fixed, thereby call player corresponding to Channel4 mosaic region, the first mosaic region after upgrading according to the position display of described operand.
As shown in Figure 3 B, after move in the mosaic region of Channel4, if other mosaic regions are all at displaying video programs, after the mosaic region that display control unit detects Channel4 is so released, original position will be got back in the mosaic region of the Channel4 after mobile.Consult Fig. 3 C, if there is a mosaic region there is no displaying video programs, after the mosaic region that display control unit detects Channel4 is so released, the mosaic region of Channel4 is moved to the mosaic regional location of original Channel1.Consult Fig. 3 D, when near the boundary position in Channel1 mosaic region and Channel2 mosaic region of the center in mosaic region that display control unit detects Channel4, control this border by highlighted demonstration, if the mosaic region of the Channel4 after moving being detected is released, the mosaic region of Channel4 is inserted between Channel1 mosaic region and Channel2 mosaic region, border Channel2 below successively backward or move forward lattice.
Concrete translation principle can be consulted Fig. 4 and be understood: the coordinate of the initial primary importance that display control unit is determined is (X, Y), the position coordinates of last operation object detected for being (X+ Δ x, Y+ Δ y), can determine that described operational motion is predetermined move operation, so along the mosaic region of the position translation Channel4 of described operand, and the first mosaic region after upgrading according to the position display of described operand.
Alternatively, on the basis of embodiment corresponding to above-mentioned Fig. 1, also comprise: determine that user uses the primary importance in the selected viewing area of operand; Determine the first mosaic region that described primary importance is affiliated; Detect described operand at the operational motion of described primary importance, when detect described operand at the operational motion of described primary importance for predetermined while choosing operation, and described the first mosaic region is just when displaying video programs, start the sound of player corresponding to described the first mosaic region, make described the first mosaic region present Voice & Video program simultaneously, and highlight described mosaic region.
This process can be consulted Fig. 5 and be understood, on display screen, there are 4 mosaic regions, be respectively Channel1, Channel2, Channel3, Channel4, determine that user uses primary importance in the selected viewing area of operand in Channel1 mosaic region, when described operational motion being detected for predetermined while choosing operation, can think that Channel1 mosaic is selected, when described mosaic region is during just at displaying video programs, start the sound of player corresponding to described the first mosaic region, make described the first mosaic region present Voice & Video program simultaneously, and highlight described mosaic region.
The predetermined operation of choosing in the embodiment of the present invention can be: whether, during touch control operation, first detect and pin a bit, if within the predetermined time, touch point is the skew of occurrence positions not, is defined as occurring " choosing operation "; If during mouse-based operation, definition a mouse click left button or right button, and only pinned left button or right button, within the predetermined time, mouse is not mobile, is defined as " choosing operation ".When being eyes whens operation, eyes rooted a bit, within the predetermined time, eyeball does not move, and is defined as occurring " choosing operation ".
Alternatively, on the basis of the above-mentioned embodiment that chooses operation, also comprise: determine described the first mosaic region under the described second place or the second mosaic region different from described the first mosaic region; Detect described operand at the operational motion of the described second place, when the operational motion of described operand in the described second place being detected, be described predetermined while choosing operation, and the described second place is in described the second mosaic region, close the sound of player corresponding to described the first mosaic region, and cancel highlighting of described the first mosaic region, start the sound of player corresponding to described the second mosaic region, and highlight described the second mosaic region; When the described second place is during in described the first mosaic region, close the sound of player corresponding to described the first mosaic region, and cancel highlighting of described the first mosaic region.
This process can be take Fig. 5 as basis, consulting Fig. 6 understands, on display screen, there are 4 mosaic regions, be respectively Channel1, Channel2, Channel3, Channel4, Channel1 mosaic region is selected, in highlighting state, when determining that user uses the second place in the selected viewing area of operand in Channel4 mosaic region, close the sound in Channel1 mosaic region, cancel highlighting of Channel1 mosaic region, start the sound in Channel4 mosaic region, and highlight Channel4 mosaic region, just sound this part cannot show in the drawings.
Highlight and can comprise a variety ofly, demonstration as highlighted in frame or other colors show etc.
The process that Fig. 6 tells about be the second place from primary importance in different mosaic regions, in fact, the second place and primary importance can be in same mosaic regions, as, all in Channel1 mosaic region, this situation, cancel the selected state in Channel1 mosaic region, close the sound in Channel1 mosaic region, cancel highlighting of Channel1 mosaic region, get back to the show state on the Tu5Zhong left side.
Alternatively, on the basis of embodiment corresponding to above-mentioned Fig. 1, also comprise: determine that user uses the primary importance in the selected viewing area of operand; Determine the first mosaic region that described primary importance is affiliated; Detect described operand at the operational motion of described primary importance, when described operand being detected, at the operational motion of described primary importance, change while frequently operating for predetermined first, obtain video data stream corresponding to channel after changing frequently, call the first player corresponding to mosaic region, described in playing in described the first mosaic region, change video data stream corresponding to channel after frequency.
Change frequently, it is switching channels, in the embodiment of the present invention predetermined first changed operation frequently and can be: during touch control operation, whether first detection points or pointer slips in viewing area, if within the predetermined time, finger or pointer slip in viewing area, and the original position of sliding and end position are in same mosaic region, be defined as " first change frequently operation " if during mouse-based operation, definition a mouse click left button or right button, and left button or right button have only been pinned, within the predetermined time, drag fast mouse, and the original position of mouse and end position are in same mosaic region, be defined as " first changes operation frequently ", when being eyes operation, eyes rooted a bit, within the predetermined time, eyeball moves rapidly, and the original position of keeping a close watch on viewing area of eyeball and end position are in same mosaic region, be defined as " first changes operation frequently ".
In Fig. 7 A, hand slides left, in Fig. 7 B, hand slides to the right, by the original position of pointing, end position can determine that the position of operand occurs in same mosaic region, can know to carry out and change operation frequently, according to described glide direction switching channels, can stipulate if slide left, this MC switching program source is next channel, slide to the right, this MC switching program source is a upper channel, in fact also can be conversely, this is not limited, what in the present embodiment, provide is to slide left, this MC switching program source is next channel, slide to the right, this MC switching program source is a upper channel, if the current broadcasting of this MC is last channel, be switched to first channel, if slide to the right, this MC switching program source is a upper channel, if the current broadcasting of this MC is first channel, this MC switching program source is last channel.
When described operational motion being detected and frequently operate for predetermined changing, obtain video data stream corresponding to channel after changing frequently, call the first player corresponding to mosaic region, in described the first mosaic region, play the video data stream of obtaining.
Alternatively, on the basis of embodiment corresponding to above-mentioned Fig. 1, also comprise: determine that user uses the primary importance in the selected viewing area of operand; Determine the first mosaic region that described primary importance is affiliated; Detect described operand at the operational motion of described primary importance, when detect described operand at the operational motion of described primary importance for predetermined while turning over screen operation, remove mosaic region current in described viewing area, generate new mosaic region, and call described each new player corresponding to mosaic region, control video data stream corresponding to described each new mosaic region and present in described each new mosaic region of correspondence.
In the embodiment of the present invention, predetermined turn over screen operation and can be: during touch control operation, whether first detection points or pointer slips in viewing area, if within the predetermined time, finger or pointer slip in viewing area, and the original position of sliding and end position are in different mosaic regions, be defined as " turn over screen operation " if during mouse-based operation, definition a mouse click left button or right button, and left button or right button have only been pinned, within the predetermined time, drag fast mouse, and the original position of mouse and end position are in different mosaic regions, be defined as " turning over screen operation ", when being eyes operation, eyes rooted a bit, within the predetermined time, eyeball moves rapidly, and the original position of keeping a close watch on viewing area of eyeball and end position are in different mosaic regions, be defined as " turning over screen operation ".
When needs turn over screen, remove mosaic region current in described viewing area, generate new mosaic region, and call described each new player corresponding to mosaic region, control video data stream corresponding to described each new mosaic region and present in described each new mosaic region of correspondence.
Contrast Fig. 7 A and Fig. 7 B introduce is that original position and the end position of operand is the situation in same mosaic region, when operand original position and end position during not in same mosaic region, can consult Fig. 8 A and Fig. 8 B understands, four mosaic regions in Fig. 8 A in display screen are respectively Channel1, Channel2, Channel3, Channel4, determine to carry out and turn over screen operation, according to glide direction, turn over screen, can stipulate to slide left for turning over backward screen, slide as turning over forward screen to the right, as Fig. 8 A, slide left, to turn over screen to Channel5, Channe6, Channel7, Channel8, Fig. 8 B is for sliding to the right, there is Channel5, Channe6, Channel7, Channel8 turns over screen to Channel1, Channel2, Channel3, Channel4.In Fig. 8 A and Fig. 8 B, turning over screen gesture is 1 finger, can be in fact also a plurality of fingers, indicate these fingers be all simultaneously, equidirectional action.
Alternatively, on the basis of embodiment corresponding to above-mentioned Fig. 1, also comprise: determine that user uses the primary importance in the selected viewing area of operand; Determine the first mosaic region that described primary importance is affiliated; Detect described operand at the operational motion of described primary importance, when the operational motion of described operand in described primary importance to be detected be predetermined video deletion action, discharge the player in the mosaic region under the position of described operand, make mosaic region under the position of described operand stop video and present.
Video deletion action predetermined in the embodiment of the present invention can be: user uses operand to click the delete dialog box on mosaic region, may be defined as " video deletion action ", user uses operand to click the delete button in mosaic region, may be defined as " video deletion action ", user uses and dwindles gesture in the slip of same mosaic region, may be defined as " video deletion action ".
This process can be consulted Fig. 9 A ~ 9C and be understood, current MC is just when broadcast program, can be by long by ejecting dialog box button or dwindling the operations such as gesture and delete program source, delete after program mosaic zone players and stop and presenting sleazy default prompting background.As shown in Figure 9 A, when display control unit receives deletion action instruction, and the position that obtains this deletion action instruction generation is in certain mosaic region, if have program to play in this MC, eject a delete dialog box inquiry user and whether delete this channel, user confirms to delete the program that play in this mosaic region, cancels and can cancel operation.As shown in Figure 9 B, if the initial distance of two occurrence positions of the deletion action instruction that system display control device detects is less than final distance, namely dwindle gesture, whether first decision operation occurs in certain MC region, if detect and dwindle gesture to occur in certain MC inner, and when the ratio of convergent-divergent is during over certain predefined value, if this MC is playing certain program, this MC stops broadcast program, and background is made as the acquiescence background that prompting does not have program to play.Or when system has detected some hitter's gesture and has occurred, first judge whether gesture occurs in certain MC, as shown in Figure 9 C, if the position that deletion action instruction occurs is that the delete button in MC is inner, if it is confirm delete button click, confirm deletion event, stopping MC program plays, background is made as the background that acquiescence prompting does not have program to play, namely discharge the player in the mosaic region under the position of described operand, make mosaic region under the position of described operand stop video and present.
Alternatively, on the basis of embodiment corresponding to above-mentioned Fig. 1, also comprise: determine that user uses primary importance and the second place in the selected viewing area of operand; Determine the mosaic region that described primary importance and the second place are affiliated; When described primary importance and the second place coexist the first mosaic region, detect the operational motion of described operand, when described operational motion to be detected be predetermined zoom operations, control described the first mosaic region and dwindle or amplify.
In the embodiment of the present invention, predetermined zoom operations can be: during touch control operation, first detect original position and the end position of two fingers, when the original position of two fingers and end position are all in same mosaic region, and when the distance of the end position of two fingers is less than the distance of original position, be defined as " reduction operation ", when the original position of two fingers and end position are all in same mosaic region, and when the distance of the end position of two fingers is greater than the distance of original position, be defined as " amplifieroperation "; If during mouse-based operation, in the mosaic region of amplifying, double-click mouse, be defined as " reduction operation ", in normal mosaic region, double-click mouse, be defined as " amplifieroperation ", when being eyes operation, eyes rooted the mosaic region of amplifying, twice eyes that blink are defined as " reduction operation ", eyes rooted normal mosaic region, twice eyes that blink are defined as " amplifieroperation ".
Alternatively, on the basis of embodiment corresponding to above-mentioned Fig. 1, also comprise: determine that user uses primary importance and the second place in the selected viewing area of operand; Determine the mosaic region that described primary importance and the second place are affiliated; When described primary importance and the second place are during respectively in the first mosaic region and the second mosaic region, detect the operational motion of described operand, when described operational motion being detected and be the operation of the video that shows in predetermined two mosaic regions of exchange, call respectively player corresponding to the first mosaic region and the second player corresponding to mosaic region, the first mosaic region and the second mosaic region after upgrading according to the position display of described operand.
In the embodiment of the present invention, the operation of the video showing in predetermined two mosaic regions of exchange can be: during touch control operation, first detect original position and the end position of two fingers, when the original position of two fingers and end position are all in different mosaic regions, and when the distance of the end position of two fingers is less than the distance of original position, be defined as " swap operation "; When being eyes whens operation, two eyes rooteds two mosaic regions, twice eyeballs, to rotating, are defined as " exchanging the operation of the video showing in two mosaic regions ".
The process moving for two mosaic regional locations can be consulted Figure 10 and be understood, as shown in figure 10, on display screen, there are 4 mosaic regions, be respectively Channel1, Channel2, Channel3, Channel4, determine that user uses after the primary importance and the second place in the selected viewing area of operand, determine the mosaic region that described primary importance and the second place are affiliated, as the Channel1 and the Channel2 mosaic region that occur respectively, continue to detect the operational motion of described operand, when described operational motion to be detected be predetermined swap operation, the mobile Channel1 of movement and Channel2 mosaic region along with operand position, last Channel1 mosaic region moves to the position in original Channel2 mosaic region, Channel2 mosaic region moves to the position in original Channel1 mosaic region, realize the exchange in two mosaic regions.
Consult Figure 11, the position of operand detected in Channel2 and Channel3 mosaic region, when the termination distance of two finger positions being detected and be less than initial distance, by the location swap in Channel2 and Channel3 mosaic region.
Consult Figure 12, when primary importance and the second place being detected in same mosaic region, as Channel2 mosaic region, when detect the initial distance of the position of two fingers be less than stop apart from time, amplify Channel2 mosaic region, otherwise, when the termination distance of the position of two fingers being detected and be less than initial distance, dwindle Channel2 mosaic region.
Alternatively, on the basis of embodiment corresponding to above-mentioned Fig. 1, also comprise: generate and indicated channel list area; Detect user and use the operational motion of operand to described channel list region, when described operational motion to be detected be predetermined move operation, determine that described move operation moves Hou position, channel list region described in the position display after described movement.
Predetermined move operation in the embodiment of the present invention can be: whether, during touch control operation, first detect and pin a bit, if within the predetermined time, the skew of touch point occurrence positions, is defined as occurring " move operation "; If during mouse-based operation, definition a mouse click left button or right button, and when pinning key, rolling mouse, is defined as " move operation ".When being eyes operation, can first keep a close watch on a bit by eyes, then eyeball moves, and is defined as occurring " move operation ".
For channel list district, can consult Figure 13 understands, when display control unit, determine user and use the primary importance in the channel list region that operand chooses, continue to detect the operational motion of described operand, when described operational motion to be detected be predetermined move operation, the Position Control after moving according to described operand shows described channel list region.
Alternatively, on the basis of the above-mentioned embodiment that comprises channel list region, also comprise: a plurality of channel options of described channel list district inclusion, the corresponding channel of each channel option, described method also comprises: determine the operating position of described operand on described channel list region, determine the channel option that described operating position is corresponding, detect the operational motion of described operand to described channel option; When described operational motion being detected, change while frequently operating for predetermined second, obtain video data stream that channel after changing is frequently corresponding to change the video data stream of the channel that described channel option is corresponding; Determine the affiliated mosaic region of channel corresponding to described channel option of described operand operation; Call player corresponding to mosaic region under described, video data stream corresponding to channel after changing frequently described in broadcasting.
Change frequently, it is switching channels, in the embodiment of the present invention predetermined second changed operation frequently and can be: during touch control operation, whether first detection points or pointer is pinned a bit in channel list district, when the time of pinning any, surpass after the scheduled time, finger or pointer move to mosaic region, be defined as " second changes operation frequently ", if during mouse-based operation, definition a mouse click left button or right button, and left button or right button have only been pinned, when the time of pinning any, surpass after the scheduled time, mouse moves to mosaic region, be defined as " second changes operation frequently ", when being eyes operation, eyes rooted a bit, when the time of keeping a close watch on any, surpass after the scheduled time, eyes rooted point moves to mosaic region, be defined as " second changes operation frequently ".
For this process, can consult Figure 14 understands, when the operational motion of finger on channel list region being detected, change while frequently operating for predetermined second, obtain video data stream corresponding to channel Channeli after changing frequently, determine the mosaic region that described operand is affiliated; Call player corresponding to mosaic region under described operand, obtain video data stream corresponding to channel after changing frequently described in broadcasting.
A plurality of embodiments of the method that more than provide are all to carry out on the basis of Fig. 1, in fact, technical scheme provided by the invention is not limited to above embodiment, each technical scheme from power can superpose mutually, and there is no sequencing between the technical scheme of setting forth on the basis of Fig. 1, as long as reach predefined operation, just can realize the function that will realize from power technical scheme.
Consult Figure 15, based on the various embodiments described above, an embodiment of the display control unit that the embodiment of the present invention provides comprises:
Receiving element 201, for receiving a plurality of video data streams;
Call unit 202, for calling the identical separate a plurality of players of described a plurality of video data stream quantity that receive with described receiving element 201, each player in described a plurality of players is for presenting a mosaic region in viewing area;
Allocation units 203, for the allocation rule according to preset, distribute to player corresponding in described a plurality of player by each video data stream in described a plurality of video data streams;
Control unit 204, the mosaic region presenting at corresponding player for each video data stream of controlling after described allocation units 203 distribute presents.
In the embodiment of the present invention, receiving element 201 receives a plurality of video data streams; Call unit 202 calls the identical separate player of video data stream quantity receiving with described receiving element 201, and described in each, player is used for presenting a mosaic region; Allocation units 203, according to preset allocation rule, distribute to respectively by a plurality of described video data streams the player that the described call unit 202 corresponding with each video data stream calls; Each video data stream that control unit 204 is controlled after described allocation units 203 distribute presents respectively in corresponding mosaic region.Compared with prior art, the display control unit that the embodiment of the present invention provides, can, for each mosaic region division program source independently, improve user's experience.But also can, on same screen, in different mosaic regions, show different video frequency programs.
On the basis of embodiment corresponding to above-mentioned Figure 15, another embodiment of the display control unit that the embodiment of the present invention provides also comprises: described player comprises document analysis thread, video decode thread and audio decoder thread; The corresponding video data queue of described video decode thread, the corresponding voice data queue of described audio decoder thread;
Described control unit 204, specifically for controlling described document analysis thread, the video data stream after distributing is resolved, the type of packet in judgement video data stream, and according to the type of packet, packet is put into corresponding described video data queue or described voice data queue, described video decode thread and audio frequency solve thread respectively from video data queue and voice data queue data fetch packet decode and present in the mosaic region corresponding with this player.
On the basis of embodiment corresponding to above-mentioned Figure 15, consult Figure 16, another embodiment of the display control unit that the embodiment of the present invention provides also comprises:
The first determining unit 205, for determining that user uses the primary importance of the selected viewing area of operand, and determines the first mosaic region under described primary importance;
The first detecting unit 206, behind the first mosaic region under determining described primary importance in described the first determining unit 205, detects the operational motion of described operand to described the first mosaic region;
Described call unit 202, also when described operational motion detected when described the first detecting unit 206 be predetermined move operation, calls the first player corresponding to mosaic region;
Described control unit 204, also for moving Hou position according to described operand, the player that uses described call unit 202 to call, the first mosaic region after display update.
On the basis of embodiment corresponding to above-mentioned Figure 15, consult Figure 17, another embodiment of the display control unit that the embodiment of the present invention provides also comprises:
The second determining unit 207, for determining that user uses the primary importance of the selected viewing area of operand, and determines the first mosaic region under described primary importance;
The second detecting unit 208, the operational motion for detection of described operand in the definite primary importance of described the second determining unit 207;
Described control unit 204, also for described operand being detected when the operational motion of described primary importance operates for predetermined choosing when described the second detecting unit 208 being detected, and described the first mosaic region is just when displaying video programs, start the sound of player corresponding to described the first mosaic region, make described the first mosaic region present Voice & Video program simultaneously, and highlight described mosaic region.
On the basis of embodiment corresponding to above-mentioned Figure 17, another embodiment of the demonstration controllable device that the embodiment of the present invention provides also comprises:
Described the second determining unit 207, also for determining that user uses the second place of the selected viewing area of operand, and described the first mosaic region under definite described second place or the second mosaic region different from described the first mosaic region;
Described the second detecting unit 208, the operational motion of the described second place of also determining in described the second determining unit 207 for detection of described operand;
Described control unit 204, for described operand detected when described the second detecting unit 208, at the operational motion of the described second place, be also described predetermined while choosing operation, and the described second place is in described the second mosaic region, close the sound of player corresponding to described the first mosaic region, and cancel highlighting of described the first mosaic region, start the sound of player corresponding to described the second mosaic region, and highlight described the second mosaic region; When the described second place is during in described the first mosaic region, close the sound of player corresponding to described the first mosaic region, and cancel highlighting of described the first mosaic region.
On the basis of embodiment corresponding to above-mentioned Figure 15, consult Figure 18, another embodiment of the display control unit that the embodiment of the present invention provides also comprises:
The 3rd determining unit 209, for determining that user uses the primary importance of the selected viewing area of operand, and determines the first mosaic region under described primary importance;
The 3rd detecting unit 210, the operational motion for detection of described operand in the definite primary importance of described the 3rd determining unit 209;
The first acquiring unit 211, changes while frequently operating for predetermined first at the operational motion of described primary importance for described operand detected when described the 3rd detecting unit 210, obtains video data stream corresponding to channel after changing frequently;
Described call unit 202, also, for obtaining at described the first acquiring unit 211 after the video data stream that channel after changing is frequently corresponding, calls the first player corresponding to mosaic region;
Described control unit 204, also the player for using described call unit 202 to call, changes video data stream corresponding to channel frequency after described in playing in described the first mosaic region.
On the basis of embodiment corresponding to above-mentioned Figure 15, consult Figure 19, another embodiment of the display control unit that the embodiment of the present invention provides also comprises:
The 4th determining unit 212, for determining that user uses the primary importance of the selected viewing area of operand, and determines the first mosaic region under described primary importance;
The 4th detecting unit 213, the operational motion for detection of described operand in the definite primary importance of described the 4th determining unit 212;
Described control unit 204, also for described operand being detected when described the 4th detecting unit 213 when the operational motion of described primary importance shields operation for predetermined turning over, remove mosaic region current in described viewing area, generate new mosaic region, and call described each new player corresponding to mosaic region, control video data stream corresponding to described each new mosaic region and present in described each new mosaic region of correspondence.
On the basis of embodiment corresponding to above-mentioned Figure 15, consult Figure 20, another embodiment of the display control unit that the embodiment of the present invention provides also comprises:
The 5th determining unit 214, for determining that user uses the primary importance of the selected viewing area of operand, and determines the first mosaic region under described primary importance;
The 5th detecting unit 215, the operational motion for detection of described operand in the definite primary importance of described the 5th determining unit 214;
Described control unit 204, also for described operand being detected when described the 5th detecting unit 215 when the operational motion of described primary importance is predetermined video deletion action, discharge the player in the mosaic region under the position of described operand, make mosaic region under the position of described operand stop video and present.
On the basis of embodiment corresponding to above-mentioned Figure 15, consult Figure 21, another embodiment of the display control unit that the embodiment of the present invention provides also comprises:
The 6th determining unit 216, for determining that user uses primary importance and the second place of the selected viewing area of operand, and determines the mosaic region under described primary importance and the second place;
The 6th detecting unit 217, for when the definite primary importance of described the 6th determining unit 216 and the second place coexist the first mosaic region, detects the operational motion of described operand;
Described control unit 204, also when described operational motion detected when described the 6th detecting unit 217 be predetermined zoom operations, control described the first mosaic region and dwindles or amplify.
On the basis of embodiment corresponding to above-mentioned Figure 15, consult Figure 22, another embodiment of the display control unit that the embodiment of the present invention provides also comprises:
The 7th determining unit 217, for determining that user uses primary importance and the second place of the selected viewing area of operand, and determines the mosaic region under described primary importance and the second place;
The 7th detecting unit 218, for when the definite primary importance of described the 7th determining unit 217 and the second place are during respectively in the first mosaic region and the second mosaic region, detects the operational motion of described operand;
Described call unit 202, also when described operational motion being detected when described the 7th detecting unit 218 and be the operation of the video that shows of predetermined two mosaic regions of exchange, call respectively player corresponding to the first mosaic region and the second player corresponding to mosaic region;
Described control unit 204, the player for using described call unit 202 to call also, the first mosaic region and the second mosaic region after upgrading according to the position display of described operand.
On the basis of embodiment corresponding to above-mentioned Figure 15, consult Figure 23, another embodiment of the display control unit that the embodiment of the present invention provides also comprises:
List generation unit 219, for generating channel list region;
Described control unit 204, also for controlling the channel list region that shows that described list generation unit 219 generates;
The 8th detecting unit 220, is used operand described control unit 204 to be controlled to the operational motion in the channel list region showing for detection of user;
The 8th determining unit 221, while being predetermined move operation for described operational motion detected when described the 8th detecting unit 220, determines that described move operation moves Hou position;
Described control unit 204, also for channel list region described in the position display after the definite movement of described the 8th determining unit 221.
On the basis of embodiment corresponding to above-mentioned Figure 23, consult Figure 24, a plurality of channel options of described channel list district inclusion, the corresponding channel of each channel option, another embodiment of the display control unit that the embodiment of the present invention provides also comprises:
Described the 8th determining unit 221, also for determining the operating position of described operand on described channel list region, and determines channel option corresponding to described operating position;
Described the 8th detecting unit 220, the also operational motion to the definite channel option of described the 8th determining unit 221 for detection of described operand;
Second acquisition unit 222, changes while frequently operating for predetermined second for described operational motion detected when described the 8th detecting unit 220, obtains video data stream that channel after changing is frequently corresponding to change the video data stream of the channel that described channel option is corresponding;
Described the 8th determining unit 221, also for the mosaic region under channel corresponding to the described channel option of definite described operand operation;
Described call unit 202, also for calling player corresponding to mosaic region under the corresponding channel of described channel option that described the 8th determining unit 221 determines;
Described control unit 204, for the player that uses described call unit 202 to call, play that described second acquisition unit 222 obtains change frequently after video data stream corresponding to channel.
The display control unit that a plurality of embodiment provide above, can, for each mosaic region division program source independently, improve user's experience.But also can, on same screen, in different mosaic regions, show different video frequency programs.
Consult Figure 25, an embodiment of the terminal that the embodiment of the present invention provides comprises: display control unit 20 and display screen 30; Display screen is used for providing viewing area;
Display control unit 20, receives a plurality of video data streams; Call the separate a plurality of players identical with a plurality of video data stream quantity, each player is for presenting a mosaic region in viewing area; According to preset allocation rule, a plurality of video data streams are distributed to respectively to player corresponding with each video data stream in a plurality of players, and the mosaic region that each video data stream after control distribution presents at corresponding player presents.
Display screen 30, the also video data stream presenting in mosaic region for showing that in viewing area display control unit is controlled.
The terminal that the embodiment of the present invention provides, can, for each mosaic region division program source independently, improve user's experience.But also can, on same screen, in different mosaic regions, show different video frequency programs.
Consult Figure 26, the display control unit providing in the embodiment of the present invention can be processor, and display screen can be touch-screen, and video data can buffer memory or is stored in memory.
For all preview contents that graphically present, adopt mosaic mode to present, all can adopt technical scheme provided by the invention, such as photograph album, bookshelf, shelf etc.All mosaic video rendering methods that the present invention proposes, also can expand to other display terminal, as controlled television set by remote controller, stare at box, or by mouse operation and control PC.
One of ordinary skill in the art will appreciate that all or part of step in the whole bag of tricks of above-described embodiment is to come the hardware that instruction is relevant to complete by program, this program can be stored in a computer-readable recording medium, and storage medium can comprise: ROM, RAM, disk or CD etc.
The method that the mosaic video above embodiment of the present invention being provided presents, display control unit and terminal are described in detail, applied specific case herein principle of the present invention and execution mode are set forth, the explanation of above embodiment is just for helping to understand method of the present invention and core concept thereof; , for one of ordinary skill in the art, according to thought of the present invention, all will change in specific embodiments and applications, in sum, this description should not be construed as limitation of the present invention meanwhile.

Claims (25)

1. the method that mosaic video presents, is characterized in that, comprising:
Receive a plurality of video data streams;
Call the separate a plurality of players identical with described a plurality of video data stream quantity, described in each, player is for presenting a mosaic region in viewing area;
According to preset allocation rule, a plurality of described video data streams are distributed to respectively to player corresponding with each video data stream in described a plurality of player, and control the mosaic region that each video data stream after described distribution presents at corresponding player and present.
2. the method for claim 1, is characterized in that:
Described player comprises document analysis thread, video decode thread and audio decoder thread; The corresponding video data queue of described video decode thread, the corresponding voice data queue of described audio decoder thread;
The mosaic region that each video data stream after the described distribution of described control presents at corresponding player presents and comprises:
Described document analysis thread is resolved the video data stream after distributing, the type of packet in judgement video data stream, and according to the type of packet, packet is put into corresponding described video data queue or described voice data queue, described video decode thread and audio frequency solve thread respectively from video data queue and voice data queue data fetch packet decode and present in the mosaic region presenting with this player.
3. method according to claim 1 and 2, is characterized in that, described method also comprises:
Determine that user uses operand selected primary importance in described viewing area;
Determine the first mosaic region that described primary importance is affiliated;
Detect the operational motion of described operand to described the first mosaic region, when described operational motion to be detected be predetermined move operation, call the first player corresponding to mosaic region, the first mosaic region after the position display after moving according to described operand is upgraded.
4. method according to claim 1 and 2, is characterized in that, described method also comprises:
Determine that user uses operand selected primary importance in described viewing area;
Determine the first mosaic region that described primary importance is affiliated;
Detect described operand at the operational motion of described primary importance, when detect described operand at the operational motion of described primary importance for predetermined while choosing operation, and described the first mosaic region is just when displaying video programs, start the sound of player corresponding to described the first mosaic region, make described the first mosaic region present Voice & Video program simultaneously, and highlight described mosaic region.
5. method according to claim 4, is characterized in that, described method also comprises:
Determine that user uses operand selected second place in described viewing area;
Determine described the first mosaic region under the described second place or the second mosaic region different from described the first mosaic region;
Detect described operand at the operational motion of the described second place, when the operational motion of described operand in the described second place being detected, be described predetermined while choosing operation, and the described second place is in described the second mosaic region, close the sound of player corresponding to described the first mosaic region, and cancel highlighting of described the first mosaic region, start the sound of player corresponding to described the second mosaic region, and highlight described the second mosaic region;
When the described second place is during in described the first mosaic region, close the sound of player corresponding to described the first mosaic region, and cancel highlighting of described the first mosaic region.
6. method according to claim 1 and 2, is characterized in that, described method also comprises:
Determine that user uses operand selected primary importance in described viewing area;
Determine the first mosaic region that described primary importance is affiliated;
Detect described operand at the operational motion of described primary importance, when described operand being detected, at the operational motion of described primary importance, change while frequently operating for predetermined first, obtain video data stream corresponding to channel after changing frequently, call the first player corresponding to mosaic region, described in playing in described the first mosaic region, change video data stream corresponding to channel after frequency.
7. method according to claim 1 and 2, is characterized in that, described method also comprises:
Determine that user uses operand selected primary importance in described viewing area;
Determine the first mosaic region that described primary importance is affiliated;
Detect described operand at the operational motion of described primary importance, when detect described operand at the operational motion of described primary importance for predetermined while turning over screen operation, remove mosaic region current in described viewing area, generate new mosaic region, and call described each new player corresponding to mosaic region, control video data stream corresponding to described each new mosaic region and present in described each new mosaic region of correspondence.
8. method according to claim 1 and 2, is characterized in that, described method also comprises:
Determine that user uses operand selected primary importance in described viewing area;
Determine the first mosaic region that described primary importance is affiliated;
Detect described operand at the operational motion of described primary importance, when the operational motion of described operand in described primary importance to be detected be predetermined video deletion action, discharge the player in the mosaic region under the position of described operand, make mosaic region under the position of described operand stop video and present.
9. method according to claim 1 and 2, is characterized in that, described method also comprises:
Determine that user uses operand selected primary importance and second place in described viewing area;
Determine the mosaic region that described primary importance and the second place are affiliated;
When described primary importance and the second place coexist the first mosaic region, detect the operational motion of described operand, when described operational motion to be detected be predetermined zoom operations, control described the first mosaic region and dwindle or amplify.
10. method according to claim 1 and 2, is characterized in that, described method also comprises:
Determine that user uses operand selected primary importance and second place in described viewing area;
Determine the mosaic region that described primary importance and the second place are affiliated;
When described primary importance and the second place are during respectively in the first mosaic region and the second mosaic region, detect the operational motion of described operand, when described operational motion being detected and be the operation of the video that shows in predetermined two mosaic regions of exchange, call respectively player corresponding to the first mosaic region and the second player corresponding to mosaic region, the first mosaic region and the second mosaic region after upgrading according to the position display of described operand.
11. methods according to claim 1 and 2, is characterized in that, described method also comprises:
In described viewing area, generate and indicated channel list area;
Detect user and use the operational motion of operand to described channel list region, when described operational motion to be detected be predetermined move operation, determine mobile Hou position in region, described viewing area, described channel list region, channel list region described in the position display after described movement.
12. methods according to claim 11, is characterized in that, a plurality of channel options of described channel list district inclusion, and the corresponding channel of each channel option, described method also comprises:
Determine the operating position of described operand on described channel list region, determine the channel option that described operating position is corresponding, detect the operational motion of described operand to described channel option;
When described operational motion being detected, change while frequently operating for predetermined second, obtain video data stream that channel after changing is frequently corresponding to change the video data stream of the channel that described channel option is corresponding;
Determine the affiliated mosaic region of channel corresponding to described channel option of described operand operation;
Call player corresponding to mosaic region under described, video data stream corresponding to channel after changing frequently described in broadcasting.
13. 1 kinds of display control units, is characterized in that, comprising:
Receiving element, for receiving a plurality of video data streams;
Call unit, for calling the identical separate a plurality of players of described a plurality of video data stream quantity that receive with described receiving element, each player in described a plurality of players is for presenting a mosaic region in viewing area;
Allocation units, for the allocation rule according to preset, distribute to player corresponding in described a plurality of player by each video data stream in described a plurality of video data streams;
Control unit, the mosaic region presenting at corresponding player for each video data stream of controlling after described allocation units distribute presents.
14. devices according to claim 13, is characterized in that, described player comprises document analysis thread, video decode thread and audio decoder thread; The corresponding video data queue of described video decode thread, the corresponding voice data queue of described audio decoder thread;
Described control unit, specifically for controlling described document analysis thread, the video data stream after distributing is resolved, the type of packet in judgement video data stream, and according to the type of packet, packet is put into corresponding described video data queue or described voice data queue, described video decode thread and audio decoder thread respectively from video data queue and voice data queue data fetch packet decode and present in the mosaic region presenting with this player.
15. according to the device described in claim 13 or 14, it is characterized in that, also comprises:
The first determining unit, for determining that user uses operand in the selected primary importance in described viewing area, and determines the first mosaic region under described primary importance;
The first detecting unit, behind the first mosaic region under determining described primary importance in described the first determining unit, detects the operational motion of described operand to described the first mosaic region;
Described call unit, also when described operational motion detected when described the first detecting unit be predetermined move operation, calls the first player corresponding to mosaic region;
Described control unit, also for moving Hou position according to described operand, the player that uses described call unit to call, the first mosaic region after display update.
16. according to the device described in claim 13 or 14, it is characterized in that, also comprises:
The second determining unit, for determining that user uses operand in the selected primary importance in described viewing area, and determines the first mosaic region under described primary importance;
The second detecting unit, the operational motion for detection of described operand in the definite primary importance of described the second determining unit;
Described control unit, also for described operand being detected when the operational motion of described primary importance operates for predetermined choosing when described the second detecting unit being detected, and described the first mosaic region is just when displaying video programs, start the sound of player corresponding to described the first mosaic region, make described the first mosaic region present Voice & Video program simultaneously, and highlight described mosaic region.
17. devices according to claim 16, is characterized in that, also comprise:
Described the second determining unit, also for definite user, use operand in the selected second place in described viewing area, and described the first mosaic region under definite described second place or the second mosaic region different from described the first mosaic region;
Described the second detecting unit, the operational motion of the described second place of also determining in described the second determining unit for detection of described operand;
Described control unit, for described operand detected when described the second detecting unit, at the operational motion of the described second place, be also described predetermined while choosing operation, and the described second place is in described the second mosaic region, close the sound of player corresponding to described the first mosaic region, and cancel highlighting of described the first mosaic region, start the sound of player corresponding to described the second mosaic region, and highlight described the second mosaic region; When the described second place is during in described the first mosaic region, close the sound of player corresponding to described the first mosaic region, and cancel highlighting of described the first mosaic region.
18. according to the device described in claim 13 or 14, it is characterized in that, also comprises:
The 3rd determining unit, for determining that user uses the primary importance of operand in selected viewing area, described viewing area, and determines the first mosaic region under described primary importance;
The 3rd detecting unit, the operational motion for detection of described operand in the definite primary importance of described the 3rd determining unit;
The first acquiring unit, changes while frequently operating for predetermined first at the operational motion of described primary importance for described operand detected when described the 3rd detecting unit, obtains video data stream corresponding to channel after changing frequently;
Described call unit, also, for obtaining at described the first acquiring unit after the video data stream that channel after changing is frequently corresponding, calls the first player corresponding to mosaic region;
Described control unit, also the player for using described call unit to call, changes video data stream corresponding to channel frequency after described in playing in described the first mosaic region.
19. according to the device described in claim 13 or 14, it is characterized in that, also comprises:
The 4th determining unit, for determining that user uses operand in the selected primary importance in described viewing area, and determines the first mosaic region under described primary importance;
The 4th detecting unit, the operational motion for detection of described operand in the definite primary importance of described the 4th determining unit;
Described control unit, also for described operand being detected when described the 4th detecting unit when the operational motion of described primary importance shields operation for predetermined turning over, remove mosaic region current in described viewing area, generate new mosaic region, and call described each new player corresponding to mosaic region, control video data stream corresponding to described each new mosaic region and present in described each new mosaic region of correspondence.
20. according to the device described in claim 13 or 14, it is characterized in that, also comprises:
The 5th determining unit, for determining that user uses operand in the selected primary importance in described viewing area, and determines the first mosaic region under described primary importance;
The 5th detecting unit, the operational motion for detection of described operand in the definite primary importance of described the 5th determining unit;
Described control unit, also for described operand being detected when described the 5th detecting unit when the operational motion of described primary importance is predetermined video deletion action, discharge the player in the mosaic region under the position of described operand, make mosaic region under the position of described operand stop video and present.
21. according to the device described in claim 13 or 14, it is characterized in that, also comprises:
The 6th determining unit, for determining that user uses operand in the selected primary importance in described viewing area and the second place, and determines the mosaic region under described primary importance and the second place;
The 6th detecting unit, for when the definite primary importance of described the 6th determining unit and the second place coexist the first mosaic region, detects the operational motion of described operand;
Described control unit, also when described operational motion detected when described the 6th detecting unit be predetermined zoom operations, control described the first mosaic region and dwindles or amplify.
22. according to the device described in claim 13 or 14, it is characterized in that, also comprises:
The 7th determining unit, for determining that user uses operand in the selected primary importance in described viewing area and the second place, and determines the mosaic region under described primary importance and the second place;
The 7th detecting unit, for when the definite primary importance of described the 7th determining unit and the second place are during respectively in the first mosaic region and the second mosaic region, detects the operational motion of described operand;
Described call unit, also when described operational motion being detected when described the 7th detecting unit and be the operation of the video that shows of predetermined two mosaic regions of exchange, call respectively player corresponding to the first mosaic region and the second player corresponding to mosaic region;
Described control unit, the player for using described call unit to call also, the first mosaic region and the second mosaic region after upgrading according to the position display of described operand.
23. according to the device described in claim 13 or 14, it is characterized in that, also comprises:
List generation unit, for generating channel list region;
Described control unit, is also presented at described viewing area for controlling the channel list region of described list generation unit generation;
The 8th detecting unit, is used operand operational motion to described channel list region in described viewing area for detection of user;
The 8th determining unit, while being predetermined move operation for described operational motion detected when described the 8th detecting unit, determines mobile Hou position in described viewing area, described channel list region;
Described control unit, also for channel list region described in the position display after the definite movement of described the 8th determining unit.
24. devices according to claim 23, is characterized in that, a plurality of channel options of described channel list district inclusion, and the corresponding channel of each channel option, described device also comprises:
Described the 8th determining unit, also for determining the operating position of described operand on described channel list region, and determines channel option corresponding to described operating position;
Described the 8th detecting unit, the also operational motion to the definite channel option of described the 8th determining unit for detection of described operand;
Second acquisition unit, changes while frequently operating for predetermined second for described operational motion detected when described the 8th detecting unit, obtains video data stream that channel after changing is frequently corresponding to change the video data stream of the channel that described channel option is corresponding;
Described the 8th determining unit, also for the mosaic region under channel corresponding to the described channel option of definite described operand operation;
Described call unit, also for calling player corresponding to mosaic region under the corresponding channel of described channel option that described the 8th determining unit determines;
Described control unit, for the player that uses described call unit to call, play that described second acquisition unit obtains change frequently after video data stream corresponding to channel.
25. 1 kinds of terminals, it is characterized in that, described terminal comprises display control unit and display screen, described display screen is used for providing viewing area, described display control unit is the display control unit described in the claims 13 ~ 24 any one, and described display screen is the video data stream presenting in mosaic region for showing that in described viewing area described display control unit is controlled also.
CN201210203274.1A 2012-06-19 2012-06-19 Mosaic video display method, display control device and terminal Pending CN103517126A (en)

Priority Applications (2)

Application Number Priority Date Filing Date Title
CN201210203274.1A CN103517126A (en) 2012-06-19 2012-06-19 Mosaic video display method, display control device and terminal
PCT/CN2013/070535 WO2013189179A1 (en) 2012-06-19 2013-01-16 Mosaic video display method, and display control device and terminal

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201210203274.1A CN103517126A (en) 2012-06-19 2012-06-19 Mosaic video display method, display control device and terminal

Publications (1)

Publication Number Publication Date
CN103517126A true CN103517126A (en) 2014-01-15

Family

ID=49768076

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201210203274.1A Pending CN103517126A (en) 2012-06-19 2012-06-19 Mosaic video display method, display control device and terminal

Country Status (2)

Country Link
CN (1) CN103517126A (en)
WO (1) WO2013189179A1 (en)

Cited By (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104954870A (en) * 2015-06-17 2015-09-30 福建新大陆通信科技股份有限公司 Method and system for quickly updating mosaic program data of STB (Set Top Box)
CN104954849A (en) * 2015-06-25 2015-09-30 福建新大陆通信科技股份有限公司 Quick logic box switching method in STB (set top box) mosaics
CN105915999A (en) * 2016-04-19 2016-08-31 乐视控股（北京）有限公司 Video play method and system
CN106412463A (en) * 2015-08-03 2017-02-15 北京鸿合智能系统股份有限公司 Playing instruction method of dynamically switching video and apparatus thereof
CN107493516A (en) * 2017-09-25 2017-12-19 深圳市茁壮网络股份有限公司 A kind of mosaic video navigation page synthetic method and device
WO2018072184A1 (en) * 2016-10-20 2018-04-26 Zte Corporation Generation of mosaic channels for ott live broadcasts
CN108200465A (en) * 2018-01-30 2018-06-22 深圳市茁壮网络股份有限公司 A kind of video broadcasting method and device
CN110351592A (en) * 2019-07-17 2019-10-18 深圳市蓝鲸数据科技有限公司 Animation rendering method, device, computer equipment and storage medium
CN112702561A (en) * 2019-10-22 2021-04-23 杭州海康威视数字技术股份有限公司 Video picture moving method and device and electronic equipment
CN114600468A (en) * 2019-09-03 2022-06-07 皇家Kpn公司 Combining video streams with metadata in a composite video stream

Families Citing this family (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP3029950A1 (en) * 2014-12-03 2016-06-08 Advanced Digital Broadcast S.A. System and method for graphical user interface mosaic
CN115439795B (en) * 2022-11-08 2023-10-13 浙江慧享信息科技有限公司 Video coding method, medium and equipment related to portrait

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101031069A (en) * 2006-12-13 2007-09-05 北京大学 Method and system for navigating video electronic programm in network TV-set
CN101155281A (en) * 2006-09-25 2008-04-02 三星电子株式会社 Mobile terminal having digital broadcast reception capability and pip display control method
CN101442627A (en) * 2008-12-17 2009-05-27 南京邮电大学 Control method for peer-to-peer calculation set-top box player
CN101984672A (en) * 2010-11-03 2011-03-09 深圳芯邦科技股份有限公司 Method and device for multi-thread video and audio synchronous control
CN102223501A (en) * 2011-06-17 2011-10-19 四川长虹电器股份有限公司 Multi-picture service realization method
CN102301736A (en) * 2011-07-06 2011-12-28 华为技术有限公司 Method, device and mobile terminal for switching video display contents

Family Cites Families (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH0926769A (en) * 1995-07-10 1997-01-28 Hitachi Ltd Picture display device
US6448956B1 (en) * 1997-10-31 2002-09-10 Eastman Kodak Company Systems and methods for direct image manipulation
JP2002354367A (en) * 2001-05-25 2002-12-06 Canon Inc Multi-screen display device, multi-screen display method, storage medium and program
CN2927177Y (en) * 2006-07-05 2007-07-25 成都东方监控技术有限公司 Multi-path audio-video processing system
KR20090019628A (en) * 2007-08-21 2009-02-25 삼성전자주식회사 The method of displaying image and the displaying system thereof
JP5557314B2 (en) * 2010-03-24 2014-07-23 Ｎｅｃカシオモバイルコミュニケーションズ株式会社 Terminal device and program
CN101959051A (en) * 2010-09-01 2011-01-26 华为终端有限公司 Method and device for choosing screen of remote presentation system
CN102036043A (en) * 2010-12-15 2011-04-27 成都市华为赛门铁克科技有限公司 Video data processing method and device as well as video monitoring system

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101155281A (en) * 2006-09-25 2008-04-02 三星电子株式会社 Mobile terminal having digital broadcast reception capability and pip display control method
CN101031069A (en) * 2006-12-13 2007-09-05 北京大学 Method and system for navigating video electronic programm in network TV-set
CN101442627A (en) * 2008-12-17 2009-05-27 南京邮电大学 Control method for peer-to-peer calculation set-top box player
CN101984672A (en) * 2010-11-03 2011-03-09 深圳芯邦科技股份有限公司 Method and device for multi-thread video and audio synchronous control
CN102223501A (en) * 2011-06-17 2011-10-19 四川长虹电器股份有限公司 Multi-picture service realization method
CN102301736A (en) * 2011-07-06 2011-12-28 华为技术有限公司 Method, device and mobile terminal for switching video display contents

Cited By (14)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104954870B (en) * 2015-06-17 2018-02-16 福建新大陆通信科技股份有限公司 A kind of set top box quickly updates the method and system of mosaic program data
CN104954870A (en) * 2015-06-17 2015-09-30 福建新大陆通信科技股份有限公司 Method and system for quickly updating mosaic program data of STB (Set Top Box)
CN104954849B (en) * 2015-06-25 2018-08-07 福建新大陆通信科技股份有限公司 A kind of method that logical box is switched fast in set-top box mosaic
CN104954849A (en) * 2015-06-25 2015-09-30 福建新大陆通信科技股份有限公司 Quick logic box switching method in STB (set top box) mosaics
CN106412463A (en) * 2015-08-03 2017-02-15 北京鸿合智能系统股份有限公司 Playing instruction method of dynamically switching video and apparatus thereof
CN106412463B (en) * 2015-08-03 2020-04-21 北京鸿合智能系统有限公司 Director method and device for dynamically switching videos
CN105915999A (en) * 2016-04-19 2016-08-31 乐视控股（北京）有限公司 Video play method and system
WO2018072184A1 (en) * 2016-10-20 2018-04-26 Zte Corporation Generation of mosaic channels for ott live broadcasts
CN107493516A (en) * 2017-09-25 2017-12-19 深圳市茁壮网络股份有限公司 A kind of mosaic video navigation page synthetic method and device
CN108200465A (en) * 2018-01-30 2018-06-22 深圳市茁壮网络股份有限公司 A kind of video broadcasting method and device
CN110351592A (en) * 2019-07-17 2019-10-18 深圳市蓝鲸数据科技有限公司 Animation rendering method, device, computer equipment and storage medium
CN110351592B (en) * 2019-07-17 2021-09-10 深圳市蓝鲸数据科技有限公司 Animation presentation method and device, computer equipment and storage medium
CN114600468A (en) * 2019-09-03 2022-06-07 皇家Kpn公司 Combining video streams with metadata in a composite video stream
CN112702561A (en) * 2019-10-22 2021-04-23 杭州海康威视数字技术股份有限公司 Video picture moving method and device and electronic equipment

Also Published As

Publication number Publication date
WO2013189179A1 (en) 2013-12-27

Similar Documents

Publication Publication Date Title
CN103517126A (en) Mosaic video display method, display control device and terminal
US11388479B2 (en) Display apparatus for processing multiple applications and method for controlling the same
US20210051359A1 (en) Systems and methods for enabling transitions between items of content
US10477277B2 (en) Electronic programming guide with expanding cells for video preview
US8381246B2 (en) Methods and apparatus for providing electronic program guides
CN105472428B (en) A kind of method and apparatus for broadcasting channel program
EP2740264B1 (en) Video peeking
US20170192642A1 (en) Systems and methods for enabling transitions between items of content based on swipe gestures
CN106576194B (en) Television user interface
US20110145745A1 (en) Method for providing gui and multimedia device using the same
CN108476338A (en) Television user interface
US20170195734A1 (en) Systems and methods for enabling transitions between items of content based on multi-level gestures
CN109640182A (en) Video broadcasting method, device and computer readable storage medium
CN106060633A (en) Signal source image preview method and television terminal
US9264776B2 (en) Apparatus of rendering user interface for playing broadcast programs and the method thereof
US20080301735A1 (en) User interface screen magnifying glass effect
US20190114064A1 (en) Enabling undo on scrubber/seekbar ui widgets
CN109982135B (en) Channel switching method, device, terminal and computer readable storage medium
Soskic et al. A proposal for second screen DTV and remote control application
KR101318325B1 (en) Navigational operation method

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
RJ01 Rejection of invention patent application after publication
RJ01 Rejection of invention patent application after publication

Application publication date: 20140115