Summary of the invention
For this purpose, the present invention provides a kind of multiple terminals joint display methods, apparatus and system, to try hard to solve or at least delay
Solution above there are the problem of.
According to an aspect of the present invention, a kind of multiple terminals joint display methods is provided, this method is in first movement terminal
Middle execution is requested comprising steps of inputting in response to user, and setting is for combining the screen area quantity of display video;It is each
Screen area is associated with a playback terminal;Convert video data to quantity sub-video data corresponding with screen area quantity
Stream, wherein each sub-video data stream is corresponding with each screen area respectively;And by each sub-video data stream be pushed to respectively with
Each associated playback terminal of screen area is to play.
Optionally, in the joint display methods of multiple terminals according to the present invention, screen area quantity is at least 2.
Optionally, in the joint display methods of multiple terminals according to the present invention, quantity and screen are converted video data to
The step of region quantity corresponding sub-video data stream includes: to video data decoding to be played;By decoded video counts
According to being divided into sub-video data stream corresponding with each screen area;And each sub-video data stream is encoded respectively,
Obtain the sub- video data stream of screen area quantity.
Optionally, multiple terminals according to the present invention joint display methods in, by decoded partitioning video data at
The step of each screen area corresponding sub-video data stream include: each image frame division of video data at each screen
The corresponding sub-image frame in region;And the corresponding each sub-image frame of the same screen area of splicing, obtain sub-video data stream.
Optionally, in the joint display methods of multiple terminals according to the present invention, each sub-video data stream is carried out respectively
The step of coding further include: obtain the resolution ratio of associated each playback terminal;And according to resolution ratio respectively to every height
Video data stream carries out interpolation processing.
Optionally, it in the joint display methods of multiple terminals according to the present invention, further comprises the steps of: sequentially to each screen area
Field Number;And the physical location that the playback terminal being associated is put is determined according to number order, to remind user according to position
Put playback terminal.
Optionally, it in the joint display methods of multiple terminals according to the present invention, further comprises the steps of: and is built with multiple playback terminals
Vertical broadcast group;Obtain the device identification of playback terminal;Wherein, playback terminal further includes the first movement terminal.
Optionally, in the joint display methods of multiple terminals according to the present invention, a broadcasting is associated with for each screen area
The step of terminal includes: to distribute a broadcasting mark for each screen area;It and is each broadcasting mark one equipment of association
Mark.
Optionally, it in the joint display methods of multiple terminals according to the present invention, further comprises the steps of: multiple in broadcast group
Playback terminal receives each sub-video data stream, plays each sub-video data stream.
According to another aspect of the present invention, a kind of multiple terminals joint display device is provided, which is suitable for residing in first
In mobile terminal, device includes: input/output interface, is suitable for receiving user and inputs request, is further adapted for each sub-video data stream
It is pushed to playback terminal associated with each screen area, respectively to play;Divide module, suitable for asking according to user's input
It asks, setting is for combining the screen area quantity of display video;Associated allocation module is suitable for each screen area and is associated with one
Playback terminal;And splicing module, suitable for converting video data to quantity sub-video data corresponding with screen area quantity
Stream, wherein each sub-video data stream is corresponding with each screen area of division respectively.
Optionally, in the joint display device of multiple terminals according to the present invention, screen area quantity is at least 2.
Optionally, in the joint display device of multiple terminals according to the present invention, splicing module includes: encoding and decoding subelement,
Suitable for encoding to video data decoding to be played and respectively to each sub-video data stream, screen area number is obtained
Measure a sub- video data stream;And splicing subelement, it is suitable for decoded partitioning video data at opposite with each screen area
The sub-video data stream answered.
Optionally, in the joint display device of multiple terminals according to the present invention, splicing subelement is further adapted for video data
Each image frame division at sub-image frame corresponding with each screen area and the corresponding each subgraph of the same screen area of splicing
As frame, sub-video data stream is obtained.
Optionally, in the joint display device of multiple terminals according to the present invention, input/output interface is further adapted for obtaining related
The resolution ratio of each playback terminal of connection;Encoding and decoding subelement is further adapted for respectively flowing into each sub-video data according to resolution ratio
The processing of row interpolation.
Optionally, in the joint display device of multiple terminals according to the present invention, segmentation module is further adapted for sequentially to each screen
Curtain zone number;And associated allocation module is further adapted for the physics for determining that the playback terminal being associated is put according to number order
Position, to remind user to put playback terminal according to position.
Optionally, multiple terminals according to the present invention joint display device in, further includes: control module, be suitable for it is multiple
Playback terminal establishes broadcast group;And obtain the device identification of playback terminal, wherein playback terminal further includes first movement end
End.
Optionally, in the joint display device of multiple terminals according to the present invention, associated allocation module is further adapted for obtaining each
The broadcasting of screen area identifies and is associated with a device identification for each broadcasting mark.
Optionally, in the joint display device of multiple terminals according to the present invention, it is further adapted for residing in more in the broadcast group
In a playback terminal, input/output interface is further adapted for receiving by each sub-video data stream;Further include playing module, is suitable for playing
Each sub-video data stream.
According to another aspect of the invention, a kind of multiple terminals joint display system, including a first movement end are provided
End and at least one other playback terminal, wherein all terminals in the system all have joint display in multiple terminals as described above
Device.
By technical solution above as it can be seen that the present invention is aobvious different from the existing splicing on the display screen of a mobile terminal
Show the technology of picture material, but establish broadcast group between the mobile terminal of multiple same sizes, using multiple mobile terminals as
Playback terminal virtually splices, and then by partitioning video data at multiple sub-video data streams, sub-video data stream is broadcast with multiple
It puts terminal to be associated with one by one, does master control equipment by choosing a mobile terminal, control each sub-video data stream association and be output to
Multiple playback terminals realize that video data is played simultaneously in multiple playback terminals, to achieve the effect that visually to expand display content,
Improve the viewing experience of user.
Specific embodiment
Exemplary embodiments of the present disclosure are described in more detail below with reference to accompanying drawings.Although showing the disclosure in attached drawing
Exemplary embodiment, it being understood, however, that may be realized in various forms the disclosure without should be by embodiments set forth here
It is limited.On the contrary, these embodiments are provided to facilitate a more thoroughly understanding of the present invention, and can be by the scope of the present disclosure
It is fully disclosed to those skilled in the art.
Fig. 1 is 100 organigram of mobile terminal according to an embodiment of the invention.Referring to Fig.1, mobile terminal
100 include: memory interface 102, one or more data processor, image processor and/or central processing unit 104, with
And peripheral interface 106.Memory interface 102, one or more processors 104 and/or peripheral interface 106 are either discrete member
Part also can integrate in one or more integrated circuits.In the mobile terminal 100, various elements can pass through one or more
Communication bus or signal wire couple.Sensor, equipment and subsystem may be coupled to peripheral interface 106, to help reality
Existing multiple functions.For example, motion sensor 110, optical sensor 112 and range sensor 114 may be coupled to peripheral interface
106, to facilitate the functions such as orientation, illumination and ranging.Other sensors 116 can equally be connected with peripheral interface 106, such as fixed
Position system (such as GPS receiver), temperature sensor, biometric sensor or other sensor devices, it is possible thereby to help reality
Apply relevant function.
Camera sub-system 120 and optical sensor 122 can be used for the camera of convenient such as record photos and video clips
The realization of function, wherein the camera sub-system and optical sensor for example can be charge-coupled device (CCD) or complementary gold
Belong to oxide semiconductor (CMOS) optical sensor.It can help to realize by one or more radio communication subsystems 124
Communication function, wherein radio communication subsystem may include radio-frequency transmitter and transmitter and/or light (such as infrared) receiver
And transmitter.The particular design and embodiment of radio communication subsystem 124 can depend on mobile terminal 100 is supported one
A or multiple communication networks.For example, mobile terminal 100 may include being designed to support GSM network, GPRS network, EDGE net
The communication subsystem 124 of network, Wi-Fi or WiMax network and BlueboothTM network.Audio subsystem 126 can be with loudspeaking
Device 128 and microphone 130 are coupled, to help the function of implementing to enable voice, such as speech recognition, speech reproduction, number
Word record and telephony feature.
I/O subsystem 140 may include touch screen controller 142 and/or other one or more input controllers 144.
Touch screen controller 142 may be coupled to touch screen 146.For example, the touch screen 146 and touch screen controller 142 can be with
The contact carried out therewith and movement or pause are detected using any one of a variety of touch-sensing technologies, wherein sensing skill
Art includes but is not limited to capacitive character, resistive, infrared and surface acoustic wave technique.Other one or more input controllers 144
May be coupled to other input/control devicess 148, for example, one or more buttons, rocker switch, thumb wheel, infrared port,
The pointer device of USB port, and/or stylus etc.One or more of button (not shown)s may include for controlling
The up/down button of 130 volume of loudspeaker 128 and/or microphone.
Memory interface 102 can be coupled with memory 150.The memory 150 may include that high random access is deposited
Reservoir and/or nonvolatile memory, such as one or more disk storage equipments, one or more optical storage apparatus, and/
Or flash memories (such as NAND, NOR).Memory 150 can store an operating system 152, for example, Android, IOS or
The operating system of Windows Phone etc.The operating system 152 may include for handling basic system services and execution
The instruction of task dependent on hardware.Memory 150 can also be stored using 154.These applications in operation, can be from memory
150 are loaded on processor 104, and run on the operating system run via processor 104, and utilize operating system
And the interface that bottom hardware provides realizes the various desired functions of user, such as instant messaging, web page browsing, pictures management.
Using can be independently of operating system offer, it is also possible to what operating system carried.
According to one embodiment of present invention, a kind of mobile terminal 100, Ke Yitong with joint display function is provided
It crosses in multiple mobile terminals 100 and arranges corresponding multiple terminals joint display device 300 to realize above-mentioned function.
Implementation according to the present invention, multiple terminals joint display system are made of at least two mobile terminals 100.And
And to reach the display effect of comfortable, multiple mobile terminals 100 in the system are preferably provided with identical size.It can be with
It is more with other by establishing broadcast group by the one of mobile terminal 100 of user setting as the master control equipment in the system
A mobile terminal 100 is communicated.
Fig. 2 shows the flow charts of multiple terminals according to an embodiment of the invention joint display methods 200.This method
200 start from step S210, input and request in response to user, and setting is for combining the screen area quantity of display video.Such as it wants
It asks user to input in the first movement terminal as master control equipment and video content is divided into several regional combinations broadcastings, ring
Respective numbers screen area should be marked off in the input of user, first movement terminal, generally, screen area is all average draws
Get.If wherein screen area quantity at least 2, it can be and set including a master control equipment and other broadcasting
Standby, master control equipment can also make playback equipment simultaneously.
Then in step S220, it is associated with a mobile terminal 100 for above-mentioned each screen area, as playback equipment.
Firstly, other mobile terminals 100 in first movement terminal 100 and the system establish broadcast group.For example, passing through
RSTP agreement completes the forwarding, study etc. of communication data between each terminal.Then, first movement terminal obtains in broadcast group and owns
The device identification of mobile terminal.Meanwhile first movement terminal distributes a broadcasting as master control equipment for each screen area
Mark, as shown in Figure 4 A, first movement terminal mark off two screen areas in left and right, respectively correspond broadcasting mark 401 and 402.
Finally, first movement terminal is respectively that each broadcasting mark one device identification of association plays 401 pairs of mark as shown in Figure 4 A
Mobile terminal 1001 is answered, the corresponding mobile terminal 1002 of mark 402 is played.
Similarly, when video content is divided into four screen areas by user, as shown in Figure 4 B, 4 screen areas
Playing mark is 403,404,405 and 406, respectively corresponds following 4 mobile terminals 1003,1004,1005 and 1006.
It should be noted that can also be made simultaneously by the first movement terminal it is found that as master control equipment is described above
Video content is played for playback equipment.So further including the equipment mark of first movement terminal itself in acquired device identification
Know, it is associated with one of broadcasting mark.
By screen area it is associated with mobile terminal after, the distribution of video content is then considered in step S230
Problem.According to one embodiment of present invention, quantity sub-video corresponding with screen area quantity is converted video data to
Data flow, wherein each sub-video data stream is corresponding with each screen area of division respectively.The step can be subdivided into following again
Several steps:
Firstly, to video data decoding to be played.For example, video data to be played can be decoded using ffmpeg, lead to
It crosses the API " avcodec_find_decoder " for calling ffmpeg to provide and obtains decoder, circulation reads figure from video file
As data are decoded.In the present invention, to video decoding algorithm and with no restrictions, the decoding algorithm of any video image all may be used
Be used in combination with the embodiment of the present invention for treating playing video data decoding.
Then, by decoded partitioning video data at sub-video data stream corresponding with each screen area.For example, if
2 screen areas are divided, then video data to be played is just divided into 2 sub- video data streams.Specific practice is:
Each image frame division of video data is at sub-image frame corresponding with each screen area (for example, dividing 2 sub-image frames), so
After splice corresponding each sub-image frame in same screen area, obtain sub-video data stream.
Then, coding is re-started to ready-portioned each sub-video data stream respectively, obtains screen area quantity height
Video data stream.
In view of can be potentially encountered following situations: the resolution ratio of video to be played is 1920*1080 originally, is divided into
After 2 sub-videos, the resolution ratio of each sub-video data stream may be 960*1080, at this point, if corresponding to playback terminal
Resolution ratio is 1920*1080, to guarantee that the viewing quality of video needs sub-video data to flow into row interpolation in this step
Operation.
Therefore in this step, further include following operation: the resolution ratio of associated each playback terminal is obtained, according to broadcasting
The resolution ratio of terminal carries out interpolation processing to each sub-video data stream respectively.
Finally, each sub-video data stream is pushed to playback terminal associated with each screen area respectively, to play.
Similarly, the mobile terminal as playback equipment in broadcast group, that is, playback terminal receive each sub-video data stream,
And it executes dependent instruction and plays each sub-video data stream.
In pushing video data flow, on the one hand need to correspond sub-video data stream and playback terminal, another party
Face, it is also necessary to pay attention to the sequence between each screen area.Therefore, in this step, also sequentially each screen area is numbered, simultaneously
The physical location that the playback terminal being associated is put is determined according to the number order, to remind user to put movement eventually according to position
End.
According to certain embodiment, number herein can also be logical with the broadcasting mark of each screen area in step S220
With.Such as in Figure 4 A, or using 401,402 as screen area number, then, correspondingly, two be associated
The sequence of putting of mobile terminal 1001,1002 must be just 1001 left sides for being located at 1002.
According to above-mentioned process, when user wishes the viewing experience for possessing large-size screen monitors or needs amplified video content certain
Viewing scene under, so that it may by this programme, multiple mobile terminals are virtually spliced, and by suitable placement position,
It realizes and expands display video content across screen.Meanwhile by controlling master control equipment (namely first movement terminal), video is realized
Content such as is played simultaneously, suspends, retracting at the functions, to meet the viewing demand of user, improves user experience.
Fig. 3 shows the schematic diagram of joint display device 300 in multiple terminals according to an embodiment of the invention.The device
300 include: input/output interface 310, segmentation module 320, associated allocation module 330 and splicing module 340.Wherein, divide
Module 320 is cut to couple with associated allocation module 330 and 340 phase of splicing module respectively.
Input/output interface 310 is suitable for receiving user and inputs request, for example, user by input digital determination to divide it is several
A screen area will match several mobile terminals to realize that joint plays display video content.
According to another embodiment, input/output interface 310 is further adapted for receiving the selection input of user, and user passes through input
It chooses some mobile terminal and makees first movement terminal, as master control equipment.
Divide module 320 to be suitable for inputting request according to user, setting is for combining the screen area quantity of display.Definition screen
Curtain region quantity is at least 2.Meanwhile dividing module 320 and being further adapted for sequentially numbering each screen area, in order to subsequent to broadcasting
The multiple mobile terminals for putting video are ranked up.
Associated allocation module 330 is suitable for each screen area and is associated with a mobile terminal as playback terminal.By above
Description it is found that associated allocation module 330 is further adapted for determining the playback terminal that is associated according to the number order of screen area
The physical location put, to remind user to put playback terminal according to position.
Embodiment according to the present invention, the present apparatus 300 further include control module, suitable for whole with multiple movements in system
Broadcast group is established at end, while obtaining the device identification of each playback terminal, wherein the first movement terminal as master control equipment
Playback terminal be can also be used as playing video content, therefore first movement terminal is further adapted for obtaining the device identification of oneself.
In this case, associated allocation module 330 can also obtain the broadcasting mark of each screen area and be each broadcasting
Mark one device identification of association.According to a kind of implementation method, broadcasting mark herein can be exactly the number of each screen area.
Splicing module 340 is suitable for accordingly being converted to video data into quantity sub-video number corresponding with screen area quantity
According to stream, wherein each sub-video data stream is corresponding with each screen area of division respectively.
According to an embodiment of the invention, splicing module 340 includes: encoding and decoding subelement and splicing subelement.Wherein, solution is compiled
Numeral unit is suitable for video data decoding to be played, splice subelement be suitable for by decoded partitioning video data at it is each
The corresponding sub-video data stream of screen area, then, encoding and decoding subelement are suitable for respectively carrying out each sub-video data stream
Coding obtains the sub- video data stream of screen area quantity.Specifically, splicing subelement is further adapted for each in video data
Image frame division is at sub-image frame corresponding with each screen area and splices the corresponding each sub-image frame of same screen area,
Obtain sub-video data stream.
It was mentioned in the description based on Fig. 2, when being recompiled to video to be played, it is also necessary to consider video resolution
The problem of.At this point, input/output interface 310 is further adapted for obtaining the resolution ratio of associated each playback terminal, encoding and decoding is single
Member is further adapted for carrying out interpolation processing to each sub-video data stream respectively according to resolution ratio.It can refer to Fig. 2 associated description, specifically do
Details are not described herein again for method.For the encoding and decoding processing of video data or interpolation processing, can be realized by calling ffmpeg,
It can also be realized by other algorithms, this programme is to herein and with no restrictions.
Input/output interface 310 is further adapted for for each sub-video data stream being pushed to respectively associated with each screen area
Playback terminal, to play.Since associated allocation module 330 is broadcast each screen area, each sub-video data stream and respectively
It is associated to put terminal, thus output interface by the corresponding pushing video data flow of associated mark can, user is suitable according to number
Sequence is well placed the position of playback terminal.
Fig. 4 A and Fig. 4 B respectively illustrate two examples of screen area of the setting for combining display, with reference to about Fig. 4 A
With the description of Fig. 4 B, how that each screen area, each sub-video data stream and each playback terminal is related describe in detail
Connection, details are not described herein again.
It should be appreciated that in order to simplify the disclosure and help to understand one or more of the various inventive aspects, it is right above
In the description of exemplary embodiment of the present invention, each feature of the invention be grouped together into sometimes single embodiment, figure or
In person's descriptions thereof.However, the disclosed method should not be interpreted as reflecting the following intention: i.e. claimed hair
Bright requirement is than feature more features expressly recited in each claim.More precisely, as the following claims
As book reflects, inventive aspect is all features less than single embodiment disclosed above.Therefore, it then follows specific real
Thus the claims for applying mode are expressly incorporated in the specific embodiment, wherein each claim itself is used as this hair
Bright separate embodiments.
Those skilled in the art should understand that the module of the equipment in example disclosed herein or unit or groups
Part can be arranged in equipment as depicted in this embodiment, or alternatively can be positioned at and the equipment in the example
In different one or more equipment.Module in aforementioned exemplary can be combined into a module or furthermore be segmented into multiple
Submodule.
Those skilled in the art will understand that can be carried out adaptively to the module in the equipment in embodiment
Change and they are arranged in one or more devices different from this embodiment.It can be the module or list in embodiment
Member or component are combined into a module or unit or component, and furthermore they can be divided into multiple submodule or subelement or
Sub-component.Other than such feature and/or at least some of process or unit exclude each other, it can use any
Combination is to all features disclosed in this specification (including adjoint claim, abstract and attached drawing) and so disclosed
All process or units of what method or apparatus are combined.Unless expressly stated otherwise, this specification is (including adjoint power
Benefit require, abstract and attached drawing) disclosed in each feature can carry out generation with an alternative feature that provides the same, equivalent, or similar purpose
It replaces.
A6, the method as described in any one of A1-5 are further comprised the steps of: and are sequentially numbered to each screen area;And root
The physical location that the playback terminal being associated is put is determined according to number order, to remind user to put playback terminal according to position.
A7, the method as described in any one of A1-6, further comprise the steps of: and establish broadcast group with multiple playback terminals;Obtain playback terminal
Device identification;Wherein, playback terminal includes first movement terminal.A8, the method as described in A7, wherein for each screen area
The step of being associated with a playback terminal includes: to distribute a broadcasting mark for each screen area;And it is identified for each broadcasting
It is associated with a device identification.A9, the method as described in A7 or 8, the multiple playback terminals further comprised the steps of: in broadcast group receive
Each sub-video data stream plays each sub-video data stream.
B14, the device as described in B12 or 13, wherein input/output interface is further adapted for obtaining associated each broadcasting
The resolution ratio of terminal;Encoding and decoding subelement is further adapted for respectively carrying out at interpolation each sub-video data stream according to the resolution ratio
Reason.B15, the device as described in any one of B10-14, wherein segmentation module is further adapted for sequentially compiling each screen area
Number;And associated allocation module is further adapted for the physical bit for determining that the playback terminal being associated is put according to the number order
It sets, to remind user to put playback terminal according to position.B16, the device as described in any one of B10-15, further includes: control mould
Block, suitable for establishing broadcast group with multiple playback terminals;And obtain the device identification of playback terminal, wherein playback terminal includes
First movement terminal.B17, the device as described in B16, wherein associated allocation module is further adapted for obtaining broadcasting for each screen area
It puts mark and is associated with a device identification for each broadcasting mark.B18, the device as described in B16 or 17, wherein device is also suitable
In the multiple playback terminals resided in the broadcast group, input/output interface is further adapted for receiving each sub-video data stream;Device
Further include playing module, is suitable for playing each sub-video data stream.
In addition, it will be appreciated by those of skill in the art that although some embodiments described herein include other embodiments
In included certain features rather than other feature, but the combination of the feature of different embodiments mean it is of the invention
Within the scope of and form different embodiments.For example, in the following claims, embodiment claimed is appointed
Meaning one of can in any combination mode come using.
In addition, be described as herein can be by the processor of computer system or by executing by some in the embodiment
The combination of method or method element that other devices of the function are implemented.Therefore, have for implementing the method or method
The processor of the necessary instruction of element forms the device for implementing this method or method element.In addition, Installation practice
Element described in this is the example of following device: the device be used for implement as in order to implement the purpose of the invention element performed by
Function.
As used in this, unless specifically stated, come using ordinal number " first ", " second ", " third " etc.
Description plain objects, which are merely representative of, is related to the different instances of similar object, and is not intended to imply that the object being described in this way must
Must have the time it is upper, spatially, sequence aspect or given sequence in any other manner.
Although the embodiment according to limited quantity describes the present invention, above description, the art are benefited from
It is interior it is clear for the skilled person that in the scope of the present invention thus described, it can be envisaged that other embodiments.Additionally, it should be noted that
Language used in this specification primarily to readable and introduction purpose and select, rather than in order to explain or limit
Determine subject of the present invention and selects.Therefore, without departing from the scope and spirit of the appended claims, for this
Many modifications and changes are obvious for the those of ordinary skill of technical field.For the scope of the present invention, to this
Invent done disclosure be it is illustrative and not restrictive, it is intended that the scope of the present invention be defined by the claims appended hereto.