WO2014063515A1 - 一种实现多媒体播放的方法、移动终端及系统 - Google Patents

一种实现多媒体播放的方法、移动终端及系统 Download PDF

Info

Publication number
WO2014063515A1
WO2014063515A1 PCT/CN2013/081227 CN2013081227W WO2014063515A1 WO 2014063515 A1 WO2014063515 A1 WO 2014063515A1 CN 2013081227 W CN2013081227 W CN 2013081227W WO 2014063515 A1 WO2014063515 A1 WO 2014063515A1
Authority
WO
WIPO (PCT)
Prior art keywords
mobile terminal
stream data
multimedia
multimedia stream
played
Prior art date
Application number
PCT/CN2013/081227
Other languages
English (en)
French (fr)
Inventor
李坤宁
Original Assignee
中兴通讯股份有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 中兴通讯股份有限公司 filed Critical 中兴通讯股份有限公司
Priority to US14/437,950 priority Critical patent/US9846563B2/en
Priority to EP13849384.6A priority patent/EP2914006A4/en
Publication of WO2014063515A1 publication Critical patent/WO2014063515A1/zh

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/14—Digital output to display device ; Cooperation and interconnection of the display device with other functional units
    • G06F3/1423—Digital output to display device ; Cooperation and interconnection of the display device with other functional units controlling a plurality of local displays, e.g. CRT and flat panel display
    • G06F3/1446—Digital output to display device ; Cooperation and interconnection of the display device with other functional units controlling a plurality of local displays, e.g. CRT and flat panel display display composed of modules, e.g. video walls
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L65/00—Network arrangements, protocols or services for supporting real-time applications in data packet communication
    • H04L65/60—Network streaming of media packets
    • H04L65/70—Media network packetisation
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/41—Structure of client; Structure of client peripherals
    • H04N21/4104—Peripherals receiving signals from specially adapted client devices
    • H04N21/4122—Peripherals receiving signals from specially adapted client devices additional display device, e.g. video projector
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/41—Structure of client; Structure of client peripherals
    • H04N21/4104—Peripherals receiving signals from specially adapted client devices
    • H04N21/4126—The peripheral being portable, e.g. PDAs or mobile phones
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/41—Structure of client; Structure of client peripherals
    • H04N21/414—Specialised client platforms, e.g. receiver in car or embedded in a mobile appliance
    • H04N21/41407—Specialised client platforms, e.g. receiver in car or embedded in a mobile appliance embedded in a portable device, e.g. video client on a mobile phone, PDA, laptop
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/4302—Content synchronisation processes, e.g. decoder synchronisation
    • H04N21/4307—Synchronising the rendering of multiple content streams or additional data on devices, e.g. synchronisation of audio on a mobile phone with the video output on the TV screen
    • H04N21/43076—Synchronising the rendering of multiple content streams or additional data on devices, e.g. synchronisation of audio on a mobile phone with the video output on the TV screen of the same content streams on multiple devices, e.g. when family members are watching the same movie on different devices
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/431—Generation of visual interfaces for content selection or interaction; Content or additional data rendering
    • H04N21/4318—Generation of visual interfaces for content selection or interaction; Content or additional data rendering by altering the content in the rendering process, e.g. blanking, blurring or masking an image region
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/436—Interfacing a local distribution network, e.g. communicating with another STB or one or more peripheral devices inside the home
    • H04N21/4363—Adapting the video stream to a specific local network, e.g. a Bluetooth® network
    • H04N21/43637—Adapting the video stream to a specific local network, e.g. a Bluetooth® network involving a wireless protocol, e.g. Bluetooth, RF or wireless LAN [IEEE 802.11]
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/80—Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
    • H04N21/85—Assembly of content; Generation of multimedia applications
    • H04N21/854—Content authoring
    • H04N21/8547—Content authoring involving timestamps for synchronizing content
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04W—WIRELESS COMMUNICATION NETWORKS
    • H04W4/00—Services specially adapted for wireless communication networks; Facilities therefor
    • H04W4/80—Services using short range communication, e.g. near-field communication [NFC], radio-frequency identification [RFID] or low energy communication
    • G—PHYSICS
    • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G2300/00—Aspects of the constitution of display devices
    • G09G2300/02—Composition of display devices
    • G09G2300/026—Video wall, i.e. juxtaposition of a plurality of screens to create a display screen of bigger dimensions
    • G—PHYSICS
    • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G2340/00—Aspects of display data processing
    • G09G2340/14—Solving problems related to the presentation of information to be displayed
    • G09G2340/145—Solving problems related to the presentation of information to be displayed related to small screens
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/44—Decoders specially adapted therefor, e.g. video decoders which are asymmetric with respect to the encoder
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/47—End-user applications
    • H04N21/485—End-user interface for client configuration
    • H04N21/4858—End-user interface for client configuration for modifying screen layout parameters, e.g. fonts, size of the windows

Definitions

  • the present invention relates to the field of wireless communications, and in particular, to a method, a mobile terminal, and a system for implementing multimedia playback. Background technique
  • LED Light Emitting Diode
  • the larger display design principle is to connect the corresponding digital pins of the horizontal module through the circuit wired connection, and connect the column pins corresponding to the module, each column module (ie, two vertical rows)
  • the module can be controlled by one chip to control dynamic scanning and loop lighting.
  • embodiments of the present invention provide a method, a mobile terminal, and a system for implementing multimedia playback, which solves the problem that the current mobile terminal has a small screen and is not conducive to magnifying the display of the multimedia playback screen.
  • An embodiment of the present invention provides a method for implementing multimedia playback, where the method includes: sending, by a local mobile terminal, a multimedia stream data to be played to a peer mobile terminal by using a connection established by a short-range wireless communication technology;
  • the local mobile terminal and the opposite mobile terminal decode the multimedia stream data to be played, and play the corresponding partially decoded multimedia stream data according to the respective partial playback modes.
  • the method before the sending the multimedia stream data that needs to be played, the method further includes:
  • the local mobile terminal establishes a connection with the opposite mobile terminal through short-range wireless communication technology.
  • the method before the sending the multimedia stream data that needs to be played, the method further includes:
  • the mobile terminal sets its own partial play mode according to user input.
  • the method further includes: the local mobile terminal and the opposite mobile terminal synchronize the multimedia play based on the synchronization mechanism.
  • the local mobile terminal and the opposite mobile terminal synchronize the multimedia play based on the synchronization mechanism, including:
  • the played multimedia stream data is calibrated for playback time.
  • the embodiment of the invention further provides a system for implementing multimedia playback, the system comprising: Local mobile terminal, peer mobile terminal;
  • the local mobile terminal is configured to send multimedia stream data to be played to the peer mobile terminal, perform decoding processing on the multimedia stream data to be played, and play the corresponding partially decoded multimedia stream data according to the set partial play mode;
  • the peer mobile terminal is configured to receive the multimedia stream data sent by the local mobile terminal, decode the received multimedia stream data, and play the corresponding partially decoded multimedia stream data according to the set partial play mode.
  • the local mobile terminal is further configured to set a partial play mode according to the user input; and the opposite mobile terminal is further configured to set a partial play mode according to the user input.
  • the local mobile terminal implements the synchronous play mechanism
  • the local mobile terminal is further configured to: synchronize the multimedia play of the mobile terminal with the peer mobile terminal based on the synchronization mechanism; or
  • the peer mobile terminal When the peer mobile terminal implements the synchronous play mechanism, the peer mobile terminal is further configured to: synchronize the multimedia play of the mobile terminal with the local mobile terminal based on the synchronization mechanism.
  • the mobile terminal includes: a decoding module and a playing module; wherein, the decoding module is configured to perform decoding processing on multimedia stream data that needs to be played; and the playing module is configured to play according to the set partial playing mode. Corresponding to the partially decoded multimedia stream data.
  • the mobile terminal further includes:
  • the setting module is configured to set a partial play mode of the local mobile terminal according to user input.
  • the mobile terminal further includes:
  • the sending module is configured to send multimedia stream data to be played to another mobile terminal; or
  • the receiving module is configured to receive multimedia stream data that needs to be played by another mobile terminal.
  • the mobile terminal further includes:
  • the synchronization module is configured to synchronize the multimedia playback of the mobile terminal with another mobile terminal based on a synchronization mechanism.
  • the synchronization module includes: a monitoring management module and a time management module;
  • the monitoring management module is configured to receive a time label of the multimedia stream data currently played by another mobile terminal, obtain a time label of the multimedia stream data currently played by the other mobile terminal, compare the two, and determine whether there is a time difference, if If yes, the trigger time management module performs a play time calibration on the multimedia stream data played by the mobile terminal;
  • the time management module is configured to perform play time calibration on the multimedia stream data played by the mobile terminal.
  • the local mobile terminal sends the multimedia stream data to be played to the peer mobile terminal by using the connection established by the short-range wireless communication technology; the local mobile terminal and the opposite mobile terminal perform the multimedia stream data that needs to be played.
  • Decoding processing respectively playing the corresponding partially decoded multimedia stream data according to the respective partial playback modes, enabling two mobile terminals to play a part of the multimedia picture based on the short-range wireless communication technology, thereby clearly splicing through the screen of the mobile terminal
  • the multimedia display screen is displayed in an enlarged manner, which helps the user to quickly solve the problem that the screen of the mobile terminal is small and is not conducive to magnifying the display of the multimedia playback screen.
  • the enlarged display of the multimedia play screen is realized by the screen splicing of the mobile terminal, which is obviously different from the existing dot matrix that is formed by the memory to realize the large screen and then the enlarged display of the multimedia play screen.
  • the method is low in cost and quick and easy, and enhances the user experience of the mobile terminal supporting the short-range wireless communication function and the multimedia playback function.
  • FIG. 1 is a schematic flowchart of a process for implementing multimedia playback according to an embodiment of the present invention
  • FIG. 2 is a schematic diagram of a partial play mode setting according to an embodiment of the present invention
  • FIG. 3 is a schematic structural diagram of establishing a multimedia synchronous play setting according to an embodiment of the present invention
  • FIG. 4 is a schematic structural diagram of a system for implementing multimedia playback according to an embodiment of the present invention.
  • Short-range wireless communication technology is a short-range high-frequency wireless communication technology that allows data transmission between terminal devices. With the increasing power of mobile terminals, the demand for data services in terminal products will continue to grow rapidly.
  • Several short-range wireless communication technologies such as Digital Living Network Alliance (DLAN) devices, Bluetooth 4.0 ( ⁇ 4.0) , Bluetooth 4.0 ), WiFi Direct, Wireless-Fidelity Direct, NFC (Near Field Communication) are gradually becoming integrated innovation.
  • DLAN Digital Living Network Alliance
  • Bluetooth 4.0 ⁇ 4.0
  • Bluetooth 4.0 Bluetooth 4.0
  • WiFi Direct Wireless-Fidelity Direct
  • NFC Near Field Communication
  • LTE Long Term Evolution
  • UMTS Universal Mobile Telecommunications System
  • two mobile terminals with the same screen size establish a connection and transmit multimedia stream data through short-range wireless communication technology, decode multimedia stream data of the multimedia file, and respectively play the partially decoded multimedia stream data, complete the video image.
  • the display is made up of the screens of two mobile terminals. It can be seen that the technical solution provided by the embodiment of the present invention shares the multimedia file to be played by the two mobile terminals having the same screen size, and the multimedia display screen is spliced by the display of the two mobile terminals, thereby achieving the magnifying effect.
  • the enlargement of the multimedia playback screen is no longer limited to the wired connection mode, which helps the user to solve the problem that the screen of the mobile terminal is small, which is not conducive to magnifying the display of the multimedia playback screen and the poor viewing performance.
  • the embodiment of the invention describes an implementation process of a method for splicing a multimedia playback screen based on short-distance communication technology. As shown in FIG. 1 , the method includes the following steps: Step 100: The mobile terminal receives the input of the user, and sets its own partial play mode according to the user input.
  • the partial playback modes set by the two mobile terminals correspond to each other, that is, the partial video images played by the two mobile terminals are spliced together to form a complete video image.
  • the partial playback mode generally used is a half frame (1/2) mode. Therefore, the partial play mode can be played in the left field and the right half.
  • Frame playback; Partial playback mode can also play for the upper and lower frames.
  • the partial play mode needs to be set to the left half frame play and the right half frame play by the screen flip mapping method, that is, one of the mobile terminal sets the partial play mode to the left field play, The other mobile terminal sets the partial play mode to play in the right half frame, and the left half frame video image and the right half frame video image are spliced together to form a complete one frame picture, thereby realizing the play through the mobile terminal screen splicing manner. Amplification of the video image.
  • the input to the mobile terminal can be implemented by button selection or option, so that the mobile terminal sets the partial play mode. For example, as shown in FIG. 2, the user sets the partial play mode to the left field play or the right field play (or the upper field play or the lower field play) by operating the button selection area.
  • Step 101 The local mobile terminal sends the multimedia stream data to be played to the peer mobile terminal through the connection established by the short-range wireless communication technology, so that the opposite mobile terminal acquires the multimedia file; the opposite mobile terminal transmits the short-range wireless communication.
  • the technology-established connection receives the multimedia stream data that needs to be played. It can be seen that the local mobile terminal realizes the sharing of the multimedia files that need to be played by the two mobile terminals by transmitting the multimedia media stream data to the opposite mobile terminal.
  • the local mobile terminal can transmit multimedia stream data.
  • the local mobile terminal streams the local multimedia file, and then is responsible for sending the multimedia streaming data to the opposite mobile terminal; For example, when the multimedia file is on the server side, the local mobile terminal directly sends the multimedia stream data to the opposite mobile terminal when receiving the multimedia stream data.
  • the screen size of the local mobile terminal and the peer mobile terminal are completely the same.
  • the local mobile terminal and the opposite mobile terminal can be identical in appearance, and the internal function setting is also It's exactly the same.
  • the mobile terminal and the peer mobile terminal can be defined as mobile terminals having exactly the same terminal model.
  • the processing flow further includes the step of establishing a connection between the local mobile terminal and the opposite mobile terminal by short-range wireless communication technology.
  • the user sets the mobile terminal that needs to send the multimedia stream data as a data source point, and the mobile terminal is the local mobile terminal.
  • the local mobile terminal can open the listening port to listen for the connection request of the opposite mobile terminal, and after listening to the connection request of the opposite mobile terminal, the local mobile terminal establishes a connection with the opposite mobile terminal through short-range wireless communication technology.
  • the local mobile terminal can also search for the opposite mobile terminal by searching for the wireless device, and then actively establish a connection with the opposite mobile terminal through short-range wireless communication technology.
  • Step 102 The local mobile terminal and the opposite mobile terminal perform decoding processing on the multimedia stream data that needs to be played.
  • the decoding process is that the local mobile terminal and the opposite mobile terminal separate the audio stream data and the video stream data for the multimedia stream data to be played, and respectively perform audio decoding and video decoding.
  • the audio decoding decodes the audio stream data
  • the video decoding decodes the video stream data.
  • the video stream data is composed of basic unit video frames, and the video frames may be reference frames or non-reference frames.
  • the reference frame is completely decoded, and the non-reference frame is subjected to the part. Sub-decoding. The specific implementation of the decoding process in the embodiment of the present invention is described in detail below in the case where the reference frame includes an I frame and a P frame, and the non-reference frame is a B frame.
  • Step 1021 The mobile terminal (the local mobile terminal or the opposite mobile terminal) determines the type of the current video frame, and the specific implementation is the same as the existing one, and details are not described herein again.
  • Step 1022 The mobile terminal decodes the extracted video frame according to the type of the video frame, and stores the decoded video frames in a video frame sequence buffer in a play order.
  • I frame decoding all macroblocks in a frame are decoded using an intra prediction algorithm; for P frame decoding, all macroblocks in a frame are decoded using an intra prediction algorithm or an inter prediction algorithm; for B frame decoding, Like the reference frame, it is also composed of macroblocks, where the macroblock is the video element to be decoded, and the intra prediction algorithm and the inter prediction algorithm may be used simultaneously when decoding the B frame.
  • all macroblock positions in the B frame may be obtained according to an inverse scanning algorithm, and a macroblock in a video range to be played indicated by a corresponding partial playback mode is used as a to-be-solved macroblock;
  • the macroblock to which the macroblock is to be solved that is, the macroblock depends; if it is determined that the dependent macroblock is located in the reference frame, the macroblock-dependent information is directly extracted from the reference frame, and is used when decoding the to-be-solved macroblock by using the intra prediction algorithm, If it is determined that the dependent macroblock is located in the current B frame, the intra prediction algorithm is used to decode the dependent macroblock first, and then the macroblock to be decoded is decoded.
  • the intra prediction algorithm is used to decode other macroblocks first.
  • the decoding depends on the macroblock, and finally the macroblock to be solved is decoded. Due to the existence of a slice, the decoding of the macroblock to be solved is limited to the slice, and no other slice is used, so the decoding time of the module to be solved will be less than the decoding time of all the macroblocks of the video frame.
  • the set of macroblocks with correlation is called slice, and the macroblocks between video slices have no correlation.
  • the interframe prediction algorithm of the B frame it means that the decoding of the macroblock needs to use the information of the previously received reference frame.
  • Step 103 The local mobile terminal and the opposite mobile terminal respectively play corresponding partially decoded multimedia stream data according to respective partial play modes. Specifically, the mobile terminal (the local mobile terminal or the opposite mobile terminal) extracts the decoded video frame, that is, the video stream data, from the video frame sequence buffer, and crops the completely decoded video frame into a corresponding partial playback mode.
  • the half-frame video image indicated, and then the half-frame video image is magnified by mapping and full-screen display, and displayed on its own screen without rotation or rotation 90 degrees, that is, for the left and right half-frame playback modes,
  • the cropped half-frame video image is directly displayed on its own screen. For the upper and lower half-frame playback modes, the cropped half-frame video is rotated by 90 degrees and displayed on its own screen.
  • Step 104 During the multimedia playing process, the local mobile terminal and the opposite mobile terminal synchronize the multimedia playback based on the synchronization mechanism.
  • the synchronous playback mechanism mainly includes time management and synchronization monitoring management.
  • the local mobile terminal implements the synchronization mechanism, as shown in FIG. 3, the opposite mobile terminal sends the current connection to the local mobile terminal through the connection established by the short-range wireless communication technology.
  • the time label of the multimedia stream data to be played the monitoring management module in the local mobile terminal receives the time label of the multimedia stream data currently played by the mobile terminal, and obtains the time label of the multimedia stream data currently played by the local mobile terminal.
  • the two are compared to determine whether there is a time difference. If yes, the time management module in the local mobile terminal is triggered to perform the play time calibration on the multimedia stream data played by the local mobile terminal, so as to implement the local mobile terminal and the opposite mobile terminal.
  • the multimedia playback is synchronized so that the two mobile terminals each play a field of the same time label.
  • the monitoring management module determines that the playing time of the two mobile terminals is not synchronized. For example, the playing time of the local mobile terminal is 0.01 seconds faster than the playing time of the mobile terminal, and the time management module slows the playing time of the local mobile terminal by 0.01. second.
  • the specific processing is basically the same as that of the above description, only the playback time calibration is implemented by the peer mobile terminal, and details are not described herein again.
  • the embodiment of the invention further provides a system for realizing multimedia playback, which is applied to a mobile terminal supporting short-range wireless communication technologies (such as DLAN, WIFI, NFC or Bluetooth), as shown in FIG. 4
  • the present invention includes: a local mobile terminal 11 and a peer mobile terminal 12, wherein
  • the local mobile terminal 11 is configured to send the multimedia stream data to be played to the peer mobile terminal 12, decode the multimedia stream data to be played, and play the corresponding partially decoded multimedia stream data according to the set partial play mode;
  • the peer mobile terminal 12 is configured to receive the multimedia stream data sent by the local mobile terminal 11, decode the received multimedia stream data, and play the corresponding partially decoded multimedia stream data according to the set partial play mode.
  • the local mobile terminal 11 is further configured to set its own partial play mode according to user input.
  • the peer mobile terminal 12 is further configured to set its own partial play mode according to user input.
  • the local mobile terminal 11 When the local mobile terminal 11 implements the synchronous play mechanism, the local mobile terminal 11 is further configured to synchronize the multimedia play of the mobile terminal 12 with the peer mobile terminal 12 based on the synchronization mechanism, and specifically, receive the multimedia stream currently played by the opposite mobile terminal 12.
  • the time tag of the data is obtained, and the time tag of the multimedia stream data currently being played by the local mobile terminal 11 is obtained, and the two are compared to determine whether there is a time difference. If yes, the playing time calibration is performed on the multimedia stream data played by the local mobile terminal 11 .
  • the peer mobile terminal 12 When the peer mobile terminal 12 implements the synchronous play mechanism, the peer mobile terminal 12 is further configured to synchronize the multimedia play of the mobile terminal 11 with the local mobile terminal 11 based on the synchronization mechanism, and specifically, receive the multimedia stream currently played by the local mobile terminal 11.
  • the time tag of the data, the time tag of the multimedia stream data currently being played by the peer mobile terminal 12 is obtained, and the two are compared to determine whether there is a time difference. If yes, the multimedia stream data played by the peer mobile terminal 12 is played. calibration.
  • the local mobile terminal 11 and the peer mobile terminal 12 includes: a sending module 111, a first decoding module 112, and a first playing module 113, where
  • the sending module 111 is configured to send the multimedia stream data to be played to the peer mobile terminal 12;
  • the first decoding module 112 is configured to perform decoding processing on the multimedia stream data that needs to be played.
  • the first playing module 113 is configured to play the corresponding partially decoded multimedia stream data according to the set partial play mode.
  • the local mobile terminal 11 further includes: a first setting module 114 configured to set a partial play mode of the local mobile terminal according to user input.
  • the local mobile terminal 11 further includes: a first synchronization module 115 configured to synchronize multimedia playback between the local mobile terminal and the opposite mobile terminal based on the synchronization mechanism.
  • the first synchronization module 115 includes: a monitoring management module and a time management module, wherein the monitoring management module is configured to receive a time label of the multimedia stream data currently played by the peer mobile terminal, and obtain a multimedia stream currently played by the local mobile terminal. The time stamp of the data is compared to determine whether there is a time difference. If yes, the trigger time management module performs a play time calibration on the multimedia stream data played by the local mobile terminal.
  • the time management module is configured to perform a play time calibration on the multimedia stream data played by the local mobile terminal.
  • the sending module 111, the first setting module 114, and the first synchronization module 115 of the local mobile terminal 11 may be processed by a central processing unit (CPU) of the mobile terminal or digital signal processing.
  • DSP Digital Signal Processor
  • FPGA programmable logic array
  • the first decoding module 112 can be implemented by a decoder
  • the first playing module 113 can be implemented by a display screen of the mobile terminal.
  • the peer mobile terminal 12 includes: a receiving module 121, a second decoding module 122, and a second playing module 123, where
  • the receiving module 121 is configured to receive multimedia stream data that needs to be played by the local mobile terminal;
  • the second decoding module 122 is configured to perform decoding processing on the multimedia stream data received by the receiving module 121.
  • the second playing module 123 is configured to play the corresponding partially decoded multimedia stream data according to the set partial playing mode.
  • the peer mobile terminal further includes: a second setting module 124 configured to set a partial play mode of the opposite mobile terminal 12 according to the user input.
  • the peer mobile terminal 12 When the peer mobile terminal 12 implements the synchronous play mechanism, the peer mobile terminal 12 further includes: a second synchronization module 125 configured to synchronize multimedia play between the opposite mobile terminal and the local mobile terminal based on the synchronization mechanism.
  • the second synchronization module 125 includes: a monitoring management module and a time management module, wherein the monitoring management module is configured to receive a time label of the multimedia stream data currently played by the local mobile terminal, and obtain a multimedia stream currently played by the peer mobile terminal. The time stamp of the data is compared to determine whether there is a time difference. If yes, the trigger time management module performs a play time calibration on the multimedia stream data played by the peer mobile terminal.
  • the time management module is configured to perform a play time calibration on the multimedia stream data played by the peer mobile terminal.
  • the specific implementation of the first decoding module and the second decoding module described above corresponds to the step 102 described in the method of the previous embodiment of the present invention.
  • the specific implementation of the first play module and the second play module described above corresponds to the step 103 described in the foregoing method in the embodiment of the present invention.
  • the receiving module 121 of the peer mobile terminal 12 can be implemented by a CPU of the mobile terminal, or a DSP, or an FPGA, etc.; the second decoding module 122 can be implemented by a decoder of the mobile terminal; the second playing module 123 can be displayed by the display screen of the mobile terminal. achieve.
  • the embodiment of the present invention can realize that each of the two mobile terminals plays a part of the multimedia picture based on the short-range wireless communication technology, so that the multimedia play picture can be clearly enlarged and displayed by the splicing of the screen of the mobile terminal.

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Theoretical Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Human Computer Interaction (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Computer Security & Cryptography (AREA)
  • Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
  • Mobile Radio Communication Systems (AREA)

Abstract

本发明公开了一种实现多媒体播放的方法，本端移动终端通过基于短距离无线通讯技术建立的连接向对端移动终端发送需要播放的多媒体流数据；本端移动终端和对端移动终端对需要播放的多媒体流数据进行解码处理，按照各自的部分播放模式分别播放对应部分解码后的多媒体流数据。同时，本发明还公开了一种实现多媒体播放的系统和移动终端。采用本发明的技术方案，能够基于短距离无线通讯技术实现两个移动终端各自播放多媒体画面的一部分，从而通过移动终端屏幕的拼接可以清晰地放大显示多媒体播放画面，帮助用户快速解决移动终端屏幕较小、不利于放大显示多媒体播放画面的问题。

Description

一种实现多媒体播放的方法、 移动终端及系统 技术领域 本发明涉及无线通讯领域， 尤其涉及一种实现多媒体播放的方法、 移 动终端及系统。 背景技术
市面上的发光二极管（LED, Light Emitting Diode ) 电子显示屏是根据 二极管共阳， 当某一行接高电平， 且某一列接入低电平时， 行列交叉的二 极管就会被点亮的原理实现的， 而更大的显示屏设计原理是通过电路有线 连接的方式将横向模块对应的数字引脚接起来， 将列向模块对应的字母引 脚接起来， 每一列模块（即竖排的两个模块）可由一个芯片控制动态扫描、 循环点亮实现。
但是这种在物理层面上的屏幕扩大不能够应用到移动终端屏幕的扩大 上， 理由 ^下：
移动终端的最重要的特点之一就是便携性， 以方便随时随地连接网络， 决定了移动终端的屏幕不可能过大。 但是移动终端的屏幕较小， 不利于多 媒体播放画面的欣赏， 而传统的通过移动终端跟大屏幕通过有线连接的放 大显示方式， 有很强的空间限制性。 发明内容
鉴于以上问题， 本发明实施例提出一种实现多媒体播放的方法、 移动 终端及系统， 解决目前的移动终端屏幕较小， 不利于放大显示多媒体播放 画面的问题。
为了实现上述目的， 本发明实施例采用以下技术方案： 本发明实施例提供了一种实现多媒体播放的方法， 所述方法包括： 本端移动终端通过基于短距离无线通讯技术建立的连接向对端移动终 端发送需要播放的多媒体流数据；
本端移动终端和对端移动终端对需要播放的多媒体流数据进行解码处 理， 按照各自设置的部分播放模式分别播放对应部分解码后的多媒体流数 据。
上述方案中， 所述发送需要播放的多媒体流数据之前， 所述方法还包 括：
本端移动终端与对端移动终端通过短距离无线通讯技术建立连接。 上述方案中， 所述发送需要播放的多媒体流数据之前， 所述方法还包 括：
移动终端根据用户输入设置自身的部分播放模式。
上述方案中， 所述方法还包括： 本端移动终端和对端移动终端基于同 步机制实现多媒体播放的同步。
上述方案中， 所述本端移动终端和对端移动终端基于同步机制实现多 媒体播放的同步， 包括：
接收对端移动终端当前播放的多媒体流数据的时间标签， 获取本端移 动终端当前播放的多媒体流数据的时间标签， 将二者进行比较， 确定是否 存在时间差， 如果存在， 则对本端移动终端播放的多媒体流数据进行播放 时间校准； 或者，
接收本端移动终端当前播放的多媒体流数据的时间标签， 获取对端移 动终端当前播放的多媒体流数据的时间标签， 将二者进行比较， 确定是否 存在时间差， 如果存在， 则对对端移动终端播放的多媒体流数据进行播放 时间校准。
本发明实施例还提供了一种实现多媒体播放的系统， 所述系统包括： 本端移动终端、 对端移动终端； 其中，
所述本端移动终端， 配置为向对端移动终端发送需要播放的多媒体流 数据， 对需要播放的多媒体流数据进行解码处理， 按照设置的部分播放模 式播放对应部分解码后的多媒体流数据；
所述对端移动终端， 配置为接收本端移动终端发送的多媒体流数据， 对收到的多媒体流数据进行解码处理， 按照设置的部分播放模式播放对应 部分解码后的多媒体流数据。
所述本端移动终端， 还配置为根据用户输入设置自身的部分播放模式； 所述对端移动终端， 还配置为根据用户输入设置自身的部分播放模式。 在本端移动终端实现同步播放机制时， 所述本端移动终端还配置为： 基于同步机制实现自身与对端移动终端的多媒体播放同步； 或者，
在对端移动终端实现同步播放机制时， 所述对端移动终端还配置为： 基于同步机制实现自身与本端移动终端的多媒体播放同步。
上述方案中， 所述移动终端包括： 解码模块、 播放模块； 其中， 所述解码模块， 配置为对需要播放的多媒体流数据进行解码处理； 所述播放模块， 配置为按照设置的部分播放模式播放对应部分解码后 的多媒体流数据。
上述方案中， 所述移动终端还包括：
所述设置模块， 配置为根据用户输入设置本端移动终端的部分播放模 式。
上述方案中， 所述移动终端还包括：
所述发送模块， 配置为向另一移动终端发送需要播放的多媒体流数据； 或者，
所述接收模块， 配置为接收另一移动终端发送的需要播放的多媒体流 数据。 上述方案中， 所述移动终端还包括：
所述同步模块， 配置为基于同步机制实现所述移动终端与另一移动终 端的多媒体播放同步。
上述方案中， 所述同步模块包括： 监测管理模块、 时间管理模块； 其 中，
所述监测管理模块， 配置为接收另一移动终端当前播放的多媒体流数 据的时间标签， 获取另一移动终端当前播放的多媒体流数据的时间标签， 将二者进行比较， 确定是否存在时间差， 如果存在， 则触发时间管理模块 对所述移动终端播放的多媒体流数据进行播放时间校准；
所述时间管理模块， 配置为对所述移动终端播放的多媒体流数据进行 播放时间校准。 本发明实施例中， 本端移动终端通过基于短距离无线通讯 技术建立的连接向对端移动终端发送需要播放的多媒体流数据； 本端移动 终端和对端移动终端对需要播放的多媒体流数据进行解码处理， 按照各自 设置的部分播放模式分别播放对应部分解码后的多媒体流数据， 能够基于 短距离无线通讯技术实现两个移动终端各自播放多媒体画面的一部分， 从 而通过移动终端屏幕的拼接可以清晰地放大显示多媒体播放画面， 帮助用 户快速解决移动终端屏幕较小、 不利于放大显示多媒体播放画面的问题。
本发明实施例提供的技术方案， 多媒体播放画面的放大显示是通过移 动终端的屏幕拼接来实现的， 明显不同于现有的通过存储器形成的点阵实 现大屏幕、 进而放大显示的多媒体播放画面的方式， 实现成本低， 并且快 速简便， 增强了支持短距离无线通讯功能和多媒体播放功能的移动终端的 用户的体验。
附图说明
图 1是本发明实施例实现多媒体播放的处理流程示意图；
图 2是本发明实施例部分播放模式设置的示意图； 图 3是本发明实施例建立多媒体同步播放设置的结构示意图； 图 4为本发明实施例实现多媒体播放的系统的组成结构示意图。 具体实施方式
短距离无线通讯技术是一种短距离的高频无线通讯技术， 允许终端设 备之间进行数据传输。 随着移动终端功能的日益强大， 终端产品对数据业 务的需求将持续、 快速增长， 几种短距离无线通讯技术如数字生活网络联 盟 （DLAN， Digital Living Network Alliance )设备、 蓝牙 4.0 ( ΒΤ4.0 , Bluetooth4.0 )、 无线保真度连接（ WiFi Direct, Wireless-Fidelity Direct )、 近 距离无线通讯 ( NFC， Near Field Communication )都逐步走向融合创新。 同 时， 短距离无线通讯技术对于移动通讯网络如长期演进（LTE， Long Term Evolution )、通用移动通讯系统( UMTS， Universal Mobile Telecommunications System ) 的互补性也是未来移动通讯发展的另一个热点。
为了使本发明的目的、技术方案及优点更加清楚， 以下结合附图及实施 例， 对本发明进行进一步详细说明。 应当理解， 此处所描述的具体实施例 仅仅用以解释本发明， 并不用于限定本发明。
本发明实施例中： 两个屏幕尺寸相同的移动终端通过短距离无线通讯 技术建立连接并传输多媒体流数据， 解码多媒体文件的多媒体流数据， 分 别播放部分解码后的多媒体流数据， 视频图像的完整显示由两个移动终端 的屏幕拼接而成。 由此可见， 本发明实施例提供的技术方案通过两个屏幕 尺寸完全相同的移动终端共享需要播放的多媒体文件， 并由这两个移动终 端的显示拼接多媒体播放画面， 从而达到放大的效果， 可以使得多媒体播 放画面的放大不再局限于有线连接方式， 帮助用户解决移动终端屏幕较小， 不利于放大显示多媒体播放画面、 观赏性差的问题。
本发明实施例记载了一种基于短距离通讯技术拼接多媒体播放画面的 方法的实现流程， 如图 1所示， 包括以下步骤： 步骤 100: 移动终端接收用户的输入， 根据用户输入设置自身的部分播 放模式。
对于两个移动终端而言， 两个移动终端所设置的部分播放模式相对应， 即将两个移动终端各自播放的那部分视频图像拼接在一起能够组成完整的 视频图像。 对于整屏播放的视频流数据， 由于协同的两款移动终端屏幕尺 寸相同， 一般采用的部分播放模式为半帧 （1/2 )模式， 因此， 部分播放模 式可以为左半帧播放和右半帧播放； 部分播放模式也可以为上半帧播放和 下半帧播放。
如果播放的视频图像是横向观赏的时候， 就需要通过屏幕翻转映射的 方法将部分播放模式设置为左半帧播放和右半帧播放， 即其中一个移动终 端设置部分播放模式为左半帧播放， 另一个移动终端则设置部分播放模式 为右半帧播放， 左半帧视频图像和右半帧视频图像拼接起来， 就构成了完 整的一帧画面， 从而通过移动终端屏幕拼接的方式实现了播放的视频图像 的放大。
用户确定移动终端的部分播放模式、 即需要移动终端播放多媒体播放 画面的哪一部分后， 可通过按钮选择或选项来实现向移动终端的输入， 以 使移动终端设置部分播放模式。 例如， 可以如图 2所示， 用户通过对按钮 选择区域的操作， 来使移动终端设置部分播放模式为左半帧播放或右半帧 播放（或者上半帧播放或下半帧播放）。
步骤 101 :本端移动终端通过基于短距离无线通讯技术建立的连接向对 端移动终端发送需要播放的多媒体流数据， 以使对端移动终端获取多媒体 文件； 对端移动终端通过基于短距离无线通讯技术建立的连接接收需要播 放的多媒体流数据。 由此可见， 本端移动终端通过向对端移动终端发送多 媒体流数据， 实现两个移动终端对需要播放的多媒体文件的共享。
根据不同的多媒体文件来源， 本端移动终端对多媒体流数据的发送可 以有两种不同的实现方式： 对于需要播放本地的多媒体文件时， 本端移动 终端对本地的多媒体文件进行流化， 然后负责发送多媒体流数据给对端移 动终端； 对于需要播放存储在非本地、 如服务器侧的多媒体文件时， 本端 移动终端在接收到多媒体流数据时直接向对端移动终端发送该多媒体流数 据。
其中， 所述的本端移动终端和对端移动终端的屏幕尺寸完全是一样的， 较佳地， 本端移动终端和对端移动终端可以在外观上完全相同， 且在内部 的功能设置上也完全相同。 特殊地， 可以限定本端移动终端和对端移动终 端是两个终端型号完全相同的移动终端。
这里， 在步骤 101 之前， 该处理流程还包括本端移动终端与对端移动 终端通过短距离无线通讯技术建立连接的步骤。
具体地来说， 用户将需要发送多媒体流数据的移动终端设置为数据源 点， 该移动终端即为本端移动终端。 本端移动终端可以打开监听端口监听 对端移动终端的连接请求， 监听到对端移动终端的连接请求后， 本端移动 终端与对端移动终端通过短距离无线通讯技术建立连接。 本端移动终端也 可以通过搜索无线设备的方式搜索到对端移动终端后， 主动与对端移动终 端通过短距离无线通讯技术建立连接。
步骤 102:本端移动终端和对端移动终端对需要播放的多媒体流数据进 行解码处理。
解码处理即是本端移动终端和对端移动终端对于要播放的多媒体流数 据分离出音频流数据和视频流数据， 分别进行音频解码和视频解码。 音频 解码即对音频流数据进行解码处理， 视频解码即对视频流数据进行解码处 理。
视频流数据由基本单位视频帧来组成， 而视频帧可以是参考帧， 也可 以是非参考帧。 视频解码中， 对参考帧进行完全解码， 对非参考帧进行部 分解码。 以下以参考帧包括 I帧和 P帧、 非参考帧为 B帧的情况， 对本发 明实施例中解码处理的具体实现进行详细描述。
步骤 1021 : 移动终端 （本端移动终端或对端移动终端）确定当前视频 帧的类型， 具体实现与现有相同， 在此不再赘述；
步骤 1022: 移动终端根据视频帧的类型解码所提取的视频帧， 并将解 码后得到的视频帧按播放顺序存放在视频帧序列緩存中；
具体地， 对于 I帧解码， 使用帧内预测算法解码帧内的所有宏块； 对于 P帧解码，使用帧内预测算法或者帧间预测算法解码帧内的所有的宏块； 对 于 B帧解码， 与参考帧一样， 也是由宏块组成， 其中， 宏块是待解码的视 频元素， 解码 B帧时可能同时使用帧内预测算法和帧间预测算法。
具体地， 解码 B帧时， 可以先按照反扫描算法得到 B帧中所有宏块位 置， 将对应设置的部分播放模式所指示的待播放的视频范围内的宏块作为 待解宏块； 然后确定待解宏块所依赖的宏块、 即依赖宏块； 如果确定依赖 宏块位于参考帧， 则直接从参考帧取出依赖宏块的信息， 在使用帧内预测 算法解码待解宏块时使用， 如果确定依赖宏块位于当前 B帧， 则使用帧内 预测算法先解码依赖宏块， 再解码待解宏块， 如果依赖宏块也依赖其他宏 块， 则使用帧内预测算法先解码其他宏块再解码依赖宏块， 最后解码待解 宏块。 由于视频片 （slice ) 的存在， 待解宏块的解码会限制在 slice内， 不 会用到其它 slice, 因此待解模块的解码时间会少于对该视频帧所有的宏块 的解码时间。 具有相关性的宏块集合称为 slice, 视频片之间的宏块没有相 关性。 对于 B帧的帧间预测算法， 就是指宏块的解码需要使用前面接收过 的参考帧的信息。
以上所述视频解码可依据视频编解码技术标准之一 H.264标准来进行。 步骤 103:本端移动终端和对端移动终端按照各自的部分播放模式分别 播放对应部分解码后的多媒体流数据。 具体地， 移动终端 （本端移动终端或对端移动终端）从视频帧序列緩 存中取出已经解码的视频帧、 即视频流数据， 并将完全解码的视频帧裁剪 为对应设置的部分播放模式所指示的那半帧视频图像， 然后再将该半帧视 频图像经过映射及全屏显示放大， 不旋转或者旋转 90度显示在自身的屏幕 上， 也就是说， 对于左、 右半帧播放模式， 将裁剪后的半帧视频图像直接 显示在自身的屏幕上， 对于上、 下半帧播放模式， 将裁剪后的半帧视频旋 转 90度后显示在自身的屏幕上。
步骤 104: 多媒体播放过程中， 本端移动终端和对端移动终端基于同步 机制实现多媒体播放的同步。
同步播放机制主要包括时间管理和同步监测管理， 当本端移动终端实 现同步机制时， 可以如图 3 所示， 对端移动终端通过基于短距离无线通讯 技术建立的连接向本端移动终端发送当前播放的多媒体流数据的时间标 签， 本端移动终端中的监测管理模块收到对端移动终端当前播放的多媒体 流数据的时间标签后， 获取本端移动终端当前播放的多媒体流数据的时间 标签， 将二者进行比较， 确定是否存在时间差， 如果存在， 则触发本端移 动终端中的时间管理模块对本端移动终端播放的多媒体流数据进行播放时 间校准， 以实现本端移动终端和对端移动终端的多媒体播放同步， 从而使 两个移动终端各自播放的是同一时间标签的半帧。
具体的， 监测管理模块确定两个移动终端的播放时间不同步， 例如本 端移动终端比对端移动终端的播放时间快了 0.01秒， 那么时间管理模块将 本端移动终端的播放时间调慢 0.01秒。
如果由对端移动终端实现同步播放机制， 具体处理与以上描述基本相 同， 只是由对端移动终端实现播放时间校准， 在此不再赘述。
本发明实施例还提供了一种实现多媒体播放的系统， 应用于支持短距 离无线通讯技术（如 DLAN、 WIFI、 NFC或蓝牙） 的移动终端， 如图 4所 示， 包括： 本端移动终端 11和对端移动终端 12， 其中，
本端移动终端 11，配置为向对端移动终端 12发送需要播放的多媒体流 数据， 对需要播放的多媒体流数据进行解码处理， 按照设置的部分播放模 式播放对应部分解码后的多媒体流数据；
对端移动终端 12， 配置为接收本端移动终端 11发送的多媒体流数据， 对接收到的多媒体流数据进行解码处理， 按照设置的部分播放模式播放对 应部分解码后的多媒体流数据。
所述本端移动终端 11， 还配置为根据用户输入设置自身的部分播放模 式。
所述对端移动终端 12， 还配置为根据用户输入设置自身的部分播放模 式。
在本端移动终端 11 实现同步播放机制时， 本端移动终端 11还配置为 基于同步机制实现自身与对端移动终端 12的多媒体播放同步， 具体地， 接 收对端移动终端 12当前播放的多媒体流数据的时间标签， 获取本端移动终 端 11当前播放的多媒体流数据的时间标签， 将二者进行比较， 确定是否存 在时间差， 如果存在， 则对本端移动终端 11播放的多媒体流数据进行播放 时间校准。
在对端移动终端 12实现同步播放机制时， 对端移动终端 12还配置为 基于同步机制实现自身与本端移动终端 11的多媒体播放同步， 具体地， 接 收本端移动终端 11当前播放的多媒体流数据的时间标签， 获取对端移动终 端 12当前播放的多媒体流数据的时间标签， 将二者进行比较， 确定是否存 在时间差， 如果存在， 则对对端移动终端 12播放的多媒体流数据进行播放 时间校准。
本端移动终端 11和对端移动终端 12的具体处理在前面的本发明实施 例方法实现中已有详细描述， 在此不再赘述。 其中， 本端移动终端包括 11 : 发送模块 111、 第一解码模块 112和第一 播放模块 113， 其中，
发送模块 111， 配置为向对端移动终端 12发送需要播放的多媒体流数 据；
第一解码模块 112， 配置为对需要播放的多媒体流数据进行解码处理； 第一播放模块 113，配置为按照设置的部分播放模式播放对应部分解码 后的多媒体流数据。
所述本端移动终端 11还包括： 第一设置模块 114， 配置为根据用户输 入设置本端移动终端的部分播放模式。
在本端移动终端实现同步播放机制时， 所述本端移动终端 11还包括： 第一同步模块 115，配置为基于同步机制实现本端移动终端与对端移动终端 的多媒体播放同步。
所述第一同步模块 115包括： 监测管理模块和时间管理模块， 其中， 监测管理模块， 配置为接收对端移动终端当前播放的多媒体流数据的 时间标签， 获取本端移动终端当前播放的多媒体流数据的时间标签， 将二 者进行比较， 确定是否存在时间差， 如果存在， 则触发时间管理模块对本 端移动终端播放的多媒体流数据进行播放时间校准；
时间管理模块， 配置为对本端移动终端播放的多媒体流数据进行播放 时间校准。
需要说明的是， 在实际应用中， 本端移动终端 11的发送模块 111、 第 一设置模块 114及第一同步模块 115可由移动终端的中央处理器（CPU, Central Processing Unit )、或数字信号处理器 ( DSP, Digital Signal Processor )、 或可编程逻辑阵列 （FPGA， Field Programmable Gate Array )等实现； 第一 解码模块 112可由解码器来实现； 第一播放模块 113可由移动终端的显示 屏来实现。 其中， 对端移动终端 12包括： 接收模块 121、 第二解码模块 122和第 二播放模块 123， 其中，
接收模块 121，配置为接收本端移动终端发送的需要播放的多媒体流数 据；
第二解码模块 122，配置为对接收模块 121收到的多媒体流数据进行解 码处理；
第二播放模块 123，配置为按照设置的部分播放模式播放对应部分解码 后的多媒体流数据。
所述对端移动终端还包括： 第二设置模块 124， 配置为根据用户输入设 置对端移动终端 12的部分播放模式。
在对端移动终端 12实现同步播放机制时， 所述对端移动终端 12还包 括： 第二同步模块 125， 配置为基于同步机制实现对端移动终端与本端移动 终端的多媒体播放同步。
所述第二同步模块 125包括： 监测管理模块和时间管理模块， 其中， 监测管理模块， 配置为接收本端移动终端当前播放的多媒体流数据的 时间标签， 获取对端移动终端当前播放的多媒体流数据的时间标签， 将二 者进行比较， 确定是否存在时间差， 如果存在， 则触发时间管理模块对对 端移动终端播放的多媒体流数据进行播放时间校准；
时间管理模块， 配置为对对端移动终端播放的多媒体流数据进行播放 时间校准。
以上所述的第一解码模块和第二解码模块的具体实现对应前面本发明 实施例中方法描述的步骤 102。
以上所述的第一播放模块和第二播放模块的具体实现对应前面本发明 实施例中方法描述的步骤 103。
需要说明的是， 在实际应用中， 对端移动终端 12的接收模块 121、 第 二设置模块 124及第二同步模块 125可由移动终端的 CPU、或 DSP、或 FPGA 等实现； 第二解码模块 122可由移动终端的解码器来实现； 第二播放模块 123可由移动终端的显示屏来实现。
如上所述， 本发明实施例能够基于短距离无线通讯技术实现两个移动 终端各自播放多媒体画面的一部分， 从而通过移动终端屏幕的拼接可以清 晰地放大显示多媒体播放画面。
以上所述， 仅为本发明的较佳实施例而已， 并非用于限定本法明的保 护范围。

Claims

权利要求书
1、 一种实现多媒体播放的方法， 所述方法包括：
本端移动终端通过基于短距离无线通讯技术建立的连接向对端移动终 端发送需要播放的多媒体流数据；
本端移动终端和对端移动终端对需要播放的多媒体流数据进行解码处 理， 按照各自设置的部分播放模式分别播放对应部分解码后的多媒体流数 据。
2、 根据权利要求 1所述的方法， 其中， 所述发送需要播放的多媒体流 数据之前， 所述方法还包括：
本端移动终端与对端移动终端通过短距离无线通讯技术建立连接。
3、 根据权利要求 1所述的方法， 其中， 所述发送需要播放的多媒体流 数据之前， 所述方法还包括：
移动终端根据用户输入设置自身的部分播放模式。
4、 根据权利要求 1、 2或 3所述的方法， 其中， 所述方法还包括： 本端移动终端和对端移动终端基于同步机制实现多媒体播放的同步。
5、 根据权利要求 4所述的方法， 其中， 所述本端移动终端和对端移动 终端基于同步机制实现多媒体播放的同步， 包括：
接收对端移动终端当前播放的多媒体流数据的时间标签， 获取本端移 动终端当前播放的多媒体流数据的时间标签， 将二者进行比较， 确定是否 存在时间差， 如果存在， 则对本端移动终端播放的多媒体流数据进行播放 时间校准； 或者，
接收本端移动终端当前播放的多媒体流数据的时间标签， 获取对端移 动终端当前播放的多媒体流数据的时间标签， 将二者进行比较， 确定是否 存在时间差， 如果存在， 则对对端移动终端播放的多媒体流数据进行播放 时间校准。
6、 一种实现多媒体播放的系统， 所述系统包括：
本端移动终端， 配置为向对端移动终端发送需要播放的多媒体流数据， 对需要播放的多媒体流数据进行解码处理， 按照设置的部分播放模式播放 对应部分解码后的多媒体流数据；
对端移动终端， 配置为接收本端移动终端发送的多媒体流数据， 对收 到的多媒体流数据进行解码处理， 按照设置的部分播放模式播放对应部分 解码后的多媒体流数据。
7、 根据权利要求 6所述的系统， 其中，
所述本端移动终端， 还配置为根据用户输入设置自身的部分播放模式； 所述对端移动终端， 还配置为根据用户输入设置自身的部分播放模式。
8、 根据权利要求 6或 7所述的系统， 其中，
在本端移动终端实现同步播放机制时， 所述本端移动终端还配置为： 基于同步机制实现自身与对端移动终端的多媒体播放同步； 或者，
在对端移动终端实现同步播放机制时， 所述对端移动终端还配置为： 基于同步机制实现自身与本端移动终端的多媒体播放同步。
9、 一种实现多媒体播放的移动终端， 所述移动终端包括：
解码模块， 配置为对需要播放的多媒体流数据进行解码处理； 播放模块， 配置为按照设置的部分播放模式播放对应部分解码后的多 媒体流数据。
10、 根据权利要求 9所述的移动终端， 其中， 所述移动终端还包括： 设置模块， 配置为根据用户输入设置本端移动终端的部分播放模式。
11、 根据权利要求 9所述的移动终端， 其中， 所述移动终端还包括： 发送模块， 配置为向另一移动终端发送需要播放的多媒体流数据； 或 者， 接收模块， 配置为接收另一移动终端发送的需要播放的多媒体流数据。
12、 根据权利要求 9、 10或 11所述的移动终端， 其中， 所述移动终端 还包括：
同步模块， 配置为基于同步机制实现所述移动终端与另一移动终端的 多媒体播放同步。
13、 根据权利要求 12所述的移动终端， 其中， 所述同步模块包括： 监测管理模块， 配置为接收另一移动终端当前播放的多媒体流数据的 时间标签， 获取另一移动终端当前播放的多媒体流数据的时间标签， 将二 者进行比较， 确定是否存在时间差， 如果存在， 则触发时间管理模块对所 述移动终端播放的多媒体流数据进行播放时间校准；
时间管理模块， 配置为对所述移动终端播放的多媒体流数据进行播放 时间校准。
PCT/CN2013/081227 2012-10-23 2013-08-09 一种实现多媒体播放的方法、移动终端及系统 WO2014063515A1 (zh)

Priority Applications (2)

Application Number Priority Date Filing Date Title
US14/437,950 US9846563B2 (en) 2012-10-23 2013-08-09 Method, mobile terminal and system for implementing multimedia playing
EP13849384.6A EP2914006A4 (en) 2012-10-23 2013-08-09 METHOD, MOBILE TERMINAL AND SYSTEM FOR READING MULTIMEDIA READING

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201210407314.4 2012-10-23
CN201210407314.4A CN103780919B (zh) 2012-10-23 2012-10-23 一种实现多媒体播放的方法、移动终端及系统

Publications (1)

Publication Number Publication Date
WO2014063515A1 true WO2014063515A1 (zh) 2014-05-01

Family

ID=50543962

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2013/081227 WO2014063515A1 (zh) 2012-10-23 2013-08-09 一种实现多媒体播放的方法、移动终端及系统

Country Status (4)

Country Link
US (1) US9846563B2 (zh)
EP (1) EP2914006A4 (zh)
CN (1) CN103780919B (zh)
WO (1) WO2014063515A1 (zh)

Families Citing this family (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
DE102015001622A1 (de) * 2015-02-09 2016-08-11 Unify Gmbh & Co. Kg Verfahren zur Übertragung von Daten in einem Multimedia-System, sowie Softwareprodukt und Vorrichtung zur Steuerung der Übertragung von Daten in einem Multimedia-System
CN105578248B (zh) * 2015-12-30 2020-07-31 Tcl新技术（惠州）有限公司 花式拼接播放方法、装置和系统
CN105872661A (zh) * 2016-03-30 2016-08-17 联想(北京)有限公司 一种信息处理方法及电子设备
CN106227492B (zh) * 2016-08-03 2019-07-26 广东威创视讯科技股份有限公司 拼接墙与移动智能终端互联方法和装置
CN109166570B (zh) * 2018-07-24 2019-11-26 百度在线网络技术（北京）有限公司 一种语音切分的方法、装置、设备和计算机存储介质

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101568028A (zh) * 2009-05-15 2009-10-28 中兴通讯股份有限公司 一种移动终端及移动终端间协同播放移动广播电视的方法
CN101674364A (zh) * 2009-09-28 2010-03-17 深圳华为通信技术有限公司 一种无线屏幕拼接显示方法、移动通信终端和装置
US20120258781A1 (en) * 2008-04-16 2012-10-11 Walker Digital, Llc Systems, methods and apparatus for facilitating multi-round lottery play

Family Cites Families (12)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP1422873A4 (en) * 2001-08-28 2007-02-21 Sony Corp INFORMATION PROCESSING APPARATUS AND METHOD AND ASSOCIATED RECORDING MEDIUM
KR100523052B1 (ko) * 2002-08-30 2005-10-24 한국전자통신연구원 다중 디스플레이 방식을 지원하는 다시점 동영상의 객체 기반 부호화 장치 및 그 방법과 그를 이용한 객체 기반 송수신 시스템 및 그 방법
US20050286546A1 (en) 2004-06-21 2005-12-29 Arianna Bassoli Synchronized media streaming between distributed peers
CN101202568B (zh) * 2006-12-14 2012-01-25 北京三星通信技术研究有限公司 支持联合播放的终端及方法
US20080216125A1 (en) * 2007-03-01 2008-09-04 Microsoft Corporation Mobile Device Collaboration
CN101459724A (zh) * 2007-12-13 2009-06-17 乐金电子(中国)研究开发中心有限公司 一种可合二为一的情侣移动终端
US8644757B2 (en) * 2008-12-04 2014-02-04 Nokia Corporation Method and system for creation and control of virtual rendering devices
CN101587431B (zh) * 2009-04-08 2011-03-16 广东威创视讯科技股份有限公司 一种可以跨屏实现多屏播放视频的方法
EP2539759A1 (en) * 2010-02-28 2013-01-02 Osterhout Group, Inc. Local advertising content on an interactive head-mounted eyepiece
CN102222493A (zh) 2010-04-19 2011-10-19 英业达股份有限公司 扩大显示影像的方法及装置
CN101969460B (zh) * 2010-09-28 2013-07-03 同辉佳视(北京)信息技术有限公司 一种多屏幕视频同步播放的方法和系统
US9696802B2 (en) * 2013-03-20 2017-07-04 Microsoft Technology Licensing, Llc Short range wireless powered ring for user interaction and sensing

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20120258781A1 (en) * 2008-04-16 2012-10-11 Walker Digital, Llc Systems, methods and apparatus for facilitating multi-round lottery play
CN101568028A (zh) * 2009-05-15 2009-10-28 中兴通讯股份有限公司 一种移动终端及移动终端间协同播放移动广播电视的方法
CN101674364A (zh) * 2009-09-28 2010-03-17 深圳华为通信技术有限公司 一种无线屏幕拼接显示方法、移动通信终端和装置

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
See also references of EP2914006A4 *

Also Published As

Publication number Publication date
US20150301780A1 (en) 2015-10-22
CN103780919A (zh) 2014-05-07
EP2914006A1 (en) 2015-09-02
CN103780919B (zh) 2018-05-08
US9846563B2 (en) 2017-12-19
EP2914006A4 (en) 2015-09-02

Similar Documents

Publication Publication Date Title
WO2021004381A1 (zh) 一种投屏显示方法及电子设备
TWI565310B (zh) 無線通訊系統中的視訊流送
US10383098B2 (en) Information processing device and information processing method
US10869069B2 (en) Information processing device and information processing method
JP6284888B2 (ja) ワイヤレスディスプレイシステム内のソースデバイスでのフレームの取込みおよびバッファリング
JP5989779B2 (ja) 同期したワイヤレスディスプレイデバイス
US8887222B2 (en) Multicasting in a wireless display system
WO2014063515A1 (zh) 一种实现多媒体播放的方法、移动终端及系统
US10547897B2 (en) Information processing device and information processing method to communicate based on capability information
US10805672B2 (en) Information processing device, information processing system, and information processing method
US20180048701A1 (en) Information processing device, information processing method, and program
WO2015074445A1 (zh) 多路无线显示方法及装置
ES2799504T3 (es) Dispositivo de procesamiento de información, método de procesamiento de información y programa
JP2015195488A (ja) 情報処理装置および情報処理方法
JP2014513903A (ja) ネットワーキング方法、サーバ装置およびクライアント装置
US10104153B2 (en) Method and device for processing information
BR102014020408A2 (pt) métodos para o compartilhamento de conteúdo utilizando uma notificação de compatibilidade para uma função de encaminhamento de exibição e dispositivos associados
JP2017517793A (ja) ビデオオリエンテーションネゴシエーション
WO2011003259A1 (zh) 基于蓝牙的监控方法及装置
WO2013185702A1 (zh) 一种多设备环境下业务内容管理系统及方法
JP2014187491A (ja) 電子機器

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 13849384

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

WWE Wipo information: entry into national phase

Ref document number: 14437950

Country of ref document: US

WWE Wipo information: entry into national phase

Ref document number: 2013849384

Country of ref document: EP