WO2013117038A1 - Video multi-screen sharing method and system for realizing same - Google Patents

Video multi-screen sharing method and system for realizing same Download PDF

Info

Publication number
WO2013117038A1
WO2013117038A1 PCT/CN2012/073730 CN2012073730W WO2013117038A1 WO 2013117038 A1 WO2013117038 A1 WO 2013117038A1 CN 2012073730 W CN2012073730 W CN 2012073730W WO 2013117038 A1 WO2013117038 A1 WO 2013117038A1
Authority
WO
WIPO (PCT)
Prior art keywords
video
window
attribute information
play
receiver
Prior art date
Application number
PCT/CN2012/073730
Other languages
French (fr)
Chinese (zh)
Inventor
喻子达
王袭
赵向阳
韩文
朴成杰
黄橙
周林
安娜
Original Assignee
海尔集团公司
海尔集团技术研发中心
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 海尔集团公司, 海尔集团技术研发中心 filed Critical 海尔集团公司
Publication of WO2013117038A1 publication Critical patent/WO2013117038A1/en

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/41—Structure of client; Structure of client peripherals
    • H04N21/4104—Peripherals receiving signals from specially adapted client devices
    • H04N21/4108—Peripherals receiving signals from specially adapted client devices characterised by an identification number or address, e.g. local network address
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/41—Structure of client; Structure of client peripherals
    • H04N21/4104—Peripherals receiving signals from specially adapted client devices
    • H04N21/4126—The peripheral being portable, e.g. PDAs or mobile phones
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/41—Structure of client; Structure of client peripherals
    • H04N21/4104—Peripherals receiving signals from specially adapted client devices
    • H04N21/4122—Peripherals receiving signals from specially adapted client devices additional display device, e.g. video projector
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/436—Interfacing a local distribution network, e.g. communicating with another STB or one or more peripheral devices inside the home
    • H04N21/43615—Interfacing a Home Network, e.g. for connecting the client to a plurality of peripherals
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/436—Interfacing a local distribution network, e.g. communicating with another STB or one or more peripheral devices inside the home
    • H04N21/4363—Adapting the video or multiplex stream to a specific local network, e.g. a IEEE 1394 or Bluetooth® network
    • H04N21/43637—Adapting the video or multiplex stream to a specific local network, e.g. a IEEE 1394 or Bluetooth® network involving a wireless protocol, e.g. Bluetooth, RF or wireless LAN [IEEE 802.11]
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/44—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream, rendering scenes according to MPEG-4 scene graphs
    • H04N21/4402—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream, rendering scenes according to MPEG-4 scene graphs involving reformatting operations of video signals for household redistribution, storage or real-time display
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/442—Monitoring of processes or resources, e.g. detecting the failure of a recording device, monitoring the downstream bandwidth, the number of times a movie has been viewed, the storage space available from the internal hard disk
    • H04N21/44231—Monitoring of peripheral device or external card, e.g. to detect processing problems in a handheld device or the failure of an external recording device
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/45—Management operations performed by the client for facilitating the reception of or the interaction with the content or administrating data related to the end-user or to the client device itself, e.g. learning user preferences for recommending movies, resolving scheduling conflicts
    • H04N21/462—Content or additional data management, e.g. creating a master electronic program guide from data received from the Internet and a Head-end, controlling the complexity of a video stream by scaling the resolution or bit-rate based on the client capabilities
    • H04N21/4621—Controlling the complexity of the content stream or additional data, e.g. lowering the resolution or bit-rate of the video stream for a mobile client with a small screen
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/60—Network structure or processes for video distribution between server and client or between remote clients; Control signalling between clients, server and network components; Transmission of management data between server and client, e.g. sending from server to client commands for recording incoming content stream; Communication details between server and client 
    • H04N21/63—Control signaling related to video distribution between client, server and network components; Network processes for video distribution between server and clients or between remote clients, e.g. transmitting basic layer and enhancement layers over different transmission paths, setting up a peer-to-peer communication via Internet between remote STB's; Communication protocols; Addressing
    • H04N21/643—Communication protocols
    • H04N21/64322—IP

Definitions

  • the invention relates to a video multi-screen sharing method and a system for implementing the same.
  • Triple network integration is also called “three networks in one”. It refers to the transformation of the three major networks of telecommunication network, computer network and cable television network, which can provide comprehensive multimedia communication services including voice, data and images. “Three-in-one” truly spans the converged services of three heterogeneous networks: telecommunication network, computer network and cable TV network – “multi-screen service”, which realizes service level, control level and bearer level through multi-screen convergence. Perfect integration.
  • Multi-screen sharing between different devices such as large-screen digital TVs, notebooks, ipads, smart phones, etc.
  • devices such as large-screen digital TVs, notebooks, ipads, smart phones, etc.
  • Multi-screen fusion and sharing technology into smart home systems, not only enabling smart home systems More practical, it also solves the limitation of achieving image information sharing in multi-screen sharing.
  • the information of the large-screen terminal device is shared with a small-screen portable device such as a mobile phone or a pad, so that the user can conveniently view information such as television video on various smart terminals.
  • a smart home system the user can change the state of the portable device application he or she uses at any time according to his actual needs, such as zooming the video play window of the video being played while viewing the instant message.
  • how to ensure that the portable device can play the video information smoothly and without distortion, and realize the adaptive coding of the shared video data with the change of the attribute information of the video playing window, so as to more effectively utilize the system resources is an urgent problem to be solved. .
  • the main object of the present invention is to provide a video multi-screen sharing method and a system for implementing the same, so as to enable a portable device for multi-screen sharing in a smart home system to play video information smoothly and without distortion.
  • the adaptive encoding of the shared video data can be implemented as the attribute information of the video playing window changes.
  • the invention discloses a video multi-screen sharing method, which comprises the following steps:
  • the video sender obtains attribute information of at least one receiver video play window
  • the video sender performs corresponding different encoding on the video data to be shared according to the obtained attribute information of each of the receiving party video playing windows, and sends each different encoded video data group to each receiving of the corresponding video playing window attribute. square.
  • the method of the present invention can realize that a portable device for multi-screen sharing in a smart home system can play video information smoothly and without distortion, and can realize sharing video data according to changes in attribute information of a video playing window.
  • Adaptive coding can realize that a portable device for multi-screen sharing in a smart home system can play video information smoothly and without distortion, and can realize sharing video data according to changes in attribute information of a video playing window.
  • the method further includes:
  • the video receiver listens to the attribute information of the video play window, and sends the attribute information of the video play window to the video sender when the attribute information is changed, and returns to step A.
  • the method of the present invention can adjust the encoding of the shared video data in real time according to the change of the attribute information of the video playing window, so as to reduce the video processing intensity of the video receiving party when the video playing window is reduced.
  • the attribute information of the video play window includes a resolution of a video play window of the video receiver and a current video play window size.
  • step B includes the following sub-steps:
  • the video sender classifies the video receiver according to a preset resolution and/or a decoding rate range
  • the video sender encodes the video data to be shared according to the preset resolution and/or decoding rate, and packages the different encoded shared video data and their corresponding video receiver IP addresses respectively. Group hair.
  • each video receiver can obtain the video data corresponding to the video play window attribute, thereby ensuring the smoothness of the video receiver video playback.
  • the step of packaging the different coded shared video data and the corresponding video receiver IP addresses in the sub-step B2 includes:
  • the preset resolution and/or decoding rate range corresponds to a certain range of values of the video play window attribute of the receiver
  • the encoding includes: determining that the video play window attribute information of the video receiver falls within the preset resolution and/or the decoding rate range, and encoding according to the encoding method preset by the resolution and/or the decoding rate range.
  • the preset encoding method includes: selecting the lower limit of the preset resolution and/or the decoding rate range to encode the shared video data.
  • the shared video data is encoded by selecting the lower limit within the preset resolution and/or the decoding rate range, and for a wider preset resolution and/or a decoding rate range, the range can be made within the range. All video receivers can play shared videos smoothly.
  • the preset encoding method includes: selecting the video window attribute information having the most occurrences within the preset resolution and/or the decoding rate range to encode the shared video data.
  • the above-mentioned preset encoding method adopted by the present invention can make a good video playback effect for most video receivers within a certain preset resolution and/or decoding rate range.
  • the preset encoding method includes: selecting an average value of each video window attribute information of the occurrence of the preset resolution and/or the decoding rate range to encode the shared video data.
  • the above-mentioned preset encoding method adopted by the present invention can enable most video receivers within a certain preset resolution and/or decoding rate range to have good video playback effects while taking into account shared video data. Coding efficiency.
  • the present invention also provides a video multi-screen sharing system for implementing the above method, the system comprising a video transmitting end and at least one video receiving end;
  • the video sending end includes:
  • the window attribute obtaining module is configured to receive the video play window attribute information sent by each video receiving end, and determine different coding modes corresponding to the video play windows of each video receiving end according to the method;
  • the encoding module is connected to the window attribute obtaining module, and is configured to perform different encoding on the video file according to the determined different encoding manners, and send the video file to the video sending end;
  • the video receiving end includes:
  • the decoding and playing module is configured to decode video data corresponding to a video playing window received by the video receiving end, and play the video using the set video playing window;
  • the window attribute monitoring module is connected to the decoding play module, and is configured to monitor attribute information of the video play window used by the decoding play module, and send the attribute information to the video sending end.
  • the system of the present invention can realize that a portable device for multi-screen sharing in a smart home system can play video information smoothly and without distortion, and can realize sharing video data according to changes in attribute information of a video playing window.
  • Adaptive coding can be used to realize that a portable device for multi-screen sharing in a smart home system to play video information smoothly and without distortion, and can realize sharing video data according to changes in attribute information of a video playing window.
  • FIG. 1 is a flowchart of a video multi-screen sharing method provided by the present invention
  • FIG. 2 is a flow chart of the sub-steps of step 100 in FIG. 1;
  • step 300 is a flow chart of the sub-steps of step 200 in FIG. 1;
  • FIG. 4 is a flow chart of sub-steps of steps 300-400 in FIG. 1;
  • Fig. 5 is a structural diagram of a system capable of implementing the above method.
  • the video receiving end in this embodiment may be a portable digital device such as a mobile phone, a personal electronic assistant (PDA), a notebook computer or the like.
  • PDA personal electronic assistant
  • the present embodiment is implemented on the basis that at least one video receiving end has established a wireless communication connection with a television program receiving device (video transmitting end). Since the establishment of a wireless communication connection between terminals is a well-known technique in the art, the process of establishing the wireless communication connection will not be described herein.
  • a video multi-screen sharing method includes the following steps:
  • Step 100 Establish multi-screen video data play sharing between the video sender and the video receiver.
  • This step is shown in Figure 2 and includes the following substeps:
  • Step 101 A video sender (generally a large screen digital television in a home smart system) issues a shared video play invitation to a video receiver (mobile terminal) in the home smart system.
  • a video sender generally a large screen digital television in a home smart system
  • a video receiver mobile terminal
  • Steps 102 to 104 The video receiver determines whether it has established video play sharing with other devices: if yes, rejects the video play sharing invitation of the video sender; otherwise, receives the invitation and plays its IP address information and video The attribute information of the window is sent to the video sender.
  • the attribute information of the video play window generally includes a screen resolution of the video receiver, a current video play window resolution (corresponding to the current video play window size), a decoding capability, such as a decoding rate, and the like.
  • Step 200 The video sender encodes the shared video data, and broadcasts the encoded shared video data.
  • This step is shown in Figure 3 and includes the following substeps:
  • Step 201 The video sender filters and denoises the shared video data.
  • the current screen image of the shared video data is captured, and Wiener filtering processing is performed on the screen image to eliminate noise of the screen image. Then grab the next frame screen image and perform Wiener filtering on the frame screen image. According to this cycle, the filtering and noise elimination of the shared video data is completed.
  • the Wiener filtering process is a well-known technology in the field of signal processing, and details are not described herein again.
  • Step 202 The video sender classifies the video receiver according to a preset resolution and/or a decoding rate range.
  • the preset resolution and/or decoding rate range may be a specific resolution and/or decoding rate, or a range between two different resolutions and/or decoding rates.
  • the video sender classifies the video receiver according to the preset resolution and/or the decoding rate range. For example, the video receiver window has a resolution of 320*240, and the video playback window has a resolution of 320. * The video receiver of the 480 is the next class, and so on.
  • the video receivers are subdivided according to a more refined preset resolution and/or decoding range, for example, having the same video playback window resolution but different decoding rates, and the video playback window resolution is 320*240, but the decoding rate is 256 kbps.
  • the video receivers are of the same type, and the video receivers with a decoding rate of 512 kbps are another type; the video playback window resolution is 320*480, but the video receivers with a decoding rate of 256 kbps are one class, and the decoding rate is 512 kbps.
  • the video receiver is another class, and so on.
  • the preset resolution and/or decoding rate range is above 320*240, below 320*480, and the decoding rate is between 216 and 512 kbps, and which video playback window resolution and decoding rate are counted in the range.
  • the combination has the most occurrences.
  • all video receivers whose video playback window resolution is above 320*240 and below 320*480 are classified into one category, and the video playback window resolution is counted most frequently in this category. And so on.
  • Each preset resolution and/or decoding range corresponds to an encoding method, for example, a resolution of 320*240, a decoding resolution of 256 kbps, and/or a decoding rate range corresponding to: a shared video
  • the data is encoded according to the resolution of 320*240 and the average decoding rate of 256 kbps;
  • the encoding method corresponding to the preset resolution and/or the decoding rate range of resolution 320 ⁇ 240 and decoding rate 512 kbps is: sharing the video data according to 320 *240 resolution and 512kbps average decoding rate are encoded, and so on.
  • the shared video data may be encoded by selecting a lower limit within the range, for example, a certain preset resolution range is 320*240 to 320*480.
  • the encoding method corresponding to the range is: uniformly encoding the shared video data at a resolution of 320*240, so that all video receivers in the range can smoothly play the shared video; in order to make a certain preset resolution and/or Or most video receivers within the decoding rate range have a good video playing effect, and the shared video data may be encoded according to the most frequently occurring video window attribute information in the range or a combination of several kinds of the attribute information, for example, If the resolution of the video playback window is in the range of 320*240 or more and 320*480 or less, and according to the statistics of the attribute information of each video receiver, the video playback window resolution of 320*320 appears the most (ie most videos).
  • the current video playback window resolution of the receiver is 320*320
  • the encoding method corresponding to the range is: unified to share with 320*320 resolution.
  • the video data is encoded; in order to enable a good video playback effect of most video receivers within a certain preset resolution and/or decoding rate range, and the sharing efficiency of the shared video data, the preset resolution may also be selected.
  • the intermediate value in the range of the decoding rate encodes the shared video data. For example, if the resolution is in the range of 320*240 or more and 320*480 or less, the encoding method corresponding to the range is: unified to 320*360
  • the resolution encodes the shared video data.
  • the average value of the video information of each receiver video window in the range may also be encoded.
  • Steps 203 to 206 according to whether the video playback window information of the video receiver exceeds the preset resolution and/or the decoding rate range, selecting an appropriate encoding method to encode the filtered and denoised shared video data, and Each encoded shared video data is combined with its corresponding video receiving end IP address information and video playing window information into a data packet for intra-group broadcast transmission.
  • the video receivers whose video playback window information does not exceed the preset resolution and/or the decoding rate range may be preset according to a preset resolution and/or a decoding rate corresponding to the decoding rate range.
  • the video receiver in the range of resolution and/or decoding rate performs encoding of the filtered and denoised shared video data; for video receivers whose video playback window information exceeds the preset resolution and/or the decoding rate range,
  • the screen resolution and/or decoding rate of the video receiver is the encoding of the filtered and denoised shared video data by the video receiver.
  • Steps 300 ⁇ 400 After the video receiver selects to receive the shared video data, the shared video is played, and when the attribute information of the video playing window is changed in real time, the changed video playing window attribute information is sent to the video sender. And returning to step 200 to request the video sender to re-encode the shared video data according to the changed video play window attribute information.
  • Steps 300 to 400 are as shown in FIG. 4, and include the following substeps:
  • Step 301 The video receiver selects to receive a data packet containing its IP address information.
  • Steps 302-400 determining whether the video play window attribute information in the data packet is consistent with the attribute information of the current video play window: if not, sending the IP address information and the attribute information of the current video play window to the video.
  • the sender requests the video sender to re-encode the shared video data (return to step 200); otherwise, receives and decodes the shared video data in the data packet, and monitors the attribute information of the video play window in real time: if its video If the attribute information of the play window changes, the IP address information and the attribute information of the current video play window are sent to the video sender, and the video sender is requested to re-share the video data according to the attribute information of the current video play window. Encoding (return to step 200).
  • the video playback window attribute information for example, the video playback window resolution caused by reducing/enlargement of the current video playback window, due to downward adjustment of the video receiver screen resolution or minimization of the video playback window.
  • causes changes in the resolution of the video playback window reduces the decoding rate to free up more CPU resources to apply other programs, and the like.
  • the adaptive coding reduces the video processing intensity of the video receiver (lower CPU and memory usage) while ensuring smooth and distortion-free playback of video data by the video receiver.
  • the present invention further provides a video multi-screen sharing system, which includes a video transmitting end 500 and at least one video receiving end 600. among them:
  • the video sending end 500 is configured to perform corresponding different encoding on the video data to be shared according to the video playing window attribute information of the video receiving end 600, and send each different encoded video data group to each video corresponding to the video playing window attribute.
  • the video sending end 500 includes:
  • the window attribute obtaining module 502 is configured to receive the video play window attribute information sent by each video receiving end 600, and determine different coding modes corresponding to the video play windows of each video receiving end 600.
  • the encoding module 501 is connected to the window attribute obtaining module 502, and is configured to perform different encoding on the video file according to the determined different encoding manners, and send the video file by the video sending end 500.
  • the video receiving end 600 is configured to decode and play the shared video data sent by the received video sending end 500 corresponding to its video playing window, and when the change of the attribute information of the video playing window is monitored, the changed The video play window attribute information is sent to the video transmitting terminal 500.
  • the video receiving end 600 includes a decoding play module 601 and a window attribute monitoring module 602 having a video play window.
  • the decoding and playing module 601 is configured to decode the video data corresponding to the video playing window received by the video receiving end 600, and play the video using the set video playing window.
  • the window attribute monitoring module 602 is electrically connected to the decoding and playing module 601, and is configured to monitor attribute information of the video playing window used by the decoding and playing module 601, and when monitoring the change of the attribute information of the video playing window, The changed video play window attribute information is sent to the video transmitting end 500.

Abstract

Disclosed is a video multi-screen sharing method, comprising the following steps: a) a video transmitter acquires the attribute information of at least one receiver video play window; b) according to the acquired attribute information of each receiver video play window, the video transmitter correspondingly encodes the to-be-shared video data differently, and broadcasts each video data encoded differently to each receiver corresponding to the attribute of the video play window. Also disclosed is a system for realizing the method, the system comprising a video transmitter and at least one video receiver, so that a portable device for multi-screen sharing in an intelligent household system can not only play video information smoothly with no distortion, but can also self-adaptively encode the shared video data as the attribute information of the video play window changes.

Description

一种视频多屏共享方法及实现该方法的系统  Video multi-screen sharing method and system for implementing the same
技术领域Technical field
本发明涉及一种视频多屏共享方法及实现该方法的系统。The invention relates to a video multi-screen sharing method and a system for implementing the same.
背景技术Background technique
“三网融合”又被称作“三网合一”，是指将电信网、计算机网和有线电视网三大网络通过技术改造，能够提供包括语音、数据、图像等综合多媒体的通信业务。“三网合一”真正跨越了电信网、计算机网和有线电视网这三种异构网络的融合业务——“多屏业务”，即通过多屏融合实现业务层面、控制层面和承载层面的完美融合。在智能家庭中实现不同设备（例如大屏幕数字电视、笔记本、ipad、智能手机等）之间的多屏共享，将“多屏融合及共享”技术带入智能家居系统中，不仅使智能家居系统更具实用性，还解决了在多屏共享中实现图像信息共享的局限性。"Triple network integration" is also called "three networks in one". It refers to the transformation of the three major networks of telecommunication network, computer network and cable television network, which can provide comprehensive multimedia communication services including voice, data and images. “Three-in-one” truly spans the converged services of three heterogeneous networks: telecommunication network, computer network and cable TV network – “multi-screen service”, which realizes service level, control level and bearer level through multi-screen convergence. Perfect integration. Multi-screen sharing between different devices (such as large-screen digital TVs, notebooks, ipads, smart phones, etc.) in smart homes, bringing "multi-screen fusion and sharing" technology into smart home systems, not only enabling smart home systems More practical, it also solves the limitation of achieving image information sharing in multi-screen sharing.
在智能家庭系统中，将大屏幕终端装置的信息与手机、pad等小屏幕便携式装置共享，从而使用户能够方便地在各种智能终端上观看电视视频等信息。在智能家庭系统中，用户会根据其实际需要，随时改变其使用的便携式装置应用程序的状态，例如在查看即时信息时缩放正在播放视频的视频播放窗口。此时如何保证便携式装置既能够顺畅、无失真地播放视频信息，又可以随着视频播放窗口属性信息的变化实现共享视频数据的自适应编码以便更加有效地利用系统资源，是一个亟待解决的问题。In the smart home system, the information of the large-screen terminal device is shared with a small-screen portable device such as a mobile phone or a pad, so that the user can conveniently view information such as television video on various smart terminals. In a smart home system, the user can change the state of the portable device application he or she uses at any time according to his actual needs, such as zooming the video play window of the video being played while viewing the instant message. At this time, how to ensure that the portable device can play the video information smoothly and without distortion, and realize the adaptive coding of the shared video data with the change of the attribute information of the video playing window, so as to more effectively utilize the system resources, is an urgent problem to be solved. .
发明内容Summary of the invention
有鉴于此，本发明的主要目的在于提供一种视频多屏共享方法及实现该方法的系统，以实现智能家庭系统中用于多屏共享的便携式装置既能够顺畅、无失真地播放视频信息，又可以随着视频播放窗口属性信息的变化实现共享视频数据的自适应编码。In view of this, the main object of the present invention is to provide a video multi-screen sharing method and a system for implementing the same, so as to enable a portable device for multi-screen sharing in a smart home system to play video information smoothly and without distortion. The adaptive encoding of the shared video data can be implemented as the attribute information of the video playing window changes.
本发明公开了一种视频多屏共享方法，包括以下步骤：The invention discloses a video multi-screen sharing method, which comprises the following steps:
A、视频发送方获取至少一个接收方视频播放窗口的属性信息；A. The video sender obtains attribute information of at least one receiver video play window;
B、视频发送方根据获取的所述各个接收方视频播放窗口属性信息，对要共享的视频数据进行相应的不同编码，并将各个不同编码的视频数据组发给对应视频播放窗口属性的各个接收方。B. The video sender performs corresponding different encoding on the video data to be shared according to the obtained attribute information of each of the receiving party video playing windows, and sends each different encoded video data group to each receiving of the corresponding video playing window attribute. square.
由上可以看出，本发明方法能够实现智能家庭系统中用于多屏共享的便携式装置既能够顺畅、无失真地播放视频信息，又可以随着视频播放窗口属性信息的变化实现共享视频数据的自适应编码。As can be seen from the above, the method of the present invention can realize that a portable device for multi-screen sharing in a smart home system can play video information smoothly and without distortion, and can realize sharing video data according to changes in attribute information of a video playing window. Adaptive coding.
在上述方法中，还包括：In the above method, the method further includes:
视频接收方监听其视频播放窗口的属性信息，并在属性信息改变时将所述视频播放窗口的属性信息发送至视频发送方，返回步骤A。The video receiver listens to the attribute information of the video play window, and sends the attribute information of the video play window to the video sender when the attribute information is changed, and returns to step A.
由上可以看出，本发明方法能够实现根据所述视频播放窗口的属性信息的改变，实时调整共享视频数据的编码，以便在所述视频播放窗口缩小时能够降低视频接收方的视频处理强度。As can be seen from the above, the method of the present invention can adjust the encoding of the shared video data in real time according to the change of the attribute information of the video playing window, so as to reduce the video processing intensity of the video receiving party when the video playing window is reduced.
在上述方法中，所述视频播放窗口的属性信息包括视频接收方视频播放窗口的分辨率、当前视频播放窗口尺寸。In the above method, the attribute information of the video play window includes a resolution of a video play window of the video receiver and a current video play window size.
在上述方法中，所述步骤B包括以下子步骤：In the above method, the step B includes the following sub-steps:
B1、所述视频发送方根据预设的分辨率和/或解码率范围来对视频接收方进行分类；B1. The video sender classifies the video receiver according to a preset resolution and/or a decoding rate range;
B2、所述视频发送方对要共享的视频数据根据所述预设的分辨率和/或解码率进行编码，并将各不同编码后的共享视频数据与其相应的各视频接收方IP地址分别打包组发。B2. The video sender encodes the video data to be shared according to the preset resolution and/or decoding rate, and packages the different encoded shared video data and their corresponding video receiver IP addresses respectively. Group hair.
由上可以看出，各个视频接收方都可以获得与其视频播放窗口属性对应的视频数据，从而保证了视频接收方视频播放的流畅性。It can be seen from the above that each video receiver can obtain the video data corresponding to the video play window attribute, thereby ensuring the smoothness of the video receiver video playback.
在上述方法中，子步骤B2所述将各不同编码后的共享视频数据与其相应的各视频接收方IP地址打包的步骤包括：In the above method, the step of packaging the different coded shared video data and the corresponding video receiver IP addresses in the sub-step B2 includes:
所述预设的分辨率和/或解码率范围对应接收方视频播放窗口属性的一定范围值；The preset resolution and/or decoding rate range corresponds to a certain range of values of the video play window attribute of the receiver;
所述编码包括：判断视频接收方的视频播放窗口属性信息落入所述预设的分辨率和/或解码率范围，按照该分辨率和/或解码率范围预设的编码方法进行编码。 The encoding includes: determining that the video play window attribute information of the video receiver falls within the preset resolution and/or the decoding rate range, and encoding according to the encoding method preset by the resolution and/or the decoding rate range.
在上述方法中，所述预设的编码方法包括：选择所述预设分辨率和/或解码率范围的下限值对所述共享视频数据进行编码。In the above method, the preset encoding method includes: selecting the lower limit of the preset resolution and/or the decoding rate range to encode the shared video data.
由上可以看出，选择所述预设分辨率和/或解码率范围内的下限对共享视频数据进行编码，对于较宽的预设分辨率和/或解码率范围，可以使该范围内的所有视频接收方都能够流畅播放共享视频。As can be seen from the above, the shared video data is encoded by selecting the lower limit within the preset resolution and/or the decoding rate range, and for a wider preset resolution and/or a decoding rate range, the range can be made within the range. All video receivers can play shared videos smoothly.
在上述方法中，所述预设的编码方法包括：选择所述预设分辨率和/或解码率范围内出现次数最多的视频窗口属性信息对所述共享视频数据进行编码。In the above method, the preset encoding method includes: selecting the video window attribute information having the most occurrences within the preset resolution and/or the decoding rate range to encode the shared video data.
由上可以看出，本发明采用的上述预设的编码方法可以使某一预设分辨率和/或解码率范围内的大多数视频接收方具有良好的视频播放效果。It can be seen from the above that the above-mentioned preset encoding method adopted by the present invention can make a good video playback effect for most video receivers within a certain preset resolution and/or decoding rate range.
在上述方法中，所述预设的编码方法包括：选择所述预设分辨率和/或解码率范围的出现的各视频窗口属性信息的平均值对所述共享视频数据进行编码。In the above method, the preset encoding method includes: selecting an average value of each video window attribute information of the occurrence of the preset resolution and/or the decoding rate range to encode the shared video data.
由上可以看出，本发明采用的上述预设的编码方法可以使某一预设的分辨率和/或解码率范围内的大多数视频接收方具有良好的视频播放效果的同时兼顾共享视频数据编码效率。It can be seen from the above that the above-mentioned preset encoding method adopted by the present invention can enable most video receivers within a certain preset resolution and/or decoding rate range to have good video playback effects while taking into account shared video data. Coding efficiency.
本发明还提供了一种实现上述方法的视频多屏共享系统，该系统包括视频发送端和至少一个视频接收端；The present invention also provides a video multi-screen sharing system for implementing the above method, the system comprising a video transmitting end and at least one video receiving end;
所述视频发送端包括：The video sending end includes:
所述窗口属性获取模块，用于接收各个视频接收端发送的视频播放窗口属性信息，并据此确定出各个视频接收端的视频播放窗口所对应的各个不同的编码方式；The window attribute obtaining module is configured to receive the video play window attribute information sent by each video receiving end, and determine different coding modes corresponding to the video play windows of each video receiving end according to the method;
所述编码模块，与窗口属性获取模块连接，用于根据确定出的各个不同的编码方式对视频文件进行不同的编码，并由视频发送端发送出去；The encoding module is connected to the window attribute obtaining module, and is configured to perform different encoding on the video file according to the determined different encoding manners, and send the video file to the video sending end;
所述视频接收端包括：The video receiving end includes:
所述解码播放模块，用于解码视频接收端所接收的对应其视频播放窗口的视频数据，并使用所设定的视频播放窗口进行播放；The decoding and playing module is configured to decode video data corresponding to a video playing window received by the video receiving end, and play the video using the set video playing window;
所述窗口属性监测模块，与解码播放模块连接，用于监测解码播放模块所使用的视频播放窗口的属性信息，并发送给所述视频发送端。The window attribute monitoring module is connected to the decoding play module, and is configured to monitor attribute information of the video play window used by the decoding play module, and send the attribute information to the video sending end.
由上可以看出，本发明系统能够实现智能家庭系统中用于多屏共享的便携式装置既能够顺畅、无失真地播放视频信息，又可以随着视频播放窗口属性信息的变化实现共享视频数据的自适应编码。As can be seen from the above, the system of the present invention can realize that a portable device for multi-screen sharing in a smart home system can play video information smoothly and without distortion, and can realize sharing video data according to changes in attribute information of a video playing window. Adaptive coding.
附图说明DRAWINGS
图1为本发明提供的一种视频多屏共享方法流程图；FIG. 1 is a flowchart of a video multi-screen sharing method provided by the present invention;
图2为图1中步骤100的子步骤流程图；2 is a flow chart of the sub-steps of step 100 in FIG. 1;
图3为图1中步骤200的子步骤流程图；3 is a flow chart of the sub-steps of step 200 in FIG. 1;
图4为图1中步骤300~400的子步骤流程图；4 is a flow chart of sub-steps of steps 300-400 in FIG. 1;
图5为能够实现上述方法的系统的结构图。Fig. 5 is a structural diagram of a system capable of implementing the above method.
具体实施方式detailed description
下面结合附图，详细介绍本发明提供的一种视频多屏共享方法及实现该方法的系统。本实施例中的视频接收端（用于多屏共享的移动终端）可为手机、个人电子助理（PDA）、笔记本电脑等便携式数码设备。A video multi-screen sharing method and a system for implementing the same according to the present invention are described in detail below with reference to the accompanying drawings. The video receiving end (mobile terminal for multi-screen sharing) in this embodiment may be a portable digital device such as a mobile phone, a personal electronic assistant (PDA), a notebook computer or the like.
若无特殊说明，本实施例是在至少一个视频接收端与电视节目接收装置（视频发送端）已建立无线通信连接的基础上实施的。由于在终端间建立无线通信连接是本领域公知技术，故，对该无线通信连接的建立过程在此不再赘述。Unless otherwise stated, the present embodiment is implemented on the basis that at least one video receiving end has established a wireless communication connection with a television program receiving device (video transmitting end). Since the establishment of a wireless communication connection between terminals is a well-known technique in the art, the process of establishing the wireless communication connection will not be described herein.
如图1所示，本发明提供的一种视频多屏共享方法包括以下步骤：As shown in FIG. 1 , a video multi-screen sharing method provided by the present invention includes the following steps:
步骤100：在视频发送方与视频接收方之间，建立多屏视频数据播放共享。Step 100: Establish multi-screen video data play sharing between the video sender and the video receiver.
本步骤如图2所示，包括以下子步骤：This step is shown in Figure 2 and includes the following substeps:
步骤101：视频发送方（一般为家庭智能系统中的大屏幕数字电视）向该家庭智能系统中的视频接收方（移动终端）发出共享视频播放邀请。Step 101: A video sender (generally a large screen digital television in a home smart system) issues a shared video play invitation to a video receiver (mobile terminal) in the home smart system.
步骤102~104：视频接收方判断自身是否已与其他装置建立了视频播放共享：若是，则拒绝所述视频发送方的视频播放共享邀请；否则，接收该邀请并将其IP地址信息以及视频播放窗口的属性信息发给所述视频发送方。 Steps 102 to 104: The video receiver determines whether it has established video play sharing with other devices: if yes, rejects the video play sharing invitation of the video sender; otherwise, receives the invitation and plays its IP address information and video The attribute information of the window is sent to the video sender.
上述视频播放窗口的属性信息通常包括视频接收方的屏幕分辨率、（与当前视频播放窗口尺寸对应的）当前视频播放窗口分辨率、解码能力，如解码率等。The attribute information of the video play window generally includes a screen resolution of the video receiver, a current video play window resolution (corresponding to the current video play window size), a decoding capability, such as a decoding rate, and the like.
步骤200：视频发送方对共享的视频数据进行编码，并将编码后的共享视频数据进行广播发送。Step 200: The video sender encodes the shared video data, and broadcasts the encoded shared video data.
本步骤如图3所示，包括以下子步骤：This step is shown in Figure 3 and includes the following substeps:
步骤201：视频发送方对共享的视频数据进行滤波除噪。Step 201: The video sender filters and denoises the shared video data.
在本子步骤中，抓取共享视频数据的当前屏幕图像，并对该屏幕图像进行Wiener滤波处理以消除该屏幕图像的噪声。接着抓取下一帧屏幕图像，并对该帧屏幕图像进行Wiener滤波处理。依此循环往复，完成对共享视频数据的滤波除噪。其中，Wiener滤波处理为信号处理领域的公知技术，在此不再赘述。In this sub-step, the current screen image of the shared video data is captured, and Wiener filtering processing is performed on the screen image to eliminate noise of the screen image. Then grab the next frame screen image and perform Wiener filtering on the frame screen image. According to this cycle, the filtering and noise elimination of the shared video data is completed. The Wiener filtering process is a well-known technology in the field of signal processing, and details are not described herein again.
步骤202：视频发送方根据预设的分辨率和/或解码率范围来对视频接收方进行分类。Step 202: The video sender classifies the video receiver according to a preset resolution and/or a decoding rate range.
在本步骤中，预设的分辨率和/或解码率范围可以是某一具体的分辨率和/或解码率，或者是两个不同分辨率和/或解码率之间的范围。视频发送方根据预设的分辨率和/或解码率范围对视频接收方进行分类，例如，视频播放窗口分辨率为320*240的视频接收方为一类，视频播放窗口分辨率为320 * 480的视频接收方为下一类，以此类推。按照更加细化的预设分辨率和/或解码范围细分视频接收方，例如，具有相同视频播放窗口分辨率但不同解码率，视频播放窗口分辨率均为320*240，但解码率为256kbps的视频接收方为一类，解码率为512kbps的视频接收方为另一类；视频播放窗口分辨率均为320*480，但解码率为256kbps的视频接收方为一类，解码率为512kbps的视频接收方为另一类，以此类推。In this step, the preset resolution and/or decoding rate range may be a specific resolution and/or decoding rate, or a range between two different resolutions and/or decoding rates. The video sender classifies the video receiver according to the preset resolution and/or the decoding rate range. For example, the video receiver window has a resolution of 320*240, and the video playback window has a resolution of 320. * The video receiver of the 480 is the next class, and so on. The video receivers are subdivided according to a more refined preset resolution and/or decoding range, for example, having the same video playback window resolution but different decoding rates, and the video playback window resolution is 320*240, but the decoding rate is 256 kbps. The video receivers are of the same type, and the video receivers with a decoding rate of 512 kbps are another type; the video playback window resolution is 320*480, but the video receivers with a decoding rate of 256 kbps are one class, and the decoding rate is 512 kbps. The video receiver is another class, and so on.
此外，从减少视频数据编码数量以缩短编码等待时间的角度考虑，还可以放宽预设的分辨率和/或解码率范围，并在所述范围内统计某种视频播放窗口属性信息或几种视频播放窗口属性信息的出现次数，依此对视频接收方进行分类。例如，预设的分辨率和/或解码率范围在320*240以上、320*480以下且解码率在216~512kbps之间，在该范围内统计出哪种视频播放窗口分辨率与解码率的组合出现次数最多。或者更宽泛地，将视频播放窗口分辨率在320*240以上且在320*480以下的所有视频接收方归为一类，并在该类统计出哪种视频播放窗口分辨率的出现次数最多，以此类推。In addition, from the viewpoint of reducing the number of video data codes to shorten the coding waiting time, it is also possible to relax the preset resolution and/or the decoding rate range, and to count certain video play window attribute information or several videos within the range. The number of occurrences of the play window attribute information, and the video receivers are classified accordingly. For example, the preset resolution and/or decoding rate range is above 320*240, below 320*480, and the decoding rate is between 216 and 512 kbps, and which video playback window resolution and decoding rate are counted in the range. The combination has the most occurrences. Or more broadly, all video receivers whose video playback window resolution is above 320*240 and below 320*480 are classified into one category, and the video playback window resolution is counted most frequently in this category. And so on.
每个预设的分辨率和/或解码范围对应一种编码方法，例如，分辨率为320*240、解码率256kbps的预设分辨率和/或解码率范围对应的编码方法为：将共享视频数据按照320*240的分辨率和256kbps的平均解码率进行编码；分辨率为320*240、解码率512kbps的预设分辨率和/或解码率范围对应的编码方法为：将共享视频数据按照320*240的分辨率和512kbps的平均解码率进行编码，以此类推。Each preset resolution and/or decoding range corresponds to an encoding method, for example, a resolution of 320*240, a decoding resolution of 256 kbps, and/or a decoding rate range corresponding to: a shared video The data is encoded according to the resolution of 320*240 and the average decoding rate of 256 kbps; the encoding method corresponding to the preset resolution and/or the decoding rate range of resolution 320×240 and decoding rate 512 kbps is: sharing the video data according to 320 *240 resolution and 512kbps average decoding rate are encoded, and so on.
此外，对于较宽的预设分辨率和/或解码率范围，可选择该范围内的下限对共享视频数据进行编码，例如，某一预设分辨率范围为320*240至320*480，则该范围对应的编码方法为：统一以320*240的分辨率对共享视频数据进行编码，以使该范围内的所有视频接收方都能够流畅播放共享视频；为了使某一预设分辨率和/或解码率范围内的大多数视频接收方具有良好的视频播放效果，可以根据所述范围内出现次数最多的视频窗口属性信息或几种所述属性信息的组合对共享视频数据进行编码，例如，如果视频播放窗口分辨率在320*240以上320*480以下的范围内，且根据对于各个视频接收方的属性信息的统计，其中320*320的视频播放窗口分辨率出现次数最多（即大多数视频接收方当前的视频播放窗口分辨率为320*320），则该范围对应的编码方法为：统一以320*320的分辨率对共享视频数据进行编码；为了使某一预设的分辨率和/或解码率范围内的大多数视频接收方具有良好的视频播放效果的同时兼顾共享视频数据编码效率，也可选择预设的分辨率和/或解码率范围内的中间值对共享视频数据进行编码，例如，如果分辨率在320*240以上、320*480以下的范围内，则该范围对应的编码方法为：统一以320*360的分辨率对共享视频数据进行编码。当然，对应各个范围，也可以按该范围内各接收方视频窗口属性信息的平均值进行编码。In addition, for a wider preset resolution and/or a range of decoding rates, the shared video data may be encoded by selecting a lower limit within the range, for example, a certain preset resolution range is 320*240 to 320*480. The encoding method corresponding to the range is: uniformly encoding the shared video data at a resolution of 320*240, so that all video receivers in the range can smoothly play the shared video; in order to make a certain preset resolution and/or Or most video receivers within the decoding rate range have a good video playing effect, and the shared video data may be encoded according to the most frequently occurring video window attribute information in the range or a combination of several kinds of the attribute information, for example, If the resolution of the video playback window is in the range of 320*240 or more and 320*480 or less, and according to the statistics of the attribute information of each video receiver, the video playback window resolution of 320*320 appears the most (ie most videos). The current video playback window resolution of the receiver is 320*320), and the encoding method corresponding to the range is: unified to share with 320*320 resolution. The video data is encoded; in order to enable a good video playback effect of most video receivers within a certain preset resolution and/or decoding rate range, and the sharing efficiency of the shared video data, the preset resolution may also be selected. And/or the intermediate value in the range of the decoding rate encodes the shared video data. For example, if the resolution is in the range of 320*240 or more and 320*480 or less, the encoding method corresponding to the range is: unified to 320*360 The resolution encodes the shared video data. Of course, corresponding to each range, the average value of the video information of each receiver video window in the range may also be encoded.
步骤203~206：根据视频接收方的视频播放窗口信息是否超出所述预设分辨率和/或解码率范围，选择适当的编码方法以对经过滤波除噪的共享视频数据的进行编码，并将各个编码后的共享视频数据与其相应的视频接收端IP地址信息和视频播放窗口信息一起打成数据包，进行组内广播发送。 Steps 203 to 206: according to whether the video playback window information of the video receiver exceeds the preset resolution and/or the decoding rate range, selecting an appropriate encoding method to encode the filtered and denoised shared video data, and Each encoded shared video data is combined with its corresponding video receiving end IP address information and video playing window information into a data packet for intra-group broadcast transmission.
其中，对于视频播放窗口信息未超出所述预设分辨率和/或解码率范围的视频接收方，可以按照预设的分辨率和/或解码率范围对应的编码方法，为各个所述预设分辨率和/或解码率范围内的视频接收方进行经过滤波除噪的共享视频数据的编码；对于视频播放窗口信息超出预设分辨率和/或解码率范围的视频接收方，则可以按照该视频接收方的屏幕分辨率和/或解码率为该视频接收方进行经过滤波除噪的共享视频数据的编码。The video receivers whose video playback window information does not exceed the preset resolution and/or the decoding rate range may be preset according to a preset resolution and/or a decoding rate corresponding to the decoding rate range. The video receiver in the range of resolution and/or decoding rate performs encoding of the filtered and denoised shared video data; for video receivers whose video playback window information exceeds the preset resolution and/or the decoding rate range, The screen resolution and/or decoding rate of the video receiver is the encoding of the filtered and denoised shared video data by the video receiver.
步骤300~400：视频接收方选择接收共享视频数据后，播放该共享视频，并在实时监听到其视频播放窗口的属性信息发生变化时，将变化后的视频播放窗口属性信息发送给视频发送方，并返回步骤200请求视频发送方根据变化后的视频播放窗口属性信息对共享视频数据进行重新编码。Steps 300~400: After the video receiver selects to receive the shared video data, the shared video is played, and when the attribute information of the video playing window is changed in real time, the changed video playing window attribute information is sent to the video sender. And returning to step 200 to request the video sender to re-encode the shared video data according to the changed video play window attribute information.
其中，步骤300~400如图4所示，包括以下子步骤：Steps 300 to 400 are as shown in FIG. 4, and include the following substeps:
步骤301：视频接收方选择接收包含其IP地址信息的数据包。Step 301: The video receiver selects to receive a data packet containing its IP address information.
步骤302~400：判断该数据包中的视频播放窗口属性信息是否与当前视频播放窗口的属性信息相一致：若不一致，则将其IP地址信息以及当前视频播放窗口的属性信息发送给所述视频发送方，请求所述视频发送方重新为共享视频数据进行编码（返回步骤200）；否则，接收并解码播放该数据包中共享视频数据，并实时监听其视频播放窗口的属性信息：若其视频播放窗口的属性信息发生变化，则将其IP地址信息以及当前视频播放窗口的属性信息发送给所述视频发送方，请求所述视频发送方根据当前视频播放窗口的属性信息重新为共享视频数据进行编码（返回步骤200）。Steps 302-400: determining whether the video play window attribute information in the data packet is consistent with the attribute information of the current video play window: if not, sending the IP address information and the attribute information of the current video play window to the video. The sender requests the video sender to re-encode the shared video data (return to step 200); otherwise, receives and decodes the shared video data in the data packet, and monitors the attribute information of the video play window in real time: if its video If the attribute information of the play window changes, the IP address information and the attribute information of the current video play window are sent to the video sender, and the video sender is requested to re-share the video data according to the attribute information of the current video play window. Encoding (return to step 200).
视频播放窗口属性信息的变化情况有多种，例如，由于缩小/放大当前视频播放窗口而引起的视频播放窗口分辨率的变化，由于向下调整视频接收方屏幕分辨率或最小化视频播放窗口而引起视频播放窗口分辨率的变化，降低解码率以释放更多的CPU资源以应用其他程序等。There are various changes in the video playback window attribute information, for example, the video playback window resolution caused by reducing/enlargement of the current video playback window, due to downward adjustment of the video receiver screen resolution or minimization of the video playback window. Causes changes in the resolution of the video playback window, reduces the decoding rate to free up more CPU resources to apply other programs, and the like.
这样，无需任何外界辅助（例如，用户手动操作等），便可以实现当缩小视频接收方的视频播放窗口时，自动实时调整共享视频数据的编码，实现了视频多屏共享时共享视频数据的自适应编码，从而在保证视频接收方顺畅、无失真地播放视频数据的同时减少了视频接收方的视频处理强度（降低了CPU及内存占用率）。In this way, without any external assistance (for example, manual operation by the user, etc.), it is possible to automatically adjust the encoding of the shared video data in real time when the video playback window of the video receiver is reduced, thereby realizing the sharing of the video data when the video is shared by multiple screens. The adaptive coding reduces the video processing intensity of the video receiver (lower CPU and memory usage) while ensuring smooth and distortion-free playback of video data by the video receiver.
如图5所示，本发明还提供了一种视频多屏共享系统，该系统包括视频发送端500和至少一个视频接收端600。其中：As shown in FIG. 5, the present invention further provides a video multi-screen sharing system, which includes a video transmitting end 500 and at least one video receiving end 600. among them:
所述视频发送端500用于根据视频接收端600的视频播放窗口属性信息对要共享的视频数据进行相应的不同编码，并将各个不同编码的视频数据组发给对应视频播放窗口属性的各个视频接收端600。所述视频发送端500包括：The video sending end 500 is configured to perform corresponding different encoding on the video data to be shared according to the video playing window attribute information of the video receiving end 600, and send each different encoded video data group to each video corresponding to the video playing window attribute. Receiver 600. The video sending end 500 includes:
所述窗口属性获取模块502，用于接收各个视频接收端600发送的视频播放窗口属性信息，并据此确定出各个视频接收端600的视频播放窗口所对应的各个不同的编码方式。The window attribute obtaining module 502 is configured to receive the video play window attribute information sent by each video receiving end 600, and determine different coding modes corresponding to the video play windows of each video receiving end 600.
所述编码模块501，与窗口属性获取模块502连接，用于根据确定出的各个不同的编码方式对视频文件进行不同的编码，并由视频发送端500发送出去。The encoding module 501 is connected to the window attribute obtaining module 502, and is configured to perform different encoding on the video file according to the determined different encoding manners, and send the video file by the video sending end 500.
所述视频接收端600用于解码和播放所接收的视频发送端500所发送的对应其视频播放窗口的共享的视频数据，并在监测到其视频播放窗口属性信息的变化时，将变化后的视频播放窗口属性信息发送给所述视频发送端500。所述视频接收端600包括具有视频播放窗口的解码播放模块601和窗口属性监测模块602。The video receiving end 600 is configured to decode and play the shared video data sent by the received video sending end 500 corresponding to its video playing window, and when the change of the attribute information of the video playing window is monitored, the changed The video play window attribute information is sent to the video transmitting terminal 500. The video receiving end 600 includes a decoding play module 601 and a window attribute monitoring module 602 having a video play window.
所述解码播放模块601用于解码视频接收端600所接收的对应其视频播放窗口的视频数据，并使用所设定的视频播放窗口进行播放。The decoding and playing module 601 is configured to decode the video data corresponding to the video playing window received by the video receiving end 600, and play the video using the set video playing window.
所述窗口属性监测模块602，与所述解码播放模块601电连接，用于监测解码播放模块601所使用的视频播放窗口的属性信息，并在监测到所述视频播放窗口属性信息的变化时，将变化后的视频播放窗口属性信息发送给所述视频发送端500。The window attribute monitoring module 602 is electrically connected to the decoding and playing module 601, and is configured to monitor attribute information of the video playing window used by the decoding and playing module 601, and when monitoring the change of the attribute information of the video playing window, The changed video play window attribute information is sent to the video transmitting end 500.
以上所述仅为本发明的较佳实施例而已，并不用以限制本发明，凡在本发明的精神和原则之内，所作的任何修改、等同替换、改进等，均应包含在本发明的保护范围之内。The above is only the preferred embodiment of the present invention, and is not intended to limit the present invention. Any modifications, equivalent substitutions, improvements, etc., which are included in the spirit and scope of the present invention, should be included in the present invention. Within the scope of protection.

Claims (9)

  1. 一种视频多屏共享方法，其特征在于，包括以下步骤： A video multi-screen sharing method, comprising the steps of:
    A、视频发送方获取至少一个接收方视频播放窗口的属性信息；A. The video sender obtains attribute information of at least one receiver video play window;
    B、视频发送方根据获取的所述各个接收方视频播放窗口属性信息，对要共享的视频数据进行相应的不同编码，并将各个不同编码的视频数据组发给对应视频播放窗口属性的各个接收方。 B. The video sender performs corresponding different encoding on the video data to be shared according to the obtained attribute information of each of the receiving party video playing windows, and sends each different encoded video data group to each receiving of the corresponding video playing window attribute. square.
  2. 根据权利要求1所述的方法，其特征在于，还包括：The method of claim 1 further comprising:
    视频接收方监听其视频播放窗口的属性信息，并在属性信息改变时将所述视频播放窗口的属性信息发送至视频发送方，返回步骤A。The video receiver listens to the attribute information of the video play window, and sends the attribute information of the video play window to the video sender when the attribute information is changed, and returns to step A.
  3. 根据权利要求1所述的方法，其特征在于，The method of claim 1 wherein
    所述视频播放窗口的属性信息包括视频接收方视频播放窗口的分辨率、当前视频播放窗口尺寸。The attribute information of the video play window includes a resolution of a video player's video play window and a current video play window size.
  4. 根据权利要求1所述的方法，其特征在于，所述步骤B包括以下子步骤：The method of claim 1 wherein said step B comprises the following substeps:
    B1、所述视频发送方根据预设的分辨率和/或解码率范围来对视频接收方进行分类；B1. The video sender classifies the video receiver according to a preset resolution and/or a decoding rate range;
    B2、所述视频发送方对要共享的视频数据根据所述预设的分辨率和/或解码率进行编码，并将各不同编码后的共享视频数据与其相应的各视频接收方IP地址分别打包组发。B2. The video sender encodes the video data to be shared according to the preset resolution and/or decoding rate, and packages the different encoded shared video data and their corresponding video receiver IP addresses respectively. Group hair.
  5. 根据权利要求4所述的方法，其特征在于，子步骤B2所述将各不同编码后的共享视频数据与其相应的各视频接收方IP地址打包的步骤包括：The method according to claim 4, wherein the step of packaging the different coded shared video data and the corresponding video receiver IP addresses in the sub-step B2 comprises:
    所述预设的分辨率和/或解码率范围对应接收方视频播放窗口属性的一定范围值；The preset resolution and/or decoding rate range corresponds to a certain range of values of the video play window attribute of the receiver;
    所述编码包括：判断视频接收方的视频播放窗口属性信息落入所述预设的分辨率和/或解码率范围，按照该分辨率和/或解码率范围预设的编码方法进行编码。 The encoding includes: determining that the video play window attribute information of the video receiver falls within the preset resolution and/or the decoding rate range, and encoding according to the encoding method preset by the resolution and/or the decoding rate range.
  6. 根据权利要求5所述的方法，其特征在于，所述预设的编码方法包括：选择所述预设分辨率和/或解码率范围的下限值对所述共享视频数据进行编码。The method according to claim 5, wherein the predetermined encoding method comprises: selecting the lower limit value of the preset resolution and/or the decoding rate range to encode the shared video data.
  7. 根据权利要求5所述的方法，其特征在于，所述预设的编码方法包括：选择所述预设分辨率和/或解码率范围内出现次数最多的视频窗口属性信息对所述共享视频数据进行编码。The method according to claim 5, wherein the predetermined encoding method comprises: selecting video window attribute information with the most occurrences within the preset resolution and/or the decoding rate range to the shared video data. Encode.
  8. 根据权利要求5所述的方法，其特征在于，所述预设的编码方法包括：选择所述预设分辨率和/或解码率范围的出现的各视频窗口属性信息的平均值对所述共享视频数据进行编码。The method according to claim 5, wherein the predetermined encoding method comprises: selecting an average value of each video window attribute information of the occurrence of the preset resolution and/or the decoding rate range to the sharing The video data is encoded.
  9. 一种实现如权利要求1所述方法的视频多屏共享系统，该系统包括视频发送端和至少一个视频接收端，其特征在于，A video multi-screen sharing system implementing the method of claim 1, the system comprising a video transmitting end and at least one video receiving end, wherein
    所述视频发送端包括：The video sending end includes:
    所述窗口属性获取模块，用于接收各个视频接收端发送的视频播放窗口属性信息，并据此确定出各个视频接收端的视频播放窗口所对应的各个不同的编码方式；The window attribute obtaining module is configured to receive the video play window attribute information sent by each video receiving end, and determine different coding modes corresponding to the video play windows of each video receiving end according to the method;
    所述编码模块，与窗口属性获取模块连接，用于根据确定出的各个不同的编码方式对视频文件进行不同的编码，并由视频发送端发送出去；The encoding module is connected to the window attribute obtaining module, and is configured to perform different encoding on the video file according to the determined different encoding manners, and send the video file to the video sending end;
    所述视频接收端包括：The video receiving end includes:
    所述解码播放模块，用于解码视频接收端所接收的对应其视频播放窗口的视频数据，并使用所设定的视频播放窗口进行播放；The decoding and playing module is configured to decode video data corresponding to a video playing window received by the video receiving end, and play the video using the set video playing window;
    所述窗口属性监测模块，与解码播放模块连接，用于监测解码播放模块所使用的视频播放窗口的属性信息，并发送给所述视频发送端。The window attribute monitoring module is connected to the decoding play module, and is configured to monitor attribute information of the video play window used by the decoding play module, and send the attribute information to the video sending end.
PCT/CN2012/073730 2012-02-08 2012-04-10 Video multi-screen sharing method and system for realizing same WO2013117038A1 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN2012100277706A CN103248947A (en) 2012-02-08 2012-02-08 Video multiple screen sharing method and system for achieving same
CN201210027770.6 2012-02-08

Publications (1)

Publication Number Publication Date
WO2013117038A1 true WO2013117038A1 (en) 2013-08-15

Family

ID=48928129

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2012/073730 WO2013117038A1 (en) 2012-02-08 2012-04-10 Video multi-screen sharing method and system for realizing same

Country Status (2)

Country Link
CN (1) CN103248947A (en)
WO (1) WO2013117038A1 (en)

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN107124652A (en) * 2017-04-19 2017-09-01 武汉斗鱼网络科技有限公司 One kind connects wheat live middle windows switching method and device
CN112019897A (en) * 2020-08-27 2020-12-01 北京字节跳动网络技术有限公司 Screen projection method and device, electronic equipment and computer readable medium

Families Citing this family (16)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103517137B (en) * 2013-09-30 2017-08-01 广州华多网络科技有限公司 Network video transmission method and system, transmission/receiving terminal treating method and apparatus
CN104703030B (en) * 2013-12-10 2018-05-22 扬智科技股份有限公司 Video encoding method and image coding device
CN104281427B (en) * 2014-03-10 2018-04-27 深圳深讯和科技有限公司 Video data handling procedure and system in interactive application
CN104079978B (en) * 2014-06-27 2017-07-21 西安诺瓦电子科技有限公司 Window adaptive media playout method and device and media networking dissemination method
US9665336B2 (en) * 2014-07-29 2017-05-30 Qualcomm Incorporated Direct streaming for wireless display
CN104581385A (en) * 2014-12-23 2015-04-29 深圳市九洲电器有限公司 Multi-screen interactive self-adaptive playback method and system
CN104902075B (en) * 2015-04-29 2017-02-22 努比亚技术有限公司 Multi-screen interaction method and system
KR20170042431A (en) * 2015-10-08 2017-04-19 삼성전자주식회사 Electronic device configured to non-uniformly encode/decode image data according to display shape
CN105933757A (en) * 2016-04-22 2016-09-07 乐视控股（北京）有限公司 Video playing method, device and system thereof
CN106528021A (en) * 2016-10-27 2017-03-22 三星电子（中国）研发中心 Screen content sharing method and apparatus
CN108076301A (en) * 2016-11-11 2018-05-25 联芯科技有限公司 The method for processing video frequency and system of VoLTE video multi-party telephones
CN109117813A (en) * 2018-08-24 2019-01-01 北京新界教育科技有限公司 Method for processing video frequency and device
CN109361937A (en) * 2018-09-25 2019-02-19 江苏电力信息技术有限公司 A kind of large-size screen monitors multichannel plug-flow code rate automatic adjusting method
CN111182303A (en) * 2019-10-08 2020-05-19 腾讯科技（深圳）有限公司 Encoding method and device for shared screen, computer readable medium and electronic equipment
CN113438535A (en) * 2021-06-23 2021-09-24 深圳康佳电子科技有限公司 Multi-window display method and device, terminal equipment and storage medium
CN113473197A (en) * 2021-08-09 2021-10-01 智道网联科技(北京)有限公司 Video transmission method, device and computer readable storage medium for traffic event

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1960260A (en) * 2006-11-28 2007-05-09 华为技术有限公司 Method for providing IPTV service for different type terminals, and IPTV service system
CN101365125A (en) * 2008-09-27 2009-02-11 腾讯科技（深圳）有限公司 Multipath video communication method and system
CN101395571A (en) * 2006-01-13 2009-03-25 雅虎公司 Method and system for online remixing of digital multimedia
CN101640784A (en) * 2008-07-28 2010-02-03 上海领世通信技术发展有限公司 Device and method for controlling multi-image compounding in video conference system

Family Cites Families (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP3828010B2 (en) * 2001-12-21 2006-09-27 株式会社日立国際電気 Image receiving system
CN101848382A (en) * 2010-05-31 2010-09-29 深圳市景阳科技股份有限公司 Method and system for adjusting video streaming image resolution ratio and code stream

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101395571A (en) * 2006-01-13 2009-03-25 雅虎公司 Method and system for online remixing of digital multimedia
CN1960260A (en) * 2006-11-28 2007-05-09 华为技术有限公司 Method for providing IPTV service for different type terminals, and IPTV service system
CN101640784A (en) * 2008-07-28 2010-02-03 上海领世通信技术发展有限公司 Device and method for controlling multi-image compounding in video conference system
CN101365125A (en) * 2008-09-27 2009-02-11 腾讯科技（深圳）有限公司 Multipath video communication method and system

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN107124652A (en) * 2017-04-19 2017-09-01 武汉斗鱼网络科技有限公司 One kind connects wheat live middle windows switching method and device
CN107124652B (en) * 2017-04-19 2019-08-02 武汉斗鱼网络科技有限公司 It is a kind of to connect windows switching method and device in wheat live streaming
CN112019897A (en) * 2020-08-27 2020-12-01 北京字节跳动网络技术有限公司 Screen projection method and device, electronic equipment and computer readable medium
CN112019897B (en) * 2020-08-27 2022-11-08 北京字节跳动网络技术有限公司 Screen projection method and device, electronic equipment and computer readable medium

Also Published As

Publication number Publication date
CN103248947A (en) 2013-08-14

Similar Documents

Publication Publication Date Title
WO2013117038A1 (en) Video multi-screen sharing method and system for realizing same
US9025000B2 (en) System and method for initiating a video conferencing through a streaming device
WO2013113190A1 (en) Method and system for implementing multi-screen synchronous display
US20100066805A1 (en) System and method for video conferencing through a television forwarding device
JP4238247B2 (en) IP set-top box providing short-range wireless communication and voice call functions
CN107959818B (en) The data processing method of integrated terminal and integrated terminal
WO2018006573A1 (en) Device implementing video conference screen sharing
WO2004023725A1 (en) The community network system with broadband integrated services
CN103096020B (en) video conference system, video conference device and method thereof
CN102202210B (en) Method for mobile phone to play real-time monitoring video and mobile phone to play real-time monitoring video
CN104683863A (en) Method and equipment for multimedia data transmission
CN108134916A (en) A kind of data processing method of 4K terminals and 4K terminals
CN108124158B (en) The data processing method of multimedia terminal and multimedia terminal
CN103338346A (en) Method and system for realizing multimedia digital conference
WO2013113189A1 (en) Method and system for image transmission
WO2020151445A1 (en) Data transmission apparatus, device, and system, and data reception apparatus and device
CN103561311A (en) Screen transmission method and television
CN101316177B (en) Computer and television function integrated IP video telephone
CN102438119B (en) Audio/video communication system of digital television
CN108881932A (en) A kind of method and apparatus of video playing
CN110198384B (en) Communication method based on video networking and transfer server
WO2013113192A1 (en) Method and system for image transmission
US8243726B2 (en) System and method for enabling operation of an ethernet device over an extended distance
CN101141615B (en) External implementing method of session television terminal supporting double currents
CN204707195U (en) Based on the multi-medium intelligent terminal of power communication

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 12867748

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 12867748

Country of ref document: EP

Kind code of ref document: A1