WO2017193830A1 - Video switching method, device and system, and storage medium - Google Patents

Video switching method, device and system, and storage medium Download PDF

Info

Publication number
WO2017193830A1
WO2017193830A1 PCT/CN2017/082484 CN2017082484W WO2017193830A1 WO 2017193830 A1 WO2017193830 A1 WO 2017193830A1 CN 2017082484 W CN2017082484 W CN 2017082484W WO 2017193830 A1 WO2017193830 A1 WO 2017193830A1
Authority
WO
WIPO (PCT)
Prior art keywords
switching
video
video image
preset
image
Prior art date
Application number
PCT/CN2017/082484
Other languages
French (fr)
Chinese (zh)
Inventor
王福
Original Assignee
中兴通讯股份有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 中兴通讯股份有限公司 filed Critical 中兴通讯股份有限公司
Publication of WO2017193830A1 publication Critical patent/WO2017193830A1/en

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00Television systems
    • H04N7/14Systems for two-way working
    • H04N7/15Conference systems
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/60Network structure or processes for video distribution between server and client or between remote clients; Control signalling between clients, server and network components; Transmission of management data between server and client, e.g. sending from server to client commands for recording incoming content stream; Communication details between server and client 
    • H04N21/65Transmission of management data between client and server
    • H04N21/658Transmission by the client directed to the server
    • H04N21/6587Control parameters, e.g. trick play commands, viewpoint selection
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00Details of television systems
    • H04N5/222Studio circuitry; Studio devices; Studio equipment
    • H04N5/262Studio circuits, e.g. for mixing, switching-over, change of character of image, other special effects ; Cameras specially adapted for the electronic generation of special effects
    • H04N5/268Signal distribution or switching

Definitions

  • the present disclosure relates to the field of communications, and relates to a video switching method, apparatus, system, and storage medium.
  • both the voice excitation mode and the chairman/director control mode have a venue as a broadcast source.
  • the terminal When the terminal outputs the media stream, all the participating terminals except the terminal will watch the video image of the broadcast source terminal.
  • the broadcast source switching caused by the voice excitation or the conference control during the conference may cause the video of the terminal watching the broadcast source to switch.
  • the current video conference picture mode is divided into two modes: single picture and multiple picture.
  • single-screen mode all sites can only see video images of one site, and cannot view video images of other sites.
  • multi-picture mode each site can see a preset multi-screen layout. Different sites display different sites. After being coded by the Multipoint Control Unit (MCU), they are sent to the terminals participating in the conference.
  • MCU Multipoint Control Unit
  • the video fast update command (VCU) and the video freeze command (VCF) letter are usually used.
  • VCU video fast update command
  • VCF video freeze command
  • the frame video stream is sent to the terminal watching the broadcast source.
  • the terminal watching the broadcast source switches the original broadcast source image that has been frozen on the display to the new broadcast source video image for playback.
  • the multi-picture mode is basically the same as the previous single-picture processing flow. The difference is that the frozen is no longer the terminal that watches the broadcast source, but the wide-area synthesis unit in the video conferencing system. The sub-picture image where the source video is broadcasted, so now the video switching of each video manufacturer in the case of single picture or multi-picture is a sudden switch from one frozen video picture to another new video image, which is not very good in user experience. .
  • the embodiments of the present disclosure provide a video switching method, apparatus, system, and storage medium to solve at least the problem of low user experience when video conference images are switched in the related art.
  • a video switching method comprising: confirming, according to the received indication information, switching a source video image in a video conference to a target video image; according to the source video image and the target The video image generates a switching video that meets a preset switching parameter, where the preset switching parameter includes a preset switching dynamic effect; and the switching video is output.
  • generating a switching video that conforms to the preset switching parameter according to the source video image and the target video image includes: extracting, according to the preset switching parameter, a first preset number of images from the source video image a frame, and extracting a second preset number of image frames from the target video image; synthesizing the first preset number of image frames and the second predetermined number of image frames to carry the preset switch The switching video of the dynamic effect.
  • the method before the generating the switching video that meets the preset switching parameter according to the source video image and the target video image, the method further includes: acquiring a preset switching effect instruction or being sent by the multi-point controller MCU. And switching the special effect instruction, wherein the preset switching effect instruction or the switching special effect instruction issued by the multi-point controller MCU is used to configure the preset switching parameter.
  • the determining, according to the received indication information, that the switching the source video image in the video conference to the target video image comprises: receiving the indication information; determining whether the indication information carries The video fast update command VCF determines whether the indication information indicates that the media stream in the real-time transport protocol RTP information in the video media stream is switched; if the determination result is yes, confirms that the video conference is to be The source video image is switched to the target video image.
  • outputting the switching video includes: playing the switching video when the source video image is played.
  • a video switching apparatus comprising: an acknowledgment module configured to confirm switching a source video image in a video conference to a target video image according to the received indication information; generating a module, setting And generating, according to the source video image and the target video image, a switching video that meets a preset switching parameter, where the preset switching parameter includes a preset switching dynamic effect; and an output module configured to output the switching video.
  • the generating module includes: an extracting unit, configured to extract a first preset number of image frames from the source video image according to the preset switching parameter, and extract the first image image from the target video image a preset number of image frames; a synthesizing unit configured to synthesize the first preset number of image frames and the second predetermined number of image frames into the switching video carrying the preset switching dynamic effect .
  • the device further includes: an acquiring module, configured to acquire a preset switching effect effect instruction or a switching effect effect instruction issued by the multi-point controller MCU, wherein the preset switching special effect instruction or the multi-point The switching effect command issued by the controller MCU is used to configure the preset switching parameter.
  • an acquiring module configured to acquire a preset switching effect effect instruction or a switching effect effect instruction issued by the multi-point controller MCU, wherein the preset switching special effect instruction or the multi-point The switching effect command issued by the controller MCU is used to configure the preset switching parameter.
  • the confirmation module includes: a receiving unit, configured to receive the indication information; and a determining unit, configured to determine whether the indication information carries a video fast update command VCF or determine whether the indication information indicates a video medium
  • the media stream in the in-stream real-time transport protocol RTP information is switched; the confirming unit is configured to confirm that the source video image in the video conference is switched to the target video image if the determination result is yes.
  • the output module is configured to: when the source video image is played, play the switching video.
  • a video switching system including: a first terminal and a first multipoint controller MCU, wherein the first terminal is set as a root And confirming, according to the received indication information, switching the source video image in the video conference to the target video image; and generating, according to the source video image and the target video image, a switching video that meets a preset switching parameter, where the preset The switching parameter includes a preset switching dynamic effect; outputting the switching video; the first multi-point controller MCU is configured to send the source video image and the target video image to the first terminal.
  • a video switching system comprising: a second terminal and a second multipoint controller MCU, wherein the second multipoint controller MCU is configured to be based on the received indication And confirming that the source video image in the video conference is switched to the target video image; generating, according to the source video image and the target video image, a switching video that meets a preset switching parameter, where the preset switching parameter includes a preset Switching the dynamic effect; outputting the switching video; the second terminal is configured to receive the switching video, the source video image, and the target video image sent by the second multi-point controller MCU.
  • a storage medium including a stored program, wherein the program is executed while the video switching method is executed.
  • the disclosure according to the received indication information, confirming that the source video image in the video conference is switched to the target video image; and generating, according to the source video image and the target video image, a switching video that meets a preset switching parameter, where the switching parameter is preset Including the preset switching dynamic effect; output switching video, it can be seen that, when the video image in the video conference is switched from the source video image to the target video image, the above scheme can be used to generate the pre-loaded according to the source video image and the target video image. It is set to switch the video of the dynamic effect, so that the picture when the video image is switched is not fixed in a frozen picture, but is more vividly switched from the source video image to the target video image, thereby improving the user experience when the video conference image is switched. Degree, thereby solving the problem that the user experience is low when the video conference image is switched in the related art.
  • FIG. 1 is a block diagram showing a hardware structure of a mobile terminal of a video switching method according to an embodiment of the present disclosure
  • FIG. 2 is a flowchart of a video switching method according to an embodiment of the present disclosure
  • FIG. 3 is a structural block diagram 1 of a video switching apparatus according to an embodiment of the present disclosure.
  • FIG. 4 is a block diagram 2 of a video switching apparatus according to an embodiment of the present disclosure.
  • FIG. 5 is a structural block diagram 3 of a video switching apparatus according to an embodiment of the present disclosure.
  • FIG. 6 is a structural block diagram 4 of a video switching device according to an embodiment of the present disclosure.
  • FIG. 7 is a flowchart of a video switching method in accordance with an alternative embodiment of the present disclosure.
  • FIG. 8 is a structural block diagram of a video switching system in accordance with an alternative embodiment of the present disclosure.
  • Embodiment 1 of the present disclosure may be executed in a mobile terminal, a computer terminal, or the like.
  • the mobile terminal 10 may include one or more (only shown in the figure).
  • the processor 102 (the processor 102 may include, but is not limited to, a processing device such as a microprocessor MCU or a programmable logic device FPGA), a memory 104 for storing data, and a transmission device 106 for communication functions.
  • a processing device such as a microprocessor MCU or a programmable logic device FPGA
  • memory 104 for storing data
  • a transmission device 106 for communication functions.
  • moving Terminal 10 may also include more or fewer components than shown in FIG. 1, or have a different configuration than that shown in FIG.
  • the memory 104 can be configured as a software program and a module for storing application software, such as program instructions/modules corresponding to the carrier phase recovery method of the alternative embodiment, and the processor 102 executes each by executing a software program and a module stored in the memory 104.
  • a functional application and data processing, that is, the above method is implemented.
  • Memory 104 may include high speed random access memory, and may also include non-volatile memory such as one or more magnetic storage devices, flash memory, or other non-volatile solid state memory.
  • memory 104 may also include memory remotely located relative to processor 102, which may be connected to mobile terminal 10 over a network. Examples of such networks include, but are not limited to, the Internet, intranets, local area networks, mobile communication networks, and combinations thereof.
  • Transmission device 106 is arranged to receive or transmit data via a network.
  • the network optional examples described above may include a wireless network provided by a communication provider of the mobile terminal 10.
  • the transmission device 106 includes a Network Interface Controller (NIC) that can be connected to other network devices through a base station to communicate with the Internet.
  • the transmission device 106 can be a Radio Frequency (RF) module for communicating with the Internet wirelessly.
  • NIC Network Interface Controller
  • RF Radio Frequency
  • FIG. 2 is a flowchart of a video switching method according to an embodiment of the present disclosure. As shown in FIG. 2, the process includes the following steps:
  • Step S202 according to the received indication information, confirm that the source video image in the video conference is switched to the target video image
  • Step S204 Generate, according to the source video image and the target video image, a switching video that meets a preset switching parameter, where the preset switching parameter includes a preset switching dynamic effect;
  • Step S206 outputting a switching video.
  • the foregoing video switching method may be, but is not limited to, being applied to a scenario of a video conference.
  • a scene in which a video image is switched in a video conference a scene in which a video image is switched in a video conference.
  • the sub-picture switching method in the single-picture or multi-picture mode is to directly replace the original video image, and the video switching process can be better presented to all the conference sites by the method provided in this embodiment. Participants.
  • the video switching method may be applied to the terminal, such as a mobile phone, a tablet computer, a desktop computer, a smart wearable device, and a projection device.
  • the above video switching method may also be applied to, but not limited to, a multi-point controller MCU.
  • the above scheme can be used to generate the pre-loaded according to the source video image and the target video image. It is set to switch the video of the dynamic effect, so that the picture when the video image is switched is not fixed in a frozen picture, but is more vividly switched from the source video image to the target video image, thereby improving the user experience when the video conference image is switched. Degree, thereby solving the problem that the user experience is low when the video conference image is switched in the related art.
  • the preset switching parameter may be, but not limited to, used to indicate the generated switching video duration, and/or to indicate a preset switching dynamic effect used when generating the switching video.
  • the preset switching dynamic effect may include, but is not limited to, at least one of the following: 3D motion, stretching, wipe, scrolling, stitching, erasing, sliding, zooming, etc. switching dynamic effects.
  • the first preset number of image frames may be extracted from the source video image according to the preset switching parameter, and the second preset number of image frames are extracted from the target video image. And converting the first preset number of image frames and the second preset number of image frames into a switching video carrying a preset switching dynamic effect.
  • the duration of switching the video is set to S seconds, and the preset switching dynamic effect is “sliding”. Extracting, according to the indication of the preset switching parameter, an image frame of a first preset number M from the source video image, and extracting a second preset number N of image frames from the target video image, wherein the total duration of the M and the N is S .
  • the extracted M frame source video image The switching video with the N-frame target video image is switched to switch the dynamic effect to "sliding".
  • a switching video carrying a preset switching dynamic effect can be generated, so that the picture when the video switching occurs is more vivid, and the user experience of the video conference image switching is improved, thereby solving the user in the related art in the video conference image switching.
  • the preset switching effect instruction or the switching effect instruction issued by the multi-point controller MCU may be acquired, where the preset switching effect instruction or the MCU is issued by the multi-point controller
  • the switch effect effect command is used to configure preset switch parameters.
  • the preset switching parameters can be configured by switching the special effect instructions.
  • the indication information may be received, but not limited to, whether the indication information carries the video fast update command VCF or whether the indication information indicates that the media stream in the real-time transport protocol RTP information in the video media stream occurs. Switching, and in the case where the determination result is YES, confirm that the source video image in the video conference is switched to the target video image.
  • the video image switching can be determined by the video fast update command VCF or the media stream in the real-time transport protocol RTP information in the video media stream is switched.
  • the switching video may be played, but not limited to, when the source video image is played.
  • a video switching device is also provided, which is used to implement the above-mentioned embodiments and optional embodiments, and has not been described again.
  • the term "module” may implement a combination of software and/or hardware of a predetermined function.
  • the apparatus described in the following embodiments is preferably implemented in software, hardware, or a combination of software and hardware, is also possible and contemplated.
  • FIG. 3 is a structural block diagram 1 of a video switching apparatus according to an embodiment of the present disclosure. As shown in FIG. 3, the apparatus includes:
  • the confirmation module 32 is configured to confirm switching the source video image in the video conference to the target video image according to the received indication information
  • the generating module 34 is coupled to the confirmation module 32, and configured to generate, according to the source video image and the target video image, a switching video that meets a preset switching parameter, where the preset switching parameter includes a preset switching dynamic effect;
  • An output module 36 coupled to the generation module 34, configured to output a switching video.
  • the above video switching device may be, but is not limited to, applied to a scene of a video conference.
  • a scene in which a video image is switched in a video conference a scene in which a video image is switched in a video conference.
  • the single-picture or multi-picture mode sub-picture switching method directly replaces the original video image, and the video switching process can be better presented to all the conference participants by the method provided in this embodiment.
  • the video switching device may be, but is not limited to, applied to a terminal, such as a mobile phone, a tablet computer, a desktop computer, a smart wearable device, and a projection device.
  • a terminal such as a mobile phone, a tablet computer, a desktop computer, a smart wearable device, and a projection device.
  • the above video switching method may also be applied to, but not limited to, a multi-point controller MCU.
  • the confirmation module 32 confirms that the source video image in the video conference is switched to the target video image according to the received indication information; the generating module 34 generates a switching video that conforms to the preset switching parameter according to the source video image and the target video image.
  • the preset switching parameter includes a preset switching dynamic effect; the output module 36 outputs the switching video, and thus, it can be seen that, when the confirmation module 32 confirms that the video image in the video conference is switched from the source video image to the target video image, the foregoing solution is generated.
  • the module 34 can generate a switching video carrying a preset switching dynamic effect according to the source video image and the target video image, so that the screen when the video image is switched is not fixed in a frozen screen, but is more vividly switched from the source video image to the The target video image, therefore, improves the user experience when the video conference image is switched, thereby solving the problem of low user experience when the video conference image is switched in the related art.
  • the preset switching parameter may be, but not limited to, used to indicate the generated switching video duration, and/or to indicate a preset switching dynamic effect used when generating the switching video.
  • the preset switching dynamic effect may include, but is not limited to, at least one of the following: 3D motion, stretching, wipe, scrolling, stitching, erasing, sliding, zooming, etc. switching dynamic effects.
  • FIG. 4 is a structural block diagram 2 of a video switching apparatus according to an embodiment of the present disclosure.
  • the generating module 36 includes:
  • the extracting unit 42 is configured to extract a first preset number of image frames from the source video image according to the preset switching parameter, and extract a second preset number of image frames from the target video image;
  • the synthesizing unit 44 is coupled to the extracting unit 42 and configured to synthesize the first preset number of image frames and the second preset number of image frames into a switching video carrying a preset switching dynamic effect.
  • a switching video carrying a preset switching dynamic effect can be generated, so that the picture when the video switching occurs is more vivid, and the user experience of the video conference image switching is improved, thereby solving the user in the related art in the video conference image switching.
  • FIG. 5 is a structural block diagram 3 of a video switching apparatus according to an embodiment of the present disclosure. As shown in FIG. 5, optionally, the apparatus further includes:
  • the obtaining module 52 is coupled between the confirmation module 32 and the generating module 34, and is configured to acquire a preset switching effect effect instruction or a switching effect effect instruction issued by the multi-point controller MCU, wherein the preset switching effect effect instruction or the multi-point control
  • the switching effect command issued by the MCU is used to configure preset switching parameters.
  • the preset switching parameter can be configured by switching the special effect command.
  • FIG. 6 is a structural block diagram of a video switching apparatus according to an embodiment of the present disclosure.
  • the confirmation module 32 includes:
  • receiving unit 62 configured to receive indication information
  • the determining unit 64 is coupled to the receiving unit 62, and is configured to determine whether the indication information carries the video fast update command VCF or whether the indication information indicates the video medium.
  • the media stream in the real-time transport protocol RTP information in the body stream is switched;
  • the confirmation unit 66 coupled to the determination unit 64, is arranged to confirm that the source video image in the video conference is switched to the target video image if the determination result is YES.
  • the video image switching can be determined by the video fast update command VCF or the media stream in the real-time transport protocol RTP information in the video media stream is switched.
  • the output module can be, but is not limited to, set to: play the switching video at the end of the playback of the source video image.
  • each of the above modules may be implemented by software or hardware.
  • the foregoing may be implemented by, but not limited to, the foregoing modules are all located in the same processor; or, the modules are located in multiple In the processor.
  • a video switching system including: a first terminal and a first multi-point controller MCU, wherein the first terminal is configured to confirm a source in the video conference according to the received indication information. Switching the video image to the target video image; generating a switching video that conforms to the preset switching parameter according to the source video image and the target video image, wherein the preset switching parameter includes a preset switching dynamic effect; the output switching video; the first multi-point controller MCU And configured to send the source video image and the target video image to the first terminal.
  • a video switching system including: a second terminal and a second multi-point controller MCU, wherein the second multi-point controller MCU is configured to confirm the video according to the received indication information.
  • the source video image in the conference is switched to the target video image; the switching video that meets the preset switching parameter is generated according to the source video image and the target video image, wherein the preset switching parameter includes a preset switching dynamic effect; the output switching video; the second terminal And configured to receive the switching video, the source video image, and the target video image sent by the second multi-point controller MCU.
  • An alternative embodiment of the present disclosure provides a video switching method and system for improving user experience in a video image switching process in a video conference, and effectively improving the video switching process. Solve the problem of sudden switching of video images.
  • An alternative embodiment of the present disclosure is a method, device, and system for improving a video switching process of a current video conferencing system.
  • Step 1 The terminal watching the broadcast source determines that the watched video will be switched according to the received VCF signaling or Real-time Transport Protocol (RTP) information in the video media stream.
  • RTP Real-time Transport Protocol
  • Step 2 Obtain a switching effect effect command that is configured by the current video terminal or sent by the MCU.
  • Step 3 The special effect processing unit performs video switching special effect processing on the N frame source video image and the M frame target video image according to the special effect processing instruction, and the switching effect may be, but not limited to, including: 3D motion, stretching, wipe, scrolling, and pinning. , erase, slide, zoom, etc. switch effects.
  • step 4 the video image after the effect synthesis is switched.
  • the video switching can be performed by using the special effects on the single screen or the multi-picture sub-picture switching, thereby enhancing the conference experience of the participants.
  • an optional embodiment of the present disclosure further provides a system for improving a video switching effect in a video conference
  • the system may be, but not limited to, including a video conference terminal, and a video conference multipoint control unit MCU, where the terminal views
  • the video image is not transcoded or synthesized by the MCU, but is forwarded to the terminal by the MCU during the broadcast source switching process, and the terminal completes the generation and output of the broadcast source video image switching effect; when the video image viewed by the terminal is transcoded by the MCU or In the multi-picture synthesis, the MCU completes the video screen switching effect during the video switching process, and sends the code to all the terminals that need to view the video picture image.
  • the method and system proposed by the optional embodiment of the present disclosure improve the effect of video image switching and improve the user experience.
  • FIG. 7 is a flowchart of a video switching method according to an alternative embodiment of the present disclosure, in FIG. The process of video switching processing by the special effect processing module is also given. As shown in FIG. 7, the process includes the following steps:
  • Step S702 the signaling processing module receives the VCF signaling, or the media transceiver module detects that the media stream in the RTP is switched.
  • Step S704 Acquire a currently configured switching effect effect instruction, configure a parameter used by the video special effect module, and determine a method for switching the special effect generation.
  • Step S706 the source video image and the target video image are sent to the video special effect module.
  • Step S708 The video special effect module performs special effects on the broadcast source video image before the switching and the switched broadcast source video image according to the configured parameters, to generate a switching video.
  • Step S710 If the switching video is currently generated by the video conference terminal, output the video image of the switching video generated by the video special effect module. If the switching video is generated by the MCU, the video image code of the switching video is transmitted to the viewing terminal.
  • the video switching process with the video special effect is completed, and the related technical solution is avoided to directly switch to the source video image using the target video image, so that the user experience of the video conference system is better.
  • the system includes: a broadcast source terminal 82, a plurality of video conferencing terminals 84, and a video conference multipoint control unit MCU 86.
  • the multipoint control unit MCU 86 includes a service control module 86-2, a signaling processing module 86-4, a media transceiver module 86-6, a video effect module 86-8, and a media processing module 86-10.
  • the plurality of video conference terminals 84 respectively include a signaling processing module 84-2, a media transceiver module 84-4, a video effect module 84-6, and a video output module 84-8.
  • the broadcast source terminal 82 is arranged to provide a video image of the video conference.
  • the service control module 86-2 is set to video conference service flow control.
  • the signaling processing module 86-4 (84-2) is configured to transmit and receive signaling between the MCU and the video terminal, such as the aforementioned VCU, VCF signaling.
  • the media transceiver module 86-6 (84-4) is configured to receive and transmit the video and audio media stream. It is also possible to analyze the RTP header of the received video stream to determine whether the video source has switched.
  • the video effects module 86-8 (84-6) is configured to generate a switching effect video based on the configuration parameters and the received broadcast source video image.
  • Media processing module 84-4 is arranged to decode and encode the video image.
  • Video output module 84-8 is arranged to output images to the television and display.
  • the method according to the above embodiment can be implemented by means of software plus a necessary general hardware platform, and of course, by hardware, but in many cases, the former is A better implementation.
  • the technical solution of the present disclosure which is essential or contributes to the related art, may be embodied in the form of a software product stored in a storage medium (such as ROM/RAM, disk, CD-ROM).
  • the instructions include a number of instructions for causing a terminal device (which may be a cell phone, a computer, a server, or a network device, etc.) to perform the methods described in various embodiments of the present disclosure.
  • Embodiments of the present disclosure also provide a storage medium.
  • the foregoing storage medium may be configured to store program code for performing the following steps:
  • the storage medium is further arranged to store program code for performing the method steps recited in the above embodiments.
  • the foregoing storage medium may include, but not limited to, a USB flash drive, a Read-Only Memory (ROM), a Random Access Memory (RAM), a mobile hard disk, and a magnetic memory.
  • ROM Read-Only Memory
  • RAM Random Access Memory
  • a mobile hard disk e.g., a hard disk
  • magnetic memory e.g., a hard disk
  • the processor executes the method steps described in the foregoing embodiments according to the stored program code in the storage medium.
  • modules or steps of the present disclosure described above can be implemented by a general-purpose computing device that can be centralized on a single computing device or distributed across a network of multiple computing devices. Alternatively, they may be implemented by program code executable by the computing device such that they may be stored in the storage device by the computing device and, in some cases, may be different from the order herein.
  • the steps shown or described are performed, or they are separately fabricated into individual integrated circuit modules, or a plurality of modules or steps thereof are fabricated as a single integrated circuit module. As such, the disclosure is not limited to any specific combination of hardware and software.
  • the source video image in the video conference is switched to the target video image; and the switching video conforming to the preset switching parameter is generated according to the source video image and the target video image, wherein
  • the preset switching parameters include preset switching dynamic effects; output switching video, which solves the problem of low user experience when the video conference image is switched in the related art, and improves the user experience when the video conference image is switched.

Abstract

Disclosed are a video switching method, device and system, and a storage medium. The method comprises: confirming switching of a source video image in a video conference to a target video image according to received indication information; generating a switching video conforming to a preset switching parameter according to the source video image and the target video image, wherein the preset switching parameter comprises a preset switch dynamic effect; and outputting the switching video. The present invention solves the problem in the related art of bad user experience during image switching in a video conference, thereby improving the user experience during image switching in the video conference.

Description

视频切换方法、装置、系统及存储介质Video switching method, device, system and storage medium 技术领域Technical field
本公开涉及通信领域,涉及一种视频切换方法、装置、系统及存储介质。The present disclosure relates to the field of communications, and relates to a video switching method, apparatus, system, and storage medium.
背景技术Background technique
在多方视频会议过程中,无论是语音激励模式还是主席/导演控制模式,都有一个会场作为广播源。当该终端输出媒体流时,除该终端外其他所有与会终端都会观看广播源终端的视频图像。当视频会议中有三个以上的终端参加会议时,则在会议过程中无论是语音激励还是会控操作导致的广播源切换,都会导致观看广播源的终端出现视频切换。In the multi-party video conference process, both the voice excitation mode and the chairman/director control mode have a venue as a broadcast source. When the terminal outputs the media stream, all the participating terminals except the terminal will watch the video image of the broadcast source terminal. When there are more than three terminals participating in the conference in the video conference, the broadcast source switching caused by the voice excitation or the conference control during the conference may cause the video of the terminal watching the broadcast source to switch.
当前视频会议画面模式分为单画面和多画面两种模式。在单画面模式下,所有会场都只能看到某一会场视频图像,不能看到其他会场视频图像。多画面模式下各会场看到一个预先设定好的多画面布局,不同的位置显示不同的会场,经过多点控制器(Multipoint Control Unit,简称为MCU)统一编码之后发送给参加会议的终端。The current video conference picture mode is divided into two modes: single picture and multiple picture. In single-screen mode, all sites can only see video images of one site, and cannot view video images of other sites. In the multi-picture mode, each site can see a preset multi-screen layout. Different sites display different sites. After being coded by the Multipoint Control Unit (MCU), they are sent to the terminals participating in the conference.
在单画面模式下,当视频会议中需要将观看广播源的终端上显示的图像切换为当前新广播源终端的图像时,通常是利用视频快速更新命令(VCU)和视频冻结命令(VCF)信令,先通过VCF冻结观看广播源的终端上的图像,并停止向观看广播源的终端发送视频码流,并向新广播源终端发送VCU信令,当MCU收到新广播源终端发出的I帧视频流后将其发送给观看广播源的终端。观看广播源的终端收到新视频媒体流后,将显示器上已经冻结的原始广播源图像切换为新广播源视频图像进行播放。In the single-picture mode, when the image displayed on the terminal that views the broadcast source needs to be switched to the image of the current new broadcast source terminal in the video conference, the video fast update command (VCU) and the video freeze command (VCF) letter are usually used. Let the image on the terminal of the broadcast source be frozen by the VCF, stop transmitting the video code stream to the terminal watching the broadcast source, and send the VCU signaling to the new broadcast source terminal, when the MCU receives the I sent by the new broadcast source terminal. After the frame video stream is sent to the terminal watching the broadcast source. After receiving the new video media stream, the terminal watching the broadcast source switches the original broadcast source image that has been frozen on the display to the new broadcast source video image for playback.
多画面模式下与前面的单画面处理流程基本相同,区别是冻结的不再是观看广播源的终端,而是视频会议系统中多画面合成单元的广 播源视频所在的子画面图像,所以现在各视频厂商无论是单画面还是多画面情况下的视频切换都是从一个冻结视频图像突然切换到另外一个新视频图像,在用户体验上并不是很好。The multi-picture mode is basically the same as the previous single-picture processing flow. The difference is that the frozen is no longer the terminal that watches the broadcast source, but the wide-area synthesis unit in the video conferencing system. The sub-picture image where the source video is broadcasted, so now the video switching of each video manufacturer in the case of single picture or multi-picture is a sudden switch from one frozen video picture to another new video image, which is not very good in user experience. .
针对相关技术中视频会议图像切换时用户体验度低的问题,目前还没有有效地解决方案。In view of the low user experience in video conferencing image switching in the related art, there is currently no effective solution.
公开内容Public content
本公开实施例提供了一种视频切换方法、装置、系统及存储介质,以至少解决相关技术中视频会议图像切换时用户体验度低的问题。The embodiments of the present disclosure provide a video switching method, apparatus, system, and storage medium to solve at least the problem of low user experience when video conference images are switched in the related art.
根据本公开的一个实施例,提供了一种视频切换方法,包括:根据接收到的指示信息,确认将视频会议中的源视频图像切换至目标视频图像;根据所述源视频图像和所述目标视频图像生成符合预设切换参数的切换视频,其中,所述预设切换参数包括预设切换动态特效;输出所述切换视频。According to an embodiment of the present disclosure, there is provided a video switching method, comprising: confirming, according to the received indication information, switching a source video image in a video conference to a target video image; according to the source video image and the target The video image generates a switching video that meets a preset switching parameter, where the preset switching parameter includes a preset switching dynamic effect; and the switching video is output.
可选地,根据所述源视频图像和所述目标视频图像生成符合预设切换参数的切换视频包括:根据所述预设切换参数,从所述源视频图像中提取第一预设数量的图像帧,并从所述目标视频图像中提取第二预设数量的图像帧;将所述第一预设数量的图像帧和所述第二预设数量的图像帧合成携带有所述预设切换动态特效的所述切换视频。Optionally, generating a switching video that conforms to the preset switching parameter according to the source video image and the target video image includes: extracting, according to the preset switching parameter, a first preset number of images from the source video image a frame, and extracting a second preset number of image frames from the target video image; synthesizing the first preset number of image frames and the second predetermined number of image frames to carry the preset switch The switching video of the dynamic effect.
可选地,在根据所述源视频图像和所述目标视频图像生成符合预设切换参数的切换视频之前,所述方法还包括:获取预设切换特效指令或者由多点控制器MCU下发的切换特效指令,其中,所述预设切换特效指令或者所述由多点控制器MCU下发的切换特效指令用于配置所述预设切换参数。Optionally, before the generating the switching video that meets the preset switching parameter according to the source video image and the target video image, the method further includes: acquiring a preset switching effect instruction or being sent by the multi-point controller MCU. And switching the special effect instruction, wherein the preset switching effect instruction or the switching special effect instruction issued by the multi-point controller MCU is used to configure the preset switching parameter.
可选地,根据接收到的所述指示信息,确认将所述视频会议中的所述源视频图像切换至所述目标视频图像包括:接收所述指示信息;判断所述指示信息中是否携带有视频快速更新命令VCF或者判断所述指示信息是否指示视频媒体流中实时传输协议RTP信息中的媒体流发生切换;在判断结果为是的情况下,确认将所述视频会议中的所 述源视频图像切换至所述目标视频图像。Optionally, the determining, according to the received indication information, that the switching the source video image in the video conference to the target video image comprises: receiving the indication information; determining whether the indication information carries The video fast update command VCF determines whether the indication information indicates that the media stream in the real-time transport protocol RTP information in the video media stream is switched; if the determination result is yes, confirms that the video conference is to be The source video image is switched to the target video image.
可选地,输出所述切换视频包括:在所述源视频图像播放结束时,播放所述切换视频。Optionally, outputting the switching video includes: playing the switching video when the source video image is played.
根据本公开的另一个实施例,提供了一种视频切换装置,包括:确认模块,设置为根据接收到的指示信息,确认将视频会议中的源视频图像切换至目标视频图像;生成模块,设置为根据所述源视频图像和所述目标视频图像生成符合预设切换参数的切换视频,其中,所述预设切换参数包括预设切换动态特效;输出模块,设置为输出所述切换视频。According to another embodiment of the present disclosure, there is provided a video switching apparatus, comprising: an acknowledgment module configured to confirm switching a source video image in a video conference to a target video image according to the received indication information; generating a module, setting And generating, according to the source video image and the target video image, a switching video that meets a preset switching parameter, where the preset switching parameter includes a preset switching dynamic effect; and an output module configured to output the switching video.
可选地,所述生成模块包括:提取单元,设置为根据所述预设切换参数,从所述源视频图像中提取第一预设数量的图像帧,并从所述目标视频图像中提取第二预设数量的图像帧;合成单元,设置为将所述第一预设数量的图像帧和所述第二预设数量的图像帧合成携带有所述预设切换动态特效的所述切换视频。Optionally, the generating module includes: an extracting unit, configured to extract a first preset number of image frames from the source video image according to the preset switching parameter, and extract the first image image from the target video image a preset number of image frames; a synthesizing unit configured to synthesize the first preset number of image frames and the second predetermined number of image frames into the switching video carrying the preset switching dynamic effect .
可选地,所述装置还包括:获取模块,设置为获取预设切换特效指令或者由多点控制器MCU下发的切换特效指令,其中,所述预设切换特效指令或者所述由多点控制器MCU下发的切换特效指令用于配置所述预设切换参数。Optionally, the device further includes: an acquiring module, configured to acquire a preset switching effect effect instruction or a switching effect effect instruction issued by the multi-point controller MCU, wherein the preset switching special effect instruction or the multi-point The switching effect command issued by the controller MCU is used to configure the preset switching parameter.
可选地,所述确认模块包括:接收单元,设置为接收所述指示信息;判断单元,设置为判断所述指示信息中是否携带有视频快速更新命令VCF或者判断所述指示信息是否指示视频媒体流中实时传输协议RTP信息中的媒体流发生切换;确认单元,设置为在判断结果为是的情况下,确认将所述视频会议中的所述源视频图像切换至所述目标视频图像。Optionally, the confirmation module includes: a receiving unit, configured to receive the indication information; and a determining unit, configured to determine whether the indication information carries a video fast update command VCF or determine whether the indication information indicates a video medium The media stream in the in-stream real-time transport protocol RTP information is switched; the confirming unit is configured to confirm that the source video image in the video conference is switched to the target video image if the determination result is yes.
可选地,所述输出模块设置为:在所述源视频图像播放结束时,播放所述切换视频。Optionally, the output module is configured to: when the source video image is played, play the switching video.
根据本公开的另一个实施例,提供了一种视频切换系统,包括:第一终端和第一多点控制器MCU,其中,所述第一终端,设置为根 据接收到的指示信息,确认将视频会议中的源视频图像切换至目标视频图像;根据所述源视频图像和所述目标视频图像生成符合预设切换参数的切换视频,其中,所述预设切换参数包括预设切换动态特效;输出所述切换视频;所述第一多点控制器MCU,设置为向所述第一终端发送所述源视频图像和所述目标视频图像。According to another embodiment of the present disclosure, a video switching system is provided, including: a first terminal and a first multipoint controller MCU, wherein the first terminal is set as a root And confirming, according to the received indication information, switching the source video image in the video conference to the target video image; and generating, according to the source video image and the target video image, a switching video that meets a preset switching parameter, where the preset The switching parameter includes a preset switching dynamic effect; outputting the switching video; the first multi-point controller MCU is configured to send the source video image and the target video image to the first terminal.
根据本公开的另一个实施例,提供了一种视频切换系统,包括:第二终端和第二多点控制器MCU,其中,所述第二多点控制器MCU,设置为根据接收到的指示信息,确认将视频会议中的源视频图像切换至目标视频图像;根据所述源视频图像和所述目标视频图像生成符合预设切换参数的切换视频,其中,所述预设切换参数包括预设切换动态特效;输出所述切换视频;所述第二终端,设置为接收所述第二多点控制器MCU发送的所述切换视频、所述源视频图像和所述目标视频图像。According to another embodiment of the present disclosure, there is provided a video switching system comprising: a second terminal and a second multipoint controller MCU, wherein the second multipoint controller MCU is configured to be based on the received indication And confirming that the source video image in the video conference is switched to the target video image; generating, according to the source video image and the target video image, a switching video that meets a preset switching parameter, where the preset switching parameter includes a preset Switching the dynamic effect; outputting the switching video; the second terminal is configured to receive the switching video, the source video image, and the target video image sent by the second multi-point controller MCU.
根据本公开的另一个实施例,提供了一种存储介质,所述存储介质包括存储的程序,其中,所述程序运行时执行所述视频切换方法。According to another embodiment of the present disclosure, a storage medium is provided, the storage medium including a stored program, wherein the program is executed while the video switching method is executed.
通过本公开,根据接收到的指示信息,确认将视频会议中的源视频图像切换至目标视频图像;根据源视频图像和目标视频图像生成符合预设切换参数的切换视频,其中,预设切换参数包括预设切换动态特效;输出切换视频,由此可见,采用上述方案在确认视频会议中的视频图像从源视频图像切换至目标视频图像时,可以根据源视频图像和目标视频图像生成携带有预设切换动态特效的切换视频,使视频图像切换时的画面不再定格在一个冻结的画面,而是更加生动地从源视频图像切换到目标视频图像,因此,提升了视频会议图像切换时用户体验度,从而解决了相关技术中视频会议图像切换时用户体验度低的问题。Through the disclosure, according to the received indication information, confirming that the source video image in the video conference is switched to the target video image; and generating, according to the source video image and the target video image, a switching video that meets a preset switching parameter, where the switching parameter is preset Including the preset switching dynamic effect; output switching video, it can be seen that, when the video image in the video conference is switched from the source video image to the target video image, the above scheme can be used to generate the pre-loaded according to the source video image and the target video image. It is set to switch the video of the dynamic effect, so that the picture when the video image is switched is not fixed in a frozen picture, but is more vividly switched from the source video image to the target video image, thereby improving the user experience when the video conference image is switched. Degree, thereby solving the problem that the user experience is low when the video conference image is switched in the related art.
附图说明DRAWINGS
此处所说明的附图用来提供对本公开的理解,构成本公开的一部分,本公开的示意性实施例及其说明用于解释本公开,并不构成对本 公开的不当限定。在附图中:The drawings described herein are provided to provide a understanding of the disclosure, and constitute a part of this disclosure. Improper disclosure of the disclosure. In the drawing:
图1是本公开实施例的一种视频切换方法的移动终端的硬件结构框图;1 is a block diagram showing a hardware structure of a mobile terminal of a video switching method according to an embodiment of the present disclosure;
图2是根据本公开实施例的一种视频切换方法的流程图;2 is a flowchart of a video switching method according to an embodiment of the present disclosure;
图3是根据本公开实施例的一种视频切换装置的结构框图一;FIG. 3 is a structural block diagram 1 of a video switching apparatus according to an embodiment of the present disclosure;
图4是根据本公开实施例的一种视频切换装置的结构框图二;4 is a block diagram 2 of a video switching apparatus according to an embodiment of the present disclosure;
图5是根据本公开实施例的一种视频切换装置的结构框图三;FIG. 5 is a structural block diagram 3 of a video switching apparatus according to an embodiment of the present disclosure;
图6是根据本公开实施例的一种视频切换装置的结构框图四;6 is a structural block diagram 4 of a video switching device according to an embodiment of the present disclosure;
图7是根据本公开可选实施例的视频切换方法的流程图;7 is a flowchart of a video switching method in accordance with an alternative embodiment of the present disclosure;
图8是根据本公开可选实施例的视频切换系统的结构框图。FIG. 8 is a structural block diagram of a video switching system in accordance with an alternative embodiment of the present disclosure.
实施方式Implementation
下文中将参考附图并结合实施例来详细说明本公开。需要说明的是,在不冲突的情况下,本公开中的实施例及实施例中的特征可以相互组合。The present disclosure will be described in detail below with reference to the drawings in conjunction with the embodiments. It should be noted that the embodiments in the present disclosure and the features in the embodiments may be combined with each other without conflict.
需要说明的是,本公开的说明书和权利要求书及上述附图中的术语“第一”、“第二”等是用于区别类似的对象,而不必用于描述特定的顺序或先后次序。It is to be understood that the terms "first", "second", and the like in the specification and claims of the present disclosure are used to distinguish similar objects, and are not necessarily used to describe a particular order or order.
实施例1Example 1
本公开实施例1所提供的方法实施例可以在移动终端、计算机终端或者类似的运算装置中执行。以运行在移动终端上为例,图1是本公开实施例的一种视频切换方法的移动终端的硬件结构框图,如图1所示,移动终端10可以包括一个或多个(图中仅示出一个)处理器102(处理器102可以包括但不限于微处理器MCU或可编程逻辑器件FPGA等的处理装置)、用于存储数据的存储器104、以及用于通信功能的传输装置106。本领域普通技术人员可以理解,图1所示的结构仅为示意,其并不对上述电子装置的结构造成限定。例如,移动 终端10还可包括比图1中所示更多或者更少的组件,或者具有与图1所示不同的配置。The method embodiment provided by Embodiment 1 of the present disclosure may be executed in a mobile terminal, a computer terminal, or the like. 1 is a block diagram of a hardware structure of a mobile terminal according to a video switching method according to an embodiment of the present disclosure. As shown in FIG. 1, the mobile terminal 10 may include one or more (only shown in the figure). The processor 102 (the processor 102 may include, but is not limited to, a processing device such as a microprocessor MCU or a programmable logic device FPGA), a memory 104 for storing data, and a transmission device 106 for communication functions. It will be understood by those skilled in the art that the structure shown in FIG. 1 is merely illustrative and does not limit the structure of the above electronic device. For example, moving Terminal 10 may also include more or fewer components than shown in FIG. 1, or have a different configuration than that shown in FIG.
存储器104可设置为存储应用软件的软件程序以及模块,如可选实施例的载波相位恢复方法对应的程序指令/模块,处理器102通过运行存储在存储器104内的软件程序以及模块,从而执行各种功能应用以及数据处理,即实现上述的方法。存储器104可包括高速随机存储器,还可包括非易失性存储器,如一个或者多个磁性存储装置、闪存、或者其他非易失性固态存储器。在一些实例中,存储器104还可以包括相对于处理器102远程设置的存储器,这些远程存储器可以通过网络连接至移动终端10。上述网络的实例包括但不限于互联网、企业内部网、局域网、移动通信网及其组合。The memory 104 can be configured as a software program and a module for storing application software, such as program instructions/modules corresponding to the carrier phase recovery method of the alternative embodiment, and the processor 102 executes each by executing a software program and a module stored in the memory 104. A functional application and data processing, that is, the above method is implemented. Memory 104 may include high speed random access memory, and may also include non-volatile memory such as one or more magnetic storage devices, flash memory, or other non-volatile solid state memory. In some examples, memory 104 may also include memory remotely located relative to processor 102, which may be connected to mobile terminal 10 over a network. Examples of such networks include, but are not limited to, the Internet, intranets, local area networks, mobile communication networks, and combinations thereof.
传输装置106设置为经由一个网络接收或者发送数据。上述的网络可选实例可包括移动终端10的通信供应商提供的无线网络。在一个实例中,传输装置106包括一个网络适配器(Network Interface Controller,NIC),其可通过基站与其他网络设备相连从而可与互联网进行通讯。在一个实例中,传输装置106可以为射频(Radio Frequency,RF)模块,其用于通过无线方式与互联网进行通讯。 Transmission device 106 is arranged to receive or transmit data via a network. The network optional examples described above may include a wireless network provided by a communication provider of the mobile terminal 10. In one example, the transmission device 106 includes a Network Interface Controller (NIC) that can be connected to other network devices through a base station to communicate with the Internet. In one example, the transmission device 106 can be a Radio Frequency (RF) module for communicating with the Internet wirelessly.
在本实施例中提供了一种视频切换方法,图2是根据本公开实施例的一种视频切换方法的流程图,如图2所示,该流程包括如下步骤:A video switching method is provided in this embodiment. FIG. 2 is a flowchart of a video switching method according to an embodiment of the present disclosure. As shown in FIG. 2, the process includes the following steps:
步骤S202,根据接收到的指示信息,确认将视频会议中的源视频图像切换至目标视频图像;Step S202, according to the received indication information, confirm that the source video image in the video conference is switched to the target video image;
步骤S204,根据源视频图像和目标视频图像生成符合预设切换参数的切换视频,其中,预设切换参数包括预设切换动态特效;Step S204: Generate, according to the source video image and the target video image, a switching video that meets a preset switching parameter, where the preset switching parameter includes a preset switching dynamic effect;
步骤S206,输出切换视频。Step S206, outputting a switching video.
可选地,上述视频切换方法可以但不限于应用于视频会议的场景中。例如:视频会议中视频图像切换的场景。目前视频会议中的单画面或者多画面模式下子画面切换方法都是直接替换原始视频图像,通过本实施例提供的方法可以把视频切换过程更好的呈现给所有会场 参会人员。Optionally, the foregoing video switching method may be, but is not limited to, being applied to a scenario of a video conference. For example: a scene in which a video image is switched in a video conference. In the current video conference, the sub-picture switching method in the single-picture or multi-picture mode is to directly replace the original video image, and the video switching process can be better presented to all the conference sites by the method provided in this embodiment. Participants.
可选地,上述视频切换方法可以但不限于应用于终端,例如:手机,平板电脑,台式电脑,智能穿戴设备,投影设备。上述视频切换方法还可以但不限于应用于多点控制器MCU。Optionally, the video switching method may be applied to the terminal, such as a mobile phone, a tablet computer, a desktop computer, a smart wearable device, and a projection device. The above video switching method may also be applied to, but not limited to, a multi-point controller MCU.
通过上述步骤,根据接收到的指示信息,确认将视频会议中的源视频图像切换至目标视频图像;根据源视频图像和目标视频图像生成符合预设切换参数的切换视频,其中,预设切换参数包括预设切换动态特效;输出切换视频,由此可见,采用上述方案在确认视频会议中的视频图像从源视频图像切换至目标视频图像时,可以根据源视频图像和目标视频图像生成携带有预设切换动态特效的切换视频,使视频图像切换时的画面不再定格在一个冻结的画面,而是更加生动地从源视频图像切换到目标视频图像,因此,提升了视频会议图像切换时用户体验度,从而解决了相关技术中视频会议图像切换时用户体验度低的问题。Through the above steps, according to the received indication information, confirm that the source video image in the video conference is switched to the target video image; and the switching video that meets the preset switching parameter is generated according to the source video image and the target video image, wherein the preset switching parameter Including the preset switching dynamic effect; output switching video, it can be seen that, when the video image in the video conference is switched from the source video image to the target video image, the above scheme can be used to generate the pre-loaded according to the source video image and the target video image. It is set to switch the video of the dynamic effect, so that the picture when the video image is switched is not fixed in a frozen picture, but is more vividly switched from the source video image to the target video image, thereby improving the user experience when the video conference image is switched. Degree, thereby solving the problem that the user experience is low when the video conference image is switched in the related art.
在本实施例中,预设切换参数可以但不限于用于指示生成的切换视频时长,和/或,用于指示生成切换视频时使用的预设切换动态特效。In this embodiment, the preset switching parameter may be, but not limited to, used to indicate the generated switching video duration, and/or to indicate a preset switching dynamic effect used when generating the switching video.
在本实施例中,预设切换动态特效可以但不限于包括以下至少之一:3D运动,伸展,划像,卷页,叠化,擦除,滑动,缩放等切换动态特效。In this embodiment, the preset switching dynamic effect may include, but is not limited to, at least one of the following: 3D motion, stretching, wipe, scrolling, stitching, erasing, sliding, zooming, etc. switching dynamic effects.
可选地,在上述步骤S204中,可以但不限于根据预设切换参数,从源视频图像中提取第一预设数量的图像帧,并从目标视频图像中提取第二预设数量的图像帧,再将第一预设数量的图像帧和第二预设数量的图像帧合成携带有预设切换动态特效的切换视频。Optionally, in the foregoing step S204, the first preset number of image frames may be extracted from the source video image according to the preset switching parameter, and the second preset number of image frames are extracted from the target video image. And converting the first preset number of image frames and the second preset number of image frames into a switching video carrying a preset switching dynamic effect.
例如,预设切换参数中设置了切换视频的时长为S秒,预设切换动态特效为“滑动”。根据预设切换参数的指示,从源视频图像中提取第一预设数量M的图像帧,从目标视频图像中提取第二预设数量N的图像帧,其中,M与N的总时长为S。将提取的M帧源视频图像 与N帧目标视频图像合成切换动态特效为“滑动”的切换视频。For example, in the preset switching parameter, the duration of switching the video is set to S seconds, and the preset switching dynamic effect is “sliding”. Extracting, according to the indication of the preset switching parameter, an image frame of a first preset number M from the source video image, and extracting a second preset number N of image frames from the target video image, wherein the total duration of the M and the N is S . The extracted M frame source video image The switching video with the N-frame target video image is switched to switch the dynamic effect to "sliding".
通过上述步骤,可以生成携带有预设切换动态特效的切换视频,使发生视频切换时的画面更加生动,提升了视频会议图像切换时用户体验度,从而解决了相关技术中视频会议图像切换时用户体验度低的问题。Through the above steps, a switching video carrying a preset switching dynamic effect can be generated, so that the picture when the video switching occurs is more vivid, and the user experience of the video conference image switching is improved, thereby solving the user in the related art in the video conference image switching. The problem of low experience.
可选地,在上述步骤S204之前,可以但不限于获取预设切换特效指令或者由多点控制器MCU下发的切换特效指令,其中,预设切换特效指令或者由多点控制器MCU下发的切换特效指令用于配置预设切换参数。通过上述步骤,可以通过切换特效指令配置预设切换参数。Optionally, before the step S204, the preset switching effect instruction or the switching effect instruction issued by the multi-point controller MCU may be acquired, where the preset switching effect instruction or the MCU is issued by the multi-point controller The switch effect effect command is used to configure preset switch parameters. Through the above steps, the preset switching parameters can be configured by switching the special effect instructions.
可选地,在上述步骤S202中,可以但不限于接收指示信息,判断指示信息中是否携带有视频快速更新命令VCF或者判断指示信息是否指示视频媒体流中实时传输协议RTP信息中的媒体流发生切换,并在判断结果为是的情况下,确认将视频会议中的源视频图像切换至目标视频图像。Optionally, in the foregoing step S202, the indication information may be received, but not limited to, whether the indication information carries the video fast update command VCF or whether the indication information indicates that the media stream in the real-time transport protocol RTP information in the video media stream occurs. Switching, and in the case where the determination result is YES, confirm that the source video image in the video conference is switched to the target video image.
可见,通过上述步骤,可以通过视频快速更新命令VCF或者视频媒体流中实时传输协议RTP信息中的媒体流发生切换判断出视频图像发生切换。It can be seen that, through the foregoing steps, the video image switching can be determined by the video fast update command VCF or the media stream in the real-time transport protocol RTP information in the video media stream is switched.
可选地,在上述步骤S206中,可以但不限于在源视频图像播放结束时,播放切换视频。Optionally, in the foregoing step S206, the switching video may be played, but not limited to, when the source video image is played.
实施例2Example 2
在本实施例中还提供了一种视频切换装置,该装置用于实现上述实施例及可选实施方式,已经进行过说明的不再赘述。如以下所使用的,术语“模块”可以实现预定功能的软件和/或硬件的组合。尽管以下实施例所描述的装置较佳地以软件来实现,但是硬件,或者软件和硬件的组合的实现也是可能并被构想的。In the embodiment, a video switching device is also provided, which is used to implement the above-mentioned embodiments and optional embodiments, and has not been described again. As used below, the term "module" may implement a combination of software and/or hardware of a predetermined function. Although the apparatus described in the following embodiments is preferably implemented in software, hardware, or a combination of software and hardware, is also possible and contemplated.
图3是根据本公开实施例的一种视频切换装置的结构框图一,如图3所示,该装置包括: FIG. 3 is a structural block diagram 1 of a video switching apparatus according to an embodiment of the present disclosure. As shown in FIG. 3, the apparatus includes:
1)确认模块32,设置为根据接收到的指示信息,确认将视频会议中的源视频图像切换至目标视频图像;1) The confirmation module 32 is configured to confirm switching the source video image in the video conference to the target video image according to the received indication information;
2)生成模块34,耦合至确认模块32,设置为根据源视频图像和目标视频图像生成符合预设切换参数的切换视频,其中,预设切换参数包括预设切换动态特效;2) The generating module 34 is coupled to the confirmation module 32, and configured to generate, according to the source video image and the target video image, a switching video that meets a preset switching parameter, where the preset switching parameter includes a preset switching dynamic effect;
3)输出模块36,耦合至生成模块34,设置为输出切换视频。3) An output module 36, coupled to the generation module 34, configured to output a switching video.
可选地,上述视频切换装置可以但不限于应用于视频会议的场景中。例如:视频会议中视频图像切换的场景。目前视频会议中的单画面或者多画面模式下子画面切换方法都是直接替换原始视频图像,通过本实施例提供的方法可以把视频切换过程更好的呈现给所有会场参会人员。Optionally, the above video switching device may be, but is not limited to, applied to a scene of a video conference. For example: a scene in which a video image is switched in a video conference. In the current video conference, the single-picture or multi-picture mode sub-picture switching method directly replaces the original video image, and the video switching process can be better presented to all the conference participants by the method provided in this embodiment.
可选地,上述视频切换装置可以但不限于应用于终端,例如:手机,平板电脑,台式电脑,智能穿戴设备,投影设备。上述视频切换方法还可以但不限于应用于多点控制器MCU。Optionally, the video switching device may be, but is not limited to, applied to a terminal, such as a mobile phone, a tablet computer, a desktop computer, a smart wearable device, and a projection device. The above video switching method may also be applied to, but not limited to, a multi-point controller MCU.
通过上述装置,确认模块32根据接收到的指示信息,确认将视频会议中的源视频图像切换至目标视频图像;生成模块34根据源视频图像和目标视频图像生成符合预设切换参数的切换视频,其中,预设切换参数包括预设切换动态特效;输出模块36输出切换视频,由此可见,采用上述方案在确认模块32确认视频会议中的视频图像从源视频图像切换至目标视频图像时,生成模块34可以根据源视频图像和目标视频图像生成携带有预设切换动态特效的切换视频,使视频图像切换时的画面不再定格在一个冻结的画面,而是更加生动地从源视频图像切换到目标视频图像,因此,提升了视频会议图像切换时用户体验度,从而解决了相关技术中视频会议图像切换时用户体验度低的问题。Through the above device, the confirmation module 32 confirms that the source video image in the video conference is switched to the target video image according to the received indication information; the generating module 34 generates a switching video that conforms to the preset switching parameter according to the source video image and the target video image. The preset switching parameter includes a preset switching dynamic effect; the output module 36 outputs the switching video, and thus, it can be seen that, when the confirmation module 32 confirms that the video image in the video conference is switched from the source video image to the target video image, the foregoing solution is generated. The module 34 can generate a switching video carrying a preset switching dynamic effect according to the source video image and the target video image, so that the screen when the video image is switched is not fixed in a frozen screen, but is more vividly switched from the source video image to the The target video image, therefore, improves the user experience when the video conference image is switched, thereby solving the problem of low user experience when the video conference image is switched in the related art.
在本实施例中,预设切换参数可以但不限于用于指示生成的切换视频时长,和/或,用于指示生成切换视频时使用的预设切换动态特效。 In this embodiment, the preset switching parameter may be, but not limited to, used to indicate the generated switching video duration, and/or to indicate a preset switching dynamic effect used when generating the switching video.
在本实施例中,预设切换动态特效可以但不限于包括以下至少之一:3D运动,伸展,划像,卷页,叠化,擦除,滑动,缩放等切换动态特效。In this embodiment, the preset switching dynamic effect may include, but is not limited to, at least one of the following: 3D motion, stretching, wipe, scrolling, stitching, erasing, sliding, zooming, etc. switching dynamic effects.
图4是根据本公开实施例的一种视频切换装置的结构框图二,如图4所示,可选地,生成模块36包括:FIG. 4 is a structural block diagram 2 of a video switching apparatus according to an embodiment of the present disclosure. As shown in FIG. 4, optionally, the generating module 36 includes:
1)提取单元42,设置为根据预设切换参数,从源视频图像中提取第一预设数量的图像帧,并从目标视频图像中提取第二预设数量的图像帧;1) The extracting unit 42 is configured to extract a first preset number of image frames from the source video image according to the preset switching parameter, and extract a second preset number of image frames from the target video image;
2)合成单元44,耦合至提取单元42,设置为将第一预设数量的图像帧和第二预设数量的图像帧合成携带有预设切换动态特效的切换视频。2) The synthesizing unit 44 is coupled to the extracting unit 42 and configured to synthesize the first preset number of image frames and the second preset number of image frames into a switching video carrying a preset switching dynamic effect.
通过上述装置,可以生成携带有预设切换动态特效的切换视频,使发生视频切换时的画面更加生动,提升了视频会议图像切换时用户体验度,从而解决了相关技术中视频会议图像切换时用户体验度低的问题。Through the foregoing device, a switching video carrying a preset switching dynamic effect can be generated, so that the picture when the video switching occurs is more vivid, and the user experience of the video conference image switching is improved, thereby solving the user in the related art in the video conference image switching. The problem of low experience.
图5是根据本公开实施例的一种视频切换装置的结构框图三,如图5所示,可选地,装置还包括:FIG. 5 is a structural block diagram 3 of a video switching apparatus according to an embodiment of the present disclosure. As shown in FIG. 5, optionally, the apparatus further includes:
获取模块52,耦合至确认模块32和生成模块34之间,设置为获取预设切换特效指令或者由多点控制器MCU下发的切换特效指令,其中,预设切换特效指令或者由多点控制器MCU下发的切换特效指令用于配置预设切换参数。The obtaining module 52 is coupled between the confirmation module 32 and the generating module 34, and is configured to acquire a preset switching effect effect instruction or a switching effect effect instruction issued by the multi-point controller MCU, wherein the preset switching effect effect instruction or the multi-point control The switching effect command issued by the MCU is used to configure preset switching parameters.
通过上述装置,可以通过切换特效指令配置预设切换参数。Through the above device, the preset switching parameter can be configured by switching the special effect command.
图6是根据本公开实施例的一种视频切换装置的结构框图四,如图6所示,可选地,确认模块32包括:FIG. 6 is a structural block diagram of a video switching apparatus according to an embodiment of the present disclosure. As shown in FIG. 6, optionally, the confirmation module 32 includes:
1)接收单元62,设置为接收指示信息;1) receiving unit 62, configured to receive indication information;
2)判断单元64,耦合至接收单元62,设置为判断指示信息中是否携带有视频快速更新命令VCF或者判断指示信息是否指示视频媒 体流中实时传输协议RTP信息中的媒体流发生切换;2) The determining unit 64 is coupled to the receiving unit 62, and is configured to determine whether the indication information carries the video fast update command VCF or whether the indication information indicates the video medium. The media stream in the real-time transport protocol RTP information in the body stream is switched;
3)确认单元66,耦合至判断单元64,设置为在判断结果为是的情况下,确认将视频会议中的源视频图像切换至目标视频图像。3) The confirmation unit 66, coupled to the determination unit 64, is arranged to confirm that the source video image in the video conference is switched to the target video image if the determination result is YES.
可见,通过上述步骤,可以通过视频快速更新命令VCF或者视频媒体流中实时传输协议RTP信息中的媒体流发生切换判断出视频图像发生切换。It can be seen that, through the foregoing steps, the video image switching can be determined by the video fast update command VCF or the media stream in the real-time transport protocol RTP information in the video media stream is switched.
可选地,输出模块可以但不限于设置为:在源视频图像播放结束时,播放切换视频。Optionally, the output module can be, but is not limited to, set to: play the switching video at the end of the playback of the source video image.
需要说明的是,上述各个模块是可以通过软件或硬件来实现的,对于后者,可以通过以下方式实现,但不限于此:上述模块均位于同一处理器中;或者,上述模块分别位于多个处理器中。It should be noted that each of the above modules may be implemented by software or hardware. For the latter, the foregoing may be implemented by, but not limited to, the foregoing modules are all located in the same processor; or, the modules are located in multiple In the processor.
实施例3Example 3
在本实施例中还提供了一种视频切换系统,包括:第一终端和第一多点控制器MCU,其中,第一终端,设置为根据接收到的指示信息,确认将视频会议中的源视频图像切换至目标视频图像;根据源视频图像和目标视频图像生成符合预设切换参数的切换视频,其中,预设切换参数包括预设切换动态特效;输出切换视频;第一多点控制器MCU,设置为向第一终端发送源视频图像和目标视频图像。In this embodiment, a video switching system is further provided, including: a first terminal and a first multi-point controller MCU, wherein the first terminal is configured to confirm a source in the video conference according to the received indication information. Switching the video image to the target video image; generating a switching video that conforms to the preset switching parameter according to the source video image and the target video image, wherein the preset switching parameter includes a preset switching dynamic effect; the output switching video; the first multi-point controller MCU And configured to send the source video image and the target video image to the first terminal.
在本实施例中还提供了一种视频切换系统,包括:第二终端和第二多点控制器MCU,其中,第二多点控制器MCU,设置为根据接收到的指示信息,确认将视频会议中的源视频图像切换至目标视频图像;根据源视频图像和目标视频图像生成符合预设切换参数的切换视频,其中,预设切换参数包括预设切换动态特效;输出切换视频;第二终端,设置为接收第二多点控制器MCU发送的切换视频、源视频图像和目标视频图像。In this embodiment, a video switching system is further provided, including: a second terminal and a second multi-point controller MCU, wherein the second multi-point controller MCU is configured to confirm the video according to the received indication information. The source video image in the conference is switched to the target video image; the switching video that meets the preset switching parameter is generated according to the source video image and the target video image, wherein the preset switching parameter includes a preset switching dynamic effect; the output switching video; the second terminal And configured to receive the switching video, the source video image, and the target video image sent by the second multi-point controller MCU.
下面结合本公开可选实施例进行详细说明。The following is a detailed description in conjunction with alternative embodiments of the present disclosure.
本公开可选实施例提供了一种在视频会议中改进视频图像切换过程中用户体验的视频切换方法及系统,有效的改进视频切换过程, 解决视频图像突然切换的问题。本公开可选实施例是一种针对目前视频会议系统视频切换过程改进的方法、设备、及系统。An alternative embodiment of the present disclosure provides a video switching method and system for improving user experience in a video image switching process in a video conference, and effectively improving the video switching process. Solve the problem of sudden switching of video images. An alternative embodiment of the present disclosure is a method, device, and system for improving a video switching process of a current video conferencing system.
本可选实施例公开的一种视频图像切换的方法,包括以下步骤:A method for video image switching disclosed in this alternative embodiment includes the following steps:
步骤1,观看广播源的终端根据收到的VCF信令或者视频媒体流中实时传输协议(Real-time Transport Protocol,简称为RTP)信息判断所观看的视频将发生切换。Step 1: The terminal watching the broadcast source determines that the watched video will be switched according to the received VCF signaling or Real-time Transport Protocol (RTP) information in the video media stream.
步骤2,获取当前视频终端配置的或者MCU下发的切换特效指令。Step 2: Obtain a switching effect effect command that is configured by the current video terminal or sent by the MCU.
步骤3,特效处理单元,根据特效处理指令对N帧源视频图像和M帧目标视频图像进行视频切换特效处理,切换特效可以但不限于包括:3D运动,伸展,划像,卷页,叠化,擦除,滑动,缩放等切换特效方法。Step 3: The special effect processing unit performs video switching special effect processing on the N frame source video image and the M frame target video image according to the special effect processing instruction, and the switching effect may be, but not limited to, including: 3D motion, stretching, wipe, scrolling, and pinning. , erase, slide, zoom, etc. switch effects.
步骤4,将切换特效合成后的视频图像输出。In step 4, the video image after the effect synthesis is switched.
需要说明的是,无论是单画面或者多画面中的子画面切换都可以通过上面使用特效的方式进行视频切换,提升与会人员的会议体验。It should be noted that the video switching can be performed by using the special effects on the single screen or the multi-picture sub-picture switching, thereby enhancing the conference experience of the participants.
此外,本公开可选实施例还提供了一种在视频会议中改进视频切换效果的系统,该系统可以但不限于包括视频会议终端,以及视频会议多点控制单元MCU,其中,当终端观看的视频图像没经过MCU转码或者合成,而是由MCU在广播源切换过程中转发給终端时,由终端完成广播源视频图像切换特效的生成和输出;当终端观看的视频图像经过MCU转码或者多画面合成时,由MCU完成视频切换过程中视频画面切换特效的生成,编码后发送给所有需要观看此视频画面图像的终端。In addition, an optional embodiment of the present disclosure further provides a system for improving a video switching effect in a video conference, the system may be, but not limited to, including a video conference terminal, and a video conference multipoint control unit MCU, where the terminal views The video image is not transcoded or synthesized by the MCU, but is forwarded to the terminal by the MCU during the broadcast source switching process, and the terminal completes the generation and output of the broadcast source video image switching effect; when the video image viewed by the terminal is transcoded by the MCU or In the multi-picture synthesis, the MCU completes the video screen switching effect during the video switching process, and sends the code to all the terminals that need to view the video picture image.
采用本公开可选实施例提出的方法和系统,与现有会议电视视频切换技术相比,改进了视频图像切换的效果,提升了用户体验。Compared with the existing conference television video switching technology, the method and system proposed by the optional embodiment of the present disclosure improve the effect of video image switching and improve the user experience.
下面结合附图对本公开可选实施例进行说明和描述。The following describes an alternative embodiment of the present disclosure with reference to the accompanying drawings.
图7是根据本公开可选实施例的视频切换方法的流程图,图7中 还给出了特效处理模块进行视频切换处理的过程。如图7所示,该流程包括如下步骤:FIG. 7 is a flowchart of a video switching method according to an alternative embodiment of the present disclosure, in FIG. The process of video switching processing by the special effect processing module is also given. As shown in FIG. 7, the process includes the following steps:
步骤S702,信令处理模块收到VCF信令,或者媒体收发模块检测到RTP中的媒体流发生切换。Step S702, the signaling processing module receives the VCF signaling, or the media transceiver module detects that the media stream in the RTP is switched.
步骤S704,获取当前配置的切换特效指令,配置视频特效模块使用的参数,并确定切换特效生成的方法。Step S704: Acquire a currently configured switching effect effect instruction, configure a parameter used by the video special effect module, and determine a method for switching the special effect generation.
步骤S706,将源视频图像和目标视频图像发送給视频特效模块。Step S706, the source video image and the target video image are sent to the video special effect module.
步骤S708,视频特效模块根据配置的参数对切换前的广播源视频图像和切换后的广播源视频图像进行特效制作,生成切换视频。Step S708: The video special effect module performs special effects on the broadcast source video image before the switching and the switched broadcast source video image according to the configured parameters, to generate a switching video.
步骤S710,如果当前是由视频会议终端生成切换视频,则将视频特效模块生成的切换视频的视频图像输出显示。如果是由MCU生成切换视频,则将切换视频的视频图像编码发送給观看的终端。Step S710: If the switching video is currently generated by the video conference terminal, output the video image of the switching video generated by the video special effect module. If the switching video is generated by the MCU, the video image code of the switching video is transmitted to the viewing terminal.
通过上述步骤,完成了具有视频特效的视频切换过程,避免了相关技术方案使用目标视频图像直接切换到源视频图像,使视频会议系统的用户体验更好。Through the above steps, the video switching process with the video special effect is completed, and the related technical solution is avoided to directly switch to the source video image using the target video image, so that the user experience of the video conference system is better.
图8是根据本公开可选实施例的视频切换系统的结构框图,如图8所示,该系统包括:广播源终端82、多个视频会议终端84,还有视频会议多点控制单元MCU 86。其中,多点控制单元MCU 86包括:业务控制模块86-2、信令处理模块86-4、媒体收发模块86-6、视频特效模块86-8以及媒体处理模块86-10。多个视频会议终端84分别包括:信令处理模块84-2、媒体收发模块84-4、视频特效模块84-6以及视频输出模块84-8。广播源终端82设置为提供视频会议的视频图像。8 is a structural block diagram of a video switching system according to an alternative embodiment of the present disclosure. As shown in FIG. 8, the system includes: a broadcast source terminal 82, a plurality of video conferencing terminals 84, and a video conference multipoint control unit MCU 86. . The multipoint control unit MCU 86 includes a service control module 86-2, a signaling processing module 86-4, a media transceiver module 86-6, a video effect module 86-8, and a media processing module 86-10. The plurality of video conference terminals 84 respectively include a signaling processing module 84-2, a media transceiver module 84-4, a video effect module 84-6, and a video output module 84-8. The broadcast source terminal 82 is arranged to provide a video image of the video conference.
业务控制模块86-2设置为视频会议业务流程控制。The service control module 86-2 is set to video conference service flow control.
信令处理模块86-4(84-2)设置为MCU与视频终端之间信令的收发,比如前面提到的VCU,VCF信令。The signaling processing module 86-4 (84-2) is configured to transmit and receive signaling between the MCU and the video terminal, such as the aforementioned VCU, VCF signaling.
媒体收发模块86-6(84-4)设置为视音频媒体流的接收发送处理, 还可以对接收视频流的RTP头进行分析判断视频源是否发生切换。The media transceiver module 86-6 (84-4) is configured to receive and transmit the video and audio media stream. It is also possible to analyze the RTP header of the received video stream to determine whether the video source has switched.
视频特效模块86-8(84-6)设置为根据配置参数和接收到的广播源视频图像生成切换特效视频。The video effects module 86-8 (84-6) is configured to generate a switching effect video based on the configuration parameters and the received broadcast source video image.
媒体处理模块84-4设置为对视频图像解码和编码。Media processing module 84-4 is arranged to decode and encode the video image.
视频输出模块84-8设置为将图像输出到电视及显示器。Video output module 84-8 is arranged to output images to the television and display.
以上实施例仅用以说明本公开的技术方案而非对其进行限制,本领域的普通技术人员可以对本公开的技术方案进行修改或者等同替换,而不脱离本公开的精神和范围,本公开的保护范围应以权利要求所述为准。The above embodiments are only used to illustrate the technical solutions of the present disclosure, and the present invention is not limited thereto, and those skilled in the art can modify or replace the technical solutions of the present disclosure without departing from the spirit and scope of the present disclosure. The scope of protection shall be as stated in the claims.
实施例4Example 4
通过以上的实施方式的描述,本领域的技术人员可以清楚地了解到根据上述实施例的方法可借助软件加必需的通用硬件平台的方式来实现,当然也可以通过硬件,但很多情况下前者是更佳的实施方式。基于这样的理解,本公开的技术方案本质上或者说对相关技术做出贡献的部分可以以软件产品的形式体现出来,该计算机软件产品存储在一个存储介质(如ROM/RAM、磁碟、光盘)中,包括若干指令用以使得一台终端设备(可以是手机,计算机,服务器,或者网络设备等)执行本公开各个实施例所述的方法。Through the description of the above embodiments, those skilled in the art can clearly understand that the method according to the above embodiment can be implemented by means of software plus a necessary general hardware platform, and of course, by hardware, but in many cases, the former is A better implementation. Based on such understanding, the technical solution of the present disclosure, which is essential or contributes to the related art, may be embodied in the form of a software product stored in a storage medium (such as ROM/RAM, disk, CD-ROM). The instructions include a number of instructions for causing a terminal device (which may be a cell phone, a computer, a server, or a network device, etc.) to perform the methods described in various embodiments of the present disclosure.
本公开的实施例还提供了一种存储介质。可选地,在本实施例中,上述存储介质可以被设置为存储用于执行以下步骤的程序代码:Embodiments of the present disclosure also provide a storage medium. Optionally, in the embodiment, the foregoing storage medium may be configured to store program code for performing the following steps:
S1,根据接收到的指示信息,确认将视频会议中的源视频图像切换至目标视频图像;S1, according to the received indication information, confirm that the source video image in the video conference is switched to the target video image;
S2,根据源视频图像和目标视频图像生成符合预设切换参数的切换视频,其中,预设切换参数包括预设切换动态特效;S2. Generate, according to the source video image and the target video image, a switching video that meets a preset switching parameter, where the preset switching parameter includes a preset switching dynamic effect;
S3,输出切换视频。S3, output switching video.
可选地,存储介质还被设置为存储用于执行上述实施例记载的方法步骤的程序代码。 Optionally, the storage medium is further arranged to store program code for performing the method steps recited in the above embodiments.
可选地,在本实施例中,上述存储介质可以包括但不限于:U盘、只读存储器(ROM,Read-Only Memory)、随机存取存储器(RAM,Random Access Memory)、移动硬盘、磁碟或者光盘等各种可以存储程序代码的介质。Optionally, in this embodiment, the foregoing storage medium may include, but not limited to, a USB flash drive, a Read-Only Memory (ROM), a Random Access Memory (RAM), a mobile hard disk, and a magnetic memory. A variety of media that can store program code, such as a disc or a disc.
可选地,在本实施例中,处理器根据存储介质中已存储的程序代码执行上述实施例记载的方法步骤。Optionally, in this embodiment, the processor executes the method steps described in the foregoing embodiments according to the stored program code in the storage medium.
可选地,本实施例中的示例可以参考上述实施例及可选实施方式中所描述的示例,本实施例在此不再赘述。For example, the examples in this embodiment may refer to the examples described in the foregoing embodiments and the optional embodiments, and details are not described herein again.
显然,本领域的技术人员应该明白,上述的本公开的各模块或各步骤可以用通用的计算装置来实现,它们可以集中在单个的计算装置上,或者分布在多个计算装置所组成的网络上,可选地,它们可以用计算装置可执行的程序代码来实现,从而,可以将它们存储在存储装置中由计算装置来执行,并且在某些情况下,可以以不同于此处的顺序执行所示出或描述的步骤,或者将它们分别制作成各个集成电路模块,或者将它们中的多个模块或步骤制作成单个集成电路模块来实现。这样,本公开不限制于任何特定的硬件和软件结合。It will be apparent to those skilled in the art that the various modules or steps of the present disclosure described above can be implemented by a general-purpose computing device that can be centralized on a single computing device or distributed across a network of multiple computing devices. Alternatively, they may be implemented by program code executable by the computing device such that they may be stored in the storage device by the computing device and, in some cases, may be different from the order herein. The steps shown or described are performed, or they are separately fabricated into individual integrated circuit modules, or a plurality of modules or steps thereof are fabricated as a single integrated circuit module. As such, the disclosure is not limited to any specific combination of hardware and software.
以上所述仅为本公开的可选实施例而已,并不用于限制本公开,对于本领域的技术人员来说,本公开可以有各种更改和变化。凡在本公开的精神和原则之内,所作的任何修改、等同替换、改进等,均应包含在本公开的保护范围之内。The above description is only an alternative embodiment of the present disclosure, and is not intended to limit the disclosure, and various changes and modifications may be made to the present disclosure. Any modifications, equivalent substitutions, improvements, etc., made within the spirit and scope of the present disclosure are intended to be included within the scope of the present disclosure.
工业实用性Industrial applicability
在本公开的技术方案中,通过根据接收到的指示信息,确认将视频会议中的源视频图像切换至目标视频图像;根据源视频图像和目标视频图像生成符合预设切换参数的切换视频,其中,预设切换参数包括预设切换动态特效;输出切换视频,解决了相关技术中视频会议图像切换时用户体验度低的问题,提升了视频会议图像切换时用户体验度 In the technical solution of the present disclosure, by switching according to the received indication information, the source video image in the video conference is switched to the target video image; and the switching video conforming to the preset switching parameter is generated according to the source video image and the target video image, wherein The preset switching parameters include preset switching dynamic effects; output switching video, which solves the problem of low user experience when the video conference image is switched in the related art, and improves the user experience when the video conference image is switched.

Claims (13)

  1. 一种视频切换方法,包括:A video switching method includes:
    根据接收到的指示信息,确认将视频会议中的源视频图像切换至目标视频图像;Confirming that the source video image in the video conference is switched to the target video image according to the received indication information;
    根据所述源视频图像和所述目标视频图像生成符合预设切换参数的切换视频,其中,所述预设切换参数包括预设切换动态特效;Generating, according to the source video image and the target video image, a switching video that meets a preset switching parameter, where the preset switching parameter includes a preset switching dynamic effect;
    输出所述切换视频。The switching video is output.
  2. 根据权利要求1所述的方法,其中,根据所述源视频图像和所述目标视频图像生成符合预设切换参数的切换视频包括:The method according to claim 1, wherein the generating the switching video according to the preset switching parameter according to the source video image and the target video image comprises:
    根据所述预设切换参数,从所述源视频图像中提取第一预设数量的图像帧,并从所述目标视频图像中提取第二预设数量的图像帧;Extracting, according to the preset switching parameter, a first preset number of image frames from the source video image, and extracting a second preset number of image frames from the target video image;
    将所述第一预设数量的图像帧和所述第二预设数量的图像帧合成携带有所述预设切换动态特效的所述切换视频。And combining the first preset number of image frames and the second preset number of image frames to carry the switching video that carries the preset switching dynamic effect.
  3. 根据权利要求1所述的方法,其中,在根据所述源视频图像和所述目标视频图像生成符合预设切换参数的切换视频之前,所述方法还包括:The method of claim 1, wherein before the generating a switching video that matches the preset switching parameter according to the source video image and the target video image, the method further comprises:
    获取预设切换特效指令或者由多点控制器MCU下发的切换特效指令,其中,所述预设切换特效指令或者所述由多点控制器MCU下发的切换特效指令用于配置所述预设切换参数。Obtaining a preset switching effect instruction or a switching effect effect instruction issued by the multi-point controller MCU, wherein the preset switching effect effect instruction or the switching special effect instruction issued by the multi-point controller MCU is used to configure the pre-predetermined Set the switching parameters.
  4. 根据权利要求1所述的方法,其中,根据接收到的所述指示信息,确认将所述视频会议中的所述源视频图像切换至所述目标视频图像包括:The method according to claim 1, wherein, according to the received indication information, confirming that switching the source video image in the video conference to the target video image comprises:
    接收所述指示信息;Receiving the indication information;
    判断所述指示信息中是否携带有视频快速更新命令VCF或者 判断所述指示信息是否指示视频媒体流中实时传输协议RTP信息中的媒体流发生切换;Determining whether the indication information carries a video fast update command VCF or Determining whether the indication information indicates that the media stream in the real-time transport protocol RTP information in the video media stream is switched;
    在判断结果为是的情况下,确认将所述视频会议中的所述源视频图像切换至所述目标视频图像。In the case where the determination result is YES, it is confirmed that the source video image in the video conference is switched to the target video image.
  5. 根据权利要求1至4中任一项所述的方法,其中,输出所述切换视频包括:The method according to any one of claims 1 to 4, wherein outputting the switching video comprises:
    在所述源视频图像播放结束时,播放所述切换视频。The switching video is played when the source video image is played.
  6. 一种视频切换装置,包括:A video switching device includes:
    确认模块,设置为根据接收到的指示信息,确认将视频会议中的源视频图像切换至目标视频图像;a confirmation module, configured to confirm switching the source video image in the video conference to the target video image according to the received indication information;
    生成模块,设置为根据所述源视频图像和所述目标视频图像生成符合预设切换参数的切换视频,其中,所述预设切换参数包括预设切换动态特效;a generating module, configured to generate, according to the source video image and the target video image, a switching video that meets a preset switching parameter, where the preset switching parameter includes a preset switching dynamic effect;
    输出模块,设置为输出所述切换视频。An output module configured to output the switching video.
  7. 根据权利要求6所述的装置,其中,所述生成模块包括:The apparatus of claim 6, wherein the generating module comprises:
    提取单元,设置为根据所述预设切换参数,从所述源视频图像中提取第一预设数量的图像帧,并从所述目标视频图像中提取第二预设数量的图像帧;The extracting unit is configured to extract a first preset number of image frames from the source video image according to the preset switching parameter, and extract a second preset number of image frames from the target video image;
    合成单元,设置为将所述第一预设数量的图像帧和所述第二预设数量的图像帧合成携带有所述预设切换动态特效的所述切换视频。And a synthesizing unit, configured to synthesize the first preset number of image frames and the second preset number of image frames into the switching video that carries the preset switching dynamic effect.
  8. 根据权利要求6所述的装置,其中,所述装置还包括:The apparatus of claim 6 wherein said apparatus further comprises:
    获取模块,设置为获取预设切换特效指令或者由多点控制器MCU下发的切换特效指令,其中,所述预设切换特效指令或者所述由多点控制器MCU下发的切换特效指令用于配置所述预设切 换参数。The acquiring module is configured to obtain a preset switching effect effect instruction or a switching effect effect instruction issued by the multi-point controller MCU, wherein the preset switching special effect instruction or the switching special effect instruction issued by the multi-point controller MCU is used For configuring the preset cut Change parameters.
  9. 根据权利要求6所述的装置,其中,所述确认模块包括:The apparatus of claim 6 wherein said validation module comprises:
    接收单元,设置为接收所述指示信息;a receiving unit, configured to receive the indication information;
    判断单元,设置为判断所述指示信息中是否携带有视频快速更新命令VCF或者判断所述指示信息是否指示视频媒体流中实时传输协议RTP信息中的媒体流发生切换;The determining unit is configured to determine whether the instruction information carries the video fast update command VCF or whether the indication information indicates that the media stream in the real-time transport protocol RTP information in the video media stream is switched;
    确认单元,设置为在判断结果为是的情况下,确认将所述视频会议中的所述源视频图像切换至所述目标视频图像。The confirmation unit is configured to confirm that the source video image in the video conference is switched to the target video image if the determination result is YES.
  10. 根据权利要求6至9中任一项所述的装置,其中,所述输出模块设置为:The apparatus according to any one of claims 6 to 9, wherein the output module is configured to:
    在所述源视频图像播放结束时,播放所述切换视频。The switching video is played when the source video image is played.
  11. 一种视频切换系统,包括:第一终端和第一多点控制器MCU,其中,A video switching system includes: a first terminal and a first multipoint controller MCU, wherein
    所述第一终端,设置为根据接收到的指示信息,确认将视频会议中的源视频图像切换至目标视频图像;根据所述源视频图像和所述目标视频图像生成符合预设切换参数的切换视频,其中,所述预设切换参数包括预设切换动态特效;输出所述切换视频;The first terminal is configured to: according to the received indication information, confirm that the source video image in the video conference is switched to the target video image; and generate a handover according to the preset switching parameter according to the source video image and the target video image. a video, where the preset switching parameter includes a preset switching dynamic effect; and outputting the switching video;
    所述第一多点控制器MCU,设置为向所述第一终端发送所述源视频图像和所述目标视频图像。The first multipoint controller MCU is configured to transmit the source video image and the target video image to the first terminal.
  12. 一种视频切换系统,其中,包括:第二终端和第二多点控制器MCU,其中,A video switching system, comprising: a second terminal and a second multi-point controller MCU, wherein
    所述第二多点控制器MCU,设置为根据接收到的指示信息,确认将视频会议中的源视频图像切换至目标视频图像;根据所述源视频图像和所述目标视频图像生成符合预设切换参数的切换视频,其中,所述预设切换参数包括预设切换动态特效;输出所述 切换视频;The second multi-point controller MCU is configured to: according to the received indication information, confirm to switch the source video image in the video conference to the target video image; and generate a compliance preset according to the source video image and the target video image Switching the switching video of the parameter, wherein the preset switching parameter includes a preset switching dynamic effect; outputting the Switch video;
    所述第二终端,设置为接收所述第二多点控制器MCU发送的所述切换视频、所述源视频图像和所述目标视频图像。The second terminal is configured to receive the switching video, the source video image, and the target video image sent by the second multi-point controller MCU.
  13. 一种存储介质,所述存储介质包括存储的程序,其中,所述程序运行时执行权利要求1至5中任一项所述的方法。 A storage medium, the storage medium comprising a stored program, wherein the program is executed to perform the method of any one of claims 1 to 5.
PCT/CN2017/082484 2016-05-11 2017-04-28 Video switching method, device and system, and storage medium WO2017193830A1 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201610313415.3 2016-05-11
CN201610313415.3A CN107370980A (en) 2016-05-11 2016-05-11 Video switching method, apparatus and system

Publications (1)

Publication Number Publication Date
WO2017193830A1 true WO2017193830A1 (en) 2017-11-16

Family

ID=60266353

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2017/082484 WO2017193830A1 (en) 2016-05-11 2017-04-28 Video switching method, device and system, and storage medium

Country Status (2)

Country Link
CN (1) CN107370980A (en)
WO (1) WO2017193830A1 (en)

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN111954062A (en) * 2020-07-14 2020-11-17 西安万像电子科技有限公司 Information processing method and device
CN112308540A (en) * 2020-12-04 2021-02-02 珠海优特电力科技股份有限公司 Method and device for switching on/off state of equipment in rail transit and storage medium
CN112822545A (en) * 2019-11-15 2021-05-18 西安诺瓦星云科技股份有限公司 Image display method, device and system and video controller
CN113542851A (en) * 2021-07-09 2021-10-22 Vidaa美国公司 Menu refreshing method and display device

Families Citing this family (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112543342B (en) * 2020-11-26 2023-03-14 腾讯科技(深圳)有限公司 Virtual video live broadcast processing method and device, storage medium and electronic equipment
CN113825020B (en) * 2021-09-18 2023-09-29 北京百度网讯科技有限公司 Video definition switching method, device, equipment, storage medium and program product

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101510989A (en) * 2009-03-30 2009-08-19 祝文燕 Method and device for smoothly switching multipath video source
CN102685417A (en) * 2011-03-17 2012-09-19 青岛海信电器股份有限公司 Method for switching channels of television, device and television
CN103024559A (en) * 2012-11-09 2013-04-03 北京小米科技有限责任公司 Method and device for video switchover and equipment
US20140368734A1 (en) * 2013-06-17 2014-12-18 Spotify Ab System and method for switching between media streams while providing a seamless user experience
CN105100644A (en) * 2015-07-15 2015-11-25 西安诺瓦电子科技有限公司 Seamless switching method for video source

Family Cites Families (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2002006820A (en) * 2000-06-19 2002-01-11 Hiroshi Tei Presentation system, its controlling method and recording medium with its control program recorded
CN201928372U (en) * 2010-11-15 2011-08-10 深圳市唯奥视讯技术有限公司 Device for seamlessly switching various input video images
CN103024599B (en) * 2011-09-20 2016-03-16 中国联合网络通信集团有限公司 Set top box communication method, device and system

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101510989A (en) * 2009-03-30 2009-08-19 祝文燕 Method and device for smoothly switching multipath video source
CN102685417A (en) * 2011-03-17 2012-09-19 青岛海信电器股份有限公司 Method for switching channels of television, device and television
CN103024559A (en) * 2012-11-09 2013-04-03 北京小米科技有限责任公司 Method and device for video switchover and equipment
US20140368734A1 (en) * 2013-06-17 2014-12-18 Spotify Ab System and method for switching between media streams while providing a seamless user experience
CN105100644A (en) * 2015-07-15 2015-11-25 西安诺瓦电子科技有限公司 Seamless switching method for video source

Cited By (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112822545A (en) * 2019-11-15 2021-05-18 西安诺瓦星云科技股份有限公司 Image display method, device and system and video controller
CN111954062A (en) * 2020-07-14 2020-11-17 西安万像电子科技有限公司 Information processing method and device
CN112308540A (en) * 2020-12-04 2021-02-02 珠海优特电力科技股份有限公司 Method and device for switching on/off state of equipment in rail transit and storage medium
CN112308540B (en) * 2020-12-04 2024-01-23 珠海优特电力科技股份有限公司 Method, device and storage medium for switching device opening and closing states in rail transit
CN113542851A (en) * 2021-07-09 2021-10-22 Vidaa美国公司 Menu refreshing method and display device

Also Published As

Publication number Publication date
CN107370980A (en) 2017-11-21

Similar Documents

Publication Publication Date Title
WO2017193830A1 (en) Video switching method, device and system, and storage medium
CN104754396B (en) The display methods and device of barrage data
CN110798697B (en) Video display method, device and system and electronic equipment
US20150124048A1 (en) Switchable multiple video track platform
JP6172610B2 (en) Video conferencing system
EP2863642B1 (en) Method, device and system for video conference recording and playing
US9497390B2 (en) Video processing method, apparatus, and system
WO2015070558A1 (en) Video shooting control method and device
CN106303663B (en) live broadcast processing method and device and live broadcast server
CN112262583A (en) 360-degree multi-view port system
CN107197320B (en) Video live broadcast method, device and system
CN106060526A (en) Live broadcast method and device based on two cameras
CN111343477B (en) Data transmission method and device, electronic equipment and storage medium
WO2021143043A1 (en) Multi-person instant messaging method, system, apparatus and electronic device
CN104837043B (en) Multimedia information processing method and electronic equipment
US20220030214A1 (en) Generation and distribution of immersive media content from streams captured via distributed mobile devices
CN110662119A (en) Video splicing method and device
KR20170081517A (en) Server and method for providing interactive broadcast
KR101980330B1 (en) Device for Generating a Video Output Data Stream, Video Source, Video System and Method for Generating a Video Output Data Stream and a Video Source Data Stream
US11431770B2 (en) Method, system, apparatus, and electronic device for managing data streams in a multi-user instant messaging system
WO2014012384A1 (en) Communication data transmitting method, system and receiving device
WO2013067898A1 (en) Method and terminal for transmitting information
CN109862385B (en) Live broadcast method and device, computer readable storage medium and terminal equipment
KR101542416B1 (en) Method and apparatus for providing multi angle video broadcasting service
CN115767158A (en) Synchronous playing method, terminal equipment and storage medium

Legal Events

Date Code Title Description
NENP Non-entry into the national phase

Ref country code: DE

121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 17795448

Country of ref document: EP

Kind code of ref document: A1

122 Ep: pct application non-entry in european phase

Ref document number: 17795448

Country of ref document: EP

Kind code of ref document: A1