WO2019242774A1 - 一种视频会议中画面切换方法、终端及mcu - Google Patents

一种视频会议中画面切换方法、终端及mcu Download PDF

Info

Publication number
WO2019242774A1
WO2019242774A1 PCT/CN2019/092468 CN2019092468W WO2019242774A1 WO 2019242774 A1 WO2019242774 A1 WO 2019242774A1 CN 2019092468 W CN2019092468 W CN 2019092468W WO 2019242774 A1 WO2019242774 A1 WO 2019242774A1
Authority
WO
WIPO (PCT)
Prior art keywords
screen
conference terminal
video conference
switching
video
Prior art date
Application number
PCT/CN2019/092468
Other languages
English (en)
French (fr)
Inventor
杨亮
Original Assignee
中兴通讯股份有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 中兴通讯股份有限公司 filed Critical 中兴通讯股份有限公司
Publication of WO2019242774A1 publication Critical patent/WO2019242774A1/zh

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00—Television systems
    • H04N7/08—Systems for the simultaneous or sequential transmission of more than one television signal, e.g. additional information signals, the signals occupying wholly or partially the same frequency band, e.g. by time division
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00—Television systems
    • H04N7/14—Systems for two-way working
    • H04N7/15—Conference systems
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00—Television systems
    • H04N7/14—Systems for two-way working
    • H04N7/15—Conference systems
    • H04N7/152—Multipoint control units therefor

Definitions

  • the embodiments of the present application relate to, but are not limited to, the technical field of video conferences, for example, to a method for switching pictures in a video conference, a terminal, and a multi-point control unit (MCU).
  • MCU multi-point control unit
  • UP Universal Port Technology
  • the MCU decodes the pictures of multiple sites according to their different video capabilities, re-encodes them, synthesizes the video capability pictures supported by the destination terminal, and sends them to multiple sites.
  • UP provides independent decoding and encoding for each venue, so that the MCU can provide separate pictures for each venue and other venues to meet the independent picture requirements of multiple venues.
  • An embodiment of the present application provides a method for switching pictures in a video conference, including:
  • the first video conference terminal When the first video conference terminal recognizes the switching operation, the first video conference terminal sends a screen switching message to the multipoint control unit MCU, where the screen switching message includes the type of the switched screen and the number of the second video conference terminal to be switched;
  • An embodiment of the present application further provides a method for switching pictures in a video conference, including:
  • the multipoint control unit MCU receives a picture switching message sent by the first video conference terminal, where the picture switching message includes a type of the switched picture and a second video conference terminal number to be switched;
  • the switched video code stream is generated according to the screen switching message, and the switched video code stream is sent to the first video conference terminal, so that the first video conference terminal performs screen display.
  • An embodiment of the present application further provides a video conference terminal, where the terminal includes:
  • the sending unit is configured to send a picture switching message to the multipoint control unit MCU when the switching operation is recognized, where the picture switching message includes a type of the switched picture and a second video conference terminal number to be switched;
  • the display unit is configured to receive the switched video code stream sent by the MCU and perform screen display.
  • An embodiment of the present application further provides a multipoint control unit MCU, where the MCU includes:
  • a receiving unit configured to receive a picture switching message sent by a first video conference terminal, where the picture switching message includes a type of a switched picture and a second video conference terminal number to be switched;
  • the switching unit is configured to generate a switched video code stream according to the screen switching message, and send the switched video code stream to the first video conference terminal, so that the first video conference terminal performs screen display.
  • An embodiment of the present application further provides a video conference terminal, which includes a memory, a processor, and a computer program stored on the memory and executable on the processor.
  • the computer program is implemented when the processor is executed by the processor.
  • the screen switching method performed by the video conference terminal.
  • An embodiment of the present application further provides a multipoint control unit MCU, including a memory, a processor, and a computer program stored on the memory and executable on the processor, where the computer program is executed by the processor Realize the screen switching method executed by the MCU at any time.
  • a multipoint control unit MCU including a memory, a processor, and a computer program stored on the memory and executable on the processor, where the computer program is executed by the processor Realize the screen switching method executed by the MCU at any time.
  • An embodiment of the present application further provides a computer-readable storage medium.
  • the computer-readable storage medium stores an information processing program, and when the information processing program is executed by a processor, any of the foregoing screen switching methods is implemented.
  • Figure 1-1 is a schematic diagram of the screen switching process in a traditional video conference
  • Figure 1-2 is a schematic diagram of the screen switching process in a traditional video conference
  • FIG. 2 is a schematic flowchart of a screen switching method in a video conference according to the first embodiment of the present application
  • FIG. 3 is a schematic flowchart of a method for switching pictures in a video conference according to the first embodiment of the present application
  • FIG. 4 is a schematic flowchart of a screen switching method in a video conference provided in Embodiment 3 of the present application; FIG.
  • 5 is a screen diagram of a conference terminal list
  • FIG. 6 is a schematic diagram of a screen for switching the image of the terminal A displayed by the first video conference terminal to the image of the terminal B when the terminal B's label is clicked;
  • FIG. 7 is a screen diagram of switching the terminal A image displayed by the first video conference terminal to the terminal B image when the display screen is tapped and swiped from right to left;
  • FIG. 8 is a schematic diagram of a screen displaying a small-screen image of the touch terminal A label
  • FIG. 9 is a schematic diagram of a screen switching provided by Embodiment 4 of the present application.
  • FIG. 10 is a schematic flowchart of a screen switching method provided in Embodiment 4 of the present application.
  • FIG. 11 is a schematic diagram of a screen switching provided by Embodiment 5 of the present application.
  • FIG. 12 is a schematic flowchart of a screen switching method provided in Embodiment 5 of the present application.
  • FIG. 13 is a schematic structural diagram of a video conference terminal provided in Embodiment 6 of the present application.
  • FIG. 14 is a schematic structural diagram of an MCU provided in Embodiment 6 of the present application.
  • FIG 1-1 is a schematic diagram of the screen switching process in a traditional video conference
  • Figure 1-2 is a schematic diagram of the screen switching process in a traditional video conference.
  • terminal A views the image of terminal B.
  • the image data of terminal B passes through the decoding node of terminal B and sends the decoded code stream to the encoding node of terminal A.
  • the encoding node of terminal A then transmits the code stream of terminal B.
  • the code is sent to terminal A, as shown in Figure 1-1.
  • the media management module commands the decoding node of terminal B to stop sending the code stream to the encoding node of terminal A, and instructs the decoding node of terminal C to send the code stream to
  • the encoding node of terminal A also instructs the encoding node of terminal A to receive the decoded code stream from the decoding node of terminal C, and the encoding node of terminal A sends the encoded video stream of terminal C to terminal A, as shown in Figure 1- 2 shown.
  • the embodiments of the present application provide a method, a terminal, and an MCU for screen switching in a video conference. Dynamically switching the screen of a conference site on the video conference terminal side can quickly implement screen switching and improve the user experience.
  • FIG. 2 is a schematic flowchart of a screen switching method in a video conference provided by Embodiment 1 of the present application. As shown in FIG. 2, the screen switching method includes the following steps.
  • Step 2010 When the first video conference terminal recognizes the switching operation, the first video conference terminal sends a screen switching message to the multipoint control unit MCU, where the screen switching message includes the type of the screen to be switched and the number of the second video conference terminal to be switched. .
  • Step 2020 Receive the switched video code stream sent by the MCU and perform screen display.
  • the first video conference terminal receives the switched video code stream sent by the MCU and performs screen display, including: A video conference terminal receives a video stream of the second video conference terminal sent by the MCU, and displays a local picture as a picture of a conference site where the second video conference terminal is located.
  • the type of the switching screen is to switch the small screen;
  • the screen switching message further includes: a display type identified as being displayed, and a small screen display starting position information;
  • Receiving, by a video conference terminal, a switched video code stream sent by an MCU and displaying a picture including: receiving, by a first video conference terminal, a video stream sent by an MCU and superimposing a local picture corresponding to a small picture of the second video conference terminal, And displaying a screen corresponding to the video bitstream to display the small screen at a small screen display start position corresponding to the small screen display start position information of the local screen, that is, it can be seen in the local screen that the The small screen display start position corresponding to the small screen display start position information displays the small screen.
  • the type of switching screen is switching a small screen;
  • the screen switching message further includes: a display type identified as a canceled display;
  • the first video conference terminal Receiving the switched video code stream and displaying the picture from the MCU includes: a first video conference terminal receiving the video stream of a local picture sent by the MCU, and displaying a picture corresponding to the video stream to display the picture on the local picture
  • the small screen display start position corresponding to the small screen display start position information no longer displays the small screen.
  • the method further includes: after joining the conference, the first video conference terminal receives a list of conference terminals sent by the MCU; the first video conference terminal forms a preset list of viewing terminals according to the conference terminal list, and detects In the case of the preset operation, the label of the list of preset viewing terminals is displayed or cancelled on the display screen of the first video conference terminal.
  • the first video conference terminal when it is detected that the display screen of the first video conference terminal is clicked, displays a label of the preset viewing terminal list on the display screen. After the display screen of the first video conference terminal leaves and exceeds a preset time, the first video conference terminal cancels displaying the label of the preset viewing terminal list.
  • the first video conference terminal when it is detected that the display screen is clicked and swipes from left to right or right to left, the first video conference terminal recognizes that the switching operation is local screen switching; when swiping from left to right, The second video conference terminal to be switched is the video conference terminal corresponding to the left label of the video conference terminal corresponding to the local picture in the label of the preset viewing terminal list; when sliding from right to left, the The second video conference terminal to be switched is the video conference terminal corresponding to the right label of the video conference terminal corresponding to the local picture among the labels of the preset viewing terminal list.
  • the first video conference terminal recognizes that the switching operation is to display a small screen, and when a touch operation on the label is detected When it disappears, it is identified that the switching operation is to cancel the small screen, and the second video conference terminal to be switched is the video conference terminal corresponding to the tag.
  • the first video conference terminal when it is detected that a label displaying a small screen is clicked, the first video conference terminal recognizes that the switching operation is local screen switching, and the second video conference terminal to be switched is a video corresponding to the displayed small screen. Conference terminal.
  • FIG. 3 is a schematic flowchart of a screen switching method in a video conference provided by Embodiment 1 of the present application. As shown in FIG. 3, the screen switching method includes the following steps.
  • Step 3010 The multi-point control unit MCU receives a picture switching message sent by the first video conference terminal, where the picture switching message includes a type of a switched picture and a second video conference terminal number to be switched.
  • Step 3020 Generate a switched video code stream according to the screen switching message, and send the switched video code stream to the first video conference terminal, so that the first video conference terminal performs screen display.
  • the switching video stream is generated according to the switching message, and the MCU sends the switching video stream to the first video conference terminal.
  • the method includes: the MCU sends a video stream of the second video conference terminal to the first video conference terminal, so that the first video conference terminal displays a local picture as a picture of a conference site where the second video conference terminal is located.
  • the screen switching message when the switching screen type is switching small screen, the screen switching message further includes: a display type identified as a display, and a small screen display start position information; the MCU generates a switch after the switching according to the screen switching message.
  • Sending the switched video code stream to the first video conference terminal including: MCU superimposing a small screen of the second video conference terminal to a small screen display of a local screen of the first video conference terminal to start Position, and send the superimposed video stream to the first video conference terminal, so that the first video conference terminal displays the small screen at the small screen display start position of the local screen.
  • the screen switching message when the type of the switching screen is switching small screen, the screen switching message further includes: a display type identified as a canceled display; the MCU generates a switched video code stream according to the screen switching message, The first video conference terminal sends the switched video code stream, including: the MCU stops superimposing the small screen of the second video conference terminal to the small screen display start position of the local screen of the first video conference terminal, and The local screen video code stream of the video conference terminal is sent to the first video conference terminal, so that the first video conference terminal no longer displays the small screen at the small screen display start position of the local screen.
  • the method further includes: after the MCU joins the conference, the MCU sends a conference terminal list to the first video conference terminal.
  • Embodiments 1 and 2 of the present invention provide a new method for screen switching in a video conference.
  • the screen of a conference site is dynamically switched on the video conference terminal side, which can quickly implement screen switching and improve user experience.
  • FIG. 4 is a schematic flowchart of a screen switching method in a video conference provided in Embodiment 3 of the present application. As shown in FIG. 4, the screen switching method includes:
  • Step 4010 After the first video conference terminal joins the conference, the multipoint control unit MCU sends a conference terminal list to the first video conference terminal.
  • a video conference is held. After multiple conference terminals join the conference, the MCU sends a preset video picture to each conference terminal. At the same time, on the MCU side, the MCU sends the conference terminal list to multiple conference terminals; the content of the conference terminal list may include: terminal number and / or terminal name.
  • Step 4020 The first video conference terminal forms its own preset viewing terminal list according to the received conference terminal list.
  • the conference terminal list sent by the MCU is received, and the conference terminal receives the conference terminal list and saves it.
  • the site user presets the terminal list that he wants to watch according to the conference terminal list sent by the MCU, and forms a preset viewing terminal list.
  • the conference terminal list sent by the MCU includes terminal A, terminal B, terminal C, and terminal D. End users who have received the conference terminal list can select the terminal list they want to see from the conference terminal list. Set the list of viewing terminals.
  • the preset viewing terminal list includes terminal A, terminal B, and terminal C.
  • step 4030 if a preset operation is detected, a label of the list of preset viewing terminals is displayed or cancelled on a display screen of the first video conference terminal.
  • it may be preset to display a label of the preset viewing terminal list on the display screen when it is detected that the display screen of the first video conference terminal is clicked, and when it is detected that the display screen of the first video conference terminal is clicked, After the display screen of the first video conference terminal leaves and exceeds a preset time, the label of the preset viewing terminal list is canceled.
  • the display screen on the side of the first video conference terminal may support multi-touch.
  • the label of the preset viewing terminal list can be set to be displayed anywhere on the local screen, for example, it can be set below the display screen; when the display screen of the first video conference terminal is not clicked, the label of the preset viewing terminal list below the screen should be Hidden; when the display is clicked, the preset viewing terminal list is displayed in one or more rows below the display screen, similar to the display layout of the toolbar after the computer display is reduced.
  • the maximum display terminal list label can be set to 25 In this way, the length of each terminal label can be set to 1/25 of the screen length; if the screen is left after clicking, the label of the preset viewing terminal list below the screen should be hidden after a timeout of 10 seconds (s).
  • Step 4040 when the first video conference terminal recognizes the switching operation, the first video conference terminal sends a screen switching message to the multipoint control unit MCU, where the screen switching message includes the type of the switched screen and the number of the second video conference terminal to be switched .
  • the first video conference terminal may switch the video source to be viewed according to the preset viewing terminal list.
  • the terminal wants to switch the video source it sends a screen switching message to the MCU.
  • the content of the screen switching message is used to send the terminal the source video of the specified site to the terminal.
  • the switching picture type includes small picture switching and large picture switching.
  • the large screen switching refers to a request to switch a local screen of a video conference terminal
  • the small screen switching refers to a request to display or cancel the display of a small screen.
  • the switching screen type is a switching large screen; for example, when the tab of the preset viewing terminal list that can be displayed by clicking is set, the switching operation is identified as The local screen is switched.
  • the second video conference terminal to be switched is the video conference terminal corresponding to the clicked label. For example, as shown in FIG. 6, the original first video conference terminal displays an image of terminal A.
  • the image of terminal A displayed by the first video conference terminal is switched to the image of terminal B.
  • the switching operation is a local screen switch when the display screen is tapped and swiped from left to right or right to left, and when swiped from left to right, the second video conference terminal to be switched is
  • the video conference terminal corresponding to the left label of the video conference terminal corresponding to the local picture in the label of the preset viewing terminal list is described; when sliding from right to left, the second video conference terminal to be switched is the preset
  • the video conference terminal corresponding to the label on the right side of the label of the video conference terminal corresponding to the local picture in the label of the viewing terminal list For example, as shown in FIG.
  • the original first video conference terminal displays an image of terminal A.
  • the display screen is tapped and swiped from right to left, the image of terminal A displayed by the first video conference terminal is switched to the image of terminal B. Display it.
  • the switching operation of local screen switching can be set in the conference terminal in advance. The above setting is only an example, and various settings can be made as required. For example, you can also use the remote control to switch operations. When the remote control selects the current screen, use the remote control's front and rear direction buttons, or the remote control to roll the ball, etc. to switch the screen image; You can preview the small screen image of this terminal, trigger the process of switching small screens, and so on.
  • the type of the switching screen is to switch the small screen; the screen switching message further includes: a display type identified as being displayed, and small screen display starting position information.
  • the display types include displaying and canceling display, which respectively indicate displaying a small screen and canceling displaying a small screen.
  • the small screen display start position information refers to the position corresponding to the touched label.
  • the maximum value of the preset viewing terminal list label can be set to 25, and the position of each label is an integer 1/25 of the length of the bottom edge of the screen.
  • the preset tags for viewing the terminal list include: Terminal A, Terminal B, and Terminal C. Assuming that the local screen displays the site screen of Terminal A at this time, when the first terminal tab is touched, the The start position of the screen display is 3 * (1/25) * the length of the bottom edge of the screen.
  • the start position information of the small screen display can be represented by a value of 1 in the screen switching message, and the second video conference terminal number to be switched is terminal A.
  • the switching operation of small screen switching may be set in the conference terminal in advance. For example, when the screen is touched and moved to a label of a preset viewing terminal list, a switching operation is recognized as displaying a small screen.
  • the screen switching message includes a type of switching screen identified as a small screen switching, The number of the second video conference terminal to be switched, the display type to be displayed, and the start position information of the small screen display; the second video conference terminal to be switched is the video conference terminal corresponding to the touched label. It can also be set to detect that the switching operation is canceling the small screen when it is detected that the touch operation on the label disappears.
  • the switching operation is local screen switching
  • the second video conference terminal to be switched is a video conference terminal corresponding to the displayed small screen.
  • Step 4050 After receiving the screen switching message sent by the first video conference terminal, the MCU generates a switched video code stream according to the screen switching message, and sends the switched video code stream to the first video conference terminal.
  • the screen switching message includes: a screen switching type and a second video conference terminal number to be switched; when the screen switching type is a large screen switching, the MCU stops sending the original video conference terminal to the first video conference terminal
  • the local screen video code stream uses the video code stream of the second video conference terminal as the switched video code stream to send to the first video conference terminal.
  • the decoding node of the original screen terminal is notified to stop sending the stream to the coding node of the conference terminal (the first video conference terminal); according to the terminal number (the second video conference terminal number) in the screen switching message ), Notify the decoding node of the second video conference terminal to send the code stream to the encoding node of the conference terminal, and at the same time notify the encoding node of the conference terminal to receive the code stream from the new decoding node.
  • the screen switching message includes a display type in addition to a screen switching type and a second video conference terminal number to be switched.
  • the display type is display or cancel display.
  • the screen switching message further includes: small screen display start position information.
  • the switching screen type is switching small screen and the display type is display, it means that instead of switching the local screen, the small screen is displayed on the local screen.
  • the switching screen type is switching small screen and the display type is display: first, the second video conference terminal image notification node is notified according to the second video conference terminal number in the screen switching message, and the small screen video code stream is sent to On the encoding node of this conference terminal (the first video conference terminal); notify the encoding node of this conference terminal to receive the code stream of the decoding node of the original large picture (the original local picture displayed by the first video conference terminal), and also receive the small stream
  • the coding node of the conference terminal superimposes the small picture on the designated position of the original large picture (small picture display start position)
  • the switching screen type is switching small screen and the display type is canceling display, it means that instead of switching the local screen, displaying the small screen on the local screen is canceled.
  • the switching screen type is switching small screen and the display type is canceled display: First, notify the decoding node of the video conference terminal according to the video conference terminal number in the screen switching message, and stop sending the decoded code stream to the encoding of the conference terminal. Node; the encoding node of the conference terminal stops receiving the code stream of this decoding node, and cancels the superimposition of small pictures.
  • Step 4060 The first video conference terminal receives the switched video code stream sent by the MCU, and performs screen display.
  • the first video conference terminal when the switching picture type is switching a large picture, receives a video stream of the second video conference terminal sent by the MCU, and displays the local picture as the second video conference. Screen of the site where the terminal is located.
  • the first video conference terminal receives a video from the MCU superimposed on the local screen corresponding to the second screen of the second video conference terminal. Code stream, and display the picture corresponding to the video code stream to display the small picture at the small picture display start position of the local picture.
  • the first video conference terminal when the switching picture type is switching small picture and the display type is canceling display, the first video conference terminal only continues to receive the video stream of the local picture sent by the MCU, and corresponds to the video stream. The screen is displayed so that the small screen is no longer displayed at the small screen display start position of the local screen.
  • FIG. 9 is a schematic diagram of a screen switching screen provided in Embodiment 4 of the present application
  • FIG. 10 is a schematic flowchart of a screen switching method provided in Embodiment 4 of the present application.
  • terminal A views the image of terminal B.
  • the image of terminal B displayed by terminal A is switched to the image of terminal C; or when the screen of terminal A is tapped
  • the image of the terminal B displayed by the terminal A is switched to the image of the terminal C.
  • the screen switching process provided in this embodiment is shown in FIG. 10 and includes the following steps.
  • Step S10010 on the display screen of the terminal A, the user clicks the terminal C label at the bottom of the screen or taps the screen from right to left by touching the terminal screen to trigger the terminal A to send a screen switch message to the MCU.
  • the content of the screen switch message includes :
  • the switching screen type is switching large screen, and the number of the video conference terminal to be switched is terminal C.
  • terminal A views the image of terminal B, and the video code stream direction is: terminal B sends its own video code stream to the decoding node of terminal B in the MCU, and the terminal B ’s The decoding node then sends the decoded video code stream to the encoding node of terminal A, and the encoding node of terminal A sends the encoded video code stream to terminal A.
  • Step S10020 after the media management module on the MCU receives the screen switching message, it is parsed that the content of the message is that the large-screen image on terminal A needs to be switched from terminal B to terminal C; the media management module sends a decoding stop message to the decoding of terminal B Node, instructs the decoding node of terminal B to stop sending the decoded code stream to the encoding node of terminal A, and sends a decode send message to the decoding node of terminal C, instructs the decoding node of terminal C to send the decoded code stream of terminal C to the encoding of terminal A node.
  • the decoding node of terminal B after receiving the message, stops sending the decoded code stream to the encoding node of terminal A.
  • step S10030 the media management module on the MCU sends a code receiving message to the coding node of terminal A, and instructs the coding node of terminal A to receive the code stream from the decoding node of terminal C.
  • Step 10040 After receiving the message, the encoding node of the terminal A receives the code stream from the decoding node of the terminal C, and then performs encoding, and sends the encoded code stream to the terminal A.
  • the terminal A after receiving the video stream, the terminal A switches the image of the terminal B displayed by the terminal A to the image of the terminal C.
  • FIG. 11 is a schematic diagram of a screen switching screen provided in Embodiment 5 of the present application
  • FIG. 12 is a schematic flowchart of a screen switching method provided in Embodiment 5 of the present application.
  • the terminal A views the image of the terminal B.
  • the screen of the terminal A is clicked and moved to the label of the terminal C at the bottom of the screen, the small screen of the terminal C is displayed on the label of the terminal C displayed by the terminal A.
  • the screen switching process provided in this embodiment is shown in FIG. 12 and includes the following steps.
  • Step S12010 on the display screen of the terminal A, when the position of the screen in the point is moved to the label of the terminal C at the bottom of the screen, the terminal A is triggered to send a screen switching message to the MCU.
  • the content of the screen switching message includes: switching the screen type to Small screen switching; display type is display; terminal C is the third terminal label, so the small screen display start position information is the label start position of terminal C: 3.
  • the number of the switched video conference terminal is terminal C.
  • terminal A views the image of terminal B
  • the video code stream direction is: terminal B sends its own video code stream to the decoding node of terminal B in the MCU, terminal B The decoding node sends the decoded video stream to the encoding node of terminal A, and the encoding node of terminal A sends the encoded video stream to terminal A.
  • Step S12020 after the media management module on the MCU receives the screen switching message, it is parsed that the content of the message is that the small screen image on terminal A needs to be switched to terminal C; the media management module sends a decoding start message to the decoding node of terminal C, indicating The decoding node of terminal C sends the decoded code stream of terminal C to the encoding node of terminal A.
  • the decoding node of terminal C after receiving the message, sends the decoded code stream to the encoding node of terminal A.
  • Step S12030 the media management module sends an encoding and receiving message to the encoding node of terminal A, instructs the encoding node of terminal A to receive the code stream from the decoding node of terminal C, and the message also indicates that the picture switching type is small picture switching; the size of the encoded picture: The screen size is one-fifth of the entire large screen; position information in the image: 3.
  • Step S12040 after the encoding node of the terminal A receives the message, it receives the code stream from the decoding node of the terminal C, and then compiles a small picture according to the picture switching type in the message, and encodes the position in the picture to encode the code.
  • the subsequent code stream is sent to the terminal A.
  • the terminal A after receiving the video code stream, the terminal A displays the small screen of the terminal C on the large screen displayed by the terminal A.
  • FIG. 13 is a schematic structural diagram of a video conference terminal provided in Embodiment 6 of the present application.
  • the video conference terminal includes: a sending unit configured to send a screen switching message to the multipoint control unit MCU when a switching operation is recognized, where the screen switching message includes a switching screen type and a to-be-switched The second video conference terminal number; the display unit is configured to receive the switched video code stream sent by the MCU and perform screen display.
  • the type of the switching screen is switching a large screen; and the display unit is configured to receive a video of the second video conference terminal sent by the MCU.
  • the code stream displays the local picture as the site picture where the second video conference terminal is located.
  • the type of the switching screen is to switch the small screen;
  • the screen switching message further includes: a display type identified as being displayed, and information on a starting position of the small screen display
  • the display unit is configured to receive a video stream transmitted by the MCU and superimposed a local picture corresponding to the second video conference terminal and display a picture corresponding to the video stream, so that The small screen is displayed at the screen display start position.
  • the type of switching screen is switching a small screen;
  • the screen switching message further includes: a display type identified as a canceled display; and the display unit, It is set to receive the video code stream of the local picture sent by the MCU, and display the picture corresponding to the video code stream, so that the small picture is no longer displayed at the small picture display start position of the local picture.
  • the video conference terminal further includes: a receiving unit configured to receive a list of conference terminals sent by the MCU after the first video conference terminal joins the conference; and a display unit further configured to be based on the conference terminal list A list of preset viewing terminals is formed, and if a preset operation is detected, a label of the list of preset viewing terminals is displayed or canceled on a display screen of the first video conference terminal.
  • FIG. 14 is a schematic structural diagram of an MCU provided in Embodiment 6 of the present application.
  • the MCU includes: a receiving unit configured to receive a picture switching message sent by a first video conference terminal, where the picture switching message includes a switching picture type and a second video conference terminal number to be switched; a switching unit, It is configured to generate a switched video code stream according to the screen switching message, and send the switched video code stream to the first video conference terminal, so that the first video conference terminal performs screen switching.
  • the switching unit in a case where the switching screen type is switching a large screen, is configured to send a video of the second video conference terminal to a first video conference terminal according to the screen switching message. Code stream, so that the first video conference terminal displays the local picture as the site picture where the second video conference terminal is located.
  • the screen switching message further includes: a display type identified as being displayed, and a small screen display starting position information; the switching unit is set to Superimposing a small screen of the second video conference terminal to a small screen display start position of a local screen of the first video conference terminal, and sending the superimposed video code stream to the first video conference terminal so that the first video The conference terminal displays the small screen at the small screen display start position of the local screen.
  • the screen switching message further includes: a display type identified as a canceled display; and the switching unit is configured to stop the second screen
  • the small screen of the video conference terminal is superimposed on the small screen display start position of the local screen of the first video conference terminal, and the local screen video code stream of the first video conference terminal is sent to the first video conference terminal, so that the first video The conference terminal no longer displays the small screen at the small screen display start position of the local screen.
  • the MCU further includes a sending unit configured to send a conference terminal list to the first video conference terminal after the first video conference terminal joins the conference.
  • the functions of the receiving unit and the switching unit may be borne by a media management module and a codec module in the MCU, respectively.
  • a media management module and a codec module in the MCU, respectively.
  • An embodiment of the present application further provides a video conference terminal, which includes a memory, a processor, and a computer program stored on the memory and executable on the processor.
  • the computer program is implemented when the processor is executed by the processor. Any one of the screen switching methods performed by the video conference terminal.
  • An embodiment of the present application further provides a multipoint control unit MCU, including a memory, a processor, and a computer program stored on the memory and executable on the processor, where the computer program is executed by the processor Realize any of the screen switching methods performed by the MCU at any time.
  • a multipoint control unit MCU including a memory, a processor, and a computer program stored on the memory and executable on the processor, where the computer program is executed by the processor Realize any of the screen switching methods performed by the MCU at any time.
  • An embodiment of the present application further provides a computer-readable storage medium.
  • the computer-readable storage medium stores an information processing program, and when the information processing program is executed by a processor, implements any one of the screen switching methods described above.
  • Computer storage medium includes both volatile and nonvolatile implementations in any method or technology used to store information such as computer-readable instructions, data structures, program modules or other data.
  • Computer storage media include, but are not limited to, Random Access Memory (RAM), Read-Only Memory (ROM), Electrically Erasable Programmable Read Only Memory (EEPROM), Flash memory or other memory technology, Compact Disc-Read-Only Memory (CD-ROM), Digital Video Disc (DVD) or other optical disc storage, magnetic box, magnetic tape, disk storage or other magnetic storage A device, or any other medium that can be used to store desired information and can be accessed by a computer.
  • a communication medium typically contains computer-readable instructions, data structures, program modules, or other data in a modulated data signal such as a carrier wave or other transmission mechanism, and may include any information delivery medium .

Abstract

本申请实施例提供了一种视频会议中画面切换方法、终端及MCU，其中的画面切换方法包括：第一视频会议终端在识别到切换操作的情况下，向多点控制单元MCU发送画面切换消息，所述画面切换消息包括切换画面类型、待切换的第二视频会议终端号码；接收MCU发送的切换后的视频码流并进行画面显示。

Description

一种视频会议中画面切换方法、终端及MCU
本申请要求在2018年06月22日提交中国专利局、申请号为201810650092.6的中国专利申请的优先权，该申请的全部内容通过引用结合在本申请中。
技术领域
本申请实施例涉及但不限于视频会议技术领域，例如涉及一种视频会议中画面切换方法、终端及多点控制单元(Multi Control Unit，MCU)。
背景技术
随着视频会议技术的发展，MCU的处理能力越来越强大，出现了通用端口技术(Universal Port，UP)，UP的目的为实现多个会场终端所看不同画面功能，满足不同会场的个性化需求。
视频会议中通常存在两个或以上的会场，MCU把多个会场的画面，根据其不同的视频能力进行解码，再编码，合成目的终端支持的视频能力画面，发送到多个会场。UP提供给每个会场独立的解码和编码，这样MCU可以单独提供给每个会场与其他会场不同的画面，满足多个会场独立的画面需求。
然而在给多个会场终端定制画面的过程中，通常需要在MCU上进行设定多个会场所看的画面，是一种集中式管理，当多个会场使用者想修改自己所看画面时，必须通知会议管理员，来集中统一修改。实际中多个会场都会有此需求，会议管理员很难快速服务所有会场的需求。
发明内容
本申请实施例提供了一种视频会议中画面切换方法，包括：
第一视频会议终端在识别到切换操作的情况下，第一视频会议终端向多点控制单元MCU发送画面切换消息，所述画面切换消息包括切换画面类型和待切换的第二视频会议终端号码；
接收MCU发送的切换后的视频码流并进行画面显示。
本申请实施例还提供了一种视频会议中画面切换方法，包括：
多点控制单元MCU接收第一视频会议终端发送的画面切换消息，所述画面切换消息包括切换画面类型和待切换的第二视频会议终端号码；
根据所述画面切换消息生成切换后的视频码流，向所述第一视频会议终端 发送切换后的视频码流，以便所述第一视频会议终端进行画面显示。
本申请实施例还提供了一种视频会议终端，所述终端包括：
发送单元，设置为在识别到切换操作的情况下，向多点控制单元MCU发送画面切换消息，所述画面切换消息包括切换画面类型和待切换的第二视频会议终端号码；
显示单元，设置为接收MCU发送的切换后的视频码流，并进行画面显示。
本申请实施例还提供了一种多点控制单元MCU，所述MCU包括：
接收单元，设置为接收第一视频会议终端发送的画面切换消息，所述画面切换消息包括切换画面类型和待切换的第二视频会议终端号码；
切换单元，设置为根据所述画面切换消息生成切换后的视频码流，向所述第一视频会议终端发送切换后的视频码流，以便所述第一视频会议终端进行画面显示。
本申请实施例还提供了一种视频会议终端，包括存储器、处理器及存储在所述存储器上并可在所述处理器上运行的计算机程序，所述计算机程序被所述处理器执行时实现上述视频会议终端执行的所述画面切换方法。
本申请实施例还提供了一种多点控制单元MCU，包括存储器、处理器及存储在所述存储器上并可在所述处理器上运行的计算机程序，所述计算机程序被所述处理器执行时实现上述MCU执行的所述画面切换方法。
本申请实施例还提供了一种计算机可读存储介质，所述计算机可读存储介质上存储有信息处理程序，所述信息处理程序被处理器执行时实现上述任一种画面切换方法。
附图说明
附图用来提供对本申请技术方案的理解，并且构成说明书的一部分，与本申请的实施例一起用于解释本申请的技术方案，并不构成对本申请技术方案的限制。
图1-1为传统视频会议中画面切换流程示意图；
图1-2为传统视频会议中画面切换流程示意图；
图2为本申请实施例一提供的视频会议中画面切换方法的流程示意图；
图3为本申请实施例一提供的视频会议中画面切换方法的流程示意图；
图4为本申请实施例三提供的视频会议中画面切换方法的流程示意图；
图5为会议终端列表的屏幕示意图；
图6为当点击终端B的标签时，将第一视频会议终端显示的终端A图像切换为终端B图像的屏幕示意图；
图7为当点击显示屏并从右向左滑动时，将第一视频会议终端显示的终端A图像切换为终端B图像的屏幕示意图；
图8为触摸终端A标签显示小画面图像的屏幕示意图；
图9为本申请实施例四提供的画面切换的屏幕示意图；
图10为本申请实施例四提供的画面切换方法的流程示意图；
图11为本申请实施例五提供的画面切换的屏幕示意图；
图12为本申请实施例五提供的画面切换方法的流程示意图；
图13为本申请实施例六提供的视频会议终端的结构示意图；
图14为本申请实施例六提供的MCU的结构示意图。
具体实施方式
下文中将结合附图对本申请的实施例进行说明。
在附图的流程图示出的步骤可以在诸如一组计算机可执行指令的计算机系统中执行。
在给多个会场终端定制画面的过程中，通常在MCU上进行集中式管理，即当多个会场使用者想修改自己所看画面时，必须通知会议管理员，来集中统一修改。图1-1为传统视频会议中画面切换流程示意图；图1-2为传统视频会议中画面切换流程示意图。初始状态时，终端A观看终端B的图像，终端B的图像数据，经过终端B的解码节点，发送解码后的码流到终端A的编码节点，终端A的编码节点再将终端B的码流编码后发给终端A，如图1-1所示。当会议管理员或终端上的主席控制终端A切换观看终端C的图像时，媒体管理模块命令终端B的解码节点停止发送码流到终端A的编码节点，命令终端C的解码节点发送码流到终端A的编码节点，同时命令终端A的编码节点接收来自终端C的解码节点解码后的码流，终端A的编码节点再将编码后的终端C视频码流发送给终端A，如图1-2所示。如此，当多个会场同时需要切换本地画面时，会议管理员很难快速服务所有会场的需求；并且必须通过会议管理员来进行画面切换， 操作复杂，用户体验不佳。
为此，本申请实施例提供了一种视频会议中画面切换方法、终端及MCU，在视频会议终端侧动态切换会场画面，能够快速实现画面切换，提升了用户体验。
实施例一
图2为本申请实施例一提供的视频会议中画面切换方法的流程示意图。如图2所示，该画面切换方法包括如下步骤。
步骤2010，当第一视频会议终端识别到切换操作时，第一视频会议终端向多点控制单元MCU发送画面切换消息，所述画面切换消息包括切换画面类型、待切换的第二视频会议终端号码。
步骤2020，接收MCU发送的切换后的视频码流并进行画面显示。
在一实施例中，当所述切换操作为本地画面切换时，所述切换画面类型为切换大画面；第一视频会议终端接收MCU发送的切换后的视频码流并进行画面显示，包括：第一视频会议终端接收MCU发送的所述第二视频会议终端的视频码流，将本地画面显示为所述第二视频会议终端所在的会场画面。
在一实施例中，当所述切换操作为显示小画面时，所述切换画面类型为切换小画面；所述画面切换消息还包括：标识为显示的显示类型、小画面显示开始位置信息；第一视频会议终端接收MCU发送的切换后的视频码流并进行画面显示，包括：第一视频会议终端接收MCU发送的叠加了所述第二视频会议终端对应小画面的本地画面的视频码流，并对所述视频码流对应的画面进行显示，以在本地画面的所述小画面显示开始位置信息对应的小画面显示开始位置显示所述小画面，即在本地画面中可以看到，所述小画面显示开始位置信息对应的小画面显示开始位置显示了所述小画面。
在一实施例中，当所述切换操作为取消小画面时，所述切换画面类型为切换小画面；所述画面切换消息还包括：标识为取消显示的显示类型；所述第一视频会议终端接收MCU发送的切换后的视频码流并进行画面显示，包括：第一视频会议终端接收MCU发送的本地画面的视频码流，并对所述视频码流对应的画面进行显示，以在本地画面的所述小画面显示开始位置信息对应的小画面显示开始位置不再显示所述小画面。
在一实施例中，所述方法还包括：第一视频会议终端在入会后，接收MCU发送的会议终端列表；第一视频会议终端根据所述会议终端列表形成预设观看终端列表，并在检测到预设操作的情况下，在所述第一视频会议终端的显示屏上显示或取消显示所述预设观看终端列表的标签。
在一实施例中，当检测到所述第一视频会议终端的显示屏被点击时，第一视频会议终端在所述显示屏上显示所述预设观看终端列表的标签，当检测到点击所述第一视频会议终端的显示屏后离开并超过预设时间后，第一视频会议终端取消显示所述预设观看终端列表的标签。
在一实施例中，当检测到所述显示屏被点击且从左向右或从右向左滑动时，第一视频会议终端识别到切换操作为本地画面切换；当从左向右滑动时，所述待切换的第二视频会议终端为所述预设观看终端列表的标签中本地画面对应的视频会议终端的标签的左侧标签对应的视频会议终端；当从右向左滑动时，所述待切换的第二视频会议终端为所述预设观看终端列表的标签中本地画面对应的视频会议终端的标签的右侧标签对应的视频会议终端。
在一实施例中，当检测到显示的所述预设观看终端列表的标签上的触摸操作时，第一视频会议终端识别到切换操作为显示小画面，当检测到所述标签上的触摸操作消失时，识别切换操作到为取消小画面，所述待切换的第二视频会议终端为所述标签对应的视频会议终端。
在一实施例中，当检测到显示小画面的标签被点击时，第一视频会议终端识别到切换操作为本地画面切换，所述待切换的第二视频会议终端为显示的小画面对应的视频会议终端。
实施例二
图3为本申请实施例一提供的视频会议中画面切换方法的流程示意图。如图3所示，该画面切换方法包括如下步骤。
步骤3010，多点控制单元MCU接收第一视频会议终端发送的画面切换消息，所述画面切换消息包括切换画面类型、待切换的第二视频会议终端号码。
步骤3020，根据所述画面切换消息生成切换后的视频码流，向所述第一视频会议终端发送切换后的视频码流，以便所述第一视频会议终端进行画面显示。
在一实施例中，当所述切换画面类型为切换大画面时，所述根据所述画面切换消息生成切换后的视频码流，MCU向所述第一视频会议终端发送切换后的视频码流，包括：MCU向第一视频会议终端发送所述第二视频会议终端的视频码流，以便第一视频会议终端将本地画面显示为第二视频会议终端所在的会场画面。
在一实施例中，当所述切换画面类型为切换小画面时，所述画面切换消息还包括：标识为显示的显示类型、小画面显示开始位置信息；MCU根据所述画面切换消息生成切换后的视频码流，向所述第一视频会议终端发送切换后的视频码流，包括：MCU将所述第二视频会议终端的小画面叠加到第一视频会议终 端的本地画面的小画面显示开始位置，并将叠加后的视频码流发送给所述第一视频会议终端，以便第一视频会议终端在本地画面的小画面显示开始位置显示所述小画面。
在一实施例中，当所述切换画面类型为切换小画面，所述画面切换消息还包括：标识为取消显示的显示类型；MCU根据所述画面切换消息生成切换后的视频码流，向所述第一视频会议终端发送切换后的视频码流，包括：MCU停止将所述第二视频会议终端的小画面叠加到第一视频会议终端的本地画面的小画面显示开始位置，并将第一视频会议终端的本地画面视频码流发送给所述第一视频会议终端，以便第一视频会议终端在本地画面的小画面显示开始位置不再显示所述小画面。
在一实施例中，所述方法还包括：MCU在所述第一视频会议终端入会后，向所述第一视频会议终端发送会议终端列表。
本发明实施例一、二提供了一种新的视频会议中画面切换方法，在视频会议终端侧动态切换会场画面，能够快速实现画面切换，提升了用户体验。
下面通过两个实施例对实施例一、二提供的技术方案进行说明。
实施例三
图4为本申请实施例三提供的视频会议中画面切换方法的流程示意图。如图4所示，该画面切换方法包括：
步骤4010，第一视频会议终端入会后，多点控制单元MCU向第一视频会议终端发送会议终端列表。
在一实施例中，召开视频会议，多个会议终端入会后，MCU向每个会议终端发送预先设定的视频画面。与此同时，在MCU侧，MCU发送会议终端列表到多个会议终端；会议终端列表的内容可以包括：终端号和/或终端名称。
步骤4020，第一视频会议终端根据接收的会议终端列表形成自己的预设观看终端列表。
在会议终端侧，接收MCU发来的会议终端列表，会议终端接收到会议终端列表后进行保存。会场用户根据MCU发来的会议终端列表，来预设自己想要看的终端列表，形成预设观看终端列表。如图5所示，MCU发送的会议终端列表包括终端A、终端B、终端C、终端D，接收了会议终端列表的终端用户可以在会议终端列表中选择自己想要看的终端列表，即预设观看终端列表。本实施例中，预设观看终端列表包括终端A、终端B、终端C。
步骤4030，在检测到预设操作的情况下，在所述第一视频会议终端的显示 屏上显示或取消显示所述预设观看终端列表的标签。
在一实施例中，可以预先设置为当检测到所述第一视频会议终端的显示屏被点击时，在所述显示屏上显示所述预设观看终端列表的标签，当检测到点击所述第一视频会议终端的显示屏后离开并超过预设时间后，取消显示所述预设观看终端列表的标签。
在一实施例中，第一视频会议终端侧的显示屏可以支持多点触控。预设观看终端列表的标签可以设置显示在本地画面上的任意位置，例如可以设置在显示屏下方；当没有点中第一视频会议终端的显示屏时，屏幕下方的预设观看终端列表标签应该隐藏；当点中显示屏时，在显示屏屏幕下方，按照一行或多行显示预设观看终端列表，类似电脑显示屏缩小后在工具栏的显示布局，最大显示终端列表标签可以设置为25个，如此每个终端标签的长度可以设置为屏幕长度的1/25；如果点中屏幕后离开，超时10秒(s)后屏幕下方的预设观看终端列表的标签应该隐藏。
步骤4040，当第一视频会议终端识别到切换操作时，第一视频会议终端向多点控制单元MCU发送画面切换消息，所述画面切换消息包括切换画面类型、待切换的第二视频会议终端号码。
在一实施例中，在会议召开过程中，第一视频会议终端可以根据预设观看终端列表切换观看的视频源，在终端想要切换视频源的情况下，发送画面切换消息到MCU，MCU根据画面切换消息的内容来给终端发送指定会场视频源画面。
在一实施例中，所述切换画面类型包括小画面切换和大画面切换。所述大画面切换是指请求切换视频会议终端的本地画面，所述小画面切换是指请求显示或取消显示小画面。在一实施例中，当所述切换操作为本地画面切换时，所述切换画面类型为切换大画面；例如，可以设置为点击显示的预设观看终端列表的标签时，识别所述切换操作为本地画面切换，待切换的第二视频会议终端为被点击的标签对应的视频会议终端。例如图6所示，原第一视频会议终端显示的为终端A图像，当点击终端B的标签时，将第一视频会议终端显示的终端A的图像切换为终端B的图像。也可以设置为点击显示屏并从左向右或从右向左滑动时，识别所述切换操作为本地画面切换，当从左向右滑动时，所述待切换的第二视频会议终端为所述预设观看终端列表的标签中本地画面对应的视频会议终端的标签的左侧标签对应的视频会议终端；当从右向左滑动时，所述待切换的第二视频会议终端为所述预设观看终端列表的标签中本地画面对应的视频会议终端的标签的右侧标签对应的视频会议终端。例如图7所示，原第一视频会议终端显示的为终端A的图像，当点击显示屏并从右向左滑动时，将第一 视频会议终端显示的终端A的图像切换为终端B的图像进行显示。本地画面切换的切换操作可以预先设置在会议终端中，上述设置仅为举例，可以根据需要进行多种设置。例如也可以通过遥控器进行切换操作，当遥控器选定当前画面后，使用遥控器的前后方向按键，或者遥控器滚动球等，来切换画面图像；当遥控器选定屏幕下方终端标签时，可预览此终端的小画面图像，触发切换小画面的流程等等。
在一实施例中，当所述切换操作为显示小画面时，所述切换画面类型为切换小画面；所述画面切换消息还包括：标识为显示的显示类型、小画面显示开始位置信息。
在一实施例中，所述显示类型包括显示和取消显示，分别表示显示小画面和取消显示小画面。小画面显示开始位置信息是指被触摸的标签对应的位置，例如，预设观看终端列表的标签的最大值可以设置为25个，每个标签的位置为屏幕底边长度的1/25的整数倍，如图8所示，预设观看终端列表的标签包括：终端A、终端B、终端C，假设此时本地画面显示的为终端A的会场画面，当触摸第1个终端标签时，小画面显示开始位置就是3*(1/25)*屏幕底边长度，小画面显示开始位置信息在画面切换消息中可以用数值表示为1，待切换的第二视频会议终端号码为终端A。
在一实施例中，小画面切换的切换操作可以预先设置在会议终端中。例如，可以设置当点击屏幕后触摸移动到预设观看终端列表的标签上时，识别到切换操作为显示小画面，此时，所述画面切换消息包括标识为小画面切换的切换画面类型、待切换的第二视频会议终端号码、标识为显示的显示类型、小画面显示开始位置信息；所述待切换的第二视频会议终端为触摸的标签对应的视频会议终端。也可以设置当检测到所述标签上的触摸操作消失时，识别到切换操作为取消小画面。还可以设置检测到显示小画面的标签被点击时，识别到切换操作为本地画面切换，所述待切换的第二视频会议终端为显示的小画面对应的视频会议终端。上述设置仅为举例，可以根据需要进行多种设置。
步骤4050，MCU接收到第一视频会议终端发送的所述画面切换消息后，根据所述画面切换消息生成切换后的视频码流，向所述第一视频会议终端发送切换后的视频码流。
在一实施例中，所述画面切换消息包括：切换画面类型、待切换的第二视频会议终端号码；当所述切换画面类型为切换大画面时，MCU停止向第一视频会议终端发送原来的本地画面视频码流，将第二视频会议终端的视频码流作为切换后的视频码流，发送给第一视频会议终端。例如，如果是切换大画面：首先通知原画面终端的解码节点停止发送码流到本会议终端(第一视频会议终端) 的编码节点；根据画面切换消息中的终端号码(第二视频会议终端号码)，通知第二视频会议终端的解码节点发送码流到本会议终端的编码节点，同时通知本会议终端的编码节点从新的解码节点接收码流。
在一实施例中，所述画面切换消息除了包括切换画面类型、待切换的第二视频会议终端号码，还包括显示类型。显示类型为显示或取消显示。当显示类型为显示时，画面切换消息还包括：小画面显示开始位置信息。
当所述切换画面类型为切换小画面，且显示类型为显示时，表示并非切换本地画面而是在本地画面上显示小画面。例如，如果切换画面类型是切换小画面，且显示类型为显示：首先根据画面切换消息中的第二视频会议终端号码，通知第二视频会议终端图像的解码节点，将小画面视频码流发送到本会议终端(第一视频会议终端)的编码节点上；通知本会议终端的编码节点接收原先大画面(原第一视频会议终端显示的本地画面)的解码节点的码流的同时，还接收小画面的解码节点(第二视频会议终端的解码节点)发来的解码后的码流，同时通知本会议终端的编码节点，大小画面码流各自的编码画面信息，包括画面大小信息，画面位置信息；本会议终端的编码节点根据这些信息将小画面叠加在原来大画面的指定位置(小画面显示开始位置)，然后通过MCU的接入节点发送给本会议终端(第一视频会议终端)。
当所述切换画面类型为切换小画面，且显示类型为取消显示时，表示并非切换本地画面而是取消在本地画面上显示小画面。例如，如果切换画面类型是切换小画面，且显示类型为取消显示：首先根据画面切换消息中的视频会议终端号码，通知此视频会议终端的解码节点，停止发送解码码流到本会议终端的编码节点；通过本会议终端的编码节点停止接收此解码节点的码流，同时取消小画面的叠加。
步骤4060，第一视频会议终端接收MCU发送的切换后的视频码流并进行画面显示。
在一实施例中，当所述切换画面类型为切换大画面时，第一视频会议终端接收MCU发送的所述第二视频会议终端的视频码流，将本地画面显示为所述第二视频会议终端所在的会场画面。
在一实施例中，当所述切换画面类型为切换小画面，且显示类型为显示时，第一视频会议终端接收MCU发送的叠加了所述第二视频会议终端对应小画面的本地画面的视频码流，并对视频码流对应的画面进行显示，以在本地画面的小画面显示开始位置显示所述小画面。
在一实施例中，当所述切换画面类型为切换小画面，且显示类型为取消显 示时，第一视频会议终端只继续接收MCU发送的本地画面的视频码流，并对视频码流对应的画面进行显示，以在本地画面的小画面显示开始位置不再显示所述小画面。
上述步骤顺序仅为示例性说明，并不存在固定的前后顺序。
实施例四
图9为本申请实施例四提供的画面切换屏幕示意图，图10为本申请实施例四提供的画面切换方法的流程示意图。
如图9所示，终端A观看终端B的图像，当点击终端A屏幕并从右向左滑动时，将终端A显示的终端B的图像切换为终端C的图像；或者当点击终端A屏幕中显示的终端C的标签时，将终端A显示的终端B的图像切换为终端C的图像。本实施例提供的画面切换流程如图10所示，包括如下步骤。
步骤S10010，在终端A的显示屏上，用户通过终端屏幕触屏方式点击屏幕下方终端C标签或者点击并从右向左滑动屏幕，触发终端A发送画面切换消息到MCU，画面切换消息的内容包括：切换画面类型为切换大画面，待切换的视频会议终端号码为终端C。
在一实施例中，在该步骤之前，召开会议后，终端A观看终端B的图像，视频码流流向为：终端B将自己的视频码流发送给MCU中终端B的解码节点，终端B的解码节点再将解码后的视频码流发送给终端A的编码节点，终端A的编码节点将编码完成的视频码流发送给终端A。
步骤S10020，MCU上媒体管理模块收到画面切换消息后，解析到消息内容为需要将终端A上的大画面图像从终端B切换为终端C；媒体管理模块发送停止解码发送消息到终端B的解码节点，指示终端B的解码节点停止发送解码码流到终端A的编码节点，并发送解码发送消息到终端C的解码节点，指示终端C的解码节点发送终端C的解码码流到终端A的编码节点。
本实施例中，终端B的解码节点收到此消息后，停止发送解码码流到终端A的编码节点。
步骤S10030，MCU上媒体管理模块发送编码接收消息到终端A的编码节点，指示终端A的编码节点从终端C的解码节点接收码流。
步骤10040，终端A的编码节点收到此消息后，就从终端C的解码节点接收码流，然后进行编码，将编码后的码流发送给终端A。
本实施例中，终端A接收到视频码流后，将终端A显示的终端B的图像切换为终端C的图像。
上述步骤顺序仅为示例性说明，并不存在固定的前后顺序。
实施例五
图11为本申请实施例五提供的画面切换屏幕示意图，图12为本申请实施例五提供的画面切换方法的流程示意图。
如图11所示，终端A观看终端B的图像，当点击终端A屏幕并移动到屏幕底边的终端C的标签上时，在终端A显示的终端C的标签上显示终端C的小画面。本实施例提供的画面切换流程如图12所示，包括如下步骤。
步骤S12010，在终端A的显示屏上，当点中屏幕的位置移动到屏幕底边的终端C标签上时，触发终端A发送画面切换消息到MCU，画面切换消息的内容包括：切换画面类型为小画面切换；显示类型为显示；终端C为第3个终端标签，因而小画面显示开始位置信息为终端C的标签开始位置：3。切换的视频会议终端号码为终端C。
在一实施例中，在该步骤前，召开会议后，终端A观看终端B的图像，视频码流流向为：终端B将自己的视频码流发送给MCU中的终端B的解码节点，终端B的解码节点再将解码后的视频码流发送给终端A的编码节点，终端A的编码节点将编码完成的视频码流发送给终端A。
步骤S12020，MCU上媒体管理模块收到画面切换消息后，解析到消息内容为需要将终端A上的小画面图像切换为终端C；媒体管理模块发送开始解码发送消息到终端C的解码节点，指示终端C的解码节点发送终端C的解码码流到终端A的编码节点。
本实施例中，终端C的解码节点收到此消息后，发送解码码流到终端A的编码节点。
步骤S12030，媒体管理模块发送编码接收消息到终端A的编码节点，指示终端A的编码节点从终端C的解码节点接收码流，消息中同时指示画面切换类型为小画面切换；编码画面的大小：画面大小为整个大画面的25分之一；在图像中的位置信息：3。
步骤S12040，终端A的编码节点收到此消息后，就从终端C的解码节点接收码流，然后按照消息中的画面切换类型，编一个小画面，并且在画面中的位置进行编码，将编码后的码流发送给终端A。
本实施例中，终端A收到视频码流后，在终端A显示大画面上显示终端C的小画面。
上述步骤顺序仅为示例性说明，并不存在固定的前后顺序。
实施例六
图13为本申请实施例六提供的视频会议终端的结构示意图。如图13所示，该视频会议终端包括：发送单元，设置为在识别到切换操作的情况下，向多点控制单元MCU发送画面切换消息，所述画面切换消息包括切换画面类型和待切换的第二视频会议终端号码；显示单元，设置为接收MCU发送的切换后的视频码流并进行画面显示。
在一实施例中，在所述切换操作为本地画面切换的情况下，所述切换画面类型为切换大画面；所述显示单元，是设置为接收MCU发送的所述第二视频会议终端的视频码流，将本地画面显示为所述第二视频会议终端所在的会场画面。
在一实施例中，在所述切换操作为显示小画面的情况下，所述切换画面类型为切换小画面；所述画面切换消息还包括：标识为显示的显示类型、小画面显示开始位置信息；所述显示单元，是设置为接收MCU发送的叠加了所述第二视频会议终端对应小画面的本地画面的视频码流，并对视频码流对应的画面进行显示，以在本地画面的小画面显示开始位置显示所述小画面。
在一实施例中，在所述切换操作为取消小画面的情况下，所述切换画面类型为切换小画面；所述画面切换消息还包括：标识为取消显示的显示类型；所述显示单元，是设置为接收MCU发送的本地画面的视频码流，并对视频码流对应的画面进行显示，以在本地画面的小画面显示开始位置不再显示所述小画面。
在一实施例中，所述视频会议终端还包括：接收单元，设置为在所述第一视频会议终端入会后，接收MCU发送的会议终端列表；显示单元，还设置为根据所述会议终端列表形成预设观看终端列表，并在检测到预设操作的情况下，在所述第一视频会议终端的显示屏上显示或取消显示所述预设观看终端列表的标签。
图14为本申请实施例六提供的MCU的结构示意图。如图14所示，该MCU包括：接收单元，设置为接收第一视频会议终端发送的画面切换消息，所述画面切换消息包括切换画面类型和待切换的第二视频会议终端号码；切换单元，设置为根据所述画面切换消息生成切换后的视频码流，向所述第一视频会议终端发送切换后的视频码流，以便所述第一视频会议终端进行画面切换。
在一实施例中，在所述切换画面类型为切换大画面的情况下，所述切换单元，是设置为根据所述画面切换消息向第一视频会议终端发送所述第二视频会议终端的视频码流，以便第一视频会议终端将本地画面显示为第二视频会议终端所在的会场画面。
在一实施例中，在所述切换画面类型为切换小画面的情况下，所述画面切 换消息还包括：标识为显示的显示类型、小画面显示开始位置信息；所述切换单元，是设置为将所述第二视频会议终端的小画面叠加到第一视频会议终端的本地画面的小画面显示开始位置，并将叠加后的视频码流发送给所述第一视频会议终端，以便第一视频会议终端在本地画面的小画面显示开始位置显示所述小画面。
在一实施例中，在所述切换画面类型为切换小画面的情况下，所述画面切换消息还包括：标识为取消显示的显示类型；所述切换单元，是设置为停止将所述第二视频会议终端的小画面叠加到第一视频会议终端的本地画面的小画面显示开始位置，并将第一视频会议终端的本地画面视频码流发送给所述第一视频会议终端，以便第一视频会议终端在本地画面的小画面显示开始位置不再显示所述小画面。
在一实施例中，所述MCU还包括，发送单元，设置为在所述第一视频会议终端入会后，向所述第一视频会议终端发送会议终端列表。
在一实施例中，上述接收单元和切换单元的功能可以由MCU中的媒体管理模块、编解码模块分别承担，具体参见实施例四、五的内容。
本申请实施例还提供了一种视频会议终端，包括存储器、处理器及存储在所述存储器上并可在所述处理器上运行的计算机程序，所述计算机程序被所述处理器执行时实现上述视频会议终端执行的任一所述的画面切换方法。
本申请实施例还提供了一种多点控制单元MCU，包括存储器、处理器及存储在所述存储器上并可在所述处理器上运行的计算机程序，所述计算机程序被所述处理器执行时实现上述MCU执行的任一所述的画面切换方法。
本申请实施例还提供了一种计算机可读存储介质，所述计算机可读存储介质上存储有信息处理程序，所述信息处理程序被处理器执行时实现上述任一所述的画面切换方法。
本领域普通技术人员可以理解，上文中所公开方法中的全部或某些步骤、系统、装置中的功能模块/单元可以被实施为软件、固件、硬件及其适当的组合。在硬件实施方式中，在以上描述中提及的功能模块/单元之间的划分不一定对应于物理组件的划分；例如，一个物理组件可以具有多个功能，或者一个功能或步骤可以由多个物理组件合作执行。某些组件或所有组件可以被实施为由处理器，如数字信号处理器或微处理器执行的软件，或者被实施为硬件，或者被实施为集成电路，如专用集成电路。这样的软件可以分布在计算机可读介质上，计算机可读介质可以包括计算机存储介质(或非暂时性介质)和通信介质(或暂时性介质)。如本领域普通技术人员公知的，术语计算机存储介质包括在用 于存储信息(诸如计算机可读指令、数据结构、程序模块或其他数据)的任何方法或技术中实施的易失性和非易失性、可移除和不可移除介质。计算机存储介质包括但不限于随机存取存储器(Random Access Memory，RAM)、只读存储器(Read-Only Memory，ROM)、带电可擦可编程只读存储器(Electrically Erasable Programmable read only memory，EEPROM)、闪存或其他存储器技术、光盘只读存储器(Compact Disc Read-Only Memory，CD-ROM)、数字多功能盘(Digital Video Disc，DVD)或其他光盘存储、磁盒、磁带、磁盘存储或其他磁存储装置、或者可以用于存储期望的信息并且可以被计算机访问的任何其他的介质。此外，本领域普通技术人员公知的是，通信介质通常包含计算机可读指令、数据结构、程序模块或者诸如载波或其他传输机制之类的调制数据信号中的其他数据，并且可包括任何信息递送介质。

Claims (15)

  1. 一种视频会议中画面切换方法，包括：
    第一视频会议终端在识别到切换操作的情况下，向多点控制单元MCU发送画面切换消息，所述画面切换消息包括切换画面类型和待切换的第二视频会议终端号码；
    所述第一视频会议终端接收所述MCU发送的切换后的视频码流并进行画面显示。
  2. 根据权利要求1所述的方法，其中，
    在所述切换操作为本地画面切换的情况下，所述切换画面类型为切换大画面；
    所述接收所述MCU发送的切换后的视频码流并进行画面显示，包括：
    接收所述MCU发送的所述第二视频会议终端的视频码流，将本地画面显示为所述第二视频会议终端所在的会场画面。
  3. 根据权利要求1所述的方法，其中，
    在所述切换操作为显示小画面的情况下，所述切换画面类型为切换小画面；所述画面切换消息还包括：标识为显示的显示类型和小画面显示开始位置信息；
    所述接收所述MCU发送的切换后的视频码流并进行画面显示，包括：
    接收所述MCU发送的叠加了所述第二视频会议终端对应小画面的本地画面的视频码流，并对所述视频码流对应的画面进行显示，以在本地画面的所述小画面显示开始位置信息对应的小画面显示开始位置显示所述小画面。
  4. 根据权利要求3所述的方法，其中，
    在所述切换操作为取消小画面的情况下，所述切换画面类型为切换小画面；所述画面切换消息还包括：标识为取消显示的显示类型；
    所述接收所述MCU发送的切换后的视频码流并进行画面显示，包括：
    接收所述MCU发送的本地画面的视频码流，并对所述视频码流对应的画面进行显示，以在本地画面的所述小画面显示开始位置信息对应的小画面显示开始位置不再显示所述小画面。
  5. 根据权利要求2-4任一所述的方法，还包括：
    所述第一视频会议终端在入会后，接收所述MCU发送的会议终端列表；
    所述第一视频会议终端根据所述会议终端列表形成预设观看终端列表，并在检测到预设操作的情况下，在所述第一视频会议终端的显示屏上显示或取消 显示所述预设观看终端列表的标签。
  6. 一种视频会议中画面切换方法，包括：
    多点控制单元MCU接收第一视频会议终端发送的画面切换消息，所述画面切换消息包括切换画面类型和待切换的第二视频会议终端号码；
    所述MCU根据所述画面切换消息生成切换后的视频码流，向所述第一视频会议终端发送切换后的视频码流，以便所述第一视频会议终端进行画面显示。
  7. 根据权利要求6所述的方法，其中，
    在所述切换画面类型为切换大画面的情况下，所述根据所述画面切换消息生成切换后的视频码流，向所述第一视频会议终端发送切换后的视频码流，包括：
    根据所述画面切换消息向所述第一视频会议终端发送所述第二视频会议终端的视频码流，以便所述第一视频会议终端将本地画面显示为第二视频会议终端所在的会场画面。
  8. 根据权利要求6所述的方法，其中，
    在所述切换画面类型为切换小画面的情况下，所述画面切换消息还包括：标识为显示的显示类型和小画面显示开始位置信息；
    所述根据所述画面切换消息生成切换后的视频码流，向所述第一视频会议终端发送切换后的视频码流，包括：
    将所述第二视频会议终端的小画面叠加到所述第一视频会议终端的本地画面的小画面显示开始位置，并将叠加后的视频码流发送给所述第一视频会议终端，以便所述第一视频会议终端在本地画面的小画面显示开始位置显示所述小画面。
  9. 根据权利要求8所述的方法，其中，
    在所述切换画面类型为切换小画面的情况下，所述画面切换消息还包括：标识为取消显示的显示类型；
    所述根据所述画面切换消息生成切换后的视频码流，向所述第一视频会议终端发送切换后的视频码流，包括：
    停止将所述第二视频会议终端的小画面叠加到所述第一视频会议终端的本地画面的小画面显示开始位置，并将所述第一视频会议终端的本地画面视频码流发送给所述第一视频会议终端，以便所述第一视频会议终端在本地画面的小画面显示开始位置不再显示所述小画面。
  10. 根据权利要求6所述的方法，还包括：
    在所述第一视频会议终端入会后，向所述第一视频会议终端发送会议终端列表。
  11. 一种视频会议终端，包括：
    发送单元，设置为在识别到切换操作的情况下，向多点控制单元MCU发送画面切换消息，所述画面切换消息包括切换画面类型和待切换的第二视频会议终端号码；
    显示单元，设置为接收所述MCU发送的切换后的视频码流并进行画面显示。
  12. 一种多点控制单元MCU，包括：
    接收单元，设置为接收第一视频会议终端发送的画面切换消息，所述画面切换消息包括切换画面类型和待切换的第二视频会议终端号码；
    切换单元，设置为根据所述画面切换消息生成切换后的视频码流，向所述第一视频会议终端发送切换后的视频码流，以便所述第一视频会议终端进行画面显示。
  13. 一种视频会议终端，包括存储器、处理器及存储在所述存储器上并可在所述处理器上运行的计算机程序，所述计算机程序被所述处理器执行时实现如权利要求1至5中任一项所述的画面切换方法。
  14. 一种多点控制单元MCU，包括存储器、处理器及存储在所述存储器上并可在所述处理器上运行的计算机程序，所述计算机程序被所述处理器执行时实现如权利要求6至10中任一项所述的画面切换方法。
  15. 一种计算机可读存储介质，存储有信息处理程序，所述信息处理程序被处理器执行时实现如权利要求1至10中任一项所述的画面切换方法。
PCT/CN2019/092468 2018-06-22 2019-06-24 一种视频会议中画面切换方法、终端及mcu WO2019242774A1 (zh)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201810650092.6A CN110636242B (zh) 2018-06-22 2018-06-22 一种视频会议中画面切换方法、终端及mcu
CN201810650092.6 2018-06-22

Publications (1)

Publication Number Publication Date
WO2019242774A1 true WO2019242774A1 (zh) 2019-12-26

Family

ID=68967005

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2019/092468 WO2019242774A1 (zh) 2018-06-22 2019-06-24 一种视频会议中画面切换方法、终端及mcu

Country Status (2)

Country Link
CN (1) CN110636242B (zh)
WO (1) WO2019242774A1 (zh)

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112650464A (zh) * 2021-01-05 2021-04-13 深圳市捷视飞通科技股份有限公司 视频画面显示方法、装置、计算机设备和存储介质
CN115474073A (zh) * 2021-06-11 2022-12-13 上海赛连信息科技有限公司 一种智能切换画面布局的方法和装置

Families Citing this family (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112218031A (zh) * 2020-09-17 2021-01-12 江苏怀业信息技术股份有限公司 视频会议数据的传输方法和系统
CN112380234A (zh) * 2020-11-03 2021-02-19 广州迈聆信息科技有限公司 视频会议的窗口查找、显示方法和装置及视频会议系统
CN116886856B (zh) * 2023-09-08 2023-12-15 湖北华中电力科技开发有限责任公司 基于视频通讯的电力应急会商方法及系统

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6288740B1 (en) * 1998-06-11 2001-09-11 Ezenia! Inc. Method and apparatus for continuous presence conferencing with voice-activated quadrant selection
JP2006216997A (ja) * 2005-02-01 2006-08-17 Yamaguchi Univ 通信機器接続装置、方法、プログラム、記録媒体
CN101534411A (zh) * 2009-04-08 2009-09-16 深圳华为通信技术有限公司 一种基于图像的视讯会议控制方法、终端及系统
CN102082944A (zh) * 2009-11-30 2011-06-01 华为终端有限公司 一种包含远程呈现会场的会议控制方法、装置及系统
CN103873813A (zh) * 2012-12-10 2014-06-18 中兴通讯股份有限公司 一种会议电视多画面切换的方法及系统

Family Cites Families (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN100583985C (zh) * 2007-04-27 2010-01-20 华为技术有限公司 一种在视频业务中实现画面切换的方法、装置及系统
CN101350898A (zh) * 2008-08-29 2009-01-21 深圳华为通信技术有限公司 一种组合画面视频源选择方法及其装置
CN101742221B (zh) * 2009-11-09 2012-06-13 中兴通讯股份有限公司 一种会议电视系统中的多画面合成方法及装置
CN101895718B (zh) * 2010-07-21 2013-10-23 杭州华三通信技术有限公司 视频会议系统多画面广播方法及其装置和系统
CN102750122B (zh) * 2012-06-05 2015-10-21 华为技术有限公司 多画面显示控制方法、装置及系统
CN103051865B (zh) * 2012-12-28 2016-03-30 华为技术有限公司 画面控制的方法及终端、视频会议装置

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6288740B1 (en) * 1998-06-11 2001-09-11 Ezenia! Inc. Method and apparatus for continuous presence conferencing with voice-activated quadrant selection
JP2006216997A (ja) * 2005-02-01 2006-08-17 Yamaguchi Univ 通信機器接続装置、方法、プログラム、記録媒体
CN101534411A (zh) * 2009-04-08 2009-09-16 深圳华为通信技术有限公司 一种基于图像的视讯会议控制方法、终端及系统
CN102082944A (zh) * 2009-11-30 2011-06-01 华为终端有限公司 一种包含远程呈现会场的会议控制方法、装置及系统
CN103873813A (zh) * 2012-12-10 2014-06-18 中兴通讯股份有限公司 一种会议电视多画面切换的方法及系统

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112650464A (zh) * 2021-01-05 2021-04-13 深圳市捷视飞通科技股份有限公司 视频画面显示方法、装置、计算机设备和存储介质
CN112650464B (zh) * 2021-01-05 2024-02-06 深圳市捷视飞通科技股份有限公司 视频画面显示方法、装置、计算机设备和存储介质
CN115474073A (zh) * 2021-06-11 2022-12-13 上海赛连信息科技有限公司 一种智能切换画面布局的方法和装置
CN115474073B (zh) * 2021-06-11 2023-12-12 上海赛连信息科技有限公司 一种智能切换画面布局的方法和装置

Also Published As

Publication number Publication date
CN110636242A (zh) 2019-12-31
CN110636242B (zh) 2023-02-17

Similar Documents

Publication Publication Date Title
WO2019242774A1 (zh) 一种视频会议中画面切换方法、终端及mcu
US9913301B2 (en) Content sharing method and device
US8860776B2 (en) Conference terminal, conference server, conference system and data processing method
KR101716263B1 (ko) 멀티스트림 회의를 위한 미디어 협상 방법, 장치 및 시스템
US9319631B2 (en) External input apparatus, communication terminal, display data sharing system and computer readable information recording medium
RU2637469C2 (ru) Способ, устройство и система осуществления вызовов в видеоконференциях, основанных на унифицированном общении
US10341771B2 (en) Main speaker, sub speaker and system including the same
US10592189B2 (en) Information processing method and information processing apparatus
US9876987B2 (en) Communication terminal, communication method and computer readable information recording medium
WO2010115364A1 (zh) 一种基于图像的视讯会议控制方法、终端及系统
CN103597468A (zh) 用于视频通信系统中改进的交互式内容共享的系统和方法
US9654516B2 (en) Method and device for negotiating media capability
AU2013345759A1 (en) Transmission system and program
WO2014101428A1 (zh) 画面控制的方法及终端、视频会议装置
US20140028778A1 (en) Systems and methods for ad-hoc integration of tablets and phones in video communication systems
JP2015070543A (ja) 伝送端末、伝送方法、及びプログラム
KR20170031444A (ko) 디지털 디바이스 및 상기 디지털 디바이스에서 데이터 처리 방법
US9516071B2 (en) Video conferencing system and associated interaction display method
JP2017142610A (ja) サーバ装置、伝送システム及びプログラム
WO2015129550A1 (ja) 伝送制御システム、伝送システム、伝送制御方法、及び記録媒体
JP6458345B2 (ja) 電子情報連携システム
JP6680323B2 (ja) 情報処理装置、情報処理方法、及びプログラム
CN112104649A (zh) 多媒体交互方法、装置、电子设备、服务器和存储介质
TWI636691B (zh) 視訊畫面智能切換方法及其系統
JP7392383B2 (ja) 伝送端末、通信システム、通信制御方法、及びプログラム

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 19823320

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

32PN Ep: public notification in the ep bulletin as address of the adressee cannot be established

Free format text: NOTING OF LOSS OF RIGHTS PURSUANT TO RULE 112(1) EPC (EPO FORM 1205 DATED 11/05/2021)

122 Ep: pct application non-entry in european phase

Ref document number: 19823320

Country of ref document: EP

Kind code of ref document: A1