WO2014173091A1 - 一种视频会议中会议材料的显示方法及装置 - Google Patents

一种视频会议中会议材料的显示方法及装置 Download PDF

Info

Publication number
WO2014173091A1
WO2014173091A1 PCT/CN2013/085260 CN2013085260W WO2014173091A1 WO 2014173091 A1 WO2014173091 A1 WO 2014173091A1 CN 2013085260 W CN2013085260 W CN 2013085260W WO 2014173091 A1 WO2014173091 A1 WO 2014173091A1
Authority
WO
WIPO (PCT)
Prior art keywords
video image
signal
video
sub
display screen
Prior art date
Application number
PCT/CN2013/085260
Other languages
English (en)
French (fr)
Inventor
周振涛
Original Assignee
华为技术有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 华为技术有限公司 filed Critical 华为技术有限公司
Priority to EP13882946.0A priority Critical patent/EP2961158A4/en
Publication of WO2014173091A1 publication Critical patent/WO2014173091A1/zh
Priority to US14/856,755 priority patent/US9491405B2/en

Links

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00Television systems
    • H04N7/14Systems for two-way working
    • H04N7/15Conference systems
    • H04N7/152Multipoint control units therefor
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F18/00Pattern recognition
    • G06F18/20Analysing
    • G06F18/22Matching criteria, e.g. proximity measures
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00Image analysis
    • G06T7/10Segmentation; Edge detection
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00Image analysis
    • G06T7/70Determining position or orientation of objects or cameras
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00Details of television systems
    • H04N5/222Studio circuitry; Studio devices; Studio equipment
    • H04N5/262Studio circuits, e.g. for mixing, switching-over, change of character of image, other special effects ; Cameras specially adapted for the electronic generation of special effects
    • H04N5/265Mixing
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00Television systems
    • H04N7/14Systems for two-way working
    • H04N7/15Conference systems

Definitions

  • the present invention relates to the field of video communication technologies, and in particular, to a display method and apparatus for conference materials in a video conference. Background technique
  • Video conferencing technology is to collect and digitize the on-site information of the participating parties by video and audio collection equipment, and then perform corresponding compression processing, and then transmit the digital signal to the remote end through the available communication channel/line.
  • the technology of compression, reduction, and reproduction, that is, video conferencing is a conference that integrates video, audio, and data communication.
  • the images and sounds of each venue can be transmitted in real time, so that each venue is logically in a conference, but not physically. within the area.
  • video conferencing is more efficient and cost-effective, and can solve the problem of long-distance communication.
  • FIG. 1A is a schematic structural diagram of a video conference system in the prior art.
  • the video conference system mainly includes an MCU (Multi-Point Control Unit) and a conference terminal.
  • MCU Multi-Point Control Unit
  • each conference site in the video conference system has at least one conference terminal.
  • the structure of the video conference system is specifically as shown in FIG. 1B.
  • Each conference terminal collects the voice and image of each conference site and sends the code to the MCU, and the MCU will process the The sound and image and the conference material are sent to other conference terminals in the video conference, and the other conference terminals decode and output the sound, image and conference materials of the remote conference site to realize remote video communication, wherein the conference material is displayed in two ways: A display screen for displaying multiple desktop materials in a video conferencing system, the main display screen of the display participant is separated from the desktop material display screen displaying the conference material, and each one or several participants share a desktop material display. Screen, as shown in FIG. 1C, the main function of the desktop material display screen is to demonstrate various electronic materials in the remote conference;
  • the other is to have a material display screen in the video conference system.
  • the main display screen of the participant is separated from the material display screen for displaying the conference material. All participants of a conference site share a material display screen. As shown in FIG. 1D, the main function of the material display screen is to demonstrate various electronic materials in the conference.
  • the system for implementing the video conference needs a main display screen for displaying the participant and at least one material display screen for displaying the conference material, and the main display screen is separated from the material display screen, During the implementation process, the two devices need to be separately operated. Because the two display screen devices are separated, the video conference system is difficult to move, and the flexibility is poor. In addition, since the two display screen devices are often placed in different positions in the conference site, The connection between them is complicated and complicated, and there are restrictions on the layout of the venue or the connection failure. Therefore, the maintenance requirements are high. At the same time, since the presenter and the conference materials are not on one screen, it is necessary to pay attention to the lecture at the same time. For people and other participants in the conference materials, the visual needs to be transferred between the presenter and the conference materials in a wide range, the conference is less efficient and affects the user experience. Summary of the invention
  • the embodiment of the invention provides a method for displaying a conference material in a remote conference, which is used to solve the problem that the video conference system in the prior art is difficult to move, has poor flexibility, high maintenance cost, and low conference efficiency.
  • a method for displaying a conference material in a video conference including:
  • the video data signal is combined into a video encoded signal, and includes: combining the video image signal of the first designated user, the at least one second designated user, and the video data signal of the conference material into a video encoded signal.
  • the first possible implementation manner of the first aspect when the location coordinates of the specified user in the site are determined, the specified user is determined to be in the conference site by using the voice recognition technology. Position coordinates; or, based on the position locator, determine the position coordinates of the specified user in the venue.
  • the video image signal of the site is cut according to the position coordinate, and the video image signal of the specified user is obtained, and the location is The coordinates are matched with the spatial position coordinates of the video image signal of the site, and the position of the video image signal of the specified user in the video image signal of the site is obtained; the video image signal at the position is determined by the face recognition technology. Specifying a video image of the user; cutting a video image signal of the site at a preset distance from the image of the specified user, and acquiring a video image signal of the specified user.
  • a method for displaying a conference material in a video conference including:
  • a video image signal of at least one second designated user that is sent by another site and is in the same site as the first designated user is received; where Combining the video image signal of the first designated user with the video data signal of the conference material to synthesize a video encoded signal, comprising: respectively receiving the video image signal of the first designated user, the at least one second The video image signal of the specified user and the video data signal of the conference material are combined to form a video encoded signal.
  • a method for displaying a conference material in a video conference including:
  • the obtained video coded signal further includes at least one video image signal of the second designated user, and the at least one second designated user to be decoded The video image is displayed in the other at least one cut sub-display screen.
  • the decoded The video image of the conference material is displayed in adjacent at least two of the cut sub-display screens in any one of the display screens.
  • the decoded video image of the specified user is displayed on the at least one cutting in the any one of the display screens.
  • the decoded sub-display screen of each of the specified user's video images is respectively cut in any one of the any one of the display screens. Displaying in the screen; or, displaying the decoded video images of at least two specified users in a sub-display screen obtained by cutting any one of the any one of the display screens.
  • the video image of the conference material is displayed in the sub-display screen obtained by cutting at least one of the any one of the display screens, and the video image of the first designated user is displayed
  • the video image of the first designated user is displayed
  • the video image of the conference material is displayed in the sub-display screen obtained by cutting at least one of the any one of the display screens, and the video image of the first designated user is displayed
  • the video image of the first designated user is displayed
  • the first possible implementation manner of the third aspect in a fifth possible implementation manner, when the role of one of the second designated users is changed to the role of the first designated user, Changing at least one sub-display screen adjacent to the sub-display screen of the video image of the second designated user of the character; at least one sub-display screen of the video image of the conference material originally displayed, and at least one of the determined The video images in the sub display screen are exchanged for display.
  • the first possible implementation manner of the third aspect in a sixth possible implementation manner, when a second designated user speaks, determining a sub-display screen of the video image of the conference material At least one sub-display screen adjacent to the sub-display screen displaying the video image of the first designated user; the video image in the sub-display screen of the video image of the second designated user who originally displayed the speech, Exchanging display with the video image in the determined at least one sub-display screen.
  • the fourth aspect provides a display device for meeting materials in a video conference, including:
  • a determining unit configured to determine a position coordinate of the first designated user in the conference site
  • An image signal acquiring unit configured to collect a video image signal of the site, and cut a video image signal of the site according to a position coordinate determined by the determining unit, to acquire a video image signal of the first designated user, And obtaining a video data signal of the displayed conference material;
  • a communication unit configured to acquire a video image of the first designated user acquired by the image signal acquiring unit After the video data signals of the signal and the conference material are combined into one video coded signal, they are sent to other sites for signal decoding and displayed on the same display screen of the other sites.
  • the determining unit is further configured to determine location coordinates of the at least one second designated user that is in the same site as the first designated user in the site;
  • the image signal acquiring unit is further configured to cut the video image signal of the site according to the position coordinates of the at least one second designated user determined by the determining unit, and acquire the video image signals of each of the second designated users respectively ;
  • the communication unit is specifically configured to synthesize the video image signal of the first designated user, the at least one second designated user, and the video data signal of the conference material respectively acquired by the image signal acquiring unit into one video coding After the signal is sent to other sites for signal decoding and display on the same display screen of the other sites.
  • the determining unit is specifically configured to determine a location coordinate of the specified user in the conference site by using a listening and sound discriminating technique Or, based on the position locator, determine the position coordinates of the specified user in the venue.
  • the image signal acquiring unit is specifically configured to use the position coordinate and the spatial position coordinate of the video image signal of the site Performing a match to obtain a position of a video image signal of the specified user in the video image signal of the site; and determining a video image of the specified user by using a face recognition technology for the video image signal at the location; And cutting a video image signal of the site at a preset distance from the image of the specified user, and acquiring a video image signal of the specified user.
  • a conference terminal including:
  • An image signal processor configured to determine a position coordinate of the first designated user in the conference site, collect a video image signal of the site, and cut a video image signal of the site according to the location coordinate to obtain the first designation a video image signal of the user, and a video data signal for obtaining the displayed conference material;
  • An image signal multiplexer for capturing a video image of the first designated user acquired by the image signal processor
  • the video data signal of the image signal and the conference material is combined to form a video coded signal;
  • the signal transceiver is configured to send a video coded signal synthesized by the image signal multiplexer to other sites for signal decoding, and at the other venues Displayed on the same display screen.
  • the image signal processor is further configured to determine a location of the at least one second designated user in the same site as the first designated user in the site a coordinate image, and cutting a video image signal of the site according to the determined position coordinates of the at least one second designated user, respectively acquiring video image signals of each of the second designated users;
  • the image signal multiplexer is specifically configured to synthesize the first specified user, the video image signal of the at least one second designated user, and the video data signal of the conference material respectively acquired by the image signal processor into one video Coded signal.
  • the image signal processor is specifically configured to determine a specified user in the conference site by using a voice recognition technology Position coordinates; or, based on the position locator, determine the position coordinates of the specified user in the venue.
  • the image signal processor is specifically configured to use the position coordinate and the spatial position coordinate of the video image signal of the site Performing a match to obtain a position of a video image signal of the specified user in the video image signal of the site; and determining a video image of the specified user by using a face recognition technology for the video image signal at the location; And cutting a video image signal of the site at a preset distance from the image of the specified user, and acquiring a video image signal of the specified user.
  • a sixth aspect provides a display device for meeting materials in a video conference, including:
  • a communication unit configured to receive a video image signal of a first designated user and a video data signal of the conference material sent by another site, and receive the received video image signal of the first designated user and the video data signal of the conference material Synthesizing a video encoded signal;
  • a rendering unit configured to decode the video encoded signal synthesized by the communication unit, and display the same on the same display screen of the site.
  • the communication unit is further configured to receive a video of at least one second designated user that is sent by another site and is in the same site as the first designated user. An image signal, and synthesizing the received video image signal of the at least one second designated user into the synthesized video encoded signal.
  • a conference terminal including:
  • a signal transceiver configured to receive a video image signal of a first designated user and a video data signal of a conference material sent by another site;
  • An image signal multiplexer configured to synthesize a video image signal of the first designated user and a video data signal of the conference material received by the signal transceiver into a video encoded signal; and a display for the image signal
  • the video encoded signal synthesized by the multiplexer is decoded and displayed on the same display screen of the site.
  • the signal transceiver is further configured to receive, by another site, at least one second designated user that is in the same site as the first designated user.
  • Video image signal ;
  • the image signal multiplexer is specifically configured to respectively synthesize a video signal signal of the first designated user, the at least one second designated user, and the video data signal of the conference material received by the signal transceiver into a video encoded signal.
  • the eighth aspect provides a display device for meeting materials in a video conference, including:
  • a signal decoding unit configured to obtain a video encoded signal that combines a video image signal of a first designated user and a video data signal of a conference material, and decodes the obtained video encoded signal
  • a screen cutting unit configured to Any one of the display screens is virtually cut into a preset number of sub-display screens
  • a presentation unit configured to display a video image of the conference material obtained by decoding the signal decoding unit in at least one sub-display screen cut by the screen cutting unit, and decode the signal decoding unit A video image of a specified user is displayed in at least one other sub-display screen cut by the screen cutting unit.
  • the signal decoding unit obtains The video encoding signal further includes a video image signal of the at least one second designated user; the rendering unit is further configured to cut the video image of the at least one second designated user obtained by decoding the signal decoding unit on the screen The at least one other sub-display screen obtained by the unit cutting is displayed.
  • the presenting unit is specifically configured to: at least two adjacent ones of the video image of the conference material decoded by the signal decoding unit are cut by the screen cutting unit Displayed in the sub display screen.
  • the presenting unit is specifically configured to separately decode, by using the signal decoding unit, a video image of each specified user.
  • the screen cutting unit is cut into any sub-display screen for display; or the video images of at least two specified users obtained by decoding the signal decoding unit are cut in the screen cutting unit to obtain any sub-display screen for display. .
  • the presenting unit is specifically configured to: display, by using any one of the sub-display screens cut by the screen cutting unit, the first decoded by the signal decoding unit Specifying a video image of the user; displaying a video image of the conference material decoded by the signal decoding unit in a sub-display screen adjacent to the selected sub-display screen and close to the central area of the display screen.
  • the presenting unit is further configured to: when a role of a second designated user is changed to a role of the first designated user, Determining at least one sub-display screen adjacent to the sub-display screen of the video image of the second designated user displaying the changed character; and displaying the video image in the at least one sub-display screen of the video image in which the conference material is originally displayed, The determined video images in the at least one sub-display screen are exchanged for display.
  • the presentation unit is further configured to: when a second designated user speaks, determine and display a video image of the conference material Sub-displays at least one sub-display screen adjacent to the screen and different from the sub-display screen displaying the video image of the first designated user; the second designation in which the speech is originally displayed The video image in the sub-display screen of the user's video image is displayed in exchange with the determined video image in the at least one sub-display screen.
  • a conference terminal including:
  • a signal transceiver configured to obtain a video encoded signal that combines a video image signal of the first designated user and a video data signal of the conference material
  • a signal decoder configured to decode a video encoded signal obtained by the signal transceiver; a processor, configured to virtually cut any one of the display screens of the venue into a preset number of sub-display screens, and the signal a video image of the conference material decoded by the decoder is displayed in the at least one sub-display screen obtained by cutting, and the video image of the first designated user obtained by decoding the signal decoder is at least one other sub-process obtained by cutting Displayed on the display screen.
  • the video coded signal obtained by the signal transceiver further includes at least one video image signal of the second designated user;
  • the processor is further configured to display the video image of the at least one second designated user obtained by decoding the signal decoder in at least one other sub-display screen cut by the processor.
  • the processor is specifically configured to: at least two adjacent sub-display screens obtained by cutting a video image of the conference material obtained by decoding the signal decoder Displayed in the middle.
  • the processor is specifically configured to cut a video image of each specified user that is decoded by the signal decoder The display is performed in any one of the sub-display screens; or the video images of the at least two specified users obtained by decoding the signal decoder are displayed in any one of the sub-display screens.
  • the processor is specifically configured to: display, by using any one of the sub-display screens obtained by the cutting, the decoded by the signal decoder a video image of the first designated user; displaying the signal decoder decoding in a sub-display screen adjacent to the selected sub-display screen and adjacent to the central area of the display screen A resulting video image of the conference material.
  • the processor is further configured to: when a role of a second designated user is changed to a role of the first designated user, Determining at least one sub-display screen adjacent to the sub-display screen of the video image of the second designated user displaying the changed character; and displaying the video image in the at least one sub-display screen of the video image in which the conference material is originally displayed, The determined video images in the at least one sub-display screen are exchanged for display.
  • the processor is further configured to: when a second designated user speaks, determine and display a video image of the conference material Sub-displays at least one sub-display screen adjacent to the screen and different from the sub-display screen displaying the video image of the first designated user; the sub-display screen of the video image of the second designated user who originally displayed the speech The video image is displayed in exchange with the determined video image in at least one of the sub display screens.
  • One of the first is to determine the position coordinates of the first designated user in the site, and then collect the video image signal of the site, and cut the video image signal of the site according to the position coordinate to obtain the video image signal of the first designated user, and then Obtaining a video data signal of the displayed conference material, and synthesizing the video image signal of the first designated user and the video data signal of the conference material into one video encoding signal, and transmitting the signal to the other site for signal decoding and the same display screen of the other site Displaying, in this scheme, by acquiring the obtained video image signal of the first designated user and the video data signal of the conference material, and then transmitting to other sites, and performing in the same display screen of other sites.
  • the other is that after receiving the video image signal of the first designated user and the video data signal of the conference material sent by the other site, the received video image signal of the first designated user and the video data signal of the conference material are combined into one video coding.
  • the signal is decoded on the same display screen of the site after decoding the synthesized video encoded signal.
  • the conference passes the video image signal of the first designated user and the video data signal of the conference material.
  • Performing one-way encoding and displaying in the same display screen of the site realizing the effect that the video image of the first designated user and the video image of the meeting material are displayed on the same display screen in the same site, since only one display is needed
  • the screen displays the conference material and the first designated user at the same time, and does not need to display the conference material and the first designated user separately by using two display screens, thereby effectively avoiding the video conference system being difficult to move due to a large number of screens, and the cost is high.
  • Another method is: obtaining a video encoding signal that combines a video image signal of a first designated user and a video data signal of a conference material; decoding the obtained synthesized video encoding signal, and virtualizing any one of the display screens of the conference site Cutting into a preset number of sub-display screens; displaying the decoded video image of the conference material in at least one of the cut sub-display screens, and decoding the decoded video image of the first designated user in at least one of the other cuts The display is displayed in the sub-display screen.
  • the site obtains a video encoding signal that combines the video image signal of the first designated user and the video data signal of the conference material, and then virtually cuts any display screen of the venue into a preset number of sub-display screens, and displaying the decoded video image of the conference material in at least one of the cut sub-display screens, and decoding the decoded video image of the first designated user in at least one of the other cut sub-pictures Display in the display screen, realized
  • FIG. 1A is a schematic diagram of a first structure of a video conference system in the prior art
  • 1B is a schematic diagram showing a second structure of a video conference system in the prior art
  • 1C is a first schematic diagram showing a conference material in a video conference in the prior art
  • 1D is a second schematic diagram of a conference material in a video conference in the prior art
  • FIG. 2A is a first detailed flowchart of a conference material display in a video conference according to an embodiment of the present invention
  • FIG. 2B is a second detailed flowchart of a conference material display in a video conference according to an embodiment of the present invention
  • the third detailed flowchart of the conference material display in the video conference
  • FIG. 3A is a third schematic diagram of the conference material display in the video conference according to the embodiment of the present invention
  • FIG. 3B is the fourth conference material display in the video conference according to the embodiment of the present invention
  • FIG. 3 is a fifth schematic diagram of a conference material display in a video conference according to an embodiment of the present invention
  • FIG. 4A is a sixth schematic diagram showing a conference material display in a video conference according to an embodiment of the present invention.
  • the seventh schematic diagram of the conference material display in the video conference is an eighth schematic diagram of the conference material display in the video conference according to the embodiment of the present invention
  • FIG. 5A is a ninth schematic diagram of the conference material display in the video conference according to the embodiment of the present invention
  • FIG. 5B is a tenth schematic diagram of a conference material display in a video conference according to an embodiment of the present invention
  • FIG. 6A is a conference material in a video conference according to an embodiment of the present invention
  • FIG. 6B is a twelfth schematic diagram showing the display of the conference material in the video conference according to the embodiment of the present invention
  • FIG. 6C is a thirteenth schematic diagram showing the conference material display in the video conference according to the embodiment of the present invention.
  • the fourth detailed flowchart of the conference material display in the video conference in the embodiment of the present invention is a schematic diagram of the first display device for displaying the conference material in the video conference according to the embodiment of the present invention.
  • FIG. 8B is a schematic diagram of a first conference terminal for displaying conference materials in a video conference according to an embodiment of the present invention.
  • FIG. 9A is a schematic diagram of a second display device for displaying conference materials in a video conference according to an embodiment of the present invention.
  • FIG. 9B is a schematic diagram of a second conference terminal for displaying conference materials in a video conference according to an embodiment of the present invention.
  • FIG. 10A is a schematic diagram of a third display device for displaying conference materials in a video conference according to an embodiment of the present invention.
  • FIG. 10B is a schematic diagram of a third conference terminal for displaying conference materials in a video conference according to an embodiment of the present invention. detailed description
  • the embodiment of the present invention In order to solve the problem that the video conferencing system in the prior art is difficult to move, the flexibility is poor, the maintenance cost is high, and the conference efficiency is low, in the embodiment of the present invention, three display methods of the conference material in the remote conference are proposed. It can effectively avoid the problem that the video conference system is difficult to move due to the large number of screens, and the cost is high and the flexibility is poor. At the same time, since the participants pay attention to the conference materials and the first designated user at the same time, it is not necessary to display the conference materials. The video image is visually transferred between the two display screens displaying the video image of the first designated user, thereby improving the efficiency of the video conference and improving the user experience.
  • the first detailed process of displaying the conference material in the video conference is as follows:
  • Embodiment 1 is a diagrammatic representation of Embodiment 1:
  • Step 20 Determine the position coordinates of the first specified user in the site.
  • the positional coordinates of the first designated user in the conference site are determined by using the listening and sound discriminating technique, for example, Obtaining a sound signal of the venue by using a sound signal collector respectively set at different positions of the conference site, and calculating a spatial position of the signal source that emits the sound signal according to the sound signal with the highest intensity collected by the conference; or, by positioning The device determines the position coordinates of the first designated user in the conference site.
  • the positioning by the position locator is a relatively mature technology in the prior art, and is no longer detailed here.
  • Step 21 The video image signal of the conference site is collected, and the video image signal of the conference site is cut according to the position coordinate, the video image signal of the first designated user is obtained, and the video data signal of the displayed conference material is obtained.
  • the video image signal of the site is collected, and the video image signal of the site is cut according to the position coordinate, and the video image signal of the first designated user is obtained in various ways.
  • the position is first The coordinates are matched with the spatial position coordinates of the video image signal, and the position of the video image signal of the first designated user in the video image signal of the site is obtained, and the video image signal at the position is determined by the face recognition technology to determine the first designated user.
  • the video image is then cut at a preset distance from the video image of the first designated user to obtain a video image signal of the first designated user.
  • the video image signals of the plurality of second designated users that are in the same site as the first designated user may also be used. Displaying on the display screen of the other site, for example, determining the position coordinates of the plurality of second designated users in the site; and then performing video image signals of the site according to the determined position coordinates of the plurality of second designated users.
  • Step 22 The video image signal of the first designated user and the video data signal of the conference material are combined into one video encoded signal, and then sent to other sites for signal decoding and displayed on the same display screen of other sites.
  • the video data signal of the conference material and the video image signal of the first designated user are encoded by one video coding method, and are sent to the same display screen of other conference sites for presentation, thereby meeting the conference material and the first
  • the purpose of a specified user (for example, a presenter) being presented on the same screen avoids the presentation of the conference material and the first designated user in different display screens of the same venue, and the resulting video conference system is difficult to move and has flexibility.
  • FIG. 2B a detailed process of displaying a conference material in a video conference is also proposed, as shown in FIG. 2B.
  • Embodiment 2 is a diagrammatic representation of Embodiment 1:
  • Step 200 Receive a video image signal of a first designated user and a video data signal of a conference material sent by another site.
  • Step 210 Synthesize the received video image signal of the first designated user and the video data signal of the conference material into one video encoding signal.
  • Step 220 Decode the synthesized video encoded signal and display it on the same display screen of the site.
  • the video of the plurality of second designated users sent by the other site in the same site as the first designated user may also be received.
  • the image signal has a plurality of processing manners for receiving the video image signals of the plurality of second designated users, and preferably, the received video image signals of the first designated user and the video image signals of the second designated user are respectively And the video data signal of the conference material is combined into one video coded signal.
  • the video data signal of the received conference material and the video image signal of the first designated user are encoded by using one video coding mode, and are presented in the same display screen of the conference, and the conference is reached.
  • the purpose of the material and the first designated user (for example, the presenter) being presented on the same screen avoids the difference between the meeting material and the first designated user at the same venue.
  • Presented in the screen resulting in a video conferencing system that is difficult to move, less flexible, and more expensive to maintain, while avoiding the need for simultaneous attention to meeting materials and other participants of the first designated user in the video conference
  • the visual shift between the display screen presenting the conference material and the display screen presenting the first designated user improves the conference efficiency and the user experience.
  • FIG. 2C a detailed process of displaying the conference material in the video conference is further provided, as shown in FIG. 2C:
  • Embodiment 3 is a diagrammatic representation of Embodiment 3
  • Step 2000 Obtain a video encoding signal that combines the video image signal of the first designated user and the video data signal of the conference material.
  • the obtained one-way video encoded signal may further include at least one video image signal of the second designated user while including the video image signal of the first designated user.
  • Step 2100 Decode the obtained one-way video encoded signal, and virtually cut any one of the display screens of the site into a preset number of sub-display screens.
  • Step 2200 Display the decoded video image of the conference material in the at least one cut sub-display screen, and perform the decoded video image of the first designated user in the other at least one cut sub-display screen. display.
  • the obtained one-way video encoded signal may further include at least one video image signal of the second designated user, and at least one of the decoded video signals, including the video image signal of the first designated user.
  • the display may be performed in at least one of the other sub-display screens that are different from the display of the conference material, that is, the sub-display screen of the video image of the second designated user is displayed and the conference is displayed.
  • the sub-display screen of the video image of the material may be the same or different from the sub-display screen displaying the video image of the first designated user.
  • the decoded video image of the conference material in at least one of the cut display sub-display screens.
  • the decoded conference material is to be decoded.
  • Video images in adjacent ones of the above display screens At least two of the cut sub-display screens are displayed.
  • the first designated user is the presenter A
  • the site where A is located is the first site B1
  • B1 sends the video image signal of A and the video data signal of the conference material to the second conference site B2.
  • B2 virtually cuts the display screen C of the venue into 6 sub-display screens, numbers from left to right, and selects two sub-screens numbered 2 and 3 to video data signals of the conference material.
  • the codec is performed, as shown in FIG. 3A, in actual application, two sub-screens numbered 1, 2 may be selected for presentation, or two sub-screens numbered 3 and 4 may be selected for presentation. Further details will be given.
  • the decoded video image of the specified user in the other at least one cut sub-display screen in any one of the above display screens for example, each designated user to be decoded.
  • the video images are respectively displayed in a cut sub-display screen in any one of the above display screens; or, the decoded video of the at least two specified users in one of the above display screens Displayed on the display screen.
  • the display screen of the venue is virtually cut into 6 sub-display screens, numbered from left to right, in the video image of the first designated user (first designated user 1), and three second designated users (second designation When the video image of the user 1, the second designated user 2, and the second designated user 3) and the video image of the conference material are displayed in the sub display screen, the sub display screen No. 1, the sub display screen No. 2, and the third sub
  • the display screen, the 4th sub display screen, and the 5th sub display screen respectively display video images of the first designated user 1, the second designated user 1, the second designated user 2, the second designated user 3, and the conference material, and may also be
  • the video image of the first designated user 1 is displayed on the No. 1 sub display screen
  • the video images of the second designated user 1, the second designated user 2, and the second designated user 3 are displayed on the No. 2 sub display screen, and displayed in the No. 3 sub-display.
  • a video image of the meeting material is displayed on the screen.
  • the embodiment of the present invention selecting a sub-display screen in each of the cut sub-display screens to display the first designation obtained by decoding a video image of the user; in the sub-display screen adjacent to the selected sub-display screen and close to the central area of the display screen, the display selection is decoded
  • the video image of the conference material can be implemented as follows: After the display screen of the venue is virtually cut into a preset number of sub-display screens, the sub-display screens are numbered according to a preset order, and the presentation is determined.
  • the adjacent sub-display screen decodes the video data signal of the conference material.
  • the presentation is performed such that the video image of the conference material is adjacent to the video image of the first designated user and presented in a sub-display screen that is adjacent to the central area of the display screen.
  • the first designated user is the presenter A
  • the site where A is located is the first site B1
  • B1 sends the video image signal of A and the video data signal of the conference material to the second conference site B2.
  • B2 firstly cuts the display screen of the venue into 10 sub-display screens, numbers the 10 sub-display screens from left to right, and then determines the sub-display of the first designated user.
  • the number of the screen is 4, since the number of the sub display screen is from left to right, the 4th sub display screen is located on the left side of the display screen, therefore, the adjacent subtitle of the right side of the 4th sub display screen is selected.
  • the display screen (the 5th sub display screen and the 6th sub display screen) decodes the video data signal of the conference material, as shown in FIG. 3B. If the number of the sub-display screen of the first designated user is 7, since the number of the sub-display screen is performed from left to right, the sub-display screen No. 7 is located on the right side of the display screen, therefore, the number 7 is selected.
  • the adjacent sub-display screen on the left side of the display screen decodes the video data signal of the conference material, and as shown in FIG. 3C, realizes the sub-display of the presentation conference material.
  • the screen is adjacent to the sub-display screen that presents the first designated user and is closer to the center of the display screen.
  • the sub-display screen of the first designated user may also change.
  • the sub-display screen of the present presenter is changed from the sub-display screen of No. 2 in FIG. 3A to the sub-display screen of No. 4 in FIG. 3A.
  • the sub-display screen for presenting the conference material is adjacent to the sub-display screen that presents the first designated user, and is located on the side closer to the central area of the display screen, thereby improving the display quality of the presentation conference material.
  • the video images in the display screen are exchanged and displayed, which can be implemented as follows: The display screen is virtually cut into a preset number of sub-display screens, and after the sub-display screens are numbered in a preset order, it is determined that the first designated user position is moved.
  • the sub-display screen displays the adjacent sub-display screens according to the preset order selected by numbering the sub-display screens, so that the adjacent sub-display screens decode the video data signals of the conference materials, and then display A sub-display screen of the video data signal of the conference material is initially presented, and the video image in the determined sub-display screen is presented.
  • the first designated user is the presenter A
  • the site where A is located is the first site B1
  • B1 sends the video image signal of A and the video data signal of the conference material to the second site B2.
  • B2 After receiving the video stream, B2 firstly cuts the display screen of the site into 10 sub-display screens, and numbers the 10 sub-display screens from left to right, wherein the number of the sub-display screens of the first designated user is 7 .
  • the sub-display screens of the present participant 1, the participant 2 and the participant 3 are respectively the sub-display screen No. 2, the sub-display screen No. 3 and the sub-display screen No. 4, and the number of the sub-display screen of the conference material is presented. 5, 6, as shown in FIG.
  • the roles of the first designated user and the second designated user may change, for example, the presenter (the first designated user) becomes the participant, and the second designated user becomes the presenter, in order to ensure the presentation of the meeting.
  • the sub-display screen of the material is adjacent to the sub-display screen that presents the first designated user, and is located on the side of the sub-display screen that presents the first designated user and is close to the central area of the display screen, thereby improving the display quality of the presentation meeting material.
  • At least one sub-display screen adjacent to the sub-display screen of the video image of the second designated user displaying the changed character is determined;
  • the video image in the at least one sub-display screen of the video image originally displayed with the conference material is displayed in exchange with the determined video image in the at least one sub-display screen.
  • the first designated user is A
  • the site where A is located is the first site B1, 2.
  • the designated user is C.
  • B1 sends the video image signal of A and the video data signal of the conference material to the second site B2 by the video stream encoded by one video.
  • B2 After receiving the video stream, B2 first
  • the display screen of the venue is virtually cut into 10 sub-display screens, and 10 sub-display screens are numbered from left to right, wherein the sub-display screen of the presentation A is numbered 7, and the participants 1 and the participants 2 are presented.
  • the sub-display screens of the participants 3 are the 2nd sub-display screen, the 3rd sub-display screen and the 4th sub-display screen, and the sub-display screens of the presentation materials are numbered 5, 6, as shown in FIG. 4A, if now
  • the presenter is changed from A to C, and the sub display screen of C is displayed as the 2nd sub display screen, and the conference material is changed from the sub-page 5 display screen and the 6th sub-display screen to the 3rd sub-display screen and the 4th sub-display screen.
  • the sub-display screen is presented, and the participant 2 and the participant 3 are presented on the 5th sub-display screen and the 6th sub-display screen, as shown in FIG. 4C.
  • the conference material when determining that one of the second designated users speaks, determining and displaying the conference material a sub-display screen adjacent to the sub-display screen displaying the first designated user adjacent to the sub-display screen of the video image, and the video image in the sub-display screen of the video image of the second designated user who originally displayed the speech, and the determination
  • the video image in the sub-display screen adjacent to the sub-display screen of the video image displaying the conference material is exchanged and displayed, which can be implemented as follows: After the display screen is virtually cut into a preset number of sub-display screens, the pair is The display screen is numbered in a preset order, and the number of the sub-display screen of the video image signal of the conference material is determined, and the number of the sub-display screen of the video image signal of the first designated user is presented, and the video data signal of the conference material is presented
  • the first designated user is the presenter A
  • the site where A is located is the first site B1
  • B1 sends the video image signal of A and the video data signal of the conference material to the second site B2.
  • B2 After receiving the video stream, B2 firstly cuts the display screen of the site into 10 sub-display screens, and numbers the 10 sub-display screens from left to right, wherein the number of the sub-display screens of the first designated user is 7.
  • the sub-display screens of the present participant 1 and the participant 2 are respectively displayed on the 4th sub-display screen and the 8th sub-display screen, and the sub-display screen of the conference material is presented. No. 5, 6, as shown in Fig.
  • the participant 2 changes from the display on the 8th sub-display screen to the presentation on the 4th sub-display screen, the participants 1 is displayed on the No. 8 sub display screen, as shown in FIG. 5B.
  • the first designated user may be presented in a variety of manners on the screen.
  • the first designated user may be presented in a highlighted form, or may be presented in an animated form, or may be presented in a specified color.
  • the conference material may be displayed in a specified time period during the video conference, and the conference material is not displayed in other time periods.
  • the conference material is closed. Thereafter, all the video images on one side of the sub display screen of the conference material are presented, and the presentation is performed on the sub display screen whose number is different from the initial sub display screen number of 2.
  • the display screen is virtually divided into six sub-display screens, wherein the conference material is displayed on the sub-display screens No. 3 and No. 4, and the presenter is displayed on the sub-number 2 display screen, and the participants 2 and the participants 3 Participants 4 are displayed on the No. 1 sub-display screen, No. 5 sub-display screen, and No. 6 sub-display screen.
  • the participant 2 and the presenter respectively display the screen from the No. 1 sub-display.
  • the display on the 2nd sub-display screen is changed to display on the 3rd and 4th sub-display screens, and the sub-display screen of the participant 3 and the participant 4 is not changed, as shown in FIG.
  • the member 3 and the participant 4 are respectively displayed from the sub-page 5 display screen and the 6th sub-display screen to be displayed on the 3rd and 4th sub-display screens respectively, presenting the participants of the participant 1 and the presenter.
  • the display screen is not changed, as shown in Figure 6C.
  • the site obtains a video encoding signal that combines the video image signal of the first designated user and the video data signal of the conference material, and then virtually cuts any display screen of the site into a preset number.
  • a sub-display screen and displaying the decoded video image of the conference material in at least one of the cut sub-display screens, and decoding the decoded video image of the first designated user in the other at least one cut sub-display screen Displaying, realizing the effect that the video image of the first designated user and the video image of the conference material are displayed on the same display screen in the same venue, since the conference material and the first designated user are only in one display screen
  • the display of different sub-display screens does not require two display screens to separately display the conference material and the first designated user.
  • the video conference system is difficult to move due to the large number of screens, and the cost is high and the flexibility is poor.
  • the problem since the participant pays attention to the conference material and the first designated user at the same time, there is no need to perform a visual transfer between the video image displaying the conference material and the two display screens displaying the video image of the first designated user, , improve the efficiency of video conferencing, and improve the user experience.
  • the first embodiment and the third embodiment are combined, that is, the sender site performs the composite signal transmission in the manner of the first embodiment, and the receiver site decodes the composite signal in the manner of the third embodiment and displays the signal.
  • the screen is cut into a sub-screen for display;
  • the second embodiment and the third embodiment can be combined, that is, the receiver site receives the signal and synthesizes one way in the second embodiment, and then decodes the synthesized signal, and implements the signal.
  • the third way is to display the display screen into a sub-screen. Any one of the first embodiment, the second embodiment, and the third embodiment can solve the problem that the video conference system in the prior art is difficult to move, has poor flexibility, high maintenance cost, and low conference efficiency.
  • FIG. 7 where A is the main speaker, A is located The venue is the first venue, and the other venue is the second venue:
  • Step 700 Determine the position coordinates of A in the first venue by using the listening and discriminating technique.
  • Step 710 The video image signal of the first site is collected, and the video image signal of the first site is cut according to the position coordinates, and the video image signal of A is obtained.
  • Step 720 Obtain a video data signal of the conference material, and encode the video image signal of the A and the video data signal of the conference material by one video and then send the video data to the second conference site.
  • Step 730 The second site virtually cuts the same display screen of the site into eight sub-display screens.
  • the sub display screens are numbered from left to right.
  • Step 740 The second site determines the number bit 6 of the sub display screen that presents A, and selects the sub-number 4 display screen and the 5th sub-display screen adjacent to the 6th sub-display screen.
  • Step 750 The video image of the conference material is presented on the 4th sub display screen and the 5th sub display screen.
  • Step 760 After determining that the sub display screen of the presentation A is changed from the 6th sub display screen to the 1st sub display screen, the conference material is presented on the 2nd sub display screen and the 3rd sub display screen.
  • the number is located on the 1st.
  • the sub-display screen, the 2nd sub-display screen, and the 3rd sub-display screen participants 1, 2, 3, are displayed on the 4th sub-display screen, the 5th sub-display screen, and the 6th sub-display screen.
  • Step 770 After the participant 2 is determined to be a speaker, the video image of the participant 2 is displayed on the display screen of the number 4, and the video image of the participant 1 is displayed on the display screen of the fifth.
  • an embodiment of the present invention further provides a display device for a conference material in a video conference.
  • the display device includes:
  • a determining unit 80 configured to determine location coordinates of the first designated user in the conference site
  • the image signal acquisition unit 81 is configured to collect the video image signal of the conference site, and cut the video image signal of the site according to the position coordinates determined by the determining unit 80, acquire the video image signal of the first designated user, and obtain the displayed conference material.
  • the communication unit 82 is configured to synthesize the video image signal of the first designated user and the video data signal of the conference material acquired by the image signal acquiring unit 81 into one video encoding signal, and then send the signal to other sites for signal decoding and the same display at other sites. Displayed on the screen.
  • the determining unit 80 is further configured to determine location coordinates of the at least one second designated user in the same site as the first specified user in the conference site; at this time, the image signal acquiring unit 81 is further configured to determine the unit according to the determining unit Determining, by the position coordinates of the at least one second designated user, the video image signals of the site are cut, respectively acquiring video image signals of each second designated user;
  • the communication unit 82 is specifically configured to acquire the first image signal acquiring unit 81 respectively.
  • the video image signal of the specified user, the at least one second designated user, and the video data signal of the conference material are combined into one video encoded signal, and then sent to other sites for signal decoding and displayed on the same display screen of other sites.
  • the determining unit 80 is specifically configured to determine the position coordinates of the specified user in the conference site by using the listening and sound discriminating technique; or determining the position coordinates of the specified user in the conference site based on the position locator.
  • the image signal acquiring unit 81 is specifically configured to match the position coordinates with the spatial position coordinates of the video image signal of the site, and obtain a position of the video image signal of the specified user in the video image signal of the site;
  • the video image signal at the location is determined by the face recognition technology to determine the video image of the specified user; and the video image signal of the site is cut at a preset distance from the image of the specified user to obtain a video image signal of the specified user.
  • the embodiment of the present invention further provides a conference terminal, where the conference terminal includes: an image signal processor 800, configured to determine location coordinates of a first designated user in a conference site, and collect video image signals of the conference site. And cutting the video image signal of the site according to the position coordinate, acquiring a video image signal of the first designated user, and acquiring a video data signal of the displayed conference material; and an image signal multiplexer 810 for acquiring the image signal processor 800 The video image signal of the first designated user and the video data signal of the conference material are combined into one video encoded signal;
  • the signal transceiver 820 is configured to send a video encoded signal synthesized by the image signal multiplexer 810 to other sites for signal decoding, and display on the same display screen of other sites.
  • the image signal processor 800 is further configured to determine location coordinates of the at least one second designated user in the same site as the first designated user, and determine the location of the at least one second specified user.
  • the coordinates of the video image signal of the site are cut, and the video image signals of each second designated user are respectively acquired;
  • the image signal multiplexer 810 is specifically configured to synthesize a video signal signal of the first designated user, the video image signal of the at least one second designated user, and the conference material respectively acquired by the image signal processor 800 into a video encoded signal.
  • the image signal processor 800 is specifically configured to determine the position coordinates of the specified user in the conference site by using the listening and sound discriminating technique; or determining the position of the specified user in the conference site based on the position locator Coordinates.
  • the image signal processor 800 is specifically configured to match the position coordinates with the spatial position coordinates of the video image signal of the site, and obtain the position of the video image signal of the specified user in the video image signal of the site;
  • the video image signal at the location is determined by the face recognition technology to determine the video image of the specified user; and the video image signal of the site is cut at a preset distance from the image of the specified user to obtain a video image signal of the specified user.
  • an embodiment of the present invention further provides a display device for a conference material in a video conference.
  • the display device includes:
  • the communication unit 90 is configured to receive the video image signal of the first designated user and the video data signal of the conference material sent by the other site, and synthesize the received video image signal of the first designated user and the video data signal of the conference material into one video. Coded signal
  • the presentation unit 91 is configured to decode the video encoded signal synthesized by the communication unit 90 and display it on the same display screen of the site.
  • the communication unit 90 is further configured to receive a video image signal of at least one second designated user that is sent by another site and is in the same site as the first designated user, and that is to receive the received at least one second designated user.
  • the video image signal is synthesized into a synthesized video encoded signal.
  • the embodiment of the present invention further provides a conference terminal, where the conference terminal includes: a signal transceiver 900, configured to receive a video image signal of a first designated user and a video data signal of a conference material sent by another conference site;
  • the image signal multiplexer 910 is configured to synthesize the video image signal of the first specified user and the video data signal of the conference material received by the signal transceiver 900 into a video encoded signal;
  • the display 920 is configured to decode the video encoded signal synthesized by the image signal multiplexer 910 and display on the same display screen of the site.
  • the signal transceiver 900 is further configured to receive video image signals of at least one second designated user sent by the other site in the same meeting place as the first designated user.
  • the image signal multiplexer 910 is specifically configured to respectively synthesize the video data signals of the first designated user, the at least one second designated user, and the conference material received by the signal transceiver 900 into one video encoded signal.
  • an embodiment of the present invention further provides a display device for a conference material in a video conference, where the display device includes:
  • the signal decoding unit 10 is configured to obtain a video encoded signal that combines the video image signal of the first designated user and the video data signal of the conference material, and decodes the obtained video encoded signal;
  • the screen cutting unit 11 is configured to virtually cut any one of the display screens of the venue into a preset number of sub-display screens;
  • the presentation unit 12 is configured to display the video image of the conference material decoded by the signal decoding unit 10 in at least one sub-display screen cut by the screen cutting unit 11, and decode the obtained first specified user by the signal decoding unit 10.
  • the video image is displayed in at least one other sub-display screen cut by the screen cutting unit 11.
  • the video decoding signal obtained by the signal decoding unit 10 further includes at least one video image signal of the second designated user; at this time, the rendering unit 12 is further configured to decode at least one second obtained by the signal decoding unit 10.
  • the video image of the designated user is displayed in at least one other sub-display screen cut by the screen cutting unit 11.
  • the presentation unit 12 is configured to display the video image of the conference material decoded by the signal decoding unit 10 in at least two adjacent sub-display screens cut by the screen cutting unit 11.
  • the presentation unit 12 is specifically configured to display the video image of each specified user decoded by the signal decoding unit 10 in any sub-display screen by the screen cutting unit 11; or, the signal decoding unit 10
  • the decoded video images of at least two specified users are displayed in the screen cutting unit 11 to be displayed in any one of the sub-display screens.
  • the presentation unit 12 is specifically configured to: display, by the screen cutting unit 11, any one of the sub-display screens, the video image of the first designated user decoded by the signal decoding unit 10; In the sub display screen adjacent to the selected sub display screen and adjacent to the display screen center area, the display signal decoding unit 10 decodes the obtained video image of the conference material.
  • the presentation unit 12 is further configured to determine, when the role of one of the second designated users is changed to the role of the first designated user, adjacent to the sub-display screen of the video image of the second designated user displaying the changed character. At least one sub-display screen; displaying the video image in the at least one sub-display screen of the video image in which the conference material is originally displayed, and the video image in the determined at least one sub-display screen.
  • the presentation unit 12 is further configured to: when a second designated user speaks, determine that is adjacent to the sub-display screen displaying the video image of the conference material, and different from the sub-display screen displaying the video image of the first designated user At least one sub-display screen; displaying the video image in the sub-display screen of the video image of the second designated user that originally displayed the speech, and exchanging the video image in the determined at least one sub-display screen.
  • the embodiment of the present invention further provides a conference terminal, where the conference terminal includes: a signal transceiver 100, configured to obtain a video that combines a video image signal of a first designated user and a video data signal of a conference material.
  • a signal transceiver 100 configured to obtain a video that combines a video image signal of a first designated user and a video data signal of a conference material.
  • a signal decoder no for decoding a video encoded signal obtained by the signal transceiver 100;
  • the processor 120 is configured to virtually cut a display screen of the conference site into a preset number of sub-display screens, and perform a video image of the conference material decoded by the signal decoder 110 in at least one sub-display screen obtained by cutting Displaying, and displaying the video image of the first designated user decoded by the signal decoder 110 in at least one other sub-display screen obtained by cutting.
  • the video transceiver signal obtained by the signal transceiver 100 further includes at least one video image signal of the second designated user; at this time, the processor 120 is further configured to decode at least one second of the signal decoder 110.
  • the video image of the designated user is displayed in at least one other sub-display screen cut by the processor 120.
  • the processor 120 is configured to display the video image of the conference material decoded by the signal decoder 110 in at least two adjacent sub-display screens obtained by cutting.
  • the processor 120 is configured to display the video image of each specified user decoded by the signal decoder 110 in an arbitrary sub-display screen, or at least decode the signal decoder 110.
  • the video images of the two specified users are displayed in any sub-display screen that is cut.
  • the processor 120 is configured to display, by using any one of the sub-display screens obtained by the cutting, the video image of the first designated user decoded by the signal decoder 110; adjacent to the selected sub-display screen, and displayed In the sub-display screen near the center of the screen, the video image of the obtained conference material decoded by the signal decoder 110 is displayed.
  • the processor 120 is further configured to: when one of the roles of the second designated user is changed to the role of the first designated user, determine, adjacent to the sub-display screen of the video image of the second designated user that displays the changed role. At least one sub-display screen; displaying the video image in the at least one sub-display screen of the video image in which the conference material is originally displayed, and the video image in the determined at least one sub-display screen.
  • the processor 120 is further configured to: when a second designated user speaks, determine that is adjacent to the sub-display screen displaying the video image of the conference material, and different from the sub-display screen displaying the video image of the first designated user At least one sub-display screen; displaying the video image in the sub-display screen of the video image of the second designated user that originally displayed the speech, and exchanging the video image in the determined at least one sub-display screen.
  • three display methods of conference materials in a remote conference are proposed: one of which is to first determine the position coordinates of the first designated user in the conference site, and then collect the video image signals of the conference site, and The video image signal of the site is cut according to the position coordinate, the video image signal of the first designated user is obtained, and then the video data signal of the displayed conference material is obtained, and the video image signal of the first designated user and the video data of the conference material are obtained. After the signal is combined into one video coded signal, it is sent to other sites for signal decoding and displayed on the same display screen of other sites. In this solution, the obtained video image signal of the first designated user and the video of the conference material are obtained.
  • the data signal is encoded one by one, and then sent to other sites, and displayed in the same display screen of other sites, realizing the video image of the first specified user's video image and conference material.
  • the effect of displaying on the same display screen in the same venue because only one display screen is needed to simultaneously display the conference material and the first designated user, effectively avoiding the video conference system being difficult to move, costly, and more flexible. Poor question, at the same time, since the participant pays attention to the conference material and the first designated user at the same time, there is no need to perform visual transfer between the display screen of the video image displaying the conference material and the display screen displaying the video image of the first designated user.
  • the efficiency of the video conference is improved, and the user experience is also improved; and the first designation is received after receiving the video image signal of the first designated user and the video data signal of the conference material sent by the other site.
  • the user's video image signal and the video data signal of the conference material are combined into one video coded signal, and the synthesized video coded signal is decoded and displayed on the same display screen of the site.
  • the site will receive The first specified user's video image signal and will The video data signal of the material is encoded and displayed in the same display screen of the site, and the video image of the first designated user and the video image of the conference material are displayed on the same display screen in the same venue.
  • Video coded signal one way to the obtained synthesis Decoding the encoded signal, and virtually cutting any display screen of the site into a preset number of sub-display screens; displaying the decoded video image of the conference material in at least one of the cut sub-display screens, and decoding the obtained
  • the video image of the first designated user is displayed in the other at least one cut sub-display screen.
  • the venue obtains a video encoded signal that combines the video image signal of the first designated user and the video data signal of the conference material. After the virtual display of any one of the display screens of the conference site is cut into a preset number of sub-display screens, and the video image of the decoded conference material is displayed in at least one of the cut sub-display screens, the decoding is obtained.
  • the video image of the first designated user is displayed in the other at least one cut sub-display screen, and the video image of the first designated user and the video image of the conference material are displayed on the same display screen in the same venue. Since the conference material and the first designated user are displayed only in different sub-display screens of one display screen, it is not necessary to separately display the conference material and the first designated user by using two display screens, thereby effectively avoiding the video due to more screens.
  • the conference system is not easy to move, the cost is high, and the flexibility is poor.
  • the video image of the conference material and the video of the first designated user are not required to be displayed. Visual transfer between the two display screens of the image, thus improving the efficiency of the video conference and improving the user experience.
  • the computer program instructions can also be stored in a computer readable memory that can direct a computer or other programmable data processing device to operate in a particular manner, such that the instructions stored in the computer readable memory produce an article of manufacture comprising the instruction device.
  • the apparatus functions in one or more blocks of a flow or a flow diagram and/or block diagram of a flowchart.
  • These computer program instructions can also be loaded onto a computer or other programmable data processing device such that a series of operational steps are performed on a computer or other programmable device to produce computer-implemented processing for execution on a computer or other programmable device.
  • the instructions provide steps for implementing the functions in one or more blocks of the flowchart or in a flow or block of the flowchart.

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • General Physics & Mathematics (AREA)
  • Physics & Mathematics (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Data Mining & Analysis (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Evolutionary Biology (AREA)
  • Evolutionary Computation (AREA)
  • Bioinformatics & Computational Biology (AREA)
  • General Engineering & Computer Science (AREA)
  • Bioinformatics & Cheminformatics (AREA)
  • Artificial Intelligence (AREA)
  • Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
  • Telephonic Communication Services (AREA)

Abstract

本发明涉及视频通信技术领域,公开了一种视频会议中会议材料的显示方法及装置,具体为:确定第一指定用户在会场中的位置坐标;釆集会场的视频图像信号,并根据位置坐标对会场的视频图像信号进行切割,获取第一指定用户的视频图像信号;获取显示的会议材料的视频数据信号,并将第一指定用户的视频图像信号和会议材料的视频数据信号合成一路视频编码信号后,发送至其它会场进行信号解码并在其它会场的同一显示屏幕上进行显示,这样,通过将第一指定用户的视频图像信号和会议材料的视频数据信号以一路视频编码实现在同一显示屏幕上呈现,从而有效解决现有技术中存在的视频会议系统不易搬移,灵活性较差、维护成本较高及会议效率较低的问题。

Description

一种视频会议中会议材料的显示方法及装置 本申请要求在 2013年 04月 22日 提交中 国专利局、 申请号为 201310140460.X、 发明名称为 "一种视频会议中会议材料的显示方法及装置,, 的中国专利申请的优先权, 其全部内容通过引用结合在本申请中。 技术领域
本发明涉及视频通信技术领域, 特别涉及一种视频会议中会议材料的显 示方法及装置。 背景技术
随着视频编码以及网络技术的发展, 网络视频的应用也越来越广泛, 网 络视频的其中一种应用方式是视频会议。 视频会议技术是将参与通信一方的 现场信息用视频和音频釆集设备进行釆集和数字化后, 进行相应的压缩处理, 然后,通过可获得的通信信道 /线路将数字信号传递给远端进行解压缩、还原、 再现的技术, 即视频会议是集视频、 音频、 数据通信于一体的会议, 可实时 传输各个会场的图像和声音, 使得各个会场从逻辑上处于一个会议中, 但是 物理上不在一个区域内。 视频会议与传统会议相比由于效率更高、 节约成本, 并且能够解决远距离通信的问题, 同时能够满足用户面对面沟通的需求, 具 有模拟真实场景效果等优点, 使得视频会议在企业中的应用越来越多, 其中, 图 1A为现有技术中的视频会议系统的结构示意图, 视频会议系统主要包括 MCU ( Multi-Point Control Unit, 多点控制单元 )和会议终端。
目前, 视频会议系统中的每个会场均具有至少一个会议终端, 视频会议 系统的结构具体如图 1B所示, 各会议终端釆集各自会场的声音、 图像并编码 发送给 MCU, MCU将处理后的声音和图像以及会议材料发送给视频会议中 的其它会议终端, 其它各会议终端解码输出远端会场的声音、 图像和会议材 料, 实现远程视频通信, 其中, 会议材料的显示方式有两种: 一种为在视频会议系统中有多个桌面材料显示屏幕, 显示参会人员的主 显示屏幕与显示会议材料的桌面材料显示屏幕是分开的, 每一个或几个参会 人员共用一个桌面材料显示屏幕, 具体参阅图 1C所示, 该桌面材料显示屏幕 的主要功能为演示远程会议中的各种电子材料;
另外一种为在视频会议系统中有一个材料显示屏幕, 显示参会人员的主 显示屏幕与显示会议材料的材料显示屏幕是分开的, 一个会场的所有参会人 员共用一个材料显示屏幕, 具体参阅图 1D所示, 该材料显示屏幕的主要功能 为演示会议中的各种电子材料。
在上述传统的实现视频会议的过程中, 实现视频会议的系统需要一个显 示参会人员的主显示屏幕与至少一个显示会议材料的材料显示屏幕, 并且主 显示屏幕与材料显示屏幕是分离的, 在实现过程中, 需要分别对两个设备执 行操作, 由于两个显示屏幕设备分离, 造成视频会议系统不易搬移, 灵活性 较差, 另外, 由于这两个显示屏幕设备常置于会场中的不同位置, 其各自的 以及之间连线多且复杂, 对会场布置有限制或者容易出现连线方面的故障, 因此, 维护要求高, 同时, 由于主讲人与会议材料不在一个屏幕上, 对于需 要同时关注主讲人以及会议材料的其它参会人员来说, 视觉需要不停的在主 讲人和会议材料之间较大范围内进行转移, 会议效率较低, 且影响用户体验。 发明内容
本发明实施例提供一种远程会议中会议材料的显示方法, 用以解决现有 技术中存在的视频会议系统不易搬移、 灵活性较差、 维护成本较高及会议效 率较低的问题。
第一方面, 提供一种视频会议中会议材料的显示方法, 包括:
确定第一指定用户在会场中的位置坐标;
釆集所述会场的视频图像信号, 并根据所述位置坐标对所述会场的视频 图像信号进行切割 , 获取所述第一指定用户的视频图像信号;
获取显示的会议材料的视频数据信号, 并将所述第一指定用户的视频图 像信号和所述会议材料的视频数据信号合成一路视频编码信号后, 发送至其 它会场进行信号解码并在所述其它会场的同一显示屏幕上进行显示。
结合第一方面, 在第一种可能的实现方式中, 确定与所述第一指定用户 处在同一会场中的至少一个第二指定用户在会场中的位置坐标; 并根据确定 的至少一个第二指定用户的位置坐标对所述会场的视频图像信号进行切割, 分别获取每个所述第二指定用户的视频图像信号; 其中, 将所述第一指定用 户的视频图像信号和所述会议材料的视频数据信号合成一路视频编码信号, 包括: 将所述第一指定用户、 所述至少一个第二指定用户的视频图像信号和 所述会议材料的视频数据信号合成一路视频编码信号。
结合第一方面、 第一方面的第一种可能的实现方式, 在第二种可能的实 现方式中, 确定指定用户在会场中的位置坐标时, 釆用听声辩位技术确定指 定用户在会场中的位置坐标; 或者, 基于位置定位器确定指定用户在会场中 的位置坐标。
结合第一方面、 第一方面的第一种可能的实现方式, 在第三种可能的实 现方式中, 根据位置坐标对会场的视频图像信号进行切割, 获取指定用户的 视频图像信号时, 将位置坐标与会场的视频图像信号的空间位置坐标进行匹 配, 得出指定用户的视频图像信号在所述会场的视频图像信号中的位置; 对 所述位置处的视频图像信号通过人脸识别技术确定出所述指定用户的视频图 像; 在与所述指定用户的图像相距预设距离处对所述会场的视频图像信号进 行切割, 获取指定用户的视频图像信号。
第二方面, 提供一种视频会议中会议材料的显示方法, 包括:
接收其它会场发送的第一指定用户的视频图像信号和会议材料的视频数 据信号;
将接收到的所述第一指定用户的视频图像信号和所述会议材料的视频数 据信号合成一路视频编码信号;
对合成的视频编码信号进行解码, 并在本会场的同一显示屏幕上进行显 结合第二方面, 在第一种可能的实现方式中, 接收其它会场发来的与所 述第一指定用户处在同一会场中的至少一个第二指定用户的视频图像信号; 其中, 将接收到的所述第一指定用户的视频图像信号和所述会议材料的视频 数据信号合成一路视频编码信号, 包括: 分别将接收到的所述第一指定用户 的视频图像信号、 所述至少一个第二指定用户的视频图像信号和会议材料的 视频数据信号合成一路视频编码信号。
第三方面, 提供一种视频会议中会议材料的显示方法, 包括:
获得将第一指定用户的视频图像信号和会议材料的视频数据信号合成的 一路视频编码信号;
对获得的一路视频编码信号解码, 并将本会场的任意一个显示屏幕虚拟 切割为预设数量的子显示屏幕;
将解码得到的会议材料的视频图像在所述任意一个显示屏幕中的至少一 个切割得到的子显示屏幕中进行显示, 并将解码得到的所述第一指定用户的 视频图像在所述任意一个显示屏幕中的其它至少一个切割得到的子显示屏幕 中进行显示。
结合第三方面, 在第一种可能的实现方式中, 所述获得的一路视频编码 信号中还包括有至少一个第二指定用户的视频图像信号, 将解码得到的所述 至少一个第二指定用户的视频图像在所述其它至少一个切割得到的子显示屏 幕中进行显示。
结合第三方面, 在第二种可能的实现方式中, 将解码得到的会议材料的 视频图像在所述任意一个显示屏幕中的至少一个切割得到的子显示屏幕中进 行显示时, 将解码得到的会议材料的视频图像在所述任意一个显示屏幕中的 相邻的至少两个切割得到的子显示屏幕中进行显示。
结合第三方面、 第三方面的第一种可能的实现方式, 在第三种可能的实 现方式中, 将解码得到的指定用户的视频图像显示在所述任意一个显示屏幕 中的其它至少一个切割得到的子显示屏幕中时, 将解码得到的每个指定用户 的视频图像分别在所述任意一个显示屏幕中的任意一个切割得到的子显示屏 幕中进行显示; 或者, 将解码得到的至少两个指定用户的视频图像在所述任 意一个显示屏幕中的任意一个切割得到的子显示屏幕中进行显示。
结合第三方面, 在第四种可能的实现方式中, 将会议材料的视频图像在 所述任意一个显示屏幕中的至少一个切割得到的子显示屏幕中显示, 并将第 一指定用户的视频图像在所述任意一个显示屏幕中的其它至少一个切割得到 的子显示屏幕中进行显示时, 在切割得到的所述任意一个显示屏幕中的全部 子显示屏幕中选择一个子显示屏幕显示解码得到的所述第一指定用户的视频 图像; 在与选择的该子显示屏幕相邻、 且与所述显示屏幕中心区域靠近的子 显示屏幕中, 显示选择解码得到的所述会议材料的视频图像。
结合第三方面、 第三方面的第一种可能的实现方式, 在第五种可能的实 现方式中, 在其中一个第二指定用户的角色变更为第一指定用户的角色时, 确定与显示有变更角色的第二指定用户的视频图像的子显示屏幕相邻的至少 一个子显示屏幕; 将原来显示有所述会议材料的视频图像的至少一个子显示 屏幕中的视频图像, 与确定的至少一个子显示屏幕中的视频图像进行交换显 示。
结合第三方面、 第三方面的第一种可能的实现方式, 在第六种可能的实 现方式中, 其中一个第二指定用户发言时, 确定与显示所述会议材料的视频 图像的子显示屏幕相邻的、 且与显示所述第一指定用户的视频图像的子显示 屏幕不同的至少一个子显示屏幕; 将原来显示有发言的第二指定用户的视频 图像的子显示屏幕中的视频图像, 与确定的至少一个子显示屏幕中的视频图 像进行交换显示。
第四方面, 提供一种视频会议中会议材料的显示装置, 包括:
确定单元, 用于确定第一指定用户在会场中的位置坐标;
图像信号获取单元, 用于釆集所述会场的视频图像信号, 并根据所述确 定单元确定的位置坐标对所述会场的视频图像信号进行切割, 获取所述第一 指定用户的视频图像信号, 并获取显示的会议材料的视频数据信号;
通信单元, 用于将所述图像信号获取单元获取的第一指定用户的视频图 像信号和所述会议材料的视频数据信号合成一路视频编码信号后, 发送至其 它会场进行信号解码并在所述其它会场的同一显示屏幕上进行显示。
结合第四方面, 在第一种可能的实现方式中, 所述确定单元, 还用于确 定与所述第一指定用户处在同一会场中的至少一个第二指定用户在会场中的 位置坐标;
图像信号获取单元, 还用于根据所述确定单元确定的的至少一个第二指 定用户的位置坐标对所述会场的视频图像信号进行切割, 分别获取每个所述 第二指定用户的视频图像信号;
所述通信单元, 具体用于将所述图像信号获取单元分别获取的所述第一 指定用户、 所述至少一个第二指定用户的视频图像信号和所述会议材料的视 频数据信号合成一路视频编码信号后, 发送至其它会场进行信号解码并在所 述其它会场的同一显示屏幕上进行显示。
结合第四方面、 第四方面的第一种可能的实现方式, 在第二种可能的实 现方式中, 所述确定单元, 具体用于釆用听声辩位技术确定指定用户在会场 中的位置坐标; 或者, 基于位置定位器确定指定用户在会场中的位置坐标。
结合第四方面、 第四方面的第一种可能的实现方式, 在第三种可能的实 现方式中, 所述图像信号获取单元, 具体用于将位置坐标与会场的视频图像 信号的空间位置坐标进行匹配, 得出指定用户的视频图像信号在所述会场的 视频图像信号中的位置; 并对所述位置处的视频图像信号通过人脸识别技术 确定出所述指定用户的视频图像; 以及在与所述指定用户的图像相距预设距 离处对所述会场的视频图像信号进行切割, 获取指定用户的视频图像信号。
第五方面, 提供一种会议终端, 包括:
图像信号处理器, 用于确定第一指定用户在会场中的位置坐标, 釆集所 述会场的视频图像信号, 并根据位置坐标对所述会场的视频图像信号进行切 割, 获取所述第一指定用户的视频图像信号, 以及获取显示的会议材料的视 频数据信号;
图像信号复用器, 用于将图像信号处理器获取的第一指定用户的视频图 像信号和所述会议材料的视频数据信号合成一路视频编码信号; 信号收发器, 用于将图像信号复用器合成的一路视频编码信号发送至其 它会场进行信号解码, 并在所述其它会场的同一显示屏幕上进行显示。
结合第五方面, 在第一种可能的实现方式中, 所述图像信号处理器, 还 用于确定与所述第一指定用户处在同一会场中的至少一个第二指定用户在会 场中的位置坐标, 并根据确定的至少一个第二指定用户的位置坐标对所述会 场的视频图像信号进行切割, 分别获取每个所述第二指定用户的视频图像信 号;
图像信号复用器, 具体用于将所述图像信号处理器分别获取的所述第一 指定用户、 所述至少一个第二指定用户的视频图像信号和所述会议材料的视 频数据信号合成一路视频编码信号。
结合第五方面、 第五方面的第一种可能的实现方式, 在第二种可能的实 现方式中, 所述图像信号处理器, 具体用于釆用听声辩位技术确定指定用户 在会场中的位置坐标; 或者, 基于位置定位器确定指定用户在会场中的位置 坐标。
结合第五方面、 第五方面的第一种可能的实现方式, 在第三种可能的实 现方式中, 所述图像信号处理器, 具体用于将位置坐标与会场的视频图像信 号的空间位置坐标进行匹配, 得出指定用户的视频图像信号在所述会场的视 频图像信号中的位置; 并对所述位置处的视频图像信号通过人脸识别技术确 定出所述指定用户的视频图像; 以及在与所述指定用户的图像相距预设距离 处对所述会场的视频图像信号进行切割, 获取指定用户的视频图像信号。
第六方面, 提供一种视频会议中会议材料的显示装置, 包括:
通信单元, 用于接收其它会场发送的第一指定用户的视频图像信号和会 议材料的视频数据信号, 并将接收到的所述第一指定用户的视频图像信号和 所述会议材料的视频数据信号合成一路视频编码信号;
呈现单元, 用于对所述通信单元合成的视频编码信号进行解码, 并在本 会场的同一显示屏幕上进行显示。 结合第六方面, 在第一种可能的实现方式中, 所述通信单元, 还用于接 收其它会场发来的与所述第一指定用户处在同一会场中的至少一个第二指定 用户的视频图像信号, 以及将所述接收收到的至少一个第二指定用户的视频 图像信号合成到已合成的一路视频编码信号中。
第七方面, 提供一种会议终端, 包括:
信号收发器, 用于接收其它会场发送的第一指定用户的视频图像信号和 会议材料的视频数据信号;
图像信号复用器, 用于将将所述信号收发器接收到的所述第一指定用户 的视频图像信号和所述会议材料的视频数据信号合成一路视频编码信号; 显示器, 用于对图像信号复用器合成的视频编码信号进行解码, 并在本 会场的同一显示屏幕上进行显示。
结合第七方面, 在第一种可能的实现方式中, 所述信号收发器, 还用于 接收其它会场发来的与所述第一指定用户处在同一会场中的至少一个第二指 定用户的视频图像信号;
所述图像信号复用器, 具体用于分别将所述信号收发器接收到的第一指 定用户、 至少一个第二指定用户的视频图像信号和会议材料的视频数据信号 合成一路视频编码信号。
第八方面, 提供一种视频会议中会议材料的显示装置, 包括:
信号解码单元, 用于获得将第一指定用户的视频图像信号和会议材料的 视频数据信号合成的一路视频编码信号, 并对获得的一路视频编码信号解码; 屏幕切割单元, 用于将本会场的任意一个显示屏幕虚拟切割为预设数量 的子显示屏幕;
呈现单元, 用于将所述信号解码单元解码得到的会议材料的视频图像在 所述屏幕切割单元切割得到的至少一个子显示屏幕中进行显示, 并将所述信 号解码单元解码得到的所述第一指定用户的视频图像在所述屏幕切割单元切 割得到的至少一个其它子显示屏幕中进行显示。
结合第八方面, 在第一种可能的实现方式中, 所述信号解码单元获得的 一路视频编码信号中还包括有至少一个第二指定用户的视频图像信号; 所述呈现单元, 还用于将信号解码单元解码得到的所述至少一个第二指 定用户的视频图像在所述屏幕切割单元切割得到的至少一个其它子显示屏幕 中进行显示。
结合第八方面, 在第二种可能的实现方式中, 所述呈现单元, 具体用于 将信号解码单元解码得到的会议材料的视频图像在所述屏幕切割单元切割得 到的至少两个相邻的子显示屏幕中进行显示。
结合第八方面的第一种可能的实现方式, 在第三种可能的实现方式中, 所述呈现单元, 具体用于将所述信号解码单元解码得到的每个指定用户的视 频图像分别在所述屏幕切割单元切割得到任意一个子显示屏幕中进行显示; 或者, 将所述信号解码单元解码得到的至少两个指定用户的视频图像在所述 屏幕切割单元切割得到任意一个子显示屏幕中进行显示。
结合第八方面, 在第四种可能的实现方式中, 所述呈现单元具体用于, 在所述屏幕切割单元切割得到的任意一个子显示屏幕显示所述信号解码单元 解码得到的所述第一指定用户的视频图像; 在与选择的该子显示屏幕相邻、 且与所述显示屏幕中心区域靠近的子显示屏幕中, 显示所述信号解码单元解 码得到的所述会议材料的视频图像。
结合第八方面的第一种可能的实现方式, 在第五种可能的实现方式中, 所述呈现单元还用于, 在其中一个第二指定用户的角色变更为第一指定用户 的角色时, 确定与显示有变更角色的第二指定用户的视频图像的子显示屏幕 相邻的至少一个子显示屏幕; 将原来显示有所述会议材料的视频图像的至少 一个子显示屏幕中的视频图像, 与确定的至少一个子显示屏幕中的视频图像 进行交换显示。
结合第八方面的第一种可能的实现方式, 在第六种可能的实现方式中, 所述呈现单元还用于, 其中一个第二指定用户发言时, 确定与显示所述会议 材料的视频图像的子显示屏幕相邻的、 且与显示所述第一指定用户的视频图 像的子显示屏幕不同的至少一个子显示屏幕; 将原来显示有发言的第二指定 用户的视频图像的子显示屏幕中的视频图像, 与确定的至少一个子显示屏幕 中的视频图像进行交换显示。
第九方面, 提供一种会议终端, 包括:
信号收发器, 用于获得将第一指定用户的视频图像信号和会议材料的视 频数据信号合成的一路视频编码信号;
信号解码器, 用于对所述信号收发器获得的一路视频编码信号进行解码; 处理器, 用于将本会场的任意一个显示屏幕虚拟切割为预设数量的子显 示屏幕, 并将所述信号解码器解码得到的会议材料的视频图像在切割得到的 至少一个子显示屏幕中进行显示, 并将所述信号解码器解码得到的所述第一 指定用户的视频图像在切割得到的至少一个其它子显示屏幕中进行显示。
结合第九方面, 在第一种可能的实现方式中, 所述信号收发器获得的一 路视频编码信号中还包括有至少一个第二指定用户的视频图像信号;
所述处理器, 还用于将所述信号解码器解码得到的所述至少一个第二指 定用户的视频图像在所述处理器切割得到的至少一个其它子显示屏幕中进行 显示。
结合第九方面, 在第二种可能的实现方式中, 所述处理器, 具体用于将 所述信号解码器解码得到的会议材料的视频图像在切割得到的至少两个相邻 的子显示屏幕中进行显示。
结合第九方面的第一种可能的实现方式, 在第三种可能的实现方式中, 所述处理器, 具体用于将所述信号解码器解码得到的每个指定用户的视频图 像分别在切割得到任意一个子显示屏幕中进行显示; 或者, 将所述信号解码 器解码得到的至少两个指定用户的视频图像在切割得到任意一个子显示屏幕 中进行显示。
结合第九方面的第一种可能的实现方式, 在第四种可能的实现方式中, 所述处理器具体用于, 在切割得到的任意一个子显示屏幕显示所述信号解码 器解码得到的所述第一指定用户的视频图像; 在与选择的该子显示屏幕相邻、 且与所述显示屏幕中心区域靠近的子显示屏幕中, 显示所述信号解码器解码 得到的所述会议材料的视频图像。
结合第九方面的第一种可能的实现方式, 在第五种可能的实现方式中, 所述处理器还用于, 在其中一个第二指定用户的角色变更为第一指定用户的 角色时, 确定与显示有变更角色的第二指定用户的视频图像的子显示屏幕相 邻的至少一个子显示屏幕; 将原来显示有所述会议材料的视频图像的至少一 个子显示屏幕中的视频图像, 与确定的至少一个子显示屏幕中的视频图像进 行交换显示。
结合第九方面的第一种可能的实现方式, 在第六种可能的实现方式中, 所述处理器还用于, 其中一个第二指定用户发言时, 确定与显示所述会议材 料的视频图像的子显示屏幕相邻的、 且与显示所述第一指定用户的视频图像 的子显示屏幕不同的至少一个子显示屏幕; 将原来显示有发言的第二指定用 户的视频图像的子显示屏幕中的视频图像, 与确定的至少一个子显示屏幕中 的视频图像进行交换显示。
本发明实施例中, 提出三种远程会议中会议材料的显示方法:
其中一种为先确定第一指定用户在会场中的位置坐标, 再釆集会场的视 频图像信号, 并根据位置坐标对会场的视频图像信号进行切割, 获取第一指 定用户的视频图像信号, 然后, 获取显示的会议材料的视频数据信号, 并将 第一指定用户的视频图像信号和会议材料的视频数据信号合成一路视频编码 信号后, 发送至其它会场进行信号解码并在其它会场的同一显示屏幕上进行 显示, 在该方案中, 通过将获取得到的第一指定用户的视频图像信号和会议 材料的视频数据信号进行一路编码, 然后, 发送至其它会场, 并在其它会场 的同一显示屏幕中进行显示, 实现了第一指定用户的视频图像和会议材料的 视频图像在同一会场中的同一显示屏幕进行显示的效果, 由于只需要用一个 显示屏幕对会议材料与第一指定用户进行同时显示, 有效避免了视频会议系 统不易搬移、 成本较高、 及灵活性较差的问题, 同时, 由于参会人员同时关 注会议材料和第一指定用户时, 不需要在显示会议材料的视频图像的显示屏 幕和显示第一指定用户的视频图像的显示屏幕之间进行视觉转移, 因此, 提 高了视频会议的效率, 还提高了用户体验;
另一种为接收到其它会场发送的第一指定用户的视频图像信号和会议材 料的视频数据信号后, 将接收到的第一指定用户的视频图像信号和会议材料 的视频数据信号合成一路视频编码信号, 并对合成的一路视频编码信号进行 解码后在本会场的同一显示屏幕上进行显示, 在该方案中, 会场通过将接收 到的第一指定用户的视频图像信号和会议材料的视频数据信号进行一路编 码, 并在本会场的同一显示屏幕中进行显示, 实现了第一指定用户的视频图 像和会议材料的视频图像在同一会场中的同一显示屏幕进行显示的效果, 由 于只需要用一个显示屏幕同时显示会议材料与第一指定用户即可, 不需要用 两个显示屏幕分别显示会议材料与第一指定用户, 因此, 有效避免了由于屏 幕较多导致的视频会议系统不易搬移、 成本较高及灵活性较差的问题, 同时, 由于参会人员同时关注会议材料和第一指定用户时, 不需要在显示会议材料 的视频图像和显示第一指定用户的视频图像的两个显示屏幕之间进行视觉转 移, 因此, 提高了视频会议的效率, 还提高了用户体验;
还有一种为, 获得将第一指定用户的视频图像信号和会议材料的视频数 据信号合成的一路视频编码信号; 对获得的合成的一路视频编码信号解码, 并将本会场的任意一个显示屏幕虚拟切割为预设数量的子显示屏幕; 将解码 得到的会议材料的视频图像在至少一个切割得到的子显示屏幕中进行显示, 将解码得到的第一指定用户的视频图像在其它至少一个切割得到的子显示屏 幕中进行显示, 在该方案中, 会场获得将第一指定用户的视频图像信号和会 议材料的视频数据信号合成的一路视频编码信号后, 通过将本会场的任意一 个显示屏幕虚拟切割为预设数量的子显示屏幕, 并将解码得到的会议材料的 视频图像在至少一个切割得到的子显示屏幕中进行显示, 将解码得到的第一 指定用户的视频图像在其它至少一个切割得到的子显示屏幕中进行显示, 实 现了第一指定用户的视频图像和会议材料的视频图像在同一会场中的同一显 示屏幕进行显示的效果, 由于会议材料与第一指定用户仅在一个显示屏幕的 不同子显示屏幕中显示, 不需要用两个显示屏幕分别显示会议材料与第一指 定用户, 因此, 有效避免了由于屏幕较多导致的视频会议系统不易搬移、 成 本较高及灵活性较差的问题, 同时, 由于参会人员同时关注会议材料和第一 指定用户时, 不需要在显示会议材料的视频图像和显示第一指定用户的视频 图像的两个显示屏幕之间进行视觉转移, 因此, 提高了视频会议的效率, 还 提高了用户体验。 附图说明
图 1A为现有技术中视频会议系统的第一结构示意图;
图 1B为现有技术中视频会议系统的第二结构示意图;
图 1C为现有技术中视频会议中会议材料的第一显示示意图;
图 1D为现有技术中视频会议中会议材料的第二显示示意图;
图 2A为本发明实施例中视频会议中会议材料显示的第一详细流程图; 图 2B为本发明实施例中视频会议中会议材料显示的第二详细流程图; 图 2C为本发明实施例中视频会议中会议材料显示的第三详细流程图; 图 3 A为本发明实施例中视频会议中会议材料显示的第三示意图; 图 3B为本发明实施例中视频会议中会议材料显示的第四示意图; 图 3 C为本发明实施例中视频会议中会议材料显示的第五示意图; 图 4 A为本发明实施例中视频会议中会议材料显示的第六示意图; 图 4B为本发明实施例中视频会议中会议材料显示的第七示意图; 图 4C为本发明实施例中视频会议中会议材料显示的第八示意图; 图 5 A为本发明实施例中视频会议中会议材料显示的第九示意图; 图 5B为本发明实施例中视频会议中会议材料显示的第十示意图; 图 6A为本发明实施例中视频会议中会议材料显示的第十一示意图; 图 6B为本发明实施例中视频会议中会议材料显示的第十二示意图; 图 6C为本发明实施例中视频会议中会议材料显示的第十三示意图; 图 7为本发明实施例中视频会议中会议材料显示的第四详细流程图; 图 8A为本发明实施例中视频会议中会议材料显示的第一显示装置示意 图;
图 8B 为本发明实施例中视频会议中会议材料显示的第一会议终端示意 图;
图 9A为本发明实施例中视频会议中会议材料显示的第二显示装置示意 图;
图 9B 为本发明实施例中视频会议中会议材料显示的第二会议终端示意 图;
图 10A为本发明实施例中视频会议中会议材料显示的第三显示装置示意 图;
图 10B为本发明实施例中视频会议中会议材料显示的第三会议终端示意 图。 具体实施方式
为了解决现有技术中存在的视频会议系统不易搬移、 灵活性较差、 维护 成本较高及会议效率较低的问题, 本发明实施例中, 提出三种远程会议中会 议材料的显示方法, 都可以有效避免由于屏幕较多导致的视频会议系统不易 搬移、 成本较高及灵活性较差的问题, 同时, 由于参会人员同时关注会议材 料和第一指定用户时, 不需要在显示会议材料的视频图像和显示第一指定用 户的视频图像的两个显示屏幕之间进行视觉转移, 因此, 提高了视频会议的 效率, 还提高了用户体验。
下面结合附图对本发明优选的实施方式进行详细说明。
参阅图 2A所示, 本发明实施例中, 视频会议中会议材料显示的第一详细 流程如下:
实施例一:
步骤 20: 确定第一指定用户在会场中的位置坐标。
本发明实施例中, 确定第一指定用户在会场中的位置坐标的方式有多种, 较佳的, 釆用听声辩位技术确定第一指定用户在会场中的位置坐标, 例如, 通过在会场的不同位置分别设置的声音信号釆集器获取会场的声音信号, 并 根据釆集到的强度最大的声音信号计算出发出该声音信号的信号源所在的空 间位置; 或者, 通过位置定位器来确定第一指定用户在会场中的位置坐标, 通过位置定位器来进行定位是现有技术中比较成熟的技术, 在此不再——进 行详述。
步骤 21 : 釆集会场的视频图像信号, 并根据位置坐标对会场的视频图像 信号进行切割, 获取第一指定用户的视频图像信号, 并获取显示的会议材料 的视频数据信号。
本发明实施例中, 釆集会场的视频图像信号, 并根据位置坐标对会场的 视频图像信号进行切割, 获取第一指定用户的视频图像信号的实现方式有多 种, 较佳的, 先将位置坐标与视频图像信号的空间位置坐标进行匹配, 得出 第一指定用户的视频图像信号在会场的视频图像信号中的位置, 对位置处的 视频图像信号通过人脸识别技术确定出第一指定用户的视频图像, 然后, 在 与第一指定用户的视频图像相距预设距离处对会场的视频图像信号进行切 割, 获取第一指定用户的视频图像信号。
本发明实施例中, 在将第一指定用户的视频图像信号发送至其它会场的 显示屏幕上进行显示时, 也可以将与第一指定用户处于同一会场的多个第二 指定用户的视频图像信号发送至其它会场的显示屏幕上进行显示, 例如, 先 确定多个第二指定用户在会场中的位置坐标; 然后, 根据确定的多个第二指 定用户的位置坐标分别对会场的视频图像信号进行切割, 分别获取每个第二 指定用户的视频图像信号, 最后, 将第一指定用户、 第二指定用户的视频图 像信号分别和会议材料的视频数据信号合成一路视频编码信号, 其中, 在确 定第二指定用户在会场中的位置坐标与确定第一指定用户在会场中的位置坐 标所釆用的方式相同。
步骤 22: 将第一指定用户的视频图像信号和会议材料的视频数据信号合 成一路视频编码信号后, 发送至其它会场进行信号解码并在其它会场的同一 显示屏幕上进行显示。 本发明实施例中, 通过将会议材料的视频数据信号和第一指定用户的视 频图像信号釆用一路视频编码方式进行编码, 并发送至其它会场的同一显示 屏幕进行呈现, 达到了会议材料和第一指定用户 (例如, 主讲人)在同一屏 幕中呈现的目的, 避免了会议材料和第一指定用户在同一会场的不同显示屏 幕中呈现, 而导致的视频会议系统存在的不易搬移、 灵活性较差, 及维护成 本较高的问题, 同时, 避免了需要同时关注会议材料和第一指定用户的其它 参会人员在视频会议中, 视觉在呈现会议材料的显示屏幕和呈现第一指定用 户的显示屏幕之间转移, 提高了会议效率, 及用户体验。
本发明实施例中, 还提出了一种视频会议中会议材料显示的详细流程, 具体如图 2B所示:
实施例二:
步骤 200: 接收其它会场发送的第一指定用户的视频图像信号和会议材料 的视频数据信号。
步骤 210: 将接收到的第一指定用户的视频图像信号和会议材料的视频数 据信号合成一路视频编码信号。
步骤 220: 对合成的视频编码信号进行解码, 并在本会场的同一显示屏幕 上进行显示。
本发明实施例中, 在接收其它会场发来的第一指定用户的视频图像信号 时, 也可以接收其它会场发来的与第一指定用户处在同一会场中的多个第二 指定用户的视频图像信号, 对接收到的多个第二指定用户的视频图像信号的 处理方式有多种, 较佳的, 将接收到的第一指定用户的视频图像信号、 第二 指定用户的视频图像信号分别和会议材料的视频数据信号合成一路视频编码 信号。
本发明实施例中, 通过将接收到的会议材料的视频数据信号和第一指定 用户的视频图像信号釆用一路视频编码方式进行编码, 并在本会场的同一显 示屏幕中进行呈现, 达到了会议材料和第一指定用户 (例如, 主讲人)在同 一屏幕中呈现的目的, 避免了会议材料和第一指定用户在同一会场的不同显 示屏幕中呈现, 而导致的视频会议系统不易搬移、 灵活性较差, 及维护成本 较高的问题, 同时, 还避免了需要同时关注会议材料和第一指定用户的其它 参会人员在视频会议中, 视觉在呈现会议材料的显示屏幕和呈现第一指定用 户的显示屏幕之间转移, 提高了会议效率, 及用户体验。
本发明实施例中, 还提供了一种视频会议中会议材料显示的详细流程, 具体如图 2C所示:
实施例三:
步骤 2000: 获得将第一指定用户的视频图像信号和会议材料的视频数据 信号合成的一路视频编码信号。
本发明实施例中, 获得的合成的一路视频编码信号中在包括第一指定用 户的视频图像信号的同时, 还可以包括至少一个第二指定用户的视频图像信 号。
步骤 2100: 对获得的一路视频编码信号解码, 并将本会场的任意一个显 示屏幕虚拟切割为预设数量的子显示屏幕。
步骤 2200: 将解码得到的会议材料的视频图像在上述至少一个切割得到 的子显示屏幕中进行显示, 并将解码得到的第一指定用户的视频图像在其它 至少一个切割得到的子显示屏幕中进行显示。
本发明实施例中, 获得的合成的一路视频编码信号中在包括第一指定用 户的视频图像信号的同时, 还可以包括至少一个第二指定用户的视频图像信 号, 在将解码得到的至少一个第二指定用户的视频图像进行显示时, 可以在 与显示会议材料不同的其它至少一个切割得到的子显示屏幕中进行显示, 也 就是说, 显示第二指定用户的视频图像的子显示屏幕与显示会议材料的视频 图像的子显示屏幕不同, 与显示第一指定用户的视频图像的子显示屏幕可以 相同也可以不同。
本发明实施例中, 将解码得到的会议材料的视频图像在上述任意一个显 示屏幕中的至少一个切割得到的子显示屏幕中进行显示的方式有多种, 较佳 的, 将解码得到的会议材料的视频图像在上述任意一个显示屏幕中的相邻的 至少两个切割得到的子显示屏幕中进行显示。
例如, 第一指定用户为主讲人 A, A所在的会场为第一会场 Bl , B1将 A的 视频图像信号和会议材料的视频数据信号以一路视频编码后的视频流发送至 第二会场 B2, B2在接收到该视频流后, 先将本会场的显示屏幕 C虚拟切割为 6 个子显示屏幕, 从左至右进行编号, 并选择编号为 2、 3的两个子屏幕对会议 材料的视频数据信号编解码后进行呈现, 具体如图 3A所示, 在实际应用中, 也可以选择编号为 1、 2的两个子屏幕进行呈现, 或者选择编号为 3、 4的两个 子屏幕进行呈现, 在此不再进行详述。
本发明实施例中, 将解码得到的指定用户的视频图像显示在上述任意一 个显示屏幕中的其它至少一个切割得到的子显示屏幕中的方式有多种, 例如, 将解码得到的每个指定用户的视频图像分别在上述任意一个显示屏幕中的一 个切割得到的子显示屏幕中进行显示; 或者, 将解码得到的至少两个指定用 户的视频图像在上述任意一个显示屏幕中的一个切割得到的子显示屏幕中进 行显示。
例如, 将本会场的显示屏幕虚拟切割为 6个子显示屏幕, 从左至右进行编 号,在对第一指定用户(第一指定用户 1 )的视频图像、三个第二指定用户(第 二指定用户 1、 第二指定用户 2及第二指定用户 3 )的视频图像和会议材料的视 频图像在子显示屏幕中进行显示时, 可以在 1号子显示屏幕、 2号子显示屏幕、 3号子显示屏幕、 4号子显示屏幕、 5号子显示屏幕上分别显示第一指定用户 1、 第二指定用户 1、 第二指定用户 2、 第二指定用户 3及会议材料的视频图像, 也 可以在 1号子显示屏幕上显示第一指定用户 1的视频图像, 在 2号子显示屏幕上 显示第二指定用户 1、 第二指定用户 2、 第二指定用户 3的视频图像, 在 3号子 显示屏幕上显示会议材料的视频图像。
进一步的, 为了提高会议材料在显示屏幕中的呈现质量, 提高会议效率 及提升用户体验, 本发明实施例中, 在切割得到的各个子显示屏幕中选择一 个子显示屏幕显示解码得到的第一指定用户的视频图像; 在与选择的该子显 示屏幕相邻、 且与显示屏幕中心区域靠近的子显示屏幕中, 显示选择解码得 到的会议材料的视频图像, 具体可以釆用如下方式实现: 在将本会场的一个 显示屏幕虚拟切割为预设数量的子显示屏幕后, 对子显示屏幕按照预设顺序 编号, 及确定呈现第一指定用户的子显示屏幕的编号, 并根据对子显示屏幕 进行编号所釆取的预设顺序选取相邻的子显示屏幕, 令相邻的子显示屏幕对 会议材料的视频数据信号进行解码后进行呈现, 实现会议材料的视频图像与 第一指定用户的视频图像相邻, 且在与显示屏幕中心区域靠近的子显示屏幕 中进行呈现。
例如, 第一指定用户为主讲人 A, A所在的会场为第一会场 Bl , B1将 A的 视频图像信号和会议材料的视频数据信号以一路视频编码后的视频流发送至 第二会场 B2, B2在接收到该视频流后, 先将本会场的显示屏幕虚 C拟切割为 10个子显示屏幕, 从左至右对 10个子显示屏幕进行编号, 然后, 确定出呈现 第一指定用户的子显示屏幕的编号为 4, 由于子显示屏幕的编号是按照从左至 右的方式进行的, 4号子显示屏幕位于显示屏幕的左侧, 因此, 选择 4号子显 示屏幕的右侧的相邻子显示屏幕(5号子显示屏幕与 6号子显示屏幕)对会议 材料的视频数据信号进行解码后进行呈现, 如图 3B所示。 若呈现第一指定用 户的子显示屏幕的编号为 7, 由于子显示屏幕的编号是按照从左至右的方式进 行的, 7号子显示屏幕位于显示屏幕的右侧, 因此, 选择 7号子显示屏幕的左 侧的相邻子显示屏幕(5号子显示屏幕与 6号子显示屏幕)对会议材料的视频 数据信号进行解码后进行呈现, 如图 3C所示, 实现呈现会议材料的子显示屏 幕与呈现第一指定用户的子显示屏幕相邻, 且与显示屏幕中心区域距离较近。
在实际应用中, 呈现第一指定用户的子显示屏幕也可能发生变化, 如, 呈现主讲人的子显示屏幕由图 3A中的 2号子显示屏幕更改为图 3A中的 4号 子显示屏幕, 为了保证呈现会议材料的子显示屏幕与呈现第一指定用户的子 显示屏幕相邻, 且位于与显示屏幕中心区域靠近的一侧, 进而提高呈现会议 材料的显示质量, 本发明实施例中, 先确定与显示移动后的第一指定用户的 视频图像的子显示屏幕相邻的至少一个子显示屏幕, 再将原来显示有会议材 料的视频图像的至少一个子显示屏幕中的视频图像, 与确定的至少一个子显 示屏幕中的视频图像进行交换显示, 具体可以通过如下方式实现: 将显示屏 幕虚拟切割为预设数量的子显示屏幕, 对子显示屏幕按照预设顺序编号后, 确定第一指定用户位置移动后所在子显示屏幕的编号, 及根据对子显示屏幕 进行编号所釆取的预设顺序选取相邻的子显示屏幕, 令相邻的子显示屏幕对 会议材料的视频数据信号进行解码后显示, 令初始呈现会议材料的视频数据 信号的子显示屏幕, 对确定的子显示屏幕中的视频图像进行呈现。
例如, 第一指定用户为主讲人 A, A所在的会场为第一会场 Bl , B1将 A 的视频图像信号和会议材料的视频数据信号以一路视频编码后的视频流发送 至第二会场 B2, B2在接收到该视频流后,先将本会场的显示屏幕虚拟切割为 10个子显示屏幕, 从左至右对 10个子显示屏幕进行编号, 其中, 呈现第一指 定用户的子显示屏幕的编号为 7 , 呈现参会人员 1、 参会人员 2及参会人员 3 的子显示屏幕分别为 2号子显示屏幕、 3号子显示屏幕及 4号子显示屏幕, 呈 现会议材料的子显示屏幕的编号为 5、 6 , 如图 4A所示, 若显示 A的子显示 屏幕从 7号子显示屏幕更改为 2号子显示屏幕, 则会议材料从在 5号子显示 屏幕及 6号子显示屏幕进行呈现更改为在 3号子显示屏幕及 4号子显示屏幕 进行呈现, 参会人员 2及参会人员 3分别在 5号子显示屏幕及 6号子显示屏 幕进行呈现, 参会人员 1在 7号子显示屏幕进行呈现, 具体如图 4B所示。
在实际应用中, 第一指定用户与第二指定用户的角色可能发生变化, 如, 主讲人(第一指定用户) 由变成参会者, 第二指定用户变成主讲人, 为了保 证呈现会议材料的子显示屏幕与呈现第一指定用户的子显示屏幕相邻, 且位 于呈现第一指定用户的子显示屏幕中与显示屏幕中心区域靠近的一侧, 进而 提高呈现会议材料的显示质量, 本发明实施例中, 在第二指定用户的角色变 更为第一指定用户的角色时, 确定与显示有变更角色的第二指定用户的视频 图像的子显示屏幕相邻的至少一个子显示屏幕; 将原来显示有会议材料的视 频图像的至少一个子显示屏幕中的视频图像, 与确定的至少一个子显示屏幕 中的视频图像进行交换显示。
例如, 第一指定用户 (主讲人)为 A, A所在的会场为第一会场 B1 , 第 二指定用户 (参会人员)为 C, B1将 A的视频图像信号和会议材料的视频数 据信号以一路视频编码后的视频流发送至第二会场 B2, B2在接收到该视频流 后, 先将本会场的显示屏幕虚拟切割为 10个子显示屏幕, 从左至右对 10个 子显示屏幕进行编号, 其中, 呈现 A的子显示屏幕的编号为 7, 呈现参会人 员 1、 参会人员 2及参会人员 3的子显示屏幕分别为 2号子显示屏幕、 3号子 显示屏幕及 4号子显示屏幕, 呈现会议材料的子显示屏幕的编号为 5、 6, 如 图 4A所示, 若现在主讲人由 A更改为 C, 显示 C的子显示屏幕为 2号子显 示屏幕, 则会议材料从在 5号子显示屏幕及 6号子显示屏幕进行呈现更改为 在 3号子显示屏幕及 4号子显示屏幕进行呈现, 参会人员 2及参会人员 3分 别在 5号子显示屏幕及 6号子显示屏幕进行呈现, 具体如图 4C所示。
在实际的视频会议过程中, 可能存在讨论阶段, 存在其它参会人员进行 发言的情况, 为了提升用户体验, 本发明实施例中, 确定其中一个第二指定 用户发言时, 确定与显示会议材料的视频图像的子显示屏幕相邻的与显示第 一指定用户的子显示屏幕不同的子显示屏幕, 并将原来显示有发言的第二指 定用户的视频图像的子显示屏幕中的视频图像, 与确定的与显示会议材料的 视频图像的子显示屏幕相邻的子显示屏幕中的视频图像进行交换显示, 具体 可以通过如下方式实现: 将显示屏幕虚拟切割为预设数量的子显示屏幕后, 对子显示屏幕按照预设顺序编号, 并确定会议材料的视频图像信号的子显示 屏幕的编号, 及呈现第一指定用户的视频图像信号的子显示屏幕的编号后, 令呈现会议材料的视频数据信号的子显示屏幕的另一侧的子显示屏幕对第二 指定用户的视频图像信号进行呈现。
例如, 第一指定用户为主讲人 A, A所在的会场为第一会场 Bl , B1将 A 的视频图像信号和会议材料的视频数据信号以一路视频编码后的视频流发送 至第二会场 B2, B2在接收到该视频流后,先将本会场的显示屏幕虚拟切割为 10个子显示屏幕, 从左至右对 10个子显示屏幕进行编号, 其中, 呈现第一指 定用户的子显示屏幕的编号为 7,呈现参会人员 1及参会人员 2的子显示屏幕 分别为 4号子显示屏幕与 8号子显示屏幕, 呈现会议材料的子显示屏幕的编 号为 5、 6 , 如图 5A所示, 若现在参会人员 2为发言人, 则参会人员 2从在 8 号子显示屏幕进行呈现更改为在 4号子显示屏幕进行呈现, 参会人员 1在 8 号子显示屏幕进行呈现, 具体如图 5B所示。
在本发明实施例中, 第一指定用户在屏幕中的呈现方式有多种, 较佳的, 可以以高亮形式呈现, 也可以以动画形式进行呈现, 还可以以指定的颜色进 行呈现。
在实际应用中, 可能在视频会议过程中的指定时间段显示会议材料, 在 其它时间段不显示会议材料, 为了保证视频会议的质量, 提高会议效率, 本 发明实施例中, 在将会议材料关闭后, 将呈现会议材料的子显示屏幕的一侧 的所有视频图像, 在编号与初始子显示屏幕编号相差为 2 的子显示屏幕上进 行呈现即可。
例如, 显示屏幕虚拟划分为 6个子显示屏幕, 其中, 会议材料在 3号及 4 号子显示屏幕上进行显示,主讲人在 2号子显示屏幕上进行显示,参会人员 2、 参会人员 3、 参会人员 4分别在 1号子显示屏幕、 5号子显示屏幕、 6号子显 示屏幕, 如图 6A所示, 会议材料关闭后, 参会人员 2与主讲人分别从 1号子 显示屏幕、 2号子显示屏幕上显示更改为在 3号及 4号子显示屏幕上进行显示, 呈现参会人员 3、参会人员 4的子显示屏幕不进行更改, 如图 6B所示, 或者, 参会人员 3与参会人员 4分别从在 5号子显示屏幕、 6号子显示屏幕中显示更 改为分别在 3号及 4号子显示屏幕上进行显示, 呈现参会人员 1、 主讲人的子 显示屏幕不进行更改, 如图 6C所示。
在实施例三提供的方案中, 会场获得将第一指定用户的视频图像信号和 会议材料的视频数据信号合成的一路视频编码信号后, 通过将本会场的任意 一个显示屏幕虚拟切割为预设数量的子显示屏幕, 并将解码得到的会议材料 的视频图像在至少一个切割得到的子显示屏幕中进行显示, 将解码得到的第 一指定用户的视频图像在其它至少一个切割得到的子显示屏幕中进行显示, 实现了第一指定用户的视频图像和会议材料的视频图像在同一会场中的同一 显示屏幕进行显示的效果, 由于会议材料与第一指定用户仅在一个显示屏幕 的不同子显示屏幕中显示, 不需要用两个显示屏幕分别显示会议材料与第一 指定用户, 因此, 有效避免了由于屏幕较多导致的视频会议系统不易搬移、 成本较高及灵活性较差的问题, 同时, 由于参会人员同时关注会议材料和第 一指定用户时, 不需要在显示会议材料的视频图像和显示第一指定用户的视 频图像的两个显示屏幕之间进行视觉转移, 因此, 提高了视频会议的效率, 还提高了用户体验。
本发明实施例中, 可以将实施例一与实施例三进行组合操作, 即发送方 会场釆用实施例一的方式进行合成信号发送, 接收端会场使用实施例三的方 式解码合成信号并对显示屏幕切割成子屏幕进行显示; 也可以将实施例二与 实施例三进行组合操作, 即接收方会场釆用实施例二的方式接收信号并合成 一路, 然后再解码合成一路的信号, 并釆用实施例三的方式并对显示屏幕切 割成子屏幕进行显示。 由于实施例一、 实施例二及实施例三中的任意一个实 施例都可以解决现有技术中存在的视频会议系统不易搬移、 灵活性较差、 维 护成本较高及会议效率较低的问题, 因此, 将实施例一与实施例三进行组合 操作, 或者将实施例二与实施例三进行组合操作的实施例也可以解决现有技 术中存在的视频会议系统不易搬移、 灵活性较差、 维护成本较高及会议效率 较低的问题, 其中, 每一个实施例可以达到上述效果的具体分析在前面有论 述, 在此不再——进行详述。
为了更好地理解本发明实施例, 以下给出具体应用场景, 针对远程会议 中会议材料的显示过程, 做出进一步详细描述, 具体如图 7 所示 (其中, A 为主讲人, A所在的会场为第一会场, 其它会场为第二会场):
步骤 700: 釆用听声辩位技术确定 A在第一会场中的位置坐标。
步骤 710: 釆集第一会场的视频图像信号, 并根据位置坐标对第一会场的 视频图像信号进行切割, 获取 A的视频图像信号。
步骤 720: 获取会议材料的视频数据信号, 并将 A的视频图像信号和会 议材料的视频数据信号以一路视频编码后发送至第二会场。
步骤 730:第二会场将本会场的同一显示屏幕虚拟切割为 8个子显示屏幕, 并对子显示屏幕从左至右进行编号。
步骤 740: 第二会场确定出呈现 A的子显示屏幕的编号位 6, 并选取 6号 子显示屏幕相邻的 4号子显示屏幕与 5号子显示屏幕。
步骤 750: 在 4号子显示屏幕与 5号子显示屏幕上呈现会议材料的视频 图像。
步骤 760: 确定呈现 A的子显示屏幕从 6号子显示屏幕更改为 1号子显 示屏幕后, 在 2号子显示屏幕及 3号子显示屏幕上呈现会议材料。
在该步骤中, 在将呈现 A的子显示屏幕从 6号子显示屏幕更改为 1号子 显示屏幕后, 在 2号子显示屏幕及 3号子显示屏幕上呈现会议材料后, 使位 于 1号子显示屏幕、 2号子显示屏幕及 3号子显示屏幕的参会人员 1、 2、 3 , 分别在 4号子显示屏幕、 5号子显示屏幕及 6号子显示屏幕上进行显示。
步骤 770: 确定参会人员 2为发言人后, 在 4号子显示屏幕上呈现参会人员 2的视频图像, 5号子显示屏幕中呈现参会人员 1的视频图像。
参阅图 8A所示,本发明实施例还提出一种视频会议中会议材料的显示装 置, 该显示装置包括:
确定单元 80 , 用于确定第一指定用户在会场中的位置坐标;
图像信号获取单元 81 , 用于釆集会场的视频图像信号, 并根据确定单元 80确定的位置坐标对会场的视频图像信号进行切割, 获取第一指定用户的视 频图像信号, 并获取显示的会议材料的视频数据信号;
通信单元 82 ,用于将图像信号获取单元 81获取的第一指定用户的视频图 像信号和会议材料的视频数据信号合成一路视频编码信号后, 发送至其它会 场进行信号解码并在其它会场的同一显示屏幕上进行显示。
进一步的, 确定单元 80, 还用于确定与第一指定用户处在同一会场中的 至少一个第二指定用户在会场中的位置坐标; 此时, 图像信号获取单元 81 , 还用于根据确定单元 80确定的的至少一个第二指定用户的位置坐标对会场的 视频图像信号进行切割 , 分别获取每个第二指定用户的视频图像信号;
较佳的, 通信单元 82 , 具体用于将图像信号获取单元 81分别获取的第一 指定用户、 至少一个第二指定用户的视频图像信号和会议材料的视频数据信 号合成一路视频编码信号后, 发送至其它会场进行信号解码并在其它会场的 同一显示屏幕上进行显示。
较佳的, 确定单元 80, 具体用于釆用听声辩位技术确定指定用户在会场 中的位置坐标; 或者, 基于位置定位器确定指定用户在会场中的位置坐标。
较佳的, 图像信号获取单元 81 , 具体用于将位置坐标与会场的视频图像 信号的空间位置坐标进行匹配, 得出指定用户的视频图像信号在会场的视频 图像信号中的位置; 并对位置处的视频图像信号通过人脸识别技术确定出指 定用户的视频图像; 以及在与指定用户的图像相距预设距离处对会场的视频 图像信号进行切割 , 获取指定用户的视频图像信号。
参阅图 8B所示, 本发明实施例还提出一种会议终端, 该会议终端包括: 图像信号处理器 800 , 用于确定第一指定用户在会场中的位置坐标, 釆集 会场的视频图像信号, 并根据位置坐标对会场的视频图像信号进行切割, 获 取第一指定用户的视频图像信号, 以及获取显示的会议材料的视频数据信号; 图像信号复用器 810 ,用于将图像信号处理器 800获取的第一指定用户的 视频图像信号和会议材料的视频数据信号合成一路视频编码信号;
信号收发器 820,用于将图像信号复用器 810合成的一路视频编码信号发 送至其它会场进行信号解码, 并在其它会场的同一显示屏幕上进行显示。
较佳的, 图像信号处理器 800,还用于确定与第一指定用户处在同一会场 中的至少一个第二指定用户在会场中的位置坐标, 并根据确定的至少一个第 二指定用户的位置坐标对会场的视频图像信号进行切割, 分别获取每个第二 指定用户的视频图像信号;
图像信号复用器 810 ,具体用于将图像信号处理器 800分别获取的第一指 定用户、 至少一个第二指定用户的视频图像信号和会议材料的视频数据信号 合成一路视频编码信号。
较佳的, 图像信号处理器 800, 具体用于釆用听声辩位技术确定指定用户 在会场中的位置坐标; 或者, 基于位置定位器确定指定用户在会场中的位置 坐标。
较佳的, 图像信号处理器 800, 具体用于将位置坐标与会场的视频图像信 号的空间位置坐标进行匹配, 得出指定用户的视频图像信号在会场的视频图 像信号中的位置; 并对位置处的视频图像信号通过人脸识别技术确定出指定 用户的视频图像; 以及在与指定用户的图像相距预设距离处对会场的视频图 像信号进行切割 , 获取指定用户的视频图像信号。
参阅图 9A所示,本发明实施例还提出一种视频会议中会议材料的显示装 置, 该显示装置包括:
通信单元 90 , 用于接收其它会场发送的第一指定用户的视频图像信号和 会议材料的视频数据信号, 并将接收到的第一指定用户的视频图像信号和会 议材料的视频数据信号合成一路视频编码信号;
呈现单元 91 , 用于对通信单元 90合成的视频编码信号进行解码, 并在本 会场的同一显示屏幕上进行显示。
进一步的, 通信单元 90, 还用于接收其它会场发来的与第一指定用户处 在同一会场中的至少一个第二指定用户的视频图像信号, 以及将接收收到的 至少一个第二指定用户的视频图像信号合成到已合成的一路视频编码信号 中。
参阅图 9B所示, 本发明实施例还提出一种会议终端, 该会议终端包括: 信号收发器 900,用于接收其它会场发送的第一指定用户的视频图像信号 和会议材料的视频数据信号;
图像信号复用器 910 ,用于将信号收发器 900接收到的第一指定用户的视 频图像信号和会议材料的视频数据信号合成一路视频编码信号;
显示器 920, 用于对图像信号复用器 910合成的视频编码信号进行解码, 并在本会场的同一显示屏幕上进行显示。
进一步的,信号收发器 900 ,还用于接收其它会场发来的与第一指定用户 处在同一会场中的至少一个第二指定用户的视频图像信号。
当信号收发器 900还接收至少一个第二指定用户的视频图像信号时, 图 像信号复用器 910, 具体用于分别将信号收发器 900接收到的第一指定用户、 至少一个第二指定用户的视频图像信号和会议材料的视频数据信号合成一路 视频编码信号。
参阅图 10A所示, 本发明实施例还提出一种视频会议中会议材料的显示 装置, 该显示装置包括:
信号解码单元 10, 用于获得将第一指定用户的视频图像信号和会议材料 的视频数据信号合成的一路视频编码信号, 并对获得的一路视频编码信号解 码;
屏幕切割单元 11 , 用于将本会场的任意一个显示屏幕虚拟切割为预设数 量的子显示屏幕;
呈现单元 12,用于将信号解码单元 10解码得到的会议材料的视频图像在 屏幕切割单元 11切割得到的至少一个子显示屏幕中进行显示, 并将信号解码 单元 10解码得到的第一指定用户的视频图像在屏幕切割单元 11切割得到的 至少一个其它子显示屏幕中进行显示。
进一步的, 信号解码单元 10获得的一路视频编码信号中还包括有至少一 个第二指定用户的视频图像信号; 此时, 呈现单元 12, 还用于将信号解码单 元 10解码得到的至少一个第二指定用户的视频图像在屏幕切割单元 11切割 得到的至少一个其它子显示屏幕中进行显示。
较佳的, 呈现单元 12, 具体用于将信号解码单元 10解码得到的会议材料 的视频图像在屏幕切割单元 11切割得到的至少两个相邻的子显示屏幕中进行 显示。
较佳的, 呈现单元 12, 具体用于将信号解码单元 10解码得到的每个指定 用户的视频图像分别在屏幕切割单元 11切割得到任意一个子显示屏幕中进行 显示; 或者, 将信号解码单元 10解码得到的至少两个指定用户的视频图像在 屏幕切割单元 11切割得到任意一个子显示屏幕中进行显示。
较佳的, 呈现单元 12具体用于, 在屏幕切割单元 11切割得到的任意一 个子显示屏幕显示信号解码单元 10解码得到的第一指定用户的视频图像; 在 与选择的该子显示屏幕相邻、 且与显示屏幕中心区域靠近的子显示屏幕中, 显示信号解码单元 10解码得到的会议材料的视频图像。
进一步的, 呈现单元 12还用于, 在其中一个第二指定用户的角色变更为 第一指定用户的角色时, 确定与显示有变更角色的第二指定用户的视频图像 的子显示屏幕相邻的至少一个子显示屏幕; 将原来显示有会议材料的视频图 像的至少一个子显示屏幕中的视频图像, 与确定的至少一个子显示屏幕中的 视频图像进行交换显示。
进一步的, 呈现单元 12还用于, 其中一个第二指定用户发言时, 确定与 显示会议材料的视频图像的子显示屏幕相邻的、 且与显示第一指定用户的视 频图像的子显示屏幕不同的至少一个子显示屏幕; 将原来显示有发言的第二 指定用户的视频图像的子显示屏幕中的视频图像, 与确定的至少一个子显示 屏幕中的视频图像进行交换显示。
参阅图 10B所示, 本发明实施例还提出一种会议终端, 该会议终端包括: 信号收发器 100,用于获得将第一指定用户的视频图像信号和会议材料的 视频数据信号合成的一路视频编码信号;
信号解码器 no,用于对信号收发器 100获得的一路视频编码信号进行解 码;
处理器 120,用于将本会场的任意一个显示屏幕虚拟切割为预设数量的子 显示屏幕, 并将信号解码器 110解码得到的会议材料的视频图像在切割得到 的至少一个子显示屏幕中进行显示, 并将信号解码器 110解码得到的第一指 定用户的视频图像在切割得到的至少一个其它子显示屏幕中进行显示。
进一步的, 信号收发器 100获得的一路视频编码信号中还包括有至少一 个第二指定用户的视频图像信号; 此时, 处理器 120 , 还用于将信号解码器 110解码得到的至少一个第二指定用户的视频图像在处理器 120切割得到的至 少一个其它子显示屏幕中进行显示。
较佳的, 处理器 120 , 具体用于将信号解码器 110解码得到的会议材料的 视频图像在切割得到的至少两个相邻的子显示屏幕中进行显示。 较佳的, 处理器 120 , 具体用于将信号解码器 110解码得到的每个指定用 户的视频图像分别在切割得到任意一个子显示屏幕中进行显示; 或者, 将信 号解码器 110解码得到的至少两个指定用户的视频图像在切割得到任意一个 子显示屏幕中进行显示。
较佳的, 处理器 120具体用于, 在切割得到的任意一个子显示屏幕显示 信号解码器 110解码得到的第一指定用户的视频图像; 在与选择的该子显示 屏幕相邻、且与显示屏幕中心区域靠近的子显示屏幕中, 显示信号解码器 110 解码得到的会议材料的视频图像。
进一步的, 处理器 120还用于, 在其中一个第二指定用户的角色变更为 第一指定用户的角色时, 确定与显示有变更角色的第二指定用户的视频图像 的子显示屏幕相邻的至少一个子显示屏幕; 将原来显示有会议材料的视频图 像的至少一个子显示屏幕中的视频图像, 与确定的至少一个子显示屏幕中的 视频图像进行交换显示。
进一步的, 处理器 120还用于, 其中一个第二指定用户发言时, 确定与 显示会议材料的视频图像的子显示屏幕相邻的、 且与显示第一指定用户的视 频图像的子显示屏幕不同的至少一个子显示屏幕; 将原来显示有发言的第二 指定用户的视频图像的子显示屏幕中的视频图像, 与确定的至少一个子显示 屏幕中的视频图像进行交换显示。
综上所述, 本发明实施例中, 提出三种远程会议中会议材料的显示方法: 其中一种为先确定第一指定用户在会场中的位置坐标, 再釆集会场的视频图 像信号, 并根据位置坐标对会场的视频图像信号进行切割, 获取第一指定用 户的视频图像信号, 然后, 获取显示的会议材料的视频数据信号, 并将第一 指定用户的视频图像信号和会议材料的视频数据信号合成一路视频编码信号 后, 发送至其它会场进行信号解码并在其它会场的同一显示屏幕上进行显示, 在该方案中, 通过将获取得到的第一指定用户的视频图像信号和会议材料的 视频数据信号进行一路编码, 然后, 发送至其它会场, 并在其它会场的同一 显示屏幕中进行显示, 实现了第一指定用户的视频图像和会议材料的视频图 像在同一会场中的同一显示屏幕进行显示的效果, 由于只需要用一个显示屏 幕对会议材料与第一指定用户进行同时显示, 有效避免了视频会议系统不易 搬移、 成本较高、 及灵活性较差的问题, 同时, 由于参会人员同时关注会议 材料和第一指定用户时, 不需要在显示会议材料的视频图像的显示屏幕和显 示第一指定用户的视频图像的显示屏幕之间进行视觉转移, 因此, 提高了视 频会议的效率, 还提高了用户体验; 另一种为接收到其它会场发送的第一指 定用户的视频图像信号和会议材料的视频数据信号后, 将接收到的第一指定 用户的视频图像信号和会议材料的视频数据信号合成一路视频编码信号, 并 对合成的一路视频编码信号进行解码后在本会场的同一显示屏幕上进行显 示, 在该方案中, 会场通过将接收到的第一指定用户的视频图像信号和会议 材料的视频数据信号进行一路编码, 并在本会场的同一显示屏幕中进行显示 , 实现了第一指定用户的视频图像和会议材料的视频图像在同一会场中的同一 显示屏幕进行显示的效果, 由于只需要用一个显示屏幕同时显示会议材料与 第一指定用户即可, 不需要用两个显示屏幕分别显示会议材料与第一指定用 户, 因此, 有效避免了由于屏幕较多导致的视频会议系统不易搬移、 成本较 高及灵活性较差的问题, 同时, 由于参会人员同时关注会议材料和第一指定 用户时, 不需要在显示会议材料的视频图像和显示第一指定用户的视频图像 的两个显示屏幕之间进行视觉转移, 因此, 提高了视频会议的效率, 还提高 了用户体验; 还有一种为, 获得将第一指定用户的视频图像信号和会议材料 的视频数据信号合成的一路视频编码信号; 对获得的合成的一路视频编码信 号解码, 并将本会场的任意一个显示屏幕虚拟切割为预设数量的子显示屏幕; 将解码得到的会议材料的视频图像在至少一个切割得到的子显示屏幕中进行 显示, 将解码得到的第一指定用户的视频图像在其它至少一个切割得到的子 显示屏幕中进行显示, 在该方案中, 会场获得将第一指定用户的视频图像信 号和会议材料的视频数据信号合成的一路视频编码信号后, 通过将本会场的 任意一个显示屏幕虚拟切割为预设数量的子显示屏幕, 并将解码得到的会议 材料的视频图像在至少一个切割得到的子显示屏幕中进行显示, 将解码得到 的第一指定用户的视频图像在其它至少一个切割得到的子显示屏幕中进行显 示, 实现了第一指定用户的视频图像和会议材料的视频图像在同一会场中的 同一显示屏幕进行显示的效果, 由于会议材料与第一指定用户仅在一个显示 屏幕的不同子显示屏幕中显示, 不需要用两个显示屏幕分别显示会议材料与 第一指定用户, 因此, 有效避免了由于屏幕较多导致的视频会议系统不易搬 移、 成本较高及灵活性较差的问题, 同时, 由于参会人员同时关注会议材料 和第一指定用户时, 不需要在显示会议材料的视频图像和显示第一指定用户 的视频图像的两个显示屏幕之间进行视觉转移, 因此, 提高了视频会议的效 率, 还提高了用户体验。
本发明是参照根据本发明实施例的方法、 设备(系统) 、 和计算机程序 产品的流程图和 /或方框图来描述的。 应理解可由计算机程序指令实现流程 图和 /或方框图中的每一流程和 /或方框、 以及流程图和 /或方框图中的流 程和 /或方框的结合。 可提供这些计算机程序指令到通用计算机、 专用计算 机、 嵌入式处理机或其它可编程数据处理设备的处理器以产生一个机器, 使 得通过计算机或其它可编程数据处理设备的处理器执行的指令产生用于实现 在流程图一个流程或多个流程和 /或方框图一个方框或多个方框中的功能的 装置。
这些计算机程序指令也可存储在能引导计算机或其它可编程数据处理设 备以特定方式工作的计算机可读存储器中, 使得存储在该计算机可读存储器 中的指令产生包括指令装置的制造品, 该指令装置实现在流程图一个流程或 多个流程和 /或方框图一个方框或多个方框中的功能。
这些计算机程序指令也可装载到计算机或其它可编程数据处理设备上, 使得在计算机或其它可编程设备上执行一系列操作步骤以产生计算机实现的 处理, 从而在计算机或其它可编程设备上执行的指令提供用于实现在流程图 一个流程或多个流程和 /或方框图一个方框或多个方框中的功能的步骤。
尽管已描述了本发明的优选实施例, 但本领域内的技术人员一旦得知了 基本创造性概念, 则可对这些实施例作出另外的变更和修改。 所以, 所附权 利要求意欲解释为包括优选实施例以及落入本发明范围的所有变更和修改。 脱离本发明实施例的精神和范围。 这样, 倘若本发明实施例的这些修改和变 型属于本发明权利要求及其等同技术的范围之内, 则本发明也意图包含这些 改动和变型在内。

Claims

权 利 要 求
1、 一种视频会议中会议材料的显示方法, 其特征在于, 包括: 确定第一指定用户在会场中的位置坐标;
釆集所述会场的视频图像信号, 并根据所述位置坐标对所述会场的视频 图像信号进行切割, 获取所述第一指定用户的视频图像信号, 并获取显示的 会议材料的视频数据信号;
将所述第一指定用户的视频图像信号和所述会议材料的视频数据信号合 成一路视频编码信号后, 发送至其它会场进行信号解码并在所述其它会场的 同一显示屏幕上进行显示。
2、 如权利要求 1所述的方法, 其特征在于, 还包括:
确定与所述第一指定用户处在同一会场中的至少一个第二指定用户在会 场中的位置坐标;
并根据确定的至少一个第二指定用户的位置坐标对所述会场的视频图像 信号进行切割, 分别获取每个所述第二指定用户的视频图像信号;
将所述第一指定用户的视频图像信号和所述会议材料的视频数据信号合 成一路视频编码信号, 包括:
将所述第一指定用户、 所述至少一个第二指定用户的视频图像信号和所 述会议材料的视频数据信号合成一路视频编码信号。
3、 如权利要求 1或 2所述的方法, 其特征在于, 确定指定用户在会场中 的位置坐标, 包括:
釆用听声辩位技术确定指定用户在会场中的位置坐标; 或者
基于位置定位器确定指定用户在会场中的位置坐标。
4、 如权利要求 1或 2所述的方法, 其特征在于, 根据位置坐标对会场的 视频图像信号进行切割, 获取指定用户的视频图像信号, 包括:
将位置坐标与会场的视频图像信号的空间位置坐标进行匹配, 得出指定 用户的视频图像信号在所述会场的视频图像信号中的位置; 对所述位置处的视频图像信号通过人脸识别技术确定出所述指定用户的 视频图像;
在与所述指定用户的图像相距预设距离处对所述会场的视频图像信号进 行切割, 获取指定用户的视频图像信号。
5、 一种视频会议中会议材料的显示方法, 其特征在于, 包括: 接收其它会场发送的第一指定用户的视频图像信号和会议材料的视频数 据信号;
将接收到的所述第一指定用户的视频图像信号和所述会议材料的视频数 据信号合成一路视频编码信号;
对合成的视频编码信号进行解码, 并在本会场的同一显示屏幕上进行显 示。
6、 如权利要求 5所述的方法, 其特征在于, 还包括:
接收其它会场发来的与所述第一指定用户处在同一会场中的至少一个第 二指定用户的视频图像信号;
将接收到的所述第一指定用户的视频图像信号和所述会议材料的视频数 据信号合成一路视频编码信号, 包括:
分别将接收到的所述第一指定用户的视频图像信号、 所述至少一个第二 指定用户的视频图像信号和会议材料的视频数据信号合成一路视频编码信 号。
7、 一种视频会议中会议材料的显示方法, 其特征在于, 包括: 获得将第一指定用户的视频图像信号和会议材料的视频数据信号合成的 一路视频编码信号;
对获得的一路视频编码信号解码, 并将本会场的任意一个显示屏幕虚拟 切割为预设数量的子显示屏幕;
将解码得到的会议材料的视频图像在所述任意一个显示屏幕中的至少一 个切割得到的子显示屏幕中进行显示, 并将解码得到的所述第一指定用户的 视频图像在所述任意一个显示屏幕中的其它至少一个切割得到的子显示屏幕 中进行显示。
8、 如权利要求 7所述的方法, 其特征在于, 所述获得的一路视频编码信 号中还包括有至少一个第二指定用户的视频图像信号;
所述方法还包括:
将解码得到的所述至少一个第二指定用户的视频图像在所述其它至少一 个切割得到的子显示屏幕中进行显示。
9、 如权利要求 7所述的方法, 其特征在于, 将解码得到的会议材料的视 频图像在所述任意一个显示屏幕中的至少一个切割得到的子显示屏幕中进行 显示, 包括:
将解码得到的会议材料的视频图像在所述任意一个显示屏幕中的相邻的 至少两个切割得到的子显示屏幕中进行显示。
10、 如权利要求 8 所述的方法, 其特征在于, 将解码得到的指定用户的 视频图像显示在所述任意一个显示屏幕中的其它至少一个切割得到的子显示 屏幕中, 包括:
将解码得到的每个指定用户的视频图像分别在所述任意一个显示屏幕中 的任意一个切割得到的子显示屏幕中进行显示; 或者
将解码得到的至少两个指定用户的视频图像在所述任意一个显示屏幕中 的任意一个切割得到的子显示屏幕中进行显示。
11、 如权利要求 7 所述的方法, 其特征在于, 将会议材料的视频图像在 所述任意一个显示屏幕中的至少一个切割得到的子显示屏幕中显示, 并将第 一指定用户的视频图像在所述任意一个显示屏幕中的其它至少一个切割得到 的子显示屏幕中进行显示, 包括:
在切割得到的所述任意一个显示屏幕中的全部子显示屏幕中选择一个子 显示屏幕显示解码得到的所述第一指定用户的视频图像;
在与选择的该子显示屏幕相邻、 且与所述显示屏幕中心区域靠近的子显 示屏幕中, 显示选择解码得到的所述会议材料的视频图像。
12、 如权利要求 8所述的方法, 其特征在于, 还包括: 在其中一个第二指定用户的角色变更为第一指定用户的角色时, 确定与 显示有变更角色的第二指定用户的视频图像的子显示屏幕相邻的至少一个子 显示屏幕;
将原来显示有所述会议材料的视频图像的至少一个子显示屏幕中的视频 图像, 与确定的至少一个子显示屏幕中的视频图像进行交换显示。
13、 如权利要求 8所述的方法, 其特征在于, 还包括:
其中一个第二指定用户发言时, 确定与显示所述会议材料的视频图像的 子显示屏幕相邻的、 且与显示所述第一指定用户的视频图像的子显示屏幕不 同的至少一个子显示屏幕;
将原来显示有发言的第二指定用户的视频图像的子显示屏幕中的视频图 像, 与确定的至少一个子显示屏幕中的视频图像进行交换显示。
14、 一种视频会议中会议材料的显示装置, 其特征在于, 包括: 确定单元, 用于确定第一指定用户在会场中的位置坐标;
图像信号获取单元, 用于釆集所述会场的视频图像信号, 并根据所述确 定单元确定的位置坐标对所述会场的视频图像信号进行切割, 获取所述第一 指定用户的视频图像信号, 并获取显示的会议材料的视频数据信号;
通信单元, 用于将所述图像信号获取单元获取的第一指定用户的视频图 像信号和所述会议材料的视频数据信号合成一路视频编码信号后, 发送至其 它会场进行信号解码并在所述其它会场的同一显示屏幕上进行显示。
15、 如权利要求 14所述的装置, 其特征在于, 所述确定单元, 还用于确 定与所述第一指定用户处在同一会场中的至少一个第二指定用户在会场中的 位置坐标;
图像信号获取单元, 还用于根据所述确定单元确定的的至少一个第二指 定用户的位置坐标对所述会场的视频图像信号进行切割, 分别获取每个所述 第二指定用户的视频图像信号;
所述通信单元, 具体用于将所述图像信号获取单元分别获取的所述第一 指定用户、 所述至少一个第二指定用户的视频图像信号和所述会议材料的视 频数据信号合成一路视频编码信号后, 发送至其它会场进行信号解码并在所 述其它会场的同一显示屏幕上进行显示。
16、 如权利要求 14或 15所述的装置, 其特征在于, 所述确定单元, 具 体用于釆用听声辩位技术确定指定用户在会场中的位置坐标; 或者, 基于位 置定位器确定指定用户在会场中的位置坐标。
17、 如权利要求 14或 15所述的装置, 其特征在于, 所述图像信号获取 单元, 具体用于将位置坐标与会场的视频图像信号的空间位置坐标进行匹配, 得出指定用户的视频图像信号在所述会场的视频图像信号中的位置; 并对所 述位置处的视频图像信号通过人脸识别技术确定出所述指定用户的视频图 像; 以及在与所述指定用户的图像相距预设距离处对所述会场的视频图像信 号进行切割, 获取指定用户的视频图像信号。
18、 一种会议终端, 其特征在于, 包括:
图像信号处理器, 用于确定第一指定用户在会场中的位置坐标, 釆集所 述会场的视频图像信号, 并根据位置坐标对所述会场的视频图像信号进行切 割, 获取所述第一指定用户的视频图像信号, 以及获取显示的会议材料的视 频数据信号;
图像信号复用器, 用于将图像信号处理器获取的第一指定用户的视频图 像信号和所述会议材料的视频数据信号合成一路视频编码信号;
信号收发器, 用于将图像信号复用器合成的一路视频编码信号发送至其 它会场进行信号解码, 并在所述其它会场的同一显示屏幕上进行显示。
19、如权利要求 18所述的会议终端, 其特征在于, 所述图像信号处理器, 还用于确定与所述第一指定用户处在同一会场中的至少一个第二指定用户在 会场中的位置坐标, 并根据确定的至少一个第二指定用户的位置坐标对所述 会场的视频图像信号进行切割, 分别获取每个所述第二指定用户的视频图像 信号;
图像信号复用器, 具体用于将所述图像信号处理器分别获取的所述第一 指定用户、 所述至少一个第二指定用户的视频图像信号和所述会议材料的视 频数据信号合成一路视频编码信号。
20、 如权利要求 18或 19所述的会议终端, 其特征在于, 所述图像信号 处理器, 具体用于釆用听声辩位技术确定指定用户在会场中的位置坐标; 或 者, 基于位置定位器确定指定用户在会场中的位置坐标。
21、 如权利要求 18或 19所述的会议终端, 其特征在于, 所述图像信号 处理器, 具体用于将位置坐标与会场的视频图像信号的空间位置坐标进行匹 配, 得出指定用户的视频图像信号在所述会场的视频图像信号中的位置; 并 对所述位置处的视频图像信号通过人脸识别技术确定出所述指定用户的视频 图像; 以及在与所述指定用户的图像相距预设距离处对所述会场的视频图像 信号进行切割, 获取指定用户的视频图像信号。
22、 一种视频会议中会议材料的显示装置, 其特征在于, 包括: 通信单元, 用于接收其它会场发送的第一指定用户的视频图像信号和会 议材料的视频数据信号, 并将接收到的所述第一指定用户的视频图像信号和 所述会议材料的视频数据信号合成一路视频编码信号;
呈现单元, 用于对所述通信单元合成的视频编码信号进行解码, 并在本 会场的同一显示屏幕上进行显示。
23、 如权利要求 22所述的装置, 其特征在于, 所述通信单元, 还用于接 收其它会场发来的与所述第一指定用户处在同一会场中的至少一个第二指定 用户的视频图像信号, 以及将所述接收收到的至少一个第二指定用户的视频 图像信号合成到已合成的一路视频编码信号中。
24、 一种会议终端, 其特征在于, 包括:
信号收发器, 用于接收其它会场发送的第一指定用户的视频图像信号和 会议材料的视频数据信号;
图像信号复用器, 用于将所述信号收发器接收到的所述第一指定用户的 视频图像信号和所述会议材料的视频数据信号合成一路视频编码信号;
显示器, 用于对图像信号复用器合成的视频编码信号进行解码, 并在本 会场的同一显示屏幕上进行显示。
25、 如权利要求 24所述的会议终端, 其特征在于, 所述信号收发器, 还 用于接收其它会场发来的与所述第一指定用户处在同一会场中的至少一个第 二指定用户的视频图像信号;
所述图像信号复用器, 具体用于分别将所述信号收发器接收到的第一指 定用户、 至少一个第二指定用户的视频图像信号和会议材料的视频数据信号 合成一路视频编码信号。
26、 一种视频会议中会议材料的显示装置, 其特征在于, 包括: 信号解码单元, 用于获得将第一指定用户的视频图像信号和会议材料的 视频数据信号合成的一路视频编码信号, 并对获得的一路视频编码信号解码; 屏幕切割单元, 用于将本会场的任意一个显示屏幕虚拟切割为预设数量 的子显示屏幕;
呈现单元, 用于将所述信号解码单元解码得到的会议材料的视频图像在 所述屏幕切割单元切割得到的至少一个子显示屏幕中进行显示, 并将所述信 号解码单元解码得到的所述第一指定用户的视频图像在所述屏幕切割单元切 割得到的至少一个其它子显示屏幕中进行显示。
27、 如权利要求 26所述的装置, 其特征在于, 所述信号解码单元获得的 一路视频编码信号中还包括有至少一个第二指定用户的视频图像信号;
所述呈现单元, 还用于将所述信号解码单元解码得到的所述至少一个第 二指定用户的视频图像在所述屏幕切割单元切割得到的至少一个其它子显示 屏幕中进行显示。
28、 如权利要求 26所述的装置, 其特征在于, 所述呈现单元, 具体用于 将信号解码单元解码得到的会议材料的视频图像在所述屏幕切割单元切割得 到的至少两个相邻的子显示屏幕中进行显示。
29、 如权利要求 27所述的装置, 其特征在于, 所述呈现单元, 具体用于 将所述信号解码单元解码得到的每个指定用户的视频图像分别在所述屏幕切 割单元切割得到任意一个子显示屏幕中进行显示; 或者, 将所述信号解码单 元解码得到的至少两个指定用户的视频图像在所述屏幕切割单元切割得到任 意一个子显示屏幕中进行显示。
30、 如权利要求 26所述的装置, 其特征在于, 所述呈现单元具体用于, 在所述屏幕切割单元切割得到的任意一个子显示屏幕显示所述信号解码单元 解码得到的所述第一指定用户的视频图像; 在与选择的该子显示屏幕相邻、 且与所述显示屏幕中心区域靠近的子显示屏幕中, 显示所述信号解码单元解 码得到的所述会议材料的视频图像。
31、 如权利要求 27所述的装置, 其特征在于, 所述呈现单元还用于, 在 其中一个第二指定用户的角色变更为第一指定用户的角色时, 确定与显示有 变更角色的第二指定用户的视频图像的子显示屏幕相邻的至少一个子显示屏 幕; 将原来显示有所述会议材料的视频图像的至少一个子显示屏幕中的视频 图像, 与确定的至少一个子显示屏幕中的视频图像进行交换显示。
32、 如权利要求 27所述的装置, 其特征在于, 所述呈现单元还用于, 其 中一个第二指定用户发言时, 确定与显示所述会议材料的视频图像的子显示 屏幕相邻的、 且与显示所述第一指定用户的视频图像的子显示屏幕不同的至 少一个子显示屏幕; 将原来显示有发言的第二指定用户的视频图像的子显示 屏幕中的视频图像, 与确定的至少一个子显示屏幕中的视频图像进行交换显 示。
33、 一种会议终端, 其特征在于, 包括:
信号收发器, 用于获得将第一指定用户的视频图像信号和会议材料的视 频数据信号合成的一路视频编码信号;
信号解码器, 用于对所述信号收发器获得的一路视频编码信号进行解码; 处理器, 用于将本会场的任意一个显示屏幕虚拟切割为预设数量的子显 示屏幕, 并将所述信号解码器解码得到的会议材料的视频图像在切割得到的 至少一个子显示屏幕中进行显示, 并将所述信号解码器解码得到的所述第一 指定用户的视频图像在切割得到的至少一个其它子显示屏幕中进行显示。
34、 如权利要求 33所述的会议终端, 其特征在于, 所述信号收发器获得 的一路视频编码信号中还包括有至少一个第二指定用户的视频图像信号; 所述处理器, 还用于将所述信号解码器解码得到的所述至少一个第二指 定用户的视频图像在所述处理器切割得到的至少一个其它子显示屏幕中进行 显示。
35、 如权利要求 33所述的会议终端, 其特征在于, 所述处理器, 具体用 于将所述信号解码器解码得到的会议材料的视频图像在切割得到的至少两个 相邻的子显示屏幕中进行显示。
36、 如权利要求 34所述的会议终端, 其特征在于, 所述处理器, 具体用 于将所述信号解码器解码得到的每个指定用户的视频图像分别在切割得到任 意一个子显示屏幕中进行显示; 或者, 将所述信号解码器解码得到的至少两 个指定用户的视频图像在切割得到任意一个子显示屏幕中进行显示。
37、如权利要求 33所述的会议终端, 其特征在于, 所述处理器具体用于, 在切割得到的任意一个子显示屏幕显示所述信号解码器解码得到的所述第一 指定用户的视频图像; 在与选择的该子显示屏幕相邻、 且与所述显示屏幕中 心区域靠近的子显示屏幕中, 显示所述信号解码器解码得到的所述会议材料 的视频图像。
38、 如权利要求 34所述的会议终端, 其特征在于, 所述处理器还用于, 在其中一个第二指定用户的角色变更为第一指定用户的角色时, 确定与显示 有变更角色的第二指定用户的视频图像的子显示屏幕相邻的至少一个子显示 屏幕; 将原来显示有所述会议材料的视频图像的至少一个子显示屏幕中的视 频图像, 与确定的至少一个子显示屏幕中的视频图像进行交换显示。
39、 如权利要求 34所述的会议终端, 其特征在于, 所述处理器还用于, 其中一个第二指定用户发言时, 确定与显示所述会议材料的视频图像的子显 示屏幕相邻的、 且与显示所述第一指定用户的视频图像的子显示屏幕不同的 至少一个子显示屏幕; 将原来显示有发言的第二指定用户的视频图像的子显 示屏幕中的视频图像, 与确定的至少一个子显示屏幕中的视频图像进行交换 显示。
PCT/CN2013/085260 2013-04-22 2013-10-15 一种视频会议中会议材料的显示方法及装置 WO2014173091A1 (zh)

Priority Applications (2)

Application Number Priority Date Filing Date Title
EP13882946.0A EP2961158A4 (en) 2013-04-22 2013-10-15 METHOD AND DEVICE FOR DISPLAYING CONFERENCE MATERIAL IN A VIDEOCONFERENCE
US14/856,755 US9491405B2 (en) 2013-04-22 2015-09-17 Method and apparatus for displaying conference material in video conference

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201310140460.XA CN104113721B (zh) 2013-04-22 2013-04-22 一种视频会议中会议材料的显示方法及装置
CN201310140460.X 2013-04-22

Related Child Applications (1)

Application Number Title Priority Date Filing Date
US14/856,755 Continuation US9491405B2 (en) 2013-04-22 2015-09-17 Method and apparatus for displaying conference material in video conference

Publications (1)

Publication Number Publication Date
WO2014173091A1 true WO2014173091A1 (zh) 2014-10-30

Family

ID=51710341

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2013/085260 WO2014173091A1 (zh) 2013-04-22 2013-10-15 一种视频会议中会议材料的显示方法及装置

Country Status (4)

Country Link
US (1) US9491405B2 (zh)
EP (1) EP2961158A4 (zh)
CN (1) CN104113721B (zh)
WO (1) WO2014173091A1 (zh)

Families Citing this family (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105991962B (zh) * 2015-02-03 2020-08-18 阿里巴巴集团控股有限公司 连接方法、信息展示方法、装置及系统
US9674453B1 (en) * 2016-10-26 2017-06-06 Cisco Technology, Inc. Using local talker position to pan sound relative to video frames at a remote location
CN108683874B (zh) * 2018-05-16 2020-09-11 瑞芯微电子股份有限公司 一种视频会议注意力聚焦的方法及一种存储设备
CN109862419B (zh) * 2018-11-09 2021-08-03 广州长嘉电子有限公司 一种智能数字激光电视交互方法及系统
US11425502B2 (en) 2020-09-18 2022-08-23 Cisco Technology, Inc. Detection of microphone orientation and location for directional audio pickup
CN112616035B (zh) * 2020-11-23 2023-09-19 深圳市捷视飞通科技股份有限公司 多画面拼接方法、装置、计算机设备和存储介质
US11824647B2 (en) * 2020-12-09 2023-11-21 Microsoft Technology Licensing, Llc Promotion of users in collaboration sessions
US11115625B1 (en) 2020-12-14 2021-09-07 Cisco Technology, Inc. Positional audio metadata generation
CN112887654B (zh) * 2021-01-25 2022-05-31 联想(北京)有限公司 一种会议设备、会议系统及数据处理方法
CN113573153B (zh) * 2021-02-02 2022-08-12 腾讯科技(深圳)有限公司 图像处理方法、装置及设备

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20050264648A1 (en) * 2004-05-25 2005-12-01 Victor Ivashin Local video loopback method for a multi-participant conference system using a back-channel video interface
CN101826168A (zh) * 2009-03-06 2010-09-08 新奥特硅谷视频技术有限责任公司 一种远程数字化庭审系统
CN101828392A (zh) * 2007-10-19 2010-09-08 创新科技有限公司 用于处理合成视频图像的方法和系统
CN102638672A (zh) * 2011-02-09 2012-08-15 宝利通公司 用于多流多站点远程呈现会议系统的自动视频布局

Family Cites Families (12)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20030160862A1 (en) * 2002-02-27 2003-08-28 Charlier Michael L. Apparatus having cooperating wide-angle digital camera system and microphone array
US8487956B2 (en) * 2005-11-29 2013-07-16 Kyocera Corporation Communication terminal, system and display method to adaptively update a displayed image
JP2010157906A (ja) * 2008-12-26 2010-07-15 Canon Inc 映像表示装置
US9628722B2 (en) * 2010-03-30 2017-04-18 Personify, Inc. Systems and methods for embedding a foreground video into a background feed based on a control input
US8624955B2 (en) * 2011-06-02 2014-01-07 Microsoft Corporation Techniques to provide fixed video conference feeds of remote attendees with attendee information
US20130147901A1 (en) * 2011-12-07 2013-06-13 Reginald Weiser Systems and methods for video enabling pbx systems without a sip stack
US20130198629A1 (en) * 2012-01-28 2013-08-01 Microsoft Corporation Techniques for making a media stream the primary focus of an online meeting
JP6171263B2 (ja) * 2012-03-19 2017-08-02 株式会社リコー 遠隔会議システム及び遠隔会議端末
US8963986B2 (en) * 2012-07-26 2015-02-24 Cisco Technology, Inc. System and method for scaling a video presentation based on presentation complexity and room participants
US8890923B2 (en) * 2012-09-04 2014-11-18 Cisco Technology, Inc. Generating and rendering synthesized views with multiple video streams in telepresence video conference sessions
US9076028B2 (en) * 2012-10-08 2015-07-07 Citrix Systems, Inc. Facial recognition and transmission of facial images in a videoconference
US9019337B2 (en) * 2013-02-21 2015-04-28 Avaya Inc. System and method for managing a presentation

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20050264648A1 (en) * 2004-05-25 2005-12-01 Victor Ivashin Local video loopback method for a multi-participant conference system using a back-channel video interface
CN101828392A (zh) * 2007-10-19 2010-09-08 创新科技有限公司 用于处理合成视频图像的方法和系统
CN101826168A (zh) * 2009-03-06 2010-09-08 新奥特硅谷视频技术有限责任公司 一种远程数字化庭审系统
CN102638672A (zh) * 2011-02-09 2012-08-15 宝利通公司 用于多流多站点远程呈现会议系统的自动视频布局

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
See also references of EP2961158A4 *

Also Published As

Publication number Publication date
EP2961158A1 (en) 2015-12-30
US20160006984A1 (en) 2016-01-07
EP2961158A4 (en) 2016-03-16
US9491405B2 (en) 2016-11-08
CN104113721B (zh) 2017-08-18
CN104113721A (zh) 2014-10-22

Similar Documents

Publication Publication Date Title
WO2014173091A1 (zh) 一种视频会议中会议材料的显示方法及装置
US8379075B2 (en) Method, device, and computer-readable medium for processing images during video conferencing
US9497390B2 (en) Video processing method, apparatus, and system
WO2008141539A1 (fr) Procédé d'affichage de légendes, système et appareil de communication vidéo
CN101939989B (zh) 虚拟桌子
CN101478642A (zh) 视频会议系统的多画面混图方法及装置
CN103051864B (zh) 移动视频会议方法
CN100562094C (zh) 一种会议电视系统中的多画面远端摄像机遥控方法
KR101577986B1 (ko) 양방향 가상 현실 구현 시스템
WO2010045857A1 (zh) 会议终端、会议服务器、会议系统及数据处理方法
CN105959613A (zh) 数字会议设备和系统
CN101198008A (zh) 一种实现多屏多画面的方法和系统
WO2011140812A1 (zh) 多画面合成方法、系统及媒体处理装置
US9661273B2 (en) Video conference display method and device
WO2008120125A1 (en) A device for and a method of processing image data representative of an object
CN104980683A (zh) 一种视频电话会议的实现方法及装置
CN101729850A (zh) 基于笔迹特征数据流的视频通信方法及其处理系统
WO2014094461A1 (zh) 视频会议中的视音频信息的处理方法、装置及系统
CN102348097B (zh) 视频会议中的对话方法及多点控制单元
WO2014177082A1 (zh) 一种视频会议中处理视频的方法及终端
WO2016206471A1 (zh) 多媒体业务处理方法、系统及装置
CN103533294B (zh) 视频数据流的发送方法、终端及系统
KR20120009948A (ko) 휴대용 단말기에서 입체 영상 데이터를 생성하기 위한 장치 및 방법
JPH0670040A (ja) 多地点テレビ会議システムにおける表示形態変更方式
JP2823571B2 (ja) 分散多地点通信会議装置

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 13882946

Country of ref document: EP

Kind code of ref document: A1

WWE Wipo information: entry into national phase

Ref document number: 2013882946

Country of ref document: EP

NENP Non-entry into the national phase

Ref country code: DE