WO2015192631A1 - Video conferencing system and method - Google Patents

Video conferencing system and method Download PDF

Info

Publication number
WO2015192631A1
WO2015192631A1 PCT/CN2014/095179 CN2014095179W WO2015192631A1 WO 2015192631 A1 WO2015192631 A1 WO 2015192631A1 CN 2014095179 W CN2014095179 W CN 2014095179W WO 2015192631 A1 WO2015192631 A1 WO 2015192631A1
Authority
WO
WIPO (PCT)
Prior art keywords
information
video conference
video
audio
display
Prior art date
Application number
PCT/CN2014/095179
Other languages
French (fr)
Chinese (zh)
Inventor
张泽良
谭笑
李军
黄云鹏
Original Assignee
中兴通讯股份有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 中兴通讯股份有限公司 filed Critical 中兴通讯股份有限公司
Publication of WO2015192631A1 publication Critical patent/WO2015192631A1/en

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00Television systems
    • H04N7/14Systems for two-way working
    • H04N7/15Conference systems

Definitions

  • the present invention relates to the field of communications, and in particular to a video conferencing system and method.
  • the aerial touch screen technology mainly includes aerial imaging technology and laser time-of-flight (TOF) positioning technology, in which the aerial imaging technology forms a real image above the projection plate through the projection plate; the laser time-of-flight positioning technology passes through
  • the screen capture device acquires the laser flight time and calculates the distance from the object based on the laser flight time.
  • the laser time-of-flight positioning technology can capture the user's action on the real image of the aerial imaging technology.
  • video conferences mostly use conference terminals + display devices.
  • the video projection control or the input of text and images is generally performed by means of a mouse or a keyboard; even if some display devices have been added with a touch function, the touch position is fixed and the display size is fixed, and still exists. Control single, single interaction and other issues.
  • the embodiment of the present invention provides a video conference system and method, to at least solve the problem of poor user operation or experience caused by fixed display size and/or display position of a video conference screen projection in a video conference system in the related art.
  • a video conferencing system includes: a control processing device, a plurality of projection display devices, a plurality of image capturing devices, and a plurality of audio capturing devices, wherein the plurality of projection display devices are The current conference site center is disposed to be circumferentially disposed, and is configured to respectively project a plurality of video conference screens according to the control information and the data information sent by the control processing device, wherein the control information is used to indicate a part of the plurality of video conference screens Or the location and/or size of the video conference screen projection display; the plurality of image capture devices configured to capture environmental information of the current conference site and transmit the environmental information to the control processing device; a plurality of audio capture devices configured to capture audio information of the current conference site and transmit the audio information to the control processing device; the control processing device respectively associated with the plurality of projections The display device, the plurality of image capturing devices, and the plurality of audio capturing devices are connected, configured to generate the control information according to the received environmental information and/or
  • the projection display device includes: a display position adjustment unit configured to adjust a position of the plurality of video conference screens to be displayed according to the control information; and/or a display size adjustment unit, configured to Control information, adjusting the size of the projection display of the plurality of video conference screens.
  • the plurality of image capturing devices are disposed facing the conference site center around the current conference site, or are disposed around the center of the current conference site.
  • the plurality of audio capture devices are disposed facing the conference site center around the current conference site, or are disposed around the center of the current conference site.
  • the control processing device includes: a signal receiving unit, a first processing unit and/or a second processing unit, a control information generating unit, and a signal sending unit, wherein the signal receiving unit is configured to receive the environment Information and/or the audio information; the first processing unit is configured to determine, within the capture range of the image capture device corresponding to the environment information, according to image features in the environment information sent by the corresponding image capture device The second processing unit is configured to determine location information of the corresponding one or more audio sources in the audio information according to the audio information sent by the multiple audio capture devices; the control information a generating unit, configured to determine, according to the participant number information, a display size of a corresponding video conference screen in a capturing direction of the corresponding image capturing device, and/or determine a display size of the video conference screen corresponding thereto according to the location information / or display the location, and generate the control information according to the determined display size and / or display location; A signal transmitting unit configured to transmit the control information, and means for generating the video conference
  • the audio information includes volume information, and at least one of the following: frequency information, timbre information.
  • the plurality of projection display devices respectively form an aerial imaging technology to form the plurality of video conference screens.
  • the projection display device further includes: an operation action capturing unit configured to capture an operation action performed by the user on the plurality of video conference screens; and an operation action sending unit configured to send the information of the operation action To the control processing device.
  • control processing device further includes: an operation action analysis unit configured to parse the operation action as an operation instruction, wherein the operation instruction includes a display for indicating a current video conference screen An operation instruction for small and/or display position, and/or an operation instruction for inputting graphics and/or text information to a corresponding position in the currently displayed video conference screen; wherein the control information generation unit is further configured to The display size and/or display position of the currently operated video conference screen indicated by the operation instruction generates the control information.
  • control processing device further comprises: a data information processing unit configured to update the data information according to an operation for inputting graphics and/or text information to a corresponding position in the currently displayed video conference screen.
  • a data information processing unit configured to update the data information according to an operation for inputting graphics and/or text information to a corresponding position in the currently displayed video conference screen.
  • the video conferencing system further includes: a network interaction device, connected to the control processing device, configured to: the control processing device interacts with the control processing device in the video conferencing system as described above, and the data information and / or an operation instruction for inputting graphic and/or text information to a corresponding position in the currently displayed video conference screen.
  • a network interaction device connected to the control processing device, configured to: the control processing device interacts with the control processing device in the video conferencing system as described above, and the data information and / or an operation instruction for inputting graphic and/or text information to a corresponding position in the currently displayed video conference screen.
  • a video conferencing method comprising: acquiring environmental information and/or audio information of a current conference site, and data information indicating content of the video conference screen; according to the environmental information and/or And generating, by the audio information, a plurality of video conference screens according to the control information and the data information, where the control information is used to indicate some or all of the video conferences in the plurality of video conference screens.
  • the position and/or size of the screen projection display comprising: acquiring environmental information and/or audio information of a current conference site, and data information indicating content of the video conference screen; according to the environmental information and/or And generating, by the audio information, a plurality of video conference screens according to the control information and the data information, where the control information is used to indicate some or all of the video conferences in the plurality of video conference screens.
  • the method further includes: applying the aerial imaging technology to form the plurality of video conference pictures.
  • the environment information and/or audio information of the current conference site is acquired, and the data information indicating the content of the video conference screen is used; the control information is generated according to the environment information and/or the audio information; and the projection information is separately projected according to the control information and the data information.
  • a plurality of video conference screens wherein the control information is used to indicate a position and/or a size of a part or all of the video conference screens in the plurality of video conference screens, and the display size of the video conference screen projections in the video conference system is solved.
  • FIG. 1 is a schematic flowchart diagram of a video conference method according to an embodiment of the present invention
  • FIG. 2 is a schematic structural diagram of a video conference system according to an embodiment of the present invention.
  • FIG. 3 is a schematic diagram of a preferred structure of a video conference system according to an embodiment of the present invention.
  • FIG. 4 is a schematic diagram of a video conference initial model 0 according to an embodiment of the present invention.
  • FIG. 5 is a schematic diagram of a video conference initial model 1 according to an embodiment of the present invention.
  • FIG. 6 is a schematic diagram of a video conference interaction model according to an embodiment of the present invention.
  • FIG. 7 is a schematic diagram of a video conference interaction model-interaction in the same direction according to an embodiment of the present invention.
  • FIG. 8 is a schematic diagram of a video conference interaction model-multiple person sharing interaction according to an embodiment of the present invention.
  • FIG. 1 is a schematic flowchart of a video conference method according to an embodiment of the present invention. As shown in FIG. 1, the method includes the following steps:
  • Step S102 Acquire environment information and/or audio information of the current conference site, and data information indicating content of the video conference screen;
  • Step S104 generating control information according to environment information and/or audio information
  • Step S106 respectively projecting a plurality of video conference screens according to the control information and the data information, wherein the control information is used to indicate the position and/or size of the partial or full video conference screen projection display in the plurality of video conference screens.
  • the video conference screen projection display of different positions and/or sizes is performed by collecting environmental information and/or audio information, thereby solving the problem that the display size and/or the display position of the video conference screen projection in the video conference system is fixed.
  • the aerial imaging technology and the laser time-of-flight positioning technology for user operation acquisition the user's operation can be made more flexible and convenient by adjusting the display size and/or display position of the video conference screen projection.
  • an aerial imaging technique is applied in the above method to form a plurality of video conference pictures.
  • aerial imaging technologies include, but are not limited to, the technology disclosed by Panasonic Corporation or other well-known aerial imaging technologies.
  • a video conference system is provided in this embodiment.
  • the video conference system described in the system embodiment corresponds to the foregoing video conference method embodiment, and the structure of a specific module or unit in the system may not be well known, but those skilled in the art may refer to known techniques. And the technical content disclosed in this embodiment can be easily realized.
  • the functions of the modules or units exemplified in the system embodiments can be implemented as the implementation steps of the above method embodiments, and implemented in combination with existing steps.
  • the video conference system includes: a control processing device 22, a plurality of projection display devices 24, a plurality of image capturing devices 26, and a plurality of audios.
  • the capturing device 28 wherein the plurality of projection display devices 24 are disposed around the current conference site center, and are configured to project a plurality of video conference screens according to the control information and the data information sent by the control processing device 22, wherein the control information is used for And indicating a position and/or a size of the partial or full video conference screen projection display in the plurality of video conference screens;
  • the plurality of image capturing devices 26 are configured to capture environment information of the current conference site, and send the environment information to the control processing device 22 a plurality of audio capture devices 28 configured to capture audio information of the current conference site and transmit the audio information to the control processing device 22;
  • a plurality of audio capture devices 28 are connected, arranged to receive environmental information and/or audio information according to Generating control information, and control information transmitted to the projection display apparatus 24.
  • the modules and units involved in the embodiments of the present invention may be implemented by software or by hardware.
  • the described modules and units in this embodiment may also be disposed in a processor, for example, as a processor including a control processing device 22, a plurality of projection display devices 24, a plurality of image capturing devices 26, and a plurality of Audio capture device 28.
  • a processor including a control processing device 22, a plurality of projection display devices 24, a plurality of image capturing devices 26, and a plurality of Audio capture device 28.
  • the names of these modules do not constitute a limitation on the module itself under certain circumstances.
  • the control processing device 22 may also be described as "set to generate control information according to received environmental information and/or audio information. The control information is sent to the module of the projection display device 24.
  • connection manner of the control processing device 22 with the plurality of projection display devices 24, the plurality of image capturing devices 26, and the plurality of audio capturing devices 28 includes a wired connection and a wireless connection, wherein the wireless connection includes, but is not limited to, a Bluetooth connection, and a WiFi connection. Connection method such as connection.
  • the above-mentioned projection display device 24 includes: a display position adjusting unit configured to adjust a position of the projection display of the plurality of video conference screens according to the control information; and/or a display size adjustment unit, configured to adjust according to the control information The size of the video conference screen projection display.
  • a plurality of image capturing devices 26 are disposed facing the conference site center around the current conference site, or are disposed around the center of the current conference site.
  • a plurality of audio capture devices 28 are disposed around the conference site center around the current conference site, or at the center of the current conference site.
  • the control processing device 22 comprises: a signal receiving unit, a first processing unit and/or a second processing unit, a control information generating unit, a signal transmitting unit, wherein the signal receiving unit is configured to receive environmental information and/or audio
  • the first processing unit is configured to determine, according to the image feature in the environment information sent by the corresponding image capturing device 26, the number of participants in the capturing range of the image capturing device 26 corresponding to the environment information
  • the second processing unit setting The position information of the corresponding one or more sound sources in the audio information is determined according to the audio information transmitted by the plurality of audio capturing devices 28
  • the control information generating unit is configured to determine the capturing direction of the corresponding image capturing device 26 according to the number of participants Displaying a display size of the corresponding video conference screen, and/or determining a display size and/or a display position of the video conference screen corresponding thereto according to the location information, and generating control information according to the determined display size and/or display position
  • the signal sending unit Set to send control information
  • the audio information includes volume information, and at least one of the following: frequency information, timbre information. Different frequency information or timbre information can be used to identify different sound sources, and combined with volume information to achieve separate positioning of different sound sources.
  • the plurality of projection display devices 24 respectively form a plurality of video conference screens using aerial imaging technology.
  • the projection display device 24 further includes: an operation action capturing unit configured to capture an operation action performed by the user on the plurality of video conference screens; and an operation action transmitting unit configured to transmit the information of the operation action to the control processing device 22 .
  • control processing device 22 further includes: an operation action analysis unit configured to parse the operation action as an operation instruction, wherein the operation instruction includes an operation instruction for indicating a display size and/or a display position of the currently operated video conference screen And/or an operation instruction for inputting graphics and/or text information to a corresponding position in the currently displayed video conference screen; wherein the control information generating unit is further set to the currently operated video conference screen according to the operation instruction Display size and/or display position generation control information.
  • an operation action analysis unit configured to parse the operation action as an operation instruction, wherein the operation instruction includes an operation instruction for indicating a display size and/or a display position of the currently operated video conference screen And/or an operation instruction for inputting graphics and/or text information to a corresponding position in the currently displayed video conference screen; wherein the control information generating unit is further set to the currently operated video conference screen according to the operation instruction Display size and/or display position generation control information.
  • control processing device 22 further includes: a data information processing unit configured to update the data information according to an operation for inputting graphics and/or text information to a corresponding position in the currently displayed video conference screen.
  • the input graphic and/or text information is superimposed on the data information according to the corresponding input position, and is distributed to the plurality of projection display devices 24 for display by the control processing device 22.
  • FIG. 3 is a schematic diagram of a preferred structure of a video conference system according to an embodiment of the present invention.
  • the video conference system further includes: a network interaction device 30 connected to the control processing device 22 and configured to be controlled.
  • the processing device 22 interacts with other control processing devices in the video conferencing system as described above with data information and/or operational instructions for inputting graphics and/or text information to corresponding locations in the currently displayed video conference screen. In this way, information interaction with a remote video conferencing system on the network is achieved.
  • the preferred embodiment adopts sound localization and camera omnidirectional conference room image information collection for the limitation of the current conference; in some preferred manners, the image size and the information to be exchanged may also be controlled by gesture control.
  • the present invention preferably provides a video conference display, interaction, and control method, including: the conference terminal directly projects to the center of the conference room according to the number of conferences, and dynamically displays the default projection size according to the number of people. At the same time, according to the sound source to draw the projection distance, the current presenter can write relevant information on the projection according to the gesture. Related information is processed after processing.
  • the immersive video conferencing method scans the current information of the conference room through the comprehensive camera group, locates the current conference speaker through the sound sensor, and interactively displays the conference state through the projection scanning device.
  • the projection collection device and the camera group can be connected to the terminal device through USB, WiFi, Bluetooth, and the like.
  • the current conference TV uses a single camera and is fixed in a corner of the conference room. This design can only collect environmental information in a specific direction.
  • a camera set having a plurality of cameras is used, which can be fixed in the center of the conference table to realize panoramic information collection of the conference room.
  • a microphone with a sound localization sensor for sound collection and sound source localization is used to determine the specific location of the current speaker of each aspect of the conference.
  • the projection acquisition input device (corresponding to the above-mentioned operation motion capture unit) recognizes the gesture trajectory tracking and positioning control.
  • the conference TV is controlled by a web interface control or an infrared remote controller.
  • the image is displayed by a display device such as a television or a projection.
  • the whiteboard operation needs to be operated by the pen on the fixed whiteboard in the conference room, and the other party in the meeting has no way to directly change the objection on the other party's whiteboard. Even if the current electronic whiteboard technology can only solve the meeting, the other party can directly change the object on the other party's whiteboard, but the modified person needs to go to the electronic whiteboard area for information interaction.
  • the preferred embodiment directly controls the terminal device by the projection acquisition device (corresponding to the above-described operation action capture unit) recognizing the gesture of the current speaker. It is also possible to change the size of the projected area according to the gesture, and the distance of the projected image from the speaker. At the same time, according to the gesture, the information exchange of the electronic whiteboard can be directly performed.
  • the core idea of the preferred embodiment is to improve the video conferencing user experience and close proximity participation.
  • Traditional interaction requires an oil-based pen to be input on the whiteboard device, and the camera is manually controlled to capture the whiteboard content.
  • the electronic whiteboard device has recently received a fixed location of the device, the interaction needs to go into the scope of the electronic whiteboard to operate.
  • the size of the displayed image at the same time is limited by the display device.
  • the preferred embodiment realizes a random interactive experience at any position.
  • the video conference display scenario provided by the preferred embodiment provides a conference state by stereoscopic display.
  • the terminal will display whether it is a single-direction display or (east, south, west, and north) according to the distribution of the number of people in the meeting (such as the initial state of the meeting, the default East, South, West, and North participants will display the meeting status. ), as shown in Figure 4; according to the number of participants in a certain direction to change the size of the default display image (such as the initial state of the conference 1 through the camera to collect information found that more participants in the east, the east projection image default Larger, as shown in Figure 5.)
  • the person in a specific direction can control the size of the image displayed in one direction through the projection collection device.
  • the terminal device determines the current speaker position according to the sound sensing device, and recognizes the gesture of the speaker by the projection collection device,
  • the distance projection acquisition device displays the distance, and the size of the projection can be adjusted by sliding the gesture.
  • the projection acquisition device is currently a touch of size and control, and the publisher can publish content by finger input within the projection range (as if writing on a blackboard with chalk).
  • the projection collection device transmits the collection information to the terminal (corresponding to the control processing device 22), and the terminal is processed and displayed on the display device in each direction and/or transmitted to the remote conference device through the network device.
  • the person in this direction needs to modify the current display content, directly pull the projection image closer to himself, and directly input the information on the projection device, as shown in the conference interaction model shown in FIG. 7 - interaction in the same direction. After the modification, the projected image is centered according to the gesture.
  • the publisher ends the meeting and the image is returned to the meeting initial model 0 or initial model 1.
  • the environment information and/or audio information of the current conference site and the data information indicating the content of the video conference screen are acquired; and the environment information and/or the audio information are generated according to the environment information and/or the audio information.
  • Controlling information respectively, projecting a plurality of video conference screens according to the control information and the data information, wherein the control information is used to indicate a position and/or a size of a part or all of the video conference screens in the plurality of video conference screens, and the solution is solved.
  • the user's operation or poor experience caused by the fixed display size and/or display position of the video conference screen projection in the video conference system improves the user experience.
  • modules or steps of the present invention described above can be implemented by a general-purpose computing device that can be centralized on a single computing device or distributed across a network of multiple computing devices. Alternatively, they may be implemented by program code executable by the computing device, such that they may be stored in a storage device by a computing device, or they may be fabricated into individual integrated circuit modules, or Multiple modules or steps are made into a single integrated circuit module. Thus, the invention is not limited to any specific combination of hardware and software.
  • the video conference system and method provided by the embodiments of the present invention have the following beneficial effects: video conference screen projection display of different positions and/or sizes by collecting environment information and/or audio information, thereby solving the video conference.
  • the user's operation or poor experience caused by the fixed display size and/or display position of the video conference screen projection in the system improves the user experience.
  • the user's operation can be made more flexible and convenient by adjusting the display size and/or display position of the video conference screen projection.

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
  • Controls And Circuits For Display Device (AREA)

Abstract

Disclosed are a video conferencing system and method, the method comprising the following steps: obtaining environmental information and/or audio information of a current conference site and data information indicating the video conference screen content (S102); generating control information according to the environmental information and/or the audio information (S104); projecting to multiple video conference screens respectively according to the control information and data information, the control information being used to indicate position and/or size of the projection display of some or all of the multiple video conference screens (S106). The present invention solves the problem of poor user operation or user experience caused by fixed display size and/or display position of the video conference screen projection in a video conference system, improving the user experience.

Description

视频会议系统及方法Video conference system and method 技术领域Technical field
本发明涉及通信领域,具体而言,涉及一种视频会议系统及方法。The present invention relates to the field of communications, and in particular to a video conferencing system and method.
背景技术Background technique
松下公司目前公布了其空中触摸显示屏(FID)的实现方法。空中触摸显示屏技术主要包括空中成像技术和激光飞行时间(TOF)测位技术,其中空中成像技术通过投射板将图像源投射的画面在投射板的上方形成实像;激光飞行时间测位技术通过多个画面捕捉装置获取激光飞行时间,并根据激光飞行时间计算距物体的距离。通过激光飞行时间测位技术可以捕获用户在空中成像技术所成实像上的操作动作。Panasonic has announced its implementation of the Air Touch Display (FID). The aerial touch screen technology mainly includes aerial imaging technology and laser time-of-flight (TOF) positioning technology, in which the aerial imaging technology forms a real image above the projection plate through the projection plate; the laser time-of-flight positioning technology passes through The screen capture device acquires the laser flight time and calculates the distance from the object based on the laser flight time. The laser time-of-flight positioning technology can capture the user's action on the real image of the aerial imaging technology.
目前视频会议大多是采用会议终端+显示设备方式。在该方式中,一般采用鼠标、键盘的方式进行视频投影的控制或文字、图像的输入;即使现在有的显示设备已经增加了触控功能,但因触控位置固定、显示大小固定,仍然存在控制单一,交互单一等问题。At present, video conferences mostly use conference terminals + display devices. In this mode, the video projection control or the input of text and images is generally performed by means of a mouse or a keyboard; even if some display devices have been added with a touch function, the touch position is fixed and the display size is fixed, and still exists. Control single, single interaction and other issues.
针对相关技术中视频会议系统中视频会议画面投影的显示大小和/或显示位置固定导致的用户操作或体验差的问题,目前尚未提出有效的解决方案。For the problem that the display size and/or the display position of the video conference screen projection in the video conferencing system in the related art is poor, the user operation or the experience is poor, and an effective solution has not been proposed yet.
发明内容Summary of the invention
本发明实施例提供了一种视频会议系统及方法,以至少解决相关技术中视频会议系统中视频会议画面投影的显示大小和/或显示位置固定导致的用户操作或体验差的问题。The embodiment of the present invention provides a video conference system and method, to at least solve the problem of poor user operation or experience caused by fixed display size and/or display position of a video conference screen projection in a video conference system in the related art.
根据本发明的一个方面,提供了一种视频会议系统,包括:控制处理装置、多个投影显示装置、多个图像捕捉装置和多个音频捕捉装置,其中,所述多个投影显示装置,在当前会议现场中心面向四周设置,设置为根据所述控制处理装置发送的控制信息和数据信息,分别投影多个视频会议画面,其中,所述控制信息用于指示所述多个视频会议画面中部分或全部视频会议画面投影显示的位置和/或大小;所述多个图像捕捉装置,设置为捕捉所述当前会议现场的环境信息,并将所述环境信息发送给所述控制处理装置;所述多个音频捕捉装置,设置为捕捉所述当前会议现场的音频信息,并将所述音频信息发送给所述控制处理装置;所述控制处理装置,分别与所述多个投影 显示装置、所述多个图像捕捉装置和所述多个音频捕捉装置连接,设置为根据接收的所述环境信息和/或所述音频信息,生成所述控制信息,并将所述控制信息发送至所述投影显示装置。According to an aspect of the present invention, a video conferencing system includes: a control processing device, a plurality of projection display devices, a plurality of image capturing devices, and a plurality of audio capturing devices, wherein the plurality of projection display devices are The current conference site center is disposed to be circumferentially disposed, and is configured to respectively project a plurality of video conference screens according to the control information and the data information sent by the control processing device, wherein the control information is used to indicate a part of the plurality of video conference screens Or the location and/or size of the video conference screen projection display; the plurality of image capture devices configured to capture environmental information of the current conference site and transmit the environmental information to the control processing device; a plurality of audio capture devices configured to capture audio information of the current conference site and transmit the audio information to the control processing device; the control processing device respectively associated with the plurality of projections The display device, the plurality of image capturing devices, and the plurality of audio capturing devices are connected, configured to generate the control information according to the received environmental information and/or the audio information, and send the control information To the projection display device.
可选地,所述投影显示装置包括:显示位置调整单元,设置为根据所述控制信息,调整所述多个视频会议画面投影显示的位置;和/或显示大小调整单元,设置为根据所述控制信息,调整所述多个视频会议画面投影显示的大小。Optionally, the projection display device includes: a display position adjustment unit configured to adjust a position of the plurality of video conference screens to be displayed according to the control information; and/or a display size adjustment unit, configured to Control information, adjusting the size of the projection display of the plurality of video conference screens.
可选地,所述多个图像捕捉装置,在所述当前会议现场的四周面向会议现场中心设置,或者在所述当前会议现场的中心面向四周设置。Optionally, the plurality of image capturing devices are disposed facing the conference site center around the current conference site, or are disposed around the center of the current conference site.
可选地,所述多个音频捕捉装置,在所述当前会议现场的四周面向会议现场中心设置,或者在所述当前会议现场的中心面向四周设置。Optionally, the plurality of audio capture devices are disposed facing the conference site center around the current conference site, or are disposed around the center of the current conference site.
可选地,所述控制处理装置包括:信号接收单元、第一处理单元和/或第二处理单元、控制信息生成单元、信号发送单元,其中,所述信号接收单元,设置为接收所述环境信息和/或所述音频信息;所述第一处理单元,设置为根据对应的图像捕捉装置发送的所述环境信息中的图像特征,确定所述环境信息对应的图像捕捉装置的捕捉范围内的参会人数信息;所述第二处理单元,设置为根据所述多个音频捕捉装置发送的所述音频信息,确定所述音频信息中对应的一个或多个音源的位置信息;所述控制信息生成单元,设置为根据所述参会人数信息确定对应的图像捕捉装置的捕捉方向上对应的视频会议画面的显示大小,和/或根据所述位置信息确定与其对应的视频会议画面的显示大小和/或显示位置,并根据确定的显示大小和/或显示位置生成所述控制信息;所述信号发送单元,设置为向所述投影显示装置发送所述控制信息和用于生成所述视频会议画面的所述数据信息。Optionally, the control processing device includes: a signal receiving unit, a first processing unit and/or a second processing unit, a control information generating unit, and a signal sending unit, wherein the signal receiving unit is configured to receive the environment Information and/or the audio information; the first processing unit is configured to determine, within the capture range of the image capture device corresponding to the environment information, according to image features in the environment information sent by the corresponding image capture device The second processing unit is configured to determine location information of the corresponding one or more audio sources in the audio information according to the audio information sent by the multiple audio capture devices; the control information a generating unit, configured to determine, according to the participant number information, a display size of a corresponding video conference screen in a capturing direction of the corresponding image capturing device, and/or determine a display size of the video conference screen corresponding thereto according to the location information / or display the location, and generate the control information according to the determined display size and / or display location; A signal transmitting unit configured to transmit the control information, and means for generating the video conference screen display of the data information to the projection.
可选地,所述音频信息包括音量信息,以及以下至少之一:频率信息、音色信息。Optionally, the audio information includes volume information, and at least one of the following: frequency information, timbre information.
可选地,所述多个投影显示装置分别应用空中成像技术形成所述多个视频会议画面。Optionally, the plurality of projection display devices respectively form an aerial imaging technology to form the plurality of video conference screens.
可选地,所述投影显示装置还包括:操作动作捕获单元,设置为捕获用户在所述多个视频会议画面上执行的操作动作;操作动作发送单元,设置为将所述操作动作的信息发送至所述控制处理装置。Optionally, the projection display device further includes: an operation action capturing unit configured to capture an operation action performed by the user on the plurality of video conference screens; and an operation action sending unit configured to send the information of the operation action To the control processing device.
可选地,所述控制处理装置还包括:操作动作解析单元,设置为解析所述操作动作为操作指令,其中,所述操作指令包括用于指示当前操作的视频会议画面的显示大 小和/或显示位置的操作指令,和/或用于向当前显示的视频会议画面中的对应位置输入图形和/或文字信息的操作指令;其中,所述控制信息生成单元,还设置为根据所述操作指令指示的当前操作的视频会议画面的显示大小和/或显示位置生成所述控制信息。Optionally, the control processing device further includes: an operation action analysis unit configured to parse the operation action as an operation instruction, wherein the operation instruction includes a display for indicating a current video conference screen An operation instruction for small and/or display position, and/or an operation instruction for inputting graphics and/or text information to a corresponding position in the currently displayed video conference screen; wherein the control information generation unit is further configured to The display size and/or display position of the currently operated video conference screen indicated by the operation instruction generates the control information.
可选地,所述控制处理装置还包括:数据信息处理单元,设置为根据用于向当前显示的视频会议画面中的对应位置输入图形和/或文字信息的操作,更新所述数据信息。Optionally, the control processing device further comprises: a data information processing unit configured to update the data information according to an operation for inputting graphics and/or text information to a corresponding position in the currently displayed video conference screen.
可选地,所述视频会议系统还包括:网络交互装置,与所述控制处理装置连接,设置为所述控制处理装置与其他如上述的视频会议系统中的控制处理装置交互所述数据信息和/或用于向当前显示的视频会议画面中的对应位置输入图形和/或文字信息的操作指令。Optionally, the video conferencing system further includes: a network interaction device, connected to the control processing device, configured to: the control processing device interacts with the control processing device in the video conferencing system as described above, and the data information and / or an operation instruction for inputting graphic and/or text information to a corresponding position in the currently displayed video conference screen.
根据本发明的另一个方面,还提供了一种视频会议方法,包括:获取当前会议现场的环境信息和/或音频信息,以及指示视频会议画面内容的数据信息;根据所述环境信息和/或所述音频信息,生成控制信息;根据所述控制信息和所述数据信息,分别投影多个视频会议画面,其中,所述控制信息用于指示所述多个视频会议画面中部分或全部视频会议画面投影显示的位置和/或大小。According to another aspect of the present invention, a video conferencing method is further provided, comprising: acquiring environmental information and/or audio information of a current conference site, and data information indicating content of the video conference screen; according to the environmental information and/or And generating, by the audio information, a plurality of video conference screens according to the control information and the data information, where the control information is used to indicate some or all of the video conferences in the plurality of video conference screens. The position and/or size of the screen projection display.
可选地,所述方法还包括:应用空中成像技术形成所述多个视频会议画面。Optionally, the method further includes: applying the aerial imaging technology to form the plurality of video conference pictures.
通过本发明,采用获取当前会议现场的环境信息和/或音频信息,以及指示视频会议画面内容的数据信息;根据环境信息和/或音频信息,生成控制信息;根据控制信息和数据信息,分别投影多个视频会议画面,其中,控制信息用于指示多个视频会议画面中部分或全部视频会议画面投影显示的位置和/或大小的方式,解决了视频会议系统中视频会议画面投影的显示大小和/或显示位置固定导致的用户操作或体验差的问题,提高了用户体验。Through the present invention, the environment information and/or audio information of the current conference site is acquired, and the data information indicating the content of the video conference screen is used; the control information is generated according to the environment information and/or the audio information; and the projection information is separately projected according to the control information and the data information. a plurality of video conference screens, wherein the control information is used to indicate a position and/or a size of a part or all of the video conference screens in the plurality of video conference screens, and the display size of the video conference screen projections in the video conference system is solved. / / Display the problem of poor user operation or poor experience caused by fixed location, improving the user experience.
附图说明DRAWINGS
此处所说明的附图用来提供对本发明的进一步理解,构成本申请的一部分,本发明的示意性实施例及其说明用于解释本发明,并不构成对本发明的不当限定。在附图中:The drawings described herein are intended to provide a further understanding of the invention, and are intended to be a part of the invention. In the drawing:
图1是根据本发明实施例的视频会议方法的流程示意图;FIG. 1 is a schematic flowchart diagram of a video conference method according to an embodiment of the present invention; FIG.
图2是根据本发明实施例的视频会议系统的结构示意图; 2 is a schematic structural diagram of a video conference system according to an embodiment of the present invention;
图3是根据本发明实施例的视频会议系统的优选结构示意图;FIG. 3 is a schematic diagram of a preferred structure of a video conference system according to an embodiment of the present invention; FIG.
图4是根据本发明实施例的视频会议初始模型0示意图;4 is a schematic diagram of a video conference initial model 0 according to an embodiment of the present invention;
图5是根据本发明实施例的视频会议初始模型1示意图;FIG. 5 is a schematic diagram of a video conference initial model 1 according to an embodiment of the present invention; FIG.
图6是根据本发明实施例的视频会议互动模型示意图;6 is a schematic diagram of a video conference interaction model according to an embodiment of the present invention;
图7是根据本发明实施例的视频会议互动模型-互动同方向示意图;7 is a schematic diagram of a video conference interaction model-interaction in the same direction according to an embodiment of the present invention;
图8是根据本发明实施例的视频会议互动模型-多人共享交互示意图。FIG. 8 is a schematic diagram of a video conference interaction model-multiple person sharing interaction according to an embodiment of the present invention.
具体实施方式detailed description
需要说明的是,在不冲突的情况下,本申请中的实施例及实施例中的特征可以相互组合。下面将参考附图并结合实施例来详细说明本发明。It should be noted that the embodiments in the present application and the features in the embodiments may be combined with each other without conflict. The invention will be described in detail below with reference to the drawings in conjunction with the embodiments.
在附图的流程图示出的步骤可以在诸如一组计算机可执行指令的计算机系统中执行,并且,虽然在流程图中示出了逻辑顺序,但是在某些情况下,可以以不同于此处的顺序执行所示出或描述的步骤。The steps illustrated in the flowchart of the figures may be performed in a computer system such as a set of computer executable instructions, and although the logical order is shown in the flowchart, in some cases, may differ from this The steps shown are performed in the order shown or described.
本实施例提供了一种视频会议方法,图1是根据本发明实施例的视频会议方法的流程示意图,如图1所示,包括如下的步骤:This embodiment provides a video conference method. FIG. 1 is a schematic flowchart of a video conference method according to an embodiment of the present invention. As shown in FIG. 1, the method includes the following steps:
步骤S102,获取当前会议现场的环境信息和/或音频信息,以及指示视频会议画面内容的数据信息;Step S102: Acquire environment information and/or audio information of the current conference site, and data information indicating content of the video conference screen;
步骤S104,根据环境信息和/或音频信息,生成控制信息;Step S104, generating control information according to environment information and/or audio information;
步骤S106,根据控制信息和数据信息,分别投影多个视频会议画面,其中,控制信息用于指示多个视频会议画面中部分或全部视频会议画面投影显示的位置和/或大小。Step S106, respectively projecting a plurality of video conference screens according to the control information and the data information, wherein the control information is used to indicate the position and/or size of the partial or full video conference screen projection display in the plurality of video conference screens.
通过上述步骤,通过采集环境信息和/或音频信息进行不同位置和/或大小的视频会议画面投影显示,从而解决了视频会议系统中视频会议画面投影的显示大小和/或显示位置固定导致的用户操作或体验差的问题,提升了用户体验。其中,在采用空中成像技术和激光飞行时间测位技术进行用户操作采集的情况下通过调整视频会议画面投影的显示大小和/或显示位置,可以使得用户操作更加灵活和方便。 Through the above steps, the video conference screen projection display of different positions and/or sizes is performed by collecting environmental information and/or audio information, thereby solving the problem that the display size and/or the display position of the video conference screen projection in the video conference system is fixed. Improve the user experience by operating or experiencing poor problems. Among them, by using the aerial imaging technology and the laser time-of-flight positioning technology for user operation acquisition, the user's operation can be made more flexible and convenient by adjusting the display size and/or display position of the video conference screen projection.
优选地,在上述方法中应用空中成像技术形成多个视频会议画面。其中的空中成像技术包括但不限于松下公司所披露的技术或其他公知的空中成像技术。Preferably, an aerial imaging technique is applied in the above method to form a plurality of video conference pictures. Among them, aerial imaging technologies include, but are not limited to, the technology disclosed by Panasonic Corporation or other well-known aerial imaging technologies.
为了实现上述方法,在本实施例中提供了一种视频会议系统。需要说明的是,系统实施例中描述的视频会议系统对应于上述的视频会议方法实施例,其系统中具体的模块或单元的结构可能并不是公知的,但是本领域技术人员可以参照公知的技术以及本实施例中披露的技术内容得以轻松实现。此外,在系统实施例中举例的模块或单元的功能可以作为上述方法实施例的实现步骤,并结合现有步骤得以实施。In order to implement the above method, a video conference system is provided in this embodiment. It should be noted that the video conference system described in the system embodiment corresponds to the foregoing video conference method embodiment, and the structure of a specific module or unit in the system may not be well known, but those skilled in the art may refer to known techniques. And the technical content disclosed in this embodiment can be easily realized. Furthermore, the functions of the modules or units exemplified in the system embodiments can be implemented as the implementation steps of the above method embodiments, and implemented in combination with existing steps.
图2是根据本发明实施例的视频会议系统的结构示意图,如图2所示,该视频会议系统包括:控制处理装置22、多个投影显示装置24、多个图像捕捉装置26和多个音频捕捉装置28,其中,多个投影显示装置24,在当前会议现场中心面向四周设置,设置为根据控制处理装置22发送的控制信息和数据信息,分别投影多个视频会议画面,其中,控制信息用于指示多个视频会议画面中部分或全部视频会议画面投影显示的位置和/或大小;多个图像捕捉装置26,设置为捕捉当前会议现场的环境信息,并将环境信息发送给控制处理装置22;多个音频捕捉装置28,设置为捕捉当前会议现场的音频信息,并将音频信息发送给控制处理装置22;控制处理装置22,分别与多个投影显示装置24、多个图像捕捉装置26和多个音频捕捉装置28连接,设置为根据接收的环境信息和/或音频信息,生成控制信息,并将控制信息发送至投影显示装置24。2 is a schematic structural diagram of a video conference system according to an embodiment of the present invention. As shown in FIG. 2, the video conference system includes: a control processing device 22, a plurality of projection display devices 24, a plurality of image capturing devices 26, and a plurality of audios. The capturing device 28, wherein the plurality of projection display devices 24 are disposed around the current conference site center, and are configured to project a plurality of video conference screens according to the control information and the data information sent by the control processing device 22, wherein the control information is used for And indicating a position and/or a size of the partial or full video conference screen projection display in the plurality of video conference screens; the plurality of image capturing devices 26 are configured to capture environment information of the current conference site, and send the environment information to the control processing device 22 a plurality of audio capture devices 28 configured to capture audio information of the current conference site and transmit the audio information to the control processing device 22; the control processing device 22, and the plurality of projection display devices 24, the plurality of image capture devices 26, and A plurality of audio capture devices 28 are connected, arranged to receive environmental information and/or audio information according to Generating control information, and control information transmitted to the projection display apparatus 24.
本发明的实施例中所涉及到的模块、单元可以通过软件的方式实现,也可以通过硬件的方式来实现。本实施例中的所描述的模块、单元也可以设置在处理器中,例如,可以描述为:一种处理器包括控制处理装置22、多个投影显示装置24、多个图像捕捉装置26和多个音频捕捉装置28。其中,这些模块的名称在某种情况下并不构成对该模块本身的限定,例如,控制处理装置22还可以被描述为“设置为根据接收的环境信息和/或音频信息,生成控制信息,并将控制信息发送至投影显示装置24的模块”。The modules and units involved in the embodiments of the present invention may be implemented by software or by hardware. The described modules and units in this embodiment may also be disposed in a processor, for example, as a processor including a control processing device 22, a plurality of projection display devices 24, a plurality of image capturing devices 26, and a plurality of Audio capture device 28. Wherein, the names of these modules do not constitute a limitation on the module itself under certain circumstances. For example, the control processing device 22 may also be described as "set to generate control information according to received environmental information and/or audio information. The control information is sent to the module of the projection display device 24.
其中,控制处理装置22与多个投影显示装置24、多个图像捕捉装置26和多个音频捕捉装置28的连接方式包括有线连接和无线连接,其中,无线连接包括但不限于:蓝牙连接、WiFi连接等连接方式。The connection manner of the control processing device 22 with the plurality of projection display devices 24, the plurality of image capturing devices 26, and the plurality of audio capturing devices 28 includes a wired connection and a wireless connection, wherein the wireless connection includes, but is not limited to, a Bluetooth connection, and a WiFi connection. Connection method such as connection.
可选地,上述的投影显示装置24包括:显示位置调整单元,设置为根据控制信息,调整多个视频会议画面投影显示的位置;和/或显示大小调整单元,设置为根据控制信息,调整多个视频会议画面投影显示的大小。Optionally, the above-mentioned projection display device 24 includes: a display position adjusting unit configured to adjust a position of the projection display of the plurality of video conference screens according to the control information; and/or a display size adjustment unit, configured to adjust according to the control information The size of the video conference screen projection display.
可选地,多个图像捕捉装置26,在当前会议现场的四周面向会议现场中心设置,或者在当前会议现场的中心面向四周设置。 Optionally, a plurality of image capturing devices 26 are disposed facing the conference site center around the current conference site, or are disposed around the center of the current conference site.
可选地,多个音频捕捉装置28,在当前会议现场的四周面向会议现场中心设置,或者在当前会议现场的中心面向四周设置。Optionally, a plurality of audio capture devices 28 are disposed around the conference site center around the current conference site, or at the center of the current conference site.
可选地,控制处理装置22包括:信号接收单元、第一处理单元和/或第二处理单元、控制信息生成单元、信号发送单元,其中,信号接收单元,设置为接收环境信息和/或音频信息;第一处理单元,设置为根据对应的图像捕捉装置26发送的环境信息中的图像特征,确定环境信息对应的图像捕捉装置26的捕捉范围内的参会人数信息;第二处理单元,设置为根据多个音频捕捉装置28发送的音频信息,确定音频信息中对应的一个或多个音源的位置信息;控制信息生成单元,设置为根据参会人数信息确定对应的图像捕捉装置26的捕捉方向上对应的视频会议画面的显示大小,和/或根据位置信息确定与其对应的视频会议画面的显示大小和/或显示位置,并根据确定的显示大小和/或显示位置生成控制信息;信号发送单元,设置为向投影显示装置24发送控制信息和用于生成视频会议画面的数据信息。Optionally, the control processing device 22 comprises: a signal receiving unit, a first processing unit and/or a second processing unit, a control information generating unit, a signal transmitting unit, wherein the signal receiving unit is configured to receive environmental information and/or audio The first processing unit is configured to determine, according to the image feature in the environment information sent by the corresponding image capturing device 26, the number of participants in the capturing range of the image capturing device 26 corresponding to the environment information; the second processing unit, setting The position information of the corresponding one or more sound sources in the audio information is determined according to the audio information transmitted by the plurality of audio capturing devices 28; the control information generating unit is configured to determine the capturing direction of the corresponding image capturing device 26 according to the number of participants Displaying a display size of the corresponding video conference screen, and/or determining a display size and/or a display position of the video conference screen corresponding thereto according to the location information, and generating control information according to the determined display size and/or display position; the signal sending unit Set to send control information to the projection display device 24 and for generating Data video conference screen.
可选地,音频信息包括音量信息,以及以下至少之一:频率信息、音色信息。通过不同的频率信息或音色信息可以用于识别不同的音源,同时结合音量信息,实现不同音源的分别定位。Optionally, the audio information includes volume information, and at least one of the following: frequency information, timbre information. Different frequency information or timbre information can be used to identify different sound sources, and combined with volume information to achieve separate positioning of different sound sources.
可选地,多个投影显示装置24分别应用空中成像技术形成多个视频会议画面。Optionally, the plurality of projection display devices 24 respectively form a plurality of video conference screens using aerial imaging technology.
可选地,投影显示装置24还包括:操作动作捕获单元,设置为捕获用户在多个视频会议画面上执行的操作动作;操作动作发送单元,设置为将操作动作的信息发送至控制处理装置22。Optionally, the projection display device 24 further includes: an operation action capturing unit configured to capture an operation action performed by the user on the plurality of video conference screens; and an operation action transmitting unit configured to transmit the information of the operation action to the control processing device 22 .
可选地,控制处理装置22还包括:操作动作解析单元,设置为解析操作动作为操作指令,其中,操作指令包括用于指示当前操作的视频会议画面的显示大小和/或显示位置的操作指令,和/或用于向当前显示的视频会议画面中的对应位置输入图形和/或文字信息的操作指令;其中,控制信息生成单元,还设置为根据操作指令指示的当前操作的视频会议画面的显示大小和/或显示位置生成控制信息。Optionally, the control processing device 22 further includes: an operation action analysis unit configured to parse the operation action as an operation instruction, wherein the operation instruction includes an operation instruction for indicating a display size and/or a display position of the currently operated video conference screen And/or an operation instruction for inputting graphics and/or text information to a corresponding position in the currently displayed video conference screen; wherein the control information generating unit is further set to the currently operated video conference screen according to the operation instruction Display size and/or display position generation control information.
可选地,控制处理装置22还包括:数据信息处理单元,设置为根据用于向当前显示的视频会议画面中的对应位置输入图形和/或文字信息的操作,更新数据信息。其中,输入的图形和/或文字信息根据对应的输入位置被叠加到数据信息中,并通过控制处理装置22分别分发给多个投影显示装置24进行显示。Optionally, the control processing device 22 further includes: a data information processing unit configured to update the data information according to an operation for inputting graphics and/or text information to a corresponding position in the currently displayed video conference screen. The input graphic and/or text information is superimposed on the data information according to the corresponding input position, and is distributed to the plurality of projection display devices 24 for display by the control processing device 22.
图3是根据本发明实施例的视频会议系统的优选结构示意图,如图3所示,可选地,视频会议系统还包括:网络交互装置30,与控制处理装置22连接,设置为控制 处理装置22与其他如上述的视频会议系统中的控制处理装置交互数据信息和/或用于向当前显示的视频会议画面中的对应位置输入图形和/或文字信息的操作指令。通过该方式实现了与网络上的远程视频会议系统的信息交互。FIG. 3 is a schematic diagram of a preferred structure of a video conference system according to an embodiment of the present invention. As shown in FIG. 3, optionally, the video conference system further includes: a network interaction device 30 connected to the control processing device 22 and configured to be controlled. The processing device 22 interacts with other control processing devices in the video conferencing system as described above with data information and/or operational instructions for inputting graphics and/or text information to corresponding locations in the currently displayed video conference screen. In this way, information interaction with a remote video conferencing system on the network is achieved.
为了使本发明的技术方案和实现方法更加清楚,下面将结合优选的实施例对其实现过程进行详细描述。In order to make the technical solutions and implementation methods of the present invention clearer, the implementation process will be described in detail below in conjunction with the preferred embodiments.
本优选实施例针对当前会议的局限,采用声音定位、摄像头全方位会议室图像信息采集;在一些优选方式中还可以通过手势控制显示图像大小及输入要交互的信息。The preferred embodiment adopts sound localization and camera omnidirectional conference room image information collection for the limitation of the current conference; in some preferred manners, the image size and the information to be exchanged may also be controlled by gesture control.
本优选提供一种视频会议显示、互动、控制的方法包括:会议终端根据会议人数直接投影到会议室中央,根据人数动态显示默认投影大小。同时根据声音源拉近投影距离,当前宣讲人根据手势可以在投影上写下相关信息。相关信息通过处理后显示处理。该融入式视频会议方法通过全方位摄像头组扫描会议室当前信息,通过声音传感器定位当前会议发言人,通过投影扫描设备进行互动交互显示会议状态。其中,投影采集设备和摄像头组可以通过USB、WiFi、蓝牙等方式接入到终端设备。通过上述方法可以实现会议图像适应性显示、信息输入的灵活控制。The present invention preferably provides a video conference display, interaction, and control method, including: the conference terminal directly projects to the center of the conference room according to the number of conferences, and dynamically displays the default projection size according to the number of people. At the same time, according to the sound source to draw the projection distance, the current presenter can write relevant information on the projection according to the gesture. Related information is processed after processing. The immersive video conferencing method scans the current information of the conference room through the comprehensive camera group, locates the current conference speaker through the sound sensor, and interactively displays the conference state through the projection scanning device. The projection collection device and the camera group can be connected to the terminal device through USB, WiFi, Bluetooth, and the like. Through the above method, flexible display of the adaptive display of the conference image and the input of the information can be realized.
在本优选实施例中采用了下列技术或方法:The following techniques or methods are employed in the preferred embodiment:
1、采用360度全景摄像头组进行会议室环境采集。目前的会议电视采用单摄像头,固定在会议室一个角落,此设计只能采集特定方向环境信息。本优选实施例中采用具有多个摄像头的摄像头组,可以固定在会议桌子中央,实现会议室全景信息采集。1. Use the 360-degree panoramic camera group to collect the conference room environment. The current conference TV uses a single camera and is fixed in a corner of the conference room. This design can only collect environmental information in a specific direction. In the preferred embodiment, a camera set having a plurality of cameras is used, which can be fixed in the center of the conference table to realize panoramic information collection of the conference room.
2、带有声音定位传感器的麦克风,进行声音采集及声源定位。目前的麦克风仅实现了声音输入和声音输出。本优选实施例中通过声音定位传感器确定各个方面会议当前发言人具体位置。2. A microphone with a sound localization sensor for sound collection and sound source localization. Current microphones only implement sound input and sound output. In the preferred embodiment, the sound location sensor is used to determine the specific location of the current speaker of each aspect of the conference.
3、投影采集输入设备(相当于上述的操作动作捕获单元)识别手势轨迹跟踪定位控制。目前会议电视通过Web界面控制或红外遥控器控制。图像通过电视或投影等显示设备显示。白板操作需要到会议室固定的白板上用笔操作,同时开会的对方没有办法直接更改对方白板上有异议的地方。即使现在出现的电子白板技术也仅能解决开会的对方可以直接更改对方白板上有异议的地方,但需要修改人要走到电子白板区域进行信息交互。本优选实施例通过投影采集设备(相当于上述的操作动作捕获单元)识别当前发言人的手势就直接控制终端设备。也可以根据手势改变投影的区域的大小,以及投影图像距离发言人的远近。同时根据手势就可以直接进行电子白板信息交流。 3. The projection acquisition input device (corresponding to the above-mentioned operation motion capture unit) recognizes the gesture trajectory tracking and positioning control. Currently, the conference TV is controlled by a web interface control or an infrared remote controller. The image is displayed by a display device such as a television or a projection. The whiteboard operation needs to be operated by the pen on the fixed whiteboard in the conference room, and the other party in the meeting has no way to directly change the objection on the other party's whiteboard. Even if the current electronic whiteboard technology can only solve the meeting, the other party can directly change the object on the other party's whiteboard, but the modified person needs to go to the electronic whiteboard area for information interaction. The preferred embodiment directly controls the terminal device by the projection acquisition device (corresponding to the above-described operation action capture unit) recognizing the gesture of the current speaker. It is also possible to change the size of the projected area according to the gesture, and the distance of the projected image from the speaker. At the same time, according to the gesture, the information exchange of the electronic whiteboard can be directly performed.
本优选实施例的核心思想是:改善视频会议用户体验和近距离参与便捷。传统互动需要借助油性笔在白板设备上输入,同时要手动控制摄像头采集白板内容。即使最近电子白板设备也收到设备位置固定,互动时需要走进到电子白板范围才可以操作的局限。同时显示图像的大小受到显示设备的限制。但优选实施例为了改善用户体验,和用户使用智能输入设备的便捷性,发明一种任意位置上实现随意互动体验。The core idea of the preferred embodiment is to improve the video conferencing user experience and close proximity participation. Traditional interaction requires an oil-based pen to be input on the whiteboard device, and the camera is manually controlled to capture the whiteboard content. Even if the electronic whiteboard device has recently received a fixed location of the device, the interaction needs to go into the scope of the electronic whiteboard to operate. The size of the displayed image at the same time is limited by the display device. However, in order to improve the user experience and the convenience of the user using the smart input device, the preferred embodiment realizes a random interactive experience at any position.
本优选实施例提供的一种视频会议显示场景,通过立体显示会议状态。例如通过松下的空中成像技术形成的立体显示画面。The video conference display scenario provided by the preferred embodiment provides a conference state by stereoscopic display. For example, a stereoscopic display image formed by Panasonic aerial imaging technology.
会议开始时,终端会根据会议人数的分布情况采用是单方位显示还是(东、南、西、北)多方位显示(如会议初始状态默认东、南、西、北参会人员一样显示会议状态),如图4所示;根据某一方向参会人员的多少改变默认显示图像的大小(比如会议初始状态1通过摄像头采集信息发现东面的参会人员比较多,东面投影图像默认就要更大一些,如图5所示)。同时特定方向人员可以通过投影采集设备控制单方向显示图像的大小。At the beginning of the meeting, the terminal will display whether it is a single-direction display or (east, south, west, and north) according to the distribution of the number of people in the meeting (such as the initial state of the meeting, the default East, South, West, and North participants will display the meeting status. ), as shown in Figure 4; according to the number of participants in a certain direction to change the size of the default display image (such as the initial state of the conference 1 through the camera to collect information found that more participants in the east, the east projection image default Larger, as shown in Figure 5.) At the same time, the person in a specific direction can control the size of the image displayed in one direction through the projection collection device.
会议中某一方向发言人需要互动时,如图6和图7所示的会议互动状态;终端设备会根据声音传感设备确定当前发言人位置,通过投影采集设备识别发言人的手势拉近、拉远投影采集设备显示距离,可以通过手势滑动可以调节投影的大小。投影采集设备当前就相当一块大小可控的触摸,发表人就可以在是投影范围内通过手指输入发表内容(如同用粉笔在黑板上写字一样)。投影采集设备把采集信息传送到终端(相当于控制处理装置22),终端经过处理后分别显示到各方向显示设备上个/或通过网络设备传输到远端会议设备上。When a speaker in a certain direction needs to interact, the interactive state of the conference shown in FIG. 6 and FIG. 7; the terminal device determines the current speaker position according to the sound sensing device, and recognizes the gesture of the speaker by the projection collection device, The distance projection acquisition device displays the distance, and the size of the projection can be adjusted by sliding the gesture. The projection acquisition device is currently a touch of size and control, and the publisher can publish content by finger input within the projection range (as if writing on a blackboard with chalk). The projection collection device transmits the collection information to the terminal (corresponding to the control processing device 22), and the terminal is processed and displayed on the display device in each direction and/or transmitted to the remote conference device through the network device.
其他人需要修改当前显示内容,只需把本方向的投影图像拉近,在投影设备上直接输入信息,如图8所示的会议互动模型—多人共享交互。意见发表完后,发言人可以同时挥动手势,摄像头根据收到的信息控制投影画面远离发言人。会议回复到如图4或图5所示的会议初始模型。Others need to modify the current display content, just zoom in on the projected image in this direction, and directly input the information on the projection device, as shown in the conference interaction model shown in Figure 8 - multi-person shared interaction. After the comments are published, the speaker can swing the gesture at the same time, and the camera controls the projection screen away from the speaker according to the received information. The meeting reverts to the initial conference model shown in Figure 4 or Figure 5.
本方向人需要修改当前显示内容,直接把投影图像拉近自己,在投影设备上直接输入信息,如图7所示的会议互动模型—互动同方向。修改完后根据手势,投影图像居中。The person in this direction needs to modify the current display content, directly pull the projection image closer to himself, and directly input the information on the projection device, as shown in the conference interaction model shown in FIG. 7 - interaction in the same direction. After the modification, the projected image is centered according to the gesture.
发表人结束会议,图像退回会议初始模型0或初始模型1。The publisher ends the meeting and the image is returned to the meeting initial model 0 or initial model 1.
综上所述,根据本发明的上述实施例,采用获取当前会议现场的环境信息和/或音频信息,以及指示视频会议画面内容的数据信息;根据环境信息和/或音频信息,生成 控制信息;根据控制信息和数据信息,分别投影多个视频会议画面,其中,控制信息用于指示多个视频会议画面中部分或全部视频会议画面投影显示的位置和/或大小的方式,解决了视频会议系统中视频会议画面投影的显示大小和/或显示位置固定导致的用户操作或体验差的问题,提高了用户体验。In summary, according to the above embodiment of the present invention, the environment information and/or audio information of the current conference site and the data information indicating the content of the video conference screen are acquired; and the environment information and/or the audio information are generated according to the environment information and/or the audio information. Controlling information; respectively, projecting a plurality of video conference screens according to the control information and the data information, wherein the control information is used to indicate a position and/or a size of a part or all of the video conference screens in the plurality of video conference screens, and the solution is solved. The user's operation or poor experience caused by the fixed display size and/or display position of the video conference screen projection in the video conference system improves the user experience.
显然,本领域的技术人员应该明白,上述的本发明的各模块或各步骤可以用通用的计算装置来实现,它们可以集中在单个的计算装置上,或者分布在多个计算装置所组成的网络上,可选地,它们可以用计算装置可执行的程序代码来实现,从而,可以将它们存储在存储装置中由计算装置来执行,或者将它们分别制作成各个集成电路模块,或者将它们中的多个模块或步骤制作成单个集成电路模块来实现。这样,本发明不限制于任何特定的硬件和软件结合。It will be apparent to those skilled in the art that the various modules or steps of the present invention described above can be implemented by a general-purpose computing device that can be centralized on a single computing device or distributed across a network of multiple computing devices. Alternatively, they may be implemented by program code executable by the computing device, such that they may be stored in a storage device by a computing device, or they may be fabricated into individual integrated circuit modules, or Multiple modules or steps are made into a single integrated circuit module. Thus, the invention is not limited to any specific combination of hardware and software.
以上所述仅为本发明的优选实施例而已,并不用于限制本发明,对于本领域的技术人员来说,本发明可以有各种更改和变化。凡在本发明的精神和原则之内,所作的任何修改、等同替换、改进等,均应包含在本发明的保护范围之内。The above description is only the preferred embodiment of the present invention, and is not intended to limit the present invention, and various modifications and changes can be made to the present invention. Any modifications, equivalent substitutions, improvements, etc. made within the spirit and scope of the present invention are intended to be included within the scope of the present invention.
工业实用性Industrial applicability
如上所述,本发明实施例提供的一种视频会议系统及方法具有以下有益效果:通过采集环境信息和/或音频信息进行不同位置和/或大小的视频会议画面投影显示,从而解决了视频会议系统中视频会议画面投影的显示大小和/或显示位置固定导致的用户操作或体验差的问题,提升了用户体验。其中,在采用空中成像技术和激光飞行时间测位技术进行用户操作采集的情况下通过调整视频会议画面投影的显示大小和/或显示位置,可以使得用户操作更加灵活和方便。 As described above, the video conference system and method provided by the embodiments of the present invention have the following beneficial effects: video conference screen projection display of different positions and/or sizes by collecting environment information and/or audio information, thereby solving the video conference. The user's operation or poor experience caused by the fixed display size and/or display position of the video conference screen projection in the system improves the user experience. Among them, by using the aerial imaging technology and the laser time-of-flight positioning technology for user operation acquisition, the user's operation can be made more flexible and convenient by adjusting the display size and/or display position of the video conference screen projection.

Claims (13)

  1. 一种视频会议系统,包括:控制处理装置、多个投影显示装置、多个图像捕捉装置和多个音频捕捉装置,其中,A video conferencing system includes: a control processing device, a plurality of projection display devices, a plurality of image capturing devices, and a plurality of audio capturing devices, wherein
    所述多个投影显示装置,在当前会议现场中心面向四周设置,设置为根据所述控制处理装置发送的控制信息和数据信息,分别投影多个视频会议画面,其中,所述控制信息用于指示所述多个视频会议画面中部分或全部视频会议画面投影显示的位置和/或大小;The plurality of projection display devices are disposed at a periphery of the current conference site center, and are configured to respectively project a plurality of video conference screens according to the control information and the data information sent by the control processing device, wherein the control information is used to indicate Position and/or size of a partial or full video conference screen projection display of the plurality of video conference screens;
    所述多个图像捕捉装置,设置为捕捉所述当前会议现场的环境信息,并将所述环境信息发送给所述控制处理装置;The plurality of image capturing devices are configured to capture environmental information of the current meeting site, and send the environmental information to the control processing device;
    所述多个音频捕捉装置,设置为捕捉所述当前会议现场的音频信息,并将所述音频信息发送给所述控制处理装置;The plurality of audio capture devices are configured to capture audio information of the current conference site, and send the audio information to the control processing device;
    所述控制处理装置,分别与所述多个投影显示装置、所述多个图像捕捉装置和所述多个音频捕捉装置连接,设置为根据接收的所述环境信息和/或所述音频信息,生成所述控制信息,并将所述控制信息发送至所述投影显示装置。The control processing device is respectively connected to the plurality of projection display devices, the plurality of image capturing devices, and the plurality of audio capturing devices, and is configured to be based on the received environmental information and/or the audio information. The control information is generated and transmitted to the projection display device.
  2. 根据权利要求1所述的视频会议系统,其中,所述投影显示装置包括:The video conferencing system of claim 1 wherein said projection display device comprises:
    显示位置调整单元,设置为根据所述控制信息,调整所述多个视频会议画面投影显示的位置;和/或a display position adjustment unit configured to adjust a position of the projection display of the plurality of video conference screens according to the control information; and/or
    显示大小调整单元,设置为根据所述控制信息,调整所述多个视频会议画面投影显示的大小。The display size adjustment unit is configured to adjust a size of the projection display of the plurality of video conference screens according to the control information.
  3. 根据权利要求1所述的视频会议系统,其中,所述多个图像捕捉装置,在所述当前会议现场的四周面向会议现场中心设置,或者在所述当前会议现场的中心面向四周设置。The video conferencing system according to claim 1, wherein the plurality of image capturing devices are disposed facing the conference site center around the current conference site, or are disposed around the center of the current conference site.
  4. 根据权利要求1所述的视频会议系统,其中,所述多个音频捕捉装置,在所述当前会议现场的四周面向会议现场中心设置,或者在所述当前会议现场的中心面向四周设置。The video conferencing system according to claim 1, wherein the plurality of audio capturing devices are disposed facing the conference site center around the current conference site, or are disposed around the center of the current conference site.
  5. 根据权利要求1所述的视频会议系统,其中,所述控制处理装置包括:信号接收单元、第一处理单元和/或第二处理单元、控制信息生成单元、信号发送单元,其中, The video conferencing system according to claim 1, wherein the control processing device comprises: a signal receiving unit, a first processing unit and/or a second processing unit, a control information generating unit, and a signal transmitting unit, wherein
    所述信号接收单元,设置为接收所述环境信息和/或所述音频信息;The signal receiving unit is configured to receive the environmental information and/or the audio information;
    所述第一处理单元,设置为根据对应的图像捕捉装置发送的所述环境信息中的图像特征,确定所述环境信息对应的图像捕捉装置的捕捉范围内的参会人数信息;The first processing unit is configured to determine, according to the image feature in the environment information sent by the corresponding image capturing device, the number of participants in the capturing range of the image capturing device corresponding to the environment information;
    所述第二处理单元,设置为根据所述多个音频捕捉装置发送的所述音频信息,确定所述音频信息中对应的一个或多个音源的位置信息;The second processing unit is configured to determine location information of the corresponding one or more audio sources in the audio information according to the audio information sent by the multiple audio capture devices;
    所述控制信息生成单元,设置为根据所述参会人数信息确定对应的图像捕捉装置的捕捉方向上对应的视频会议画面的显示大小,和/或根据所述位置信息确定与其对应的视频会议画面的显示大小和/或显示位置,并根据确定的显示大小和/或显示位置生成所述控制信息;The control information generating unit is configured to determine, according to the number of participants information, a display size of a video conference screen corresponding to a capture direction of the corresponding image capturing device, and/or determine a video conference screen corresponding thereto according to the location information. Display size and/or display position, and generate the control information according to the determined display size and/or display position;
    所述信号发送单元,设置为向所述投影显示装置发送所述控制信息和用于生成所述视频会议画面的所述数据信息。The signal transmitting unit is configured to transmit the control information and the data information for generating the video conference screen to the projection display device.
  6. 根据权利要求1所述的视频会议系统,其中,所述音频信息包括音量信息,以及以下至少之一:频率信息、音色信息。The video conferencing system of claim 1, wherein the audio information comprises volume information, and at least one of: frequency information, timbre information.
  7. 根据权利要求1至6中任一项所述的视频会议系统,其中,所述多个投影显示装置分别应用空中成像技术形成所述多个视频会议画面。The video conferencing system according to any one of claims 1 to 6, wherein the plurality of projection display devices respectively form an aerial imaging technique to form the plurality of video conference screens.
  8. 根据权利要求7所述的视频会议系统,其中,所述投影显示装置还包括:The video conferencing system of claim 7, wherein the projection display device further comprises:
    操作动作捕获单元,设置为捕获用户在所述多个视频会议画面上执行的操作动作;An operation action capturing unit configured to capture an operation performed by a user on the plurality of video conference screens;
    操作动作发送单元,设置为将所述操作动作的信息发送至所述控制处理装置。The operation action transmitting unit is configured to transmit information of the operation action to the control processing device.
  9. 根据权利要求8所述的视频会议系统,其中,所述控制处理装置还包括:The video conferencing system of claim 8, wherein the control processing device further comprises:
    操作动作解析单元,设置为解析所述操作动作为操作指令,其中,所述操作指令包括用于指示当前操作的视频会议画面的显示大小和/或显示位置的操作指令,和/或用于向当前显示的视频会议画面中的对应位置输入图形和/或文字信息的操作指令;An operation action analysis unit configured to parse the operation action as an operation instruction, wherein the operation instruction includes an operation instruction for indicating a display size and/or a display position of the currently operated video conference screen, and/or for An operation instruction for inputting graphics and/or text information at a corresponding position in the currently displayed video conference screen;
    其中,所述控制信息生成单元,还设置为根据所述操作指令指示的当前操作的视频会议画面的显示大小和/或显示位置生成所述控制信息。The control information generating unit is further configured to generate the control information according to a display size and/or a display position of a currently operated video conference screen indicated by the operation instruction.
  10. 根据权利要求9所述的视频会议系统,其中,所述控制处理装置还包括: The video conferencing system of claim 9, wherein the control processing device further comprises:
    数据信息处理单元,设置为根据用于向当前显示的视频会议画面中的对应位置输入图形和/或文字信息的操作,更新所述数据信息。The data information processing unit is configured to update the data information according to an operation for inputting graphic and/or text information to a corresponding position in the currently displayed video conference screen.
  11. 根据权利要求1至6、8至10中任一项所述的视频会议系统,其中,所述视频会议系统还包括:The video conferencing system according to any one of claims 1 to 6, 8 to 10, wherein the video conferencing system further comprises:
    网络交互装置,与所述控制处理装置连接,设置为所述控制处理装置与其他如权利要求1至6、8至10中任一项所述的视频会议系统中的控制处理装置交互所述数据信息和/或用于向当前显示的视频会议画面中的对应位置输入图形和/或文字信息的操作指令。a network interaction device, coupled to the control processing device, configured to interact with the control processing device in the video conferencing system according to any one of claims 1 to 6, 8 to 10 Information and/or operational instructions for inputting graphical and/or textual information to corresponding locations in the currently displayed video conference screen.
  12. 一种视频会议方法,包括:A video conferencing method includes:
    获取当前会议现场的环境信息和/或音频信息,以及指示视频会议画面内容的数据信息;Obtaining environmental information and/or audio information of the current conference site, and data information indicating the content of the video conference screen;
    根据所述环境信息和/或所述音频信息,生成控制信息;Generating control information according to the environmental information and/or the audio information;
    根据所述控制信息和所述数据信息,分别投影多个视频会议画面,其中,所述控制信息用于指示所述多个视频会议画面中部分或全部视频会议画面投影显示的位置和/或大小。And respectively, according to the control information and the data information, respectively projecting a plurality of video conference screens, wherein the control information is used to indicate a position and/or a size of a part or all of the video conference screens of the plurality of video conference screens. .
  13. 根据权利要求12所述的视频会议方法,其中,所述方法还包括:应用空中成像技术形成所述多个视频会议画面。 The video conferencing method of claim 12, wherein the method further comprises applying the aerial imaging technique to form the plurality of video conference pictures.
PCT/CN2014/095179 2014-06-17 2014-12-26 Video conferencing system and method WO2015192631A1 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201410269890.6A CN105306868B (en) 2014-06-17 2014-06-17 Video conferencing system and method
CN201410269890.6 2014-06-17

Publications (1)

Publication Number Publication Date
WO2015192631A1 true WO2015192631A1 (en) 2015-12-23

Family

ID=54934826

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2014/095179 WO2015192631A1 (en) 2014-06-17 2014-12-26 Video conferencing system and method

Country Status (2)

Country Link
CN (1) CN105306868B (en)
WO (1) WO2015192631A1 (en)

Cited By (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106127534A (en) * 2016-08-24 2016-11-16 杨威 A kind of exhibition system based on virtual reality
CN107027004A (en) * 2017-05-26 2017-08-08 上海启诺信息科技有限公司 Phonotape and videotape linkage microphone host
CN112241663A (en) * 2019-07-18 2021-01-19 上汽通用汽车有限公司 Device and system for allocating a plurality of vehicle-mounted resources
CN113905204A (en) * 2021-09-07 2022-01-07 深圳壹秘科技有限公司 Image display method, device, equipment and storage medium
CN114245156A (en) * 2021-11-30 2022-03-25 广州繁星互娱信息科技有限公司 Live broadcast audio adjusting method and device, storage medium and electronic equipment
CN115277650A (en) * 2022-07-13 2022-11-01 深圳乐播科技有限公司 Screen projection display control method, electronic equipment and related device

Families Citing this family (12)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN107333117B (en) * 2016-04-29 2022-10-28 中兴通讯股份有限公司 Projection device, conference system, and projection device control method
CN106095098A (en) * 2016-06-07 2016-11-09 深圳奥比中光科技有限公司 Body feeling interaction device and body feeling interaction method
CN105959614A (en) * 2016-06-21 2016-09-21 维沃移动通信有限公司 Method and system for processing video conference
CN107734286B (en) 2016-08-12 2021-05-04 阿里巴巴集团控股有限公司 Video window display method and device
CN106791574B (en) * 2016-12-16 2020-04-24 联想(北京)有限公司 Video annotation method and device and video conference system
CN107426523A (en) * 2017-04-25 2017-12-01 太仓鸿策拓达科技咨询有限公司 A kind of wireless video conference system
CN107948577A (en) * 2017-12-26 2018-04-20 深圳市保千里电子有限公司 A kind of method and its system of panorama video conference
CN109274921A (en) * 2018-07-27 2019-01-25 像航(上海)科技有限公司 Video conferencing system
CN110333837B (en) * 2019-07-09 2023-05-16 高创(苏州)电子有限公司 Conference system, communication method and device
CN114265381B (en) * 2021-11-11 2024-02-09 四川华能宝兴河水电有限责任公司 Remote fault diagnosis system for hydropower station
CN114374682B (en) * 2022-01-07 2023-03-28 深圳看到科技有限公司 Data sharing method and system, storage medium and terminal equipment
CN114845144B (en) * 2022-04-26 2023-12-15 长沙朗源电子科技有限公司 Screen projection method, auxiliary screen projection device and storage medium

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN201765431U (en) * 2010-08-05 2011-03-16 上海飞来飞去多媒体创意有限公司 Streamline image annular projecting and displaying system
CN102714705A (en) * 2012-03-08 2012-10-03 华为技术有限公司 Method, device, and system for highlighting party of interest
CN103297743A (en) * 2012-03-05 2013-09-11 联想(北京)有限公司 Video conference display window adjusting method and video conference service equipment
CN103533295A (en) * 2013-10-15 2014-01-22 陈海华 Full high-definition video meeting system
CN103841360A (en) * 2013-12-11 2014-06-04 三亚中兴软件有限责任公司 Distributed video conference achieving method and system, video conference terminal and audio and video integrated device

Family Cites Families (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102724604B (en) * 2012-06-06 2014-11-26 北京中自投资管理有限公司 Sound processing method for video meeting
JP6016090B2 (en) * 2012-09-04 2016-10-26 株式会社リコー Image projection system, image projection apparatus, remote control apparatus for image projection system, and video conference system using image projection system

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN201765431U (en) * 2010-08-05 2011-03-16 上海飞来飞去多媒体创意有限公司 Streamline image annular projecting and displaying system
CN103297743A (en) * 2012-03-05 2013-09-11 联想(北京)有限公司 Video conference display window adjusting method and video conference service equipment
CN102714705A (en) * 2012-03-08 2012-10-03 华为技术有限公司 Method, device, and system for highlighting party of interest
CN103533295A (en) * 2013-10-15 2014-01-22 陈海华 Full high-definition video meeting system
CN103841360A (en) * 2013-12-11 2014-06-04 三亚中兴软件有限责任公司 Distributed video conference achieving method and system, video conference terminal and audio and video integrated device

Cited By (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106127534A (en) * 2016-08-24 2016-11-16 杨威 A kind of exhibition system based on virtual reality
CN107027004A (en) * 2017-05-26 2017-08-08 上海启诺信息科技有限公司 Phonotape and videotape linkage microphone host
CN112241663A (en) * 2019-07-18 2021-01-19 上汽通用汽车有限公司 Device and system for allocating a plurality of vehicle-mounted resources
CN112241663B (en) * 2019-07-18 2023-07-25 上汽通用汽车有限公司 Device and system for allocating multiple vehicle-mounted resources
CN113905204A (en) * 2021-09-07 2022-01-07 深圳壹秘科技有限公司 Image display method, device, equipment and storage medium
CN114245156A (en) * 2021-11-30 2022-03-25 广州繁星互娱信息科技有限公司 Live broadcast audio adjusting method and device, storage medium and electronic equipment
CN115277650A (en) * 2022-07-13 2022-11-01 深圳乐播科技有限公司 Screen projection display control method, electronic equipment and related device
CN115277650B (en) * 2022-07-13 2024-01-09 深圳乐播科技有限公司 Screen-throwing display control method, electronic equipment and related device

Also Published As

Publication number Publication date
CN105306868B (en) 2019-07-26
CN105306868A (en) 2016-02-03

Similar Documents

Publication Publication Date Title
WO2015192631A1 (en) Video conferencing system and method
WO2017148294A1 (en) Mobile terminal-based apparatus control method, device, and mobile terminal
CN112243583B (en) Multi-endpoint mixed reality conference
CN103631768B (en) Collaboration data editor and processing system
JP5903936B2 (en) Method, storage medium and apparatus for information selection and switching
US20220156986A1 (en) Scene interaction method and apparatus, electronic device, and computer storage medium
CN106548517B (en) Method and device for carrying out video conference based on augmented reality technology
CN104777991B (en) A kind of remote interaction optical projection system based on mobile phone
US11595615B2 (en) Conference device, method of controlling conference device, and computer storage medium
US8902280B2 (en) Communicating visual representations in virtual collaboration systems
JP2013197838A (en) Remote conference system and remote conference terminal
CN104750498B (en) A kind of method and electronic equipment controlling mouse module
WO2019029087A1 (en) Live broadcast annotation method and apparatus, terminal, and live broadcast system
JP2010113618A (en) Image distribution device and method, and program
WO2023016107A1 (en) Remote interaction method, apparatus and system, and electronic device and storage medium
CN109413364A (en) A kind of interactive remote meeting system and method
US20230269482A1 (en) Information processing system, communication system, and image sharing method
JP2005303683A (en) Image transceiver
US10545716B2 (en) Information processing device, information processing method, and program
KR102034277B1 (en) The system of conference live streaming broadcasting
US20230308764A1 (en) Display terminal, communication system, method for displaying, method for communicating, and recording medium
US20230326001A1 (en) Display terminal, display method, and recording medium
US20230308622A1 (en) Display terminal, displaying method, and recording medium
US20240007610A1 (en) Display terminal, communication system, display method, and communication method
US20230269481A1 (en) Information processing system, communication system, and image transmission method

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 14894960

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 14894960

Country of ref document: EP

Kind code of ref document: A1