WO2021073155A1 - Video conference method, apparatus and device, and storage medium - Google Patents

Video conference method, apparatus and device, and storage medium Download PDF

Info

Publication number
WO2021073155A1
WO2021073155A1 PCT/CN2020/099236 CN2020099236W WO2021073155A1 WO 2021073155 A1 WO2021073155 A1 WO 2021073155A1 CN 2020099236 W CN2020099236 W CN 2020099236W WO 2021073155 A1 WO2021073155 A1 WO 2021073155A1
Authority
WO
WIPO (PCT)
Prior art keywords
video conference
data
format
video
connection
Prior art date
Application number
PCT/CN2020/099236
Other languages
French (fr)
Chinese (zh)
Inventor
洪凌毅
Original Assignee
平安科技(深圳)有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 平安科技(深圳)有限公司 filed Critical 平安科技(深圳)有限公司
Publication of WO2021073155A1 publication Critical patent/WO2021073155A1/en

Links

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00Television systems
    • H04N7/14Systems for two-way working
    • H04N7/15Conference systems
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00Television systems
    • H04N7/14Systems for two-way working
    • H04N7/141Systems for two-way working between two video terminals, e.g. videophone
    • H04N7/147Communication arrangements, e.g. identifying the communication as a video-communication, intermediate storage of the signals

Definitions

  • the embodiments of the present application relate to the field of smart city technology, and in particular, to video conference methods, devices, equipment, and storage media.
  • Video conferences usually use video conference systems, which require the purchase of a large number of video conference hardware equipment, including terminal equipment, server equipment, and high equipment prices and maintenance costs.
  • video conferencing terminal equipment must be deployed in a dedicated conference room, and meeting users must hold meetings at an agreed time and place. It is impossible to use the Internet for mobile meetings anytime and anywhere, which is inconvenient to use.
  • the embodiments of the present application provide a video conference method, device, computer equipment, and computer-readable storage medium, which are used to solve the problem that Internet conferences and video conferences cannot communicate with each other.
  • a video conference method includes:
  • a first connection between the first video conference device and the network device is established, and first connection information is generated.
  • the first connection information includes the connected user information of the first video conference device and the information of the local media in the first video conference device.
  • Media stream description
  • Control the second video conference device and/or the first video conference device to parse the first video conference data and/or the second video conference data to display the data corresponding to the first video conference data and/or the second video conference data Video conference content.
  • an embodiment of the present application further provides a video conference device, which includes:
  • the first connection establishment module is configured to establish a first connection between a first video conference device and a network device, and generate first connection information, where the first connection information includes the connected user information of the first video conference device and the first connection 1.
  • a second connection establishment module configured to establish a second connection between the network device and the second video conference device according to the first connection information
  • a video conference data transmission module configured to obtain the first video conference data of the first video conference device and/or the second video conference data of the second video conference device through the first connection and the second connection;
  • the video conference data conversion module is configured to convert the first video conference data into an analytic format corresponding to the second video conference device, and/or convert the second video conference data into an analysis format corresponding to the first video conference device Parsing format
  • the control video conference data display module is used to control the second video conference device and/or the first video conference device to parse the first corresponding video conference data and/or the second video conference data to display the first video conference The data and/or the video conference content corresponding to the second video conference data.
  • embodiments of the present application also provide a computer device, the computer device including a memory, a processor, and a computer program stored on the memory and running on the processor, and the processor executes the following steps :
  • a first connection between the first video conference device and the network device is established, and first connection information is generated.
  • the first connection information includes the connected user information of the first video conference device and the information of the local media in the first video conference device.
  • Media stream description
  • Control the second video conference device and/or the first video conference device to parse the first video conference data and/or the second video conference data to display the data corresponding to the first video conference data and/or the second video conference data Video conference content.
  • the embodiments of the present application also provide a computer-readable storage medium having a computer program stored in the computer-readable storage medium, and the computer program may be executed by at least one processor, so that the at least A processor performs the following steps:
  • a first connection between the first video conference device and the network device is established, and first connection information is generated.
  • the first connection information includes the connected user information of the first video conference device and the information of the local media in the first video conference device.
  • Media stream description
  • Control the second video conference device and/or the first video conference device to parse the first video conference data and/or the second video conference data to display the data corresponding to the first video conference data and/or the second video conference data Video conference content.
  • the video conferencing method, device, computer equipment, and computer-readable storage medium provided by the embodiments of the application can realize the conversion between web page session and traditional video conferencing system, and the conversion between web page data and video conference data can be realized by enterprises. It is more convenient for internal and external users to hold video conferences through the audio and video communication between the web pages of mobile phones and PC browsers and the video conference system. By accessing the existing video conference system of the enterprise, some unrealized functions in mobile conferences are enriched, such as Remote desktop sharing, whiteboard sharing, PPT document/media data presentation, fixed phone/mobile access, etc., learn from each other while avoiding waste of corporate resources.
  • FIG. 1 is a flowchart of the steps of the video conference method according to the first embodiment of the application
  • FIG. 2 is a schematic diagram of program modules of the second embodiment of the computer equipment of this application.
  • Fig. 3 is a schematic diagram of the hardware structure of the third embodiment of the computer equipment of the present application.
  • FIG. 4 is a schematic diagram of the step flow of step S108.
  • FIG. 1 shows a flowchart of the steps of a video conference method according to an embodiment of the present application. It can be understood that the flowchart in this method embodiment is not used to limit the order of execution of the steps.
  • the following is an exemplary description with computer equipment as the main body of execution, and the details are as follows:
  • Step S100 Establish a first connection between a first video conference device and a network device, and generate first connection information, where the first connection information includes the connected user information of the first video conference device and the information in the first video conference device.
  • the media stream description of the local media is not limited to:
  • the first video conference device is a non-dedicated video conference device, including but not limited to computers, mobile phones, tablets, and other terminals that support video conferences, and the network devices include, but are not limited to, routers and switches with gateways, etc. .
  • the user inputs user information through the webpage of the browser of the first video conference device to initiate a request for establishing the first connection, and the gateway controls the webpage to send verification information to the gateway.
  • the verification information includes the user login name and password, and the gateway verifies the user login name and password.
  • the gateway continues to process the request for establishment of the first connection, and if the verification fails, the request for establishment of the first connection is rejected.
  • the gateway After the gateway receives the request for establishing the first connection, it generates first connection information, where the first connection information includes the connection user information and the media stream description of the local media.
  • the media stream description of the local media refers to the media stream description of the first video conference device, and the connected user information carries the number of the second video conference device selected by the user in initiating the first connection establishment request. Select the second video conference device that needs to be used.
  • the local media stream description includes the name and purpose of the session, the time segment of the session activation, the media that constitutes the session, the bandwidth information used by the session, the contact information of the person in charge of the session, and the media Information
  • the media information includes: media type (video, audio, etc.), media transfer protocol (RTP/UDP/IP H.320, etc.), media format (H.264 video, MPEG video, etc.), media address and port, etc. .
  • Step S102 Establish a second connection between the network device and the second video conference device according to the first connection information.
  • the second video conference device is a dedicated video conference device.
  • the gateway receives the first connection information and obtains the serial number of the second video conference device according to the connected user information, and obtains the audio and video encoding of the web page through the media stream description on the web page.
  • the connected user information is: offer from user ZHOUQIAN001 to polycom1995217, the number of the second video conference terminal selected here is 1995217; the media stream description is
  • the gateway extracts from the media stream description to obtain the audio encoding format supported by the web page as g.711/isac/opus,
  • the video encoding format is vp8/vp9/h.264baseline. It can be seen that the audio encoding format supported by the second video device end is only G.711 encoding, and the video encoding format is only H.264 encoding.
  • the gateway initiates an H.323 call to the second video conferencing device according to the G.711 and H.264 encoding.
  • the H.323 protocol uses binary-based The ASN.1 coding specification is used to package signaling messages.
  • the H.323 protocol is a protocol suite, including H.225 and H.245 protocols.
  • the H.225 protocol is used to establish call signaling channels.
  • the H.245 protocol is used to negotiate media channel parameters to prepare for the transmission of multimedia information.
  • the gateway first sends the H.225 text format setup message in the H.323 protocol suite and converts it to the ASN.1 binary format.
  • the setup message is sent to the second video conference device, the setup message is an initialization message used by the caller to establish a call, and the setup message includes the gateway number, the second video conference end number, and the The video conference terminal IP address, port number, terminal identity, call identifier, send complete field and H.245 Tunnelling field, the second video conference device receives the H.225 protocol setup message, and returns H to the gateway .225 CS: alerting and CS: connectASN.1 binary format messages, translated into text H.225 CS: alerting and CS: connect text format messages, sent to the gateway, the alerting message and the connect message are the second The video conference device sends it to indicate that the second video conference device is ready, and the alerting message includes the IP address, port number, H.245 Tunnelling field, and the second video conference device for establishing an H.245 connection to the second video conference device.
  • the video conference device identity field, the connect message indicates that the second video conference device has accepted the call from the gateway, and the connect message includes the IP address and port for establishing the H.245 connection to the second video conference device Number, H.245 Tunnelling field, call identifier, and the second video conference device identity field.
  • the gateway and the second video conferencing device conduct capability negotiation through the H.245 protocol.
  • the H.245 capability negotiation includes processes such as capability exchange, master-slave determination, and logical channel establishment.
  • the capability exchange process refers to the After the gateway receives the connect message, it is the first process to be executed.
  • the capability exchange process is that the two parties in communication understand each other's receiving and sending capabilities.
  • the receiving capability defines the sending mode of the opposite end, and the sending capability specifies the negotiation range of the desired mode of the opposite end requesting to receive signals.
  • the logical channel is activated by the second video conference device, and the second video conference device sends an open logical channel message to the gateway, and the open logical channel message includes the logical channel number from the second video conference device to the gateway and The first channel parameter, where the first channel parameter includes the transport layer address from the gateway to the second video conference device; after the gateway receives the open logical channel message, it sends back an open logical channel confirmation message, the open logical channel confirmation
  • the message includes the logical channel number from the gateway to the second video conference device and the second channel parameter, and the second channel parameter includes the transport layer address from the second video conference device to the gateway.
  • the gateway sends the media stream description of the web page terminal to the second video conference terminal according to the acquired audio and video coding format.
  • the gateway converts the media stream description of the web page into an H.245 media capability negotiation message and forwards it to the second video conference end, and the gateway extracts the audio encoding G.711 and G.711 and that are supported by both parties.
  • the second video conference terminal returns an audio and video message supported by the gateway, and the gateway extracts a corresponding media stream description that conforms to the audio and video encoding format of the web page terminal and sends it to the second video conference terminal to establish the gateway terminal Connection with the second video conference terminal.
  • the second video conference terminal returns to the gateway to parse a binary message, extracts the G.711 and H.264 encoding capabilities supported by the web page, and discards the unsupported G.722/G.723/G .729 and other codes, generate an open logical channel message and return it to the gateway.
  • the gateway After receiving the open logical channel message, the gateway sends an open logical channel confirmation message to the second video conference end, and the media capability negotiation between the two parties is completed. , The gateway successfully establishes the second connection with the second video conference device.
  • Step S104 Obtain the first video conference data of the first video conference device and/or the second video conference data of the second video conference device through the first connection and the second connection.
  • the video conference data in the first format obtained by the first video conference device is transmitted to the network device, or the video conference data in the second format obtained by the second video conference device is transmitted to the network device through the second connection. Mentioned network equipment.
  • the video conference data in the first format or the video conference data in the second format is encrypted and sent to the network device.
  • Step S106 Convert the first video conference data into an analytical format corresponding to the second video conference device, and/or convert the second video conference data into an analytical format corresponding to the first video conference device.
  • the video conference data in the first format is converted into video conference data in the second format and sent to a second video conference device, or the video conference data in the second format is converted into video conference data in the first format and sent to The first video conference equipment.
  • the video conference data in the first format After decrypting the video conference data in the first format, it is converted into video conference data in the second format and sent to the video conference device in the second format, or the video conference data in the second format is decrypted and converted into video in the first format.
  • the conference data is sent to the video conference device in the first format.
  • the media stream format corresponding to the second video conference device is a media stream in RTP format
  • the second video conference device sends the media stream in RTP format to the gateway
  • the RTP includes a media format for identifying the media format.
  • the media stream corresponding to the web page side is an SRTP format media stream, and the web page side sends SRTP format media to the gateway. flow.
  • the format of the SRTP packet is the same as that of the RTP header. The difference is that the media load part is encrypted in different ways.
  • the gateway acts as a media stream proxy, and the gateway transfers the media stream in the RTP format from the second video conference device. Unpack, remove the RTP packet header, and decrypt the remaining packet load according to the session negotiated on the web page, then add the RTP packet header again, package it into SRTP format and forward it to the web page; unpack the media stream in SRTP format from the web page, and remove The SRTP packet header, the remaining packet load is decrypted according to the session negotiated by the second video conference device, the RTP packet header is added again, and it is packaged into an RTP format and forwarded to the second video conference device.
  • Step S108 Control the second video conference device and/or the first video conference device to parse the corresponding video conference data and/or the second video conference data to display the first video conference data and/or the second video conference The video conference content corresponding to the data.
  • step S108 may further include:
  • S108A Separate the decrypted video conference data in the first format or the video conference data in the second format into audio stream compression coded data and video stream compression coded data;
  • the video conference data includes audio data and video data
  • the second format video conference data also includes data such as PPT document presentation, media material presentation, whiteboard sharing, and fixed-line, mobile phone access.
  • S108C Synchronize the uncompressed audio raw data and the uncompressed video raw data, and send the uncompressed audio raw data and the uncompressed video raw data to the first video conference device or the second video conference equipment.
  • the uncompressed audio original data and the uncompressed video original data are synchronized, and the uncompressed
  • the audio raw data and the uncompressed video raw data are sent to the graphics card and sound card of the system for playback.
  • the embodiment of the application develops a video conference method to realize the conversation between the web page session and the traditional video conference system, and can realize the audio and video communication between the web page page and the video conference system through the mobile phone and PC browser of the users inside and outside the enterprise.
  • Video conferencing is more convenient. By accessing the company's existing video conferencing system, some unrealized functions in mobile meetings are enriched, such as remote desktop sharing, whiteboard sharing, PPT document/media presentation, fixed phone/mobile access, etc. , Learn from each other while avoiding waste of enterprise resources.
  • FIG. 2 shows a schematic diagram of program modules of the video conference device of the present application.
  • the video conference device 20 may include or be divided into one or more program modules, and the one or more program modules are stored in a storage medium and executed by one or more processors to complete the present invention. Apply, and realize the above-mentioned video conference method.
  • the program module referred to in the embodiments of the present application refers to a series of computer program instruction segments capable of completing specific functions, and is more suitable for describing the execution process of the video conference device 20 in the storage medium than the program itself. The following description will specifically introduce the functions of each program module in this embodiment:
  • the first connection establishment module 200 is configured to establish a first connection between a first video conference device and a network device, and generate first connection information.
  • the first connection information includes the connected user information of the first video conference device and the The media stream description of the local media in the first video conference device;
  • first connection establishment module 200 is also used to control the first video conference device to send verification information to the network device;
  • the second connection establishment module 202 is configured to establish a second connection between the network device and the second video conference device according to the first connection information
  • the video conference data transmission module 204 is configured to obtain the first video data of the first video conference device and/or the second video conference data of the second video conference device through the first connection and the second connection;
  • the video conference data transmission module 204 is configured to transmit the video conference data in the first format obtained by the first video conference device to the network device, or transmit the second video conference device through the second connection The acquired video conference data in the second format to the network device;
  • the video conference data transmission module 204 is further configured to encrypt the video conference data in the first format and send it to the network device, and encrypt the video conference data in the second format and send it to the network device.
  • the video conference data conversion module 206 is configured to convert the first video conference data into an analytic format corresponding to the second video conference device and/or convert the second video conference data into an analysis format corresponding to the first video conference device Parsing format
  • the video conference data conversion module 206 is configured to convert the first format video conference data into a second format video conference data and send it to a second video conference device, or convert the second format video conference data The video conference data in the first format is sent to the first video conference device.
  • the video conference data conversion module 206 is further configured to decrypt the video conference data in the first format and send it to the second format video conference device, and decrypt the video conference data in the second format and send it to the first format.
  • Format video conferencing equipment
  • the control video conference data display module 208 is used to control the second video conference device and/or the first video conference device to parse the first video conference data and/or the second video conference data to display the first video conference data And/or the video conference content corresponding to the second video conference data.
  • control video conference data display module 208 is further configured to separate the decrypted video conference data in the first format or the video conference data in the second format into audio stream compression coded data and video stream compression coded data;
  • the uncompressed audio raw data and the uncompressed video raw data are synchronized, and the uncompressed audio raw data and the uncompressed video raw data are sent to the first video conference device or the second video conference device.
  • the computer device 2 is a device that can automatically perform numerical calculation and/or information processing in accordance with pre-set or stored instructions.
  • the computer device 2 may be a rack server, a blade server, a tower server, or a cabinet server (including an independent server or a server cluster composed of multiple servers).
  • the computer equipment 2 at least includes, but is not limited to, a memory 21, a processor 22, a network interface 23, and a video conference device 20 that can communicate with each other through a system bus. among them:
  • the memory 21 includes at least one type of computer-readable storage medium.
  • the readable storage medium includes flash memory, hard disk, multimedia card, card-type memory (for example, SD or DX memory, etc.), random access memory ( RAM), static random access memory (SRAM), read-only memory (ROM), electrically erasable programmable read-only memory (EEPROM), programmable read-only memory (PROM), magnetic memory, magnetic disks, optical disks, etc.
  • the memory 21 may be an internal storage unit of the computer device 2, for example, a hard disk or a memory of the computer device 2.
  • the memory 21 may also be an external storage device of the computer device 2, for example, a plug-in hard disk, a smart memory card (Smart Media Card, SMC), and a secure digital (Secure Digital, SD) card, flash card (FlashCard), etc.
  • the memory 21 may also include both the internal storage unit of the computer device 2 and its external storage device.
  • the memory 21 is generally used to store an operating system and various application software installed in the computer device 2, for example, the program code of the video conference device 20 in the second embodiment.
  • the memory 21 can also be used to temporarily store various types of data that have been output or will be output.
  • the processor 22 may be a central processing unit (Central Processing Unit, CPU), a controller, a microcontroller, a microprocessor, or other data processing chips.
  • the processor 22 is generally used to control the overall operation of the computer device 2.
  • the processor 22 is used to run the program code or process data stored in the memory 21, for example, to run the video conference device 20, so as to implement the video conference method of the first embodiment.
  • the network interface 23 may include a wireless network interface or a wired network interface, and the network interface 23 is generally used to establish a communication connection between the computer device 2 and other electronic devices.
  • the network interface 23 is used to connect the computer device 2 with an external terminal through a network, and establish a data transmission channel and a communication connection between the computer device 2 and the external terminal.
  • the network may be an intranet (Intranet), the Internet (Internet), a global system of mobile communication (GSM), a wideband code division multiple access (WCDMA), 4G network, 5G Network, Bluetooth (Bluetooth), Wi-Fi and other wireless or wired networks.
  • FIG. 3 only shows the computer device 2 with components 20-23, but it should be understood that it is not required to implement all the components shown, and more or fewer components may be implemented instead.
  • the video conference device 20 stored in the memory 21 may also be divided into one or more program modules, and the one or more program modules are stored in the memory 21 and are composed of one or more program modules. Is executed by two processors (in this embodiment, the processor 22) to complete the application.
  • FIG. 2 shows a schematic diagram of program modules for implementing the second embodiment of the video conferencing device 20.
  • the video conferencing device 20 can be divided into a first connection establishment module 200 and a second connection establishment module. 202, a video conference data transmission module 204, a video conference data conversion module 206, and a control video conference data display module 208.
  • the program module referred to in the present application refers to a series of computer program instruction segments that can complete specific functions, and is more suitable than a program to describe the execution process of the video conference device 20 in the computer device 2.
  • the specific functions of the program modules 200-208 have been described in detail in the second embodiment, and will not be repeated here.
  • This embodiment also provides a computer-readable storage medium, such as flash memory, hard disk, multimedia card, card-type memory (for example, SD or DX memory, etc.), random access memory (RAM), static random access memory (SRAM), only Readable memory (ROM), electrically erasable programmable read-only memory (EEPROM), programmable read-only memory (PROM), magnetic memory, magnetic disks, optical disks, servers, App application malls, etc., on which computer programs are stored, The corresponding function is realized when the program is executed by the processor.
  • the computer-readable storage medium of this embodiment is used to store the video conferencing device 20, and when executed by a processor, the video conferencing method of the first embodiment is implemented.
  • the computer-readable storage medium may be non-volatile or volatile. .

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
  • Telephonic Communication Services (AREA)

Abstract

Provided is a video conference method, comprising: establishing a first connection between a first video conference device and a network device, generating first connection information, establishing, according to the first connection information, a second connection between the network device and a second video conference device, acquiring first video conference data of the first video conference device and/or second video conference data of the second video conference device by means of the first connection and the second connection, converting the video conference data into parsing formats corresponding to the first video conference device and the second video conference device, and controlling the first video conference device and the second video conference device to parse the corresponding video conference data in order to present the corresponding video conference content. Further provided are a video conference apparatus and device, and a storage medium. Web page sessions, sessions of a traditional video conference system, and audio and video communications between users inside and outside an enterprise and a video conference system by means of a mobile phone and a web page of a PC browser are thus realized.

Description

视频会议方法、装置、设备及存储介质Video conference method, device, equipment and storage medium
本申请要求于2019年10月16日提交中国专利局、申请号为201910983269.9、发明名称为“视频会议方法、装置、设备及存储介质”的中国专利申请的优先权,其全部内容通过引用结合在本申请中。This application claims the priority of a Chinese patent application filed with the Chinese Patent Office, the application number is 201910983269.9, and the invention title is "video conferencing method, device, equipment and storage medium" on October 16, 2019. The entire content is incorporated by reference. In this application.
技术领域Technical field
本申请实施例涉及智慧城市技术领域,尤其涉及视频会议方法、装置、设备及存储介质。The embodiments of the present application relate to the field of smart city technology, and in particular, to video conference methods, devices, equipment, and storage media.
背景技术Background technique
传统的视频会议通常采用视频会议系统,需要采购大量视频会议硬件设备,包括终端设备、服务器设备,设备价格和维护成本高昂。但是,发明人发现,视频会议终端设备必须部署在专用会议室房间内,会议用户必须在约定的时间地点召开会议,无法做到随时随地利用互联网进行移动会议,使用不方便。Traditional video conferences usually use video conference systems, which require the purchase of a large number of video conference hardware equipment, including terminal equipment, server equipment, and high equipment prices and maintenance costs. However, the inventor found that video conferencing terminal equipment must be deployed in a dedicated conference room, and meeting users must hold meetings at an agreed time and place. It is impossible to use the Internet for mobile meetings anytime and anywhere, which is inconvenient to use.
市面上已有的其它互联网会议工具,虽然能够通过手机等移动设备进行会议,却因为网络传输协议和编解码格式上不兼容,无法做到和传统视频会议设备互联互通。Other Internet conferencing tools on the market, although they can be used to conduct meetings via mobile devices such as mobile phones, they cannot be interconnected with traditional video conferencing equipment due to the incompatibility of network transmission protocols and codec formats.
对于大量采购视频会议设备的企业来说,一方面很多实时性会议无法利用既有资源,造成了资源浪费,另一方面,经常存在企业内和企业外用户之间要召开会议的需求,无论是单纯视频会议或单纯互联网会议都无法满足应用场景。因此,需要提供一种视频会议方法,用来解决互联网会议和视频会议不能互通的问题。For companies that purchase a large number of video conferencing equipment, on the one hand, many real-time meetings cannot use existing resources, resulting in a waste of resources. On the other hand, there is often a need to hold meetings between users within and outside the enterprise, whether it is Neither video conferences nor Internet conferences can meet the application scenarios. Therefore, it is necessary to provide a video conference method to solve the problem that Internet conferences and video conferences cannot communicate with each other.
发明内容Summary of the invention
有鉴于此,本申请实施例提供了一种视频会议方法、装置、计算机设备及计算机可读存储介质,用于解决互联网会议和视频会议不能互通的问题。In view of this, the embodiments of the present application provide a video conference method, device, computer equipment, and computer-readable storage medium, which are used to solve the problem that Internet conferences and video conferences cannot communicate with each other.
本申请实施例是通过下述技术方案来解决上述技术问题:The embodiments of this application solve the above technical problems through the following technical solutions:
一种视频会议方法,包括:A video conference method includes:
建立第一视频会议设备和网络设备的第一连接,生成第一连接信息,所述第一连接信息包括所述第一视频会议设备的连接用户信息和所述第一视频会议设备中本地媒体的媒体流描述;A first connection between the first video conference device and the network device is established, and first connection information is generated. The first connection information includes the connected user information of the first video conference device and the information of the local media in the first video conference device. Media stream description;
根据所述第一连接信息建立所述网络设备和第二视频会议设备的第二连接;Establishing a second connection between the network device and the second video conference device according to the first connection information;
通过所述第一连接和所述第二连接获取所述第一视频会议设备第一视频会议数据和/或所述第二视频会议设备的第二视频会议数据;Acquiring first video conference data of the first video conference device and/or second video conference data of the second video conference device through the first connection and the second connection;
将所述第一视频会议数据转换成所述第二视频会议设备对应的解析格式,和/或将第二视频会议数据转换成所述第一视频会议设备对应的解析格式;Converting the first video conference data into an analytic format corresponding to the second video conference device, and/or converting the second video conference data into an analytic format corresponding to the first video conference device;
控制所述第二视频会议设备和/或第一视频会议设备解析第一视频会议数据和/或第二视频会议数据,以展示所述第一视频会议数据和/或第二视频会议数据对应的视频会议内容。Control the second video conference device and/or the first video conference device to parse the first video conference data and/or the second video conference data to display the data corresponding to the first video conference data and/or the second video conference data Video conference content.
为了实现上述目的,本申请实施例还提供一种视频会议装置,其中,包括:In order to achieve the foregoing objective, an embodiment of the present application further provides a video conference device, which includes:
第一连接建立模块,用于建立第一视频会议设备和网络设备的第一连接,生成第一连接信息,所述第一连接信息包括所述第一视频会议设备的连接用户信息和所述第一视频会议设备中本地媒体的媒体流描述;;The first connection establishment module is configured to establish a first connection between a first video conference device and a network device, and generate first connection information, where the first connection information includes the connected user information of the first video conference device and the first connection 1. The media stream description of the local media in the video conference device;
第二连接建立模块,用于根据所述第一连接信息建立所述网络设备和第二视频会议设备的第二连接;A second connection establishment module, configured to establish a second connection between the network device and the second video conference device according to the first connection information;
视频会议数据传输模块,用于通过所述第一连接和所述第二连接获取所述第一视频会议设备第一视频会议数据和/或所述第二视频会议设备的第二视频会议数据;A video conference data transmission module, configured to obtain the first video conference data of the first video conference device and/or the second video conference data of the second video conference device through the first connection and the second connection;
视频会议数据转换模块,用于将所述第一视频会议数据转换成所述第二视频会议设备对应的解析格式,和/或将第二视频会议数据转换成所述第一视频会议设备对应的解析格式;The video conference data conversion module is configured to convert the first video conference data into an analytic format corresponding to the second video conference device, and/or convert the second video conference data into an analysis format corresponding to the first video conference device Parsing format
控制视频会议数据展示模块,用于控制所述第二视频会议设备和/或第一视频会议设备解析第一对应的视频会议数据和/或第二视频会议数据,以展示所述第一视频会议数据和/或第二视频会议数据对应的视频会议内容。The control video conference data display module is used to control the second video conference device and/or the first video conference device to parse the first corresponding video conference data and/or the second video conference data to display the first video conference The data and/or the video conference content corresponding to the second video conference data.
为了实现上述目的,本申请实施例还提供一种计算机设备,所述计算机设备包括存储器、处理器以及存储在所述存储器上并可在处理器上运行的计算机程序,所述处理器执行以下步骤:In order to achieve the foregoing objective, embodiments of the present application also provide a computer device, the computer device including a memory, a processor, and a computer program stored on the memory and running on the processor, and the processor executes the following steps :
建立第一视频会议设备和网络设备的第一连接,生成第一连接信息,所述第一连接信息包括所述第一视频会议设备的连接用户信息和所述第一视频会议设备中本地媒体的媒体流描述;A first connection between the first video conference device and the network device is established, and first connection information is generated. The first connection information includes the connected user information of the first video conference device and the information of the local media in the first video conference device. Media stream description;
根据所述第一连接信息建立所述网络设备和第二视频会议设备的第二连接;Establishing a second connection between the network device and the second video conference device according to the first connection information;
通过所述第一连接和所述第二连接获取所述第一视频会议设备第一视频会议数据和/或所述第二视频会议设备的第二视频会议数据;Acquiring first video conference data of the first video conference device and/or second video conference data of the second video conference device through the first connection and the second connection;
将所述第一视频会议数据转换成所述第二视频会议设备对应的解析格式,和/或将第二视频会议数据转换成所述第一视频会议设备对应的解析格式;Converting the first video conference data into an analytic format corresponding to the second video conference device, and/or converting the second video conference data into an analytic format corresponding to the first video conference device;
控制所述第二视频会议设备和/或第一视频会议设备解析第一视频会议数据和/或第二视频会议数据,以展示所述第一视频会议数据和/或第二视频会议数据对应的视频会议内容。Control the second video conference device and/or the first video conference device to parse the first video conference data and/or the second video conference data to display the data corresponding to the first video conference data and/or the second video conference data Video conference content.
为了实现上述目的,本申请实施例还提供一种计算机可读存储介质,所述计算机可读存储介质内存储有计算机程序,所述计算机程序可被至少一个处理器所执行,以使所述至少一个处理器执行以下步骤:In order to achieve the foregoing objective, the embodiments of the present application also provide a computer-readable storage medium having a computer program stored in the computer-readable storage medium, and the computer program may be executed by at least one processor, so that the at least A processor performs the following steps:
建立第一视频会议设备和网络设备的第一连接,生成第一连接信息,所述第一连接信息包括所述第一视频会议设备的连接用户信息和所述第一视频会议设备中本地媒体的媒体流描述;A first connection between the first video conference device and the network device is established, and first connection information is generated. The first connection information includes the connected user information of the first video conference device and the information of the local media in the first video conference device. Media stream description;
根据所述第一连接信息建立所述网络设备和第二视频会议设备的第二连接;Establishing a second connection between the network device and the second video conference device according to the first connection information;
通过所述第一连接和所述第二连接获取所述第一视频会议设备第一视频会议数据和/或所述第二视频会议设备的第二视频会议数据;Acquiring first video conference data of the first video conference device and/or second video conference data of the second video conference device through the first connection and the second connection;
将所述第一视频会议数据转换成所述第二视频会议设备对应的解析格式,和/或将第二视频会议数据转换成所述第一视频会议设备对应的解析格式;Converting the first video conference data into an analytic format corresponding to the second video conference device, and/or converting the second video conference data into an analytic format corresponding to the first video conference device;
控制所述第二视频会议设备和/或第一视频会议设备解析第一视频会议数据和/或第二视频会议数据,以展示所述第一视频会议数据和/或第二视频会议数据对应的视频会议内容。Control the second video conference device and/or the first video conference device to parse the first video conference data and/or the second video conference data to display the data corresponding to the first video conference data and/or the second video conference data Video conference content.
本申请实施例提供的视频会议方法、装置、计算机设备及计算机可读存储介质,现了网页页面会话与传统视频会议系统的会话,网页端数据与视频会议端数据之间的转换,可以实现企业内外用户通过手机和PC浏览器网页页面与视频会议系统之间的音视频通讯,召开视频会议更加方便,通过接入企业已有的视频会议系统,丰富了移动会议上一些没有实现的功能,例如远程桌面共享、白板共享、PPT文档/媒体资料演示、固定电话/手机接入等等,取长补短同时避免了企业资源浪费。The video conferencing method, device, computer equipment, and computer-readable storage medium provided by the embodiments of the application can realize the conversion between web page session and traditional video conferencing system, and the conversion between web page data and video conference data can be realized by enterprises. It is more convenient for internal and external users to hold video conferences through the audio and video communication between the web pages of mobile phones and PC browsers and the video conference system. By accessing the existing video conference system of the enterprise, some unrealized functions in mobile conferences are enriched, such as Remote desktop sharing, whiteboard sharing, PPT document/media data presentation, fixed phone/mobile access, etc., learn from each other while avoiding waste of corporate resources.
附图说明Description of the drawings
图1为本申请实施例一之视频会议方法的步骤流程图;FIG. 1 is a flowchart of the steps of the video conference method according to the first embodiment of the application;
图2为本申请计算机设备之实施例二的程序模块示意图;2 is a schematic diagram of program modules of the second embodiment of the computer equipment of this application;
图3为图本申请计算机设备之实施例三的硬件结构示意图;Fig. 3 is a schematic diagram of the hardware structure of the third embodiment of the computer equipment of the present application;
图4为步骤S108的步骤流程示意图。FIG. 4 is a schematic diagram of the step flow of step S108.
具体实施方式Detailed ways
为了使本申请的目的、技术方案及优点更加清楚明白,以下结合附图及实施例,对本申请进行进一步详细说明。应当理解,此处所描述的具体实施例仅用以解释本申请,并不用于限定本申请。基于本申请中的实施例,本领域普通技术人员在没有做出创造性劳动前提下所获得的所有其他实施例,都属于本申请保护的范围。In order to make the purpose, technical solutions, and advantages of this application clearer, the following further describes this application in detail with reference to the accompanying drawings and embodiments. It should be understood that the specific embodiments described here are only used to explain the present application, and are not used to limit the present application. Based on the embodiments in this application, all other embodiments obtained by those of ordinary skill in the art without creative work shall fall within the protection scope of this application.
各个实施例之间的技术方案可以相互结合,但是必须是以本领域普通技术人员能够实现为基础,当技术方案的结合出现相互矛盾或无法实现时应当认为这种技术方案的结合不存在,也不在本申请要求的保护范围之内。The technical solutions between the various embodiments can be combined with each other, but they must be based on what can be achieved by a person of ordinary skill in the art. When the combination of technical solutions is contradictory or cannot be achieved, it should be considered that such a combination of technical solutions does not exist. It is not within the scope of protection required by this application.
实施例一Example one
请参阅图1,示出了本申请实施例视频会议方法的步骤流程图。可以理解,本方法实施例中的流程图不用于对执行步骤的顺序进行限定。下面以计算机设备为执行主体进行示例性描述,具体如下:Please refer to FIG. 1, which shows a flowchart of the steps of a video conference method according to an embodiment of the present application. It can be understood that the flowchart in this method embodiment is not used to limit the order of execution of the steps. The following is an exemplary description with computer equipment as the main body of execution, and the details are as follows:
步骤S100,建立第一视频会议设备和网络设备的第一连接,生成第一连接信息,所述第一连接信息包括所述第一视频会议设备的连接用户信息和所述第一视频会议设备中本地媒体的媒体流描述。Step S100: Establish a first connection between a first video conference device and a network device, and generate first connection information, where the first connection information includes the connected user information of the first video conference device and the information in the first video conference device. The media stream description of the local media.
具体的,所述第一视频会议设备为非专用的视频会议设备,包括但不限于电脑、手机、平板等支持视频会议的终端,所述网络设备包括但不限于设有网关的路由器、交换机等。Specifically, the first video conference device is a non-dedicated video conference device, including but not limited to computers, mobile phones, tablets, and other terminals that support video conferences, and the network devices include, but are not limited to, routers and switches with gateways, etc. .
在本实施例中,用户通过所述第一视频会议设备浏览器的网页输入用户信息,发起所述第一连接的建立请求,所述网关控制所述网页向所述网关发送验证信息,所述验证信息包括用户登录名和密码,所述网关对用户登录名和密码进行验证。In this embodiment, the user inputs user information through the webpage of the browser of the first video conference device to initiate a request for establishing the first connection, and the gateway controls the webpage to send verification information to the gateway. The verification information includes the user login name and password, and the gateway verifies the user login name and password.
所述用户信息验证通过后,所述网关继续处理所述第一连接的建立请求,验证不通过则拒绝所述第一连接的建立请求。After the user information is verified, the gateway continues to process the request for establishment of the first connection, and if the verification fails, the request for establishment of the first connection is rejected.
所述网关接收所述第一连接的建立请求后,生成第一连接信息,所述第一连接信息包括连接用户信息和本地媒体的媒体流描述。所述本地媒体的媒体流描述是指所述第一视频会议设备的媒体流描述,所述连接用户信息中携带用户在发起第一连接的建立请求选择的第二视频会议设备的编号,用来对需要使用的第二视频会议设备进行选择,所述本地媒体流描述中包括会话名和目的、会话激活的时间区段、构成会话的媒体、会话所用的带宽信息、会话负责人的联系信息和媒体信息,所述媒体信息包括:媒体类型(视频,音频等)、媒体传送协议(RTP/UDP/IP H.320等)、媒体格式(H.264视频,MPEG视频等)、媒体地址和端口等。After the gateway receives the request for establishing the first connection, it generates first connection information, where the first connection information includes the connection user information and the media stream description of the local media. The media stream description of the local media refers to the media stream description of the first video conference device, and the connected user information carries the number of the second video conference device selected by the user in initiating the first connection establishment request. Select the second video conference device that needs to be used. The local media stream description includes the name and purpose of the session, the time segment of the session activation, the media that constitutes the session, the bandwidth information used by the session, the contact information of the person in charge of the session, and the media Information, the media information includes: media type (video, audio, etc.), media transfer protocol (RTP/UDP/IP H.320, etc.), media format (H.264 video, MPEG video, etc.), media address and port, etc. .
步骤S102,根据所述第一连接信息建立所述网络设备和第二视频会议设备的第二连接。所述第二视频会议设备为专用的视频会议设备。Step S102: Establish a second connection between the network device and the second video conference device according to the first connection information. The second video conference device is a dedicated video conference device.
具体的,网关接收所述第一连接信息并根据所述连接用户信息获取所述第二视频会议设备的编号,通过所述网页端的媒体流描述获取所述网页端的音视频编码。Specifically, the gateway receives the first connection information and obtains the serial number of the second video conference device according to the connected user information, and obtains the audio and video encoding of the web page through the media stream description on the web page.
以宝利通视频会议系统为例进行进一步说明,示例性的,所述连接用户信息为:offer from user ZHOUQIAN001 to polycom1995217,此处选择的第二视频会议端编号为1995217;所述媒体流描述为Take the Polycom video conference system as an example for further explanation. Illustratively, the connected user information is: offer from user ZHOUQIAN001 to polycom1995217, the number of the second video conference terminal selected here is 1995217; the media stream description is
m=audio 9 UDP/TLS/RTP/SAVPF 111 103 104 102 0 8 106 105 13 110 112 113 126m=audio 9 UDP/TLS/RTP/SAVPF 111 103 104 102 0 8 106 105 13 110 112 113 126
a=rtpmap:111 opus/48000/2a=rtpmap:111 opus/48000/2
a=rtpmap:103 ISAC/16000a=rtpmap:103 ISAC/16000
a=rtpmap:104 ISAC/32000a=rtpmap:104 ISAC/32000
a=rtpmap:0 PCMU/8000a=rtpmap:0 PCMU/8000
a=rtpmap:8 PCMA/8000a=rtpmap:8 PCMA/8000
m=video 9 UDP/TLS/RTP/SAVPF 96 98 100 102 127 97 99 101 125m=video 9 UDP/TLS/RTP/SAVPF 96 98 100 102 127 97 99 101 125
a=rtpmap:96 VP8/90000a=rtpmap:96 VP8/90000
a=rtpmap:98 VP9/90000a=rtpmap:98 VP9/90000
a=rtpmap:100 H264/90000a=rtpmap:100 H264/90000
a=fmtp:100a=fmtp:100
level-asymmetry-allowed=1;packetization-mode=1;profile-level-id=42e01f,所述网关通过所述媒体流描述提取得到所述网页端支持音频编码格式为g.711/isac/opus,视频编码格式为vp8/vp9/h.264baseline,可以看到所述第二视频设备端支持的音频编码格式只有G.711编码,视频编码格式只有H.264编码。level-asymmetry-allowed=1;packetization-mode=1;profile-level-id=42e01f, the gateway extracts from the media stream description to obtain the audio encoding format supported by the web page as g.711/isac/opus, The video encoding format is vp8/vp9/h.264baseline. It can be seen that the audio encoding format supported by the second video device end is only G.711 encoding, and the video encoding format is only H.264 encoding.
所述网关根据G.711和H.264编码向所述第二视频会议设备发起H.323呼叫,与网页端基于Websocket协议的文本的媒体流描述消息不同,所述H.323协议采用基于二进制的ASN.1编码规范来打包信令消息,所述H.323协议是一种协议簇,包括H.225和H.245协议,所述H.225协议用于建立呼叫信令通道,所述H.245协议用于协商媒体信道参数,为多媒体信息的传送做好准备,所述网关首先发送所述H.323协议簇中的H.225文本格式的setup消息,转换为ASN.1二进制格式的setup消息后,发送至所述第二视频会议设备,所述setup消息是主叫建立呼叫是使用的初始化消息,所述setup消息包括所述网关号码、所述第二视频会议端号码、所述视频会议端IP地址、端口号、终端身份、呼叫识别符、发送完全字段和H.245Tunnelling字段,所述第二视频会议设备接收H.225协议所述setup消息后,向所述网关返回H.225 CS: alerting和CS:connectASN.1二进制格式消息,翻译为文本的H.225CS:alerting和CS:connect文本格式消息,发送至所述网关,所述alerting消息和connect消息为所述第二视频会议设备发送,表示所述第二视频会议设备已经准备就绪,所述alerting消息包括建立H.245连接所述第二视频会议设备的IP地址、端口号、H.245Tunnelling字段和所述第二视频会议设备身份字段,所述connect消息表示所述第二视频会议设备已经接受了所述网关发出的呼叫,所述connect消息包括建立H.245连接所述第二视频会议设备的IP地址、端口号、H.245Tunnelling字段、呼叫识别符和所述第二视频会议设备身份字段。The gateway initiates an H.323 call to the second video conferencing device according to the G.711 and H.264 encoding. Unlike the web-side media stream description message based on the text of the Websocket protocol, the H.323 protocol uses binary-based The ASN.1 coding specification is used to package signaling messages. The H.323 protocol is a protocol suite, including H.225 and H.245 protocols. The H.225 protocol is used to establish call signaling channels. The H.245 protocol is used to negotiate media channel parameters to prepare for the transmission of multimedia information. The gateway first sends the H.225 text format setup message in the H.323 protocol suite and converts it to the ASN.1 binary format. The setup message is sent to the second video conference device, the setup message is an initialization message used by the caller to establish a call, and the setup message includes the gateway number, the second video conference end number, and the The video conference terminal IP address, port number, terminal identity, call identifier, send complete field and H.245 Tunnelling field, the second video conference device receives the H.225 protocol setup message, and returns H to the gateway .225 CS: alerting and CS: connectASN.1 binary format messages, translated into text H.225 CS: alerting and CS: connect text format messages, sent to the gateway, the alerting message and the connect message are the second The video conference device sends it to indicate that the second video conference device is ready, and the alerting message includes the IP address, port number, H.245 Tunnelling field, and the second video conference device for establishing an H.245 connection to the second video conference device. The video conference device identity field, the connect message indicates that the second video conference device has accepted the call from the gateway, and the connect message includes the IP address and port for establishing the H.245 connection to the second video conference device Number, H.245 Tunnelling field, call identifier, and the second video conference device identity field.
所述网关与所述第二视频会议设备通过H.245协议进行能力协商,所述H.245能力协商包括能力交换、主从决定、建立逻辑通道等过程,所述能力交换过程是指所述网关接收到所述connect消息后首先要执行的过程,所述能力交换过程是通信双方了解对方的接收和发送能力。所述接收能力限定了对端的发送模式,所述发送能力给定了对端请求接收信号的希望模式的协商范围。The gateway and the second video conferencing device conduct capability negotiation through the H.245 protocol. The H.245 capability negotiation includes processes such as capability exchange, master-slave determination, and logical channel establishment. The capability exchange process refers to the After the gateway receives the connect message, it is the first process to be executed. The capability exchange process is that the two parties in communication understand each other's receiving and sending capabilities. The receiving capability defines the sending mode of the opposite end, and the sending capability specifies the negotiation range of the desired mode of the opposite end requesting to receive signals.
所述逻辑通道由所述第二视频会议设备启动,所述第二视频会议设备向所述网关发送打开逻辑信道消息,所述打开逻辑信道消息包括第二视频会议设备至网关的逻辑信道号和第一信道参数,所述第一信道参数包括网关到第二视频会议设备的传输层地址;所述网关收到所述打开逻辑信道消息后,回送打开逻辑信道证实消息,所述打开逻辑信道证实消息包括网关至第二视频会议设备的逻辑信道号和第二信道参数,所述第二信道参数包括第二视频会议设备到网关的传输层地址。The logical channel is activated by the second video conference device, and the second video conference device sends an open logical channel message to the gateway, and the open logical channel message includes the logical channel number from the second video conference device to the gateway and The first channel parameter, where the first channel parameter includes the transport layer address from the gateway to the second video conference device; after the gateway receives the open logical channel message, it sends back an open logical channel confirmation message, the open logical channel confirmation The message includes the logical channel number from the gateway to the second video conference device and the second channel parameter, and the second channel parameter includes the transport layer address from the second video conference device to the gateway.
具体的,网关根据获取的所述音视频编码格式发送所述网页端的媒体流描述至所述第二视频会议端。Specifically, the gateway sends the media stream description of the web page terminal to the second video conference terminal according to the acquired audio and video coding format.
示例性的,所述网关将所述网页端的媒体流描述转换为H.245媒体能力协商消息转发给所述第二视频会议端,所述网关提取双方都支持的所述音频编码G.711和视频编码H.264,舍弃所述第二视频会议端不支持的Opus/iSAC/VP8等编码,翻译为ASN.1二进制格式的媒体流描述后发送至所述第二视频会议端。Exemplarily, the gateway converts the media stream description of the web page into an H.245 media capability negotiation message and forwards it to the second video conference end, and the gateway extracts the audio encoding G.711 and G.711 and that are supported by both parties. Video encoding H.264, discarding Opus/iSAC/VP8 and other encodings that are not supported by the second video conference terminal, translate it into an ASN.1 binary format media stream description and send it to the second video conference terminal.
所述第二视频会议端返回所述网关支持的音视频消息,所述网关提取符合所述网页端音视频编码格式的相应媒体流描述发送至所述第二视频会议端,建立所述网关端和所述第二视频会议端的连接。The second video conference terminal returns an audio and video message supported by the gateway, and the gateway extracts a corresponding media stream description that conforms to the audio and video encoding format of the web page terminal and sends it to the second video conference terminal to establish the gateway terminal Connection with the second video conference terminal.
示例性的,所述第二视频会议端返回给所述网关解析二进制消息,提取所述网页端支持的G.711和H.264编码能力,舍弃不支持的G.722/G.723/G.729等编码,生成打开逻辑信道消息返回所述网关,所述网关收到后所述打开逻辑信道消息后,向所述第二视频会议端发送打开逻辑信道证实消息,至此双方媒体能力协商完成,所述网关与所述第二视频会议设备成功建立所述第二连接。Exemplarily, the second video conference terminal returns to the gateway to parse a binary message, extracts the G.711 and H.264 encoding capabilities supported by the web page, and discards the unsupported G.722/G.723/G .729 and other codes, generate an open logical channel message and return it to the gateway. After receiving the open logical channel message, the gateway sends an open logical channel confirmation message to the second video conference end, and the media capability negotiation between the two parties is completed. , The gateway successfully establishes the second connection with the second video conference device.
步骤S104,通过所述第一连接和所述第二连接获取所述第一视频会议设备第一视频会议数据和/或所述第二视频会议设备的第二视频会议数据。Step S104: Obtain the first video conference data of the first video conference device and/or the second video conference data of the second video conference device through the first connection and the second connection.
进一步地,传输所述第一视频会议设备获取的第一格式视频会议数据至所述网络设备,或通过所述第二连接传输所述第二视频会议设备获取的第二格式视频会议数据至所述网络设备。Further, the video conference data in the first format obtained by the first video conference device is transmitted to the network device, or the video conference data in the second format obtained by the second video conference device is transmitted to the network device through the second connection. Mentioned network equipment.
进一步地,将所述第一格式视频会议数据或第二格式视频会议数据加密后发送至所述网络设备。Further, the video conference data in the first format or the video conference data in the second format is encrypted and sent to the network device.
步骤S106,将所述第一视频会议数据转换成所述第二视频会议设备对应的解析格式,和/或将第二视频会议数据转换成所述第一视频会议设备对应的解析格式。Step S106: Convert the first video conference data into an analytical format corresponding to the second video conference device, and/or convert the second video conference data into an analytical format corresponding to the first video conference device.
具体的,将所述第一格式视频会议数据转换成第二格式视频会议数据并发送给第二视频会议设备,或将所述第二格式视频会议数据转换成第一格式视频会议数据并发送给第一视频会议设备。Specifically, the video conference data in the first format is converted into video conference data in the second format and sent to a second video conference device, or the video conference data in the second format is converted into video conference data in the first format and sent to The first video conference equipment.
进一步地,解密所述第一格式视频会议数据后,转换成第二格式视频会议数据发送至所述第二格式视频会议设备,或解密所述第二格式视频会议数据,转换成第一格式视频会议数据发送至所述第一格式视频会议设备。Further, after decrypting the video conference data in the first format, it is converted into video conference data in the second format and sent to the video conference device in the second format, or the video conference data in the second format is decrypted and converted into video in the first format. The conference data is sent to the video conference device in the first format.
具体的,所述第二视频会议设备对应的媒体流格式为RTP格式的媒体流,所述第二视频会议设备向所述网关发送RTP格式的媒体流,所述RTP包括一个用于标识媒体格式、媒体流ID、包序列号和时间戳等信息的包头,以及媒体流编码压缩后的媒体负载,所述网页端对应的媒体流为SRTP格式媒体流,所述网页端向网关发送SRTP格式媒体流。Specifically, the media stream format corresponding to the second video conference device is a media stream in RTP format, and the second video conference device sends the media stream in RTP format to the gateway, and the RTP includes a media format for identifying the media format. , The header of the media stream ID, packet sequence number, timestamp and other information, as well as the media load after encoding and compression of the media stream. The media stream corresponding to the web page side is an SRTP format media stream, and the web page side sends SRTP format media to the gateway. flow.
所述SRTP包与所述RTP包头格式相同,区别是媒体负载部分经过不同方式的加密处理,所述网关作为媒体流代理,所述网关将来自所述第二视频会议设备的RTP格式的媒体流解包,去除所述RTP包头,剩下包负载按照网页端协商的会话解密,再重新加上RTP包头,打包成SRTP格式转发给网页端;将来自网页端的SRTP格式的媒体流解包,去除SRTP包头,剩下包负载按照第二视频会议设备协商的会话解密,重新添加RTP包头,打包成RTP格式转发给所述第二视频会议设备。The format of the SRTP packet is the same as that of the RTP header. The difference is that the media load part is encrypted in different ways. The gateway acts as a media stream proxy, and the gateway transfers the media stream in the RTP format from the second video conference device. Unpack, remove the RTP packet header, and decrypt the remaining packet load according to the session negotiated on the web page, then add the RTP packet header again, package it into SRTP format and forward it to the web page; unpack the media stream in SRTP format from the web page, and remove The SRTP packet header, the remaining packet load is decrypted according to the session negotiated by the second video conference device, the RTP packet header is added again, and it is packaged into an RTP format and forwarded to the second video conference device.
步骤S108,控制所述第二视频会议设备和/或第一视频会议设备解析对应的视频会议数据和/或第二视频会议数据,以展示所述第一视频会议数据和/或第二视频会议数据对应的视频会议内容。Step S108: Control the second video conference device and/or the first video conference device to parse the corresponding video conference data and/or the second video conference data to display the first video conference data and/or the second video conference The video conference content corresponding to the data.
在示例性的实施例中,请参阅图4,步骤S108还可以进一步包括:In an exemplary embodiment, referring to FIG. 4, step S108 may further include:
S108A,将解密后的第一格式视频会议数据或所述第二格式视频会议数据分离成音频流压缩编码数据和视频流压缩编码数据;S108A: Separate the decrypted video conference data in the first format or the video conference data in the second format into audio stream compression coded data and video stream compression coded data;
具体的,所述视频会议数据包括音频数据和视频数据,所述第二格式视频会议数据还包括PPT文档演示、媒体资料演示、白板共享和固话、手机接入等数据。Specifically, the video conference data includes audio data and video data, and the second format video conference data also includes data such as PPT document presentation, media material presentation, whiteboard sharing, and fixed-line, mobile phone access.
S108B,将所述音频流压缩编码数据和所述视频流压缩编码数据解码为非压缩的音频原始数据和非压缩视频原始数据;S108B. Decode the audio stream compressed coded data and the video stream compressed coded data into uncompressed audio raw data and uncompressed video raw data;
S108C,同步所述非压缩的音频原始数据和所述非压缩视频原始数据,并将所述非压缩的音频原始数据和所述非压缩视频原始数据发送给第一视频会议设备或第二视频会议设备。S108C. Synchronize the uncompressed audio raw data and the uncompressed video raw data, and send the uncompressed audio raw data and the uncompressed video raw data to the first video conference device or the second video conference equipment.
具体的,根据分离成音频流压缩编码数据和视频流压缩编码数据过程中获取到的参数信息,同步所述非压缩的音频原始数据和所述非压缩视频原始数据,并将所述非压缩的音频原始数据和所述非压缩视频原始数据送至系统的显卡和声卡播放出来。Specifically, according to the parameter information obtained in the process of separating the compressed and encoded data of the audio stream and the compressed and encoded data of the video stream, the uncompressed audio original data and the uncompressed video original data are synchronized, and the uncompressed The audio raw data and the uncompressed video raw data are sent to the graphics card and sound card of the system for playback.
本申请实施例通过开发一种视频会议方法,实现了网页页面会话与传统视频会议系统的会话,可以实现企业内外用户通过手机和PC浏览器网页页面与视频会议系统之间的音视频通讯,召开视频会议更加方便,通过接入企业已有的视频会议系统,丰富了移动会议上一些没有实现的功能,例如远程桌面共享、白板共享、PPT文档/媒体资料演示、固定电话/手机接入等等,取长补短同时避免了企业资源浪费。The embodiment of the application develops a video conference method to realize the conversation between the web page session and the traditional video conference system, and can realize the audio and video communication between the web page page and the video conference system through the mobile phone and PC browser of the users inside and outside the enterprise. Video conferencing is more convenient. By accessing the company's existing video conferencing system, some unrealized functions in mobile meetings are enriched, such as remote desktop sharing, whiteboard sharing, PPT document/media presentation, fixed phone/mobile access, etc. , Learn from each other while avoiding waste of enterprise resources.
实施例二Example two
请继续参阅图2,示出了本申请视频会议装置的程序模块示意图。在本实施例中,视频会议装置20可以包括或被分割成一个或多个程序模块,一个或者多个程序模块被存储于存储介质中,并由一个或多个处理器所执行,以完成本申请,并可实现上述视频会议方法。本申请实施例所称的程序模块是指能够完成特定功能的一系列计算机程序指令段,比程序本身更适合于描述视频会议装置20在存储介质中的执行过程。以下描述将具体介绍本实施例各程序模块的功能:Please continue to refer to FIG. 2, which shows a schematic diagram of program modules of the video conference device of the present application. In this embodiment, the video conference device 20 may include or be divided into one or more program modules, and the one or more program modules are stored in a storage medium and executed by one or more processors to complete the present invention. Apply, and realize the above-mentioned video conference method. The program module referred to in the embodiments of the present application refers to a series of computer program instruction segments capable of completing specific functions, and is more suitable for describing the execution process of the video conference device 20 in the storage medium than the program itself. The following description will specifically introduce the functions of each program module in this embodiment:
第一连接建立模块200,用于建立第一视频会议设备和网络设备的第一连接,生成第一连接信息,所述第一连接信息包括所述第一视频会议设备的连接用户信息和所述第一视频会议设备中本地媒体的媒体流描述;The first connection establishment module 200 is configured to establish a first connection between a first video conference device and a network device, and generate first connection information. The first connection information includes the connected user information of the first video conference device and the The media stream description of the local media in the first video conference device;
进一步地,所述第一连接建立模块200还用于控制第一视频会议设备向网络设备发送验证信息;Further, the first connection establishment module 200 is also used to control the first video conference device to send verification information to the network device;
当所述验证信息满足预设条件时建立第一视频会议设备和网络设备的第一连接。When the verification information meets the preset condition, a first connection between the first video conference device and the network device is established.
第二连接建立模块202,用于根据所述第一连接信息建立所述网络设备和第二视频会议设备的第二连接;The second connection establishment module 202 is configured to establish a second connection between the network device and the second video conference device according to the first connection information;
视频会议数据传输模块204,用于通过所述第一连接和所述第二连接获取所述第一视频会议设备第一视频数据和/或所述第二视频会议设备的第二视频会议数据;The video conference data transmission module 204 is configured to obtain the first video data of the first video conference device and/or the second video conference data of the second video conference device through the first connection and the second connection;
具体的,所述视频会议数据传输模块204用于传输所述第一视频会议设备获取的第一格式视频会议数据至所述网络设备,或通过所述第二连接传输所述第二视频会议设备获取的第二格式视频会议数据至所述网络设备;Specifically, the video conference data transmission module 204 is configured to transmit the video conference data in the first format obtained by the first video conference device to the network device, or transmit the second video conference device through the second connection The acquired video conference data in the second format to the network device;
进一步地,所述视频会议数据传输模块204还用于将所述第一格式视频会议数据加密后发送至所述网络设备,将所述第二格式视频会议数据加密后发送至所述网络设备。Further, the video conference data transmission module 204 is further configured to encrypt the video conference data in the first format and send it to the network device, and encrypt the video conference data in the second format and send it to the network device.
视频会议数据转换模块206,用于将所述第一视频会议数据转换成所述第二视频会议设备对应的解析格式和/或将第二视频会议数据转换成所述第一视频会议设备对应的解析格式;The video conference data conversion module 206 is configured to convert the first video conference data into an analytic format corresponding to the second video conference device and/or convert the second video conference data into an analysis format corresponding to the first video conference device Parsing format
具体的,所述视频会议数据转换模块206用于将所述第一格式视频会议数据转换成第二格式视频会议数据并发送给第二视频会议设备,或将所述第二格式视频会议数据转换成第一格式视频会议数据并发送给第一视频会议设备。Specifically, the video conference data conversion module 206 is configured to convert the first format video conference data into a second format video conference data and send it to a second video conference device, or convert the second format video conference data The video conference data in the first format is sent to the first video conference device.
进一步地,所述视频会议数据转换模块206还用于,解密所述第一格式视频会议数据发送至所述第二格式视频会议设备,解密所述第二格式视频会议数据发送至所述第一格式视频会议设备。Further, the video conference data conversion module 206 is further configured to decrypt the video conference data in the first format and send it to the second format video conference device, and decrypt the video conference data in the second format and send it to the first format. Format video conferencing equipment.
控制视频会议数据展示模块208,用于控制所述第二视频会议设备和/或第一视频会议设备解析第一视频会议数据和/或第二视频会议数据,以展示所述第一视频会议数据和/或第二视频会议数据对应的视频会议内容。The control video conference data display module 208 is used to control the second video conference device and/or the first video conference device to parse the first video conference data and/or the second video conference data to display the first video conference data And/or the video conference content corresponding to the second video conference data.
进一步地,所述控制视频会议数据展示模块208还用于将解密后的第一格式视频会议数据或所述第二格式视频会议数据分离成音频流压缩编码数据和视频流压缩编码数据;Further, the control video conference data display module 208 is further configured to separate the decrypted video conference data in the first format or the video conference data in the second format into audio stream compression coded data and video stream compression coded data;
将所述音频流压缩编码数据和所述视频流压缩编码数据解码为非压缩的音频原始数据和非压缩视频原始数据;Decoding the audio stream compressed and encoded data and the video stream compressed and encoded data into uncompressed audio raw data and uncompressed video raw data;
同步所述非压缩的音频原始数据和所述非压缩视频原始数据,并将所述非压缩的音频原始数据和所述非压缩视频原始数据发送给第一视频会议设备或第二视频会议设备。The uncompressed audio raw data and the uncompressed video raw data are synchronized, and the uncompressed audio raw data and the uncompressed video raw data are sent to the first video conference device or the second video conference device.
实施例三Example three
参阅图3,是本申请实施例三计算机设备的硬件架构示意图。本实施例中,所述计算机设备2是一种能够按照事先设定或者存储的指令,自动进行数值计算和/或信息处理的设备。该计算机设备2可以是机架式服务器、刀片式服务器、塔式服务器或机柜式服务器(包括独立的服务器,或者多个服务器所组成的服务器集群)等。如图3所示,所述计算机设备2至少包括,但不限于,可通过系统总线相互通信连接存储器21、处理器22、网络接口23、以及视频会议装置20。其中:Refer to FIG. 3, which is a schematic diagram of the hardware architecture of the computer device in the third embodiment of the present application. In this embodiment, the computer device 2 is a device that can automatically perform numerical calculation and/or information processing in accordance with pre-set or stored instructions. The computer device 2 may be a rack server, a blade server, a tower server, or a cabinet server (including an independent server or a server cluster composed of multiple servers). As shown in FIG. 3, the computer equipment 2 at least includes, but is not limited to, a memory 21, a processor 22, a network interface 23, and a video conference device 20 that can communicate with each other through a system bus. among them:
本实施例中,存储器21至少包括一种类型的计算机可读存储介质,所述可读存储介质包括闪存、硬盘、多媒体卡、卡型存储器(例如,SD或DX存储器等)、随机访问存储器(RAM)、静态随机访问存储器(SRAM)、只读存储器(ROM)、电可擦除可编程只读存储器(EEPROM)、可编程只读存储器(PROM)、磁性存储器、磁盘、光盘等。在一些实施例中,存储器21可以是计算机设备2的内部存储单元,例如该计算机设备2的硬盘或内存。在另一些实施例中,存储器21也可以是计算机设备2的外部存储设备,例如该计算机设备2上配备的插接式硬盘,智能存储卡(Smart Media Card, SMC),安全数字(Secure Digital, SD)卡,闪存卡(FlashCard)等。当然,存储器21还可以既包括计算机设备2的内部存储单元也包括其外部存储设备。本实施例中,存储器21通常用于存储安装于计算机设备2的操作系统和各类应用软件,例如实施例二的视频会议装置20的程序代码等。此外,存储器21还可以用于暂时地存储已经输出或者将要输出的各类数据。In this embodiment, the memory 21 includes at least one type of computer-readable storage medium. The readable storage medium includes flash memory, hard disk, multimedia card, card-type memory (for example, SD or DX memory, etc.), random access memory ( RAM), static random access memory (SRAM), read-only memory (ROM), electrically erasable programmable read-only memory (EEPROM), programmable read-only memory (PROM), magnetic memory, magnetic disks, optical disks, etc. In some embodiments, the memory 21 may be an internal storage unit of the computer device 2, for example, a hard disk or a memory of the computer device 2. In other embodiments, the memory 21 may also be an external storage device of the computer device 2, for example, a plug-in hard disk, a smart memory card (Smart Media Card, SMC), and a secure digital (Secure Digital, SD) card, flash card (FlashCard), etc. Of course, the memory 21 may also include both the internal storage unit of the computer device 2 and its external storage device. In this embodiment, the memory 21 is generally used to store an operating system and various application software installed in the computer device 2, for example, the program code of the video conference device 20 in the second embodiment. In addition, the memory 21 can also be used to temporarily store various types of data that have been output or will be output.
处理器22在一些实施例中可以是中央处理器(Central Processing Unit,CPU)、控制器、微控制器、微处理器、或其他数据处理芯片。该处理器22通常用于控制计算机设备2的总体操作。本实施例中,处理器22用于运行存储器21中存储的程序代码或者处理数据,例如运行视频会议装置20,以实现实施例一的视频会议方法。In some embodiments, the processor 22 may be a central processing unit (Central Processing Unit, CPU), a controller, a microcontroller, a microprocessor, or other data processing chips. The processor 22 is generally used to control the overall operation of the computer device 2. In this embodiment, the processor 22 is used to run the program code or process data stored in the memory 21, for example, to run the video conference device 20, so as to implement the video conference method of the first embodiment.
所述网络接口23可包括无线网络接口或有线网络接口,该网络接口23通常用于在所述计算机设备2与其他电子装置之间建立通信连接。例如,所述网络接口23用于通过网络将所述计算机设备2与外部终端相连,在所述计算机设备2与外部终端之间的建立数据传输通道和通信连接等。所述网络可以是企业内部网(Intranet)、互联网(Internet)、全球移动通讯系统(Global System of Mobile communication,GSM)、宽带码分多址(Wideband Code Division Multiple Access,WCDMA)、4G网络、5G网络、蓝牙(Bluetooth)、Wi-Fi等无线或有线网络。The network interface 23 may include a wireless network interface or a wired network interface, and the network interface 23 is generally used to establish a communication connection between the computer device 2 and other electronic devices. For example, the network interface 23 is used to connect the computer device 2 with an external terminal through a network, and establish a data transmission channel and a communication connection between the computer device 2 and the external terminal. The network may be an intranet (Intranet), the Internet (Internet), a global system of mobile communication (GSM), a wideband code division multiple access (WCDMA), 4G network, 5G Network, Bluetooth (Bluetooth), Wi-Fi and other wireless or wired networks.
需要指出的是,图3仅示出了具有部件20-23的计算机设备2,但是应理解的是,并不要求实施所有示出的部件,可以替代的实施更多或者更少的部件。It should be pointed out that FIG. 3 only shows the computer device 2 with components 20-23, but it should be understood that it is not required to implement all the components shown, and more or fewer components may be implemented instead.
在本实施例中,存储于存储器21中的所述视频会议装置20还可以被分割为一个或者多个程序模块,所述一个或者多个程序模块被存储于存储器21中,并由一个或多个处理器(本实施例为处理器22)所执行,以完成本申请。In this embodiment, the video conference device 20 stored in the memory 21 may also be divided into one or more program modules, and the one or more program modules are stored in the memory 21 and are composed of one or more program modules. Is executed by two processors (in this embodiment, the processor 22) to complete the application.
例如,图2示出了所述实现视频会议装置20实施例二的程序模块示意图,该实施例中,所述基于视频会议装置20可以被划分为第一连接建立模块200、第二连接建立模块202、视频会议数据传输模块204、视频会议数据转换模块206和控制视频会议数据展示模块208。其中,本申请所称的程序模块是指能够完成特定功能的一系列计算机程序指令段,比程序更适合于描述所述视频会议装置20在所述计算机设备2中的执行过程。所述程序模块200-208的具体功能在实施例二中已有详细描述,在此不再赘述。For example, FIG. 2 shows a schematic diagram of program modules for implementing the second embodiment of the video conferencing device 20. In this embodiment, the video conferencing device 20 can be divided into a first connection establishment module 200 and a second connection establishment module. 202, a video conference data transmission module 204, a video conference data conversion module 206, and a control video conference data display module 208. Among them, the program module referred to in the present application refers to a series of computer program instruction segments that can complete specific functions, and is more suitable than a program to describe the execution process of the video conference device 20 in the computer device 2. The specific functions of the program modules 200-208 have been described in detail in the second embodiment, and will not be repeated here.
实施例四Example four
本实施例还提供一种计算机可读存储介质,如闪存、硬盘、多媒体卡、卡型存储器(例如,SD或DX存储器等)、随机访问存储器(RAM)、静态随机访问存储器(SRAM)、只读存储器(ROM)、电可擦除可编程只读存储器(EEPROM)、可编程只读存储器(PROM)、磁性存储器、磁盘、光盘、服务器、App应用商城等等,其上存储有计算机程序,程序被处理器执行时实现相应功能。本实施例的计算机可读存储介质用于存储视频会议装置20,被处理器执行时实现实施例一的视频会议方法,所述计算机可读存储介质可以是非易失性,也可以是易失性。This embodiment also provides a computer-readable storage medium, such as flash memory, hard disk, multimedia card, card-type memory (for example, SD or DX memory, etc.), random access memory (RAM), static random access memory (SRAM), only Readable memory (ROM), electrically erasable programmable read-only memory (EEPROM), programmable read-only memory (PROM), magnetic memory, magnetic disks, optical disks, servers, App application malls, etc., on which computer programs are stored, The corresponding function is realized when the program is executed by the processor. The computer-readable storage medium of this embodiment is used to store the video conferencing device 20, and when executed by a processor, the video conferencing method of the first embodiment is implemented. The computer-readable storage medium may be non-volatile or volatile. .
上述本申请实施例序号仅仅为了描述,不代表实施例的优劣。The serial numbers of the foregoing embodiments of the present application are only for description, and do not represent the superiority or inferiority of the embodiments.
通过以上的实施方式的描述,本领域的技术人员可以清楚地了解到上述实施例方法可借助软件加必需的通用硬件平台的方式来实现,当然也可以通过硬件,但很多情况下前者是更佳的实施方式。Through the description of the above embodiments, those skilled in the art can clearly understand that the method of the above embodiments can be implemented by means of software plus the necessary general hardware platform. Of course, it can also be implemented by hardware, but in many cases the former is better.的实施方式。
以上仅为本申请的优选实施例,并非因此限制本申请的专利范围,凡是利用本申请说明书及附图内容所作的等效结构或等效流程变换,或直接或间接运用在其他相关的技术领域,均同理包括在本申请的专利保护范围内。The above are only the preferred embodiments of the application, and do not limit the scope of the patent for this application. Any equivalent structure or equivalent process transformation made using the content of the description and drawings of the application, or directly or indirectly applied to other related technical fields , The same reason is included in the scope of patent protection of this application.

Claims (20)

  1. 一种视频会议方法,应用于网络设备中,其中,包括:A video conference method applied to network equipment, including:
    建立第一视频会议设备和网络设备的第一连接,生成第一连接信息,所述第一连接信息包括所述第一视频会议设备的连接用户信息和所述第一视频会议设备中本地媒体的媒体流描述;A first connection between the first video conference device and the network device is established, and first connection information is generated. The first connection information includes the connected user information of the first video conference device and the information of the local media in the first video conference device. Media stream description;
    根据所述第一连接信息建立所述网络设备和第二视频会议设备的第二连接;Establishing a second connection between the network device and the second video conference device according to the first connection information;
    通过所述第一连接和所述第二连接获取所述第一视频会议设备第一视频会议数据和/或所述第二视频会议设备的第二视频会议数据;Acquiring first video conference data of the first video conference device and/or second video conference data of the second video conference device through the first connection and the second connection;
    将所述第一视频会议数据转换成所述第二视频会议设备对应的解析格式,和/或将第二视频会议数据转换成所述第一视频会议设备对应的解析格式;Converting the first video conference data into an analytic format corresponding to the second video conference device, and/or converting the second video conference data into an analytic format corresponding to the first video conference device;
    控制所述第二视频会议设备和/或第一视频会议设备解析第一视频会议数据和/或第二视频会议数据,以展示所述第一视频会议数据和/或第二视频会议数据对应的视频会议内容。Control the second video conference device and/or the first video conference device to parse the first video conference data and/or the second video conference data to display the data corresponding to the first video conference data and/or the second video conference data Video conference content.
  2. 根据权利要求1所述的视频会议方法,其中,所述通过所述第一连接和所述第二连接获取所述第一视频会议设备第一视频会议数据和/或所述第二视频会议设备的第二视频会议数据包括:The video conference method according to claim 1, wherein the first video conference data of the first video conference device and/or the second video conference device are acquired through the first connection and the second connection The second video conference data includes:
    传输所述第一视频会议设备获取的第一格式视频会议数据至所述网络设备,或通过所述第二连接传输所述第二视频会议设备获取的第二格式视频会议数据至所述网络设备;Transmit the video conference data in the first format obtained by the first video conference device to the network device, or transmit the video conference data in the second format obtained by the second video conference device to the network device through the second connection ;
    所述将所述第一视频会议数据转换成所述第二视频会议设备对应的解析格式,和/或将第二视频会议数据转换成所述第一视频会议设备对应的解析格式包括:The converting the first video conference data into an analytical format corresponding to the second video conference device, and/or converting the second video conference data into an analytical format corresponding to the first video conference device includes:
    将所述第一格式视频会议数据转换成第二格式视频会议数据并发送给第二视频会议设备,或将所述第二格式视频会议数据转换成第一格式视频会议数据并发送给第一视频会议设备。Convert the video conference data in the first format into video conference data in the second format and send it to a second video conference device, or convert the video conference data in the second format into video conference data in the first format and send it to the first video Conference equipment.
  3. 根据权利要求2所述的视频会议方法,其中,所述传输所述第一视频会议设备获取的第一格式视频会议数据至所述网络设备包括:The video conference method according to claim 2, wherein the transmitting the first format video conference data obtained by the first video conference device to the network device comprises:
    将所述第一格式视频会议数据加密后发送至所述网络设备;Encrypt the video conference data in the first format and send it to the network device;
    所述将所述第一格式视频会议数据转换成第二格式视频会议数据并发送给第二视频会议设备包括:The converting the video conference data in the first format into the video conference data in the second format and sending to the second video conference device includes:
    解密所述第一格式视频会议数据发送至所述第二格式视频会议设备。Decrypt the video conference data in the first format and send it to the video conference device in the second format.
  4. 根据权利要求2所述的视频会议方法,其中,所述通过所述第二连接传输所述第二视频会议设备获取的第二格式视频会议数据至所述网络设备包括:The video conference method according to claim 2, wherein the transmitting the second format video conference data obtained by the second video conference device to the network device through the second connection comprises:
    将所述第二格式视频会议数据加密后发送至所述网络设备;Encrypting the second format video conference data and sending it to the network device;
    所述第二格式视频会议数据转换成第一格式视频会议数据并发送给第一视频会议设备包括:The conversion of the second format video conference data into the first format video conference data and sending to the first video conference device includes:
    解密所述第二格式视频会议数据发送至所述第一格式视频会议设备。Decrypt the second format video conference data and send it to the first format video conference device.
  5. 根据权利要求1所述的视频会议方法,其中,所述控制所述第二视频会议设备和/或第一视频会议设备解析第一视频会议数据和/或第二视频会议数据,以展示所述第一视频会议数据和/或第二视频会议数据对应的视频会议内容包括:The video conference method according to claim 1, wherein said controlling said second video conference device and/or first video conference device to parse first video conference data and/or second video conference data to display said The video conference content corresponding to the first video conference data and/or the second video conference data includes:
    将解密后的第一格式视频会议数据或所述第二格式视频会议数据分离成音频流压缩编码数据和视频流压缩编码数据;Separating the decrypted video conference data in the first format or the video conference data in the second format into audio stream compression coded data and video stream compression coded data;
    将所述音频流压缩编码数据和所述视频流压缩编码数据解码为非压缩的音频原始数据和非压缩视频原始数据;Decoding the audio stream compressed and encoded data and the video stream compressed and encoded data into uncompressed audio raw data and uncompressed video raw data;
    同步所述非压缩的音频原始数据和所述非压缩视频原始数据,并将所述非压缩的音频原始数据和所述非压缩视频原始数据发送给第一视频会议设备或第二视频会议设备。The uncompressed audio raw data and the uncompressed video raw data are synchronized, and the uncompressed audio raw data and the uncompressed video raw data are sent to the first video conference device or the second video conference device.
  6. 根据权利要求1所述的视频会议方法,其中,所述建立第一视频会议设备和网络设备的第一连接包括:The video conference method according to claim 1, wherein said establishing a first connection between the first video conference device and the network device comprises:
    控制第一视频会议设备向网络设备发送验证信息;Controlling the first video conference device to send verification information to the network device;
    当所述验证信息满足预设条件时建立第一视频会议设备和网络设备的第一连接。When the verification information meets the preset condition, a first connection between the first video conference device and the network device is established.
  7. 根据权利要求1所述的视频会议方法,其中,所述第一视频会议设备为非专用的视频会议设备,包括但不限于电脑、手机、平板等支持视频会议的终端,所述第二视频会议设备为专用的视频会议设备。The video conference method according to claim 1, wherein the first video conference device is a non-dedicated video conference device, including but not limited to terminals supporting video conferences such as computers, mobile phones, and tablets, and the second video conference The equipment is dedicated video conferencing equipment.
  8. 一种视频会议装置,其中,包括:A video conference device, which includes:
    第一连接建立模块,用于建立第一视频会议设备和网络设备的第一连接,生成第一连接信息,所述第一连接信息包括所述第一视频会议设备的连接用户信息和所述第一视频会议设备中本地媒体的媒体流描述;The first connection establishment module is configured to establish a first connection between a first video conference device and a network device, and generate first connection information, where the first connection information includes the connected user information of the first video conference device and the first connection 1. The media stream description of the local media in the video conference device;
    第二连接建立模块,用于根据所述第一连接信息建立所述网络设备和第二视频会议设备的第二连接;A second connection establishment module, configured to establish a second connection between the network device and the second video conference device according to the first connection information;
    视频会议数据传输模块,用于通过所述第一连接和所述第二连接获取所述第一视频会议设备第一视频会议数据和/或所述第二视频会议设备的第二视频会议数据;A video conference data transmission module, configured to obtain the first video conference data of the first video conference device and/or the second video conference data of the second video conference device through the first connection and the second connection;
    视频会议数据转换模块,用于将所述第一视频会议数据转换成所述第二视频会议设备对应的解析格式,和/或将第二视频会议数据转换成所述第一视频会议设备对应的解析格式;The video conference data conversion module is configured to convert the first video conference data into an analytic format corresponding to the second video conference device, and/or convert the second video conference data into an analysis format corresponding to the first video conference device Parsing format
    控制视频会议数据展示模块,用于控制所述第二视频会议设备和/或第一视频会议设备解析第一对应的视频会议数据和/或第二视频会议数据,以展示所述第一视频会议数据和/或第二视频会议数据对应的视频会议内容。The control video conference data display module is used to control the second video conference device and/or the first video conference device to parse the first corresponding video conference data and/or the second video conference data to display the first video conference The data and/or the video conference content corresponding to the second video conference data.
  9. 一种计算机设备,所述计算机设备包括存储器、处理器以及存储在所述存储器上并可在所述处理器上运行的计算机程序,其特征于,所述处理器执行所述计算机程序时执行以下步骤:A computer device comprising a memory, a processor, and a computer program stored on the memory and running on the processor, characterized in that the processor executes the following when the computer program is executed step:
    建立第一视频会议设备和网络设备的第一连接,生成第一连接信息,所述第一连接信息包括所述第一视频会议设备的连接用户信息和所述第一视频会议设备中本地媒体的媒体流描述;A first connection between the first video conference device and the network device is established, and first connection information is generated. The first connection information includes the connected user information of the first video conference device and the information of the local media in the first video conference device. Media stream description;
    根据所述第一连接信息建立所述网络设备和第二视频会议设备的第二连接;Establishing a second connection between the network device and the second video conference device according to the first connection information;
    通过所述第一连接和所述第二连接获取所述第一视频会议设备第一视频会议数据和/或所述第二视频会议设备的第二视频会议数据;Acquiring first video conference data of the first video conference device and/or second video conference data of the second video conference device through the first connection and the second connection;
    将所述第一视频会议数据转换成所述第二视频会议设备对应的解析格式,和/或将第二视频会议数据转换成所述第一视频会议设备对应的解析格式;Converting the first video conference data into an analytic format corresponding to the second video conference device, and/or converting the second video conference data into an analytic format corresponding to the first video conference device;
    控制所述第二视频会议设备和/或第一视频会议设备解析第一视频会议数据和/或第二视频会议数据,以展示所述第一视频会议数据和/或第二视频会议数据对应的视频会议内容。Control the second video conference device and/or the first video conference device to parse the first video conference data and/or the second video conference data to display the data corresponding to the first video conference data and/or the second video conference data Video conference content.
  10. 根据权利要求9所述的计算机设备,其中,所述处理器执行所述计算机可读指令时执行以下步骤:The computer device according to claim 9, wherein the processor executes the following steps when executing the computer readable instruction:
    传输所述第一视频会议设备获取的第一格式视频会议数据至所述网络设备,或通过所述第二连接传输所述第二视频会议设备获取的第二格式视频会议数据至所述网络设备;Transmit the video conference data in the first format obtained by the first video conference device to the network device, or transmit the video conference data in the second format obtained by the second video conference device to the network device through the second connection ;
    所述将所述第一视频会议数据转换成所述第二视频会议设备对应的解析格式,和/或将第二视频会议数据转换成所述第一视频会议设备对应的解析格式包括:The converting the first video conference data into an analytical format corresponding to the second video conference device, and/or converting the second video conference data into an analytical format corresponding to the first video conference device includes:
    将所述第一格式视频会议数据转换成第二格式视频会议数据并发送给第二视频会议设备,或将所述第二格式视频会议数据转换成第一格式视频会议数据并发送给第一视频会议设备。Convert the video conference data in the first format into video conference data in the second format and send it to a second video conference device, or convert the video conference data in the second format into video conference data in the first format and send it to the first video Conference equipment.
  11. 根据权利要求10所述的计算机设备,其中,所述处理器执行所述计算机可读指令时执行以下步骤:The computer device according to claim 10, wherein the processor executes the following steps when executing the computer readable instruction:
    将所述第一格式视频会议数据加密后发送至所述网络设备;Encrypt the video conference data in the first format and send it to the network device;
    所述将所述第一格式视频会议数据转换成第二格式视频会议数据并发送给第二视频会议设备包括:The converting the video conference data in the first format into the video conference data in the second format and sending to the second video conference device includes:
    解密所述第一格式视频会议数据发送至所述第二格式视频会议设备。Decrypt the video conference data in the first format and send it to the video conference device in the second format.
  12. 根据权利要求10所述的计算机设备,其中,所述处理器执行所述计算机可读指令时执行以下步骤:The computer device according to claim 10, wherein the processor executes the following steps when executing the computer readable instruction:
    将所述第二格式视频会议数据加密后发送至所述网络设备;Encrypting the second format video conference data and sending it to the network device;
    所述第二格式视频会议数据转换成第一格式视频会议数据并发送给第一视频会议设备包括:The conversion of the second format video conference data into the first format video conference data and sending to the first video conference device includes:
    解密所述第二格式视频会议数据发送至所述第一格式视频会议设备。Decrypt the second format video conference data and send it to the first format video conference device.
  13. 根据权利要求9所述的计算机设备,其中,所述处理器执行所述计算机可读指令时执行以下步骤:The computer device according to claim 9, wherein the processor executes the following steps when executing the computer readable instruction:
    将解密后的第一格式视频会议数据或所述第二格式视频会议数据分离成音频流压缩编码数据和视频流压缩编码数据;Separating the decrypted video conference data in the first format or the video conference data in the second format into audio stream compression coded data and video stream compression coded data;
    将所述音频流压缩编码数据和所述视频流压缩编码数据解码为非压缩的音频原始数据和非压缩视频原始数据;Decoding the audio stream compressed and encoded data and the video stream compressed and encoded data into uncompressed audio raw data and uncompressed video raw data;
    同步所述非压缩的音频原始数据和所述非压缩视频原始数据,并将所述非压缩的音频原始数据和所述非压缩视频原始数据发送给第一视频会议设备或第二视频会议设备。The uncompressed audio raw data and the uncompressed video raw data are synchronized, and the uncompressed audio raw data and the uncompressed video raw data are sent to the first video conference device or the second video conference device.
  14. 根据权利要求9所述的计算机设备,其中,所述处理器执行所述计算机可读指令时执行以下步骤:The computer device according to claim 9, wherein the processor executes the following steps when executing the computer readable instruction:
    控制第一视频会议设备向网络设备发送验证信息;Controlling the first video conference device to send verification information to the network device;
    当所述验证信息满足预设条件时建立第一视频会议设备和网络设备的第一连接。When the verification information meets the preset condition, a first connection between the first video conference device and the network device is established.
  15. 一种计算机可读存储介质,其中,所述计算机可读存储介质内存储有计算机可读指令,所述计算机可读指令可被至少一个处理器所执行,以使所述至少一个处理器执行以下步骤:A computer-readable storage medium, wherein computer-readable instructions are stored in the computer-readable storage medium, and the computer-readable instructions can be executed by at least one processor, so that the at least one processor executes the following step:
    建立第一视频会议设备和网络设备的第一连接,生成第一连接信息,所述第一连接信息包括所述第一视频会议设备的连接用户信息和所述第一视频会议设备中本地媒体的媒体流描述;A first connection between the first video conference device and the network device is established, and first connection information is generated. The first connection information includes the connected user information of the first video conference device and the information of the local media in the first video conference device. Media stream description;
    根据所述第一连接信息建立所述网络设备和第二视频会议设备的第二连接;Establishing a second connection between the network device and the second video conference device according to the first connection information;
    通过所述第一连接和所述第二连接获取所述第一视频会议设备第一视频会议数据和/或所述第二视频会议设备的第二视频会议数据;Acquiring first video conference data of the first video conference device and/or second video conference data of the second video conference device through the first connection and the second connection;
    将所述第一视频会议数据转换成所述第二视频会议设备对应的解析格式,和/或将第二视频会议数据转换成所述第一视频会议设备对应的解析格式;Converting the first video conference data into an analytic format corresponding to the second video conference device, and/or converting the second video conference data into an analytic format corresponding to the first video conference device;
    控制所述第二视频会议设备和/或第一视频会议设备解析第一视频会议数据和/或第二视频会议数据,以展示所述第一视频会议数据和/或第二视频会议数据对应的视频会议内容。Control the second video conference device and/or the first video conference device to parse the first video conference data and/or the second video conference data to display the data corresponding to the first video conference data and/or the second video conference data Video conference content.
  16. 根据权利要求15所述的计算机可读存储介质,其中,所述至少一个处理器执行以下步骤:The computer-readable storage medium of claim 15, wherein the at least one processor performs the following steps:
    传输所述第一视频会议设备获取的第一格式视频会议数据至所述网络设备,或通过所述第二连接传输所述第二视频会议设备获取的第二格式视频会议数据至所述网络设备;Transmit the video conference data in the first format obtained by the first video conference device to the network device, or transmit the video conference data in the second format obtained by the second video conference device to the network device through the second connection ;
    所述将所述第一视频会议数据转换成所述第二视频会议设备对应的解析格式,和/或将第二视频会议数据转换成所述第一视频会议设备对应的解析格式包括:The converting the first video conference data into an analytical format corresponding to the second video conference device, and/or converting the second video conference data into an analytical format corresponding to the first video conference device includes:
    将所述第一格式视频会议数据转换成第二格式视频会议数据并发送给第二视频会议设备,或将所述第二格式视频会议数据转换成第一格式视频会议数据并发送给第一视频会议设备。Convert the video conference data in the first format into video conference data in the second format and send it to a second video conference device, or convert the video conference data in the second format into video conference data in the first format and send it to the first video Conference equipment.
  17. 根据权利要求16所述的计算机可读存储介质,其中,所述至少一个处理器执行以下步骤:The computer-readable storage medium of claim 16, wherein the at least one processor performs the following steps:
    将所述第一格式视频会议数据加密后发送至所述网络设备;Encrypt the video conference data in the first format and send it to the network device;
    所述将所述第一格式视频会议数据转换成第二格式视频会议数据并发送给第二视频会议设备包括:The converting the video conference data in the first format into the video conference data in the second format and sending to the second video conference device includes:
    解密所述第一格式视频会议数据发送至所述第二格式视频会议设备。Decrypt the video conference data in the first format and send it to the video conference device in the second format.
  18. 根据权利要求16所述的计算机可读存储介质,其中,所述至少一个处理器执行以下步骤:The computer-readable storage medium of claim 16, wherein the at least one processor performs the following steps:
    将所述第二格式视频会议数据加密后发送至所述网络设备;Encrypting the second format video conference data and sending it to the network device;
    所述第二格式视频会议数据转换成第一格式视频会议数据并发送给第一视频会议设备包括:The conversion of the second format video conference data into the first format video conference data and sending to the first video conference device includes:
    解密所述第二格式视频会议数据发送至所述第一格式视频会议设备。Decrypt the second format video conference data and send it to the first format video conference device.
  19. 根据权利要求15所述的计算机可读存储介质,其中,所述至少一个处理器执行以下步骤:The computer-readable storage medium of claim 15, wherein the at least one processor performs the following steps:
    将解密后的第一格式视频会议数据或所述第二格式视频会议数据分离成音频流压缩编码数据和视频流压缩编码数据;Separating the decrypted video conference data in the first format or the video conference data in the second format into audio stream compression coded data and video stream compression coded data;
    将所述音频流压缩编码数据和所述视频流压缩编码数据解码为非压缩的音频原始数据和非压缩视频原始数据;Decoding the audio stream compressed and encoded data and the video stream compressed and encoded data into uncompressed audio raw data and uncompressed video raw data;
    同步所述非压缩的音频原始数据和所述非压缩视频原始数据,并将所述非压缩的音频原始数据和所述非压缩视频原始数据发送给第一视频会议设备或第二视频会议设备。The uncompressed audio raw data and the uncompressed video raw data are synchronized, and the uncompressed audio raw data and the uncompressed video raw data are sent to the first video conference device or the second video conference device.
  20. 根据权利要求15所述的计算机可读存储介质,其中,所述至少一个处理器执行以下步骤:The computer-readable storage medium of claim 15, wherein the at least one processor performs the following steps:
    控制第一视频会议设备向网络设备发送验证信息;Controlling the first video conference device to send verification information to the network device;
    当所述验证信息满足预设条件时建立第一视频会议设备和网络设备的第一连接。When the verification information meets the preset condition, a first connection between the first video conference device and the network device is established.
PCT/CN2020/099236 2019-10-16 2020-06-30 Video conference method, apparatus and device, and storage medium WO2021073155A1 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201910983269.9 2019-10-16
CN201910983269.9A CN110798651A (en) 2019-10-16 2019-10-16 Video conference method, device, equipment and storage medium

Publications (1)

Publication Number Publication Date
WO2021073155A1 true WO2021073155A1 (en) 2021-04-22

Family

ID=69440336

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2020/099236 WO2021073155A1 (en) 2019-10-16 2020-06-30 Video conference method, apparatus and device, and storage medium

Country Status (2)

Country Link
CN (1) CN110798651A (en)
WO (1) WO2021073155A1 (en)

Families Citing this family (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110798651A (en) * 2019-10-16 2020-02-14 平安科技(深圳)有限公司 Video conference method, device, equipment and storage medium
CN111953925A (en) * 2020-08-21 2020-11-17 浙江华创视讯科技有限公司 Media stream processing method, device and system
CN113709405A (en) * 2021-10-27 2021-11-26 深圳市鹏创软件有限公司 Video conference fusion method, system, bridge terminal and readable storage medium

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101986696A (en) * 2010-11-30 2011-03-16 上海华平信息技术股份有限公司 Information transfer equipment and video conference system
US20130239025A1 (en) * 2009-10-21 2013-09-12 At&T Intellectual Property I, L.P. Method and apparatus for providing a collaborative workspace
CN106331581A (en) * 2015-07-06 2017-01-11 北京视联动力国际信息技术有限公司 Method and device for communication between mobile terminal and video networking terminal
CN108234421A (en) * 2016-12-21 2018-06-29 北京视联动力国际信息技术有限公司 It is a kind of to regard networked terminals and the method and system of internet terminal audio data intercommunication
CN110798651A (en) * 2019-10-16 2020-02-14 平安科技(深圳)有限公司 Video conference method, device, equipment and storage medium

Family Cites Families (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN100505864C (en) * 2005-02-06 2009-06-24 中兴通讯股份有限公司 Multi-spot video conference system and media processing method
CN101938624A (en) * 2010-08-31 2011-01-05 中山大学 Multipoint safe videoconference system with IP set-top box based on H.323 protocol
WO2014134820A1 (en) * 2013-03-08 2014-09-12 华为终端有限公司 Video communication method, home terminal and home server
CN104506793B (en) * 2015-01-16 2018-04-27 东北大学 A kind of security video conference system and method based on internet
CN107846379B (en) * 2016-09-18 2021-09-07 中兴通讯股份有限公司 Port multiplexing method and server in video conference system
CN106998439A (en) * 2017-03-23 2017-08-01 中国南方电网有限责任公司 A kind of gateway system for merging conventional video conference system with WEBRTC and method
CN109688364A (en) * 2018-08-21 2019-04-26 平安科技(深圳)有限公司 Video-meeting method, device, server and storage medium
CN109788072A (en) * 2019-03-07 2019-05-21 杭州当虹科技股份有限公司 A method of standard Webrtc client is accessed into existing system

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20130239025A1 (en) * 2009-10-21 2013-09-12 At&T Intellectual Property I, L.P. Method and apparatus for providing a collaborative workspace
CN101986696A (en) * 2010-11-30 2011-03-16 上海华平信息技术股份有限公司 Information transfer equipment and video conference system
CN106331581A (en) * 2015-07-06 2017-01-11 北京视联动力国际信息技术有限公司 Method and device for communication between mobile terminal and video networking terminal
CN108234421A (en) * 2016-12-21 2018-06-29 北京视联动力国际信息技术有限公司 It is a kind of to regard networked terminals and the method and system of internet terminal audio data intercommunication
CN110798651A (en) * 2019-10-16 2020-02-14 平安科技(深圳)有限公司 Video conference method, device, equipment and storage medium

Also Published As

Publication number Publication date
CN110798651A (en) 2020-02-14

Similar Documents

Publication Publication Date Title
CN110213652B (en) Audio and video data transmission method and device and storage medium
US7266611B2 (en) Method and system for improved transcoding of information through a telecommunication network
EP2779579B1 (en) Method and apparatuses for realizing voip call in cloud computing environment
WO2021073155A1 (en) Video conference method, apparatus and device, and storage medium
CN106850399B (en) Communication method based on WebRTC technology instant message
CN105554029A (en) Method for realizing media intercommunication between WebRTC terminal and SIP terminal and media gateway
JP2004534424A (en) Method and system for transcoding video and audio signals
JP2015512172A (en) Bidirectional tunneling via user input back channel for wireless display
US10523730B2 (en) Real-time transport protocol (RTP) media conference server routing engine
EP3059945A1 (en) Method and system for video surveillance content adaptation, and central server and device
EP3515032B1 (en) Port multiplexing method and server in video conference system and computer storage medium
US9332049B1 (en) Media compression for tunneled real-time communications
WO2010083737A1 (en) Method and apparatus for processing voice signal, method and apparatus for transmitting voice signal
CN115334273A (en) Protocol conversion audio and video communication method and system
KR102064284B1 (en) Device, system, and method to perform real-time communication
CN103151041B (en) A kind of implementation method of automatic speech recognition business, system and media server
WO2015078220A1 (en) Method and device for media multiplexing negotiation
US20060133372A1 (en) Apparatus and method for multiplexing packet in mobile communication network
CN113301025B (en) IMS audio and video transcoding and transmission control system and implementation method
CN102137093A (en) Method for processing media stream and media gateway
WO2012174908A1 (en) Method, device and system for realizing audio transcoding of text to speech
WO2017152566A1 (en) Method for negotiating media coding/decoding, and terminal device
CN114978485B (en) Voice data transmission method, system, electronic equipment and storage medium
CN114710568B (en) Audio and video data communication method, device and storage medium
ES2264980T3 (en) METHOD, GATE SYSTEM AND DISPOSITION IN A COMMUNICATION NETWORK.

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 20875949

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 20875949

Country of ref document: EP

Kind code of ref document: A1